Method and system for audio feedback during live broadcast and non-transitory computer-readable recording medium

Abstract

To provide a method, system and non-transitory computer-readable recording medium for audio feedback during a live broadcast.SOLUTION: A method implemented on a computer system includes providing a live broadcast by receiving broadcast content transmitted from an electronic device of a caster, and by streaming the received broadcast content to electronic devices of multiple users through a communication session established between an account of the caster and accounts of the users; receiving audio feedback about the live broadcast from an electronic device of a user during the live broadcast; and delivering the audio feedback to the electronic device of the caster.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The following description relates to a technique for transmitting viewer feedback to a caster during a live broadcast. [Background technology]

[0002] In recent years, media clients, including live broadcast clients, have been growing rapidly.

[0003] Casters can upload live broadcasts to channels through their media clients, and viewers can freely watch the live broadcasts uploaded by casters through their media clients.

[0004] For example, Patent Document 1 (published on November 27, 2006) discloses a live streaming broadcasting method for broadcasting live over a network. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Korean Patent Publication No. 10-2006-0120571 Summary of the Invention [Problem to be solved by the invention]

[0006] To provide a technology that enables viewers to directly transmit voice feedback to a newscaster during live broadcasting.

[0007] To provide a technology that enables a caster during live broadcasting to immediately hear the audio feedback of viewers without performing any special operation. [Means for solving the problem]

[0008] A method executed on a computer system, the computer system including at least one processor configured to execute computer-readable instructions contained in a memory, the method including: providing a live broadcast by receiving broadcast content sent from an electronic device of a presenter in a communication session established between the presenter's account and multiple user accounts and streaming the broadcast content to the electronic devices of the users; and receiving, during the live broadcast, audio feedback for the live broadcast from the electronic devices of the users and transmitting the audio feedback to the electronic device of the presenter.

[0009] According to one aspect, the transmitting step includes activating a voice channel between the anchor's account and the user's account when an audio input signal is received from the user's electronic device, receiving a voice message from the user's electronic device in real time, and transmitting the voice message to the anchor's electronic device.

[0010] In another aspect, the transmitting step includes activating a voice channel of a push to talk (PTT) method or a voice call method in response to a voice input signal of the user's electronic device.

[0011] According to another aspect, the transmitting step includes receiving a voice message in the form of a recording file from the user's electronic device and transmitting the voice message to the anchor's electronic device.

[0012] According to another aspect, the audio feedback is output immediately to an audio output interface of the caster's electronic device immediately after receiving it.

[0013] According to another aspect, the transmitting step includes determining whether to allow the voice feedback of the user according to a broadcast environment setting of the anchor.

[0014] According to another aspect, the transmitting step includes determining whether to accept the user's voice feedback based on the user's feedback history.

[0015] According to another aspect, the transmitting step includes determining whether to share the audio feedback with the plurality of users according to a broadcast environment setting of the anchor.

[0016] According to another aspect, the providing step includes providing a function for applying at least one of an effect and a filter to an image of the broadcast content.

[0017] According to yet another aspect, the method further includes the at least one processor storing the broadcast content and the audio feedback in association with a chat room corresponding to the communication session.

[0018] A non-transitory computer-readable recording medium is provided, which has recorded thereon a program for causing a computer to execute the method.

[0019] Provided is a computer system including at least one processor configured to execute computer-readable instructions contained in a memory, the at least one processor comprising: a live broadcast providing unit that provides a live broadcast by receiving broadcast content sent from a caster's electronic device and streaming it to the users' electronic devices in a communication session established between the caster's account and multiple users' accounts; and a feedback transmitting unit that receives audio feedback on the live broadcast from the users' electronic devices during the live broadcast and transmits it to the caster's electronic device. [Brief explanation of the drawings]

[0020] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram illustrating the internal configuration of an electronic device and a server according to an embodiment of the present invention. [Figure 3] FIG. 2 is a block diagram illustrating example components that a processor of a server may include in one embodiment of the present invention. [Figure 4] 1 is a flowchart illustrating an example method that may be performed by a server in one embodiment of the present invention. [Figure 5] FIG. 10 is a diagram showing an example of a chat room screen displayed on an electronic device of a viewer watching a live broadcast in one embodiment of the present invention. [Figure 6] FIG. 10 is a diagram showing an example of a chat room screen displayed on an electronic device of a viewer watching a live broadcast in one embodiment of the present invention. [Figure 7] FIG. 10 is a diagram showing an example of a chat room screen displayed on an electronic device of a viewer watching a live broadcast in one embodiment of the present invention. [Figure 8] FIG. 10 is a diagram showing an example of a chat room screen displayed on an electronic device of a viewer watching a live broadcast in one embodiment of the present invention. [Figure 9] FIG. 10 is a diagram showing an example of a chat room screen displayed on the electronic device of a caster who is conducting a live broadcast in one embodiment of the present invention. [Figure 10] FIG. 10 is a diagram showing an example of a chat room screen displayed on the electronic device of a caster who is conducting a live broadcast in one embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0021] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0022] The live broadcast providing method according to an embodiment of the present invention may be executed by a computer device such as an electronic device or a server described below. In this case, a computer program according to an embodiment of the present invention may be installed and run on the computer device, and the computer device may execute the live broadcast providing method according to an embodiment of the present invention under the control of the run computer program. The computer program may be stored on a computer-readable recording medium in combination with the computer device to cause the computer to execute the live broadcast providing method. For example, the server may provide a live broadcast streaming service based on a social networking service (SNS) (e.g., messenger) that allows group chats and group calls via the Internet, and may transmit viewer feedback in real time to a live broadcast host.

[0023] Fig. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in Fig. 1 shows an example including multiple electronic devices 110, 120, 130, and 140, multiple servers 150 and 160, and a network 170. Fig. 1 is merely an example for explaining the present invention, and the number of electronic devices and the number of servers are not limited to those shown in Fig. 1.

[0024] The electronic devices 110, 120, 130, and 140 may be fixed or mobile terminals implemented by computers. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, game consoles, wearable devices, internet of things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. While FIG. 1 illustrates the electronic device 1 (110) in the form of a smartphone, in embodiments of the present invention, the electronic device 1 (110) may represent one of a variety of physical computer devices capable of communicating with other electronic devices 120, 130, and 140 and / or servers 150 and 160 via a network 170 using a substantially wireless or wired communication method.

[0025] The communication method is not limited, and may include not only communication methods utilizing communication networks (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, and a satellite network) that can be included in network 170, but also short-range wireless communication between devices. For example, network 170 may include any one or more of networks such as a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), and the Internet. Furthermore, network 170 may include any one or more of network topologies including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree network, or a hierarchical network.

[0026] Each of the servers 150 and 160 may be realized by a computer device or multiple computer devices that communicate with the multiple electronic devices 110, 120, 130, and 140 via the network 170 and provide instructions, code, files, content, services, etc. For example, the server 150 may be a system that provides a first service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170, and the server 160 may be a system that provides a second service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, the server 150 may provide a service (e.g., a live broadcast streaming service) targeted by an application as a computer program installed and running on the multiple electronic devices 110, 120, 130, and 140 as a first service to the multiple electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide, as a second service, a service of distributing files for installing and running the above-mentioned applications to the plurality of electronic devices 110, 120, 130, and 140.

[0027] 2 is a block diagram illustrating the internal configuration of an electronic device and a server according to an embodiment of the present invention. In FIG. 2, the internal configuration of electronic device 1 (110) is illustrated as an example of an electronic device, and the internal configuration of server 150 is illustrated as an example of a server. In addition, other electronic devices 120, 130, 140 and server 160 may have the same or similar internal configuration as the electronic device 1 (110) or server 150 described above.

[0028] The electronic device 1 (110) and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223, and input / output interfaces 214 and 224. The memories 211 and 221 are non-transitory computer-readable recording media and may include random access memory (RAM), read only memory (ROM), and permanent mass storage devices such as disk drives, solid state drives (SSDs), flash memory, etc. Here, permanent mass storage devices such as ROMs, SSDs, flash memory, and disk drives may be included in the electronic device 1 (110) or the server 150 as permanent storage devices separate from the memories 211 and 221. The memories 211 and 221 may also store an operating system and at least one program code (for example, code for a browser installed and run on the electronic device 1 (110) or an application installed on the electronic device 1 (110) to provide a particular service). Such software components may be loaded from a computer-readable recording medium separate from the memories 211, 221. Such separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, or a memory card. In other embodiments, the software components may be loaded into the memories 211, 221 through a communication module 213, 223 that is not a computer-readable recording medium. For example, at least one program may be loaded into the memories 211, 221 based on a program (such as the above-mentioned application) to be installed by a file provided over the network 170 by a developer or a file distribution system that distributes application installation files (such as the above-mentioned server 160).

[0029] The processors 212, 222 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processors 212, 222 by the memories 211, 221 or the communication modules 213, 223. For example, the processors 212, 222 may be configured to execute instructions received according to program code stored in a storage device such as the memories 211, 221.

[0030] The communication modules 213 and 223 may provide a function for the electronic device 1 (110) and the server 150 to communicate with each other via the network 170, or may provide a function for the electronic device 1 (110) and / or the server 150 to communicate with other electronic devices (for example, the electronic device 2 (120)) or other servers (for example, the server 160). For example, a request generated by the processor 212 of the electronic device 1 (110) in accordance with program code stored in a recording device such as the memory 211 may be transmitted to the server 150 via the network 170 under the control of the communication module 213. Conversely, control signals, instructions, content, files, etc. provided under the control of the processor 222 of the server 150 may be received by the electronic device 1 (110) via the communication module 213 of the electronic device 1 (110) via the communication module 223 and the network 170. For example, control signals, instructions, content, files, etc. from the server 150 received through the communication module 213 may be transmitted to the processor 212 or memory 211, and the content, files, etc. may be stored in a storage medium (the permanent storage device described above) that the electronic device 1 (110) may further include.

[0031] The input / output interface 214 may be a means for interfacing with the input / output device 215. For example, the input device may include a keyboard, a mouse, a microphone, a camera, etc., and the output device may include a display, a speaker, a haptic feedback device, etc. As another example, the input / output interface 214 may be a means for interfacing with a device that integrates input and output functions into one, such as a touchscreen. The input / output device 215 may be configured as a single device together with the electronic device 1 (110). Furthermore, the input / output interface 224 of the server 150 may be a means for interfacing with an input or output device (not shown) that may be connected to or included in the server 150. As a more specific example, when the processor 212 of the electronic device 1 (110) processes instructions of a computer program loaded into the memory 211, a service screen or content configured using data provided by the server 150 or the electronic device 2 (120) may be displayed on a display via the input / output interface 214.

[0032] In other embodiments, the electronic device 1 (110) and the server 150 may include more components than those shown in FIG. 2 . However, it is not necessary to clearly illustrate most of the conventional components. For example, the electronic device 1 (110) may be implemented to include at least some of the input / output devices 215 described above, and may further include other components such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, etc. As a more specific example, if the electronic device 1 (110) is a smartphone, the electronic device 1 (110) may further include various components typically included in a smartphone, such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, buttons using a touch panel, input / output ports, a vibrator for vibration, etc.

[0033] Specific embodiments of a method and system for communicating viewer feedback to a presenter during a live broadcast are described below.

[0034] A live broadcast streaming service provides live broadcasts through group chat rooms in which multiple users participate. In the chat room where the broadcast is taking place, viewers can use reaction buttons (like, angry, sad, etc.), emojis, stamps, etc., or create text-based messages while watching the broadcast, allowing viewers' feedback to be conveyed to the anchor who is hosting the live broadcast.

[0035] Much of the viewer feedback on live broadcasts tends to rely on text messages, but viewers who have difficulty sending text messages or who prefer voice communication can find it difficult or inconvenient to convey their feedback to the anchor.

[0036] Therefore, by providing a function in a live broadcast streaming service that allows viewers to transmit audio feedback to the anchor in real time, it is possible to provide convenience not only for viewers but also for anchors, who can check viewer feedback by audio in an environment where it is difficult to check text messages.

[0037] FIG. 3 is a block diagram illustrating example components that may be included in a processor of a server in one embodiment of the present invention, and FIG. 4 is a flowchart illustrating an example method that may be performed by a server in one embodiment of the present invention.

[0038] The server 150 according to the present embodiment serves as a platform for providing a live broadcast streaming service to a plurality of electronic devices 110, 120, 130, and 140, which are clients. The server 150 provides the live broadcast streaming service in conjunction with applications installed on the electronic devices 110, 120, 130, and 140, and allows viewers to immediately provide voice feedback to the anchor during the live broadcast.

[0039] In order for server 150 to perform the live broadcast providing method shown in Fig. 4, processor 222 of server 150 may include components including live broadcast providing unit 310 and feedback transmitting unit 320, as shown in Fig. 3. Depending on the embodiment, the components of processor 222 may be selectively included or excluded from processor 222. Also, depending on the embodiment, the components of processor 222 may be separated or combined to express the functions of processor 222.

[0040] The processor 222 and the components of the processor 222 may control the server 150 to execute steps 410 to 440 included in the live broadcast providing method of Fig. 4. For example, the processor 222 and the components of the processor 222 may be implemented to execute instructions according to the code of an operating system and the code of at least one program contained in the memory 221.

[0041] Here, the components of the processor 222 may be representations of different functions of the processor 222 that are executed by the processor 222 according to instructions provided by the program code stored in the server 150. For example, a live broadcast providing unit 310 may be used as a functional representation of the processor 222 that controls the server 150 according to the instructions described above so that the server 150 provides a live broadcast.

[0042] In step 410, the processor 222 can read necessary instructions from the memory 221 loaded with instructions related to the control of the server 150. In this case, the read instructions may include instructions for controlling the processor 222 to execute steps 420 to 440 described below.

[0043] In step 420, the live broadcast providing unit 310 may provide a live broadcast by receiving broadcast content transmitted from the anchor's electronic device through a communication session established between the anchor's account and a plurality of viewer accounts and streaming the broadcast content to the viewer's electronic device in real time. The live broadcast providing unit 310 may provide a live broadcast streaming service based on a social networking service (e.g., messenger), in which broadcast content including the anchor's video and audio is transmitted to the viewer in one-way real time. For example, the live broadcast providing unit 310 may provide the live broadcast streaming service through a social networking chat room, i.e., a chat room corresponding to a communication session established between the anchor's account and the viewer's account. In this case, the live broadcast providing unit 310 may provide the anchor's live broadcast to viewers selected by the anchor. For example, the live broadcast providing unit 310 may allow targets selected from a social networking chat room list or friend list stored on the anchor's electronic device to join the chat room for the anchor's live broadcast and provide the corresponding broadcast content.

[0044] In step 430, when a voice input signal is received from the electronic device of one of the viewers watching the anchor's live broadcast, the feedback transmitting unit 320 may activate a voice channel between the anchor and the viewer. This is to switch a one-way service channel to a two-way one in order to transmit the viewer's voice feedback to the anchor during the anchor's live broadcast. For voice feedback, a voice channel using a PTT (push to talk) method such as a walkie-talkie or a voice call method may be supported. For example, if a viewer selects an interface for voice input in a chat room where the anchor's live broadcast is in progress, the feedback transmitting unit 320 may open a voice call channel between the anchor and the viewer according to the selection signal.

[0045] In step 440, the feedback transmission unit 320 may receive voice feedback input by a viewer from the viewer's electronic device during the live broadcast and transmit it to the anchor's electronic device. The feedback transmission unit 320 may receive the viewer's voice message in real time and immediately transmit it to the anchor by activating an audio channel between the anchor and the viewer, thereby allowing the anchor to immediately hear the viewer's voice message in the chat room where the live broadcast is in progress without performing any special operation or confirmation procedure. The form of the voice feedback may be, but is not limited to, a real-time transmission method such as a walkie-talkie or voice call, and may also be provided in the form of a recorded file. In other words, the feedback transmission unit 320 may receive a voice message in the form of a recorded file from the viewer's electronic device and transmit it to the anchor's electronic device. In the chat room where the live broadcast is in progress, the received recorded file can be automatically played or played upon the anchor's request, allowing the anchor to check the voice message sent by the viewer. The viewer's audio feedback is provided directly to the anchor during the live broadcast, but in another example, it may be provided in a form that is shared by all users participating in the chat room where the anchor's live broadcast is in progress.

[0046] 5 to 8 are diagrams showing examples of chat room screens displayed on electronic devices of viewers watching a live broadcast in one embodiment of the present invention.

[0047] 5 shows an example of a chat room screen 500 displayed on a viewer's electronic device. A dedicated application installed on the electronic device can display a live broadcast screen 510 hosted by a caster as the chat room screen 500 in which viewers and casters participate. As an example, the live broadcast screen 510 with a predetermined screen ratio may be displayed on the chat room screen 500 in a fixed format, i.e., embedded format, at the top of the chat room screen 500.

[0048] This is merely an example, and the live broadcast screen 510 may be displayed in various modes other than the display mode of FIG. 5, such as a full screen mode or a PIP (picture in picture) mode.

[0049] Therefore, viewers can watch the newscaster's live broadcast in real time through a live broadcast screen 510 displayed on a chat room screen 500 of a dedicated application installed on an electronic device.

[0050] The chat room screen 500 may include a feedback input menu so that viewers can input feedback for the live broadcast while watching the broadcast. In this case, the feedback input menu may include a text input menu 501 for inputting a text-based message, an image input menu 502 for inputting various image-based feedback such as stamps and emoticons, etc., and may particularly include a voice input menu 503 for inputting a voice message as viewer feedback for the live broadcast.

[0051] Referring to FIG. 6, in a dedicated application installed on an electronic device, when a viewer selects a text input menu 501 on a chat room screen 500 while watching a live broadcast, a virtual keyboard 620 for text input is executed on the chat room screen 500, and the text message entered by the viewer using the virtual keyboard 620 may be sent to the anchor via the server 150.

[0052] Referring to FIG. 7, in a dedicated application installed on an electronic device, when a viewer selects image input menu 502 on chat room screen 500 while watching a live broadcast, an image list 730 of stamps, emoticons, etc. is displayed on chat room screen 500, and the image selected by the viewer using image list 730 may be transmitted to the anchor via server 150.

[0053] 8, in the dedicated application installed on the electronic device, when a viewer selects the voice input menu 503 on the chat room screen 500 while watching a live broadcast, an activated state 840 of the voice input interface is displayed on the chat room screen 500, and a voice message input by the viewer in the activated state 840 of the voice input interface may be transmitted to the anchor via the server 150. In this case, when a viewer selects the voice input menu 503 on the chat room screen 500, the feedback transmission unit 320 may receive the selection signal as the viewer's voice input signal, activate a voice channel between the anchor and the viewer according to the voice input signal, and receive the viewer's voice message in real time to immediately transmit it to the anchor.

[0054] In a typical live broadcasting environment, viewers have no way to directly transmit voices to the anchor, and are limited to relying on text-based feedback. However, in the present embodiment, for users who find it cumbersome or difficult to input text or users who prefer voice communication, and to provide a feedback environment optimized for live broadcasting, a live broadcast streaming service may be provided that includes a function for viewers to directly transmit voices to the anchor during the live broadcast.

[0055] Therefore, in a live broadcast streaming service, viewers can be provided with the ability to transmit audio to the anchor in real time, and as viewer feedback on the anchor's live broadcast, they can transmit not only text messages and images (stamps, emojis, etc.), but also audio messages for viewers who find it tedious or difficult to input text or images.

[0056] Whether or not the text input menu 501, image input menu 502, and voice input menu 503 described with reference to FIGS. 5 to 8 are displayed on the chat room screen 500 may be determined according to the settings of the anchor who is conducting the live broadcast. For example, if the anchor sets the broadcast environment settings to allow only voice feedback among the viewer feedback types, the text input menu 501 and image input menu 502 are not displayed on the chat room screen 500 for viewing the live broadcast, and only the voice input menu 503 is selectively displayed. As another example, the display of at least one of the text input menu 501, image input menu 502, and voice input menu 503 may be automatically determined based on the viewer's personal information (e.g., age, etc.), viewing environment (e.g., whether or not they can move, their location, time, etc.), feedback history, etc. For example, if the viewer is on the move or if voice feedback is most important, the voice input menu 503 may be displayed on the chat room screen 500 for viewing the live broadcast.

[0057] Viewer feedback (text messages, images, audio messages) for a live broadcast may be transmitted only to the anchor who is hosting the broadcast, or in other cases, may be transmitted to all users (the anchor and all viewers) participating in the chat room where the live broadcast is in progress.

[0058] The server 150 (i.e., the processor 222) may store live broadcast content together with information about chat rooms (including anchor information and viewer information) in a database system (not shown) included in the server 150 or capable of interfacing with the server 150, and may also store feedback (text messages, images, voice messages) received from viewers for each broadcast content. Viewer feedback may also be stored in the local area of ​​at least one of the anchor and viewer clients. Even after the live broadcast has ended, a function may be provided that allows the anchor or viewer to review the viewer feedback for the broadcast by reading it from the server 150 or the local area of ​​the client at their request.

[0059] Therefore, in this embodiment, viewers can directly deliver voice feedback to the anchor during live broadcast, and in this case, the voice feedback can be transmitted in real time via a walkie-talkie or voice call, as well as in the form of a recorded file.

[0060] 9 and 10 are diagrams showing examples of chat room screens displayed on the electronic device of a newscaster who is conducting a live broadcast in one embodiment of the present invention.

[0061] 9 shows an example of a chat room screen 900 displayed on a newscaster's electronic device. A dedicated application installed on the electronic device provides a function for conducting a live broadcast through the chat room screen 900. As an example, the chat room screen 900 of a group formed by a newscaster may include a "Live" menu 901 for providing a live broadcast to all users participating in the chat room.

[0062] When the "Live" menu 901 is selected on the chat room screen 900 of a group that a newscaster has organized for live broadcasting, a broadcast screen 910, which is an image captured by the camera of the newscaster's electronic device, can be displayed on the chat room screen 900.

[0063] The chat room screen 900 may display a broadcast screen 910 with a predetermined screen ratio in a fixed form, i.e., an embedded form, at the top of the chat room screen 900. This is merely an example, and the broadcast screen 910 may be displayed in various forms, such as a full screen mode or a PIP (picture in picture) mode, in addition to the display form of FIG.

[0064] The chat room screen 900 may include a start menu 913 for starting a live broadcast from the camera footage captured on the broadcast screen 910, and may further include an effect menu 911 for applying various effects to the camera footage on the broadcast screen 910, a filter menu 912 for applying various filters to the camera footage on the broadcast screen 910, etc.

[0065] When the anchor selects the start menu 913 on the chat room screen 900, the live broadcast providing unit 310 can provide a live broadcast streaming service using the camera video captured on the broadcast screen 910 to users participating in the corresponding chat room. In other words, the live broadcast providing unit 310 can stream broadcast content sent from the anchor's electronic device to the viewers' electronic devices in real time in a chat room where multiple users selected by the anchor as viewers who will watch the live broadcast are participating.

[0066] In this case, the feedback transmission unit 320 can receive feedback (text messages, images, and voice messages) input by viewers from their electronic devices during the live broadcast and transmit it to the anchor's electronic device. Referring to FIG. 10, the chat room screen 900 includes an interface area 1050 for displaying viewer feedback information regarding the ongoing live broadcast. The viewer feedback may include text feedback 1051 input as a text message and image feedback 1052 input as an image such as a stamp or emoticon. In particular, in this embodiment, voice feedback input as a voice may be included as one of the feedback types.

[0067] In the case of audio feedback, the audio message can be transmitted by a viewer to the on-air anchor during live broadcasting in real time, such as by a walkie-talkie or voice call, or can be provided in the form of a recorded file. A dedicated application installed on the anchor's electronic device can output the audio message from the viewer to the audio output interface of the electronic device immediately after receiving it, allowing the anchor to listen to and check the viewer's audio message in real time without having to perform any special operation or confirmation procedure.

[0068] Unlike text feedback 1051 and image feedback 1052, which are directly expressed as visual information, audio feedback is output from the audio output interface of the anchor's electronic device, not from the chat room screen 900. In this case, the chat room screen 900 may display information 1060 about the viewer who transmitted the audio feedback and audio playback status information 1053, which indicates that an audio message is being output.

[0069] Viewer feedback 1051, 1052, 1053 may be provided only to the chat room screen 900 targeted at the anchor during the live broadcast, but may also be provided in a form that is shared by all users through the chat room screen 500 targeted at viewers watching the live broadcast as well as the anchor's chat room screen 900.

[0070] Whether viewer feedback 1051, 1052, and 1053 are shared with viewers may be determined according to the settings of the anchor who is conducting the live broadcast. In this case, whether to share with viewers may be determined for each feedback type (text feedback, image feedback, and voice feedback). For example, if the anchor allows sharing of text and image feedback among viewer feedback types with viewers but does not allow sharing of voice feedback in the broadcast environment settings, the text and image feedback will be displayed on the chat room screen 500 for all viewers and the anchor's chat room screen 900, and the voice feedback will be output only to the anchor.

[0071] Therefore, in this embodiment, in addition to transmitting viewer feedback as text or images during a live broadcast, a function is provided for transmitting audio as viewer feedback to a newscaster in real time. Viewers who have difficulty writing text can be provided with an environment where they can easily transmit feedback through audio feedback, and similarly, newscasters who have difficulty checking text can be provided with an environment where they can easily and quickly check feedback during the broadcast by immediately outputting audio feedback.

[0072] The above-described devices may be implemented using hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, a single processing device may be described. However, those skilled in the art will understand that a processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0073] Software may include computer programs, codes, instructions, or a combination of one or more of these, which may configure a processing device to operate as desired or may independently or collectively instruct the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored and executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable recording media.

[0074] The method according to the embodiment may be implemented in the form of program instructions executable by various computer means and recorded on a computer-readable medium. In this case, the medium may continuously store the computer-executable program or may temporarily store it for execution or download. The medium may be various recording or storage means in the form of a single piece of hardware or a combination of multiple pieces of hardware. It is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; ROMs, RAMs, flash memories, etc., configured to store program instructions. Other examples of media include recording media or storage media managed by app stores that distribute applications, or by websites or servers that provide or distribute various other software.

[0075] Although the embodiments have been described above based on limited embodiments and drawings, those skilled in the art will appreciate that various modifications and variations may be made in light of the above description. For example, the described techniques may be performed in an order different from that described, and / or the described system, structure, device, circuit, or other element may be combined or combined in a manner different from that described, or may be substituted or replaced by other elements or equivalents, and still achieve suitable results.

[0076] Therefore, different embodiments that are equivalent to the claims are within the scope of the appended claims. [Explanation of symbols]

[0077] 222: Processor 310: Live Broadcasting Department 320: Feedback transmission unit

Claims

1. A program executed by a first electronic device of a first user, distributing content to be viewed by a second user by a control unit of the first electronic device; receiving, by the control unit, feedback based on text input into the second electronic device of the second user; and outputting a sound based on the feedback by the control unit.

2. A program according to claim 1, The program is executed by the control unit to display information about the second user corresponding to the feedback.

3. 3. The program according to claim 2, The program executed by the control unit is to display an object indicating that the audio is being output in association with information about the second user.

4. A program according to any one of claims 1 to 3, The program determines whether to share the audio with the second user based on a setting by the first user.

5. An information processing method for a first electronic device of a first user, comprising: distributing content to be viewed by a second user by a control unit of the first electronic device; receiving, by the control unit, feedback based on text input into the second electronic device of the second user; outputting a sound based on the feedback by the control unit.

6. An electronic device of a first user, An electronic device comprising: a control unit that delivers content to be viewed by a second user; receives feedback based on text input into the electronic device of the second user; and outputs audio based on the feedback.

7. A system including a first electronic device of a first user and a second electronic device of a second user, The first electronic device distributes content; the second electronic device outputs the content and receives an input from the second user; The system includes a first electronic device that receives feedback based on text input to the second electronic device and outputs audio based on the feedback.

8. The system according to claim 7, the first electronic device outputs the sound based on a setting of the first user; The second electronic device does not output the audio based on the setting.

9. The system according to claim 7, the first electronic device outputs the sound based on a setting of the first user; The second electronic device outputs the audio based on the setting.

10. The system of claim 7, The second electronic device is displaying information for receiving input corresponding to the feedback type set by the first user; The system does not display information for accepting input corresponding to feedback of a type different from the type set by the first user.

11. The system of claim 7, The second electronic device displays information for accepting input corresponding to feedback of a type determined based on personal information of the second user.

12. The system of claim 7, The second electronic device displays information for receiving input corresponding to feedback of a type determined based on the viewing environment of the second user.

13. An information processing method for a system including a first electronic device of a first user and a second electronic device of a second user, comprising: The first electronic device distributes content; the second electronic device outputs the content and receives an input from the second user; An information processing method, wherein the first electronic device receives feedback based on text input to the second electronic device and outputs a voice based on the feedback.

Images