Method, system and non-transitory computer-readable recording medium for audio feedback during live broadcast

Abstract

To provide a method, system and non-transitory computer-readable recording medium for audio feedback during a live broadcast.SOLUTION: A method implemented on a computer system includes providing a live broadcast by receiving broadcast content transmitted from an electronic device of a caster, and by streaming the received broadcast content to electronic devices of multiple users through a communication session established between an account of the caster and accounts of the users; receiving audio feedback about the live broadcast from an electronic device of a user during the live broadcast; and delivering the audio feedback to the electronic device of the caster.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The following description relates to a technique for transmitting feedback from viewers to a caster during a live broadcast. [Background technology]

[0002] In recent years, media clients, including live broadcast clients, have been growing rapidly.

[0003] Casters can upload live broadcasts to channels via their media clients, and viewers can freely watch the live broadcasts uploaded by casters via their media clients.

[0004] For example, Patent Document 1 (published on Nov. 27, 2006) discloses a live streaming broadcasting method for broadcasting live over a network. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Korean Patent Publication No. 10-2006-0120571 Summary of the Invention [Problem to be solved by the invention]

[0006] To provide a technique that enables a viewer to directly transmit voice feedback to a caster during a live broadcast.

[0007] To provide a technology that enables a caster during live broadcast to immediately hear the voice feedback of viewers without performing any special operation. [Means for solving the problem]

[0008] A method executed on a computer system, the computer system including at least one processor configured to execute computer-readable instructions contained in a memory, the method including: providing a live broadcast by receiving broadcast content sent from an anchor's electronic device in a communication session established between an anchor's account and a plurality of user accounts and streaming the broadcast content to the users' electronic devices; and receiving, during the live broadcast, audio feedback for the live broadcast from the users' electronic devices and transmitting the audio feedback to the anchor's electronic device.

[0009] According to one aspect, the transmitting step includes activating a voice channel between the anchor's account and the user's account when a voice input signal is received from the user's electronic device, receiving a voice message from the user's electronic device in real time, and transmitting the voice message to the anchor's electronic device.

[0010] In another aspect, the transmitting step includes activating a voice channel of a push to talk (PTT) method or a voice call method in response to a voice input signal of the user's electronic device.

[0011] In another aspect, the transmitting step includes receiving a voice message in a form of a recorded file from the user's electronic device and transmitting the voice message to the anchor's electronic device.

[0012] According to yet another aspect, the audio feedback is immediately output to an audio output interface of the caster's electronic device immediately after it is received.

[0013] According to another aspect, the transmitting step includes determining whether to accept the voice feedback of the user according to a broadcast environment setting of the anchor.

[0014] According to another aspect, the transmitting step includes determining whether to accept the voice feedback of the user based on a feedback history of the user.

[0015] According to another aspect, the transmitting step includes determining whether to share the audio feedback with the plurality of users according to a broadcast environment setting of the anchor.

[0016] According to another aspect, the providing step includes providing a function for applying at least one of an effect and a filter to an image of the broadcast content.

[0017] According to yet another aspect, the method further includes the at least one processor storing the broadcast content and the audio feedback in association with a chat room corresponding to the communication session.

[0018] The present invention provides a non-transitory computer-readable recording medium having a program recorded thereon for causing a computer to execute the method.

[0019] A computer system is provided, the computer system including at least one processor configured to execute computer-readable instructions contained in a memory, the at least one processor including a live broadcast providing unit that provides a live broadcast by receiving broadcast content sent from an anchor's electronic device and streaming it to the users' electronic devices in a communication session established between the anchor's account and multiple users' accounts, and a feedback transmission unit that receives audio feedback on the live broadcast from the users' electronic devices during the live broadcast and transmits it to the anchor's electronic device. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Diagram 2] 2 is a block diagram illustrating the internal configuration of an electronic device and a server according to an embodiment of the present invention. FIG. [Diagram 3] FIG. 2 is a block diagram illustrating example components that may be included in a processor of a server in one embodiment of the present invention. [Figure 4] 4 is a flow chart illustrating an example method that may be performed by a server in one embodiment of the present invention. [Diagram 5] FIG. 13 is a diagram showing an example of a chat room screen displayed on an electronic device of a viewer watching a live broadcast in one embodiment of the present invention. [Figure 6] FIG. 13 is a diagram showing an example of a chat room screen displayed on an electronic device of a viewer watching a live broadcast in one embodiment of the present invention. [Figure 7] FIG. 13 is a diagram showing an example of a chat room screen displayed on an electronic device of a viewer watching a live broadcast in one embodiment of the present invention. [Figure 8] FIG. 13 is a diagram showing an example of a chat room screen displayed on an electronic device of a viewer watching a live broadcast in one embodiment of the present invention. [Figure 9] FIG. 13 is a diagram showing an example of a chat room screen displayed on an electronic device of a caster who is conducting a live broadcast in one embodiment of the present invention. [Figure 10] FIG. 13 is a diagram showing an example of a chat room screen displayed on an electronic device of a caster who is conducting a live broadcast in one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0022] The live broadcast providing method according to the embodiment of the present invention may be executed by a computer device such as an electronic device or a server described below. In this case, a computer program according to an embodiment of the present invention may be installed and driven in the computer device, and the computer device may execute the live broadcast providing method according to an embodiment of the present invention under the control of the driven computer program. The above-mentioned computer program may be stored in a computer-readable recording medium in combination with the computer device to cause the computer to execute the live broadcast providing method. For example, the server may provide a live broadcast streaming service based on a social network service (SNS) (e.g., messenger, etc.) that allows group chats and group calls via the Internet, and at this time, the server may transmit viewer feedback in real time to a caster who hosts the live broadcast.

[0023] Fig. 1 is a diagram showing an example of a network environment in an embodiment of the present invention. The network environment in Fig. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Fig. 1 is merely an example for explaining the present invention, and the number of electronic devices and the number of servers are not limited to those shown in Fig. 1.

[0024] The electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals realized by computer devices. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), notebook computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, game consoles, wearable devices, internet of things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. As an example, FIG. 1 shows the shape of a smartphone as an example of the electronic device 1 (110), but in the embodiment of the present invention, the electronic device 1 (110) may mean one of various physical computer devices that can communicate with other electronic devices 120, 130, and 140 and / or servers 150 and 160 via a network 170 using a substantially wireless or wired communication method.

[0025] The communication method is not limited, and may include not only a communication method utilizing a communication network (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, or a satellite network) that the network 170 may include, but also short-range wireless communication between devices. For example, the network 170 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, and the like. Furthermore, the network 170 may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree, or a hierarchical network.

[0026] Each of the servers 150 and 160 may be realized by a computer device or a plurality of computer devices that communicate with the plurality of electronic devices 110, 120, 130, and 140 via the network 170 to provide instructions, codes, files, contents, services, and the like. For example, the server 150 may be a system that provides a first service to the plurality of electronic devices 110, 120, 130, and 140 connected via the network 170, and the server 160 may be a system that provides a second service to the plurality of electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, the server 150 may provide a service (such as a live broadcast streaming service, for example) targeted by an application as a computer program installed and operated in the plurality of electronic devices 110, 120, 130, and 140 as a first service to the plurality of electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide, as a second service, a service of distributing files for installing and running the above-mentioned applications to the multiple electronic devices 110, 120, 130, and 140.

[0027] Fig. 2 is a block diagram for explaining the internal configuration of an electronic device and a server in an embodiment of the present invention. In Fig. 2, the internal configuration of electronic device 1 (110) is explained as an example of an electronic device, and the internal configuration of server 150 is explained as an example of a server. In addition, other electronic devices 120, 130, 140 and server 160 may have the same or similar internal configuration as electronic device 1 (110) or server 150 described above.

[0028] The electronic device 1 (110) and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223, and input / output interfaces 214 and 224. The memories 211 and 221 are non-transitory computer-readable recording media and may include a random access memory (RAM), a read only memory (ROM), and a permanent mass storage device such as a disk drive, a soild state drive (SSD), a flash memory, and the like. Here, the permanent mass storage device such as a ROM, an SSD, a flash memory, a disk drive, and the like may be included in the electronic device 1 (110) or the server 150 as a separate permanent storage device separate from the memories 211 and 221. In addition, the memories 211 and 221 may store an operating system and at least one program code (for example, a code for a browser installed and operated in the electronic device 1 (110) or an application installed in the electronic device 1 (110) to provide a specific service). Such software components may be loaded from a computer-readable recording medium other than the memory 211, 221. Such another computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In another embodiment, the software components may be loaded into the memory 211, 221 through a communication module 213, 223 that is not a computer-readable recording medium. For example, at least one program may be loaded into the memory 211, 221 based on a program (the above-mentioned application, for example) that is installed by a file provided via the network 170 by a developer or a file distribution system that distributes an installation file of the application (the above-mentioned server 160, for example).

[0029] The processors 212, 222 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processors 212, 222 by the memory 211, 221 or the communication module 213, 223. For example, the processors 212, 222 may be configured to execute instructions received according to program codes stored in a recording device such as the memory 211, 221.

[0030] The communication modules 213 and 223 may provide a function for the electronic device 1 (110) and the server 150 to communicate with each other via the network 170, or may provide a function for the electronic device 1 (110) and / or the server 150 to communicate with other electronic devices (for example, the electronic device 2 (120)) or other servers (for example, the server 160). As an example, a request generated by the processor 212 of the electronic device 1 (110) according to a program code stored in a recording device such as the memory 211 may be transmitted to the server 150 via the network 170 under the control of the communication module 213. Conversely, a control signal, an instruction, a content, a file, etc. provided under the control of the processor 222 of the server 150 may be received by the electronic device 1 (110) through the communication module 213 of the electronic device 1 (110) via the communication module 223 and the network 170. For example, control signals, instructions, content, files, etc. from the server 150 received through the communication module 213 may be transmitted to the processor 212 or memory 211, and the content, files, etc. may be stored in a storage medium (the permanent storage device described above) that the electronic device 1 (110) may further include.

[0031] The input / output interface 214 may be a means for interfacing with the input / output device 215. For example, the input device may include a device such as a keyboard, a mouse, a microphone, a camera, and the like, and the output device may include a device such as a display, a speaker, a haptic feedback device, and the like. As another example, the input / output interface 214 may be a means for interfacing with a device in which functions for input and output are integrated into one, such as a touch screen. The input / output device 215 may be configured as one device together with the electronic device 1 (110). Also, the input / output interface 224 of the server 150 may be a means for interfacing with a device for input or output (not shown) that may be connected to the server 150 or included in the server 150. As a more specific example, when the processor 212 of the electronic device 1 (110) processes the instructions of the computer program loaded in the memory 211, a service screen or content configured using data provided by the server 150 or the electronic device 2 (120) may be displayed on a display via the input / output interface 214.

[0032] In other embodiments, the electronic device 1 (110) and the server 150 may include more components than those in FIG. 2. However, it is not necessary to clearly show most of the conventional technical components in the figure. For example, the electronic device 1 (110) may be realized to include at least some of the input / output devices 215 described above, and may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, a database, etc. As a more specific example, if the electronic device 1 (110) is a smartphone, various components such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, a button using a touch panel, an input / output port, a vibrator for vibration, etc., which are generally included in a smartphone, may be realized to further include in the electronic device 1 (110).

[0033] Specific embodiments of a method and system for communicating viewer feedback to a caster during a live broadcast are described below.

[0034] A live broadcast streaming service provides live broadcasts through group chat rooms in which multiple users participate, and in the chat room where the broadcast is being held, viewers can use reaction buttons (like, anger, sad, etc.), emojis, stamps, etc., or create text-based messages while watching the broadcast, allowing viewers' feedback to be transmitted to the caster hosting the live broadcast.

[0035] Much of the viewer feedback on live broadcasts tends to rely on text messages, but viewers who have difficulty sending text messages or who prefer voice communication can find it difficult or inconvenient to convey their feedback to the anchor.

[0036] Therefore, by providing a function in a live broadcast streaming service that allows viewers to transmit audio feedback to casters in real time, it is possible to provide convenience not only for viewers but also for casters, who can check viewer feedback by audio in an environment where it is difficult to check text messages.

[0037] FIG. 3 is a block diagram illustrating example components that may be included in a server processor in one embodiment of the present invention, and FIG. 4 is a flowchart illustrating an example method that may be performed by a server in one embodiment of the present invention.

[0038] The server 150 according to the present embodiment serves as a platform for providing a live broadcast streaming service to a plurality of electronic devices 110, 120, 130, and 140, which are clients. The server 150 provides the live broadcast streaming service in conjunction with applications installed on the electronic devices 110, 120, 130, and 140, and allows viewers to immediately provide voice feedback to the caster during the live broadcast.

[0039] In order for the server 150 to execute the live broadcast providing method shown in Fig. 4, the processor 222 of the server 150 may include a live broadcast providing unit 310 and a feedback transmitting unit 320 as components, as shown in Fig. 3. Depending on the embodiment, the components of the processor 222 may be selectively included or excluded from the processor 222. Also, depending on the embodiment, the components of the processor 222 may be separated or combined for expressing the functions of the processor 222.

[0040] Such processor 222 and components of processor 222 may control server 150 to execute steps 410 to 440 included in the live broadcast providing method of Fig. 4. For example, processor 222 and components of processor 222 may be realized to execute instructions according to the code of an operating system and the code of at least one program included in memory 221.

[0041] Here, the components of the processor 222 may be representations of different functions of the processor 222 that are executed by the processor 222 according to instructions provided by the program code stored in the server 150. For example, a live broadcast providing unit 310 may be used as a functional representation of the processor 222 that controls the server 150 according to the instructions described above so that the server 150 provides a live broadcast.

[0042] In step 410, the processor 222 can read necessary instructions from the memory 221 in which instructions related to the control of the server 150 are loaded. In this case, the read instructions may include instructions for controlling the processor 222 to execute steps 420 to 440 described below.

[0043] In step 420, the live broadcast providing unit 310 may provide a live broadcast by receiving broadcast content sent from the electronic device of the anchor in a communication session established between the anchor's account and a plurality of viewer's accounts and streaming the broadcast content to the electronic device of the viewer in real time. The live broadcast providing unit 310 may provide a live broadcast streaming service based on a social network (e.g., messenger, etc.), and in the live broadcast streaming service, broadcast content including the anchor's video and audio is transmitted to the viewer in one-way real time. As an example, the live broadcast providing unit 310 may provide a live broadcast streaming service through a chat room of a social network, i.e., a chat room corresponding to a communication session established between the anchor's account and the viewer's account. In this case, the live broadcast providing unit 310 may provide the anchor's live broadcast to viewers selected by the anchor. For example, targets selected from a social network chat room list or a friend list stored in the anchor's electronic device may participate in a chat room for the anchor's live broadcast, and the corresponding broadcast content may be provided.

[0044] In step 430, when a voice input signal is received from an electronic device of one of the viewers who are watching the anchor's live broadcast, the feedback transmitting unit 320 may activate a voice channel between the anchor and the viewers. This is to switch a one-way service channel to a two-way one in order to transmit the viewers' voice feedback to the anchor during the anchor's live broadcast. For voice feedback, a voice channel of a PTT (push to talk) method such as a walkie-talkie or a voice call method may be supported. For example, in a chat room where the anchor's live broadcast is in progress, if a viewer selects an interface for voice input, the feedback transmitting unit 320 may open a voice call channel between the anchor and the viewers according to the selection signal.

[0045] In step 440, the feedback transmission unit 320 may receive voice feedback input by a viewer from the electronic device of the viewer during the live broadcast and transmit it to the electronic device of the anchor. The feedback transmission unit 320 may receive the viewer's voice message in real time by activating a voice channel between the anchor and the viewer and transmit it to the anchor immediately, so that the anchor can immediately hear the viewer's voice message in the chat room where the live broadcast is in progress without taking any special operation or confirmation procedure. The form of the voice feedback may be realized by a real-time transmission method of a walkie-talkie or a voice call, but is not limited thereto, and may be provided in the form of a recorded file. In other words, the feedback transmission unit 320 may receive a voice message in the form of a recorded file from the electronic device of the viewer and transmit it to the electronic device of the anchor, and in the chat room where the live broadcast is in progress, the received recorded file is automatically played or played at the request of the anchor, so that the voice message sent by the viewer can be confirmed. The viewer's audio feedback may be provided directly to the anchor during the live broadcast, or, in another example, may be provided in a form that is shared by all users participating in the chat room where the anchor's live broadcast is in progress.

[0046] 5 to 8 are diagrams showing examples of chat room screens displayed on electronic devices of viewers watching a live broadcast in one embodiment of the present invention.

[0047] 5 shows an example of a chat room screen 500 displayed on a viewer's electronic device. A dedicated application installed on the electronic device can display a live broadcast screen 510 hosted by a caster as the chat room screen 500 in which viewers and casters participate. As an example, the live broadcast screen 510 with a predetermined screen ratio may be displayed on the chat room screen 500 in a fixed form, i.e., an embedded form, at the top of the chat room screen 500.

[0048] This is merely an example, and the live broadcast screen 510 may be displayed in various other modes, such as a full screen mode or a picture in picture (PIP) mode, in addition to the display mode of FIG.

[0049] Therefore, viewers can watch the live broadcast of the anchor in real time through the live broadcast screen 510 displayed on the chat room screen 500 of the dedicated application installed on the electronic device.

[0050] The chat room screen 500 may include a feedback input menu so that viewers can input feedback for the live broadcast while watching the live broadcast. At this time, the feedback input menu may include a text input menu 501 for inputting a text-based message, an image input menu 502 for inputting various image-based feedback such as stamps and emoticons, etc., and may particularly include a voice input menu 503 for inputting a voice message as viewer feedback for the live broadcast.

[0051] Referring to FIG. 6, in a dedicated application installed on an electronic device, when a viewer selects a text input menu 501 on a chat room screen 500 while watching a live broadcast, a virtual keyboard 620 for text input is executed on the chat room screen 500, and a text message entered by the viewer using the virtual keyboard 620 may be transmitted to the caster via the server 150.

[0052] Referring to FIG. 7, in a dedicated application installed on an electronic device, when a viewer selects an image input menu 502 on a chat room screen 500 while watching a live broadcast, an image list 730 of stamps, emoticons, etc. is displayed on the chat room screen 500, and the image selected by the viewer using the image list 730 may be transmitted to the caster via the server 150.

[0053] 8, in the dedicated application installed on the electronic device, when a viewer selects a voice input menu 503 on a chat room screen 500 while watching a live broadcast, an activation state 840 of the voice input interface is displayed on the chat room screen 500, and a voice message input by the viewer in the activation state 840 of the voice input interface may be transmitted to the anchor via the server 150. In this case, when a viewer selects the voice input menu 503 on the chat room screen 500, the feedback transmission unit 320 may receive the selection signal as a voice input signal of the viewer, activate a voice channel between the anchor and the viewer according to the voice input signal, and receive the viewer's voice message in real time to immediately transmit it to the anchor.

[0054] In a typical live broadcast environment, there is no way for a viewer to directly transmit voice to a caster, and there is a limitation that the viewer must rely on text-based feedback. However, in the present embodiment, for users who find it cumbersome or difficult to input text, or for users who prefer voice communication, and to provide a feedback environment optimized for live broadcasts, a live broadcast streaming service including a function for a viewer to directly transmit voice to a caster during a live broadcast can be provided.

[0055] Therefore, in a live broadcast streaming service, a function can be provided that enables viewers to transmit audio to the anchor in real time, and as viewer feedback on the anchor's live broadcast, not only text messages and images (stamps, emoticons, etc.) but also audio messages can be transmitted to viewers who find it tedious or difficult to input text or images.

[0056] Whether the text input menu 501, the image input menu 502, and the voice input menu 503 described with reference to FIGS. 5 to 8 are displayed on the chat room screen 500 may be determined according to the setting of the anchor who is conducting the live broadcast. For example, if the anchor sets the broadcast environment setting to allow only voice feedback among the viewer feedback types, the text input menu 501 and the image input menu 502 are not displayed on the chat room screen 500 for viewing the live broadcast, and only the voice input menu 503 is selectively displayed. As another example, it is also possible to automatically determine the display of at least one of the text input menu 501, the image input menu 502, and the voice input menu 503 based on the viewer's personal information (e.g., age, etc.), the viewing environment (e.g., whether or not the viewer can move, the location, the time, etc.), the feedback history, etc. For example, when the viewer is moving or when the proportion of voice feedback is the highest, the voice input menu 503 may be displayed on the chat room screen 500 for viewing the live broadcast.

[0057] Viewer feedback on a live broadcast (text messages, images, audio messages) may be communicated only to the caster hosting the broadcast, or in other instances, may be communicated collectively to all users participating in the chat room where the live broadcast is in progress (the caster and all viewers).

[0058] The server 150 (i.e., the processor 222) may store the live broadcast content together with information about the chat room (including anchor information and viewer information) in a database system (not shown) included in the server 150 or capable of interfacing with the server 150, and may simultaneously store feedback (text messages, images, voice messages) received from viewers for each broadcast content. In the case of viewer feedback, it may also be stored in a local area of ​​at least one of the anchor and viewer clients. Even after the live broadcast has ended, a function may be provided that allows the anchor or viewer to recheck the viewer feedback for the broadcast by reading it from the server 150 or the local area of ​​the client at their request.

[0059] Therefore, in this embodiment, viewers can directly deliver voice feedback to a caster during a live broadcast, and in this case, the voice feedback can support not only a real-time transmission method such as a walkie-talkie or voice call, but also a recorded file format.

[0060] 9 and 10 are diagrams showing examples of chat room screens displayed on the electronic device of a caster who conducts a live broadcast in one embodiment of the present invention.

[0061] 9 shows an example of a chat room screen 900 displayed on a newscaster's electronic device. A dedicated application installed on the electronic device provides a function of conducting a live broadcast through the chat room screen 900. As an example, the chat room screen 900 of a group formed by a newscaster may include a "live" menu 901 for providing a live broadcast to all users participating in the chat room.

[0062] When the "Live" menu 901 is selected on the chat room screen 900 of a group that has been organized by a newscaster for live broadcasting, a broadcast screen 910, which is an image captured by the camera of the newscaster's electronic device, can be displayed on the chat room screen 900.

[0063] A broadcast screen 910 having a predetermined screen ratio may be displayed in a fixed form, i.e., an embedded form, at the top of the chat room screen 900. This is merely an example, and the broadcast screen 910 may be displayed in various forms such as a full screen mode, a picture in picture (PIP) mode, etc., in addition to the display form of FIG.

[0064] The chat room screen 900 may include a start menu 913 for starting a live broadcast from the camera footage captured on the broadcast screen 910, and may further include an effect menu 911 for applying various effects to the camera footage on the broadcast screen 910, a filter menu 912 for applying various filters to the camera footage on the broadcast screen 910, etc.

[0065] When the caster selects the start menu 913 on the chat room screen 900, the live broadcast providing unit 310 can provide a live broadcast streaming service using the camera image captured on the broadcast screen 910 to users participating in the chat room. In other words, the live broadcast providing unit 310 can stream broadcast content sent from the caster's electronic device to the viewers' electronic devices in real time in a chat room in which multiple users selected by the caster as viewers who will watch the live broadcast participate.

[0066] At this time, the feedback transmission unit 320 can receive feedback (text message, image, voice message) input by a viewer from the viewer's electronic device during the live broadcast and transmit it to the anchor's electronic device. Referring to FIG. 10, the chat room screen 900 includes an interface area 1050 for displaying viewer feedback information for the ongoing live broadcast. The viewer feedback may include text feedback 1051 input as a text message and image feedback 1052 input as an image such as a stamp or emoticon, and in particular, in the present embodiment, voice feedback input as a voice may be included as one of the feedback types.

[0067] In the case of voice feedback, the voice message may be provided by a real-time transmission method such as a walkie-talkie or voice call as a voice message for a viewer to immediately convey to a newscaster during a live broadcast, or may be provided in the form of a recorded file. A dedicated application installed on the newscaster's electronic device can immediately output the voice message to the audio output interface of the electronic device immediately after receiving the voice message from the viewer, and the newscaster can listen to and check the viewer's voice message in real time without taking any special operation or checking procedure.

[0068] Unlike text feedback 1051 and image feedback 1052 which are directly expressed as visual information, audio feedback is output from the audio output interface of the anchor's electronic device, not from the chat room screen 900. In this case, the chat room screen 900 may display information 1060 about the viewer who transmitted the audio feedback, and audio playback status information 1053 indicating that an audio message is being output.

[0069] The viewer feedback 1051, 1052, 1053 may be provided only to the chat room screen 900 targeted at the caster during the live broadcast, or may be provided in a form shared by all users through the chat room screen 500 targeted at the viewers watching the live broadcast as well as the chat room screen 900 of the caster.

[0070] Whether or not the viewer's feedback 1051, 1052, 1053 is shared with the viewer may be determined according to the setting of the anchor who is conducting the live broadcast. In this case, whether or not to share with the viewer may be determined according to the feedback type (text feedback, image feedback, voice feedback). For example, if the anchor allows the sharing of text and image feedback among the viewer feedback types with the viewer in the broadcast environment setting, but does not allow the sharing of voice feedback, the text and image feedback are displayed on the chat room screen 500 of all viewers and the chat room screen 900 of the anchor, and the voice feedback is output only to the anchor.

[0071] Therefore, in this embodiment, in addition to transmitting viewer feedback in the form of text or images during live broadcasting, a function is provided for transmitting voice as viewer feedback to the anchor in real time. For viewers who have difficulty creating text, an environment in which feedback can be easily transmitted through voice feedback can be provided, and similarly, for anchors who have difficulty checking text, an environment in which feedback can be easily and quickly checked during broadcasting can be provided by immediately outputting voice feedback.

[0072] The above-mentioned devices may be realized by hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be realized using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the OS. The processing device may also respond to the execution of the software and access, store, manipulate, process, and generate data. For convenience of understanding, one processing device may be described as being used, but those skilled in the art will understand that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0073] The software may include computer programs, codes, instructions, or a combination of one or more of these, and may configure or instruct the processing device to operate as desired, either independently or collectively. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by or provide instructions or data to the processing device. The software may be distributed and stored and executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable recording media.

[0074] The method according to the embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a program executable by a computer, or one that temporarily stores the program for execution or download. The medium may be one of various recording means or storage means in the form of a single or multiple hardware devices combined, and is not limited to a medium directly connected to a computer system, but may be one that is distributed on a network. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROMs, RAMs, flash memories, etc., configured to store program instructions. Other examples of the medium may include recording media or storage media managed by app stores that distribute applications, or sites or servers that supply or distribute various other software.

[0075] Although the embodiments have been described above based on the limited embodiments and drawings, those skilled in the art will appreciate that various modifications and variations can be made from the above description. For example, the described techniques may be performed in an order different from that described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a manner different from that described, or may be replaced or substituted by other components or equivalents, and still achieve suitable results.

[0076] Therefore, different embodiments are within the scope of the appended claims provided they are equivalent to the claims. [Explanation of symbols]

[0077] 222: Processor 310: Live Broadcasting Department 320: Feedback transmission section

Claims

1. A program executed by a first electronic device of a first user, comprising: Delivering content to be viewed by a second user by a control unit of the first electronic device; receiving, by the control unit, feedback based on the text input into the second electronic device of the second user; and outputting a sound based on the feedback by the control unit.

2. The program according to claim 1, The program is executed by the control unit to display information about the second user corresponding to the feedback.

3. The program according to claim 2, The program executed by the control unit is to display an object corresponding to the voice in association with information regarding the second user.

4. A program according to any one of claims 1 to 3, The program determines whether to share the audio with the second user based on a setting by the first user.

5. A method for processing information on a first electronic device of a first user, comprising: Delivering content to be viewed by a second user by a control unit of the first electronic device; receiving, by the control unit, feedback based on the text input into the second electronic device of the second user; outputting a voice based on the feedback by the control unit.

6. An electronic device of a first user, An electronic device comprising: a control unit that delivers content to be viewed by a second user, receives feedback based on text input to the electronic device of the second user, and outputs audio based on the feedback.

7. A system including a first electronic device of a first user and a second electronic device of a second user, The first electronic device distributes content; the second electronic device outputs the content and receives an input from the second user; The first electronic device receives feedback based on text input to the second electronic device, and outputs audio based on the feedback.

8. The system according to claim 7, The first electronic device outputs the sound based on a setting of the first user; The second electronic device does not output the audio based on the setting.

9. The system of claim 7, The first electronic device outputs the sound based on a setting of the first user; The second electronic device outputs the audio based on the setting.

10. The system of claim 7, The second electronic device is displaying information for receiving an input corresponding to the feedback type set by the first user; The system does not display information for accepting input corresponding to feedback of a type different from the type set by the first user.

11. The system of claim 7, The second electronic device displays information for accepting input corresponding to feedback of a type determined based on personal information of the second user.

12. The system of claim 7, The second electronic device displays information for accepting input corresponding to feedback of a type determined based on the viewing environment of the second user.

13. An information processing method for a system including a first electronic device of a first user and a second electronic device of a second user, comprising: The first electronic device distributes content; the second electronic device outputs the content and receives an input from the second user; An information processing method, wherein the first electronic device receives feedback based on text input to the second electronic device, and outputs a voice based on the feedback.

Images