Method, system and computer program for sharing content during internet phone-based call

Abstract

To provide a method, system and computer program for sharing content during an internet phone-based call.SOLUTION: The invention makes it possible to share a variety of media content items between call participants during a voice over Internet protocol (VoIP) call using a social graph.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The following description relates to techniques for providing calling capabilities based on Internet telephony (VoIP). [Background technology]

[0002] Recent communication devices provide a variety of services such as voice call services, messaging services, wireless Internet services, terrestrial / satellite broadcasting services, and the like.

[0003] In particular, with the development of video compression and restoration technologies and the widespread use of devices equipped with cameras, video calling services have become available that allow users to see the other person's face while talking.

[0004] As an example of a technology for providing a video call service, Patent Document 1 (registered on September 29, 2003) discloses a technology for providing a video call service for a mobile phone terminal over a mobile phone network in a wireless environment. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Korean Patent Registration No. 10-0401262 Summary of the Invention [Problem to be solved by the invention]

[0006] The aim is to enable participants in a VoIP (voice over internet protocol) call to share a variety of media content using a social graph. [Means for solving the problem]

[0007] A content sharing method is provided, the content sharing method being executed by a computer device, the computer device including at least one processor configured to execute computer-readable instructions contained in a memory, the content sharing method including the steps of: providing, by the at least one processor, an interface for identifying content on a VoIP call screen in accordance with user input during a VoIP call in which a user of the computer device is participating; generating, by the at least one processor, metadata of VoIP call packets including data corresponding to a sharing request for the content identified in the interface; transmitting, by the at least one processor, the metadata to at least one other user participating in the VoIP call; and displaying, by the at least one processor, a playback screen of the identified content together with the VoIP call screen, the identified content being shared between the user and the computer device of the other user during the VoIP call using the metadata of the VoIP call packets.

[0008] According to one aspect, the providing step may include providing an interface for identifying content of a corresponding media type according to a media type selected as a content sharing medium.

[0009] According to another aspect, the providing step may include providing an interface including a preview of a screen sharing target when content is to be shared through screen sharing.

[0010] According to another aspect, the providing step may include providing an interface for searching for content when a user wants to share content from a content provider that provides a content sharing service.

[0011] According to another aspect, providing an interface for searching for content may include providing a provider selection screen for selecting a content provider when there are multiple content providers that can be linked.

[0012] According to another aspect, the step of providing an interface for content search may include a step of recommending search terms based on at least one of profile information and title information set in a chat room during the VoIP call and data previously shared in the chat room.

[0013] According to another aspect, the generating step may include generating metadata including an identifier of a media type selected as a content sharing medium, an identifier of the identified content, and a playback position according to a protocol defined for content sharing during a VoIP call.

[0014] According to another aspect, the generating step may include generating metadata including an identifier of a media type selected as a content sharing medium and a URL of the identified content according to a protocol defined for content sharing during a VoIP call.

[0015] According to another aspect, the generating step may include generating metadata of a VoIP call packet including changed data when the playback state or playback position of the identified content is changed by the user's operation on the playback screen.

[0016] According to another aspect, the transmitting step may transmit the metadata to the computer device of the other user using a relay server or P2P (peer to peer) communication.

[0017] According to another aspect, the identified content may be played back on the other user's computer device in synchronization with a playback state of the other user's computer device based on the metadata.

[0018] According to yet another aspect, the displaying step may include combining the playback screen with the VoIP call screen and adjusting and displaying them as one screen.

[0019] A computer program is provided that is recorded on a non-transitory computer-readable recording medium to cause the computer system to execute the content sharing method.

[0020] A computer device is provided, comprising at least one processor implemented to execute computer-readable instructions contained in a memory, the at least one processor including an interface providing unit that provides an interface for identifying content on a VoIP call screen in accordance with user input during a VoIP call in which a user of the computer device participates; a sharing request unit that generates metadata for VoIP call packets including data corresponding to a sharing request for content identified in the interface in accordance with the sharing request, and transmits the metadata to at least one other user participating in the VoIP call; and a content display unit that displays a playback screen of the identified content together with the VoIP call screen, wherein the identified content is shared during the VoIP call between the user and the computer device of the other user using the metadata of the VoIP call packets. [Brief explanation of the drawings]

[0021] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram illustrating the internal configuration of an electronic device and a server according to an embodiment of the present invention. [Figure 3] FIG. 2 illustrates example components that may be included in a processor of an electronic device in accordance with an embodiment of the present invention. [Figure 4] 1 is a flowchart illustrating an example method that can be performed by an electronic device in accordance with an embodiment of the present invention. [Figure 5] 1 is an exemplary diagram illustrating an example of a content sharing process according to an embodiment of the present invention; [Figure 6] 10 is an exemplary diagram illustrating another example of a content sharing process according to an embodiment of the present invention. [Figure 7] 1 is an exemplary diagram illustrating a process of sharing content during a VoIP call according to an embodiment of the present invention. [Figure 8] 1 is an exemplary diagram illustrating a process of sharing content during a VoIP call according to an embodiment of the present invention. [Figure 9] 1 is an exemplary diagram illustrating a process of sharing content during a VoIP call according to an embodiment of the present invention. [Figure 10] 1 is an exemplary diagram illustrating a process of sharing content during a VoIP call according to an embodiment of the present invention. [Figure 11] 1 is an exemplary diagram illustrating a process of sharing content during a VoIP call according to an embodiment of the present invention. [Figure 12] 1 is an exemplary diagram illustrating a process of sharing content during a VoIP call according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0022] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0023] TECHNICAL FIELD An embodiment of the present invention relates to a technique for providing a calling function based on VoIP (voice over internet protocol).

[0024] Embodiments, including those specifically disclosed herein, enable call participants to share a variety of media content during a VoIP call using a social graph.

[0025] Fig. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in Fig. 1 shows an example including multiple electronic devices 110, 120, 130, and 140, multiple servers 150 and 160, and a network 170. Fig. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in Fig. 1.

[0026] The electronic devices 110, 120, 130, and 140 may be fixed or mobile terminals implemented by computers. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), laptops, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, game consoles, wearable devices, Internet of Things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. While FIG. 1 illustrates a smartphone as an example of the electronic device 110, in embodiments of the present invention, the electronic device 110 may represent one of a variety of physical computer devices capable of communicating with other electronic devices 120, 130, and 140 and / or servers 150 and 160 via a network 170 using a substantially wireless or wired communication method.

[0027] The communication method is not limited, and may include not only communication methods using communication networks (such as a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, and a satellite network) that can be included in network 170, but also short-range wireless communication between devices. For example, network 170 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, and the like. Furthermore, network 170 may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree network, or a hierarchical network.

[0028] Each of the servers 150 and 160 may be realized by one or more computer devices that communicate with the plurality of electronic devices 110, 120, 130, and 140 via the network 170 and provide instructions, code, files, content, services, etc. For example, the server 150 may be a system that provides a first service to the plurality of electronic devices 110, 120, 130, and 140 connected via the network 170, and the server 160 may be a system that provides a second service to the plurality of electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, the server 150 may provide a service (e.g., a VoIP call service) targeted by an application, which is a computer program installed and executed in the plurality of electronic devices 110, 120, 130, and 140, as a first service to the plurality of electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide, as a second service, a service of distributing files for installing and executing the above-mentioned application to the multiple electronic devices 110, 120, 130, and 140.

[0029] 2 is a block diagram illustrating the internal configuration of an electronic device and a server according to an embodiment of the present invention. In FIG. 2, the internal configuration of electronic device 110 and the internal configuration of server 150 are described as examples of electronic devices. Furthermore, other electronic devices 120, 130, 140 and server 160 may also have the same or similar internal configuration as electronic device 110 or server 150 described above.

[0030] The electronic device 110 and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223, and input / output interfaces 214 and 224. The memories 211 and 221 are non-transitory computer-readable recording media and may include persistent mass storage devices such as random access memory (RAM), read only memory (ROM), a disk drive, a solid state drive (SSD), and flash memory. The persistent mass storage devices such as ROM, SSD, flash memory, and disk drive may be included in the electronic device 110 and the server 150 as separate persistent storage devices distinct from the memories 211 and 221. The memories 211 and 221 may also store an operating system and at least one program code (e.g., code for a browser installed and executed on the electronic device 110, or code for an application installed on the electronic device 110 to provide a particular service). Such software components may be loaded from a computer-readable recording medium separate from the memories 211 and 221. Such another computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In other embodiments, software components may be loaded into memory 211, 221 through communication modules 213, 223 that are not computer-readable recording media. For example, at least one program may be loaded into memory 211, 221 based on a computer program (for example, the above-mentioned application) to be installed by a file provided over network 170 by a developer or a file distribution system that distributes application installation files (for example, the above-mentioned server 160).

[0031] The processors 212, 222 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processors 212, 222 by the memories 211, 221 or the communication modules 213, 223. For example, the processors 212, 222 may be configured to execute instructions received according to program code stored in a storage device such as the memories 211, 221.

[0032] The communication modules 213 and 223 may provide a function for the electronic device 110 and the server 150 to communicate with each other via the network 170, or may provide a function for the electronic device 110 and / or the server 150 to communicate with other electronic devices (for example, the electronic device 120) or other servers (for example, the server 160). For example, a request generated by the processor 212 of the electronic device 110 in accordance with program code recorded in a recording device such as the memory 211 may be transmitted to the server 150 via the network 170 under the control of the communication module 213. Conversely, a control signal, instruction, content, file, etc. provided under the control of the processor 222 of the server 150 may be received by the electronic device 110 via the communication module 213 of the electronic device 110 via the communication module 223 and the network 170. For example, control signals, instructions, content, files, etc. from the server 150 received through the communication module 213 may be transmitted to the processor 212 or memory 211, and the content, files, etc. may be recorded on a recording medium (the above-mentioned permanent recording device) that the electronic device 110 may further include.

[0033] The input / output interface 214 may be a means for interfacing with the input / output device 215. For example, the input device may include a keyboard, a mouse, a microphone, a camera, etc., and the output device may include a display, a speaker, a haptic feedback device, etc. As another example, the input / output interface 214 may be a means for interfacing with a device that integrates input and output functions into one, such as a touchscreen. The input / output device 215 may be configured as a single device together with the electronic device 110. Furthermore, the input / output interface 224 of the server 150 may be a means for interfacing with an input or output device (not shown) that may be connected to or included in the server 150. As a more specific example, when the processor 212 of the electronic device 110 processes instructions of a computer program loaded in the memory 211, a service screen or content configured using data provided by the server 150 or the electronic device 120 may be displayed on a display via the input / output interface 214.

[0034] In other embodiments, the electronic device 110 and the server 150 may include more components than those shown in FIG. 2 . However, it is not necessary to explicitly illustrate most of the components of the prior art. For example, the electronic device 110 may be implemented to include at least some of the input / output devices 215 described above, and may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, a database, etc. As a more specific example, if the electronic device 110 is a smartphone, the electronic device 110 may further include various components that are typically included in smartphones, such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, buttons using a touch panel, input / output ports, a vibrator for vibration, etc.

[0035] Specific embodiments of a method and system for sharing content during an Internet telephony (VoIP) based call are described below.

[0036] FIG. 3 is a block diagram illustrating example components that may be included in a processor of an electronic device in accordance with an embodiment of the present invention, and FIG. 4 is a flowchart illustrating an example method that may be performed by an electronic device in accordance with an embodiment of the present invention.

[0037] A computer-implemented VoIP call system may be configured in the electronic device 110 according to the present embodiment. For example, the VoIP call system may be implemented as an independently operating program, or may be implemented as an in-app for a specific application (e.g., a messenger) so as to be operable on the specific application. In some cases, the VoIP call system may provide a VoIP call service in conjunction with the server 150.

[0038] Based on instructions provided by an application installed on the electronic device 110, the VoIP calling system implemented in the electronic device 110 may perform the content sharing method shown in FIG.

[0039] 4, the processor 212 of the electronic device 110 may include, as components, a call providing unit 310, an interface providing unit 320, a sharing request unit 330, and a content display unit 340, as shown in FIG. 3. Depending on the embodiment, the components of the processor 212 may be selectively included or excluded from the processor 212. Also, depending on the embodiment, the components of the processor 212 may be separated or combined to express the functions of the processor 212.

[0040] Such processor 212 and components of processor 212 may control electronic device 110 to execute steps 410 to 440 included in the content sharing method of Fig. 4. For example, processor 212 and components of processor 212 may be implemented to execute instructions from operating system code and at least one program code included in memory 211.

[0041] Here, the components of processor 212 may represent different functions of processor 212 that are executed by processor 212 according to instructions provided by program code stored on electronic device 110 (e.g., instructions provided by an application executed on electronic device 110). For example, call providing unit 310 may be used as a functional representation of processor 212 that controls electronic device 110 according to the instructions described above so that electronic device 110 provides VoIP calls.

[0042] The processor 212 may read necessary instructions from the memory 211 loaded with instructions related to the control of the electronic device 110. In this case, the read instructions may include instructions for controlling the processor 212 to execute steps 410 to 440 described below.

[0043] Referring to FIG. 4, in step 410, the call providing unit 310 may provide a VoIP call involving at least two or more users, including the user of the electronic device 110. The VoIP call may include a VoIP-based voice call function and a video call function. In this case, the VoIP call may support not only one-to-one calls but also group calls up to a predetermined maximum number of users. For example, when a user of one of the electronic devices 110, 120, 130, or 140 requests a VoIP call, the server 150 may transmit the call request to the other electronic device and connect a VoIP-based call channel to users who have accepted the call.

[0044] In the case of a video call, the call providing unit 310 may transmit the intention of the user of the electronic device 110 to participate in the call to the server 150, receive the participant videos of the VoIP call as individual videos from the server 150, and then render the received participant videos as a single screen to form a video call screen. The server 150 does not create a single video including videos of multiple participants and provide it to the electronic device 110, but rather the server 150 transmits the video of each participant as an individual video to the electronic device 110, and the electronic device 110 forms a video call screen with the multiple participant videos on a single screen.

[0045] In the case of a voice call, the call providing unit 310 may generate a participant list based on profile information of users who have agreed to participate in the call, and then configure a voice call screen including the participant list.

[0046] In operation 420, when a user input invoking a content sharing function is received from the user of the electronic device 110 during a VoIP call, the interface providing unit 320 may provide a graphical user interface (GUI) for identifying content to be shared with call participants. The user input may include a media type selected as a content sharing medium. For example, the media type may include screen sharing, a content provider providing a content sharing service such as YouTube, etc. The content sharing function refers to a function in which call participants share media content during a VoIP call using a screen sharing or content sharing service. The interface providing unit 320 may provide a GUI corresponding to the media type input by the user as an interface for identifying content to be shared with call participants on the VoIP call screen.

[0047] For example, when a user wishes to share content from a content provider as one of the media types, the interface providing unit 320 may provide a GUI for searching for content. The interface providing unit 320 may first provide a provider selection screen for selecting a content provider, and then, once a content provider is selected on the provider selection screen, provide a GUI for searching for content within the platform of the selected content provider. In other words, the interface providing unit 320 may provide a list of content providers for providing a content sharing service and may provide an interface for searching for content from the content provider selected from the content provider list. After selecting a specific content provider as a media type, the user may search for content within the platform of the corresponding content provider to identify content to share with call participants.

[0048] As another example, when content is to be shared by screen sharing as another one of the media types, the interface providing unit 320 may provide a GUI including a preview of the screen sharing target. When content from a content provider is to be shared by a URL, a GUI including a preview of the content of the corresponding URL may be provided. When the content provider's content URL is copied to the clipboard and the user moves to the VoIP call screen, this may be recognized as a command to call the content sharing function. In this case, the interface providing unit 320 may provide a GUI including a preview of the URL copied to the clipboard by recognizing the command to call the content sharing function. The user may check the screen sharing target or the media content of the URL through the preview and then identify it as content to be shared with the call participants.

[0049] When providing a GUI for content search, the interface providing unit 320 may recommend search terms for content search based on profile information set in a chat room during a VoIP call or data previously shared in the chat room. Here, the profile information may include chat room title information, etc. Search terms may be recommended taking into consideration profile information of users participating in the chat room, such as age, gender, and area of ​​residence. In addition to the profile information, previously shared data, such as messages or content sent in the chat room, may be analyzed to derive interests, and keywords related to the derived interests may be provided as recommended search terms. If a certain percentage of messages in the chat room are related to coronavirus, search terms related to coronavirus may be recommended. Furthermore, if statistical information related to the chat room, such as the number of recent news items shared, is high, search terms related to the news may be recommended. Furthermore, based on the content sharing history in the chat room, for example, if the most videos from the LINE Friends channel were shared using LINE LIVE during a VoIP call, popular real-time search terms for LINE LIVE or search terms related to the LINE Friends channel may be recommended. In the case of an open chat room on a messenger platform where multiple users gather and exchange content based on a specific title, search terms may be recommended based on title information set in the open chat room.

[0050] In step 430, when the sharing request unit 330 receives a sharing request for content specified in the GUI from the user of the electronic device 110, the sharing request unit 330 may generate the sharing request for the corresponding content as metadata in the protocol of the VoIP call channel and transmit the metadata to the server 150. In other words, the sharing request unit 330 may generate metadata of a VoIP call packet including data corresponding to the content sharing request and transmit the metadata to the server 150.

[0051] A content sharing protocol for exchanging data during a VoIP call may be predefined depending on the media type. For example, the content sharing protocol may include an identifier indicating a content sharing function and metadata defined by the media type. The start and end of content sharing may be handled by a core event. If the media type is a content provider, a media type identifier, a content identifier specified by the user, a title, a thumbnail, a playback state (playing, pause, etc.), a playback position, etc. may be added to the metadata of the VoIP call packet. If content from a content provider is shared via a URL, a media type identifier, a content URL, a playback state, a playback position, etc. may be added to the metadata of the VoIP call packet. If the media type is screen sharing, a media type identifier, data required for screen sharing, etc. may be added to the metadata of the VoIP call packet. The sharing request unit 330 may describe all information required for the user of the electronic device 110 and the call participants to synchronize and play the content specified in the GUI (preview or search results) as VoIP metadata and transmit the described information to the server 150.

[0052] In step 440, the content display unit 340 may display the content requested by the user of the electronic device 110 together with the VoIP call screen. After a sharing request for content specified in the GUI is transmitted from the user of the electronic device 110 to the server 150, the content display unit 340 may display a playback screen of the content (hereinafter referred to as a "content screen") together with the VoIP call screen. As an example, the content display unit 340 may incorporate the content screen into the VoIP call screen in cooperation with the call providing unit 310 and adjust and display the content screen as a single screen combined with the VoIP call screen. As another example, the content display unit 340 may overlay the content screen as a separate screen, such as a PIP screen, on the VoIP call screen.

[0053] FIG. 5 is an exemplary diagram illustrating an example of a content sharing process according to an embodiment of the present invention.

[0054] Referring to FIG. 5, when the electronic device 110 receives a content sharing request from a user during a VoIP call, the electronic device 110 generates metadata for a VoIP call packet including data corresponding to the content sharing request (S501).

[0055] The electronic device 110 transmits metadata of a VoIP call packet including data corresponding to the user's content sharing request to the server 150 (S502).

[0056] The server 150 may recognize the media type, content to be shared, etc. based on the metadata of the VoIP call packets, and may determine the electronic device 110 among the call participants that requested content sharing as the sender, and the electronic devices of the remaining participants (at least one of 120, 130, 140) as receivers.

[0057] The server 150 transmits the metadata of the VoIP call packet including the data corresponding to the content sharing request from the sender to the electronic device (at least one of 120, 130, 140) corresponding to the receiver (S503).

[0058] The server 150 may act as a relay that transmits the metadata of VoIP call packets as is between a sender and a receiver that share content.

[0059] The electronic device corresponding to the receiver (at least one of 120, 130, and 140) may share content in the same state as the sender based on the metadata of the VoIP call packet received from the sender via server 150. If the content to be shared is a video, the sender may transmit the metadata to the receiver by including only information about the video (e.g., URL information (or content identifier) ​​and information about the start time) or by including the video packet to be shared together. The receiver may load the video from the content provider based on the information included in the metadata, or may start playing the video included in the VoIP call packet received from the sender in the same state as the sender without loading it. In the case of a sharing request for a playlist, the receiver may receive the sender's state based on the metadata of the VoIP call packet, directly query the video information included in the playlist, and start playing it after satisfying the relevant information.

[0060] Although a relay server 150 is used to transmit VoIP call packets for VoIP calls, this is not limited to this, and P2P (peer to peer) may also be used for personal communication that does not go through server 150.

[0061] 6 is an exemplary diagram illustrating another example of a content sharing process according to an embodiment of the present invention, showing an example of a one-to-one VoIP call process.

[0062] Referring to FIG. 6, when the electronic device 110 receives a content sharing request from a user of the electronic device 110 during a one-to-one VoIP call with the electronic device 120, the electronic device 110 generates metadata for a VoIP call packet including data corresponding to the content sharing request (S601).

[0063] The electronic device 110 may directly transmit metadata of a VoIP call packet including data corresponding to the user's content sharing request to the electronic device 120 corresponding to the receiver through P2P, which is one-to-one communication (S602).

[0064] Therefore, VoIP call packets can be exchanged between the sender and the receiver by P2P without going through the server 150, and content can be shared during a VoIP call by using the metadata of the VoIP call packets.

[0065] Since the sender basically has the authority to operate the content shared with the receiver, if the user on the sender side changes the playback position or playback status, the sender can transmit the metadata of the VoIP call packet containing the changed data to the receiver, and synchronize the status of the content shared between the sender and receiver in accordance with the sender's operation.

[0066] As another example, the receiver may, after obtaining consent from the sender or other call participants, change the status of the content being shared or suggest sharing other content based on this consent.

[0067] 7 to 12 are exemplary diagrams illustrating a process of sharing content during a VoIP call according to an embodiment of the present invention.

[0068] 7 to 10 show examples of interface screens displayed on the display of the electronic device 110 that corresponds to the sender.

[0069] 7, the processor 212 may receive the participant videos of the VoIP call as individual videos, and then render the received participant videos into a single screen to display the video call screen 710. When a user input invoking a content sharing function is received from the user of the electronic device 110 during the VoIP call, the processor 212 may provide a GUI for specifying content to be shared with the participants in the call.

[0070] The video call screen 710 may be adjusted according to the user's environment settings and the number of participants. For example, the video call screen 710 may be configured in a form in which all participant images are displayed on one screen, or in a form in which participant images are aligned in one direction and can be swiped in the alignment direction.

[0071] When a user intends to share content from a content provider such as YouTube as one of the media types, the processor 212 may provide a GUI 720 for searching for content, as shown in Fig. 7. When there are multiple content providers that can be linked, the processor 212 may first provide a provider selection screen for selecting a content provider, and then, once a content provider is selected on the provider selection screen, may provide a GUI 720 that allows the user to search for content within the platform of the selected content provider.

[0072] If the user chooses to share content through screen sharing as another one of the media types, the processor 212 may provide a GUI 830 including a preview of the screens running on the electronic device 110 that have been identified as the screen sharing target, as shown in FIG. 8 .

[0073] The processor 212 may overlay the content search GUI 720 and preview GUI 830 on the video call screen 710 as GUIs for identifying content (see FIG. 7), or may adjust the video call screen 710 and combine them with the video call screen 710 to display them on a single screen (see FIG. 8).

[0074] When a user requests sharing of content after specifying the content using the content search GUI 720 or the preview GUI 830, the processor 212 may transmit metadata of a VoIP call packet including data for sharing the content to the receiver. At the same time, the processor 212 may display a content screen 940, which is a playback screen of the content requested to be shared, together with the video call screen 710, as shown in FIG.

[0075] When the content screen 940 is displayed on a single screen combined with the video call screen 710, the video call screen 710 may display participant images in the remaining area excluding the content screen 940. In this case, the video call screen 710 may be configured in a form in which all participant images are displayed, or in a form in which participant images are aligned in one direction and can be swiped in the alignment direction.

[0076] Referring to FIG. 9, the content screen 940 of the sender electronic device 110 may display an interface 941 for operating the content, such as changing the playback position, pausing, resuming, etc., and may include an end button 942 for ending the content sharing function.

[0077] In the case of an audio call rather than a video call, the processor 212 may provide an audio call screen 1010 including a list of participants in the call as a VoIP call screen, as shown in Figure 10. When sharing content during an audio call, the processor 212 may display a content screen 940 together with the audio call screen 1010 including the participant list.

[0078] 11 and 12 show examples of interface screens displayed on the display of at least one of the electronic devices (120, 130, 140, for example, 120) that serve as the receiver.

[0079] Referring to FIG. 11, the processor of the electronic device 120 may receive each participant's video of the VoIP call as an individual video, and then render the received participant's video into a single screen to display the video call screen 1110.

[0080] When the processor of the electronic device 120 receives metadata of a VoIP call packet for content sharing from the sender during a VoIP call with the sender, the processor may display a preview screen 1101 of the content that the sender wishes to share on the video call screen 1110 based on the metadata of the received VoIP call packet. Instead of the preview screen 1101, a notice regarding the sender's content sharing request may be displayed on the video call screen 1110, or the preview screen 1101 and the notice may be displayed simultaneously.

[0081] When the user of the electronic device 120 consents to content sharing using the preview screen 1101 or the notification, a content screen 1240 to be shared may be displayed together with the video call screen 1110, as shown in FIG.

[0082] 12, the content screen 1240 of the electronic device 120 on the receiver side may not include an interface for operating the content, but may include an interface for turning the content screen 1240 on (expanding) and off (folding). For example, the content screen 1240 in an expanded state may include a button 1241 for turning off the content screen 1240. When the user of the electronic device 120 inputs the off button 1241, the content screen 1240 may be switched to a minimized screen 1250 including content information (e.g., the title of the content) being shared and displayed on the video call screen 1110, as shown in FIG. 12. At this time, the video call screen 1110 switches to the screen before the content screen 1240 was combined, and the minimized screen 1250 may include a button 1251 for inputting on when the content screen 1240 is expanded.

[0083] As described above, according to an embodiment of the present invention, during a VoIP call (voice call or video call) using a social graph, call participants can share various media content.

[0084] The above-described devices may be implemented using hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also access, record, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, a single processing device may be described. However, those skilled in the art will recognize that a processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0085] Software may include computer programs, codes, instructions, or a combination of one or more of these, which may configure a processing device to operate as desired or may independently or collectively instruct the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored and executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

[0086] Methods according to embodiments may be implemented in the form of program instructions executable by various computer means and recorded on a computer-readable medium. Here, the medium may continuously record a computer-executable program or temporarily record it for execution or download. Furthermore, the medium may be various recording or storage means in the form of a single piece of hardware or multiple pieces of hardware combined together. It is not limited to media directly connected to a computer system, but may also be distributed over a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; ROMs, RAMs, flash memories, and the like, configured to record program instructions. Other examples of media include recording media or storage media managed by application stores that distribute applications, or by sites, servers, and the like that provide or distribute various software.

[0087] Although the embodiments have been described above based on limited examples and drawings, those skilled in the art will appreciate that various modifications and variations may be made from the above description. For example, the described techniques may be performed in an order different from that described, and / or the described system, structure, device, circuit, or other element may be coupled or combined in a manner different from that described, or may be substituted or replaced by other elements or equivalents, and still achieve suitable results.

[0088] Therefore, different embodiments that are equivalent to the claims are within the scope of the appended claims.

[0089] The following describes the contents of the claims as originally filed as an example. [Example 1] 1. A content sharing method executed by a computer device, comprising: the computing device includes at least one processor configured to execute computer-readable instructions contained in a memory; The content sharing method includes: providing, by the at least one processor, an interface for specifying content on a VoIP call screen according to user input during a VoIP call in which a user of the computing device is participating; generating, by the at least one processor, metadata for VoIP call packets in accordance with a sharing request for content identified by the interface, the metadata including data corresponding to the sharing request; transmitting, by the at least one processor, the metadata to at least one other user participating in the VoIP call; and displaying, by the at least one processor, a playback screen of the identified content along with the VoIP call screen. Including, Sharing the identified content between the user and the other user's computing device during the VoIP call using metadata in the VoIP call packets. A content sharing method comprising: [Example 2] The providing step comprises: providing an interface for identifying content of a corresponding media type according to the media type selected as the content sharing medium; 2. The content sharing method of claim 1, comprising: [Example 3] The providing step comprises: When content is to be shared through screen sharing, an interface including a preview of the screen sharing target is provided. 2. The content sharing method of claim 1, comprising: [Example 4] The providing step comprises: Providing an interface for searching for content when a content provider providing a content sharing service wishes to share content 2. The content sharing method of claim 1, comprising: [Example 5] The step of providing an interface for content search includes: providing a provider selection screen for selecting a content provider when there are a plurality of content providers that can be linked; The content sharing method according to example 4, [Example 6] The step of providing an interface for content search includes: recommending search terms based on at least one of profile information set in the chat room during the VoIP call, user information participating in the chat room, messages or content sent in the chat room, statistical information about the chat room, or content sharing history of the chat room. The content sharing method according to example 4, [Example 7] The generating step includes: generating metadata including an identifier of a media type selected as a content sharing medium and an identifier of the identified content based on a protocol defined for content sharing during a VoIP call; 2. The content sharing method according to claim 1, [Example 8] The generating step includes: The metadata includes a playback position of the identified content. 8. The content sharing method according to claim 7, [Example 9] The generating step includes: generating metadata including an identifier of a media type selected as a content sharing medium and a URL of the identified content based on a protocol defined for content sharing during a VoIP call; 2. The content sharing method of claim 1, comprising: [Example 10] The generating step includes: generating metadata of a VoIP call packet including changed data when a playback state or a playback position of the specified content is changed by the user's operation on the playback screen; 2. The content sharing method of claim 1, comprising: [Example 11] The transmitting step includes: Sending the metadata to the other users' computing devices using a relay server or P2P (peer to peer) communication. 2. The content sharing method according to claim 1, [Example 12] In the computer device of the other user, the specified content is played back in synchronization with the playback state of the computer device of the other user based on the metadata. 2. The content sharing method according to claim 1, [Example 13] The displaying step includes: The playback screen is combined with the VoIP call screen and displayed as a single screen. 2. The content sharing method according to claim 1, [Example 14] A computer program causing a computer device to execute the content sharing method according to any one of the first to thirteenth embodiments. [Example 15] 1. A computer device comprising: At least one processor configured to execute computer-readable instructions contained in the memory Including, The at least one processor: an interface providing unit that provides an interface for specifying content on a VoIP call screen in accordance with a user input during a VoIP call in which the user of the computer device participates; a sharing request unit that generates metadata for a VoIP call packet including data corresponding to the sharing request in accordance with the sharing request for the content specified by the interface, and transmits the metadata to at least one other user participating in the VoIP call; a content display unit that displays a playback screen of the specified content together with the VoIP call screen; Including, Sharing the identified content between the user and the other user's computing device during the VoIP call using metadata in the VoIP call packets. A computer device comprising: [Example 16] The interface providing unit When sharing content via screen sharing, provide an interface that includes a preview of what you are sharing. 16. The computer device of example 15, [Example 17] The interface providing unit To provide an interface for searching for content when sharing content from a content provider that provides content sharing services 16. The computer device of example 15, [Example 18] The sharing request unit generating metadata including an identifier of a media type selected as a content sharing medium, an identifier of the identified content, and a playback position based on a protocol defined for content sharing during a VoIP call; 16. The computer device of example 15, [Example 19] The sharing request unit generating metadata including an identifier of a media type selected as a content sharing medium and a URL of the identified content based on a protocol defined for content sharing during a VoIP call; 16. The computer device of example 15, [Example 20] In the computer device of the other user, the specified content is played back in synchronization with the playback state of the computer device of the other user based on the metadata. 16. The computer device of example 15, [Explanation of symbols]

[0090] 212: Processor 310: Call provision department 320: Interface providing unit 330:Share request section 340: Content display section

Claims

1. 1. A content sharing method executed by a computer device, comprising: the computing device includes processing circuitry; The content sharing method includes: providing, by the processing circuit, an interface for searching for content on a VoIP call screen according to user input during a VoIP call in which a user of the computing device is participating; transmitting, by the processing circuit, information about the identified content to a server in response to a sharing request for the identified content by a user of the computer device among the content searched through the interface; and displaying the specified content together with the VoIP call screen; How to share content, including:

2. The providing step comprises: providing recommended search terms in an interface for searching the content; The content sharing method of claim 1 , comprising:

3. The step of providing recommended search terms includes: providing the recommended search terms based on at least one of profile information set in a chat room during the VoIP call, user information participating in the chat room, messages or content sent in the chat room, statistical information regarding the chat room, or content sharing history in the chat room; The content sharing method of claim 2 , comprising:

4. The providing step comprises: and displaying an interface for searching for the content and an interface for providing a preview associated with the content on the VoIP call screen. The content sharing method of claim 1 , comprising:

5. The providing step comprises: and providing an interface for searching for content within a platform of the content provider on the VoIP call screen when a content provider providing a content sharing service is selected as a media type corresponding to the content sharing medium according to the user input. The content sharing method of claim 1 , comprising:

6. and providing an interface including a preview of a screen sharing target on the VoIP call screen when screen share is selected as a media type corresponding to a content sharing medium by the user input by the processing circuit. The content sharing method of claim 1 , further comprising:

7. The step of displaying the content includes: a playback screen of the specified content is displayed together with the VoIP call screen, and the playback screen is displayed as a single screen combined with the VoIP call screen; The content sharing method of claim 1 , comprising:

8. The transmitting step includes: generating metadata of a VoIP call packet of a VoIP call including information on the specified content as data corresponding to the sharing request; The content sharing method of claim 1 , comprising:

9. The generating step includes: generating metadata including an identifier of a media type selected as a content sharing medium and an identifier or URL of the identified content based on a protocol defined for content sharing during the VoIP call; The content sharing method of claim 8 , comprising:

10. The transmitting step includes: transmitting the generated metadata to the server. The content sharing method of claim 8 , comprising:

11. generating, by the processing circuit, metadata of a VoIP call packet including changed data when a playback state or a playback position of the specified content is changed by the user's operation on the playback screen of the specified content; The content sharing method of claim 1 , further comprising:

12. A computer program for causing a computer to execute the content sharing method according to claim 1.

13. 1. A computer device comprising: Processing Circuit Including, The processing circuitry includes: providing an interface for searching for content on a VoIP call screen according to a user input during a VoIP call in which a user of the computer device participates; transmitting information about the specified content to a server in response to a sharing request for the content identified by the user of the computer device among the content searched for on the interface; A computing device configured to display the identified content along with the VoIP call screen.

14. The processing circuitry includes: The computer device of claim 13 configured to provide suggested search terms in an interface for searching the content.

15. The processing circuitry includes: The computer device of claim 14, configured to provide the recommended search terms based on at least one of profile information set in a chat room during the VoIP call, user information participating in the chat room, messages or content sent in the chat room, statistical information about the chat room, or content sharing history of the chat room.

16. The processing circuitry includes: The computer device of claim 13 , configured to overlay an interface for searching for the content and an interface for providing a preview associated with the content on the VoIP call screen.

17. The processing circuitry includes:

14. The computer device of claim 13, wherein when a content provider that provides a content sharing service is selected as a media type corresponding to the content sharing medium by the user input, an interface for searching for content within the platform of the content provider is provided on the VoIP call screen.

18. The processing circuitry includes:

14. The computer device of claim 13, further configured to provide an interface including a preview of the screen sharing target on the VoIP call screen when screen share is selected as a media type corresponding to the content sharing medium by the user input.

19. The processing circuitry includes:

14. The computer device of claim 13, configured to display a playback screen of the identified content together with the VoIP call screen, but to display the playback screen as a single screen combined with the VoIP call screen.

20. The processing circuitry includes: The computer device of claim 13 , configured to generate VoIP call packet metadata of a VoIP call that includes information for the identified content as data corresponding to the sharing request.

Images