Content sharing method, computer program, and user terminal for sharing content during a call via an instant messaging application.

Abstract

To provide a method to share a content during a call.SOLUTION: A method of sharing a content during a call includes the steps of initiating a call, via a first external device, between a user account associated with a user terminal included in a chat room of an instant messaging application and another user account associated with another user terminal, forwarding a "watch together" request associated with the shared content to the first external device, and displaying the content to be shared on the display of the user terminal together with a call screen.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a method and system for sharing content during a call via an instant messaging application. Specifically, it relates to a method and system that enables a user to view, while on a call, one of the contents shared in a talk room together with other call participants, etc.

Background Art

[0002] With the spread of mobile devices such as smartphones, instant messaging applications are widely used for communication with people. Users who use instant messaging applications via mobile devices can exchange messages with a large number of other users. In particular, photos, web pages, videos, etc. associated with messages can be uploaded and shared via the talk rooms of instant messaging applications.

[0003] [[ID=十六]]On the other hand, recently, services that enable calls with other users who have joined a talk room using the easy accessibility of instant messaging applications have become widely popular. When using a call service via a talk room, there is a high frequency of conversations regarding the topics discussed in the talk room or the content uploaded to the talk room. However, there is an inconvenience in that it is difficult to view the content uploaded to the talk room with the person on the call during the call.

Summary of the Invention

Problems to be Solved by the Invention

Means for Solving the Problems

[0005] Various embodiments of the present disclosure provide a method for sharing content during a call, which is performed by at least one processor in a user terminal. The content sharing method according to the present disclosure includes the steps of: initiating a call via a first external device between a user account associated with a user terminal included in a talk room of an instant messaging application and another user account associated with another user terminal; transferring a content sharing request associated with the content to be shared to the first external device; and displaying the content to be shared on the user terminal's display together with the call screen.

[0006] According to embodiments of the present disclosure, a computer program stored on a computer-readable recording medium is provided for executing a content sharing method on a computer.

[0007] According to one embodiment of the present disclosure, a user terminal is provided. The user terminal according to the present disclosure includes a communication module, a display, memory, and at least one processor connected to the memory and configured to execute a computer-readable program contained in the memory, the program including instructions for initiating a call between a user account associated with the user terminal and other user accounts associated with other user terminals, via a first external device, transferring a content sharing request associated with shared content to the first external device, and displaying the shared content on the user terminal's display along with the call screen. [Effects of the Invention]

[0008] In various embodiments of this disclosure, users are provided with a service that allows them to view content shared in a chat room during a call together with other users, enabling them to easily and quickly view videos, images, and links shared in a chat room during a call and continue the call while viewing and listening to them together with the other party.

[0009] In one embodiment of this disclosure, a list of shareable content to be viewed together with people in the chat room during a call is provided in preview format, allowing users to more intuitively check the content. In addition, by providing automatically recommended shareable content suggestions during the call, users can more easily share the content they want to share with people in the chat room.

[0010] In one embodiment of the present disclosure, the list of content to be shared is sorted by similarity to the topic of the call, or by upload time, so that users can quickly find the content they want to share.

[0011] In one embodiment of this disclosure, users can synchronize and view desired scenes within shared content with other users in a chat room via user input control.

[0012] The effects of this disclosure are not limited to those described herein and may include other effects that can be clearly understood by a person with ordinary skill in the art to which this disclosure pertains. [Brief explanation of the drawing]

[0013] [Figure 1] This figure shows an example of a user using a user terminal to access a talk room content sharing service during a call, according to one embodiment of the present disclosure. [Figure 2] This is a schematic diagram showing a configuration in which an information processing system is linked to communicate with multiple user terminals in order to provide a talk room content sharing service during a call according to one embodiment of the present disclosure. [Figure 3] This is a block diagram showing the internal configuration of a user terminal and information processing system according to one embodiment of the present disclosure. [Figure 4] This figure shows an example of displaying a list of multiple shared content items on a screen in response to a "view together" request for shared content according to one embodiment of the present disclosure. [Figure 5] This figure shows an example of how the system automatically recommends the most similar chat room shared content as a candidate for shared content, according to one embodiment of the present disclosure. [Figure 6] This figure shows an example in which video is synchronized and displayed on the other party's terminal based on content control information according to one embodiment of the present disclosure. [Figure 7] This figure shows an example in which the enlargement or reduction of an image on the other party's terminal is synchronized based on content control information according to one embodiment of the present disclosure. [Figure 8] This figure shows an example in which the scroll position of a web page on the other party's terminal is synchronized based on content control information according to one embodiment of the present disclosure. [Figure 9] This flowchart shows a method for sharing content during a call between a user terminal, a first external device, a second external device, and the other party's user terminal according to one embodiment of the present disclosure. [Figure 10] This flowchart shows a method for sharing content during a call according to one embodiment of the present disclosure. [Modes for carrying out the invention]

[0014] <Summary of the Invention> According to one embodiment, the shared content is displayed in sync on the user's terminal display and on the displays of other user terminals.

[0015] According to one embodiment, a content sharing request includes identification information of the content to be shared, and other user terminals receive the identification information of the content to be shared via a first external device.

[0016] According to one embodiment, the content sharing method further includes, in response to determining that the content to be shared is not stored in the user terminal, transferring the identification information of the content to be shared to a second external device, and receiving the content to be shared from the second external device.

[0017] According to one embodiment, another user terminal uses the identification information of the content to be shared received via the first external device to receive the content to be shared from the second external device and display it together with a call screen on the display of the other user terminal.

[0018] According to one embodiment, the step of transferring the content sharing request further includes displaying a list of a plurality of contents shared in the talk room on the display, and receiving a selection for one of the plurality of contents.

[0019] According to one embodiment, the list of a plurality of contents shared in the talk room includes a preview associated with the plurality of contents, and the preview associated with the plurality of contents is received from the second external device.

[0020] According to one embodiment, the list of the plurality of contents is displayed sorted in the latest order.

[0021] According to one embodiment, the list of the plurality of contents is displayed sorted in descending order of similarity to the call topic.

[0022] According to one embodiment, the call topic is determined by analyzing call data within a predetermined time.

[0023] According to one embodiment, the content sharing method further includes displaying, on the display together with the call screen, as a content sharing candidate, the content having the highest similarity to the call topic among the plurality of contents shared in the talk room, and receiving a user input for selecting the content sharing candidate as the content to be shared.

[0024] According to one embodiment, the topic of a call is determined by analyzing call data within a predetermined time period.

[0025] In one embodiment, information about the user who uploaded the shareable content candidate to the chat room, or information about the time the shareable content candidate was uploaded to the chat room, is displayed on the screen along with a preview associated with the shareable content candidate.

[0026] According to one embodiment, the content sharing method further includes the steps of receiving a control request from a user for content to be shared, and transferring control information corresponding to the control request to another user terminal via a first external device.

[0027] According to one embodiment, the content to be shared is music or video, and the control information includes information about the playback position.

[0028] According to one embodiment, the shared content is an image, and the control information includes information regarding zooming in or out.

[0029] In one embodiment, the shared content is a web page, and the control information includes information about the scroll position.

[0030] <Detailed description of the invention> The specific details for implementing this disclosure will be described below in detail based on the attached drawings. However, in the following explanation, specific descriptions of publicly known functions and configurations will be omitted if there is a risk of unnecessarily obscuring the gist of this disclosure.

[0031] In the attached drawings, identical or corresponding components are assigned the same reference numerals. Furthermore, in the following descriptions of embodiments, redundant descriptions of identical or corresponding components may be omitted. The omission of a description of a component does not imply that such a component is not included in a particular embodiment.

[0032] The advantages and features of the disclosed embodiments, and the methods for achieving them, will become clear with reference to the embodiments described below, based on the accompanying drawings. However, this disclosure is not limited to the embodiments disclosed below and may be embodied in a variety of different forms. The embodiments disclosed below are one example that will enable a person of the ordinary skill to accurately understand the inventions relating to this disclosure.

[0033] This specification provides a brief explanation of the terms used herein and a detailed description of the embodiments of the disclosure. The terms used herein have been selected as widely used and general terms as possible, taking into account the function of this disclosure; however, these may change due to the intent of engineers in the relevant field, case law, the emergence of new technologies, etc. In certain cases, the applicant may have arbitrarily selected terms, the meanings of which will be described in detail in the description of the invention. The terms used in this disclosure are not simply nouns, but are defined based on their meaning and the overall content of this disclosure.

[0034] In this specification, unless explicitly specified in the context, a singular expression may include a plural expression, and a plural expression may include a singular expression. Throughout the specification, when a part of the specification “includes” a component, this does not mean that it excludes other components, but rather that it may further include other components, unless otherwise stated.

[0035] Furthermore, the terms “module” or “unit” as used in this specification refer to software or hardware components, and a “module” or “unit” performs a certain role. However, this does not mean that a “module” or “unit” is limited to software or hardware. A “module” or “unit” may be configured to reside on an addressable storage medium, or to regenerate one or more processors. Thus, as an example, a “module” or “unit” may include components such as software components, object-oriented software components, class components, task components, as well as at least one of processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, or variables. The functionality provided within each component and “module” or “unit” may be combined with a smaller number of components in the “module” or “unit,” or further separated into additional components in the “module” or “unit.”

[0036] In one embodiment of this disclosure, “module” or “part” may be embodied in a processor and memory. “Processor” is broadly interpreted to include general-purpose processors, central processing units (CPUs), microprocessors, digital signal processors (DSPs), controllers, microcontrollers, state machines, etc. In some environments, “processor” is also referred to as an application-specific semiconductor (ASIC), a programmable logic device (PLD), a field-programmable gate array (FPGA), etc. “Processor” may also be a combination of processing devices, such as a combination of a DSP and a microprocessor, a combination of multiple microprocessors, a combination of one or more microprocessors coupled with a DSP core, or any other such combination. “Memory” is broadly interpreted to include any electronic component capable of storing electronic information. "Memory" refers to a variety of processor-readable media, such as RAM (Random Access Memory), ROM (Read Only Memory), NVRAM (Non-Volatile Random Access Memory), PROM (Programmable Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic or optical data storage devices, and registers. When a processor can read information from and record information into memory, the memory is in electronic communication with the processor. Memory integrated into a processor is in electronic communication with the processor.

[0037] In this disclosure, “talk room” can represent a virtual space or group that can be created by an instant messaging application installed on a computer device, and in which one or more users (or user accounts) can participate. For example, one or more user accounts can participate in or be included in a talk room and exchange messages, files, and other various forms with each other. In addition, the talk room may provide VoIP (Voice over Internet Protocol) calling functionality, VoIP group calling functionality, and live broadcasting functionality (VoIP real-time video transmission functionality), enabling voice calls, video calls, and video streaming between user accounts within the talk room.

[0038] In this disclosure, "user account" may represent an account created and used by a user in an instant messaging application, or data associated therewith. Furthermore, a user account in an instant messaging application may refer to a user who uses the instant messaging application. Similarly, a user who uses instant messaging or a chat room capable of instant messaging may refer to a user account in an instant messaging application. Additionally, a user account may refer to a user account associated with the screen of a user terminal as shown in the figure. While "multiple user accounts" and "user account" are used distinctly, "multiple user accounts" may include multiple user accounts.

[0039] In this disclosure, “Content” may include various types of information or their components that are produced and provided to users in a digital format that is recognizable by human senses, such as images, text, video, and audio. For example, Content may include, but is not limited to, videos, music, images, audio, web pages, webtoons, text, and social media posts.

[0040] Figure 1 shows an example in which user 110, according to one embodiment of the present disclosure, uses a user terminal 120 to use a talk room content sharing service while on a call. As shown in the figure, user 110 can start a call with other users via a talk room in an instant messaging application. Although Figure 1 shows user 110 making a video call with other users, the user is not limited to this, and user 110 can also start a voice call with other users via a talk room in an instant messaging application. Furthermore, although Figure 1 shows user 110 making calls with multiple other users, the user is not limited to this, and user 110 can make calls with any number of other users.

[0041] During a call, user 110 can make a "view together" request (also referred to as a content sharing request in this disclosure) for shared content. In one embodiment, when user 110 selects a "view together" icon displayed on the display by touch input or the like, content shared in the chat room during the call can be displayed on the screen. At this time, user 110 can select one of the chat room shared content displayed on the screen and make a "view together" request for that content. Additionally or alternatively, when user 110 selects a recommended message for shareable content displayed on the display by touch input or the like, a "view together" request for that content can be made. Here, the recommended shareable content may be one of the contents shared in the chat room during the call.

[0042] In response to a "view together" request, the shared content 122 may be displayed on the user terminal's display along with the call screen 124. Alternatively, only the shared content 122 may be displayed on the display. The shared content 122 may be displayed in sync on the user terminal 120 of the user who is on the call.

[0043] Figure 1 shows the shared content 122 as a video, but it is not limited to this. For example, the shared content 122 could be an image, music, a webpage, or a webtoon. With this configuration, users can easily and quickly view videos, images, and links shared in the chat room during a call and continue the call while viewing or listening to them together with the other party.

[0044] Figure 2 is a schematic diagram showing a configuration in which an information processing system 230 is connected to communicate with multiple user terminals 210_1, 210_2, and 210_3 in order to provide a talk room content sharing service during a call according to one embodiment of the present disclosure. The information processing system 230 may include a system that can provide instant messaging services, including content sharing services, to multiple user terminals 210_1, 210_2, and 210_3 via a network 220 during a call. In one embodiment, the information processing system 230 may include a computer executable program (e.g., a downloadable application) associated with the instant messaging service, one or more server devices and / or databases capable of storing, providing, and executing data, and one or more distributed computer devices and / or distributed databases of a cloud computing service infrastructure. The instant messaging service provided by the information processing system 230 may be provided to users via an instant messaging application installed on each of the multiple user terminals 210_1, 210_2, and 210_3. For example, an instant messaging service may include text messaging services, video calling services, voice calling services, video streaming services, screen sharing services, and content sharing services between users of an instant messaging application.

[0045] Multiple user terminals 210_1, 210_2, and 210_3 can communicate with the information processing system 230 via the network 220. The network 220 can be configured to enable communication between the multiple user terminals 210_1, 210_2, and 210_3 and the information processing system 230. Depending on the installation environment, the network 220 may consist of a wired network such as Ethernet (registered trademark), PLC (Power Line Communication), telephone line communication equipment, and RS-serial communication, a mobile communication network, a wireless network such as WLAN (Wireless LAN), Wi-Fi (registered trademark), Bluetooth (registered trademark), and ZigBee (registered trademark), or a combination thereof. The communication method is not limited and may include not only communication methods that utilize communication networks that can include the network 220 (e.g., mobile communication networks, wired internet, wireless internet, broadcasting networks, satellite networks, etc.), but also short-range wireless communication between user terminals 210_1, 210_2, and 210_3. For example, network 220 may include one or more arbitrary networks such as a PAN (personal area network), LAN (local area network), CAN (campus area network), MAN (metropolitan area network), WAN (wide area network), BBN (broadband network), or the Internet. Network 220 may also include, but is not limited to, one or more network topologies, including bus networks, star networks, ring networks, mesh networks, star-bus networks, tree or hierarchical networks.

[0046] In Figure 2, a mobile phone is shown as an example of user terminal 210_1, a tablet as an example of user terminal 210_2, and a PC as an example of user terminal 210_3. However, the user terminals 210_1, 210_2, and 210_3 are not limited to these, and can be any computing device capable of wired and / or wireless communication and on which an instant messaging application can be installed and run. For example, user terminals can include smartphones, mobile phones, navigation systems, desktop computers, laptop computers, digital broadcasting terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), tablet PCs, game consoles, wearable devices, IoT (Internet of Things) devices, VR (virtual reality) devices, AR (augmented reality) devices, and the like. Furthermore, while Figure 2 shows a configuration in which three user terminals 210_1, 210_2, and 210_3 communicate with the information processing system 230 via the network 220, the system is not limited to this configuration, and it is also possible to configure the system so that a different number of user terminals communicate with the information processing system 230 via the network 220.

[0047] The information processing system 230 can receive "view together" requests associated with shared content by user accounts in a chat room from user terminals 210_1, 210_2, and 210_3 running the instant messaging application. When a "view together" request is received, the information processing system 230 can provide both a content sharing service (or "view together" service) and a call service between user terminals 210_1, 210_2, and 210_3 running the instant messaging application.

[0048] According to one embodiment, in order to provide a content sharing service during a call, the information processing system 230 can receive information about the content to be shared (e.g., identification information about the content to be shared) from user terminals 210_1, 210_2, and 210_3 that share the content, and can transfer the received information about the content to be shared to user terminals 210_1, 210_2, and 210_3 to which the content is provided. Here, the content to be shared may include content of a shareable type and / or link information associated with such content. For example, when a "view together" request is received, the information processing system 230 can receive information about the content to be shared from the user terminal of the user account that intends to share the content, and can transfer the received information about the content to the user terminals of multiple user accounts associated with the talk room. That is, information about the content to be shared can be shared to multiple user accounts associated with the talk room via the talk room.

[0049] Figure 3 is a block diagram showing the internal configuration of a user terminal 210 and an information processing system 230 according to one embodiment of the present disclosure. The user terminal 210 can refer to any computer device capable of running instant messaging applications and capable of wired / wireless communication, and can include, for example, the mobile phone terminal 210_1, tablet terminal 210_2, and PC terminal 210_3 in Figure 2. As shown in the figure, the user terminal 210 can include a memory 312, a processor 314, a communication module 316, and an input / output interface 318. Similarly, the information processing system 230 can include a memory 332, a processor 334, a communication module 336, and an input / output interface 338. As shown in Figure 3, the user terminal 210 and the information processing system 230 can be configured to communicate information and / or data via the network 220 using their respective communication modules 316 and 336. The input / output device 320 can also be configured to input information and / or data to the user terminal 210 or output information and / or data generated from the user terminal 210 via the input / output interface 318.

[0050] The memories 312 and 332 may include any non-temporary computer-readable recording medium. According to one embodiment, the memories 312 and 332 may include permanent mass storage devices such as RAM (random access memory), ROM (read-only memory), disk drives, SSDs (solid-state drives), and flash memory. In other examples, permanent mass storage devices such as ROM, SSDs, flash memory, and disk drives may be included in the user terminal 210 or information processing system 230 as separate permanent storage devices distinct from the memory. The memories 312 and 332 may also store an operating system and at least one program code (for example, code for an instant messaging application installed and driven on the user terminal 210).

[0051] Such software components can be loaded from a computer-readable recording medium separate from memories 312 and 332. Such a separate computer-readable recording medium may include a recording medium directly connectable to the user terminal 210 and the information processing system 230, but may also include computer-readable recording media such as floppy drives, disks, tapes, DVD / CD-ROM drives, and memory cards. As another example, software components may also be loaded into memories 312 and 332 via a communication module, rather than from a computer-readable recording medium. For example, at least one program may be loaded into memories 312 and 332 based on a computer program (e.g., an application providing instant messaging application services) installed by a file provided via the network 220 by a developer or a file distribution system that distributes application installation files.

[0052] Processors 314 and 334 can be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to processors 314 and 334 by memory 312 and 332 or by communication modules 316 and 336. For example, processors 314 and 334 can be configured to execute instructions received by program code stored in a recording device such as memory 312 and 332.

[0053] Communication modules 316 and 336 can provide configurations and functions for the user terminal 210 and the information processing system 230 to communicate with each other via the network 220, and can provide configurations and functions for the user terminal 210 and / or the information processing system 230 to communicate with other user terminals or other systems (e.g., a separate cloud system, a separate content sharing system, a content provision system, a separate call system, etc.). For example, a request (e.g., a call initiation request or a content sharing request) generated by program code stored in a recording device such as memory 312 by the processor 314 of the user terminal 210 can be transmitted to the information processing system 230 via the network 220 under the control of the communication module 316. Conversely, control signals and commands provided under the control of the processor 334 of the information processing system 230 can be received by the user terminal 210 via the communication module 336 and the network 220 through the communication module 316 of the user terminal 210. For example, the user terminal 210 can receive a determination result from the information processing system 230 via the communication module 316 regarding whether or not there is shared content.

[0054] The input / output interface 318 may be a means for interfacing with the input / output device 320. For example, the input device may include devices such as a camera including an image sensor, a keyboard, a microphone, or a mouse, and the output device may include devices such as a display, a speaker, or a haptic feedback device. In another example, the input / output interface 318 may be a means for interfacing with a device that integrates the configuration and functions for performing input and output in one unit, such as a touchscreen. For example, when the processor 314 of the user terminal 210 processes instructions of a computer program loaded into memory 312, a service screen or content, which is composed of information and / or data provided by the information processing system 230 or other user terminals 210, may be displayed on the display via the input / output interface 318. In Figure 3, the input / output device 320 is shown not to be included in the user terminal 210, but it is not limited to this and can also be configured together with the user terminal 210. Furthermore, the input / output interface 338 of the information processing system 230 may be connected to the information processing system 230 or may be a means for interface with input and output devices (not shown) that the information processing system 230 may include. In Figure 3, the input / output interfaces 318 and 338 are shown as elements configured separately from the processors 314 and 334, but the system is not limited to this, and the input / output interfaces 318 and 338 can also be configured to be included in the processors 314 and 334.

[0055] The user terminal 210 and the information processing system 230 may include more components than those shown in Figure 3. However, it is not necessary to explicitly show most of the conventional components. According to one embodiment, the user terminal 210 can be implemented to include at least a portion of the aforementioned input / output device 320. The user terminal 210 may also further include other components such as a transceiver, a GPS (Global Positioning system) module, a camera, various sensors, and a database. For example, if the user terminal 210 is a smartphone, it may include components that are generally found in smartphones, and the user terminal 210 can be implemented to further include a variety of components such as an accelerometer, a gyroscope, a camera module, various physical buttons, buttons using a touch panel, input / output ports, and a vibrator for vibration.

[0056] In one embodiment, the processor 314 of the user terminal 210 can be configured to run an instant messaging application or a web browser application that provides an instant messaging service including a content sharing service during a call. In this case, the program code associated with the application can be loaded into the memory 312 of the user terminal 210. When the application is running, the processor 314 of the user terminal 210 can receive information and / or data provided by the input / output device 320 via the input / output interface 318, or receive information and / or data from the information processing system 230 via the communication module 316, process the received information and / or data, and store it in the memory 312. In addition, such information and / or data can be provided to the information processing system 230 via the communication module 316.

[0057] When an instant messaging application is running, the processor 314 can receive text and / or images entered or selected via an input device such as a touchscreen or keyboard connected to the input / output interface 318. The received text and / or images can be stored in memory 312 or provided to the information processing system 230 via the communication module 316 and network 220. For example, the processor 314 can receive information regarding content sharing requests and video call initiation requests via an input device such as a touchscreen or keyboard. The received requests and / or information can then be provided to the information processing system 230 via the communication module 316 and network 220.

[0058] The processor 314 of the user terminal 210 can be configured to manage, process, and / or store information and / or data received from the input / output device 320, other user terminals, the information processing system 230, and / or multiple external systems. The information and / or data processed by the processor 314 can be provided to the information processing system 230 via the communication module 316 and the network 220. The processor 314 of the user terminal 210 can transfer and output information and / or data to the input / output device 320 via the input / output interface 318. For example, the processor 314 can display the received information and / or data on the screen of the user terminal.

[0059] The processor 334 of the information processing system 230 can be configured to manage, process, and / or store information and / or data received from multiple user terminals 210 and / or multiple external systems. The information and / or data processed by the processor 334 can be provided to the user terminals 210 via the communication module 336 and the network 220. In Figure 3, the information processing system 230 is shown as a single system, but is not limited to this, and can consist of multiple systems / servers to provide various services associated with the instant messaging service. For example, the information processing system 230 may include a messenger server, a call server, and a media server.

[0060] Figure 4 shows an example in which a list 422 of multiple shared content items in a chat room is displayed on the screen in response to a "view together" request for shared content according to one embodiment of the present disclosure. As shown in the figure, the user can display a list 422 of multiple shared content items in a chat room on the screen through the first operation 410 and the second operation 420, and select content to view together with the other party during a call via the instant application. In one embodiment, the user can start a video call or voice call with a user included in a 1:1 chat room or a group chat room via the instant application.

[0061] The first action 410 shows an example where the user selects the "View Together" request icon 414, which is displayed at the bottom of the display during a call, by touch input or other means. For example, if a group call with four people is started, the call screen 412 will be displayed on the display, and the "View Together" request icon 414 will be displayed at the bottom of the display. During a call, the user can select the "View Together" request icon 414 to view content shared in the chat room together with the people in the chat room during the call.

[0062] The second action 420 shows an example where, in response to a user selecting the "View Together" request icon, a list 422 of multiple pieces of content shared within a chat room including the user currently on the call is displayed on the screen. The list 422 of multiple pieces of content may include a preview associated with the content shared in the chat room during the call, the upload date, the content title, and information about the user who uploaded it. In this case, the preview may be provided as a thumbnail of the content or as a preview. Here, the form of the preview associated with the content included in the list 422 of multiple pieces of content may be determined by the type of content or the category to which the content is classified. Furthermore, the previews associated with the content included in the list 422 of multiple pieces of content may be provided categorized by content type or category. One or more previews associated with content may be provided for each content type or category. The previews included in the list 422 of multiple pieces of content may be received from an external device (e.g., a messenger server or media server).

[0063] In one embodiment, the list 422 of multiple content items can be sorted and displayed in chronological order based on the time they were uploaded. In another embodiment, the list 422 of multiple content items can be sorted and displayed in order of similarity to the call topic. For example, when a user is on a call, the user's terminal or an external device (e.g., messenger server, media server, call server, etc.) can analyze the call data to detect the call topic (or keyword), determine the similarity between the detected call topic (or keyword) and the content shared in the chat room, and prioritize displaying the content with the highest similarity. In this case, the call topic / keyword can be determined by analyzing call data within a predetermined time and can be continuously changed / updated as the call progresses.

[0064] In one embodiment, the list 422 of multiple contents can be displayed categorized by type. For example, it can be displayed categorized as image and / or video content 424, image and / or video content 426 saved as an album, media content 428 linked to a URL (link information) shared in a chat room, SNS posts, web pages / webtoons, etc. The content classifications that make up the list 422 of multiple contents are not limited to these and can further include various content categories such as music, audio messages, specific web pages, etc.

[0065] Figure 5 shows an example of how the most similar talk room shared content to the call topic is automatically recommended as a shareable content candidate according to one embodiment of the present disclosure. As shown in the figure, the user can select the shareable content candidate 514 that is automatically recommended during the call by the first action 510 and the second action 520 as the shareable content, and view it together with the other party while talking.

[0066] The first operation 510 shows an example in which, during a call, n pieces of content (where n is a natural number) that have the highest similarity to the call topic from among multiple pieces of content shared in the chat room are displayed on the screen along with the call screen 512 as candidate content to be shared 514. For example, one piece of content with the highest similarity among content uploaded within a specific period (e.g., one week) can be determined as candidate content to be shared 514. Additionally or alternatively, one or more pieces of content whose similarity is above a predetermined threshold may be determined as candidate content to be shared 514. In one embodiment, a preview associated with the candidate content to be shared 514, information about the user who uploaded it to the chat room (e.g., Brown), information about the time it was uploaded to the shared chat room (e.g., yesterday), the title (e.g., Boy Idol - LOVE YOUR FRIENDS), etc., are displayed on the screen, so that the user can refer to them when deciding whether or not to proceed with the call while viewing them together with other users.

[0067] The second action 520 shows an example where, in response to the user selecting a shareable content candidate as shareable content, the shareable content 524 is displayed on the user terminal's display along with the call screen 522. Alternatively, only the shareable content 524 can be displayed on the display. The shareable content 524 can be displayed in sync on the user terminal of the user during the call. Figure 5 shows the shareable content 524 as a video, but it is not limited to this. For example, the shareable content 524 could be an image, music, a web page, a webtoon, etc.

[0068] Figure 6 shows an example in which video is displayed in sync on the terminals of call participants based on content control information according to one embodiment of the present disclosure. As shown in the figure, the user makes a control request for the shared content through the first operation 610 and the second operation 620, and multiple call participants can view the shared content together at the same playback position.

[0069] The first operation 610 illustrates an example in which a user controls the playback position of the shared video content 612 using user input 614. For example, while the shared video content 612 is being displayed synchronously on the displays of multiple user terminals participating in a call, the user can perform user input 614 to change the playback position on the playback control bar provided by the instant messaging application to another playback position.

[0070] The second operation 620 shows an example where the playback position of the shared video content 622 is changed to another playback position in response to user input 614. At this time, the screens of other users, etc., are also synchronized and the shared video content 622 is played at the changed playback position. In Figure 6, the shared content 612 and 622 are shown as video content, but are not limited to this and could be any content with a playback position (for example, music content). Also, in Figure 6, the call screens 616 and 624 are shown as video call screens, but are not limited to this. For example, if an audio call is in progress, the call screens 616 and 624 may not be displayed.

[0071] Figure 7 shows an example in which the enlargement or reduction of an image is synchronized on the other party's terminal based on content control information according to one embodiment of the present disclosure. As shown in the figure, the user makes control requests to the shared content through the first operation 710 and the second operation 720, and can enlarge, reduce, or move the content, such as an image, so that it can be viewed together with multiple callers.

[0072] The first operation 710 illustrates an example in which a user controls the shared image content 712 by user input 714. For example, while the shared image content 712 is being displayed in sync on the displays of multiple user terminals participating in a call, a user can perform user input 714 to enlarge, reduce, or move the shared image content 712.

[0073] The second action 720 shows an example where the shared image content 722 is enlarged and displayed in response to a user's request for image enlargement control. At this time, the screens of other users, etc., are also synchronized and the shared image content 722 is displayed. Figure 7 shows an example where the image is enlarged in a synchronized manner, but it is not limited to this, and any content that can be enlarged, reduced, or moved on the screen by dragging or pinch gestures (e.g., videos, web pages, webtoons, etc.) can be displayed in a synchronized manner on multiple user terminals.

[0074] Figure 8 shows an example in which the scroll position of a web page is synchronized on the other party's terminal based on content control information according to one embodiment of the present disclosure. As shown in the figure, the user makes a control request for the shared content through the first operation 810 and the second operation 820, and synchronizes the scroll position of the web page so that it can be viewed together with multiple callers.

[0075] The first action 810 demonstrates an example where a user controls the scroll position of a shared webpage using user input 812. For example, while a shared webpage is being displayed synchronously on the displays of multiple user terminals participating in a call, a user can scroll the shared webpage using user input 812, such as drag input.

[0076] The second operation 820 shows an example where the scroll position of the shared webpage is changed and displayed in response to a user's request to control the scroll position of the webpage. At this time, the screens of other users, etc., are also synchronized and the shared webpage is scrolled and displayed. Figure 8 shows an example where the scroll position of a webpage is changed, but it is not limited to this, and any content that allows for scroll position movement can be displayed in synchronization on multiple user terminals.

[0077] Figure 9 is a flowchart illustrating a method for sharing content during a call between a user terminal 910, a first external device 930, a second external device 940, and a counterpart user terminal 950 according to one embodiment of the present disclosure. In one embodiment, the user terminal 910 and the counterpart user terminal 950 may be user terminals associated with user accounts included in the same chat room of an instant messaging application. The first external device 930 may refer to a system (e.g., a messenger server and a call server) that provides instant messaging services between users included in a chat room and initiates a call between the counterpart user terminal 950 included in the same chat room upon a call request from the user terminal 910, and sends and receives call data. Here, the first external device 930 may consist of a single server or multiple servers, in the latter case the messenger server and the call server may consist of separate servers.

[0078] The second external device 940 may refer to a system (e.g., a media server) that stores content such as text, images, and videos uploaded to the talk room of an instant messaging application. In other examples, the second external device 940 may refer to a media streaming system, SNS system, etc., operated and / or managed by a third party different from the entity providing the instant messaging service. In one embodiment, the entity providing the instant messaging service and the entity providing the media streaming service, SNS, etc., may be the same. In Figure 9, the first external device 930 and the second external device 940 are shown as separate configurations, but the system is not limited to this, and the first external device 930 and the second external device 940 can also be configured as a single system.

[0079] As shown in the figure, the first external device 930 can receive a call request (912) from the user terminal 910. The call request (912) may include information about the other party's user account and / or the other party's user terminal 950. The first external device 930 can forward the call request (932) to the other party's user terminal 950 included in the call request from the user terminal 910. Subsequently, the first external device 930 can receive call approval (952) information from the other party's user terminal 950 that received the call request. Upon receiving the call approval (952) information, the first external device 930 can initiate a call (934) between the user terminal 910 and the other party's user terminal 950. When a call is initiated, a data channel is created, and the user terminal 910 and the other party's user terminal 950 can exchange data (e.g., call data and content sharing-related data) via the first external device 930.

[0080] Subsequently, user terminal 910 can forward the "view together" request (914) associated with the shared content to the other user terminal 950 via the first external device 930. Additionally or alternatively, user terminal 910 can forward the "view together" request (914) associated with the shared content directly to the other user terminal 950. Here, the shared content may be one of the contents shared within a chat room that includes both the user account associated with user terminal 910 and the other user account associated with the other user terminal 950. For example, the shared content can be determined by the user selecting one of the previews (e.g., thumbnails) of the content shared within the chat room received from the second external device 940. In one embodiment, the "view together" request (914) may include shared content identification information. The selection of the shared content is performed as described above with reference to Figures 4 and 5.

[0081] In one embodiment, after user terminal 910 forwards a "view together" request (914) to the other user terminal 950, the "view together" function for the shared content can be executed without confirmation from the other user. Alternatively, if the other user terminal 950 approves the "view together" request, the "view together" function for the shared content will be executed. When initiating the "view together" function for the shared content, user terminal 910 forwards the shared content identification information 916 to a second external device 940 and receives the shared content 942 associated with the shared content identification information 916 from the second external device 940. For example, if it is determined that the shared content is not stored on user terminal 910, the shared content identification information 916 can be forwarded to the second external device 940 and the shared content 942 can be received. Alternatively, if it is determined that the shared content 942 is stored on the user terminal 910, the user terminal 910 can use the data stored in its internal memory or elsewhere without receiving data from the second external device 940. Alternatively, when starting "view together" of the shared content, the user terminal 910 can transfer the shared content identification information 916 to the first external device 930 and receive the shared content 942 associated with the shared content identification information 916 from the first external device 930.

[0082] Similarly, the other user terminal 950 can also transfer the shared content identification information 916 to the second external device 940 and receive the shared content 944 associated with the shared content identification information 916 from the second external device 940. Here, the shared content 942 and the shared content 944 may be the same data. Then, user terminal 910 and the other user terminal 950 can output the same shared content 942 and 944 on their displays (918, 956). At this time, the shared content can be displayed on the display together with the call screen. Alternatively, the other user terminal 950 can also transfer the shared content identification information 916 to the first external device 930 and receive the shared content 944 associated with the shared content identification information 916 from the first external device 930.

[0083] While the shared content is being synchronized and output on the displays of user terminal 910 and the other user terminal 950, user terminal 910 can receive a shared content control request from the user and transfer control information 920 to the other user terminal 950 via the first external device 930. Here, if the shared content is music or video, the control information 920 may include information about the playback position. Alternatively, if the shared content is an image, the control information 920 may include information about enlarging, shrinking, or moving the image. Alternatively, if the shared content is a web page or webtoon, the control information 920 may include information about the scroll position. The other user terminal 950 receives the control information 920 and can display the shared content synchronized with user terminal 910 on its display.

[0084] Figure 10 is a flowchart of a method 1000 for sharing content during a call according to one embodiment of the present disclosure. Method 1000 can be executed by at least one processor of a user terminal. As shown in the figure, method 1000 can be initiated by initiating a call via a first external device between a user account associated with a user terminal included in a talk room of an instant messaging application and another user account associated with another user terminal (S1010).

[0085] While a call is in progress between a user account and other user accounts, the processor can forward a "view together" request associated with the shared content selected by the user to a first external device (S1020). Here, the shared content may be one of several pieces of content shared within the chat room. The "view together" request also includes identification information for the shared content, and other user terminals can receive the identification information for the shared content via the first external device.

[0086] In one embodiment, upon determining that the shared content is not stored on the user terminal, the processor transfers the identification information of the shared content to a second external device and can receive the shared content from the second external device. Other user terminals can receive the shared content from the second external device using the identification information of the shared content received via the first external device. Subsequently, the processor can display the shared content on the user terminal's display along with the call screen (S1030). At this time, the shared content can be displayed in sync on the user terminal's display and the displays of other user terminals. Then, upon receiving a control request from the user regarding the shared content (S1040), the processor can transfer control information corresponding to the control request to other user terminals via the first external device (S1050).

[0087] The methods described above may be provided as computer programs stored on computer-readable recording media for execution on a computer. The media may be used to continuously store computer-executable programs or to temporarily store them for execution or download. Furthermore, the media may be a variety of recording or storage means, often in the form of a single or multiple hardware components combined, and is not limited to media directly connected to a computer system, but may be distributed across a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; ROM, RAM, and flash memory, all configured to store program instructions. Other examples of media include recording media or storage media managed by app stores and other sites, servers, and other software distribution sites.

[0088] The methods, operations, or techniques described herein can be implemented by a variety of means. For example, such techniques can be implemented in hardware, firmware, software, or a combination thereof. The various exemplary logical blocks, modules, circuits, and algorithmic steps described herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate such mutual substitutability between hardware and software, various exemplary components, blocks, modules, circuits, and steps have been generally described in terms of their functional aspects. Whether such functions are implemented as hardware or as software depends on the design requirements attached to the particular application and the overall system. Functions described in a variety of ways can also be implemented for each specific application, but such implementations shall not be construed as departing from the scope of this disclosure.

[0089] In hardware implementation, the processing units used to implement the technique may be implemented in one or more ASICs, DSPs, digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described herein, computers, or combinations thereof.

[0090] Accordingly, the diverse exemplary logic blocks, modules, and circuits described herein can also be implemented in any combination of general-purpose processors, DSPs, ASICs, FPGAs and other programmable logic devices, discrete gates and transistor logic, discrete hardware components, or any other devices designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but alternatively, a processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented in a combination of computing devices, such as a DSP and a microprocessor, multiple microprocessors, a DSP core and one or more associated microprocessors, or any other combination of configurations.

[0091] Firmware and / or software may be implemented as instructions stored on a computer-readable medium such as RAM (random access memory), ROM (read-only memory), NVRAM (non-volatile random access memory), PROM (programmable read-only memory), EPROM (erasable programmable read-only memory), EEPROM (electrically erasable PROM), flash memory, CD (compact disc), or magnetic or optical data storage devices. The instructions may be executable by one or more processors, and the processors may be configured to perform specific modes of the functions described herein.

[0092] When embodied in software, the technique may be stored on or transferred via a computer-readable medium as one or more instructions or code. A computer-readable medium includes any medium that facilitates the transfer of a computer program from one location to another, and includes both computer storage media and communication media. The storage medium can be any available medium accessible by a computer. As a non-limiting example, such a computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium accessible by a computer that can be used to transfer or store desired program code in the form of instructions or data structures. Furthermore, any connection may appropriately be referred to as a computer-readable medium.

[0093] For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, lead wire, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, lead wire, digital subscriber line, or wireless technologies such as infrared, radio, and microwave are included within the definition of a medium. The terms "disk" and "disc" used in this disclosure include CD, LaserDisc®, optical disc, DVD (digital versatile disc), floppy disk, and Blu-ray disc, where typically a disk reproduces data magnetically, while a disc reproduces data optically using a laser. Combinations of the above may also be included within the scope of computer-readable media.

[0094] Software modules may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disks, portable disks, CD-ROMs, or any other known form of storage medium. An exemplary storage medium may be linked to the processor so that the processor reads information from or writes information to the storage medium. Alternatively, the storage medium may be integrated into the processor. The processor and storage medium may reside within an ASIC. The ASIC may reside within a user terminal. Alternatively, the processor and storage medium may exist as separate components in the user terminal.

[0095] The embodiments described above are described as utilizing aspects of the subject matter currently disclosed in one or more standalone computer systems, but the disclosure is not limited to such embodiments and can be embodied in any computing environment, such as networks or distributed computing environments. Furthermore, aspects of the subject matter in the disclosure can be embodied in multiple processing chips or devices, and storage may be similarly affected across multiple devices. Such devices may include PCs, network servers, and portable devices.

[0096] While this specification has described the present disclosure by some examples, these examples can be modified in various ways without departing from the disclosure, to the extent that a person of the ordinary skill in the art to which the invention of this disclosure belongs can understand them. Such modifications should be understood to fall within the scope of the claims appended to this specification. [Explanation of symbols]

[0097] 110 users 120 user terminals 122 Shared Content 124 Call screen 210 User terminals 220 Networks 230 Information Processing Systems

Claims

1. A method for sharing content during a call, which is executed by at least one processor on the user terminal, The steps include: initiating a call via a first external device between a user account associated with the user terminal included in a talk room of an instant messaging application, and another user account associated with another user terminal; The steps include displaying a list of multiple pieces of content shared within the aforementioned chat room on the screen, The steps include receiving a selection for one of the aforementioned multiple contents, The steps include: transferring a content sharing request associated with a shared content, which is one of several pieces of content shared within the aforementioned talk room, to the first external device; The steps include displaying the shared content on the user terminal's display along with the call screen, Includes, The list of multiple pieces of content shared within the aforementioned chat room includes previews associated with the aforementioned multiple pieces of content, A content sharing method in which previews associated with the aforementioned multiple contents are received from a second external device.

2. The content sharing method according to claim 1, wherein the shared content is displayed in a synchronized manner on the display of the user terminal and the display of the other user terminal.

3. The content sharing request includes identification information of the content to be shared, The content sharing method according to claim 1, wherein the other user terminal receives identification information of the shared content via the first external device.

4. The steps include: determining that the shared content is not stored on the user terminal, transferring the identification information of the shared content to a second external device; The steps include receiving the shared content from the second external device, The content sharing method according to claim 3, further comprising:

5. The content sharing method according to claim 4, wherein the other user terminal receives the shared content from the second external device using the identification information of the shared content received via the first external device and displays it on the display of the other user terminal together with the call screen.

6. The content sharing method according to claim 1, wherein the list of multiple contents is displayed in order of newest first.

7. The content sharing method according to claim 1, wherein the list of multiple contents is displayed in order of similarity to the subject of the call.

8. The content sharing method according to claim 1, wherein the subject of the call is determined by analyzing call data within a predetermined time.

9. A method for sharing content during a call, which is performed by at least one processor of a user terminal, The steps include: initiating a call via a first external device between a user account associated with the user terminal included in a talk room of an instant messaging application, and another user account associated with another user terminal; The steps include: displaying, on the user's terminal display along with the call screen, the content that is most similar to the call topic among the multiple pieces of content shared in the aforementioned chat room, as a candidate for content to be shared; The steps include receiving user input to select the candidate shared content as the shared content, The steps include: transferring a content sharing request associated with the shared content to the first external device; The steps include: displaying the shared content on the display along with the call screen; Includes, A content sharing method wherein information about the user who uploaded the candidate for the content to be shared to the chat room, or information about the time the candidate for the content to be shared to the chat room was uploaded, is displayed on the display along with a preview associated with the candidate for the content to be shared.

10. The content sharing method according to claim 9, wherein the call topic is determined by analyzing call data within a predetermined time.

11. The steps include receiving a control request from a user regarding the shared content, The steps include transferring control information corresponding to the control request to the other user terminal via the first external device, The content sharing method according to claim 1, further comprising:

12. The shared content is music or video. The content sharing method according to claim 11, wherein the control information includes information regarding the playback position.

13. The shared content is an image. The content sharing method according to claim 11, wherein the control information includes information regarding scaling up or down.

14. The shared content is a web page. The content sharing method according to claim 11, wherein the control information includes information regarding the scroll position.

15. A computer program stored on a computer-readable recording medium for executing the content sharing method according to any one of claims 1 to 11 on a computer.

16. Communication module and The display and Memory and A user terminal comprising: at least one processor connected to the memory and configured to execute a computer-readable program contained in the memory, The aforementioned program, A call is initiated via a first external device between a user account associated with the user terminal included in a talk room of an instant messaging application, and between other user accounts associated with other user terminals. A list of multiple pieces of content shared within the aforementioned chat room is displayed on the screen. Upon receiving a selection for one of the aforementioned multiple contents, The content sharing request associated with the content to be shared is transferred to the first external device. The command includes instructions for displaying the shared content on the user terminal's display along with the call screen, The list of multiple pieces of content shared within the aforementioned chat room includes previews associated with the aforementioned multiple pieces of content, The aforementioned preview is received from a second external device, a user terminal.

17. The user terminal according to claim 16, wherein the shared content is displayed in sync on the display of the user terminal and the display of the other user terminal.

Images