Programs, information processing methods, terminals

The integration of advertising within chat rooms in live chat broadcasts is achieved by a program that separates and displays user content and ads in distinct areas, improving user engagement and revenue generation.

JP7866372B2Active Publication Date: 2026-05-27LY CORP

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
LY CORP
Filing Date
2021-08-06
Publication Date
2026-05-27

AI Technical Summary

Technical Problem

Existing chat services lack effective integration of advertising within chat rooms, particularly in live chat broadcasts, which can enhance user engagement and revenue generation.

Method used

A program executed by a terminal that displays a chat room for user interactions, receives and separates user content and advertising information, and integrates them in distinct areas on the display, allowing for seamless integration of advertisements within the chat experience.

Benefits of technology

Enhances user engagement and revenue generation by effectively incorporating advertising within chat rooms, particularly during live broadcasts, without disrupting the primary user interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007866372000001
    Figure 0007866372000001
  • Figure 0007866372000002
    Figure 0007866372000002
  • Figure 0007866372000003
    Figure 0007866372000003
Patent Text Reader

Abstract

To improve convenience in chatting.SOLUTION: A program, which is executed by a terminal communicating with a server, makes the terminal execute: controlling, by a control unit of the terminal, to display on a display unit of the terminal a chat room for displaying a content transmitted / received between a first user and a second user; receiving from the server, by a communication unit of the terminal, the content transmitted / received between the first user and the second user; controlling, by the control unit, to display in a first area of the chat room the content transmitted / received between the first user and the second user; receiving from the server, by the communication unit, a first content that is input by a third user different from the first user and the second user; controlling, by the control unit, to display the first content in a second area different from the first area in the chat room; receiving from the server, by the communication unit, advertisement information about an advertisement; and controlling, by the control unit, to display the advertisement information in the first area.SELECTED DRAWING: Figure 1-1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0004] , , , ,

[0001] The present disclosure relates to a program, an information processing method, a terminal, etc.

Background Art

[0002] Users are increasingly using chat services such as messaging services using terminals such as smartphones and personal computers. For example, Patent Document 1 discloses a technology related to a messaging service.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

[0004] According to a first aspect of the present invention, a program executed by a terminal communicating with a server causes a control unit of the terminal to perform control to display a chat room for displaying content transmitted and received between a first user and a second user on a display unit of the terminal, receive content transmitted and received between the first user and the second user from the server by a communication unit of the terminal, perform control by the control unit to display the content transmitted and received between the first user and the second user in a first area of the chat room, receive first content input by a third user different from the first user and the second user from the server by the communication unit, perform control by the control unit to display the first content in a second area different from the first area of the chat room, receive advertisement information related to an advertisement from the server by the communication unit, and perform control by the control unit to display the advertisement information in the first area. According to a second aspect of the present invention, the information processing method for a terminal communicating with a server includes: the terminal's control unit controlling the display unit of the terminal to display a chat room showing content transmitted and received between a first user and a second user; the terminal's communication unit receiving content transmitted and received between the first user and the second user from the server; the control unit controlling the display of the content transmitted and received between the first user and the second user in a first area of ​​the chat room; the communication unit receiving first content input by a third user different from the first and second users from the server; the control unit controlling the display of the first content in a second area different from the first area of ​​the chat room; the communication unit receiving advertising information related to advertisements from the server; and the control unit controlling the display of the advertising information in the first area. According to a third aspect of the present invention, a terminal communicating with a server includes a processor that reads a program stored in memory and executes processing based on the program, and the processor performs the following actions: control to display a chat room on the terminal's display unit that displays content sent and received between a first user and a second user; receive content sent and received between the first user and the second user from the server via the terminal's communication unit; control to display the content sent and received between the first user and the second user in a first area of ​​the chat room; receive first content entered by a third user different from the first and second users from the server via the communication unit; control to display the first content in a second area different from the first area of ​​the chat room; receive advertising information related to advertisements from the server via the communication unit; and control to display the advertising information in the first area. According to a fourth aspect of the present invention, a program executed by a terminal communicating with a server is performed by the terminal's control unit to display a chat room that shows content sent and received between a first user and a second user on the terminal's display unit, based on a first input from the terminal's user to the terminal; the terminal's communication unit receives from the server, based on the first input, the content sent and received between the first user and the second user, and first content input by a third user different from the first and second users; the control unit to display the content sent and received between the first user and the second user in a first area of ​​the chat room and the first content in a second area different from the first area of ​​the chat room, based on a second input from the terminal's user to the chat room displayed on the display unit; and the control unit to receive advertising information related to advertisements from the server and to display the advertising information in the first area. According to a fifth aspect of the present invention, a program executed by the user's terminal is performed by the terminal to display a chat room including a first user different from the user and the user on the terminal's display unit, to receive advertising information sent from the user and a sender different from the first user via the terminal's communication unit, and to control the display of the advertising information in the chat room via the terminal's control unit. [Brief explanation of the drawing]

[0005] [Figure 1-1] A diagram showing an example of the system configuration of a communication system according to the embodiment. [Figure 1-2] A diagram showing an example of a function realized by the control unit of the server according to the first embodiment. [Figure 1-3] A diagram showing an example of information stored in the storage unit of the server according to the first embodiment. [Figure 1-4] A diagram showing an example of account registration data related to the first embodiment. [Figure 1-5] A diagram showing an example of an advertising management database according to the first embodiment. [Figure 1-6] A diagram showing an example of the server configuration according to the first embodiment. [Figure 1-7] A diagram showing an example of a function realized by the control unit of the terminal according to the first embodiment. [Figure 1-8] A diagram showing an example of information stored in the memory unit of the terminal according to the first embodiment. [Figure 1-9] A diagram showing an example of a screen displayed on the display unit of a terminal according to the first embodiment. [Figure 1-10] A diagram showing an example of a screen displayed on the display unit of a terminal according to the first embodiment. [Figure 1-11] A diagram showing an example of a screen displayed on the display unit of a terminal according to the first embodiment. [Figure 1-12] A diagram showing an example of a screen displayed on the display unit of a terminal according to the first embodiment. [Figure 1-13] A flowchart showing an example of the processing flow performed by each device according to the first embodiment. [Figure 1-14] A flowchart showing an example of the processing flow performed by each device according to the first embodiment. [Figure 1-15] A diagram showing an example of a screen displayed on the display unit of the terminal relating to the first modified example. [Figure 1-16] A flowchart showing an example of the processing flow performed by each device in the first modified example. [Figure 1-17] A diagram showing an example of a screen displayed on the display unit of the terminal relating to the first modified example. [Figure 1-18] This figure shows an example of a screen displayed on the display unit of the terminal relating to the first modified example. [Figure 1-19] A flowchart showing an example of the processing flow performed by each device in the first modified example. [Figure 1-20] A diagram showing an example of detailed advertising data related to the first modified example. [Figure 1-21] A diagram showing an example of a screen displayed on the display unit of the terminal relating to the first modified example. [Figure 1-22] A diagram showing an example of a screen displayed on the display unit of the terminal relating to the first modified example. [Figure 1-23] A diagram showing an example of a screen displayed on the display unit of the terminal relating to the first modified example. [Figure 1-24]A diagram showing an example of a screen displayed on the display unit of a terminal according to the first modification example. [Figure 2-1] A diagram showing an example of a live chat archive database according to the second embodiment. [Figure 2-2] A diagram showing an example of a screen displayed on the display unit of a terminal according to the second embodiment. [Figure 2-3] A diagram showing an example of a screen displayed on the display unit of a terminal according to the second embodiment. [Figure 2-4] A flowchart showing an example of the flow of processing executed by each device according to the second embodiment. [Figure 2-5] A flowchart showing an example of the flow of processing executed by each device according to the second embodiment. [Figure 2-6] An explanatory diagram of content display control according to the second embodiment. [Figure 3-1] A diagram showing an example of a screen displayed on the display unit of a terminal according to the third embodiment [Figure 3-2] A flowchart showing an example of the flow of processing executed by each device according to the third embodiment. [Figure 4-1] A diagram showing an example of a screen displayed on the display unit of a terminal according to the fourth embodiment. [Figure 4-2] A diagram showing an example of a screen displayed on the display unit of a terminal according to the fourth embodiment. [Figure 4-3] A diagram showing an example of a screen displayed on the display unit of a terminal according to the fourth embodiment. [Figure 4-4] A flowchart showing an example of the flow of processing executed by each device according to the fourth embodiment. [Figure 4-5] A diagram showing an example of a screen displayed on the display unit of a terminal according to the fourth modification example. [Figure 4-6] A diagram showing an example of a screen displayed on the display unit of a terminal according to the fourth modification example. [Figure 4-7] A flowchart showing an example of the flow of processing executed by each device according to the fourth modification example. [Figure 5-1] A diagram showing an example of a screen displayed on the display unit of a terminal according to the fifth embodiment. [Figure 5-2]A flowchart showing an example of the processing flow performed by each device according to the fifth embodiment. [Figure 5-3] A diagram showing an example of a screen displayed on the display unit of a terminal relating to the fifth modified example. [Figure 6-1] A diagram showing an example of a screen displayed on the display unit of a terminal according to the sixth embodiment. [Figure 6-2] A diagram showing an example of a screen displayed on the display unit of a terminal according to the sixth embodiment. [Figure 6-3] A flowchart showing an example of the processing flow performed by each device according to the sixth embodiment. [Figure 6-4] A diagram showing an example of a screen displayed on the display unit of a terminal according to the sixth embodiment. [Figure 7-1] A diagram showing an example of a screen displayed on the display unit of a terminal according to the seventh embodiment. [Figure 8-1] A diagram showing an example of a screen displayed on the display unit of a terminal according to the eighth embodiment. [Figure 8-2] A diagram showing an example of a screen displayed on the display unit of a terminal according to the eighth embodiment. [Modes for carrying out the invention]

[0006] <Compliance with legal matters> Please note that the disclosures described herein are subject to compliance with the laws of the implementing country, including the confidentiality of communications, which are necessary for the implementation of these disclosures.

[0007] <Embodiment> This specification includes phrases such as "as an example, not an limitation" for clarity, but please note that this does not limit the scope of the embodiments described below to those specific phrases.

[0008] Embodiments for implementing the program etc. related to this disclosure will be described with reference to the drawings.

[0009] A system, not limited to but as an example, can be defined as a system comprising multiple devices. Multiple devices may be a combination of devices of the same type, a combination of devices of different types, or a combination of devices of the same type and devices of different types. Furthermore, the term "system" can also be thought of, not as a limited definition, but as an example, as a system in which multiple devices work together to perform some kind of processing.

[0010] Furthermore, a system involving a client (client device) and a server can be considered, not as an exhaustive list, but as an example, as at least one of the following: (1) Terminals & Servers (2) Server (3) terminal

[0011] (1) is, as an example and not an limitation, a system comprising at least one terminal and at least one server. This example is a client-server system.

[0012] The server may consist of the following devices, not as an example but as an exception, and may be a single device or a combination of multiple devices.

[0013] Specifically, a server may consist of, but is not limited to, at least one processor (for example, a CPU: Central Processing Unit, a GPU: Graphics Processing Unit, an APU: Accelerated Processing Unit, a DSP: Digital Signal Processor (for example, an ASIC: Application Specific Integrated Circuit, an FPGA: Field Programmable Gate Array), etc.), a computer device (processor + memory), a control device, an arithmetic unit, a processing unit, etc., and may be configured with multiple identical units of any one device (for example, a CPU + CPU, a homogeneous multicore processor, etc.), or with multiple heterogeneous units of any one device (for example, a CPU + DSP, a heterogeneous multicore processor, etc.), or with a combination of multiple devices (for example, a processor + computer device, a processor + arithmetic unit, a heterogeneous configuration of multiple devices, etc.). Note that the processor may be a virtual processor.

[0014] Furthermore, when a server performs some processing, if it is configured as a single device, the processing described in the embodiment will be performed by that single device. If it is configured as having multiple devices, some processing may be performed by one device and other processing may be performed by the other devices. As an example, and not an limitation, if it is configured as having a processor and an arithmetic unit, the first processing may be performed by the processor and the second processing may be performed by the arithmetic unit. Furthermore, if the system consists of multiple devices, each device may be arranged in a location that is physically separated from the others.

[0015] Furthermore, the server's functionality is not limited; for example, it may be provided in the form of PaaS, IaaS, or SaaS in cloud computing.

[0016] Furthermore, the system's control unit can be at least one of either the terminal's control unit or the server's control unit. In other words, the system's control unit can be any of the following, not limited to: (1A) only the terminal's control unit, (1B) only the server's control unit, or (1C) both the terminal's control unit and the server's control unit.

[0017] Furthermore, the control and processing performed by the system's control unit (hereinafter collectively referred to as "control, etc.") may be (1A) performed solely by the terminal's control unit, (1B) performed solely by the server's control unit, or (1C) performed by both the terminal's control unit and the server's control unit. Furthermore, (1C) is not an limitation but an example in which some of the controls that the system would normally perform are performed by the control unit of the terminal, and the remaining controls are performed by the control unit of the server. In this case, the allocation of controls may be equal, or they may be allocated in different proportions.

[0018] Furthermore, when referring to the server's communication unit, if the server is composed of a single device, it may refer to the communication unit itself provided by that single device. Also, if the server is composed of multiple devices, the server's communication unit may include the communication units provided by each of those devices. As an example, and not an limitation, if a server comprises a first device and a second device, with the first device having a first communication unit and the second device having a second communication unit, then the communication unit of the server may be considered a concept that includes both the first and second communication units.

[0019] (2) may, as an example and not an limitation, be a system consisting of multiple servers (hereinafter referred to as the "server system"). In this case, the configuration described above can be applied similarly to the configuration of each server.

[0020] The control and other functions performed by the server system may be performed by (2A) only one server, (2B) only the other servers, or (2C) one server and the other servers. Furthermore, (2C) is not limited to but is an example in which one server may perform some of the controls that the server system performs, and the remaining controls may be performed by other servers. In this case, the allocation of controls may be divided equally, or it may be allocated in different proportions.

[0021] (3) can be a system consisting of multiple terminals, not an exhaustive example. This system can be, as an example and not limited to, the following: • A system (distributed system) that assigns server functions to terminals. This is not limited to this example, but can be achieved using blockchain technology. A system in which terminals communicate wirelessly with each other. This is not limited to this, but can be achieved by using short-range wireless communication technologies such as Bluetooth (registered trademark) to communicate in a P2P (peer-to-peer) manner.

[0022] Furthermore, the above applies not only to the control unit but also to each functional unit that can be a component of the system, such as the input / output unit, communication unit, memory unit, and clock unit.

[0023] In the following embodiments, a system including terminals and servers (a client-server system, for example, is provided as an example, but is not an limitation) is illustrated. Furthermore, it is also possible to apply the server system described in (2) above as the server.

[0024] Furthermore, instead of a system that includes terminals and servers, it is also possible to apply a system that does not include a server, such as the system described in (3) above, not as a limitation but as an example. In this case, the embodiment can be constructed based on the aforementioned blockchain technology. Specifically, and not limited to, but as an example, data stored and managed on the server described in the following embodiment is stored on the blockchain. Then, when a terminal generates a transaction to the blockchain and the transaction is approved on the blockchain, the data stored on the blockchain is updated.

[0025] Furthermore, even when the term "terminal" is used, it is not limited to the meaning of a terminal as a client device in a client-server system. In other words, the term "terminal" can sometimes include the concept of a device that is not part of a client-server relationship.

[0026] Furthermore, the expression "by communication I / F" is used as appropriate in this specification. This is not an limitation, but rather an example that the device may send and receive various information and data via a communication I / F (via a communication unit) based on the control of a control unit (processor, etc.).

[0027] Furthermore, in this specification, when terms such as "concerning" or "related" are used, "B concerning A" or "B related to A" may be used not as an limitation, but as an example, to mean "B" that has some kind of relationship with "A". Specific examples will be given later.

[0028] Furthermore, in this specification, when a device processes two or more things, such as "transmitting A and B" or "receiving A and B," it may include both cases where "A" and "B" are performed at the same time (hereinafter referred to as "simultaneous") and cases where "A" and "B" are performed at different times (hereinafter referred to as "non-simultaneous"). As an example, rather than being limited, when we say that we are transmitting the first piece of information and the second piece of information, we may include both concepts: transmitting the first piece of information and the second piece of information at the same time, and transmitting the first piece of information and the second piece of information at different times. Furthermore, taking into consideration lag (time lag), "simultaneous" may include "almost simultaneous."

[0029] Furthermore, even if "A" and "B" are performed at different times, this only requires that the processing targets "A" and "B," and their purposes do not necessarily have to be the same. As an example, rather than being limited, when transmitting the first and second pieces of information as described above, it is sufficient to simply transmit the first and second pieces of information, and this may include cases where the first and second pieces of information are transmitted for different purposes, as well as cases where they are transmitted for the same purpose.

[0030] In the following examples, a messaging service is used as an example of a service for users to chat (hereinafter referred to as the "chat service"). Furthermore, an application for implementing the chat service is referred to as a "chat application," and an application for implementing the messaging service is referred to as a "messaging application." A chat application may, but not exclusively, allow users to chat in chat rooms. Similarly, a chat application may, or may not exclusively, allow users to make calls (such as voice or video calls).

[0031] Furthermore, messaging services (MS) (including instant messaging services: IMS) can be considered a form of social networking services (SNS). Therefore, a distinction may or may not be made between messaging services and social networking services. In other words, messaging services may be included within the definition of social networking services.

[0032] Furthermore, in the following embodiment, as an example of a messaging service, we illustrate an Instant Messaging Service (IMS) that sends and receives content in the form of simple messages between multiple devices (not limited to, but for example, terminals) via a server. Instant messaging applications may, but not exclusively, allow users to chat in chat rooms. Similarly, instant messaging applications may, or may not exclusively, allow users to make calls (such as voice or video calls).

[0033] A chat room (or, for example, a talk room) can be a UI (User Interface) or GUI (Graphical User Interface) that allows content sent and received between multiple users' devices to be viewed by each user.

[0034] Furthermore, the chat rooms may include one-on-one chat rooms (hereinafter referred to as "one-on-one chat rooms"), group chat rooms containing multiple users (hereinafter referred to as "group chat rooms"), and chat rooms with users of official accounts (hereinafter referred to as "official chat rooms").

[0035] For data management purposes, a one-on-one chat room may be managed as a chat room for one user or one account, or it may be managed as a chat room for a group consisting of two users or two accounts.

[0036] Official accounts are not accounts of ordinary users but accounts of businesses (accounts of business users), and users of these official accounts can, for example, use devices similar to those of ordinary users, not just limited to, to send and receive content (messages) with other devices via the server.

[0037] In this specification, content may be information transmitted from a sender to a recipient. Content may also be one or more pieces of content.

[0038] Content may include, but is not limited to, text content in text format, image content in image format (including at least one of both still images and moving images), and sound content in sound format (including voice). In addition, other elements such as buttons and icons for user interaction, as well as link information (not limited to these, but including, for example, URIs (Uniform Resource Identifiers)) and other link content may also be included.

[0039] The text may, but not be limited, include at least one of the following: national characters represented by character codes, extended characters, machine-dependent characters, numbers, symbols, figures, and codes. Note that the text does not have to include at least one of the above characters, extended characters, machine-dependent characters, numbers, symbols, figures, and codes, but may include other text.

[0040] Images can include, but are not limited to, at least one of the following types of image information: icons, buttons, stamps, emojis, banner images, etc.

[0041] Furthermore, in the following embodiments, a live chat service is given as an example of a service for users to broadcast or view live chats. The application used to implement the live chat service is referred to as a "live chat application."

[0042] The following are examples of forms that can be used to implement a live chat service, but they are not limited to any specific form. (A) A form in which a live chat service function is provided as a feature of a messaging application. (B) Forms of an application that has the functionality of a live chat service and the functionality of a messaging service (integrated application) (C) A form in which a messaging application is configured as a separate application from the live chat application.

[0043] In forms (A) and (B), the live chat service provider can be the same type of provider as the messaging service provider, not as an exclusive example, but as an example. In this case, one possible approach is to use a common account for both the user's account in the messaging application and the user's account in the live chat application. Alternatively, in this case, the user's account in the messaging application and the user's account in the live chat application can be automatically associated (linked).

[0044] In form (C), the live chat service provider may be a different business from the messaging service provider, not as an example but as an exception. Furthermore, in form (C), it is possible to perform a process that associates (links) a user's account in the messaging application with a user's account in the live chat application.

[0045] In contrast to the above, it is also possible to incorporate messaging service functionality as a feature within the live chat application.

[0046] Furthermore, in this embodiment, expressions such as "content is sent and received between users" and "content is sent and received between terminals" may be used, but these can be considered substantially synonymous. Furthermore, when applying a client-server system, it is possible to configure it so that content is sent and received between terminals via the server, and this can also be described as sending and receiving content between users or between terminals. Also, as mentioned above, it is also possible to send and receive content between terminals without applying a client-server system. The same applies to various types of information other than content.

[0047] <First Example> The first embodiment, as an example and not an exhaustive one, is an embodiment in which advertising information is displayed in a chat room (a talk room, as an example and not an exhaustive one) during a live chat broadcast by a live chat broadcaster.

[0048] In the following, a company that provides messaging services through messaging applications will be referred to as a "messaging service provider." Furthermore, a messaging service provider can also be described as a provider of messaging applications or a provider of server 10.

[0049] Furthermore, in the following, the messaging application will be referred to as "Messaging App" as appropriate in the illustrations and explanations. Furthermore, the following examples illustrate, rather than being limited, the case where a live chat service is provided within a messaging application.

[0050] Furthermore, in this embodiment, the live chat broadcast by the live streamer is not limited to, but as an example, it takes place in a talk room that includes a streamer who sets up a talk room for live chat (hereinafter referred to as the "main streamer") and a streamer who is invited by the main streamer to participate in the live chat and talk with the main streamer in the talk room (hereinafter referred to as the "sub-streamer"). This will be explained as a live chat that viewers can watch and participate by commenting. The main streamer may also be referred to as the host streamer or the master streamer. Additionally, there can be one or more sub-streamers. Furthermore, there may be no distinction between main and sub-streamers, and multiple streamers may jointly create a live chat room.

[0051] Furthermore, as a form of live chat in this disclosure, any of the following may be applied, not as an exhaustive list, but as an example: (1) Live chats that primarily consist of content such as messages delivered by broadcasters. (2) Live chat in which the audio streamed by the streamer is the primary element and the content such as messages streamed by the streamer is secondary. (3) Live chat that primarily consists of videos streamed by broadcasters and features content such as messages streamed by broadcasters.

[0052] (1) is not an limitation but an example in which content distributed by the broadcaster to be displayed in the chat room can be made the main focus of the live broadcast. In this case, viewers can choose to view the broadcaster's content displayed in the chat room. (2) is not limited to but an example, in which the broadcaster broadcasts audio in real time and incidentally broadcasts content to be displayed in the chat room. In this case, the viewer can listen to the audio broadcast by the broadcaster while the chat room is open and view the broadcaster's content incidentally displayed in the chat room. In this case, not limited to but an example, in addition to the live chat processing described later, the server 10 may also broadcast the audio data broadcast by the broadcaster to the viewer's terminal 20 via streaming. (3) is not limited to but an example, where the broadcaster broadcasts video in real time and incidentally broadcasts content to be displayed in the chat room. In this case, viewers can, not limited to but an example, watch the broadcaster's real-time video displayed in a small window or the like at a set location in the chat room while viewing the broadcaster's content displayed in the chat room. In this case, not limited to but an example, the server 10 can, in addition to processing the live chat described later, broadcast the video data broadcast by the broadcaster to the viewer's terminal 20 via streaming.

[0053] The contents described in the first embodiment are applicable to any of the other embodiments and any of the other modifications. Furthermore, components identical to those previously mentioned are given the same symbols, and their explanation is omitted.

[0054] <System Configuration> Figure 1-1 shows an example of the system configuration of the communication system 1 in an embodiment of the present disclosure. In communication system 1, as an example and not limited to, a server 10 is connected to multiple terminals 20 (terminal 20A, terminal 20B, terminal 20C, ...) via network 30.

[0055] Server 10 has the function of providing predetermined services (not limited to, but examples include messaging services, live chat services, etc.) to user-owned terminals 20 via the network 30. Server 10 can also be described as a messaging server, live chat server, etc., not limited to, but examples. In this embodiment, messaging service providers (operators) and live chat service providers (operators) are considered users of server 10.

[0056] Furthermore, there is no limit to the number of servers 10 or terminals 20 connected to network 30.

[0057] Terminal 20 (Terminal 20A, Terminal 20B, Terminal 20C, ...) can be any information processing terminal capable of realizing the functions described in each embodiment. Terminal 20 includes, but is not limited to, smartphones, mobile phones (feature phones), computers (but is not limited to, for example, desktops, laptops, tablets, etc.), media computer platforms (but is not limited to, for example, cable, satellite set-top boxes, digital video recorders), handheld computer devices (but is not limited to, for example, PDAs (personal digital assistants), email clients, etc.), wearable devices (glasses-type devices, watch-type devices, etc.), VR (Virtual Reality) terminals, smart speakers (voice recognition devices), or other types of computers or communication platforms. Terminal 20 may also be referred to as an information processing terminal.

[0058] The configurations of terminals 20A, 20B, and 20C can be identical, not as an example but as an extension. Furthermore, if necessary, the terminal used by user X may be referred to as terminal 20X, and user information in a predetermined service associated with user X or terminal 20X may be referred to as user information X, or not. User information refers to information about a user associated with an account used by that user in a given service. User information includes, but is not limited to, information associated with a user, such as the user's name, user icon image, user's age, user's gender, user's address, user's hobbies and preferences, and user identifier, which may be entered by the user or assigned by the given service. It may include any one of these items, a combination thereof, or not.

[0059] Network 30 plays the role of connecting one or more terminals 20 and one or more servers 10. In other words, network 30 refers to a communication network that provides a connection path so that the various devices described above can send and receive data after they are connected.

[0060] One or more parts of network 30 may or may not be wired or wireless networks. Network 30 may include, but is not limited to, an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless WAN (WWAN), a metropolitan area network (MAN), part of the internet, part of a public switched telephone network (PSTN), a mobile phone network, ISDN (integrated service digital networks), wireless LAN, LTE (long term evolution), CDMA (code division multiple access), Bluetooth (registered trademark), satellite communications, or two or more combinations thereof. Network 30 may include one or more networks 30.

[0061] Server 10 (not limited to, but an example of a server, information processing device, or information management device) has the function of providing predetermined services to terminal 20. Server 10 may be any information processing device capable of realizing the functions described in each embodiment. Server 10 includes, but is not limited to, a server device, a computer (not limited to, but an example of, a desktop, laptop, tablet, etc.), a media computer platform (not limited to, but an example of, a cable, satellite set-top box, digital video recorder, etc.), a handheld computer device (not limited to, but an example of, a PDA, email client, etc.), or other types of computers or communication platforms. Server 10 may also be referred to as an information processing device. If it is not necessary to distinguish between Server 10 and terminal 20, Server 10 and terminal 20 may or may not be referred to as information processing devices.

[0062] [Hardware configuration of each device] The hardware configuration of each device included in communication system 1 will be described below.

[0063] (1) Terminal hardware configuration Figure 1-1 shows an example of the hardware configuration of terminal 20. Terminal 20 comprises a control unit 21 (CPU: central processing unit), a storage unit 28, a communication interface 22, an input / output unit 23, a clock unit 29A, and a position calculation information detection unit 29B. The hardware components of terminal 20 are interconnected via bus B, not as an example but as an example. It is not mandatory for terminal 20's hardware configuration to include all components. Not as an example but as an example, terminal 20 may have a configuration in which individual components or multiple components are removed, or it may not.

[0064] The communication interface 22 transmits and receives various types of data via the network 30. Communication may be performed via wired or wireless connections, and any communication protocol may be used as long as communication between the interfaces is possible. The communication interface 22 has the function of communicating with various devices, such as the server 10, via the network 30. The communication interface 22 transmits various types of data to the server 10 and other devices according to instructions from the control unit 21. The communication interface 22 also receives various types of data transmitted from the server 10 and other devices and transmits them to the control unit 21. The communication interface 22 may also be simply referred to as the communication unit. Furthermore, if the communication interface 22 is composed of a physically structured circuit, it may be referred to as the communication circuit.

[0065] The input / output unit 23 includes devices for inputting various operations to the terminal 20, and devices for outputting processing results processed by the terminal 20. The input / output unit 23 may have an integrated input unit and an output unit, or it may have separate input and output units, or it may not have to be integrated.

[0066] The input unit is implemented by any or any combination of any type of device capable of receiving input from the user and transmitting the information related to the input to the control unit 21. The input unit includes, but is not limited to, hardware keys such as touch panels, touch displays, and keyboards, pointing devices such as mice, cameras (operation input via video), and microphones (operation input via voice).

[0067] The output unit is implemented by any or any combination of any type of device capable of outputting the processing results processed by the control unit 21. The output unit includes, but is not limited to, touch panels, touch displays, speakers (for audio output), lenses (for, but is not limited to, 3D (three-dimensional) output or hologram output), printers, and the like.

[0068] This is merely one example, but the input / output unit 23 may include, but is not limited to, a display unit 24, an audio input unit 25, an audio output unit 26, and an imaging unit 27.

[0069] The display unit 24 is implemented by any or a combination of any type of device capable of displaying data according to the display data written to the frame buffer. The display unit 24 includes, but is not limited to, touch panels, touch displays, monitors (but is not limited to, liquid crystal displays and OLEDs (organic electroluminescence displays)), head-mounted displays (HDMs), projection mapping, holograms, and devices capable of displaying images, text information, etc., in air (which may or may not be a vacuum). These display units 24 may or may not be capable of displaying display data in 3D.

[0070] The sound input unit 25 is used for inputting sound data (including voice data; the same applies hereinafter). The sound input unit 25 includes a microphone, etc. The sound output unit 26 is used for outputting sound data. The sound output unit 26 includes a speaker and the like. The imaging unit 27 is used to acquire image data (including still image data and moving image data; the same applies hereinafter). The imaging unit 27 includes a camera, etc.

[0071] If the input / output unit 23 is a touch panel, the input / output unit 23 and the display unit 24 may be arranged facing each other and have substantially the same size and shape.

[0072] The clock unit 29A is the built-in clock of the terminal 20 and outputs time information (timing information). The clock unit 29A is configured, for example, using a crystal oscillator or the like. The clock unit 29A can also be described, for example, as a timing unit or a time information detection unit.

[0073] The clock unit 29A may or may not have a clock that conforms to the NITZ (Network Identity and Time Zone) standard, etc.

[0074] The position calculation information detection unit 29B is a functional unit that detects (measures) information necessary for the control unit 21 to calculate (measure) the position of its own terminal 20 (hereinafter referred to as "position calculation information"). The position calculation information detection unit 29B can also be described as a position calculation sensor unit, not as an extension of this definition, but as an example.

[0075] The position calculation information detection unit 29B includes, but is not limited to, satellite positioning sensors (satellite positioning units) which are sensors or units for calculating the position of terminal 20 using a satellite positioning system such as GPS (Global Positioning System), inertial measurement sensors (inertial measurement units (IMUs)) which are sensors or units for calculating the position of terminal 20 using an inertial navigation system, and UWB positioning sensors (UWB positioning units) which are sensors or units for calculating the position of terminal 20 using UWB (Ultra Wide Band).

[0076] The satellite positioning unit includes, but is not limited to, an RF receiving circuit that converts RF (Radio Frequency) signals, including positioning satellite signals transmitted from positioning satellites received by an antenna (not shown), into digital signals, and a baseband processing circuit that performs correlation calculations on the digital signals output from the RF receiving circuit to capture positioning satellite signals, and outputs information such as satellite orbit data and time data extracted from the positioning satellite signals as position calculation information.

[0077] The inertial measurement unit has inertial sensors, which are sensors that detect information necessary to calculate the position of terminal 20 by inertial navigation calculations. The inertial sensors include, but are not limited to, a 3-axis accelerometer and a 3-axis gyroscope, and output the acceleration detected by the accelerometer and the angular velocity detected by the gyroscope as position calculation information.

[0078] The UWB positioning unit includes, but is not limited to, an ultra-wideband RF receiving circuit that converts an ultra-wideband RF (Radio Frequency) signal, including a positioning ultra-wideband pulse signal transmitted from a positioning beacon received by an antenna (not shown), into a digital signal, and a relative position calculation processing circuit that calculates the relative position between the terminal 20 and the positioning beacon based on the digital signal output from the ultra-wideband RF receiving circuit. For example, the UWB positioning unit may or may not function as a positioning beacon by transmitting an ultra-wideband RF signal containing a positioning ultra-wideband pulse signal from an antenna (not shown).

[0079] The control unit 21 calculates the position of its own terminal 20 at regular or specific timings, based on the position calculation information detected by the position calculation information detection unit 29B, not as an example but as an example. The position of the terminal is referred to as the "terminal position," and the calculated terminal position is referred to as the "calculated terminal position." The control unit 21 may or may not store the calculated terminal position in the storage unit 28 as calculated terminal position history data, associated with the date and time the calculated terminal position was calculated.

[0080] The control unit 21 has physically structured circuitry to perform functions realized by code or instructions contained within the program, and is implemented, not limited to but for example, by a data processing device built into the hardware. Therefore, the control unit 21 may or may not be described as a control circuit.

[0081] The control unit 21 includes, but is not limited to, a central processing unit (CPU), a microprocessor, a processor core, a multiprocessor, an ASIC (application-specific integrated circuit), and an FPGA (field programmable gate array).

[0082] The storage unit 28 has the function of storing various programs and data necessary for the operation of the terminal 20. The storage unit 28 includes, but is not limited to, various storage media such as HDD (hard disk drive), SSD (solid state drive), flash memory, RAM (random access memory), and ROM (read-only memory). The storage unit 28 may or may not be referred to as memory.

[0083] Terminal 20 stores program P in storage unit 28, and by executing program P, the control unit 21 executes the processing of each part included in the control unit 21. In other words, program P stored in storage unit 28 enables terminal 20 to realize the various functions executed by the control unit 21. Furthermore, this program P may or may not be described as a program module.

[0084] (2) Server hardware configuration Figure 1-1 shows an example of the hardware configuration of server 10. Server 10 comprises a control unit 11 (CPU), a storage unit 15, a communication interface 14, an input / output unit 12, and a clock unit 19. The hardware components of Server 10 are interconnected via bus B, not as an example but as an example. It is not mandatory for Server 10's hardware configuration to include all components. For example but as an example, Server 10's hardware may be configured to exclude individual or multiple components, or it may not.

[0085] The control unit 11 has physically structured circuitry to perform functions realized by code or instructions contained within the program, and is implemented, not limited to but for example, by a data processing device built into the hardware.

[0086] The control unit 11 is typically a central processing unit (CPU), but may also be a microprocessor, processor core, multiprocessor, ASIC, FPGA, or otherwise. In this disclosure, the control unit 11 is not limited to these.

[0087] The storage unit 15 has the function of storing various programs and data necessary for the operation of the server 10. The storage unit 15 is implemented using various storage media such as HDDs, SSDs, and flash memory. However, in this disclosure, the storage unit 15 is not limited to these. Also, the storage unit 15 may or may not be referred to as memory.

[0088] The communication interface 14 transmits and receives various types of data via the network 30. Communication may be performed via wired or wireless connections, and any communication protocol may be used as long as communication between the interfaces is possible. The communication interface 14 has the function of communicating with various devices, such as terminals 20, via the network 30. The communication interface 14 transmits various types of data to various devices, such as terminals 20, according to instructions from the control unit 11. The communication interface 14 also receives various types of data transmitted from various devices, such as terminals 20, and transmits them to the control unit 11. The communication interface 14 may also be simply referred to as the communication unit. Furthermore, if the communication interface 14 is composed of a physically structured circuit, it may be referred to as the communication circuit.

[0089] The input / output unit 12 includes devices for inputting various operations to the server 10, and devices for outputting processing results processed by the server 10. The input / output unit 12 may have an integrated input unit and an output unit, or it may have separate input and output units, or it may not have to be integrated.

[0090] The input unit is implemented by any or a combination of any type of device capable of receiving user input and transmitting the information related to the input to the control unit 11. The input unit is typically implemented by hardware keys such as keyboards or pointing devices such as mice. The input unit is not limited to, but may also include, for example, a touch panel, a camera (operation input via video), or a microphone (operation input via voice).

[0091] The output unit is implemented by any or any combination of any type of device capable of outputting the processing results processed by the control unit 11. The output unit includes, but is not limited to, touch panels, touch displays, speakers (sound output), lenses (but is not limited to, 3D (three-dimensional) output or hologram output), printers, and the like.

[0092] This is merely one example, but the input / output unit 12 may include a display unit 13, not as an example, but as an example.

[0093] The display unit 13 is implemented by a display or the like. The display is typically implemented by a monitor (not limited to, but for example, a liquid crystal display or an OLED (organic electroluminescence display)). The display may also be a head-mounted display (HDM) or not. These displays may or may not be capable of displaying data in 3D. In this disclosure, the display is not limited to these.

[0094] The clock unit 19 is the built-in clock of the server 10 and outputs time information (timing information). The clock unit 19 is configured to include, but is not limited to, a hardware clock such as an RTC (Real Time Clock) or a system clock. The clock unit 19 can also be described, but is not limited to, a timing unit or a time information detection unit. (3) Others Server 10 stores program P in storage unit 15, and by executing program P, the control unit 11 performs the processing of each part included in the control unit 11. In other words, program P stored in storage unit 15 enables server 10 to realize each function executed by the control unit 11. This program P may or may not be described as a program module. The same applies to other devices.

[0095] Each embodiment of this disclosure is described as being realized by the CPU of terminal 20 and / or server 10 executing program P.

[0096] Furthermore, the control unit 21 of terminal 20 and / or the control unit 11 of server 10 may implement each process not only with a CPU having a control circuit, but also with logic circuits (hardware) or dedicated circuits formed on an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)), etc., or they may not. Also, these circuits may be implemented by one or more integrated circuits, and the multiple processes shown in each embodiment may be implemented by a single integrated circuit, or they may not. In addition, LSIs are sometimes called VLSI, Super LSI, Ultra LSI, etc., depending on the degree of integration. For this reason, the control unit 21 may or may not be described as a control circuit.

[0097] Furthermore, the program P of each embodiment of the present disclosure (for example, a software program, a computer program, or a program module, but not limited to these) may or may not be provided stored on a computer-readable storage medium. The storage medium is a “non-temporary tangible medium” capable of storing the program P. Also, the program P may or may not be for the purpose of implementing some of the functions of each embodiment of the present disclosure. Furthermore, the program P may or may not be a so-called differential file (differential program) that can implement the functions of each embodiment of the present disclosure in combination with a program P already recorded on the storage medium.

[0098] Furthermore, when we refer to a system program (a program executed by a system), the system is as described above. The system program described above is a program that can be executed across the entire system, and this program is not limited to, for example, composed of programs for each device that makes up the system, and the programs stored in each device that makes up the system may be different. In other words, it does not have to be a common program for each device that makes up the system. As an example, and not an limitation, if the system consists of a terminal and a server, and the system program is P1, then the system program P1 consists of a program P2 stored on the terminal and a program P3 stored on the server, and P2 and P3 are for executing the system program and may be different programs. As an example, and not an limitation, the program P2 stored on the terminal may be a program that performs a first process and sends the result of the first process to the server, and the program P3 stored on the server may be a program that performs a second process on the received result of the first process and sends the result of the second process to the terminal.

[0099] The storage medium may include one or more semiconductor-based or other integrated circuits (ICs) (for example, but not limited to, field-programmable gate arrays (FPGAs) or application-specific integrated circuits (ASICs)), hard disk drives (HDDs), hybrid hard drives (HHDs), optical disks, optical disk drives (ODDs), magneto-optical disks, magneto-optical drives, floppy diskettes, floppy disk drives (FDDs), magnetic tapes, solid-state drives (SSDs), RAM drives, secure digital cards, or drives, any other suitable storage medium, or any two or more suitable combinations thereof. The storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate. The storage medium is not limited to these examples and may be any device or medium capable of storing program P. The storage medium may or may not be referred to as memory.

[0100] The server 10 and / or terminal 20 can realize the functions of the multiple functional units shown in each embodiment by reading the program P stored in the storage medium and executing the read program P.

[0101] Furthermore, the program P of this disclosure may or may not be provided to the server 10 and / or terminal 20 via any transmission medium capable of transmitting the program (such as a communication network or broadcast waves). The server 10 and / or terminal 20 realize the functions of the multiple functional units shown in each embodiment by executing the program P downloaded via the Internet or the like, for example, without limit.

[0102] Furthermore, each embodiment of this disclosure can also be realized in the form of a data signal in which the program P is embodied by electronic transmission. At least part of the processing on server 10 and / or terminal 20 may or may not be implemented by cloud computing consisting of one or more computers. The configuration may be such that at least some or all of the processing on terminal 20 is performed by server 10, or it may not be so. In this case, the configuration may be such that at least some or all of the processing of each functional unit of the control unit 21 of terminal 20 is performed by server 10, or it may not be so. The configuration may be such that at least some or all of the processing in the server 10 is performed by the terminal 20, or it may not be so. In this case, the configuration may be such that at least some or all of the processing of each functional unit of the control unit 11 of the server 10 is performed by the terminal 20, or it may not be so.

[0103] Unless otherwise explicitly stated, the configuration of the determination in the embodiments of this disclosure is not mandatory, and a predetermined process may be performed if the determination condition is met, or if the determination condition is not met, or not.

[0104] The programs disclosed herein may be implemented using, but are not limited to, scripting languages ​​such as ActionScript and JavaScript®, compiled languages ​​such as Objective-C and Java®, and markup languages ​​such as HTML Living Standard, as examples.

[0105] <Functional Configuration> (1) Server Functional Configuration Figure 1-2 shows an example of a function realized by the control unit 11 of the server 10 in this embodiment. The control unit 11 may include, but is not limited to, an application management processing unit 111 as a functional unit for executing application management processing according to an application management processing program 151 stored in the storage unit 15.

[0106] Figure 1-3 shows an example of the information stored in the storage unit 15 of the server 10 in this embodiment. The memory unit 15 stores, but is not limited to, an application management processing program 151 executed as application management processing, account registration data 153, an account management database 155, an advertising management database 157, and an advertising content database 159.

[0107] The account registration data 153 is registration data related to an application account (in this embodiment, a messaging application), and an example of its data structure is shown in Figure 1-4. The account registration data 153 stores, as an example and not limited to, the username, application ID, and other registration information in association with each other.

[0108] The username is the name of the account on device 20 using this application. It is not limited to this name, but rather, it is the name registered by the user of device 20 when they use the application.

[0109] An application ID is information used to identify an application account, or the account itself. This application ID is preferably a unique value for each account, and is not limited to, but is set and stored by the server 10 as an example for each account. The Application ID is information associated with terminal 20 or the user of terminal 20, and is an example of information about the terminal or the user of the terminal.

[0110] Other registration information may include, but is not limited to, various types of information such as identification information to identify terminal 20, terminal 20's phone number (terminal phone number), email address (terminal email address), and authentication information such as passwords used for various authentications in the application (login password, authentication password, etc.).

[0111] The identification information used to identify terminal 20 can be, for example, the terminal ID (or, for example, the IMEI (International Mobile Equipment Identity)), not limited to these. Furthermore, the identification information used to identify the user of terminal 20 is not limited to specific examples; it could be an application ID for general users or an application ID for official users.

[0112] Note that you may or may not use "User ID" instead of "Application ID". Furthermore, for applications where only one account can be registered per device 20, the limitation is not restrictive; for example, "identification information for identifying device 20 = identification information for identifying the user of device 20 = application ID" can be used.

[0113] Furthermore, as an example and not an limitation, it may be possible to assign multiple terminal IDs to a single application ID, or not. In this case, it may be possible to launch the application in parallel on multiple terminals 20 using a single application ID as the target for identification (login), or not.

[0114] Furthermore, it is possible to apply a method of managing accounts using information such as the terminal's phone number instead of various IDs such as application IDs. In this case, instead of storing information such as the application ID in the account registration data 153, information such as the terminal phone number can be stored in the account registration data 153. Alternatively, the application ID information may be associated with the terminal phone number information on a one-to-one basis, or it may not be necessary to do so.

[0115] For the sake of simplicity, in the following embodiments, it will be assumed that one account is registered for each terminal 20. Furthermore, in this case, as described above, "identification information for identifying terminal 20 = identification information for identifying the user of terminal 20 = application ID," so the term "user of the account" may be considered substantially synonymous with "terminal of the account."

[0116] The account management database 155 is a database for managing account-related data stored in the account registration data 153. The account management database 155 stores account-related data for each account (for example, application IDs), including data about accounts registered as friends in the messaging application and data about the history of sending and receiving content in chat rooms. Furthermore, if the user of this account broadcasts a live chat, as detailed below, a series of data related to that live chat will be stored.

[0117] The advertising management database 157 is a database for managing information related to advertisements to be displayed in the talk room shown on the display unit 24 of the configured terminal 20 during live chat. An example of its data structure is shown in Figure 1-5.

[0118] The advertising management database 157 stores advertising management data, not as a limitation but as an example, as data for each advertiser.

[0119] Each ad management data entry stores an advertiser ID, which is a type of advertiser identification information, and one or more ad detail data entries related to the advertiser's ads identified by that advertiser ID. Furthermore, information regarding advertisers is stored in the storage unit 15 as advertiser data (not shown), and the system is configured to allow advertisers to be identified by their advertiser ID.

[0120] Each ad detail data entry will store, for example, the ad ID, ad title, and ad content data. The ad ID stores an ID that functions as identification information to identify the advertiser's ad, not limited to, but as an example. The ad title will, as an example and not necessarily limited to, store the name or title of the advertiser who publishes the ad corresponding to that ad ID.

[0121] Advertising content is content (content configured to enable the output of advertisements) that is used to display advertisements on terminal 20 in various forms, and is not limited to, but can be configured as, for example, a machine-readable advertising media file or media data (hereinafter referred to as "advertising content file (advertising content media data)").

[0122] The advertising content data is stored in association with, but is not limited to, the advertising content ID, advertising content format, advertising content output time, and advertising content URI.

[0123] An advertising content ID is an identifier that serves to uniquely identify advertising content.

[0124] The advertising content format refers to the form and type of advertising information delivered, and is not limited to this. For example, still image advertisements (hereinafter referred to as "still image advertisements") store "still images," and moving image advertisements (hereinafter referred to as "moving images") store "moving images." Furthermore, it is also possible to deliver audio (including voice) advertisements, in which case the "sound" can be stored.

[0125] Ad content output time is the length of time during which an advertisement based on that ad content is output (displayed or played). In this example, the ad content output time for static image ads is set to "-", meaning that the live chat continues immediately after the static image ad is displayed. However, it is acceptable to display still image advertisements for a few seconds.

[0126] An advertising content URI is information that indicates the location where the advertising content is stored. The advertising content can, for example, be associated with an advertising content URI and stored in the advertising content database 159 as an advertising content file.

[0127] In this embodiment, the advertising content URI is stored in the advertising content data in the advertising management database 157, but this is not limited to this. Alternatively, the advertising content file itself can be stored in the advertising content URI field of the advertising content data. In this case, the advertising content database 159 becomes unnecessary.

[0128] Furthermore, in this embodiment, the advertising content database 159 is configured in the storage unit 15 of the server 10, but this is not limited to this configuration.

[0129] Figure 1-6 shows an example of a server configuration for managing advertising content. Figure 1-6(1) shows a configuration in which the messaging service provider's server 10 has both messaging server functionality and advertising server functionality, and stores the advertising content database 159 on the server 10, as in this embodiment.

[0130] Figure 1-6(2) shows an example of a server system (server system 100, not an example) that includes a messaging server 110 and an advertising server 120 that stores an advertising content database 159. In this case, both the messaging server 110 and the advertising server 120 may be servers managed by the messaging service provider. Furthermore, the messaging server 110 may be a server managed by the messaging service provider, and the advertising server 120 may be a server managed by a different company (such as a company that manages media files and media data of advertising content, or an advertiser).

[0131] (2) Terminal Functional Configuration Figure 1-7 shows an example of a function realized by the control unit 21 of the terminal 20 in this embodiment. The control unit 21 may, but is not limited to, include an application processing unit 211 as a functional unit for executing application processing according to an application processing program 281 stored in the storage unit 28.

[0132] Figure 1-8 shows an example of data stored in the storage unit 28 of the terminal 20 in this embodiment. The memory unit 28 stores, but is not limited to, an application processing program 281 that is executed as application processing, and an application ID 283 that corresponds to this terminal 20 or the user account of terminal 20.

[0133] <Display screen> In the following examples, rather than being limited, we will illustrate the case where terminal 20 is a smartphone equipped with a vertically oriented display unit 24.

[0134] A smartphone, as an example, has a touch panel that functions as an input area, positioned opposite its display, thereby forming a touchscreen. When an element such as an icon, button, item, or input area is displayed on the display, and a portion of the touch panel opposite the area where the element is displayed is operated by the user, the program associated with that element or a subroutine of that program is executed.

[0135] In the following, a tap operation (sometimes simply referred to as "tap") can be defined, without limitation, as an action in which a user lightly touches the display unit 24 (touchscreen), which is integrally composed of a touch panel, with their finger or pen tip, and then lifts their hand off the screen. Furthermore, scrolling can be defined, not as a limitation but as an example, as an operation (action) to scroll the displayed information. Also, not as a limitation but as an example, scrolling may be referred to as a "swipe operation" when the input is a finger or stylus, and as a "wheel operation" when the input is a mouse.

[0136] The screen transitions described below are merely examples of screen transitions for implementing the method of this disclosure. Some screens may be omitted or additional screens may be added to the screen transitions exemplified below.

[0137] In this specification, a messaging application is configured to allow users to communicate with each other in a talk room displayed on the display unit 24 of the terminal 20. In the talk room, content sent by the user (user's terminal) can be displayed in an area that is shown as a speech bubble. This area will be referred to, not exclusively, as the "talk area." The talk area may, not exclusively, be the area at the very top of the screen where the application name etc. is displayed, the area below that where the in-app location is displayed, and the area at the very bottom of the screen excluding the content input area INR for entering content. Please note that the speech bubble is merely an example, and content may be displayed in ways other than speech bubbles.

[0138] In this embodiment, as an example of a live chat, not limited to broadcasters, we illustrate a live chat with a "viewer comment function" that allows not only broadcasters but also viewers to input and send / receive content. In this embodiment of live chat, it is explained, not as an example but as an example, that content transmitted by the broadcaster is displayed in the talk area (the area where content is displayed in speech bubbles), while content transmitted by viewers is displayed in a separate area. In this case, not as an example but as an example, an area with a reduced vertical width from the talk area in a normal chat room can be allocated to the area where content transmitted by the broadcaster is displayed (hereinafter referred to as the "broadcaster area"), and the remaining vertical area can be allocated to the area where content transmitted by viewers is displayed (hereinafter referred to as the "viewer area").

[0139] Figures 1-9 and 1-10 show an example of the screen transitions displayed on the display unit 24 of the terminal 20 in this embodiment. The left side of Figure 1-9 shows an example of a chat room screen (not limited to a messaging application, but an example of a chat application), and is an example of a live chat chat room displayed on terminal 20A of user AA, who is a viewer of the live chat.

[0140] At the top center of the screen, the name of the messaging application, "Messaging App," is displayed. Also, at the top right of the screen, the icon image and username (user AA in this example) of the user of this device 20A in the messaging application are displayed.

[0141] Below that, there is an area that shows the current location and page within the messaging application (hereinafter collectively referred to as the "in-app location display area"). In this example, based on the fact that it is the screen of a live chat room, the title "Live Chat with Cooking Researcher X" is displayed, along with the icon images of the broadcasters (user XX and user YY in this example) and a "<" button to return to the previous screen.

[0142] At the bottom of the screen, there is a content input area INR where the user (in this example, user AA, who is a viewer) enters content. The content is sent when content is entered into the content input area INR and a submit button (not shown) that appears based on the content being entered is tapped.

[0143] In this live chat room, the broadcaster area (DR) displays text and image content sent by the broadcaster. The AR viewer area of ​​the chat room displays text content sent by the viewer. Image content may or may not be displayed in the AR viewer area. In this example, the broadcaster's area (DR) is displayed at the top, and the viewer's area (AR) is displayed at the bottom. The broadcaster's area (DR) is larger than the viewer's area (AR). Also, the content displayed in the broadcaster's area (DR) is larger than the content displayed in the viewer's area (AR).

[0144] Furthermore, the positional relationship and display area size relationship between the broadcaster area DR and the viewer area AR on the viewer's terminal 20 are not limited to this configuration. For example, the broadcaster area DR may be displayed at the bottom and the viewer area AR at the top, and the broadcaster area DR may be smaller than the viewer area AR. Also, the content displayed in the broadcaster area DR may be smaller than the content displayed in the viewer area AR. Viewers may or may not be able to change the position and size of the broadcaster area (DR) and the viewer area (AR) through manipulation. Furthermore, viewers may or may not be able to change the size of the content displayed in the broadcaster area (DR) and the viewer area (AR) through manipulation.

[0145] Streamers can use the chat room to send content they specify to other streamers and to their viewers. They can also use the chat room to receive content specified by other streamers and viewers. Viewers can use the chat room to send content they specify to other viewers and also to the broadcaster. They can also use the chat room to receive content specified by the broadcaster and other viewers.

[0146] In this example, user XX, a cooking expert, is the main streamer, user YY is the assistant streamer, and user AA and others are viewers. Note that the main broadcaster may be referred to as User XX, and the sub-broadcaster as User YY. In this example, multiple text contents sent and received between broadcasters are displayed in the broadcaster area DR, and multiple text contents entered by viewers are displayed in the viewer area AR.

[0147] Viewers can use the chat room to stay informed about content updates in the broadcaster's DR (Digital Reality) and the viewer's AR (Augmented Reality) in real time, allowing them to check updated information and experience content in a live-like manner. Furthermore, a mark (icon) containing the word "Live" is displayed next to the title at the top of the chat room, allowing viewers to recognize that content is currently being streamed in that chat room.

[0148] Figure 1-10 shows an example where a static image ad (SAD) based on advertising content is displayed in a chat room between a broadcaster and a viewer. The ad SAD is displayed in the broadcaster's area DR when the conditions set (not limited to, but as an example, the ad delivery conditions described later) are met after the broadcaster has started delivering content. In this example, it is displayed when "5 minutes" have passed since the broadcaster started delivering content.

[0149] For content sent and received between broadcasters, it is possible to display it associated with the broadcaster's identification information (such as an icon or name, not necessarily limited to this example) for content sent by that broadcaster. However, in this example display screen, for convenience, the display of user XX's identification information is omitted for content sent by user XX. In contrast, advertising content is displayed without being associated with user identification information.

[0150] In this embodiment, as an example rather than an limitation, advertising content (advertisements based on advertising content) can be output on the broadcaster's terminal 20 in the same way as on the viewer's terminal 20. Furthermore, as mentioned above, SAD (Service-Oriented Advertisement) can be a video ad or an audio ad (including voice). An example of the display screen when showing video ads will be described later.

[0151] Figures 1-11 and 1-12 illustrate the process leading up to the start of the live chat broadcast described above, and show an example of the screen displayed on terminal 20X of user XX, who is the main broadcaster. In this example, the text "NOW ON AIR" is displayed in the app's location display area, indicating that a live chat is currently being broadcast.

[0152] Furthermore, the area below displays a list of currently streaming live chat rooms. For each chat room, information such as the live chat (chat room) icon, title, and summary, the current number of viewers, the streamer's icon and username, and the latest streamer content displayed in the streamer's area of ​​the live chat are shown (not limited to specific rooms, but examples).

[0153] More specifically, in this example, multiple chat room information is displayed, including chat room information TL1 titled "About trendy sweets," chat room information TL2 titled "Takeout meals," and chat room information TL3 titled "Restaurants in Kyoto," etc.

[0154] In addition, in such display examples, the display unit 24 may show a list of talk rooms that are currently being broadcasted and talk rooms that are not currently being broadcasted, and the former and the latter may be displayed in different ways. For example, the former may have the text "Broadcasting" displayed next to the title, and the latter may have the text "Broadcasting stopped" displayed next to the title. Whether or not content is being streamed may be determined based on the fact that neither the streamer's area (DR) nor the viewer's area (AR) has been updated for a set period (not limited to a specific period, for example, "10 minutes"), or it may be determined based on the streamer's actions to start and end the stream.

[0155] In the lower right corner of the screen, there is an icon containing a speech bubble mark, which is used to configure settings related to live chat broadcasting. Tapping this icon displays a screen where you can select users to participate in the live chat as sub-broadcasters.

[0156] In this example, the words "Search Participants" are displayed in the in-app location display area. Below it, in addition to a box for searching by name (username), a list of users that user XX has added as friends is displayed with their icons and usernames, and next to each is a check box. It is possible to invite users who have been checked as sub-broadcasters, and in this example, user YY is shown as checked. When the "Next" button displayed in the in-app location display area is tapped in this state, the user is taken to a screen where they can set the title of a new live chat.

[0157] In this example, the words "Register New Live Chat" are displayed in the in-app location display area, and below it is an input field for entering the title of the live chat. In this example, the title "Live Chat with Cooking Researcher X" is entered as mentioned above. Below that, an icon containing a "+" symbol is displayed along with the icon of user YY, who was selected as a sub-broadcaster on the previous screen. By tapping this icon, you can add a sub-broadcaster.

[0158] In this state, when the "Invite" button BT1 at the bottom of the screen is tapped, the live chat waiting room screen will be displayed, as shown in Figure 1-12. In this example, the live chat title is displayed along with text stating that the live chat can begin once two or more participants have joined. Below that, the icon and username of the main broadcaster, user XX, and the icon and username of the invited co-broadcaster, user YY, are displayed. Below user YY's icon and username, the word "OFF" is displayed, indicating that user YY has not yet accepted to join the live chat.

[0159] Furthermore, below that, there is a broadcast start button BT2 with the words "Start Live" to begin broadcasting a live chat. However, because user YY has not yet agreed to participate in the live chat and there are not two or more participants, the broadcast start button BT2 is grayed out and tapping it will not start the live chat broadcast.

[0160] When user YY agrees to participate in the live chat, the "OFF" text above changes to "ON". As a result, the grayed-out "Start Streaming" button BT2 is removed, and when user XX taps the "Start Streaming" button BT2, the live chat broadcast begins.

[0161] Please note that the conditions for starting a live chat broadcast are not limited to those listed above. More details will be provided later.

[0162] <Processing> Figure 1-13 is a flowchart showing an example of the processing flow performed by each device in this embodiment.

[0163] In this process, one of the multiple viewers is designated as "User AA," and User AA's terminal 20 is designated as terminal 20A. The main broadcaster is designated as "User XX," and User XX's terminal 20 is designated as terminal 20X. The diagram shows, from left to right, examples of processes executed by the control unit 21 of terminal 20A, the control unit 11 of server 10, and the control unit 21 of terminal 20X. Note that the processing performed by terminal 20 of viewers other than user AA is the same as that of terminal 20A, so it is not illustrated. Also, the processing performed by terminal 20 of the sub-broadcaster is almost the same as that of terminal 20X, so it is not illustrated.

[0164] The processes described below are merely examples of processes for implementing the method of this disclosure, and are not limited to these. You may add other steps to the process described below, or you may omit (delete) some steps from the process described below. The same applies to the various processes described herein.

[0165] The control unit 21 of terminal 20X determines whether or not user XX has requested that a live chat be streamed (X110), and if it determines that a request has been made (X110: YES), it performs live chat streaming setup processing with server 10 (X120, S120). In the live chat distribution setup process, the control unit 21 of terminal 20X performs processes such as setting the title and theme of the live chat to be distributed via the server 10, and selecting and setting users to be sub-distributors from among the users registered as friends in the messaging application and inviting them.

[0166] Furthermore, if there is only one sub-streamer, it is not limited to this; for example, the live chat can be initiated based on an invitation from the main streamer and the sub-streamer's acceptance of the invitation. Furthermore, if there are two or more sub-streamers, the live chat can be initiated not only based on an invitation from the main streamer, but also, for example, once at least one of them has accepted to participate in the live chat. Alternatively, the live chat may be delayed until all sub-streamers have accepted to participate.

[0167] Also, unlike the above, the main streamer may start the live chat first without the sub-streamer present, and the sub-streamer may join the live chat later, or not. Also, unlike the above, the sub-streamer may start the live chat in advance while the main streamer is absent, and the main streamer may join the live chat later, or not.

[0168] The control unit 21 of terminal 20A searches for scheduled and completed live chats based on inputs to the input / output unit 23 of terminal 20A (for example, user operation inputs and sound inputs; the same applies to other terminals 20; the same applies hereafter), and displays the search results on the display unit 24. Based on the search results, it determines whether or not user AA has requested to view a particular live chat (A110).

[0169] If it is determined that viewing a live chat has been requested (A110: YES), the control unit 21 of terminal 20A sends live chat viewing request information via the communication interface 22 to the server 10, including, but not limited to, its own terminal 20 or the application ID 283 of the user of its terminal 20, and selection information of the live chat to be viewed (A120).

[0170] When the conditions for starting a live chat broadcast are met, the control unit 11 of the server 10 starts the live chat processing based on the information transmitted from each terminal 20 (S130, X130, A130). Once the live chat is started by the live chat processing, the control unit 11 of the server 10 starts storing the data of the series of contents of this live chat.

[0171] After the live chat processing begins, the control unit 11 of the server 10 determines whether or not the ad delivery conditions have been met (S150). The ad delivery conditions are not limited to the following, but may be any of the following as examples. (A1) The live chat started at set intervals (not limited to specific times, but for example, every 5 minutes or 10 minutes). (A2) The time measured by the clock unit 19 has reached the set time (not limited to this, but for example, it may be the hour or a set time such as "15 minutes," "30 minutes," or "45 minutes"). (A3) The timing was set in advance by the streamer. (A4) The streamer requested that advertisements be displayed during the live chat. (A5) Two or more combinations of the above

[0172] Furthermore, the setting of advertising delivery conditions by the broadcaster (not limited to, but for example, the main broadcaster) may be done during the live chat broadcast settings process, or at any earlier time.

[0173] Furthermore, the distributor may be able to set the advertising content to be distributed, the number of advertising content pieces to be distributed (number of times they are distributed), the order in which the content is distributed, etc. In this case, the distributor's terminal 20 may, not as a limiting example, display items such as "distribute more" and "distribute fewer" as information for setting the number (frequency) of advertisements to be delivered, and the server 10 may determine the number (frequency) of advertisement content to be delivered based on the selected item. For example, if "distribute more" is selected, the number may be determined from a range of "10" to "15," and if "distribute fewer" is selected, the number may be determined from a range of "3" to "5."

[0174] If it is determined that the conditions for ad delivery have been met (S150: YES), the control unit 11 of the server 10 selects the ad content to deliver (S160). Specifically, as an example rather than a limiting one, refer to the ad management database 157 and select the ad content ID of the ad content corresponding to the advertiser (advertiser ID) and ad ID set by the distributor. Alternatively, the sub-streamer may perform the above settings on device 20 instead of the main streamer, or not.

[0175] Furthermore, in step S160, server 10 may or may not randomly select advertising content.

[0176] Furthermore, live chats can be conducted in an open chat room, although restrictions on viewing may be imposed, for example. In this case, the confidentiality of communications may not apply, for example. However, permission may be required from the live chat broadcaster and viewers for server 10 to access the content of the live chat.

[0177] In this case, in step S160, the control unit 11 of the server 10 may, for example, select appropriate advertising content from the advertising content database 159 based on the content and context of the live chat based on the content sent and received between the main broadcaster and the sub-broadcaster, using methods such as maximum likelihood estimation or the Viterbi algorithm, for example.

[0178] Subsequently, the control unit 11 of the server 10 transmits advertising output information corresponding to the advertising content selected in step S160 to terminals 20A and 20X via the communication interface 14 (S170). Although not shown in the diagram, the advertising output information is also sent to other viewers' devices 20 and the sub-distributor's devices 20.

[0179] Furthermore, the transmission of advertising output information is not limited to the timing of S170. At an earlier time (not limited to this, but for example, when the live chat processing of S130 starts), information for ad output, including information regarding the timing of ad output, is sent to terminal 20. Then, the control unit 21 of terminal 20 may output the specified ad content when it is time for ad output.

[0180] Here, the information for ad output can include, but is not limited to, any of the following as examples: ad content ID and ad content output time. (B1) Advertising content file (B2) Advertising content URI

[0181] If (B1) is used as information for advertising output, the control unit 11 of the server 10 identifies the advertising content URI associated with the selected advertising content ID from the above advertising content data. Then, based on the identified advertising content URI, it accesses the advertising content database 159, retrieves the advertising content file, and sends it to the terminal 20A.

[0182] If (B2) is used as information for advertising output, the control unit 11 of the server 10 identifies the advertising content URI associated with the selected advertising content ID from the above advertising content data and sends it to the terminal 20A. When applying this method, the control unit 11 of the server 10 can send an advertising content URI to the terminal 20A, causing the terminal 20A to obtain the advertising content file. In this case, it is not limited to this example, but can be configured such that the terminal 20A obtains the advertising content file from the advertising server 120, for example, by applying the server system 100 shown in Figure 1-6(2) above.

[0183] When the terminal 20A receives advertising output information from the server 10 via the communication interface 22 (A140: YES), the control unit 21 of the terminal 20A performs advertising output processing (A150). Similarly, when terminal 20X receives advertising output information from server 10 via communication I / F 22 (X140: YES), the control unit 21 of terminal 20X performs advertising output processing (X150).

[0184] When applying (B1) above, the control unit 21 of terminal 20A can output the advertising content based on the received advertising content file, such as displaying it in the broadcaster area (first area) of the live chat talk room in a manner that is distinguishable from broadcaster content. When applying (B2) above, the control unit 21 of terminal 20A can obtain an advertising content file based on the received advertising content URI, and based on the obtained advertising content file, output the advertising content in the broadcaster area of ​​the live chat talk room in a manner that is distinguishable from the broadcaster's content. For example, broadcaster content may be displayed in a speech bubble, while advertising content may be displayed in a rectangular frame instead of a speech bubble.

[0185] In the ad output processing, as an example (not limited to this), the control unit 21 of terminal 20 outputs the ad content. If the advertising content format is a "still image," a still image advertisement will be placed in the distributor's area based on the still image advertising content file. If the advertising content is in the form of a video, the video advertising content file is deployed to the distributor's area before the video is played. If the advertising content format is "audio," the audio advertising content file is unpacked and output from the sound output unit 26, and a still image including a mark or icon (not limited to, but such as a musical note mark or icon) indicating this is displayed in the distributor's area.

[0186] Furthermore, the system may be configured to display the ad content in full screen based on whether the displayed ad content image is tapped by the user.

[0187] Once the output of the advertising content is complete, the control unit 21 of terminal 20 will display the subsequent distributor content below the advertising content. Additionally, you may configure the system to remove the ad content display once the ad content output time has elapsed.

[0188] In this embodiment, advertising content is output to both the viewer's terminal 20 and the broadcaster's terminal 20. This approach allows, not just as a limitation, but as an example, broadcasters and viewers to discuss the content of the advertisements during live chats.

[0189] After A150, the control unit 21 of terminal 20A determines whether or not to end viewing the live chat (A190). If it determines not to end viewing (A190: NO), it returns to A140. On the other hand, if it determines to end viewing the live chat (A190: YES), it terminates the process.

[0190] After S170, the control unit 11 of the server 10 determines whether or not to terminate the live chat (S190). If it determines not to terminate (S190: NO), it returns to S150. On the other hand, if it determines to terminate the live chat (S190: YES), it terminates the process.

[0191] After X150, the control unit 21 of terminal 20X determines whether or not to terminate the live chat (X190). If it determines not to terminate (X190: NO), it returns to X140. On the other hand, if it determines to terminate the live chat (X190: YES), it terminates the process.

[0192] In this process, the live chat processing and the processing related to the output of advertising content are separated, but the processing related to the output of advertising content may also be considered as part of the live chat processing.

[0193] Figure 1-14 is a flowchart illustrating an example of the processing flow related to sending, receiving, and displaying content in live chat. The interpretation of this figure is the same as in Figure 1-13.

[0194] The control unit 21 of terminal 20X determines whether or not broadcaster content has been input via the input / output unit 23 and whether or not it has been requested to send it (X1110). If it determines that it has been requested (X1110: YES), it displays the input broadcaster content in a speech bubble in the broadcaster area of ​​the talk room displayed on the display unit 24 of its own terminal 20, as content originating from itself (user XX) (X1120). Then, the control unit 21 of terminal 20X sends the input broadcaster content to the server 10 via the communication interface 22 (X1130). Note that the order of steps X1120 and X1130 may be reversed.

[0195] The control unit 11 of the server 10 determines whether or not it has received the distributor content from terminal 20X (S1110). If it determines that it has received the content (S1110: YES), it transmits the received distributor content, along with its identification information (distributor content ID, etc.) and time information, to terminal 20A (and a sub-distributor terminal 20, not shown) via the communication interface 14. The control unit 11 of the server 10 also transmits the identification information and time information of the distributor content to terminal 20X via the communication interface 14 (S1120). The same applies if the streamer's content is entered on the sub-streamer's device 20.

[0196] The time information may be the time when terminal 20 sent the content (the time when the user of terminal 20 sent the content), or it may be the time when server 10 sent the content to terminal 20. The same applies to the following.

[0197] The control unit 21 of terminal 20A determines whether or not it has received broadcaster content from server 10 via the communication I / F 22 (A1110). If it determines that it has received the content (A1110: YES), it displays the received broadcaster content in a speech bubble in the broadcaster area of ​​the talk room displayed on the display unit 24 of terminal 20, indicating that the content originates from user XX (A1120). The same applies to the sub-streamer's device 20.

[0198] Following A1120, the control unit 21 of terminal 20A determines whether viewer content has been input via the input / output unit 23 and whether it has been requested to be transmitted (A1130). If it determines that it has been requested (A1130: YES), it transmits the input viewer content to server 10 via communication I / F 22 (A1140).

[0199] After S1120, the control unit 11 of the server 10 determines whether or not it has received viewer content from terminal 20A (S1140). If it determines that it has received content (S1140: YES), it transmits the received viewer content, along with its identification information (viewer content ID, etc.) and time information, to terminal 20A (and other viewer terminals 20 not shown) and terminal 20X (and other sub-distributor terminals 20 not shown) via the communication I / F 14 (S1150). Then, the control unit 11 of the server 10 returns processing to S1110.

[0200] When viewer content is received via the communication interface 22, the control unit 21 of terminal 20A displays the received viewer content in the viewer area of ​​the talk room displayed on the display unit 24 of terminal 20 as content originating from user AA (A1150). Then, the control unit 21 of terminal 20A returns processing to A1110. Note that the order of steps A1140 and A1150 may be reversed.

[0201] The same applies to terminal 20X (X1140:YES→X1150), and also to terminal 20 of the sub-streamer.

[0202] Here, on the viewer's device 20, viewer content can be displayed in a viewer area configured below the broadcaster area, not as an example but as an example. The viewer area can be configured as an area capable of displaying a set number of lines of viewer content (not as an example but as an example, 3 to 5 lines). Furthermore, the viewer area can be considered as the area of ​​the talk room (chat room), or the broadcaster area can be considered as the area of ​​the talk room, but the viewer area can be considered as not the area of ​​the talk room.

[0203] The control unit 21 of terminal 20, as an example (though not limited to this), displays the broadcaster content received from server 10 in a speech bubble below the most recent broadcaster content already displayed in the broadcaster area. It also controls upward scrolling of the broadcaster area according to its vertical length, hiding older broadcaster content in order of time.

[0204] Furthermore, the control unit 21 of terminal 20, as an example (not limited to this), displays the viewer content below the most recent broadcaster content already displayed in the viewer area each time it receives viewer content from server 10. It also hides older viewer content sequentially, based on the number of rows that make up the viewer area.

[0205] While not limited to this display method, arranging content so that older content scrolls upwards in both the broadcaster's and viewer's areas can prevent viewers from experiencing motion sickness while viewing the content.

[0206] Furthermore, based on user actions such as scrolling in the broadcaster area, the control unit 21 of terminal 20A may perform scrolling control on the broadcaster area to enable the display of past broadcaster content. The same may be applied to the viewer area.

[0207] The viewer area may be displayed by overlaying it onto the broadcaster area, or the talk area may be split in two and assigned to the broadcaster area and the viewer area (split).

[0208] When viewer content is received via the communication interface 22, the control unit 21 of terminal 20X displays the received viewer content in the viewer area of ​​the talk room as content originating from user AA (X1150). Then, the control unit 21 of terminal 20X returns processing to X1110. The same applies to the sub-streamer's device 20.

[0209] Here, on the broadcaster's device 20, viewer content can be displayed in the viewer area, which is configured above the broadcaster area. In other words, the viewer area can be displayed in the opposite positional relationship between the viewer's device 20 and the broadcaster's device 20, not limited to but as an example.

[0210] In the process described above, advertising content is output to both the live chat broadcaster's and the viewer's terminals 20. In this case, since it is necessary for both the viewer and the broadcaster to properly view the advertising content, the control units 21 of these terminals 20 can prevent the transmission or reception of at least one of the broadcaster's content and the viewer's content until the advertising content output time has elapsed.

[0211] In this case, in the process shown in Figure 1-14, if the control unit 21 of terminal 20A determines in step A1130 that a request has been made to input and transmit content (A1130: YES) before the output of the advertising content is complete, it temporarily stores the requested content in a buffer or the like. After the output of the advertising content is complete, it can then send the temporarily stored content to the server 10 via the communication interface 22 (A1140).

[0212] Similarly, in the process shown in Figure 1-14, if the control unit 21 of terminal 20X determines in step X1110 that a request has been made to input and transmit content (X1110: YES) before the output of the advertising content is complete, it temporarily stores the requested content in a buffer or the like. After the output of the advertising content is complete, it can then send the temporarily stored content to the server 10 via the communication interface 22 (X1130).

[0213] In addition, as an example (though not limited to this), it would also be possible to prevent users from entering content while advertising content is being displayed.

[0214] When the live chat ends, the control unit 21 of each terminal 20 can, by way of example and not limitation, do the following. · Perform a process of deleting the live chat data from the storage unit 28 · Perform a process of not deleting the live chat data from the storage unit 28 but making it impossible to view based on that data However, it is possible to enable archive viewing of the live chat based on the live chat data archived and stored in the server 10 or the like, as will be described in a later embodiment.

[0215] <Effect of the First Embodiment> In this embodiment, the control unit 21 of the terminal 20 of one viewer performs control to display a talk room (an example of a chat room, not limited) in which the content transmitted and received between the main distributor (an example of the first user, not limited) and the sub-distributor (an example of the second user, not limited) is displayed on the display unit 24. Also, the terminal 20 receives the content transmitted and received between the main distributor and the sub-distributor from the server 10, and the control unit 2i performs control to display the content in the distributor area of the talk room (an example of the first area, not limited). Also, different from the main distributor and the sub-distributor, and different from the user (viewer) of the terminal 20, the terminal 20 receives viewer content input by a viewer (an example of the third user, not limited), and the control unit 21 performs control to display the received viewer content in the viewer area (an example of the second area, not limited). Also, the terminal 20 receives advertisement output information (an example of advertisement information, not limited) from the server 10, and shows a configuration in which the control unit 21 performs control to display advertisement content (an example of advertisement information, not limited) based on the received advertisement output information in the distributor area. As an example of the effects obtained by this configuration, in a chat room that displays content sent and received between a first user and a second user, the content sent and received between these users is displayed in the first area, and the first content entered by a third user different from the first and second users is displayed in the second area and can be viewed by the user on the terminal. In addition to this, advertising information related to advertisements can be acquired and that advertising information can be displayed in the first area and viewed by the user on the terminal.

[0216] In this case, the advertising content can also include video advertising content. As an example of the effects obtained by this configuration, a video advertisement can be displayed in the first area of ​​the chat room where content sent and received between the first user and the second user is displayed, allowing the user of the device to view it.

[0217] In this case, when content is input by the viewer's terminal 20, control is performed to send that content to the server 10 and to display that content as viewer content in the viewer area. However, viewer content can be prevented from being sent from the viewer's terminal 20 to the server 10 while advertising content is being played. One example of the effects obtained by this configuration is that, while advertising information is playing, the second content entered by the terminal user will not be displayed in the chat room, allowing the terminal user to properly view the advertising information.

[0218] Furthermore, this embodiment shows a configuration in which advertising output information (advertising content, etc.) is transmitted from server 10 at a set time. One example of the effects of this configuration is that advertising information can be sent from the server at an easily understandable time.

[0219] Furthermore, this embodiment shows a configuration in the viewer's terminal 20 where the viewer area (not limited to, but an example of a second area) is located in a lower area relative to the broadcaster area (not limited to, but an example of a first area). As an example of the effects of this configuration, on the user's terminal, the second area of ​​the chat room, which displays the first content entered by a third user different from the first and second users, is displayed in a lower area than the first area of ​​the chat room, which displays the content sent and received between the first and second users, thereby improving visibility.

[0220] Furthermore, this embodiment shows a configuration in the broadcaster's terminal 20 where the broadcaster area (not limited to, but an example of the first area) is located in a lower area relative to the viewer area (not limited to, but an example of the second area). As an example of the effects of this configuration, on the terminals of the first and second users, the first area of ​​the chat room where content sent and received between the first and second users is displayed is displayed in a lower area than the second area of ​​the chat room where first content entered by a third user (different from the first and second users) is displayed, thereby improving visibility.

[0221] Furthermore, this embodiment shows a configuration in which the main broadcaster (not limited to, but an example of a first user) and the sub-broadcaster (not limited to, but an example of a second user) are broadcasters who distribute broadcaster content displayed in the broadcaster area of ​​the talk room (not limited to, but an example of a first area), and the user of terminal 20 (not limited to, but an example of a user of the terminal) is a viewer who watches the broadcaster content displayed in the broadcaster area of ​​the talk room. As an example of the effects obtained by this configuration, the user of the terminal can view the content distributed by the first user and the second user and displayed in the first area of ​​the chat room.

[0222] <First variation (1)> In the above embodiment, as mentioned above, it is also possible to allow users to view past broadcaster content based on their scrolling operations on the broadcaster area. However, in this case, the timing for displaying ads may coincide with the user viewing past content from the broadcaster.

[0223] Therefore, the control unit 21 of the terminal 20 may, for example, display a reduced image of the advertising content near one of the advertising content currently displayed in the advertising area (for example, the advertising content displayed at the top or the advertising content displayed at the bottom). When this reduced image of the advertising content is tapped, the advertising content may be displayed in full screen.

[0224] In addition, and not limited to this, advertising content (advertisements based on advertising content) may be displayed in a so-called picture-in-picture format at any location on the currently displayed screen (for example, the upper right corner of the screen).

[0225] Furthermore, after the advertising content is displayed, the user may attempt to scroll to view past content from the distributor. In this case, since it is necessary to ensure that the user properly views the advertising content, the control unit 21 of the terminal 20 may, for example, refrain from performing scroll control until the advertising content output time has elapsed, or perform scroll control to the extent that the advertising content does not move outside the distributor area where it is displayed, thereby ensuring that the advertising content remains within the distributor area.

[0226] <First variation (2)> In the above embodiment, advertising content is displayed not only on the viewer's terminal 20 but also on the broadcaster's terminal 20, but this is not the only option. Advertising content may be not displayed on the broadcaster's terminal 20.

[0227] Figure 1-15 shows an example of a chat room displayed on the device 20X of user XX, the main broadcaster. Compared to the example of the viewer's device 20A shown in Figure 1-9, the difference is that the positional relationship and size relationship between the broadcaster's area DR and the viewer's area AR are reversed. Also, in this example, similar to the viewer's device 20A, the content displayed in the broadcaster's area DR is larger than the content displayed in the viewer's area AR.

[0228] Furthermore, the positional relationship and display area size relationship between the broadcaster area DR and the viewer area AR on the broadcaster's terminal 20 are not limited to this configuration. For example, the broadcaster area DR may be displayed at the top and the viewer area AR at the bottom, and the broadcaster area DR may be larger than the viewer area AR. Also, the content displayed in the viewer area AR may be larger than the content displayed in the broadcaster area DR. The broadcaster may or may not be able to change the position and size of the broadcaster area DR and the viewer area AR through manipulation. Furthermore, the broadcaster may or may not be able to change the size of the content displayed in the broadcaster area DR and the viewer area AR through manipulation.

[0229] In this example, advertising content is displayed every 5 minutes during a live chat that started at 11:00. However, as shown in Figure 1-15, the advertisement is not displayed at "11:25" in the chat room shown on user XX's device 20X. Meanwhile, in the chat room displayed on the viewer's device 20, an advertisement (a video ad VAD in the examples of Figures 1-17 and 1-18) is displayed at "11:25", as shown in Figures 1-17 and 1-18 described later.

[0230] FIG. 1-16 is a flowchart showing an example of the flow of processing executed by each device in this modification. The way of viewing the figure is the same as that of FIG. 1-13. In this modification, in step S170, the control unit 11 of the server 10 can transmit advertisement output information to the terminal 20A and other viewers' terminals 20 (not shown).

[0231] In this modification, the advertisement information is not transmitted to the terminals 20 of the main distributor (not limited, an example of the first user) and the sub - distributor (not limited, an example of the second user), but is shown to be transmitted to the terminal 20 of the viewer (not limited, an example of the third user, an example of the user of the terminal). As an example of the effect of the modification obtained by such a configuration, while the first user and the second user are not made to view the advertisement, the third user or the user of the terminal can be made to view the advertisement.

[0232] In addition to the above, as an example but not limited, the advertisement content may not be output on the terminal 20 of the main distributor, but may be output on the terminal 20 of the sub - distributor. In this case, in step S170 of FIG. 1-13, the control unit 11 of the server 10 can transmit advertisement output information to the terminal 20A, other viewers' terminals 20 (not shown), and the sub - distributor's terminal 20 (not shown).

[0233] <First Modification (3)> As described in the first modification (2), the advertisement content can be made not to be output on the terminal 20 of the distributor. However, in this case, content may be transmitted and received between the main distributor and the sub - distributor, and the live chat may proceed. However, on the viewer's terminal 20, the advertisement content is output, and it is necessary to view this until the advertisement content output time elapses.

[0234] FIG. 1-17 and FIG. 1-18 are examples of the chat room displayed on the terminal 20A of the user A.A who is a viewer. As shown in Figure 1-15, the chat room displayed on the broadcaster's device 20 shows no advertisement at "11:25" and the chat is progressing between broadcasters, whereas, as shown in Figure 1-17, the chat room displayed on device 20A shows a video ad (VAD) at "11:25".

[0235] In this example, the video ad (VAD) is a video ad about a new spice product, and a seek bar is displayed along with the text "Ad 1:00" indicating that it is a "1 minute" ad. As the video ad (VAD) plays, the circle on the seek bar moves to the right, and the remaining time of the video ad is displayed accordingly. When playback ends, "Ad 0:00" is displayed.

[0236] Furthermore, in this example, rather than being a limitation, viewers are prevented from commenting while a video ad (VAD) is playing. The content input area (INR) displays a box containing the text "Comment functionality is restricted," preventing viewers from entering content.

[0237] Figure 1-18 shows the state after the video ad (VAD) playback has finished. As playback of the video ad VAD has ended, the distributor content that was sent and received between the distributor's terminal 20 while the video ad VAD was playing on terminal 20A, specifically the distributor content from "11:25" onwards as shown in Figure 1-15, is sequentially displayed below the video ad VAD in the distributor area DR. Furthermore, as playback of the video ad VAD ends on another viewer's device 20, viewer content transmitted from the viewer's device 20, specifically the viewer content from "11:26" onwards as shown in Figure 1-15, is sequentially displayed in the viewer area AR.

[0238] Figure 1-19 is a flowchart showing an example of the processing flow performed by each device in this case. In this figure, the left side shows an example of the processing performed by the control unit 21 of terminal 20A, and the right side shows an example of the processing performed by the control unit 11 of server 10.

[0239] First, the control unit 21 of terminal 20A determines whether or not the playback of the advertising content has finished (A1210). If it determines that playback has not yet finished (A1210: NO), it remains in a waiting state. On the other hand, if it is determined that the playback of the advertising content has been completed (A1210: YES), the control unit 21 of terminal 20A sends advertising content playback completion information to the server 10 via the communication I / F 22, indicating that the playback of the advertising content has been completed (A1220).

[0240] The control unit 11 of the server 10 determines whether or not it has received information that advertising content playback is complete from the terminal 20A via the communication interface 14 (S1210). If it determines that it has received the information (S1210: YES), it reads from the content transmission history data the distributor content that has been transmitted and received between the main distributor and the sub-distributor during the period from when it sends advertising output information to the terminal 20A in step S170 of Figure 1-16 until it receives information that advertising content playback is complete from the terminal 20, and transmits this undistributed content to the terminal 20A via the communication interface 14.

[0241] When the control unit 21 of terminal 20A receives undistributed subscriber content from server 10 via the communication I / F 22, it performs undistributed subscriber content display processing (A1240).

[0242] In the process of displaying undelivered subscriber content, as an example, not limited to any specific case, the oldest undelivered subscriber content (date and time) among the received undelivered subscriber content will be displayed in the subscriber area. Furthermore, if you do not remove the ad content display after playback has finished, you can display undistributed content below the ad content. In contrast, if the ad content is removed after playback has finished, then undistributed content can be displayed in the position where the removed ad content was located.

[0243] Subsequently, based on the upward scrolling operation performed by user AA via the input / output unit 23, the control unit 21 of terminal 20A sequentially displays the undistributed subscriber content in the distributor area in chronological order. In this case, the control unit 21 of terminal 20A can, for example, not jump to displaying the most recent undistributed follower content, but rather display the oldest undistributed follower content first. This is because, if the live chat is progressing quickly and there is a large amount of undistributed follower content, viewers will need to scroll back to the oldest undistributed follower content to follow the conversation. However, this is not the only option; you could also configure it to jump to and display the most recent content. Alternatively, the system could display the oldest undistributed subscriber content first, at a slower speed, without requiring scrolling.

[0244] Furthermore, the server 10 stores information about the advertising content output time in association with the advertising content ID in the advertising content data. Therefore, the control unit 11 of the server 10 may send undelivered content to the viewer's terminal 20 when it determines that the advertising output time has elapsed since sending the advertising output information to the viewer's terminal 20.

[0245] <First variation (4)> In the above embodiment, it was made possible to display video advertisements as advertising content. However, some users may not want to watch video ads from beginning to end.

[0246] Furthermore, as explained in the first modification (2), it is also possible to prevent video ads from being displayed on the broadcaster's device 20. In this case, a live chat may be taking place between broadcasters while the viewer is watching a video ad on the viewer's device 20.

[0247] Therefore, as an example rather than a limitation, it may be possible to allow users to skip a video ad after a set time (hereinafter referred to as "set time") has elapsed since the video ad began playing.

[0248] Here, skipping may include, but not exclusively, at least one of the following: • To direct video ads to the point in the user's timeline where they want to view them. • End the playback of the video ad.

[0249] In this case, during the ad output processing step A150 in Figure 1-13, the control unit 21 of terminal 20A, after starting playback of the video ad content, determines that a set time (not limited to, for example, "5 seconds" or "10 seconds") has elapsed, and displays information for skipping the video ad (hereinafter referred to as "skip information") associated with that video ad. Then, based on the user input for the skip information received via the input / output unit 23, the control unit 21 of terminal 20A performs the above-mentioned control to skip the video to a location on the timeline specified by the user, or to terminate the playback of the video ad. The same applies to the other terminals 20.

[0250] This modified example shows a configuration where advertising information (not limited to, but video ads as an example) can be skipped after a set amount of time has elapsed. One example of the effects of this configuration is that it allows users who do not wish to view advertisements from beginning to end to skip them. Furthermore, by enabling users to skip advertisements, it becomes possible to allow users on the device to check the content of a live chat between two users, for example, before the chat is even finished.

[0251] <First variation (5)> Based on the above example, if the advertising content is viewed by viewers, compensation (fees) for viewing the advertising content can be paid by the advertiser to specific users. Users who receive this compensation are referred to as "reward recipients." The recipients of the reward are not limited to specific individuals; for example, the main streamer could be eligible. However, this is not the only option; sub-streamers may also be eligible for rewards. Furthermore, both the main streamer and sub-streamers may be eligible for rewards.

[0252] Furthermore, messaging service providers may collect a predetermined percentage of the commission fee, either within or separately from the commission amount, or charge an advertising fee.

[0253] Figure 1-20 shows an example of detailed advertising data in this modified example. In this detailed ad data, the structure of the ad content data differs slightly from that shown in Figure 1-5. Specifically, the advertising content data stores the advertising content ID, advertising content format, advertising content output time, advertising content URI, and the advertising cost, all associated with each other.

[0254] The advertising unit price is not limited to this definition, but can, for example, be the unit price paid by the advertiser to the recipient based on the output of the advertising content with that advertising content ID at the distribution device. The advertising unit price is one example of the value of the information in the advertisement.

[0255] In this example data, the ad price is stored in association with the ad content ID, and the ad price is determined for each ad content; however, this is not limited to this. Alternatively, the ad unit price could be associated with an ad ID and stored, with a fixed ad unit price for each ad. In this case, as an example, the ad unit price could be the same regardless of the ad content, as long as the ad conveys the same message, even if the ad content differs.

[0256] In the above embodiment, based on the fact that advertising content was displayed on the viewer's device 20 during the broadcaster's live chat, the advertiser can pay the main broadcaster a reward amount calculated, not limited to but as an example, for each piece of advertising content, which is calculated as "total number of views of that advertising content × advertising price of that advertising content".

[0257] In this case, the viewer's terminal 20, for example, will output advertising content and, once the advertising content output time has elapsed, will send advertising content viewing information to the server 10 via the communication interface 14, indicating that the advertising content has been viewed. The server 10 will then calculate the above-mentioned reward amount based on the advertising content viewing information received from each viewer's terminal 20, and, for example, for example, will send compensation information, including information indicating that a reward will be paid and information on the reward amount, to the reward recipient's terminal 20 via the communication interface 14. Furthermore, information on viewing the ad content may be sent only if the ad content is displayed for a set period of time or longer. Conversely, information on viewing the ad content may not be sent if the ad content is skipped.

[0258] In this modified example, the viewer's terminal 20 is controlled by the control unit 21 to send advertising content viewing information (not limited to, but an example of information indicating that the user of the terminal has viewed advertising information) to the server 10 via the communication I / F 14. In this case, the server 10 is configured to send compensation information (not limited to, but an example of compensation information based on viewing advertising information) to the reward recipient (not limited to, but an example of the first user or the second user). One example of the effects of this modified configuration is that, based on the fact that the advertising information was viewed by the terminal user, it becomes possible to pay compensation to the first user or the second user based on that viewing.

[0259] <First variation (6)> In the above embodiment, it may be possible to enable the user of terminal 20, from which the advertising content is output, to purchase a product or service related to the advertising content based on their input to the advertising content.

[0260] Figure 1-21 shows an example of the information displayed on the display unit 24 when an operation to select advertising content in the chat room is performed, not as an example of the display shown in Figure 1-10, but as an example of the display shown in Figure 1-10. When a viewer taps on an ad, their browser launches based on the URL embedded in the ad, and a website is displayed in the browser where they can purchase a product or service related to that ad.

[0261] In this example, the display unit 24 shows a website where user A can purchase the advertised recipe book by tapping the advertised SAD. The user can purchase the recipe book by selecting the product and completing the purchase procedure on the website.

[0262] In this case, as an example and not an exhaustive one, the URL of a website (such as an external e-commerce site or an in-app site provided by a messaging service provider) for purchasing products or services related to the advertising content can be associated with the advertising content, such as still image ads or video ads. In this case, as an example and not an exhaustive one, the control unit 11 of the server 10 can store the URL of the website in association with the advertising content ID in the advertising management data.

[0263] In addition, in the advertising management data, instead of associating the website URL with the advertising content ID, it is also possible to associate the website URL with the advertising ID.

[0264] Furthermore, in step S170 of Figure 1-13, the control unit 11 of the server 10 can include the URL of the website associated with the advertising content selected in step S160 in the advertising output information and send it to the terminal 20.

[0265] In the advertising output processing step A150, the control unit 21 of terminal 20 determines whether or not user input (not limited to, but such as an operation input like a tap) has been made to the advertising content via the input / output unit 23. If it is determined that input has been made, it can access the website based on the URL of the website associated with the advertising content received from the server 10, and purchase a product or service based on the user input of terminal 20.

[0266] In this case, instead of immediately accessing the website based on user input for advertising content, terminal 20 may display information such as access confirmation information to ask the user whether or not to access the website, or purchase confirmation information to ask the user whether or not to purchase a product or service, and only access the website if the user agrees.

[0267] Furthermore, if a product or service is purchased in the manner described above, the advertiser may, for example, pay the aforementioned recipient a fee based on the purchase of the product or service.

[0268] This modified example shows a configuration in which terminal 20 displays confirmation information and website information (not limited to, but an example of information for purchasing products or services related to advertising information) on the display unit 24 based on input from the user of terminal 20 regarding advertising content (not limited to, but an example of advertising information). One example of the effects of this modified configuration is that, based on the user's input regarding the advertising information, the user of the device can purchase products or services related to the advertising information.

[0269] <First variation (7)> The viewer's terminal 20 may input content to be charged to the distributor based on user input to the input / output unit 23, and the distributor may be paid based on the distribution of the input content to the server 10. In this specification, "charging" means paying money to the other party. However, it is also possible to refer to the act of paying money to the other party as "payment" and the act of imposing an obligation on the other party to pay money as "charging."

[0270] In this case, instead of being limited, as an example, the messaging service provider could receive a commission of a percentage (not limited, but 30%) of the amount charged by the viewer (the amount paid) (hereinafter referred to as the "charge amount") as stipulated in its terms and conditions, and pay the remaining amount to the main broadcaster.

[0271] Figure 1-22 shows an example of a modified version in which the content displayed in the viewer's area AR changes. Viewers can improve the display priority of their content in the viewer's area of ​​AR by paying a predetermined amount to the main broadcaster. In this example, User II, a viewer, enters the text "I'm looking forward to the recipe!" followed by payment information (not limited to specifics, but for example, the text "@500 yen" or a designated icon) into the text input field. As a result, the amount (in this example, "500 yen") is paid to the main broadcaster, and the text content based on the entered text changes to a form that is more visible than other text content.

[0272] User II's content is displayed in the viewer area AR at "11:36" and then changes to a special form that is more visible than other content. Subsequently, in response to new content being displayed in the viewer area AR, User II's content moves to the top of the viewer area. Even if further new content is displayed in the viewer area AR, User II's content does not move from the top and remains fixed in this position for a set period (not limited to a specific time, but for example, 5 minutes).

[0273] In this example, User II's content remains pinned at the top even after other users' content, which was displayed at a later time than User II's content, has disappeared from the viewer area AR.

[0274] In this case, in steps A1130 and A1140 of Figure 1-14, when the control unit 21 of terminal 20A receives a request to input and send information for executing a payment (not limited to, for example, the text "@500 yen" or a predetermined icon as described above) (A1130: YES), it displays confirmation information for making a payment using a payment method previously registered by user AA (electronic money payment via payment application, credit card payment, debit card payment, prepaid card payment, etc.). When user AA accepts this, it sends the input content and the amount to the server 10 via the communication interface 22 (A1140).

[0275] In steps S1140 and S1150 of Figure 1-14, when server 10 receives information on content and billing amount from terminal 20A via communication I / F 14, it performs payment approval processing with a payment server (not shown) using a registered payment method (S1140). Once payment is approved, it transmits viewer content based on the received content to each terminal 20 via communication I / F 14 (S1150). At this time, the control unit 11 of server 10, as an example but not limited to, associates a billing flag with the viewer content and transmits it to each terminal 20 (S1150).

[0276] Terminal 20, upon receiving viewer content, displays that viewer content at the top of the viewer area for a set period of time, not limited to a specific period, based on whether a billing flag is associated with it (A1150). The same applies to the streamer's device 20.

[0277] Furthermore, if there are multiple viewer content items associated with a payment flag, it is possible to display them higher in order of the amount paid, rather than limiting it to a specific category. In other words, the display order of viewer content can be changed according to the amount paid. Alternatively, viewer content with more recent timestamps could be displayed higher in the search results.

[0278] Furthermore, in this case, to make the difference between this content and regular viewer content that does not have a billing flag associated with it clearer, it may be possible, not limited to but as an example, to display viewer content with a billing flag associated with it using a set color shading. In this case, the shading color may also be changed depending on the amount charged. As an example, rather than being limited, multiple price ranges could be set, and the shading color could be changed depending on which price range the charged amount falls within. Alternatively, instead of using shading, the text color of viewer content may be changed to a different color from regular viewer content, or a mark may be displayed to indicate that a charge has been made in connection with viewer content.

[0279] Furthermore, it is not limited to differentiating the display method for each viewer's content; it is also possible to differentiate the display method for all viewer-generated content for each viewer who has set up billing.

[0280] This modified example shows a configuration in which content entered by the viewer's terminal 20 (not limited to, but an example of second content) includes content related to billing (not limited to, but an example of billing information), and this content is displayed in a different display manner than the normal viewer content displayed in the viewer area. As an example of the effects of this configuration, the second content, which includes billing information, is displayed in a different format than the content displayed in the second area, thus giving the user who enters the second content a sense of exclusivity.

[0281] <First variation (8)> In the above embodiment, the content sent and received between broadcasters may include content related to a survey that viewers can answer.

[0282] Figure 1-23 shows an example of a talk room displayed on the display unit 24 of terminal 20A when a broadcaster conducts a survey targeting viewers. When a broadcaster conducts a survey, they input the survey content along with information for generating the survey into terminal 20. This generates a survey object corresponding to the input content, which is then displayed in the broadcaster's area DR.

[0283] In this example, the streamer, user YY, enters the text "Shall we make the source code ourselves?" followed by information to generate the survey (not limited to this, but for example, the text "@Survey" and a designated icon) into the text input field. As a result, an object ENQ containing the text "Shall we make the source code ourselves?" is displayed in the streamer area DR. The object ENQ contains icons corresponding to "Yes" (in this example, "Make it!") and "No" (in this example, "Don't make it...") as answers to the survey. Viewers can answer the survey by selecting an icon.

[0284] In this case, the viewer's terminal 20 transmits the survey response, which was entered via the input / output unit 23, to the server 10 via the communication interface 22. The control unit 11 of the server 10 then aggregates the survey responses transmitted from each viewer's terminal 20. The aggregated results can then be transmitted to at least one of the terminals 20 of the main broadcaster and the sub-broadcaster.

[0285] This modified example shows a configuration in which content sent and received between a main broadcaster (not limited to, but an example of a first user) and a sub-broadcaster (not limited to, but an example of a second user) includes content related to a survey that viewers (not limited to, but an example of a device user) can answer. As an example of the effects of such modifications, it becomes possible to present questions to terminal users in the form of a survey, which can enhance their interest.

[0286] <First variation (9)> As an example, not limited to this case, there may be situations where a user tries to join a live chat after the broadcast has already started. In this case, displaying a list of the chat rooms where the live chat is taking place, so that the user can see the progress of the live chat, would be helpful for those who are trying to join.

[0287] Figure 1-24 shows an example of information about the talk room displayed on the viewer's device 20A. In this example, the text "NOW ON AIR" is displayed in the app's location display area, indicating that a live chat is currently being broadcast.

[0288] Furthermore, the area below displays a list of currently streaming live chat rooms. For each chat room, information such as the live chat (chat room) icon, title, and summary, the current number of viewers, the streamer's icon and username, and the latest streamer content displayed in the streamer's area of ​​the live chat are shown (not limited to specific rooms, but examples).

[0289] More specifically, in this example, multiple chat room information is displayed, including chat room information TL1 titled "About trendy sweets," chat room information TL2 titled "Takeout meals," and chat room information TL3 titled "Restaurants in Kyoto," etc.

[0290] In addition, in such display examples, the display unit 24 may show a list of talk rooms that are currently being broadcasted and talk rooms that are not currently being broadcasted, and the former and the latter may be displayed in different ways. For example, the former may have the text "Broadcasting" displayed next to the title, and the latter may have the text "Broadcasting stopped" displayed next to the title. Whether or not content is being streamed may be determined based on the fact that neither the streamer's area (DR) nor the viewer's area (AR) has been updated for a set period (not limited to a specific period, for example, "10 minutes"), or it may be determined based on the streamer's actions to start and end the stream.

[0291] Furthermore, the information displayed in the list is not limited to the latest content displayed in the broadcaster's area, but may also be the latest content displayed in the viewer's area, or both.

[0292] In this modified example, the control unit 21 of terminal 20 displays a list of multiple talk rooms in which live chats are taking place on the display unit 24. In this case, for each talk room included in the list, the control unit 21 of terminal 20 displays information regarding the progress of the live chat taking place in that talk room, including, but not limited to, information regarding the latest content sent to that talk room.

[0293] In performing this process, terminal 20 may request a list of multiple chat rooms from server 10, and server 10 may identify the latest content for each chat room included in the list based on the management data of the live chat taking place in that chat room, and send it to terminal 20 along with the list.

[0294] In this modified example, the terminal 20 is controlled by the control unit 21 to display a list of multiple talk rooms, including a first talk room (not limited to, but an example of a first chat room), on the display unit 24. In this case, the information of the first talk room included in the list is configured to include information about the latest content sent to the first talk room. One example of the effects of this modified configuration is that, based on information about the latest content sent to the first chat room and a list of multiple chat rooms including the first chat room, the user of the terminal can understand the progress of the chat taking place in the first chat room, which helps the user of the terminal to choose which chat to participate in.

[0295] <First variation (10)> In the above embodiment, while the live chat is being streamed, the streamer and at least one of the viewers may be allowed to use stamps (stamp content) provided by the advertiser of the output advertising content for the messaging service. The stamp (stamp content) data can be stored by the server 10 as a database in the storage unit 15, so that the terminal 20 can download the stamp (stamp content) data from the server 10 during live chat streaming.

[0296] <Second Example> The second embodiment is an embodiment that allows users of terminal 20 to view live chats that were previously streamed, based on the archiving function.

[0297] The contents described in the second embodiment are applicable to any of the other embodiments or any of the other modifications. Furthermore, components identical to those previously mentioned are given the same symbols, and their explanation is omitted.

[0298] <Data Structure> Figure 2-1 shows an example of the data structure of the live chat archive database 158 stored in the storage unit 15 of the server 10 in this embodiment. The live chat archive database 158 stores live chat archive data as management data for each live stream.

[0299] Each account management data includes, but is not limited to, a chat room ID to identify the chat room where the live chat took place, the chat room name (which may also be the title of the live chat), the main broadcaster's application ID, the live chat start date and time, the live chat end date and time, and sub-broadcaster data related to the sub-broadcaster associated with that live chat. These data can also be considered, but is not limited to, the metadata of the live chat. The sub-distributor data, while not limited to specific examples, stores the sub-distributor's application ID and their username in association.

[0300] In addition to the above, each account management data also stores live chat data related to the live chat that was streamed. Live chat data may include, but is not limited to, broadcaster content history data (data on the history of broadcaster content), viewer content history data (data on the history of viewer content), and advertising content history data (data on the history of advertising content), etc.

[0301] The distributor content history data can, but is not limited to, store associated information such as the time of day associated with the distributor content, the application ID of the distributor from which the content originated, the type of distributor content (text, image, etc.), and the content of the distributor content. The same applies to viewer content history data.

[0302] Furthermore, the advertising content history data can, for example, store associated time information related to the advertising output information corresponding to that advertising content, the advertising content ID of that advertising content, and so on, without being limited to these examples.

[0303] As an example, not limited to this case, after the live chat has ended, the main broadcaster's terminal 20 performs an operation to save (archive) the live chat data, and based on this, the main broadcaster's terminal 20 requests this from the server 10. In response, the server 10 creates live chat archive data based on the data that was saved in real time during the live chat broadcast and stores it in the live chat archive database 158.

[0304] Furthermore, in addition to storing the live chat archive data on server 10, it is also possible, not limited to this, but for example, to store the live chat archive data in the memory unit 28 of the main broadcaster's terminal 20 in a similar format to the live chat archive data stored on server 10, associated with information related to the live chat room, or not to do so.

[0305] <Display screen> Figure 2-2 shows an example of a talk room displayed on the display unit 24 of terminal 20A based on live chat data saved in the archive. Here, we illustrate the case of viewing archived live chat data from "Cooking Researcher X's Live Chat" as described in the first embodiment. However, for the sake of clarity, some parts of the display screen example described above have been modified for convenience.

[0306] In this example, a chat room retrieved from the archive is displayed on user AA's terminal 20A, and the content delivered using that chat room is also displayed. However, unlike the example shown in Figure 1-9, which is not limited to this case, user input into the input field is restricted (prohibited), and a frame containing the text "Archive Displaying" is displayed in the content input area INR. Furthermore, at the top of the chat room, a mark (icon) containing the word "Archive" is displayed next to the title, allowing users to understand that no content is currently being delivered in this chat room and that only previously delivered content is available for viewing.

[0307] In this example, the user viewing the archive is a viewer, and the viewer-oriented configuration of the talk room is shown, with the broadcaster's area (DR) at the top and the viewer's area (AR) at the bottom. When the archive is viewed by the streamer, the chat room may be displayed in a way that is suitable for viewers, or it may be displayed in a way that is suitable for the streamer.

[0308] The live chat example shown here began streaming at 11:00, but no content was sent by the streamer at that time. Therefore, when the chat room is first displayed, nothing is shown in the streamer area (DR). However, in this example, at 11:00, user AA commented "I've been waiting!", and viewer content indicating this is displayed in the viewer area (AR).

[0309] Subsequently, when user AA performs an upward scroll operation on the broadcaster area DR, the broadcaster content sent by user YY at the time "11:01" is displayed in the broadcaster area DR. However, since no viewers other than user AA commented at the time "11:01", the viewer content displayed in the viewer area AR does not change.

[0310] Subsequently, when user AA further scrolls upwards in the broadcaster area DR, the broadcaster content sent by user XX at the time "11:02" appears below user YY's broadcaster content. At this time, since viewers users BB and CC had sent comments, viewer content originating from these users appears in the viewer area AR below user AA's viewer content.

[0311] In this example, based on the user's scrolling actions, content corresponding to the time is displayed sequentially in both the broadcaster's area and the viewer's area.

[0312] Figure 2-3 shows an example where an advertisement (advertising content) is displayed on the display unit 24 of terminal 20A, continuing from Figure 2-2. In Figure 2-2, based on the continued upward scrolling operation by user AA, the same SAD advertisement as in Figure 1-10 is displayed, associated with the time "11:05".

[0313] <Processing> Figures 2-4 and 2-5 are flowcharts showing an example of the processing flow performed by each device in this embodiment. In this example, Figure 2-4 corresponds to the processing section in Figure 1-13, and the processing section in Figure 2-5 is executed immediately afterward.

[0314] In Figure 2-5, the control unit 21 of terminal 20X determines whether or not user XX has made an input request to save the live chat delivered via the input / output unit 23 to an archive (X210). If it determines that such a request has been made (X210: YES), the control unit 21 of terminal 20X sends archive live chat save request information to the server 10 via the communication interface 22 (X220).

[0315] The control unit 11 of the server 10 determines whether or not it has received archive live chat save request information from the terminal 20X via the communication I / F 14 (S210). If it determines that it has received the information (S210: YES), it performs the archive live chat save processing (S220). Specifically, it creates the aforementioned live chat archive data and stores it in the live chat archive database 158 of the storage unit 15.

[0316] The control unit 21 of terminal 20A requests, for example, a list of live chats whose data has been saved in the archive via the input / output unit 23, and displays it on the display unit 24. The control unit 21 of terminal 20A then determines, for example, whether a request has been made to view the live chats saved in the archive, based on whether an input has been made to select a live chat to be viewed via the input / output unit 23 (A210). If it determines that a request has been made (A210: YES), the control unit 21 of terminal 20A sends archive live chat viewing request information, including the live chat selection information, to the server 10 via the communication interface 22 (A220).

[0317] After S220, the control unit 11 of the server 10 determines whether or not it has received archive live chat viewing request information from terminal 20A via the communication interface 14 (S230). If it determines that it has received the information (S230: YES), it refers to the live chat archive database 158 in the storage unit 15 and, based on the data stored in the archive, sends archive live chat viewing information to terminal 20A via the communication interface 14 to enable viewing of the live chat using the archive function (S240).

[0318] When terminal 20A receives information for viewing archived live chat from server 10 via communication I / F14, control unit 21 of terminal 20A performs archived live chat display processing (A230).

[0319] In the archived live chat display process, the control unit 21 of terminal 20A displays the talk room of the live chat that user AA has requested to view on the display unit 24, based on the received archived live chat viewing information. In this case, as an example and not an exhaustive one, server 10 may send metadata and live chat data (information on all live chat history) to terminal 20A as information for viewing archived live chats. This can also be thought of as terminal 20A downloading live chat data from server 10 based on user operations such as selecting a live chat or requesting to view a live chat (not limited to these, but an example of a first input). Then, the control unit 21 of terminal 20A can store the received live chat data in the storage unit 28, and then display a talk room containing content on the display unit 24 based on the live chat data stored in the storage unit 28.

[0320] In addition, the display of the above-mentioned talk room on the display unit 24 and the receipt of all live chat history information from the server 10 may occur at the same time or at different times.

[0321] The control unit 21 of terminal 20A can refer to the live chat data stored in the storage unit 28 in this manner and, based on user input to the input / output unit 23 (not limited to, but for example, scrolling operations), sequentially read out and display broadcaster content and viewer content in chronological order. It can also output advertising content based on advertising content history data.

[0322] In other words, terminal 20 displays a talk room (chat room) that displays broadcaster content on its display unit 24 based on input (an example of a first input, not limited to) from a user of terminal 20 to display the talk room. Furthermore, terminal 20 receives broadcaster content and viewer content from server 10 via communication I / F 22 based on the first input described above. Furthermore, the terminal 20, based on input from its user such as scrolling operations on the talk room displayed on the display unit 24 (not limited to, but an example of a second input), is controlled by the control unit 21 to display the broadcaster's content in the broadcaster's area of ​​the talk room (not limited to, but an example of a first area) and the viewer's content in the viewer's area of ​​the talk room (not limited to, but an example of a second area). The terminal 20 can receive advertising content (not limited to, but an example of advertising information) from the server 10, and the control unit 21 can control the display of the received advertising content in the distributor area.

[0323] Furthermore, in step S240, server 10 may send to terminal 20, not limited to but as an example, the minimum information necessary to display the live chat talk room as information for viewing archived live chats. Specifically, and this is not an exhaustive list, the server 10 sends to the terminal 20A, in addition to metadata, and, for example, some of the information from the entire history of the live chat included in the live chat data (for example, the history information for a set time from the start of the live chat (approximately 1 to 5 minutes)). The control unit 21 of the terminal 20A can then store the information received from the server 10 in the storage unit 28 and display the chat room based on this information.

[0324] In this case, as an example rather than an limitation, the server 10 may, after sending the above information, send the remaining information to the terminal 20A in chronological order at set intervals, and the terminal 20A may sequentially store this information in the storage unit 28.

[0325] Furthermore, as an example and not an exhaustive list, the control unit 21 of terminal 20 may sequentially request information on unreceived live chat history from server 10 in response to user scrolling operations, based on time information associated with the content contained in the received live chat data. The control unit 21 of terminal 20 may then sequentially display the content based on the history information transmitted sequentially from server 10. In other words, the terminal 20 may not initially acquire all the live chat history information, but may first acquire some necessary information and store it in the storage unit 28, and then sequentially acquire the information necessary to display the content from the server 10 based on user input such as scrolling operations, and display it.

[0326] In other words, terminal 20 displays a talk room (chat room) that displays broadcaster content on its display unit 24 based on input (an example of a first input, not limited to) from a user of terminal 20 to display the talk room. Furthermore, terminal 20 receives broadcaster content and viewer content from server 10 via communication I / F 22 based on input such as scrolling operations by the user of terminal 20 (this is not limited to, but is an example of a second input). Furthermore, the terminal 20, based on the second input described above, is controlled by the control unit 21 to display the broadcaster's content in the broadcaster area of ​​the talk room (not limited to, but an example of the first area) and the viewer's content in the viewer area of ​​the talk room (not limited to, but an example of the second area). Furthermore, the terminal 20 may receive advertising content (not limited to, but an example of advertising information) from the server 10, and the control unit 21 may perform control to display the received advertising content in the distributor area.

[0327] The following describes, as an example rather than an extension, a method in which the control unit 21 of terminal 20A refers to live chat data stored in the memory unit 28 and displays the content chronologically based on the user's scrolling operation.

[0328] The control unit 21 of terminal 20A can, for example, display broadcaster content based on the amount of finger movement due to scrolling on the screen and the number of pixels that make up the display screen. This is not an exhaustive example; for instance, it's possible to control scrolling by 100 pixels for every 1 cm of finger movement.

[0329] In this case, if the scroll control causes a new broadcaster content to be displayed in the broadcaster area that is more recent than the most recent broadcaster content already displayed in the broadcaster area, the control unit 21 of terminal 20A controls the display of viewer content to be shown in the viewer area based on the time information associated with that broadcaster content.

[0330] Since the relationship between the amount of finger movement during scrolling and the resulting amount of scrolling (number of pixels) is fixed, it is assumed that the degree to which the streamer area is scrolled in response to how much the finger is moved within the streamer area does not fundamentally change from person to person. However, the streamer content displayed in the streamer area is discrete over time, and the same amount of streamer content may not necessarily be displayed in the streamer area for the same amount of scrolling. Furthermore, viewer content displayed in the viewer area is discrete on the time axis and independent of broadcaster content; therefore, the same amount of viewer content is not necessarily displayed for the same amount of scrolling as broadcaster content. Therefore, the control unit 21 of terminal 20A controls the display of broadcaster content and viewer content based on the scroll operation via the input / output unit 23 as follows.

[0331] Figure 2-6 is an explanatory diagram of the content display control in this embodiment. In this diagram, the horizontal axis represents time (date and time), the left vertical axis represents the cumulative number of live chats (total) for broadcaster content since the start of the live chat, and the right vertical axis represents the cumulative number of live chats (total) for viewer content since the start of the live chat. The solid black line represents the cumulative number of broadcaster content, and the dashed black line represents the cumulative number of viewer content.

[0332] In this example, the cumulative number of broadcaster content pieces remained almost unchanged from time "t1" to time "t3," and the broadcaster's talk was practically at a standstill. As an example, and not limited to this case, suppose in a live cooking chat, the streamer prepares a dish during the live chat and sends an image of the dish as content at time "t1" (or later), causing the image to appear in the streamer's area. Consequently, many viewers send viewer content, including comments and questions about the dish, resulting in a significant increase in the cumulative number of viewer contents starting from time "t2," which is later than time "t1."

[0333] In such cases, the control unit 21 of terminal 20A refers to the time information of the viewer content history data stored in the live chat data and controls the display of viewer content whose time falls within the period from time "t1" to time "t3", updating it sequentially so that the newer time is updated first, followed by the older time, similar to real-time live chat.

[0334] Specifically, the system calculates the scroll amount from the amount of finger movement caused by scrolling, and based on the calculated scroll amount, identifies broadcaster content to be newly displayed in the broadcaster area (or broadcaster content to be hidden from the broadcaster area). Then, based on the time information associated with the broadcaster content and the time information associated with the viewer content, it identifies viewer content whose associated time falls within the period from the time associated with one broadcaster content already displayed in the broadcaster area to the time associated with another broadcaster content to be newly displayed in the broadcaster area, and sequentially updates and displays that viewer content in the viewer area.

[0335] The same applies when scrolling is performed on the viewer's area. In this case, you can simply reverse the above considerations.

[0336] Furthermore, as an example rather than an exclusive one, in the archive live chat display process, a time bar may be configured to scroll the entire screen, and based on user interaction with the time bar, the corresponding broadcaster content may be displayed in the broadcaster area and the corresponding viewer content may be displayed in the viewer area using the same method as described above.

[0337] Alternatively, instead of using time information associated with the content, the corresponding broadcaster content may be displayed in the broadcaster area and the corresponding viewer content in the viewer area, using the same method as described above, based on content identification information (such as a content ID).

[0338] Returning to Figure 2-5, in the archived live chat display process, the control unit 21 of terminal 20A refers to the advertising content history data, and when the timing for outputting advertising content arrives as a result of scroll control, it outputs the advertising content.

[0339] Furthermore, the control unit 21 of terminal 20A, similar to live chat, controls the display to stay in place even if scrolling is performed, or to ensure that the advertising content fits within the screen, until the advertising content output time has elapsed, thereby allowing the user to view the advertising content. Furthermore, it is possible to control the display of broadcaster content other than that already displayed in the broadcaster area, and viewer content other than that already displayed in the viewer area, respectively.

[0340] In this case, a simple example would be to store the advertising content URI or advertising content file in addition to the time information and advertising content ID associated with the advertising content in the aforementioned advertising content history data, and send this from the server 10 to the terminal 20. Then, the control unit 21 of the terminal 20A can output the advertising content at the corresponding time based on the advertising content URI or advertising content file.

[0341] Here, when viewing a live chat in the archive, it's not limited to this case; for example, it's conceivable that a considerable amount of time may have passed since the live chat was broadcast, and that it might be viewed by a user on device 20. However, if the advertising content is related to a product or service, it's possible that the product or service no longer exists due to the passage of time. In other words, the product or service may have become obsolete, rendering the advertisement useless. It's also possible that the period during which the advertisement was permitted (the period during which it could be displayed) has expired.

[0342] Therefore, as an example rather than a limiting one, the server 10 may send and output different advertising content to terminal 20 than the advertising content output to terminal 20 during live chat distribution. In this case, the following patterns are possible. (P1) The timing of ad output (ad content) will be the same as during live chat, but the ad patterns will be different. (P2) Not only are the advertisements (ad content) different, but the timing of ad output is also different from that during live chat.

[0343] In this case, one possible approach is to allow the live chat broadcaster (not limited to specific broadcasters, but for example, the main broadcaster) to set the advertising content displayed on terminal 20 during the archived live chat, as well as the timing of its display, after the live chat has finished. As an example, and not limited to specific situations, if you've set up a real-time live chat to display ads "once every 10 minutes," then in an archived live chat, since users might skip through the content, you could shorten the time interval for displaying ad content and set it to display ads "once every 3 minutes," for example. Alternatively, you can set the ad display interval to be longer than that during live chat broadcasts.

[0344] Alternatively, instead of the broadcaster, server 10 could be configured to automatically handle the settings related to the output of the above advertisements. In this case, the control unit 11 of the server 10 can, for example, at regular intervals (not limited to, but "once a month, for example"), determine and update the advertisements to be displayed on the terminal 20 when an archived live chat is viewed on the terminal 20, by associating them with the live streaming ID, in order to make useful advertising content viewable on the terminal 20 for each live chat archive data of live chats included in the live chat archive database 158, from the latest advertising content.

[0345] In this case, server 10 may also randomly select advertising content from the latest advertising content, similar to real-time live chat. Additionally, server 10 may select advertising content from the latest advertising content based on the context of the live chat, similar to how it would be done in real-time live chat. The same applies to the timing of ad output.

[0346] In this case, the control unit 11 of the server 10 can, as an example, send archive ad output data from the server 10 to the terminal 20A, which includes information regarding the timing of outputting the configured ad content, the ad content ID of the ad content to be output, and the ad content URI or ad content file of that ad content. Then, the control unit 21 of the terminal 20A can output the ad content in the archive live chat display process based on the received archive ad output data.

[0347] The timing at which terminal 20A acquires data for archived ad output is not limited to any one of the following: (G1) The timing of sending the archived live chat viewing request information to server 10, or immediately after that timing. (G2) Timing when the execution of the archived live chat display process begins.

[0348] Alternatively, the terminal 20A may or may not obtain data in advance regarding the timing of when it will output an advertisement from the server 10, and then, based on that data, obtain data regarding the advertisement content to be output from the server 10 at the time when it is time to output an advertisement during the archived live chat display process, or at the time immediately preceding it.

[0349] Alternatively, in the archived live chat display process, the terminal 20 requesting viewing may retrieve the live chat recording data, which has been recorded by the server 10, and play it back to view the archived live chat. In this case, the recorded content will be displayed sequentially. Also, since this is recorded data, when advertising content is displayed, the display will show the advertising content being shown, and consequently, the user will inevitably view the advertising content.

[0350] In this case, as an example rather than an limitation, features such as fast-forward and rewind may be used to allow users to skip to or go back to the time they wish to watch. Furthermore, features such as double-speed or triple-speed playback may also be used to allow users to skip to the time they wish to watch.

[0351] Alternatively, instead of allowing users on terminal 20 to view archived live chats by playing back recorded data, the system may save captured images of the streamed live chats on server 10 or the like, and send these captured images to terminal 20 as archived live chat data. Terminal 20 may then display the captured images in chronological order.

[0352] <Effects of the second example> In this embodiment, the control unit 21 controls the display unit 24 to display a talk room on the viewer's terminal 20 that shows broadcaster content sent and received between the main broadcaster and the sub-broadcaster, based on user input (not limited to, but an example of a first input) from the user of terminal 20 to view archived live chat. Furthermore, the viewer's terminal 20 receives, via the communication interface 22, content sent and received between the main broadcaster and sub-broadcaster, as well as viewer content entered by a viewer other than the main broadcaster and sub-broadcaster (not limited to, but an example of a third user), from the server 10 based on the selection input in the talk room. Furthermore, the control unit 21 controls the viewer's terminal 20 to display broadcaster content in the broadcaster area and viewer content in the viewer area based on user input from the user to the talk room displayed on the display unit 24. The configuration shows that the viewer's terminal 20 receives advertising output information from the server 10, and the control unit 21 controls the display of advertising content in the distributor area based on the received advertising output information. As an example of the effects obtained by this configuration, and not as an example, it is possible to allow users of a terminal to view past live chats, etc., at a later date, and in that case, advertising information can be displayed in the chat room including the first and second users, allowing the terminal users to view the advertisements.

[0353] Furthermore, in this case, the user input (not limited to, but an example of a second input) that triggers the control of displaying the above-mentioned broadcaster content in the broadcaster area or the above-mentioned viewer content in the viewer area can include a scroll operation. As an example of the effects obtained by this configuration, based on the scrolling operation by the terminal user, content sent and received between the first user and the second user can be appropriately displayed in the first area of ​​the chat room, and the first content entered by the third user can be appropriately displayed in the second area of ​​the chat room.

[0354] In this case, the advertising content to be output to terminal 20 can be received from server 10 via communication I / F 22 based on user input (not limited to, but an example of a first input) by the user of terminal 20 to view archived live chat. One example of the effects of this configuration is that advertising information can be received from the server at the same time that the content sent and received between the first user and the second user, and the first content entered by the third user, are received from the server.

[0355] In this case, the advertisement is a video advertisement, and the terminal 20 can be controlled by the control unit 21 to not update the display of broadcaster content or viewer content based on user input to the talk room displayed on the display unit 24 while the advertisement information is being played. One example of the effects obtained by this configuration is that, while a video advertisement is playing, it can be reliably viewed by the user of the device.

[0356] <Third Example> The third embodiment is an embodiment relating to displaying advertisements in a chat room different from the chat room where the live chat described above takes place.

[0357] The contents described in the third embodiment are applicable to any of the other embodiments or other modifications. Furthermore, components identical to those previously mentioned are given the same symbols, and their explanation is omitted.

[0358] <Display screen> Figure 3-1 shows an example of the content displayed in the chat room of terminal 20A. This talk room is not limited to live chat, but is an example of an open chat room (open talk room) used for open chat, and unlike the example in Figure 1-9, there is no viewer area. The in-app location display area shows the text "Cooking Researcher X's Open Chat" along with a mark (icon) containing the word "Open," indicating that it is an open chat. In other words, this example screen shows the display for an open chat room created by user XX as the administrator.

[0359] Users who join an open chat can display the content they type in the area corresponding to the aforementioned broadcaster area in the talk room, that is, the chat area CR (similar to the talk area TR) where content is displayed in speech bubbles. Furthermore, users who join an open chat can use the open chat's talk room to send content they have entered to other users, which will then be displayed in the chat area CR. They can also receive content entered by other users and display it in the chat area CR.

[0360] In this example, the SAD advertisement shown in Figure 1-10 is displayed below the text content "I make them occasionally!" posted by user AA. In other words, in this example screen, advertising content (advertisements based on advertising content) is displayed in the open chat room.

[0361] <Processing> Figure 3-2 is a flowchart showing an example of the processing flow performed by each device in this embodiment. In this process, the user who becomes the administrator of the open chat will be referred to as "User XX," and one of the users participating in the open chat will be referred to as "User AA." The diagram then shows, from left to right, an example of the process executed by the control unit 21 of terminal 20A, the process executed by the control unit 11 of server 10, and the process executed by the control unit 21 of terminal 20X. Note that the processing performed by terminal 20 of users other than user AA and user XX who participate in the open chat is the same as that performed by terminal 20A, so the diagram is omitted.

[0362] The control unit 21 of terminal 20X determines whether or not user XX has requested to host an open chat (X310), and if it determines that a request has been made (X310: YES), it performs open chat setup processing with server 10 (S320, X320).

[0363] The open chat settings process allows you to set the title and theme of the open chat, as well as the type of open chat (public, partially public, etc.). Public access means that, instead of being restricted, any user can join an open chat if they know the link or code information (for example, a QR code (registered trademark)). Partial access does not mean complete restriction; for example, it could be an open chat where only users who know the password or keyword set by the administrator can join, or an open chat where only users who answer a question set by the administrator and are approved by the administrator based on their answers can join.

[0364] The control unit 21 of terminal 20A, for example, searches for open chats based on input to the input / output unit 23 of terminal 20A, and displays the search results on the display unit 24. It then determines whether or not participation in an open chat has been requested via the input / output unit 23 (A310).

[0365] If it is determined that participation in an open chat has been requested (A310: YES), the control unit 21 of terminal 20A sends open chat participation request information to the server 10 via the communication interface 22, not limited to but as an example, requesting participation in the selected open chat (A320).

[0366] When a request to join an open chat is received from terminal 20A via communication I / F14, information necessary to display the open chat talk room is sent to terminal 20A, thereby allowing user AA to join the open chat. This initiates the open chat process on each terminal 20 (A330, S330, X330).

[0367] The subsequent processing is almost the same as in the previously described embodiment. In other words, if it is determined in S150 that the conditions for ad delivery have been met (S150: YES), the control unit 11 of the server 10 performs the processing in steps S160 and S170. Then, the control unit 21 of terminal 20A processes steps A140 and A150, and the control unit 21 of terminal 20X processes steps X140 and X150.

[0368] In step S160, the control unit 11 of the server 10 may or may not select advertising content based on settings made by the administrator (user XX).

[0369] Furthermore, since open chat is an open chat format, as mentioned above, the confidentiality of communications may not apply. For this reason, in step S160, the control unit 11 of the server 10 may, but not necessarily, select advertising content to be delivered from the advertising content database 159 based on the context of the chat in the open chat.

[0370] While this explanation uses open chat as an example, advertising content can also be displayed in regular, non-open chat rooms. This is not limited to open chats; examples include the one-on-one chat rooms, group chat rooms, and open chat rooms mentioned earlier. However, since these chat rooms are not open chat rooms, the confidentiality of communications applies. For this reason, in step S160, the control unit 11 of the server 10 may, but is not limited to, randomly select advertising content from the advertising content database 159.

[0371] Furthermore, in relation to the live chat described in the first embodiment, it is also possible to apply this to live chat without a viewer comment function. A live chat without viewer comment functionality can be a live chat where viewers can only watch the chat between broadcasters and are unable to comment.

[0372] <Effects of the third embodiment> In this embodiment, terminal 20 displays on the display unit 24 a talk room or open chat room (an example of a chat room, not limited to this) that includes a user different from the user of terminal 20 (not limited to this, but an example of a first user) and the user of terminal 20 (not limited to this, but an example of the terminal's users). Furthermore, terminal 20 receives advertising output information transmitted from server 10 via communication I / F 22. The terminal 20 is configured such that the control unit 21 controls the display of advertising content based on advertising output information in the chat room. As an example of the effects obtained by this configuration, advertising information sent from a sender different from these users can be displayed in a chat room that includes a first user different from the terminal user and the terminal user, and can be viewed by the terminal user and others.

[0373] <Fourth Example> The fourth embodiment is an embodiment that enables video viewing within a chat room containing multiple users.

[0374] The contents described in the fourth embodiment are applicable to any of the other embodiments or any of the other modifications. Furthermore, components identical to those previously mentioned are given the same symbols, and their explanation is omitted.

[0375] In this embodiment, as an example rather than an limitation, we illustrate a case where two or more users are chatting in a chat room. Here, as a simple example, we will illustrate a scenario where two users watch a video while chatting in a one-on-one chat room.

[0376] <Display screen> The following describes examples of display screens. The video being played can be displayed in any of the following positions, not exclusively, but as an example. (M1) Any position within the talk area (M2) Any position within the entire area of ​​the display unit

[0377] (M1) allows you to set any position within the talk area as the default position for displaying the video (not limited to any specific position, but for example, the top or bottom of the talk area).

[0378] (M2) allows you to set any position within the entire display area, including the area at the top of the screen where the application name etc. is displayed, the area below it that displays the in-app location, and the content input area INR at the bottom of the screen, as the default position for displaying the video. The video may be displayed in a position that does not overlap the talk area at all, or it may be displayed in a position that partially overlaps the talk area.

[0379] Furthermore, as an example rather than a limitation, when applying (M1), the video can be displayed in one of the following ways: (N1) Embedding method (N2) Floating type

[0380] (N1) Conceptually, the embedding method can be a method in which content and video are placed on the same layer. In this method, scrolling control can be performed on the talk area based on the user's scrolling operation on the talk area. As a result, the content and video can be scrolled together, and the positions of both the content and the video can change.

[0381] (N2) The floating method can conceptually be a method in which the layer on which content is placed and the layer on which video is placed are different. In this method, scrolling control can be performed on the layer on which content is placed based on the user's scrolling operation on the talk area. As a result, the position of the content can change, but the position of the video can remain unchanged.

[0382] In the following, the area where the video is displayed will be referred to as the "video display area."

[0383] Figures 4-1, 4-2, and 4-3 show examples of screens displayed on the display unit 24 of the terminal 20 in this embodiment. This section explains an example where user PP and user QQ watch a video together while chatting in a one-on-one chat room. Furthermore, in this example, the video to be viewed is not limited to a specific video, but rather, as an example, a video created by user XX (the main broadcaster of the live chat that appeared in the previous embodiment) (a video about how to make hamburgers) that is stored in the storage unit 15 of the server 10.

[0384] In this example, the video display area MR is located above the talk area TR, but it is not limited to this position; it could be in the center or below. Furthermore, the video display area MR may not overlap with the talk area TR. If the video display area MR does not overlap with the talk area TR, its position may be above or below the talk area TR.

[0385] Figure 4-1 shows that when a user PP taps the file icon displayed in the lower right corner of the talk area TR, the video selection area MSR, which includes a list of videos, rises up from the bottom of the screen. An example is then shown in which a video selected from that list ("Super Easy! Authentic! How to Make Hamburgers") is played in the talk room. The user PP can select a video to display in the chat room using their own device 20P, and that video will then appear in the video display area MR, allowing the user to begin preparing for video playback.

[0386] In this example, user PP may also be able to start video playback in the video display area MR by selecting a video to display in the chat room using their own terminal 20P.

[0387] In this example, as shown in Figure 4-2, user PP is configured to start video playback by tapping the video display area MR using their own device 20P. Video playback also starts at the same time in the video display area MR of the chat room displayed on the chat room device 20Q of user QQ, who is the chat partner, at the same time as on device 20P. Since the video played on terminal 20P and the video played on terminal 20Q proceed simultaneously, users PP and QQ will see the same scene when the video is playing.

[0388] In the example shown in Figure 4-2, when playback of a video selected by the user PP begins, the user PP's content includes the text "Video sent," an icon representing the video, identification information for the video currently playing (in this example, information such as the video title), and an icon containing the text "Playing," all displayed within a common speech bubble. In this way, content different from the video is displayed in the talk area TR, indicating that the video specified by the user PP is being played in the video display area MR.

[0389] In this example, both user PP and user QQ may be allowed to select a video. Alternatively, only one of the users may be allowed to select a video.

[0390] In this example, the user QQ may also be able to start video playback by tapping the video display area MR on their device 20Q.

[0391] Figure 4-3 shows an example where the position and size of the displayed video are changed based on user input. In this example, a zoom-out / zoom-in button is displayed in the lower right corner of the video display area (MR) to zoom in and out. When this button is tapped, the video display area (MR) above the talk area (TR) on the left side of Figure 4-3 is reduced in size, as shown in the center of Figure 4-3.

[0392] Furthermore, this example shows the reduced video display area MR being dragged by the user towards the lower left. As a result, as shown on the right side of Figure 4-3, the video display area MR has moved and is displayed in the lower left of the talk area TR. This improves the visibility of user-generated content displayed in the chat area.

[0393] Unlike this example, the video display area MR may be scaled down or up based on user pinch gestures (pinch-in / pinch-out gestures) on the video display area MR.

[0394] <Processing> Figure 4-4 is a flowchart showing an example of the processing flow performed by each device in this embodiment. In this process, similar to the display screen example above, the process will be illustrated and explained as involving user PP's terminal 20P, user QQ's terminal 20Q, and server 10.

[0395] If the control unit 21 of terminal 20P determines that input for a talk with user QQ has been received via the input / output unit 23, it sends talk room request information to the server 10 via the communication interface 22 to request talk room content (P410). Upon receiving the talk room request information from terminal 20P via the communication interface 14, the control unit 11 of server 10 sends talk room information, including the talk room content, to terminal 20P via the communication interface 14 (S410). Upon receiving the talk room information from server 10 via the communication interface 22, the control unit 21 of terminal 20P displays the talk room on the display unit 24 based on the received talk room information (P420). The same applies to terminal 20Q (Q410, Q420).

[0396] Subsequently, a talk process takes place between terminal 20P and terminal 20Q via server 10. During the talk process, content such as text content and image content is sent and received between terminal 20P and terminal 20Q via server 10, and the content is displayed in the talk area of ​​the talk room on each terminal 20.

[0397] The control unit 21 of terminal 20P determines whether or not an input for sharing video has been made via the input / output unit 23 (P440). The videos shared here are not limited to any one of the following, but are examples: • Videos stored in the memory unit 28 of the terminal 20 • Videos stored in the memory unit 15 of server 10 (not limited to these, but examples include videos stored independently by server 10, videos uploaded by video creators or posters, videos provided by video streaming services, etc.)

[0398] If it is determined that input for sharing a video has been received (P440: YES), the control unit 21 of terminal 20P sends video sharing request information to the server 10 via the communication interface 22, not limited to but as an example, to request the sharing of the selected video (P450).

[0399] In this case, when sharing a video stored in the memory unit 28 of terminal 20P, it is possible, not limited to but as an example, to send the video data to the server 10. When sharing videos stored in the storage unit 15 of server 10, the system can, for example, request a video list based on the tapping of the aforementioned file icon, display the video list received from server 10, and then send the identification information of the selected video from that list.

[0400] The control unit 11 of the server 10 determines whether or not it has received video sharing request information from the terminal 20P via the communication I / F 14 (S450). If it determines that it has received the information (S450: YES), it performs video sharing control processing (video playback control processing) (S460).

[0401] In the video sharing control process, the control unit 11 of the server 10 acquires video data based on the URI of the selected video, not limited to this case but as an example. Then, not limited to this case but as an example, it sends the data of the first frame of the video to terminal 20P and terminal 20Q, respectively.

[0402] In response, terminals 20P and 20Q display the first frame in the video display area, and superimpose information related to the playback of that video (not limited to this, but for example, a play button, etc.) on top of it. When a video display area, including a play button, is tapped on terminal 20P via the input / output unit 23, information to that effect is sent from terminal 20P to server 10. Based on the video data, server 10 then streams the video to each terminal 20, and video playback begins. The same applies when pausing (interrupting), resuming, or ending video playback.

[0403] When receiving a video streaming from the server 10 via the communication interface 22 (Q450: YES), the control unit 21 of the terminal 20Q executes video playback processing (Q460).

[0404] Through video sharing control processing, the video is displayed in a virtually synchronized state on each terminal 20 (terminal 20P, terminal 20Q) (P460, Q460). In this case, the control unit 21 of each terminal 20 can, for example, execute video display processing and talk processing in parallel. As a result, terminal 20 can send, receive, and display content other than the video being played, even while a video is being played.

[0405] Furthermore, it is possible to avoid executing video display processing and talk processing in parallel. In this case, as an example (though not limited to this), it is possible to prevent the sending, receiving, or display of content other than the video being played while the video is playing.

[0406] In this case, the visibility of the content displayed in the talk area may decrease due to the display of the video. For this reason, as mentioned above, the control unit 21 of each terminal 20 may move the position of the video display area or enlarge or reduce it based on user input. In this case, the floating method (N2) mentioned above can be applied as the video display method, not as a limitation, but as an example.

[0407] Furthermore, as an example rather than an exclusive one, based on a user's downward scrolling operation, the control unit 21 of terminal 20 can display older content that was hidden from the talk area due to content updates within the talk area through scroll control. Furthermore, as an example rather than an limitation, based on an upward scrolling operation by the user, the control unit 21 of the terminal 20 can display new content in the talk area on the time axis by scroll control.

[0408] In this example, the user playing the video is described as User PP, but this is not limited to this. The user playing the video may also be User QQ. Furthermore, both users may be allowed to play the video.

[0409] Furthermore, it may be possible to enable users to search for videos distributed by video streaming services based on a search engine provided by the messaging service provider (the search engine provided by server 10), and then play the video selected by the user from the search results. In this case, as an example rather than an limitation, server 10 could be configured to function as a relay server (proxy server) that acts as an intermediary between the video streaming service server and terminal 20 to play the video.

[0410] <Effects of the 4th embodiment> In this embodiment, the control unit 21 controls the display unit 24 to display a talk room (an example of a chat room) containing one user (not limited to, but an example of a terminal user) and another user (not limited to, but an example of the first user of the first terminal) on the terminal 20 (not limited to, but an example of a terminal). Furthermore, the control unit 21 controls one user's terminal 20 to display content sent and received between another user's terminal 20 and its own terminal 20 in the chat room. Furthermore, one user's terminal 20 transmits information about the video to be watched together (not limited to, but an example of first video information) to another user's terminal 20 (not limited to, but an example of first terminal) based on input (not limited to, but an example of input to the terminal) related to sharing and watching a video by one user, and the control unit 21 controls the playback of the video (not limited to, but an example of first video) based on this information within the chat room. In this case, the video is configured to be played in a chat room between at least one user's terminal 20 and another user's terminal 20, based on input (not limited to, but an example of a first input) from one user regarding the playback of that video. As an example of the effects of this configuration, a video based on the first video information can be played in a chat room that includes the first user of the first terminal and the user of the terminal. As a result, it becomes possible to watch the video together.

[0411] In this embodiment, video information is transmitted via server 10 from terminal 20 of one user (not limited to, but an example of a terminal user) to terminal 20 of another user (not limited to, but an example of a first user) (not limited to, but an example of a first terminal). However, as mentioned above, this can be considered as video information being transmitted from terminal to first terminal. The same applies hereafter.

[0412] In this case, the terminal 20 of one user can be configured so that the control unit 21 controls the position of the video in the talk room based on input such as dragging operations on the video display area by that user (not limited to, but an example of input on the first video by the terminal user). As an example of the effects of this configuration, by controlling the position of the first video in the chat room, it is possible to prevent a decrease in the visibility of information displayed in the chat room, not as an example but as an example.

[0413] In this case, the terminal 20 of one user can be configured so that the control unit 21 controls the size of the video on the talk room based on input such as pinch gestures on the video display area by that user. As an example of the effects of this configuration, by controlling the size of the first video in the chat room, it is possible to prevent a decrease in the visibility of information displayed in the chat room, not as an example but as an example.

[0414] Furthermore, in this embodiment, the video can be displayed in the talk area of ​​the talk room (not limited to, but an example of the first area). In this case, the terminal 20 of one user may, for example, apply the (N2) floating method described above, and the control unit 21 controls the movement of the content in the talk room based on input such as scrolling operations by one user in the talk room (not limited to, but an example of the second input), and the control unit 21 also controls the position of the video displayed in the talk area not to move. One example of the effects of this configuration is that the first video displayed in the first area can be reliably viewed by the user. Furthermore, by moving the position of the content sent and received between the first terminals in the chat room, it becomes possible to make the content that was obscured by the first area visible to the user.

[0415] <Fourth variation (1)> The above example illustrates the case of playing a video in a one-on-one chat room, but it is not limited to this. Rather than being limited, it is also possible to display the aforementioned group chat room, open chat room, or OA chat room and play a video while chatting (talking).

[0416] Furthermore, and this is not limited to specific scenarios, it is also possible to play a video while conducting the aforementioned live chat, as an example. As for live chat, • Live chat with viewer comment function • Live chat without viewer comment function It is possible to apply either of the following.

[0417] Figure 4-5 shows an example of a chat room displayed on terminal 20X of user XX, the main broadcaster of the live chat mentioned above. This example illustrates a scenario in a live chat without viewer comment functionality where the main streamer, user XX, shares a video, and both the streamer and viewers watch the shared video together.

[0418] This chat room has the aforementioned broadcaster area (DR), but no viewer area (AR). Furthermore, this chat room has a video display area (MR) superimposed on the broadcaster area (DR).

[0419] In this example, the video display area MR is located at the top of the distributor area DR, but it is not limited to this location; it may also be located in the center or at the bottom. Furthermore, the video display area MR may not overlap with the distributor area DR. If the video display area MR does not overlap with the distributor area DR, its position may be above or below the distributor area DR.

[0420] This example shows how user XX, the main broadcaster, plays a video selected from the video list within the chat room. By using their device 20X to select a video to display in the chat room, user XX's video appears in the video display area MR, and playback begins. As an example, and not limited to this, similar to Figure 4-1, the user can select the video to play by tapping the file icon displayed in the lower right corner of the distributor area DR.

[0421] In this case, the same video will also start playing in the video display area MR of the chat room displayed on the device 20Y of user YY, who is the sub-broadcaster. Since the video playing on device 20X and the video playing on device 20Y proceed simultaneously, the main streamer and the sub-streamer will see the same scene when the video is playing.

[0422] In this example, the same video will also start playing on the viewer's device 20. In other words, the video selected by the broadcaster will be played in the video display area (MR) of the chat room that the viewer is viewing. Therefore, both the streamer (user XX, user YY) and the viewer (user AA, etc.) who are watching the same chat room will see the same scene when the video is playing.

[0423] In this way, videos are shared among broadcasters and between broadcasters and viewers. At the top of the chat room, the title of the live chat (live chat chat room) "X's Cooking Commentary" is displayed, and to the right of it, the text "LIVE" is displayed, indicating that the video currently playing is being shared between the broadcaster and the viewer. These displays are also shown on the viewer's device 20, giving viewers the impression that the broadcaster's text content and videos specified by the broadcaster are being shared in real time within the chat room created by the broadcaster.

[0424] In the example shown in Figure 4-5, when playback of a video selected by the broadcaster begins, the broadcaster's content includes the text "Video sent," an icon representing the video, identification information for the video currently playing, and an icon containing the text "Playing," all displayed within a common speech bubble. In this way, content different from the video is displayed in the broadcaster area (DR) of the chat room, indicating that the video specified by the broadcaster is being played in the video display area (MR).

[0425] Furthermore, it is possible to allow only the main streamer to select videos, or to allow both the main streamer and sub-streamers to select videos. Additionally, among sub-streamers, only those who have been enabled by the main streamer to select videos may be allowed to select videos.

[0426] Figure 4-6 shows an example of the information displayed in the chat room when a broadcaster sends content to a video that is currently being streamed. As shown in the diagram, on the broadcaster's terminal 20, during video playback, text content sent by the main broadcaster is displayed on the right side of the broadcaster area DR, and text content sent by the sub-broadcaster is displayed on the left side of the broadcaster area DR. In this way, the interaction between the main and sub-streamers via text content is displayed in real time during video playback, making this format suitable for explaining videos to viewers.

[0427] Figure 4-7 is a flowchart showing an example of the processing flow performed by each device in this modified example. In this process, the main broadcaster is designated as user XX, and the sub-broadcaster as user YY. This diagram shows, from left to right, an example of the process executed by the control unit 21 of terminal 20X, the process executed by the control unit 11 of server 10, and the process executed by the control unit 21 of terminal 20Y.

[0428] Note that the processes executed by the viewer's terminal 20 are not shown in the diagram here. When applied to live chat with viewer comment functionality, the S430 live chat processing can be configured to execute the process shown in Figure 1-14. Furthermore, when applying this to a live chat without a viewer comment function, the live chat processing in S430 can be configured to execute all steps except for steps A1130 to A1150, steps S1140 and S1150, and steps X1140 and X1150 of the processing shown in Figure 1-14.

[0429] If terminal 20X requests live chat streaming (X410:YES), the control unit 11 of server 10 performs live chat streaming configuration processing with terminal 20X to configure settings related to live chat streaming (S420, X420). In the live chat streaming setup process, for example, terminal 20X may communicate with server 10 to set the title and theme of the live chat, or select and set users from among the users registered as friends in the messaging application to be sub-streamers and invite them. The conditions for starting a live chat are not limited; they can be the same as those for the live chat mentioned earlier, for example.

[0430] When the control unit 21 of terminal 20Y receives live chat invitation information from the server 10, it determines, not limited to but as an example, whether an input accepting the invitation based on that invitation information has been made via the input / output unit 23 of terminal 20A. If it determines that the invitation has been accepted, the control unit 21 of terminal 20Y transmits live chat participation acceptance information, including, not limited to but as an example, its own terminal 20 or the application ID 283 of its terminal 20's user, to the server 10 via the communication interface 22 (Y420).

[0431] The control unit 11 of the server 10 starts live chat processing based on the information transmitted from each terminal 20 (S430, X430, Y430). In this case, and not as an example, the control unit 21 of each terminal 20 can be configured to execute video display processing and live chat processing in parallel. As a result, even while a video is playing, the terminal 20 can send, receive, and display content other than the video being played.

[0432] Furthermore, it is possible to avoid executing video display processing and live chat processing in parallel. In this case, as an example (though not limited to this), it is possible to prevent the sending, receiving, or display of content other than the video being played while a video is playing.

[0433] In live chat processing, the control unit 11 of the server 10 transmits the broadcaster content sent from the broadcaster's terminal 20 to other broadcasters' terminals 20 and viewers' terminals 20. The terminal 20 that receives the broadcaster content then displays the received broadcaster content in the broadcaster area of ​​the live chat talk room displayed on the display unit 24 of its own terminal 20, associating it with the user who sent it, using speech bubbles or the like.

[0434] Next, the control unit 21 of terminal 20X performs the steps X440 to X460. These steps are similar to the steps P440 to P460 in Figure 4-4, but are not limited to these steps. Then, the control unit 21 of terminal 20X proceeds to process X490.

[0435] Similarly, the control unit 11 of the server 10 processes the steps in S450 and S460. In this case, the control unit 11 of the server 10 can, as an example and not an exception, also stream the video data of the video selected as the video to be shared to the viewer's terminal 20. Then, the control unit 11 of the server 10 proceeds to process S490.

[0436] Similarly, the control unit 21 of terminal 20Y performs the steps Y450 and Y460. These steps are similar to the steps Q450 and Q460 in Figure 4-4, but are not limited to these steps. Then, the control unit 21 of terminal 20Y proceeds to process Y490.

[0437] As a result of the video sharing control process, in this example, the video requested to be shared by user XX is displayed on each terminal 20 in a substantially synchronized state (X460, Y460, etc.). In this case, each terminal 20 displays the video in the video display area, as described above. In other words, on the terminal 20 from which the video was delivered, the user will see the same scene as when the video is playing, as described above.

[0438] Furthermore, if the video display area is configured as shown in Figure 4-5, a portion of the broadcaster area will be obscured by the video display area, making the broadcaster content displayed in the obscured area invisible. For this reason, and not as an example, the control unit 21 in each terminal 20 may perform control to move or shrink the video display area within the broadcaster area based on operations performed by the user to move or shrink the video display area.

[0439] Furthermore, as an example rather than an limitation, based on a user's downward scrolling operation, the control unit 21 of the terminal 20 can display older broadcaster content that was hidden from the broadcaster area due to updates to the broadcaster content within the broadcaster area through scroll control. Furthermore, as an example rather than an limitation, based on an upward scrolling operation by the user, the control unit 21 of the terminal 20 can display new broadcaster content within the broadcaster area on the time axis through scroll control. In this case, the control unit 21 of the terminal 20 can, for example, control the position of the broadcaster's content in response to a scroll operation, but control it so as not to move the position of the video display area.

[0440] In this example, the user playing the video is described as the main broadcaster (user XX), but this is not limited to this. The user playing the video may also be a sub-broadcaster (user YY). Furthermore, it may be possible to allow both to play the video.

[0441] <Fourth variation (2)> In the above embodiment, when a video to be shared is selected by the user, the first frame of that video (which could also be called the video thumbnail) is displayed in the video display area MR, and the video is played in the video display area MR based on the tapping of the video display area MR, but the embodiment is not limited to this. As an example, rather than being limited, when a video to be shared is selected by the user, the video may be streamed to each device 20 via the server 10, and the video may be played on each device 20. In other words, the video may be played on each device 20 without the user having to tap the video display area MR.

[0442] Furthermore, it is possible to restrict playback to only users who have selected a video, or to allow both users who have selected a video and users who have not. Additionally, among users who have not selected a video, it is possible to restrict playback to only those users who have been granted permission to play videos by users who have selected a video.

[0443] <Fourth variation (3)> Terminal 20 may be enabled to save video data shared by users of Terminal 20 in a chat room to the server 10's archive, either during the chat or after the chat has ended.

[0444] In this case, as shown in Figure 4-4, the control unit 21 of terminal 20P determines whether user PP has made an input via the input / output unit 23 to archive the video during the execution of talk processing or when it determines that the talk has ended at P490 (P490: YES). If it determines that an input has been made, it requests server 10 to archive the shared video data in association with that talk room (in the above example, a one-on-one talk room with user QQ as the talk partner). In response, server 10 can associate the video data with the identification information of the chat room (not limited to, but for example, the chat room ID) and store it in the archive.

[0445] In this case, and this is not limited to a specific scenario, but rather an example, after a conversation in that chat room has ended, user PP can reopen the chat room, download the saved video data from the archive, and play it, allowing them to view (review) the content of the conversation they had with user QQ while simultaneously watching the video they watched together.

[0446] Furthermore, in addition to archiving and saving the video data and the chat room in association with each other on the server 10, the video data and the chat room may also be stored in association with each other on the storage unit 28 of the user PP's terminal 20P.

[0447] The same applies to the live chat processing shown in Figure 4-7. In this case, as an example rather than an limitation, based on input from the main broadcaster, user XX, to terminal 20X, video data shared by user XX in live chat can be archived and saved on server 10 in association with the live chat talk room. Furthermore, the video data and its associated live chat talk room may also be stored in the storage unit 28 of user XX's terminal 20X.

[0448] The above information applies to both live chats with and without the viewer comment function.

[0449] This modified example shows a configuration in which terminal 20, based on user input to terminal 20, has a control unit 21 that performs processes to associate information about the video played in the live chat with the chat room where the live chat took place, and to store this information in server 10, or to store it in terminal 20. As an example of the effects of this modified configuration, by associating and storing video information with chat rooms based on user input to the terminal, the user of the terminal can later view the video based on that video information while viewing the chat content in that chat room.

[0450] <Example 5> The fifth embodiment is an embodiment in which, if content is sent by the user while the video is playing in the fourth embodiment, content is displayed that includes information about the video playback time (elapsed time) at the time the content was sent.

[0451] The contents described in the fifth embodiment are applicable to any of the other embodiments or other modifications. Furthermore, components identical to those previously mentioned are given the same symbols, and their explanation is omitted.

[0452] <Display screen> Figure 5-1 shows an example of the talk room screen displayed on the display unit 24 of the user PP terminal 20P in this embodiment. This figure, like Figures 4-1 to 4-3, is an example of a display screen where the talk partner is user QQ.

[0453] In this example, when a user enters text or other content on their respective terminal 20 while a video is playing, the elapsed time from the start of video playback is displayed along with the entered content, either when the content appears in the chat room on their terminal 20 or when the content is sent to the server 10. In this example, the elapsed time is displayed with an underline after the text for each piece of content from both user PP and user QQ. Note that underlining is not mandatory. In this way, by adding the elapsed time from the start of video playback, it becomes possible to understand at what point in the video the content was transmitted.

[0454] <Processing> Figure 5-2 is a flowchart showing an example of the processing flow performed by each device in this embodiment. Here, the left side shows the processing performed by the control unit 21 of terminal 20P, and the right side shows the processing performed by the control unit 11 of server 10. This process is not limited to this specific case, but can, for example, be executed in parallel with the talk process shown in Figure 4-4 or the live chat process shown in Figure 4-7.

[0455] The control unit 21 of terminal 20P determines whether content has been input by user PP via the input / output unit 23 and whether an operation to transmit has been performed (P4110). If it determines that this has been done (P4110: YES), the control unit 21 of terminal 20P displays content including the input content and the elapsed time since the start of video playback at that time (which can also be called the current playback time of the video) in the talk area of ​​its terminal 20P as content originating from user PP (P4120). Then, the control unit 21 of terminal 20P transmits the content, including the elapsed time, to the server 10 via the communication interface 22 (P4130).

[0456] Note that the order of steps P4120 and P4130 may be reversed. In this case, the elapsed time to be added will be the elapsed time when the input content is sent to server 10.

[0457] When the server 10 receives content including the elapsed time from terminal 20P via the communication interface 14 (S4110: YES), the control unit 11 of the server 10 transmits that content to the other party's terminal 20 (terminal 20Q in this example) (S4120). In response, the control unit 21 of terminal 20Q displays the received content including the elapsed time in its own terminal 20Q's talk area as content originating from user PP.

[0458] This is not a limitation, but rather an example; the same applies when content is entered on terminal 20Q (S4130, S4140, P4140, P4150).

[0459] In the example mentioned above, the video was shared by user PP. Therefore, content originating from user PP may include elapsed time, but content originating from user QQ may not.

[0460] Furthermore, in this example, content including the elapsed time is generated at the content source terminal 20, and the server 10 relays it, but the process is not limited to this. The server 10 may generate content including the elapsed time and send it to each terminal 20. In this case, as an example rather than an limitation, the order of steps P4120 and P4130 can be reversed, and terminal 20P can send only the content entered by user PP to server 10 (P4130), and server 10 can receive the content with the elapsed time added and display it in the talk area (P4120).

[0461] Furthermore, in this example, the elapsed time is automatically added to the content sent during the video playback period, but this is not limited to this. As an example, when a user submits content, they can enter a specified identifier or object (not limited to this example, the text "@video time" or a designated icon) in the input field along with the content to be displayed in the speech bubble, so that the elapsed time is added to the content.

[0462] Furthermore, in the above configuration, the control unit 11 of the server 10 may include link-formatted elapsed time information in the content. In this case, as an example and not an exhaustive one, the control unit 11 of the server 10 may, based on the fact that the elapsed time information is tapped on the user's terminal 20, cause the video to start playing from the playback time corresponding to that elapsed time. In this case, the control unit 11 of the server 10 may, as an example and not an exhaustive one, cause the streaming video to start playing from its playback time, so to speak, causing the shared video to be delivered from a rewound playback time.

[0463] Furthermore, the video may be configured to start playing from the time the elapsed time information was tapped, but only on the device 20. In this case, a function button to return to the original streaming video from the rewound playback time may be displayed in addition to the video display area.

[0464] <Effects of the 5th Example> This embodiment shows a configuration in which, while a shared video (not limited to, but an example of a first video) is being played on one user's terminal 20, if content (not limited to, but a first content) is sent from one user's terminal 20, the control unit 21 controls the display of content in the chat room, including the playback time of the video at the time the content was sent. One example of the effects of this modified configuration is that the user of the terminal can be notified of the playback time of the first video when the first content is transmitted from the terminal.

[0465] <Fifth variation (1)> The above embodiment, like the fourth variation (1), is similarly applicable to cases where talks (chat) take place in various talk rooms (chat rooms), such as one-on-one talk rooms, group talk rooms, open chat rooms, OA talk rooms, and live chat talk rooms.

[0466] Figure 5-3, like Figures 4-5 and 4-6, is an example illustrating the application of the feature to a live chat without viewer comment functionality, rather than being a limiting example. It shows an example of the information displayed in the chat room when a broadcaster sends content to a video being streamed. As mentioned earlier, this example shows a case where elapsed time is added to content based on the input of a defined identifier or object (not limited to, but for example, the text "@video time" or a designated icon) into the input field.

[0467] As shown in the diagram, when the broadcaster enters text on the broadcaster's terminal 20X while a video is playing, the text content based on the entered text is displayed along with the elapsed time since the start of video playback at the time the text content is displayed. In this example, the text content "14:05" from user XX is displayed when "2 minutes" have elapsed since the start of video playback, and in this example, "2:00" is displayed with an underline after the text content.

[0468] As mentioned above, the control unit 11 of the server 10 may include elapsed time information in link format in the broadcaster's content. Also, as mentioned above, the video may be set to start playing from the playback time only on the terminal 20 where the elapsed time information is tapped.

[0469] <Sixth Example> The sixth embodiment, as an example rather than an limitation, is an embodiment that enables the display of information regarding the presence of a talk room (chat room) on terminal 20, as in the fourth and fifth embodiments.

[0470] The contents described in the sixth embodiment are applicable to any of the other embodiments or other modifications. Furthermore, components identical to those previously mentioned are given the same symbols, and their explanation is omitted.

[0471] In the above embodiment, it was made possible for multiple users to watch a video together in a chat room. However, in some cases, users other than the user trying to share the video may not necessarily be participating in the chat room on their own device 20. In this case, users who wish to watch the video together may want to confirm that all users are present before starting playback. Therefore, terminal 20 may be configured to display information regarding the presence of the talk room on the display unit 24.

[0472] In this embodiment, "presence" can be used, not as an extension but as an example, to represent a user's presence or absence status in a messaging application. Furthermore, "chat room (talk room) presence" can be used, not as a limiting term, but as an example, to represent the presence status, absence information, etc., of users participating in the chat (talk) within that chat room. The presence of a chat room may also be expressed as "the presence of users included in the chat room" or "the presence of users within the chat room."

[0473] In this embodiment, we illustrate a method for displaying presence information based on the communication status of each user's terminal 20, including the user themselves, who is conducting a conversation in the chat room. In this embodiment, for convenience, the state in which terminal 20 is running (starting) a messaging application in the foreground (foreground communication) is referred to as "online," not as an limitation but as an example. Furthermore, in this embodiment, for convenience, we will refer to (T1) the state in which terminal 20 has completely stopped the messaging application (not running even in the background) or (T2) the state in which terminal 20 is running the messaging application in the background (background communication) as "offline" as an example, rather than an limitation.

[0474] Furthermore, if the messaging application on terminal 20 is configured to run in state (T2) by default, the user may be allowed to forcibly stop the messaging application and switch to state (T1). Furthermore, the above classifications are merely examples and not limiting; for instance, the (T2) state may be considered online.

[0475] <Display screen> Here, as an example rather than a specific one, we will explain how to display presence information in a group chat room, assuming that three or more users are watching a video in that group chat room.

[0476] Figures 6-1 and 6-2 show an example of a group talk room screen displayed on the display unit 24 of the terminal 20 in this embodiment. Here, it is assumed that three users, PP, Q, Q, and RR, have formed a group in a messaging application and are watching a video together.

[0477] Figure 6-1 shows an example of a group chat room displayed on user PP's terminal 20P. The group name "Home Party" is displayed in the in-app location display area, and the number of users included in the group is shown in parentheses next to it (in this example, "(3)").

[0478] In the in-app location display area, to the right of the back button, indicated by "<" (not limited to this example), the icons of users included in this group are displayed. In this example, the icons of three users are displayed: PP, QQ, and RR.

[0479] Each user's icon has a circle ("○") object in its upper right corner that indicates whether the corresponding user's device 20 is online or offline. In this example, the circle object is lit for users whose device 20 is online, and unlit for users whose device 20 is offline. This object allows us to determine the user's presence, and therefore it is a type of presence-related information.

[0480] In this example, user RR's terminal 20R is offline, and the "〇" object associated with user RR's icon is not lit. This diagram illustrates the chat room displayed on the display unit 24 of terminal 20P, but the same display is shown on terminals 20Q and 20R. However, since terminal 20R is offline, the chat room is not displayed on the display unit 24 of terminal 20R. Furthermore, based on this display, the talk area TR shows text content indicating that a video of a hamburger recipe originating from user PP will be shared, followed by text content from user QQ urging the user to wait for the video to be shared because user RR's terminal 20R is offline.

[0481] Figure 6-2 shows an example of a talk room displayed on the display unit 24 of terminal 20P after terminal 20R has gone online, following the events shown in Figure 6-1. In this example, based on terminal 20R coming online, a notification is displayed at the top of the screen via push notification, not exclusively but as an example, originating from the messaging application (server 10), containing text indicating that user RR has come online (RR is now online). Furthermore, based on this display, the talk area TR displays text content informing user PP that terminal 20R, which originated from user QQ in Figure 6-1, has come online, below text content prompting user PP to wait for video sharing because terminal 20R is offline.

[0482] When terminal 20R comes online, the "〇" object shown above lights up. Therefore, users PP and QQ can be notified that terminal 20R has come online. For this reason, it is optional whether or not to display the push notification shown above.

[0483] Also, unlike the example above, you can choose not to display the "〇" object on the user's icon and instead display only the push notification, or you can choose not to do so.

[0484] In this way, by changing the object's appearance depending on whether terminal 20 is online or offline, a user viewing the chat room on the display unit 24 can understand the presence of other users.

[0485] <Processing> Figure 6-3 is a flowchart showing an example of the processing flow performed by each device in this embodiment. Here, the left side shows the processing performed by the control unit 21 of terminal 20P, which is a single terminal 20, and the right side shows the processing performed by the control unit 11 of server 10. Note that the processing performed by the control unit 21 of the user terminal 20 that is the conversation partner of terminal 20P is omitted from the illustration. This process is not limited to this specific case, but can, for example, be executed in parallel with the talk process shown in Figure 4-4 or the live chat process shown in Figure 4-7.

[0486] First, the control unit 11 of the server 10 determines whether or not the communication determination condition has been met (S4210). The communication determination condition is not limited to, but for example, it could be that the recipient user has received the specified content from any terminal 20 (not limited to, but for example, terminal 20P) whose talk room is displayed on the display unit 24 online. In one-on-one chats, the recipient can be the user you are chatting with. In group chats, the recipient can be the entire group (all users in the group) or all users in the group except yourself.

[0487] If the communication determination condition is determined to be met (S4210: YES), the control unit 11 of the server 10 performs the communication determination process (S4220). Here, we will illustrate the case where content specified by the destination user is received from terminal 20P.

[0488] The control unit 11 of the server 10 transmits the content received from terminal 20P, along with its content ID and time information, to the destination user's terminal 20 via the communication interface 14. It also transmits the content ID and time information of the content to terminal 20P via the communication interface 14. The control unit then determines whether it has received a response from each user's terminal 20 indicating that it was received successfully (not limited to, but for example, an acknowledgment: ACK). If it determines that it has received such a response, it determines that terminal 20 is online. On the other hand, if it does not receive such a response, it determines that terminal 20 is offline. The same processing can be performed when content is received from an online terminal 20 other than terminal 20P.

[0489] Furthermore, the control unit 21 of each terminal 20 may send information (state change information) indicating that it has changed from background to foreground, or conversely, from foreground to background, to the server 10 via the communication I / F 22. In this case, the control unit 11 of the server 10 may determine that the terminal 20 is offline if the received information indicates that it has changed to background, and determine that the terminal 20 is online if the received information indicates that it has changed to foreground.

[0490] Next, the control unit 11 of the server 10 transmits the communication determination result for each terminal 20 to each terminal 20 via the communication interface 22 (S4230). The control unit 21 of terminal 20P determines whether or not it has received a communication judgment result from server 10 via the communication I / F 22 (P4210). If it determines that it has received the result (P4210: YES), it updates the display of presence information shown on the display unit 24 based on that determination (P4220). As an example, not an exhaustive one, in the above display screen example, the control unit 21 of terminal 20P controls whether the "〇" object associated with each user's icon in the in-app location display area is lit or not.

[0491] In the above process, the control unit 11 of the server 10 may, for example, send a chat participation request information to a terminal 20 running a messaging application in the background, including information indicating that a chat has started and information prompting the terminal to join the chat. In this case, the terminal 20 that receives the chat participation request information can display it as a push notification on the display unit 24. By doing so, the user who sees the notification can bring the messaging application to the foreground, display the chat room on the display unit 24, and join the chat.

[0492] <Effects of the 6th Example> This embodiment shows a configuration in which a control unit 21 controls a user's terminal 20 to display information regarding the presence of users in a talk room (the presence of users included in the talk room) on a display unit 24. As an example of the effects of this configuration, not limited to but as an example, the user of the device can be notified whether or not other users are able to chat in the chat room. As a result, not limited to but as an example, the user of the device can determine whether or not it is okay to start playing a video.

[0493] <Sixth variation (1)> The above embodiment, like the fourth and fifth variations (1), is equally applicable to cases where talks (chat) take place in various talk rooms (chat rooms), such as one-on-one talk rooms, group talk rooms, open chat rooms, OA talk rooms, and live chat talk rooms.

[0494] To give an example, not as a limitation, but as an example, when applied to the aforementioned live chat, even if the main streamer starts a live chat, the sub-streamer may not yet have agreed to participate and may be absent. Conversely, if the system is configured to allow a sub-streamer to start a live chat when the main streamer is absent, it is possible that the main streamer may still be absent even if the sub-streamer starts the live chat. In such cases, information regarding the user's presence in the live chat room can be displayed, similar to the embodiment described above.

[0495] In this case, information regarding presence can be displayed on the display unit 24 of the terminal 20 using a method similar to the method described in the sixth embodiment. In this case, as an example rather than a limitation, information regarding the broadcaster's presence could be displayed on the broadcaster's device 20. This is because the viewer's presence is not very important; rather, the broadcaster's presence is more important.

[0496] In addition, and not limited to this, as an example, in the live chat processing shown in Figure 4-7, the control unit 11 of the server 10 may determine that any terminal 20 of a sub-broadcaster invited to the live chat is offline if it has not yet received live chat participation consent information (step Y420 in Figure 4-7).

[0497] In this case, the control unit 11 of the server 10 may, for example, send live chat participation request information to a sub-broadcaster's terminal 20 that has not yet received live chat participation consent information (step Y420 in Figure 4-7), including information indicating that the live chat has already started and information prompting the sub-broadcaster to participate in the live chat. In this case, the terminal 20 that receives the live chat participation request information can display the live chat participation request information as a push notification on the display unit 24. By doing so, the sub-broadcaster who has seen the notification can participate in the live chat with the messaging application in the foreground.

[0498] The same procedure can be applied if the system is configured to allow a sub-streamer to start a live chat while the main streamer is absent.

[0499] <Sixth variation (2)> If the presence information described in the above embodiment is not displayed on terminal 20, it may be difficult to identify absent users, and a video may be started by a single user. Furthermore, even if presence information is displayed on terminal 20, there is a possibility that a user may start playing the video prematurely due to time constraints or impatience waiting for absent users. Furthermore, after the video playback begins, there's a possibility that users who were previously absent might join the conversation.

[0500] Therefore, the control unit 11 of the server 10 can, as an example and not limited to, execute video sharing control processing (S460 in Figures 4-4 and 4-7) on the terminal 20 that has come online. In this case, the control unit 11 of the server 10 can, for example, stream the video from a frame corresponding to the current playback time of the shared video, so that the terminal 20 can start playing the video from that playback time.

[0501] In this embodiment, one user's terminal 20 receives video information transmitted by another user's terminal 20 via a communication interface 22, and displays a video based on that video information in the chat room. In this case, the video is configured to play from the playback time in the chat room of the other user's terminal 20. As an example of the effects of this modified configuration, and not an exhaustive one, even if a user on a terminal joins a chat midway through, they can still watch the video from the point where it was playing in the chat room on the first terminal.

[0502] <Sixth variation (3)> In the above embodiment, when a user performs an operation to share a video via the input / output unit 23, the terminal 20 may display information on the display unit 24 to confirm with the user whether or not to start sharing the video, based on the communication determination result of each terminal 20.

[0503] Figure 6-4 shows an example of a talk room displayed on the display unit 24 of terminal 20P in this modified example, and shows a group talk room corresponding to Figure 6-1. In this example, when user PP performs the action of sharing a video, video sharing confirmation information PCR is displayed superimposed on the talk area TR, including the text "RR is offline. Do you want to start sharing the video?", a "Start Sharing" button to begin sharing the video, and a "Cancel" button to stop sharing the video. When the "Start Sharing" button is tapped, video sharing begins. When the "Cancel" button is tapped, video sharing is stopped.

[0504] As described above, the control unit 21 of terminal 20P can control the illumination / de-illumination of the "〇" object associated with each user's icon in the in-app location display area, based on the communication determination result received from server 10.

[0505] Furthermore, in this modified example, the control unit 21 of terminal 20P determines, not limited to but as an example, whether or not input related to video playback has been made by the user via the input / output unit 23. If it is determined that input has been made, and based on the latest presence information, if it is determined, not limited to but as an example, that at least one user is offline on terminal 20, it can display the video sharing confirmation information as described above. This can also be interpreted as the control unit 21 of terminal 20P displaying video sharing confirmation information based on the communication determination result.

[0506] <Sixth variation (4)> In the above embodiment, an example of representing presence information using a two-stage system of online and offline states was provided, but the invention is not limited to this. For example, the online state may be further subdivided, and detailed states such as "away," "available," and "unavailable" may be displayed using text or marks associated with their respective icons and usernames.

[0507] The detailed states described above are not limiting; for example, they may be configurable by the user based on input to the input / output unit 23 of terminal 20 (user operation, etc.), or they may be configurable by the control unit 21 of terminal 20 based on the elapsed time since the last operation, etc.

[0508] Furthermore, the offline state can be further subdivided, or it may not be necessary.

[0509] <Example 7> The seventh embodiment is an example, not an limitation, of applying the contents of the fourth to sixth embodiments to a live chat with a viewer comment function, as described in the first embodiment.

[0510] The contents described in the seventh embodiment are applicable to any of the other embodiments or any of the other modifications. Furthermore, components identical to those previously mentioned are given the same symbols, and their explanation is omitted.

[0511] <Display screen example> Figure 7-1 shows an example where the viewer area AR is displayed along with the broadcaster area DR in a chat room. On user XX's device 20X, the viewer area AR and the streamer area DR are displayed, and the video display area MR is superimposed on the streamer area DR.

[0512] In this example, the broadcaster area DR is located below the viewer area AR, but the configuration is not limited to this. In the talk room displayed on the broadcaster's terminal 20, the viewer area AR may be located below the broadcaster area DR. Also, the video display area MR may be superimposed on the viewer area AR instead of the broadcaster area DR. Furthermore, on the viewer's device 20, the relative positions of the viewer's AR area and the broadcaster's DR area are reversed compared to the broadcaster's device 20. However, the relative positions of the viewer's AR area and the broadcaster's DR area may be the same as on the broadcaster's device 20.

[0513] Furthermore, as mentioned earlier, a content input area (INR) is provided at the bottom of the chat room. The broadcaster can view the video playing in the broadcaster area (DR) and input their own comments into the content input area (INR), thereby displaying text content in the broadcaster area (DR) that corresponds to the video's playback status. Additionally, viewer comments and other text content submitted by viewers are displayed in the viewer area (AR), allowing the broadcaster to understand viewer reactions in relation to the video's playback status. In this way, streamers can enhance the sense of live streaming by continuously presenting new content while monitoring video playback status and viewer reactions.

[0514] <Processing> The processing in this embodiment is not limited to but can be achieved by combining the processing in Figure 1-14 and the processing in Figure 4-7, so a detailed explanation is omitted. Specifically, not limited to but as an example, the processing in Figure 1-14 can be executed in the live chat processing of S430 in Figure 4-7.

[0515] In this embodiment, the control unit 21 controls the display of the sender content sent and received between the sender's terminal 20 and the other sender's terminal 20 in the sender area of ​​the talk room (not limited to, but an example of the first area). Furthermore, the configuration shows that the terminal 20 of one broadcaster is controlled by the control unit 21 to display viewer content sent from a viewer different from other broadcasters (not limited to, but an example of a second user) in a viewer area (not limited to, but an example of a second area) different from the broadcaster area of ​​the talk room. As an example of the effects obtained by this configuration, not only can the user of the terminal see the content sent and received between the first terminal and the terminal, but the user of the terminal can also see the first content sent by a second user who is different from the first user.

[0516] Furthermore, this embodiment shows a configuration in which, on the broadcaster's terminal 20, the broadcaster area (not limited to, but an example of the first area) is displayed below the viewer area (not limited to, but an example of the second area). As an example of the effects obtained by this configuration, the first area of ​​the chat room where content sent and received between the terminal user and the first user is displayed is displayed below the second area of ​​the chat room where the first content sent by the second user is displayed, thus improving visibility by displaying them in separate areas.

[0517] Furthermore, this embodiment shows a configuration in which the broadcaster (not limited to, but an example being a user of the terminal or the first user of the first terminal) is a broadcaster who distributes broadcaster content displayed in the broadcaster area of ​​the talk room (not limited to, but an example being the first area), and the viewer (not limited to, but an example being a second user) is a viewer who watches the content displayed in the broadcaster area of ​​the talk room. As an example of the effects obtained by this configuration, the second user can view content that is distributed by the terminal user and the first user and displayed in the first area of ​​the chat room.

[0518] <7th variation (1)> In the above embodiment, similar to the second embodiment, after the live chat with viewer comment function has ended, the server 10 may store the live chat archive data based on the fact that, for example, the main broadcaster's terminal 20 has performed an operation to save the live chat to the archive.

[0519] Furthermore, in addition to storing the live chat archive data on server 10, it is also possible, not limited to this, but as an example, to store the live chat archive data in the memory unit 28 of the main broadcaster's terminal 20 in a similar format to the live chat archive data stored on server 10, associated with information related to the chat room of that live chat.

[0520] Furthermore, live chat sessions without viewer comment functionality can also be archived in the same way.

[0521] This modified example shows a configuration in which the main broadcaster's terminal 20 has a control unit 21 that performs the following processes: associating broadcaster content displayed in the broadcaster area, viewer content displayed in the viewer area, shared video information, and the chat room where the live chat took place, and storing this information in the server 10, or storing it in its own terminal 20 (this is not limited to this; an example is the process of associating and storing content displayed in the first area, content displayed in the second area, first video information, and the chat room). As an example of the effects of this modified configuration, by processing the content displayed in the first area, the content displayed in the second area, the first video information, and the chat room to associate and store them, the content of the chat that took place in that chat room (including the content of the video played in that chat room) can be saved and viewed by the user at a later date.

[0522] <Eighth Example> The eighth embodiment is an embodiment relating to picking up viewer content displayed in the viewer content area.

[0523] The contents described in the eighth embodiment are applicable to any of the other embodiments or other modifications. Furthermore, components identical to those previously mentioned are given the same symbols, and their explanation is omitted.

[0524] <Display screen> Figure 8-1 shows an example of a live chat screen displayed on the broadcaster's device 20X. In this example, the viewer area AR is configured at the top of the screen, superimposed on the broadcaster area DR. In this example, among the viewer content displayed in the viewer area AR, the viewer content "I want to eat a balanced diet of vegetables and meat, do you have any good suggestions?" at "14:32," sent by user EE, is tapped by user XX via the input / output unit 23 of terminal 20X, and the operation to pull it down to the broadcaster area DR is performed. Based on this, the broadcaster area DR displays the picked viewer content, which is the viewer content selected from that viewer content. In this example, the display of user EE's viewer content is also removed from the viewer area AR as a result. In this example, the display format of the featured viewer content shown in the broadcaster area DR is different from the display format of the viewer content that was originally displayed in the viewer area AR.

[0525] Figure 8-2 shows an example of a screen that follows Figure 8-1. In Figure 8-1, the picked-up viewer content displayed in the broadcaster area was tapped by user XX via the input / output unit 23 and then pulled up to the viewer area AR. As a result, the viewer content of user EE, which is the source of the picked-up viewer content, is displayed in the viewer area AR at its original position. In this example, the display of the picked-up viewer content is also removed from the broadcaster area DR.

[0526] In this example display screen, viewer content was removed from the viewer area's AR when picking up content, but it is also possible to leave it displayed without removing it. Similarly, in this example screen, the featured viewer content was deleted from the broadcaster area DR when the screen was restored, but it could also be left displayed without being deleted.

[0527] Additionally, when picking up viewer content, it may be displayed in a grayed-out or similar manner within the viewer area's AR, and when returning to the original view, the display manner of the viewer content may be restored to its original state, or it may not be necessary to do so.

[0528] <Processing> In this embodiment, the processing is not limited to but is an example. In the processing shown in Figure 1-14, which is performed in the processing shown in Figures 1-13 and 4-7, the control unit 21 of terminal 20X determines, after the X1150 step, whether an operation has been performed to select one of the viewer contents displayed in the viewer content area via the input / output unit 23 and move it to the broadcaster area, not limited to but as an example. If it is determined that an operation has been performed, the control unit 21 of terminal 20X transmits identification information (viewer content ID, etc.) of the selected viewer content to the server 10 via the communication I / F 22, not limited to but as an example.

[0529] After step S1150, when the server 10 receives identification information for viewer content from terminal 20X via the communication I / F 14, the control unit 11 of the server 10 generates pick-up viewer content to display the viewer content identified by that identification information in the broadcaster area in the configured manner. The control unit 11 of the server 10 then transmits the identification information for viewer content and the generated pick-up viewer content to the main broadcaster's terminal 20X, the sub-broadcaster's terminal 20, and the viewer's terminal 20A, respectively.

[0530] Terminal 20, upon receiving the featured viewer content, displays the received featured viewer content below the latest broadcaster content displayed in the broadcaster area. Furthermore, if viewer content identified by the received identification information is displayed in the viewer content, terminal 20 hides it and removes rows of viewer content.

[0531] Conversely, if a selected viewer content is chosen on terminal 20X, and an operation is performed to move it to the viewer area (not limited to this case), the selected viewer content can be returned to its original position in the viewer area.

[0532] Furthermore, when displaying featured viewer content in the broadcaster's area, the original viewer content may be displayed as is without being removed from the viewer's area. In this case, the viewer content that forms the basis of the featured content displayed in the viewer area may be displayed in a different manner than the viewer content that has not been featured. Specifically, the viewer content that forms the basis of the featured viewer content may be shaded with a set color and displayed in the viewer area, the text color of the viewer content may be made different from other viewer content, or a mark indicating that it has been featured may be displayed. As an example, the viewer content that forms the basis of the featured viewer content may be fixed and displayed in the top row of the rows that make up the viewer area.

[0533] Furthermore, the above process may or may not be performed on the sub-distributor's device 20.

[0534] <Effects of the 8th Example> This embodiment shows a configuration in which the broadcaster's terminal 20, based on the broadcaster's input to viewer content (not limited to, but an example of first content) displayed in the viewer area (not limited to, but an example of second area), is controlled by the control unit 21 to display picked viewer content (not limited to, but second content based on first content) in the broadcaster area (not limited to, but an example of first area). One example of the effects obtained by this configuration is that it becomes possible to pick up the first content displayed in the second area and display it in the first area as the second content.

[0535] In this case, the broadcaster's terminal 20 is configured such that the control unit 21 controls the display of the original viewer content for the picked-up viewer content in the viewer area based on the broadcaster's input regarding the picked-up viewer content. One example of the effects obtained by this configuration is that it becomes possible to return the original first content, which is the source of the second content that has been picked up and displayed in the first area, back to the second area.

[0536] In this case, the broadcaster's terminal 20 can be controlled by the control unit 21 to display the viewer content that forms the basis of the featured viewer content in a different display manner from other viewer content displayed in the viewer area. As an example of the effects obtained by this configuration, when a featured viewer content is displayed in the viewer area based on the broadcaster's input to the viewer content, the control unit 21 can perform control to display the original viewer content and other viewer content displayed in the viewer area in different display modes.

[0537] Furthermore, the information described in this embodiment is also applicable to live chats with viewer comment functions that display advertisements (advertising content).

[0538] <Other examples / Others> In the first to third embodiments, live chat was used as an example where content sent and received between the first user and the second user is displayed in the first area of ​​the chat room, and first content entered by a third user different from the first user and the second user is displayed in a second area different from the first area. However, the embodiment is not limited to this.

[0539] As an example, and not limited to this, when conducting the aforementioned open chat, the chat area of ​​the open chat room used for that open chat can be divided into two areas: a first area and a second area (split). Then, as an example, and not limited to this, content sent and received between the administrator of the open chat (first user) and a user designated by the administrator (second user) can be displayed in a speech bubble in the first area (the upper area, not limited to this example), while content entered and sent by other users (third user) can be displayed in a speech bubble in the second area (the lower area, not limited to this example).

[0540] Furthermore, while the first embodiment displays advertisements in the distributor area, it is not limited to this. For example, an advertisement display area may be configured for displaying advertisements, similar to the video display area described in the fourth to eighth embodiments, and advertisements may be displayed in this advertisement display area.

[0541] Furthermore, the content regarding the output of advertisements described in the first to third embodiments and the content regarding the display of videos described in the fourth to eighth embodiments can be applied in combination. [Explanation of symbols]

[0542] 1. Communication System 10 servers 20 devices 30 Networks

Claims

1. A program to be executed on a terminal that communicates with a server, The control unit of the terminal controls the display unit of the terminal to display a chat room that shows the first content, which is content sent and received between the first user and the second user. The first content is received from the server by the communication unit of the terminal, The control unit controls the display of the first content in the first area of ​​the chat room, The communication unit receives the second content, which is content entered by a third user different from the first user and the second user, from the server. The control unit controls the display of the second content in a second area of ​​the chat room that is different from the first area. The communication unit receives advertising information related to the advertisement from the server, The control unit controls the display of the advertising information in the first area. If the user of the terminal performs a scroll operation to hide the advertising information in the first area while the advertising information is being played, the control unit will perform a control to continue displaying the advertising information in the first area. The terminal is instructed to execute the following: When the playback of the aforementioned advertisement information has finished, The control unit performs the control to delete the advertising information, The control unit controls the terminal to acquire the third content, which is the first content, from the server, which has not yet been acquired. The control unit controls the display of the third content in the first area, The terminal is instructed to execute the following: The third content is displayed in the location where the deleted advertising information was displayed. program.

2. The program according to claim 1, When content is entered by the user of the terminal, the terminal is instructed to perform the following actions: transmit the entered content to the server via the communication unit, and display the entered content in the second area via the control unit. The input content is controlled by the control unit so as not to be transmitted to the server while the advertisement information is being played. program.

3. A program according to claim 1 or claim 2, The aforementioned advertisement information can be skipped after a set time has elapsed. program.

4. A program according to any one of claims 1 to 3, The aforementioned advertising information is transmitted from the server at a set time and received by the communication unit. program.

5. A program according to any one of claims 1 to 4, A program that causes the terminal to display information on the display unit for purchasing a product or service related to the advertising information, based on input from the terminal's user regarding the advertising information.

6. A program according to any one of claims 1 to 5, The control unit is instructed to perform a control operation on the terminal that sends information indicating that the advertising information has been viewed by the user of the terminal to the server via the communication unit. Based on the transmission of the information indicating that the information has been viewed, the server transmits information regarding the compensation for viewing the advertisement to the terminal of the first user or the terminal of the second user. program.

7. A program according to any one of claims 1 to 6, The aforementioned advertising information is not transmitted to the terminal of the first user or the terminal of the second user, but is transmitted to the terminal of the third user and the terminal of the user of the terminal. program.

8. A program according to any one of claims 1 to 7, The aforementioned second region is located in a region below the aforementioned first region. program.

9. A program according to any one of claims 1 to 8, A program that causes the terminal to perform control operations to display content containing billing information entered by the terminal's user in the second area in a different display manner than content that does not contain billing information.

10. A program according to any one of claims 1 to 9, The first content includes content relating to a questionnaire that the user of the terminal can answer, program.

11. A program according to any one of claims 1 to 10, The aforementioned chat room is the first chat room, The terminal is instructed by the control unit to perform the operation of displaying a list of multiple chat rooms, including the first chat room, on the display unit. The information of the first chat room included in the list includes information about the latest content sent to the first chat room. program.

12. A program according to any one of claims 1 to 11, The first user and the second user are broadcasters who distribute the first content displayed in the first area of ​​the chat room, The user of the terminal is a viewer who views the first content displayed in the first area of ​​the chat room. program.

13. A method for processing information from a terminal that communicates with a server, The control unit of the terminal controls the display unit of the terminal to display a chat room that shows the first content, which is content sent and received between the first user and the second user. The first content is received from the server by the communication unit of the terminal, The control unit controls the display of the first content in the first area of ​​the chat room, The communication unit receives the second content, which is content entered by a third user different from the first user and the second user, from the server. The control unit controls the display of the second content in a second area of ​​the chat room that is different from the first area. The communication unit receives advertising information related to the advertisement from the server, The control unit controls the display of the advertising information in the first area. If the user of the terminal performs a scroll operation to hide the advertising information in the first area while the advertising information is being played, the control unit will perform a control to continue displaying the advertising information in the first area. Includes, When the playback of the aforementioned advertisement information has finished, The control unit performs the control to delete the advertising information, The control unit controls the terminal to acquire the third content, which is the first content, from the server, which has not yet been acquired. The control unit controls the display of the third content in the first area, Includes, The third content is displayed in the location where the deleted advertising information was displayed. Information processing methods.

14. A terminal that communicates with a server, A processor that reads a program stored in memory and performs processing based on the program, The aforementioned processor, Control to display a chat room on the terminal's display unit that shows the first content, which is content sent and received between the first user and the second user. The first content is received from the server by the communication unit of the terminal, Controlling the display of the first content in the first area of ​​the chat room, The communication unit receives the second content, which is content entered by a third user different from the first user and the second user, from the server. Control is performed to display the second content in a second area different from the first area of ​​the chat room, The communication unit receives advertising information related to the advertisement from the server, Control to display the advertising information in the first area, If the user of the terminal performs a scroll operation to hide the advertising information in the first area while the advertising information is being played, control is performed to continue displaying the advertising information in the first area. Execute, The aforementioned processor, When the playback of the aforementioned advertisement information has finished, The control to delete the aforementioned advertising information, The terminal performs control to acquire the third content, which is the first content, that it has not yet acquired, from the server. Control to display the third content in the first area, Execute, The third content is displayed in the location where the deleted advertising information was displayed. Terminal.