Program, information processing method, information processing device, and terminal

Abstract

To improve convenience about a live distribution or the like.SOLUTION: In a program to be executed by an information processing device, the information processing device executes acquisition of a value about a response of a viewer user viewing content distributed by a distribution user by a control part of the information processing device during the distribution, and performance of processing about notification of information about a change in the value to the distribution user by the control part.SELECTED DRAWING: Figure 1-1

Description

[Technical field]

[0001] The present disclosure relates to a program, an information processing method, an information processing device, a terminal, and the like. [Background technology]

[0002] There are services that enable users to distribute moving images and the like (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-21464 A Summary of the Invention

[0004] According to a first aspect of the present invention, a program executed by an information processing device includes acquiring, during distribution, a value related to a reaction of a viewing user who views content distributed by a distribution user using a control unit of the information processing device, and performing processing by the control unit to notify the distribution user of information regarding the fact that the value has satisfied a change condition. According to a second aspect of the present invention, an information processing method of an information processing device includes acquiring, by a control unit of the information processing device during distribution, a value related to a reaction of a viewing user viewing content distributed by a distribution user, and performing processing by the control unit to notify the distribution user of information that the value has satisfied a change condition. According to a third aspect of the present invention, an information processing device includes a control unit that acquires, during distribution, a value related to a reaction of a viewing user viewing content distributed by a distribution user, and performs processing related to notifying the distribution user of information regarding the fact that the value satisfies a change condition. According to a fourth aspect of the present invention, a program executed by a terminal of a distribution user that distributes content receives, by a communication unit of the terminal, information that a value related to a reaction of a viewing user that views the content during live distribution of the content has satisfied a change condition, and controls, by a control unit of the terminal, to display, on a display unit of the terminal, the information that the value has satisfied the change condition. [Brief description of the drawings]

[0005] [Figure 1-1] FIG. 1 is a diagram showing an example of a system configuration of a communication system according to an embodiment. [Figure 1-2] FIG. 2 is a diagram showing an example of functions realized by a control unit of the server according to the first embodiment. [Figure 1-3] FIG. 4 is a diagram showing an example of data stored in a storage unit of the server according to the first embodiment. [Figure 1-4] FIG. 4 is a diagram showing an example of account registration data according to the first embodiment. [Figure 1-5] FIG. 2 is a diagram showing an example of a live streaming management database according to the first embodiment. [Figure 1-6] FIG. 2 is a diagram showing an example of functions realized by a control unit of the terminal according to the first embodiment. [Figure 1-7] FIG. 4 is a diagram showing an example of data stored in a storage unit of the terminal according to the first embodiment. [Figure 1-8] FIG. 4 is a diagram showing an example of a screen displayed on a display unit of the terminal according to the first embodiment. [Figure 1-9] 4 is a flowchart showing an example of the flow of processes executed by each device according to the first embodiment. [Figure 1-10] 10 is a flowchart showing an example of the flow of a number of viewing users determination process according to the first embodiment. [Figure 1-11] 11 is a flowchart showing an example of the flow of a first analytics information generation process according to the first embodiment. [Figure 1-12] 10 is a flowchart showing an example of the flow of processes executed by each device according to a first modified example. [Figure 2-1]FIG. 11 is a diagram showing an example of viewing user number decrease determination data according to the second embodiment. [Figure 2-2] FIG. 11 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a second embodiment. [Figure 2-3] FIG. 11 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a second embodiment. [Figure 2-4] 13 is a flowchart showing an example of the flow of a second analytics information generation process according to the second embodiment. [Figure 2-5] 13 is a flowchart showing an example of the flow of a third analytics information generation process according to a second modified example. [Figure 2-6] FIG. 11 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a second modified example. [Figure 3-1] FIG. 11 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a third embodiment. [Figure 3-2] FIG. 11 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a third embodiment. [Figure 3-3] FIG. 11 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a third embodiment. [Diagram 3-4] FIG. 11 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a third embodiment. [Figure 3-5] 13 is a flowchart showing an example of the flow of processes executed by each device according to the third embodiment. [Diagram 3-6] 13 is a flowchart showing an example of the flow of a first delivery control process according to a third embodiment. [Diagram 3-7] 13 is a flowchart showing an example of the flow of a second delivery control process according to the third embodiment. [Diagram 3-8] FIG. 13 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a third modified example. [Diagram 3-9] FIG. 13 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a third modified example. [Figure 3-10] FIG. 13 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a third modified example. [Figure 4-1] FIG. 13 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a fourth embodiment. [Figure 4-2]13 is a flowchart showing an example of the flow of a third delivery control process according to the fourth embodiment. [Figure 5-1] FIG. 13 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a fifth embodiment. [Figure 5-2] FIG. 13 is a diagram showing an example of a screen displayed on a display unit of a terminal according to a fifth embodiment. [Figure 6-1] FIG. 23 is a diagram showing an example of a screen displayed on a display unit of a terminal according to the sixth embodiment. [Figure 6-2] FIG. 23 is a diagram showing an example of a screen displayed on a display unit of a terminal according to the sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0006] <Compliance with legal matters> It should be noted that the disclosures described herein are subject to compliance with the laws of the country of implementation, such as communications secrecy, as necessary for the implementation of the disclosure.

[0007] <Embodiment> In this specification, for ease of understanding, there are some places where the phrase "by way of example and not by way of limitation" is used, but please note that not only these places but also the entire embodiment described below are not limited to the contents of the description.

[0008] An embodiment for implementing a program or the like according to the present disclosure will be described with reference to the drawings.

[0009] A system may be comprised of, for example and not by way of limitation, a number of devices. The multiple devices may be a combination of devices of the same type, a combination of devices of different types, or a combination of devices of the same type and devices of different types. Note that a system can be considered, for example and not by way of limitation, as a plurality of devices working together to perform some kind of processing.

[0010] Furthermore, a system relating to a client (client device) and a server can be considered to be, by way of example and not limitation, at least one of the following: (1) Terminals and servers (2) Server (3) Terminal

[0011] (1) is, by way of example and not limitation, a system including at least one terminal and at least one server. One example of this is a client-server system.

[0012] The server is configured by the following devices, for example and not by way of limitation, and may be a single device or a combination of multiple devices.

[0013] Specifically, the server is configured to have at least one processor (for example and without limitation, CPU: Central Processing Unit, GPU: Graphics Processing Unit, APU: Accelerated Processing Unit, DSP: Digital Signal Processor (for example and without limitation, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array), etc.), computer device (processor + memory), control device, arithmetic device, processing device, etc., and may be a configuration having multiple of the same type of any one device (for example and without limitation, CPU + CPU, homogeneous multi-core processor, etc.) or a configuration having multiple different types of any one device (for example and without limitation, CPU + DSP, heterogeneous multi-core processor, etc.), or may be a combination of multiple devices (for example and without limitation, processor + computer device, processor + arithmetic device, multiple devices made heterogeneous, etc.). The processor may be a virtual processor.

[0014] Also, when a server executes some processing, if the server is configured with a single device, the processing described in the embodiment is executed by the single device. If the server is configured with multiple devices, one device may execute some processing, and the other device may execute other processing. As a non-limiting example, if the server is configured with a processor and an arithmetic device, the processor may execute a first processing, and the arithmetic device may execute a second processing. Furthermore, when a configuration is made up of a plurality of devices, the devices may be arranged in locations physically separated from one another.

[0015] Furthermore, the functions of the server may be provided in the form of PaaS, IaaS, or SaaS in cloud computing, for example and without limitation.

[0016] The control unit of the system may be at least one of the control unit of the terminal and the control unit of the server. That is, by way of example and not limitation, the control unit of the system may be any of the following: (1A) only the control unit of the terminal, (1B) only the control unit of the server, or (1C) both the control unit of the terminal and the control unit of the server.

[0017] In addition, the control and processing (hereinafter collectively referred to as "control, etc.") performed by the control unit of the system may be performed by (1A) only the control unit of the terminal, (1B) only the control unit of the server, or (1C) both the control unit of the terminal and the control unit of the server. In addition, in (1C), as an example and not a limitation, some of the controls performed by the control unit of the system may be performed by the control unit of the terminal, and the remaining controls may be performed by the control unit of the server. In this case, the allocation (allocation) of the controls may be equal or may be allocated in different proportions.

[0018] Furthermore, when referring to a communication unit of a server, if the server is configured with a single device, it may be the communication unit itself that the single device has, or, if the server is configured with multiple devices, the communication unit of the server may be configured to include each communication unit that each device has. As an example and not by way of limitation, if a server comprises a first device and a second device, the first device having a first communication unit and the second device having a second communication unit, the communication unit of the server may be conceptualized as including the first communication unit and the second communication unit.

[0019] (2) is not limited to, but may be, for example, a system consisting of multiple servers (hereinafter, referred to as a "server system"). In this case, the configuration of each server may be the same as that described above.

[0020] The control etc. performed by the server system may be performed by only one of the multiple servers (2A), by only the other servers (2B), or by both the one server and the other servers (2C). In addition, in (2C), as an example and not a limitation, one server may perform part of the control etc. performed by the server system, and another server may perform the remaining control etc. In this case, the allocation (allocation) of the control etc. may be equal or may be allocated in different proportions.

[0021] (3) By way of example and not limitation, the system may be comprised of multiple terminals. The system may be, by way of example and not limitation, a system such as the following: A system that gives server functions to terminals (distributed system). This can be realized using blockchain technology, for example and not by way of limitation. A system in which terminals communicate wirelessly with each other. This can be realized, for example and without limitation, by communicating in a peer-to-peer (P2P) manner using short-range wireless communication technology such as Bluetooth (registered trademark).

[0022] The above is not limited to the control unit, but also applies to each functional unit such as an input / output unit, a communication unit, a storage unit, and a clock unit that may be components of the system.

[0023] In the following embodiment, a system including a terminal and a server (a client-server system) is illustrated as an example and not as a limitation. It should be noted that the server system described above in (2) can also be used as the server.

[0024] Also, instead of a system including a terminal and a server, a system not including a server, such as the above system (3) as an example and not a limitation, may be applied. In this case, the embodiment can be configured based on the above-mentioned blockchain technology. Specifically, by way of example and not limitation, data stored and managed in a server described in the following embodiment is stored on the blockchain. Then, the terminal generates a transaction to the blockchain, and when the transaction is approved on the blockchain, the data stored on the blockchain can be updated.

[0025] It should be noted that even when the term "terminal" is used, this is not limited to the meaning of a terminal as a client device in a client server. That is, a terminal may include the concept of a device other than in a client-server context.

[0026] Furthermore, in this specification, the expression "through a communication I / F" is used as appropriate. This is not intended to be limiting, but may indicate, by way of example, that a device transmits and receives various types of information and data through a communication I / F (through a communication unit) based on the control of a control unit (such as a processor).

[0027] In addition, in this specification, when the terms "related to" and "associated with" are used, "B related to A" or "B related to A" may mean, by way of example and not limitation, "B" having some kind of relationship with "A." Specific examples of this will be described later.

[0028] In addition, in this specification, when a device performs processing on two or more objects, such as "transmitting A and B" or "receiving A and B," this may include performing "A" and "B" in a synchronized manner (hereinafter referred to as "simultaneous"), and performing "A" and "B" with a different timing (hereinafter referred to as "non-simultaneous"). As an example and not a limitation, when referring to transmitting first information and second information, this may include both concepts of transmitting the first information and the second information in a synchronized manner and transmitting the first information and the second information with a lag in timing. In addition, taking into account the lag (time lag), "simultaneous" may include "almost simultaneously."

[0029] Note that, even if "A" and "B" are performed at different times, this only needs to be the processing targeting "A" and "B," and the purpose does not necessarily have to be the same. As an example and not a limitation, when the first information and the second information are transmitted as described above, it is sufficient to transmit the first information and the second information, and this may include cases where the first information and the second information are transmitted for the same purpose, as well as cases where the first information and the second information are transmitted for different purposes. This may also include cases where the first information and the second information are transmitted for the purpose of

[0030] In this specification, content may be information transmitted from a source to a destination, and may be one or more pieces of content.

[0031] The content may include, by way of example and not limitation, text content in text format, image content in image format (including at least one of still images and / or moving images), audio content in sound format (including voice), and the like. In addition, the content may include operation content such as buttons and icons for user operation, and link content such as link information (including, but not limited to, URI (Uniform Resource Identifier)).

[0032] The text may include, by way of example and not limitation, at least one of national characters, extended characters, machine-dependent characters, numbers, symbols, graphics, and symbols represented by character codes. Note that the text does not have to include at least one of the above characters, extended characters, machine-dependent characters, numbers, symbols, figures, and signs, and may include other text.

[0033] The image may include at least one of various types of image information, such as, for example and without limitation, an icon, a button, a stamp, an emoji, and a banner image.

[0034] In the following embodiments, by way of example and not limitation, "video" may be described as including the concepts of moving images and still images, but a distinction will be made between "still images" and "moving images" in the description.

[0035] In the following embodiment, as an example and not a limitation, a case will be illustrated in which a user who is a distribution user performs live distribution based on live content information including video data and audio data. The live content may be essentially any type of content. As will be described later, the live content may include live commerce content, which is an example of a service that allows users to purchase products introduced during live streaming via electronic commerce.

[0036] In addition, hereinafter, the application for realizing the live streaming service is referred to as the "live streaming application" and may be illustrated and explained as the "Live Streaming App." Information including video data, audio data, and other information about the live content distributed in the live streaming service may be referred to as "live content information." A live streaming service provider may be referred to as the "live streaming service provider."

[0037] As a form for realizing a live distribution service, any of the following forms may be applied, by way of example and not limitation. (A) A form in which a live streaming application is configured as a standalone application (B) A form in which a live streaming service function is provided as one of the functions of a messaging application. (C) A form constituting an application having a live streaming service function and a messaging service function (an integrated application) (D) A messaging application that is configured as a separate application from a live streaming application

[0038] In forms (B) and (C), by way of example and not limitation, the live streaming service provider may be the same as the messaging service provider. In this case, as one method, the user's account in the messaging application and the user's account in the live distribution application can be a common account. In this case, as an alternative method, the user's account in the messaging application and the user's account in the live streaming application may be automatically associated (linked).

[0039] In form (D), by way of example and not by way of limitation, the live streaming service provider may be a different entity from the messaging service provider. In the case of the (D) embodiment, a process for associating a user's account in the messaging application with a user's account in the live distribution application (a linking process) can be performed.

[0040] Alternatively, it is possible to provide a messaging service function as one of the functions of the live distribution application.

[0041] In addition, in this embodiment, expressions such as "information is transmitted and received between users" and "information is transmitted and received between terminals" may be used, but these may be considered to be substantially synonymous. In addition, when a client-server system is applied, it is possible to configure the system so that information is transmitted between terminals via a server, but this may also be expressed as transmission and reception of information between users or terminals. Also, as described above, information may also be transmitted and received between terminals without applying a client-server system.

[0042] In addition, in the following embodiments, an example of live distribution is given in which a live distribution user (hereinafter referred to as a "distribution user") distributes live content, and a user who is a viewing user (hereinafter referred to as a "viewing user") views the live content. The distribution user may be referred to as a distributor, a live streamer, etc. Furthermore, the viewing user may be referred to as a viewer, etc.

[0043] In addition, any of the above-mentioned forms (A) to (D) may be applied as a form for realizing a live streaming service. However, in the following embodiment, as an example and not a limitation, a case where form (A) in which a live streaming application is configured as a standalone will be mainly illustrated.

[0044] <Example> An example of an embodiment to which the present invention is applied will be described below. In the following embodiment, an embodiment in which a live distribution service is applied will be mainly described. However, as will be described later, the techniques described in the following embodiments can also be similarly applied to services other than live distribution services.

[0045] <First Example> The first embodiment is an embodiment that enables a distribution user to know that the number of viewing users viewing the live content during live distribution (hereinafter referred to as the "number of viewing users") has satisfied a set reduction condition. The number of viewing users may be, by way of example and not limitation, an example of a value related to the reaction of viewing users viewing live content.

[0046] The contents described in the first embodiment are applicable to any of the other embodiments and other modified examples. Furthermore, the same components as those already mentioned are given the same reference numerals and will not be described again.

[0047] <System configuration> FIG. 1-1 is a diagram illustrating an example of a system configuration of a communication system 1 according to an embodiment of the present disclosure. In the communication system 1, as an example and not a limitation, a server 10 and a plurality of terminals 20 (terminal 20A, terminal 20B, terminal 20C, . . . ) are connected via a network 30.

[0048] The server 10 has a function of providing a predetermined service (for example, but not limited to, a live distribution service, a messaging service, etc.) to the terminal 20 owned by the user via the network 30. For example, but not limited to, the server 10 may be expressed as a live distribution server, a messaging server, etc. In this embodiment, a live distribution service provider (operator) and a messaging service provider (operator) are assumed to be users of the server 10.

[0049] The number of servers 10 and the number of terminals 20 connected to the network 30 are not limited.

[0050] The terminal 20 (terminal 20A, terminal 20B, terminal 20C, ...) may be any information processing terminal capable of implementing the functions described in each embodiment. The terminal 20 includes, but is not limited to, a smartphone, a mobile phone (feature phone), a computer (such as, but not limited to, a desktop, laptop, tablet, etc.), a media computer platform (such as, but not limited to, a cable or satellite set-top box, digital video recorder), a handheld computer device (such as, but not limited to, a PDA (personal digital assistant), email client, etc.), a wearable device (such as a glasses-type device, a watch-type device, etc.), a VR (Virtual Reality) terminal, a smart speaker (a device for voice recognition), or other types of computers or communication platforms. The terminal 20 may also be expressed as an information processing terminal.

[0051] The configurations of the terminals 20A, 20B, and 20C can be the same as one another, for example and not for limitation. In addition, if necessary, the terminal used by the user X may be expressed as the terminal 20X, and the user information in a predetermined service associated with the user X or the terminal 20X may or may not be expressed as the user information X. The user information is information of a user associated with an account used by the user in a specific service. The user information includes, but is not limited to, information associated with a user, such as the user's name, the user's icon image, the user's age, the user's sex, the user's address, the user's hobbies and interests, and the user's identifier, which is input by the user or given by a specific service, and may be any one of these, or a combination of these, or may not be the same.

[0052] The network 30 plays a role of connecting one or more terminals 20 and one or more servers 10. In other words, the network 30 refers to a communication network that provides a connection path so that the above-mentioned various devices can be connected and then transmit and receive data.

[0053] One or more portions of network 30 may or may not be wired or wireless networks. Network 30 may include, by way of example and not limitation, an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless WAN (WWAN), a metropolitan area network (MAN), a portion of the Internet, a portion of the Public Switched Telephone Network (PSTN), a cellular network, integrated service digital networks (ISDN), wireless LAN, long term evolution (LTE), code division multiple access (CDMA), Bluetooth, satellite communications, or the like, or a combination of two or more thereof. Network 30 may include one or more networks 30.

[0054] The server 10 (not limited to, but an example of a server, information processing device, or information management device) has a function of providing a predetermined service to the terminal 20. The server 10 may be any device as long as it is an information processing device capable of realizing the functions described in each embodiment. The server 10 includes, not limited to, a server device, a computer (not limited to, but an example of, a desktop, a laptop, a tablet, etc.), a media computer platform (not limited to, but an example of, a cable, a satellite set-top box, a digital video recorder), a handheld computer device (not limited to, but an example of, a PDA, an email client, etc.), or other types of computers or communication platforms. The server 10 may also be expressed as an information processing device. When it is not necessary to distinguish between the server 10 and the terminal 20, the server 10 and the terminal 20 may or may not be expressed as information processing devices.

[0055] [Hardware (HW) configuration of each device] The hardware configuration of each device included in the communication system 1 will be described.

[0056] (1) Terminal hardware configuration FIG. 1-1 shows an example of the hardware configuration of the terminal 20. In FIG. The terminal 20 includes a control unit 21 (CPU: central processing unit), a storage unit 28, a communication I / F 22 (interface), an input / output unit 23, a clock unit 29A, and a position calculation information detection unit 29B. The HW components of the terminal 20 are connected to each other via a bus B, for example and not for limitation. It is not essential that the HW configuration of the terminal 20 includes all of the components. For example and not for limitation, the terminal 20 may or may not be configured such that individual components or multiple components are removable.

[0057] The communication I / F 22 transmits and receives various data via the network 30. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as the communication between the two devices is possible. The communication I / F 22 has a function of communicating with various devices such as the server 10 via the network 30. The communication I / F 22 transmits various data to various devices such as the server 10 according to instructions from the control unit 21. The communication I / F 22 also receives various data transmitted from various devices such as the server 10 and transmits it to the control unit 21. The communication I / F 22 may also be simply referred to as a communication unit. When the communication I / F 22 is configured with a physically structured circuit, it may also be referred to as a communication circuit.

[0058] The input / output unit 23 includes a device for inputting various operations to the terminal 20, a device for outputting the results of processing performed by the terminal 20, etc. The input / output unit 23 may be an integrated input unit and an output unit, or may be separate from the input unit and the output unit, or may not be.

[0059] The input unit is realized by any one or a combination of all kinds of devices that can receive input from a user and transmit information related to the input to the control unit 21. Examples of the input unit include, but are not limited to, a touch panel, a touch display, hardware keys such as a keyboard, a pointing device such as a mouse, a camera (operation input via moving images), and a microphone (operation input by voice).

[0060] The output unit is realized by any one or a combination of all kinds of devices capable of outputting the processing results processed by the control unit 21. Examples of the output unit include, but are not limited to, a touch panel, a touch display, a speaker (audio output), a lens (for example, but not limited to, 3D (three dimensions) output and hologram output), a printer, etc.

[0061] By way of example only, the input / output unit 23 includes, by way of example and not limitation, a display unit 24, a sound input unit 25, a sound output unit 26, and an imaging unit 27.

[0062] The display unit 24 is realized by any one of all kinds of devices capable of displaying according to the display data written in the frame buffer, or a combination thereof. The display unit 24 includes, by way of example and not limitation, a touch panel, a touch display, a monitor (by way of example and not limitation, a liquid crystal display or an organic electroluminescence display (OLED)), a head mounted display (HDM), a projection mapping, a hologram, a device capable of displaying images, text information, and the like in air (which may or may not be a vacuum). Note that these display units 24 may or may not be capable of displaying display data in 3D.

[0063] The sound input unit 25 is used to input sound data (including voice data; the same applies below). The sound input unit 25 includes a microphone and the like. The sound output unit 26 is used to output sound data and includes a speaker and the like. The imaging unit 27 is used to obtain image data (including still image data and moving image data; the same applies below.) The imaging unit 27 includes a camera and the like.

[0064] When the input / output unit 23 is a touch panel, the input / output unit 23 and the display unit 24 may be disposed facing each other and have approximately the same size and shape.

[0065] The clock unit 29A is a built-in clock of the terminal 20, and outputs time information (timekeeping information). The clock unit 29A is configured to include, for example and not limitation, a clock using a crystal oscillator. The clock unit 29A can also be expressed as a timekeeping unit or a time information detection unit, for example and not limitation.

[0066] The clock unit 29A may or may not have a clock that conforms to the Network Identity and Time Zone (NITZ) standard or the like.

[0067] The position calculation information detection unit 29B is a functional unit that detects (measures) information (hereinafter referred to as "position calculation information") necessary for the control unit 21 to calculate (measure) the position of its own terminal 20. The position calculation information detection unit 29B can also be expressed as a position calculation sensor unit, for example and not by way of limitation.

[0068] The position calculation information detection unit 29B includes, by way of example and not limitation, a satellite positioning sensor (satellite positioning unit) which is a sensor or unit for calculating the position of the terminal 20 using a satellite positioning system such as GPS (Global Positioning System), an inertial measurement sensor (inertial measurement unit (IMU (Inertial Measurement Unit))) which is a sensor or unit for calculating the position of the terminal 20 using an inertial navigation system, a UWB positioning sensor (UWB positioning unit) which is a sensor or unit for calculating the position of the terminal 20 using UWB (Ultra Wide Band), and the like.

[0069] The satellite positioning unit includes, by way of example and not limitation, an RF receiving circuit that converts RF (Radio Frequency) signals, including positioning satellite signals transmitted from positioning satellites and received by an antenna (not shown), into digital signals, and a baseband processing circuit that performs correlation calculation processing or the like on the digital signals output from the RF receiving circuit to capture the positioning satellite signals, and outputs information such as satellite orbit data and time data extracted from the positioning satellite signals as information for position calculation.

[0070] The inertial measurement unit has an inertial sensor that is a sensor that detects information required for calculating the position of the terminal 20 by inertial navigation calculation. The inertial sensor includes, but is not limited to, a three-axis acceleration sensor and a three-axis gyro sensor, and outputs the acceleration detected by the acceleration sensor and the angular velocity detected by the gyro sensor as information for position calculation.

[0071] The UWB positioning unit includes, by way of example and not limitation, an ultra-wideband RF receiving circuit that converts an ultra-wideband RF (Radio Frequency) signal, including an ultra-wideband pulse signal for positioning transmitted from a positioning beacon and received by an antenna not shown, into a digital signal, and a relative position calculation processing circuit that calculates the relative position between the terminal 20 and the positioning beacon based on the digital signal output from the ultra-wideband RF receiving circuit. As an example and not by way of limitation, the UWB positioning unit may or may not cause the terminal 20 to function as a positioning beacon by transmitting an ultra-wideband RF signal including an ultra-wideband pulse signal for positioning from an antenna not shown.

[0072] As an example and not a limitation, the control unit 21 calculates the position of its own terminal 20 at regular timing or specific timing based on the position calculation information detected by the position calculation information detection unit 29B. The terminal position is referred to as the "terminal position", and the calculated terminal position is referred to as the "calculated terminal position". The control unit 21 may, but may not, associate the calculated terminal position with the date and time when the calculated terminal position is calculated and store it in the storage unit 28 as calculated terminal position history data.

[0073] The control unit 21 has a circuit physically structured to execute the functions realized by the code or instructions contained in the program, and is realized by a data processing device built into hardware, for example and not by way of limitation. Therefore, the control unit 21 may or may not be expressed as a control circuit.

[0074] The control unit 21 may include, by way of example and not limitation, a central processing unit (CPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), and a field programmable gate array (FPGA).

[0075] The storage unit 28 has a function of storing various programs and various data required for the operation of the terminal 20. The storage unit 28 includes, by way of example and not limitation, various storage media such as a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a random access memory (RAM), and a read only memory (ROM). In addition, the storage unit 28 may or may not be expressed as a memory.

[0076] Terminal 20 stores program P in storage unit 28, and executes this program P, causing control unit 21 to execute processing as each unit included in control unit 21. In other words, program P stored in storage unit 28 causes terminal 20 to realize each function executed by control unit 21. Also, this program P may or may not be expressed as a program module.

[0077] (2) Server hardware configuration FIG. 1-1 shows an example of the HW configuration of the server 10. In FIG. The server 10 includes a control unit 11 (CPU), a storage unit 15, a communication I / F 14 (interface), an input / output unit 12, and a clock unit 19. The components of the HW of the server 10 are connected to each other via a bus B, for example and not for limitation. It is not essential that the HW of the server 10 includes all the components as the configuration of the HW of the server 10. For example and not for limitation, the HW of the server 10 may or may not be configured such that individual components or multiple components are removable.

[0078] The control unit 11 has circuits physically structured to execute functions realized by codes or instructions contained in a program, and is realized, for example and not by way of limitation, by a data processing device embedded in hardware.

[0079] The control unit 11 is typically a central processing unit (CPU), but may also be a microprocessor, a processor core, a multiprocessor, an ASIC, or an FPGA, but is not limited thereto in the present disclosure.

[0080] The storage unit 15 has a function of storing various programs and various data required for the operation of the server 10. The storage unit 15 is realized by various storage media such as an HDD, an SSD, and a flash memory. However, in the present disclosure, the storage unit 15 is not limited to these. Furthermore, the storage unit 15 may or may not be expressed as a memory.

[0081] The communication I / F 14 transmits and receives various data via the network 30. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as the communication between the two devices is possible. The communication I / F 14 has a function of communicating with various devices such as the terminal 20 via the network 30. The communication I / F 14 transmits various data to various devices such as the terminal 20 according to instructions from the control unit 11. The communication I / F 14 also receives various data transmitted from various devices such as the terminal 20 and transmits it to the control unit 11. The communication I / F 14 may also be simply referred to as a communication unit. When the communication I / F 14 is configured with a physically structured circuit, it may also be referred to as a communication circuit.

[0082] The input / output unit 12 includes a device for inputting various operations to the server 10, a device for outputting the results of processing by the server 10, etc. The input / output unit 12 may be an integrated input unit and an output unit, or may be separate input unit and output unit, or may not be the same.

[0083] The input unit is realized by any one or a combination of all kinds of devices capable of receiving input from a user and transmitting information related to the input to the control unit 11. The input unit is typically realized by hardware keys such as a keyboard or a pointing device such as a mouse. Note that the input unit may or may not include a touch panel, a camera (operation input via moving images), or a microphone (operation input by voice), as examples and without limitation.

[0084] The output unit is realized by any one or a combination of all kinds of devices capable of outputting the processing results processed by the control unit 11. Examples of the output unit include, but are not limited to, a touch panel, a touch display, a speaker (sound output), a lens (for example, but not limited to, 3D (three dimensions) output and hologram output), a printer, etc.

[0085] By way of example only, the input / output unit 12 includes a display unit 13, by way of example and not by way of limitation.

[0086] The display unit 13 is realized by a display or the like. The display is typically realized by a monitor (for example, but not limited to, a liquid crystal display or an organic electroluminescence display (OLED)). The display may or may not be a head mounted display (HDM) or the like. These displays may or may not be capable of displaying display data in 3D. In the present disclosure, the display is not limited to these.

[0087] The clock unit 19 is a built-in clock of the server 10, and outputs time information (timekeeping information). The clock unit 19 is configured to include, for example and not limitation, an RTC (Real Time Clock) as a hardware clock, a system clock, etc. The clock unit 19 can also be expressed as a timekeeping unit or a time information detection unit, for example and not limitation. (3)Other The server 10 stores a program P in the storage unit 15, and by executing this program P, the control unit 11 executes the processes of each unit included in the control unit 11. In other words, the program P stored in the storage unit 15 causes the server 10 to realize each function executed by the control unit 11. This program P may or may not be expressed as a program module. The same applies to other devices.

[0088] In each embodiment of the present disclosure, the description will be given assuming that the CPU of the terminal 20 and / or the server 10 executes the program P to realize the present invention.

[0089] The control unit 21 of the terminal 20 and / or the control unit 11 of the server 10 may or may not realize each process by a CPU having a control circuit, but may also realize each process by a logic circuit (hardware) formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or a dedicated circuit. These circuits may or may not be realized by one or more integrated circuits, and the multiple processes shown in each embodiment may or may not be realized by one integrated circuit. Furthermore, an LSI may be called a VLSI, a super LSI, an ultra LSI, or the like, depending on the degree of integration. Therefore, the control unit 21 may or may not be expressed as a control circuit.

[0090] In addition, the program P (as an example, but not limited to, a software program, a computer program, or a program module) of each embodiment of the present disclosure may or may not be provided in a state stored in a computer-readable storage medium. The storage medium can store the program P in a "non-transitory tangible medium." In addition, the program P may or may not be for realizing part of the functions of each embodiment of the present disclosure. Furthermore, the program P may or may not be a so-called difference file (difference program) that can realize the functions of each embodiment of the present disclosure in combination with a program P already recorded in a storage medium.

[0091] Furthermore, when referring to a system program (a program executed by the system), the system is as described above. The above-mentioned system program is a program that can be executed by the entire system, and this program may be composed of individual programs of the devices that make up the system, for example and without limitation, and the programs stored in the individual devices that make up the system may be different from each other. In other words, it is not necessary for the programs to be common to the individual devices that make up the system. As an example and not a limitation, if a system is composed of a terminal and a server, and the system program is P1, the system program P1 is composed of a program P2 stored in the terminal and a program P3 stored in the server, and P2 and P3 are for executing the system program and may be different programs. As an example and not a limitation, the program P2 stored in the terminal may be a program that executes a first process and transmits the result of the first process to the server, and the program P3 stored in the server may be a program that executes a second process on the received result of the first process and transmits the result of the second process to the terminal.

[0092] The storage medium may include one or more semiconductor-based or other integrated circuits (ICs) (such as, by way of example and not limitation, a field programmable gate array (FPGA) or an application specific IC (ASIC)), a hard disk drive (HDD), a hybrid hard drive (HHD), an optical disk, an optical disk drive (ODD), a magneto-optical disk, a magneto-optical drive, a floppy diskette, a floppy disk drive (FDD), a magnetic tape, a solid state drive (SSD), a RAM drive, a secure digital card, or a drive, any other suitable storage medium, or a suitable combination of two or more of these. The storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate. It should be noted that the storage medium is not limited to these examples and may be any device or medium capable of storing the program P. In addition, the storage medium may or may not be referred to as a memory.

[0093] The server 10 and / or the terminal 20 can implement the functions of the multiple functional units shown in each embodiment by reading out a program P stored in a storage medium and executing the read out program P.

[0094] Furthermore, the program P of the present disclosure may or may not be provided to the server 10 and / or the terminal 20 via any transmission medium capable of transmitting a program (such as a communication network or broadcast waves). The server 10 and / or the terminal 20 executes the program P downloaded via the Internet or the like, for example and not for limitation, to realize the functions of the multiple functional units shown in each embodiment.

[0095] In addition, each embodiment of the present disclosure may also be realized in the form of a data signal in which the program P is embodied by electronic transmission. At least a part of the processing in the server 10 and / or the terminal 20 may or may not be realized by cloud computing configured with one or more computers. At least a part or all of the processing in the terminal 20 may or may not be performed by the server 10. In this case, at least a part or all of the processing of each functional unit of the control unit 21 of the terminal 20 may or may not be performed by the server 10. At least a part or all of the processing in the server 10 may or may not be performed by the terminal 20. In this case, at least a part or all of the processing of each functional unit of the control unit 11 of the server 10 may or may not be performed by the terminal 20.

[0096] Unless explicitly stated, the judgment configuration in the embodiments of the present disclosure is not essential, and a specified process may or may not be executed when the judgment condition is satisfied, or a specified process may or may not be executed when the judgment condition is not satisfied.

[0097] Note that the programs of the present disclosure are implemented using, by way of example and not limitation, scripting languages ​​such as ActionScript and JavaScript (registered trademark), compiler languages ​​such as Objective-C and Java (registered trademark), and markup languages ​​such as HTML Living Standard.

[0098] <Functional configuration> (1) Functional configuration of the server FIG. 1-2 is a diagram showing an example of functions realized by the control unit 11 of the server 10 in this embodiment. The control unit 11 includes, as a functional unit, an application management processing unit 111 for executing application management processing in accordance with an application management processing program 151 stored in the storage unit 15, for example and not for limitation.

[0099] FIG. 1-3 is a diagram showing an example of information stored in the storage unit 15 of the server 10 in this embodiment. In the storage unit 15, for example and not for limitation, an application management processing program 151 executed by the control unit 11 as application management processing, account registration data 153, and a live streaming management database 155 are stored.

[0100] The account registration data 153 is registration data related to an account of an application (for example, but not limited to, a live distribution application), and an example of the data configuration is shown in FIG. 1-4. In the account registration data 153, for example and not by way of limitation, a user name, an application ID, and other registration information are stored in association with each other.

[0101] The user name is the name of the account of the terminal 20 that uses this application, and by way of example and not limitation, the name registered by the user of the terminal 20 when using the application is stored.

[0102] The application ID is information used to identify an application account, or the account itself. This application ID is preferably a value unique to each account, and as a non-limiting example, a unique value (proper value) is set and stored by the server 10 for each account. The application ID is information associated with the terminal 20 or the user of the terminal 20, and is an example of information related to the terminal or information related to the user of the terminal.

[0103] Other registration information may include, by way of example and not limitation, various types of information such as identification information for identifying terminal 20, the telephone number (terminal telephone number) of terminal 20, an email address (terminal email address), and authentication information such as passwords (login password, authentication password, etc.) used for various authentications in applications.

[0104] The identification information for identifying the terminal 20 may be, for example and not for limitation, a terminal ID (for example and not for limitation, an International Mobile Equipment Identity (IMEI)). Furthermore, the identification information for identifying the user of the terminal 20 can be, for example and without limitation, an application ID for a general user or an application ID for an official user.

[0105] It should be noted that the application ID may or may not be replaced by a "user ID." Furthermore, if the application allows only one account to be registered per terminal 20, then, as a non-limiting example, "identification information for identifying terminal 20 = identification information for identifying the user of terminal 20 = application ID" can be used.

[0106] Also, by way of example and not limitation, it may or may not be possible to assign multiple terminal IDs to one application ID. In this case, it may or may not be possible to run applications in parallel (in parallel) on multiple terminals 20 using one application ID as an identification (login) target.

[0107] Also, instead of various IDs such as application IDs, it is possible to apply a method of managing accounts using information such as terminal telephone numbers. In this case, instead of storing ID information such as an application ID in account registration data 153, information such as a terminal telephone number can be stored in account registration data 153. Note that, instead of replacing ID information such as an application ID with information such as a terminal telephone number, ID information such as an application ID may or may not correspond one-to-one to information such as a terminal telephone number.

[0108] In the following various embodiments, for the sake of simplicity, it is assumed that one account is registered for one terminal 20. Also, in this case, since, as described above, "identification information for identifying terminal 20 = identification information for identifying the user of terminal 20 = application ID," the term "user of the account" may be essentially synonymous with "terminal of the account."

[0109] Users who can register an account may include, by way of example and not limitation, broadcast users and viewing users. It should be noted that the accounts of the broadcast user and the viewing user may or may not be explicitly distinguished. In addition, the account registration data 153 may or may not be stored separately as distribution user account registration data for registering a distribution user's account and viewing user account registration data for registering a viewing user's account.

[0110] The live distribution management database 155 is a database for managing live distribution, and an example of the data configuration is shown in FIG. 1-5. In the live streaming management database 155, live streaming management data is stored as data for each live streaming (or for each live content), for example and not for limitation.

[0111] Each live streaming management data stores, by way of example and not limitation, the streaming user's application ID, the streaming live ID, the streaming live name, viewing user number history data, viewing user number reduction determination data, comment management data, and live content information.

[0112] The broadcast user's application ID stores the broadcast user's application ID for this live broadcast.

[0113] The live broadcast ID is information used to identify this live broadcast. The broadcast live ID is preferably a unique value for each live, and as a non-limiting example, a unique value (proper value) is set and stored by the server 10 for each live content.

[0114] The live show name is the title of this live show, and by way of example and not limitation, the name registered by the broadcasting user when broadcasting live is stored.

[0115] The viewing user number history data is data on the history of the number of viewing users during this live broadcast, and by way of example and not of limitation, the number of viewing users detected in real time by the server 10 is stored in chronological order. As a non-limiting example, the server 10 may count the number of viewing users based on live streaming participation request information and exit request information transmitted from each terminal 20.

[0116] The viewing user count reduction judgment data is data based on the server 10's judgment that the number of viewing users in this live stream has satisfied a set reduction condition (hereinafter referred to as the "set reduction condition"), and as a non-limiting example, a number (No.) that is set each time the set reduction condition is satisfied is stored in association with the reduction judgment time corresponding to the timing at which the set reduction condition is satisfied.

[0117] As a non-limiting example, the decrease determination time may be stored as the elapsed time from the start time of the live distribution when it is determined that the number of viewing users satisfies the set decrease condition.

[0118] The comment management data is data for managing the history of comments sent from terminal 20 during the live distribution of this live content, and by way of example and not limitation, the comment time, the speaker application ID, and the comment information are stored in association with each other. As a non-limiting example, the comment time may store the elapsed time from the start time of live content distribution at the time the comment was sent. As a non-limiting example, the speaker application ID may store the application ID of the terminal 20 that sent the comment. As a non-limiting example, the comment information may store information related to the content of the comment sent from the terminal 20 (as a non-limiting example, text, image, etc.).

[0119] The comment management data may store a history of comments sent from the terminal 20 during archive distribution. In this case, the comment time may be, for example and not limited to, the elapsed time in the archive starting from the beginning of the archive at the time the comment was sent. Also, flag information for storing whether or not the comment was sent during live distribution may be added to the comment management data.

[0120] As a non-limiting example of the live content data, live content information (live content data) transmitted from the broadcast user's terminal 20 is stored. This live content information may include image and sound data. It should be noted that this live content data may be made available for archive distribution or the like as archive data (data stored in an archive).

[0121] In addition to these, by way of example and not limitation, information such as the start date and time of the live broadcast, the end date and time of the broadcast, the broadcast period (viewable period), and information regarding the recording destination of the archive (by way of example and not limitation, the URI) may be stored.

[0122] (2) Functional configuration of the terminal FIG. 1-6 is a diagram showing an example of functions realized by a control unit 21 of a terminal 20 in this embodiment. The control unit 21 includes, as a functional unit, an application processing unit 211 for executing application processing according to an application processing program 281 stored in the storage unit 28, for example and not for limitation.

[0123] FIG. 1-7 is a diagram showing an example of data stored in the storage unit 28 of the terminal 20 in this embodiment. In the storage unit 28, for example and not for limitation, an application processing program 281 executed as application processing by the control unit 21 and an application ID 283 corresponding to this terminal 20 or the account of the user of this terminal 20 are stored.

[0124] <Display screen> In the following, as an example and not a limitation, a case will be illustrated in which the terminal 20 is a smartphone equipped with a display unit 24 having a portrait display.

[0125] For example, but not by way of limitation, a smartphone has a touch panel that functions as an input unit and is disposed opposite the display, thereby forming a touch screen. When an element such as an icon, button, item, or input area is displayed on the display, and a part of the touch panel that faces the area where the element is displayed is operated by a user, a program associated with the element or a subroutine of the program is executed.

[0126] The transition of the display screens described below is merely an example of the transition of the display screens for realizing the method of the present disclosure. In the transition of the display screens illustrated below, some of the display screens may be omitted, or other display screens may be added.

[0127] 1-8 is a diagram showing an example of a screen displayed on display unit 24 of terminal 20 in this embodiment. Note that, below, the processing executed by terminal 20 may be illustrated and described as processing executed by terminal 20A of broadcast user (user AA) as an example and not a limitation, and here an example of a screen displayed on display unit 24 of terminal 20A of broadcast user (user AA) is shown.

[0128] This screen diagram shows, by way of example and not limitation, an example in which an analytics screen corresponding to a live broadcast is displayed when a broadcasting user of terminal 20 broadcasts a live broadcast in which a decrease in the number of viewing users has been determined in the analytics information generation process corresponding to a live broadcast (the 5th XX Live). However, this is merely an example and is not limited to this example.

[0129] FIG. 1-8 is an example, by way of example and not limitation, of an analytics screen that may be displayed after a live broadcast has been made in a live broadcast application (live streaming service). This screen is configured so that the name of the live streaming application, "Live Streaming App," is displayed in the top center of the screen. Below that is an area containing the text "Analytics" indicating the current screen.

[0130] Below that, an analytics screen display information display area AR is configured for displaying information for the analytics screen. The information display area AR for displaying the analytics screen displays, by way of example and not limitation, detailed analytics information about the live broadcast (such as viewing user count history graph information (in this example, a line graph)) and live broadcast history information about the history of live broadcasts that the broadcasting user has previously conducted.

[0131] The analytics details information displayed on this screen may correspond to a live broadcast specified by the broadcaster user from among the live broadcast history information, for example and without limitation. In this example, by way of example and not limitation, the live broadcast of "The 5th XX Live" held on April 21, 2023 has been specified by the broadcasting user, and by way of example and not limitation, the analytics details information corresponding to that live broadcast is displayed.

[0132] Among the analytics detailed information, the viewing user count history graph information is, by way of example and not limitation, displayed with information for highlighting the time period near the time when the number of viewing users was determined to have decreased (in this example, an emphasis color is displayed as the background color of the line graph).

[0133] <Processing> FIG. 1-9 is a flowchart showing an example of the flow of processing executed by each device in this embodiment. This figure shows, from the left, the processing performed by the control unit 21 of terminal 20B of user BB, who is one of the viewing users watching a live broadcast of a live event by user AA, who is a distribution user, the processing performed by the control unit 11 of the server 10, and the processing performed by the control unit 21 of terminal 20A of user AA, who is also a distribution user.

[0134] Note that the process executed by the control unit 21 of the terminal 20 of a user other than the user BB who is a viewing user who views the live broadcast can be, for example and not limited to, similar to that of the terminal 20B, and is therefore omitted from the illustration.

[0135] Note that the processes described below are merely examples of processes for implementing the method of the present disclosure, and the present disclosure is not limited to these. Another step may be added to the process described below, or some steps may be omitted (deleted) from the process described below. The same applies to the various processes described in this specification.

[0136] First, the control unit 21 of the terminal 20A, based on a request for live streaming (live broadcasting) made via the input / output unit 23, begins acquiring live content information (which may include, for example and not limitation, video data and audio data) based on the imaging unit 27 and the audio input unit 25, and begins a process of transmitting the acquired live content information to the server 10 via the communication I / F 22 (A110).

[0137] Note that, prior to transmitting the live content information, the control unit 21 of the terminal 20A may, for example and not for limitation, transmit information related to live streaming to the server 10 via the communication I / F 22 based on a user input via the input / output unit 23. Then, the control unit 11 of the server 10 may update the live streaming management data in the live streaming management database 155 based on the received information.

[0138] When live content information is received from terminal 20A via communication I / F 14, the control unit 11 of the server 10 begins control to transmit live broadcast information (which may include, for example and not limitation, video data and audio data) based on the received live content information and broadcasting the live event to terminals 20 of viewing users, including terminal 20A and terminal 20B, via communication I / F 14 (S110).

[0139] When the live broadcast information is received from the server 10 via the communication I / F 22, the control unit 21 of the terminal 20B starts displaying the received live broadcast information on the display unit 24 and outputting sound from the sound output unit 26 (B120). When the live broadcast information is received from the server 10 via the communication I / F 22, the control unit 21 of the terminal 20A starts displaying the received live broadcast information on the display unit 24 and outputting sound from the sound output unit 26 (A120).

[0140] After step S110, the control unit 11 of the server 10 starts executing the viewing user number determination process (S120).

[0141] FIG. 1-10 is a flowchart showing an example of the flow of the number of viewing users determination process. The control unit 11 of the server 10 acquires the number of viewing users (S1210). The acquired number of viewing users is stored in the viewing user number history data.

[0142] Next, the control unit 11 of the server 10 judges whether or not the latest acquired number of viewing users satisfies the set reduction condition (S1220). The set reduction condition may be, for example and without limitation, any of the following conditions. (A1) The number of viewing users has decreased by a specified percentage or more compared to the value a specified number of times ago (for example, but not limited to, the value 5 times ago or 10 times ago) (A2) The number of viewing users has decreased by a specified percentage or more compared to the average value from the first specified number of times to the second specified number of times (for example, but not limited to, the average value from 10 times to 5 times). (A3) The number of viewing users has decreased by more than a specified percentage compared to the average value for a specified number of times in the past (for example, the past 10 times or the past 20 times, but not limited to this).

[0143] The above-mentioned predetermined number of times may be set by the broadcast user, or may be automatically set by the server 10. Furthermore, the above conditions are merely examples and are not intended to be limiting.

[0144] When it is determined that the number of viewing users does not satisfy the set reduction condition (S1220: NO), the control unit 11 of the server 10 advances the process to step S1240. When it is determined that the number of viewing users satisfies the set decrease condition (S1220: YES), the control unit 11 of the server 10 stores the current time as the decrease determination time in the viewing user number decrease determination data (S1230).

[0145] Next, the control unit 11 of the server 10 determines whether or not to end the process (S1240), and if it determines to continue the process (S1240: NO), the process returns to S1210. If it is determined that the process is to be ended (S1240: YES), the control unit 11 of the server 10 ends the process.

[0146] Returning to FIG. 1-9, after step A120, the control unit 21 of the terminal 20A determines whether or not to end the live distribution based on a user input to the input / output unit 23 (A130). If it is determined that the live distribution should not be ended (A130: NO), the control unit 21 of the terminal 20A continues to wait.

[0147] If it is determined that the live distribution is to be ended (A130: YES), the control unit 21 of the terminal 20A transmits live distribution end request information requesting the end of the live distribution to the server 10 via the communication I / F 22 (A140).

[0148] The control unit 11 of the server 10 determines whether or not live distribution end request information has been received from the terminal 20A via the communication I / F 14 (S130). If it is determined that the message has not been received (S130: NO), the control unit 11 of the server 10 waits as is.

[0149] If it is determined that live streaming end request information has been received (S130: YES), the control unit 11 of the server 10 transmits live streaming end information indicating that the live streaming is to be ended to the viewing user's terminals 20, including terminal 20B, via the communication I / F 14 (S140).

[0150] After step S140, the control unit 11 of the server 10 performs an analytics information generation process (S150).

[0151] FIG. 1-11 is a flowchart showing an example of the flow of a first analytics information generation process, which is an example of the analytics information generation process. The control unit 11 of the server 10 reads out and acquires each decrease determination time from the viewing user number decrease determination data of the live distribution management data corresponding to the above live distribution (S1510).

[0152] Next, the control unit 11 of the server 10 generates a viewing user number history graph based on the viewing user number history data of the above-mentioned live distribution management data and the decrease determination time acquired in step S1510 (S1520). Specifically, as a non-limiting example, a line graph is generated with the horizontal axis representing time and the vertical axis representing the number of viewing users. At this time, as a non-limiting example, the graph is set to be displayed in a manner that emphasizes the decrease determination time and its vicinity (hereinafter, referred to as "emphasis manner").

[0153] Thereafter, the control unit 11 of the server 10 generates analytics information by associating the distributed live information with the viewing user count history graph generated in step S1520 (S1580). Then, the control unit 11 of the server 10 ends the first analytics information generation process.

[0154] Returning to FIG. 1-9, after step A140, the control unit 21 of the terminal 20A determines whether or not a user input to display an analytics screen has been made to the input / output unit 23 (A150). If it is determined that this has been done (A150: YES), the control unit 21 of the terminal 20A transmits analytics screen display request information including the application ID 283 of its own terminal 20, etc. (which may include information that can identify the live broadcast to be displayed) to the server 10 via the communication I / F 22 (A160).

[0155] After step S150, the control unit 11 of the server 10 determines whether or not analytics screen display request information has been received from the terminal 20A via the communication I / F 14 (S160). If it is determined that the information has been received (S160: YES), the control unit 11 of the server 10 transmits display information for the analytics screen, including the analytics information generated in step S150, to the terminal 20A via the communication I / F 14 (S170). Then, the control unit 11 of the server 10 ends the process.

[0156] When the analytics screen display information is received from the server 10 via the communication I / F 22, the control unit 21 of the terminal 20A causes the display unit 24 to display the analytics screen based on the received analytics screen display information (A170). Then, the control unit 21 of the terminal 20A ends the process.

[0157] <Effects of the First Embodiment> In this embodiment, the server 10 (not limited to this, but an example of an information processing device) acquires the number of viewing users (not limited to this, but an example of a value relating to the reaction of the viewing users) viewing live content (not limited to this, but an example of content) distributed by the distribution user during distribution, using the control unit 11. Then, the server 10 shows a configuration in which the control unit 11 performs processing related to notifying the distribution user of information that the number of viewing users has satisfied a set decrease condition (not limited to this, but an example of information that a value relating to the reaction of the viewing users has satisfied a change condition). As an example of the effect of the embodiment obtained by such a configuration, it is possible to notify the distributor user of information regarding the fact that a value related to the reaction of a viewing user who watches content distributed by the distributor user has satisfied a change condition. This allows the distributor user to know, by way of example and not by way of limitation, that there was a scene in which the reaction of the viewing user dropped to a certain degree, and the timing of this drop, etc.

[0158] In addition, this embodiment shows a configuration in which the above information (not limited to, but an example of information regarding the fact that a value related to the reaction of viewing users has satisfied a change condition) includes information regarding the time in the content where the number of viewing users has satisfied a decrease condition (not limited to, but an example of information regarding the time in the content where a value related to the reaction of viewing users has satisfied a change condition). As an example of the effect of the embodiment obtained by such a configuration, information regarding the time in the content where the value related to the reaction of the viewing user satisfies the change condition can be notified to the distribution user. This allows the distribution user to know, by way of example and not by way of limitation, the timing when the reaction of the viewing user has decreased to a certain extent.

[0159] In this embodiment, the value related to the reaction of the viewing users includes the number of viewing users watching the live content, and the information related to the value related to the reaction of the viewing users satisfying the change condition includes information related to the number of viewing users satisfying the set reduction condition during the distribution of the live content. As an example of the effect of the embodiment obtained by such a configuration, it is possible to notify the distributor user of information regarding the fact that the number of viewing users viewing the content distributed by the distributor user has satisfied a reduction condition. This allows the distributor user to know, by way of example and not by way of limitation, that there has been a scene in which the number of viewing users has decreased to a certain extent, and the timing of this reduction, etc.

[0160] In this embodiment, the distribution user's terminal 20 receives information that the number of viewing users during live distribution of live content has satisfied the set reduction condition via the communication I / F 22. Then, the distribution user's terminal 20 displays the received information on the display unit 24. As an example of the effect of an embodiment obtained by such a configuration, it is possible to receive information that a value related to the reaction of a viewing user watching content while the content is being live-streamed satisfies a change condition, and then display the received information on the display unit to notify the broadcasting user.

[0161] <First Modification Example (1)> In the above embodiment, after live streaming by the broadcaster user, information that the number of viewing users has satisfied the set reduction condition is notified to the broadcaster user, but the present invention is not limited to this. As a non-limiting example, during live streaming by the broadcaster user, the broadcaster user may be notified that the number of viewing users has met the set reduction condition, along with the live streaming information being displayed on the display unit 24 of the broadcaster user's terminal 20.

[0162] In this case, when the number of viewing users satisfies the set reduction condition, the control unit 11 of the server 10 transmits information including, by way of example and not limitation, a message indicating that the number of viewing users has decreased to the distribution user's terminal 20. The distribution user's terminal 20 may then display the received information on the display unit 24. In this case, the information may be displayed so as to be superimposed on the live image, or the information may be displayed so as not to be superimposed on the live image. Also, the information may be displayed by transitioning from the screen on which the live image is displayed to another screen. The received information may be output as sound by the sound output unit 26 .

[0163] In addition, if the number of viewing users satisfies the set reduction condition during live streaming, the control unit 11 of the server 10 may, by way of example and not limitation, generate a history graph of the number of viewing users from the start of streaming to that point in time and transmit it to the terminal 20 of the streaming user. The broadcast user's terminal 20 may then cause the received viewing user count history graph to be displayed on display unit 24.

[0164] FIG. 1-12 is a flowchart showing an example of the flow of processes executed by each device in this modified example. After step S120, the control unit 11 of the server 10 determines whether or not it has been determined in the number of viewing users determination process started in step S120 that the number of viewing users satisfies the set reduction condition (S122). If it is determined that the condition is satisfied (S122: YES), the control unit 11 of the server 10 performs an analytics information generation process (S124).

[0165] In this analytics information generation process, the control unit 11 of the server 10 acquires, as a non-limiting example, the time at which it is determined that the number of viewing users satisfies the set decrease condition in step S1510 of the process in FIG. 1-11 as the decrease determination time. Then, the control unit 11 of the server 10 can generate, as a non-limiting example, a history graph of the number of viewing users from the start of distribution to the decrease determination time in step S1520 of the processing of FIG. 1-11.

[0166] After step S124, the control unit 11 of the server 10 transmits the analytics information generated in step S124 to the terminal 20A via the communication I / F 14 (S126).

[0167] After step A120, the control unit 21 of the terminal 20A determines whether or not the analytics information has been received from the server 10 via the communication I / F 22 (A122). If it is determined that the analytics information has been received (A122: YES), the control unit 21 of the terminal 20A outputs the analytics information by, for example, displaying it on the display unit 24 (A126). Note that the sound output unit 26 of the terminal 20A may be caused to output a voice or a warning sound to inform the user that the number of viewing users has satisfied the set reduction condition.

[0168] Furthermore, the timing at which information regarding the number of viewing users satisfying the set reduction condition is displayed is set in the distribution user's terminal 20 based on a setting input by the user to the input / output unit 23. Alternatively, it is set automatically in the distribution user's terminal 20. Then, the broadcast user's terminal 20 may display on display unit 24, at the set timing, information indicating that the number of viewing users has satisfied the set reduction condition.

[0169] In this modified example, the distribution user's terminal 20 receives information that the number of viewing users during live distribution of live content has satisfied the set reduction condition via the communication I / F 22. Then, the distribution user's terminal 20 displays the received information on the display unit 24 based on the set condition regarding display. As an example of the effect of the modified example obtained by such a configuration, after receiving information that a value related to the reaction of a viewing user watching content while the content is being live-streamed has satisfied a change condition, the received information can be displayed on the display unit based on the setting conditions related to the display to notify the broadcasting user.

[0170] <First Modification (2)> In the above embodiment, it is determined that the number of viewing users satisfies the set reduction condition, but the present invention is not limited to this.

[0171] Depending on the broadcaster, a certain increase in the number of viewing users during live broadcasting may also be of interest. Therefore, as a non-limiting example, it may be determined that the number of viewing users has satisfied a set increase condition (hereinafter, referred to as a "set increase condition"). Then, when the number of viewing users has satisfied the set increase condition, the same processing as above may be performed.

[0172] The set increase condition may be, for example and without limitation, any of the following conditions. (B1) The number of viewing users has increased by a specified percentage or more compared to the value a specified number of times ago (for example, but not limited to, the value 5 times ago or 10 times ago) (B2) The number of viewing users has increased by a specified percentage or more relative to the average value from the first specified number of times before the second specified number of times (for example, but not limited to, the average value from 10 times before to 5 times before) (B3) The number of viewing users has increased by a specified percentage or more compared to the average value for a specified number of times in the past (for example, the past 10 times or the past 20 times, but not limited to this).

[0173] The above-mentioned predetermined number of times may be set by the broadcast user, or may be automatically set by the server 10. Furthermore, the above conditions are merely examples and are not intended to be limiting.

[0174] In this modified example, the above-mentioned information includes information regarding the number of viewing users satisfying the set increase condition (not limited to this, but an example of information regarding the value regarding the reaction of viewing users satisfying the change condition). As an example of the effect of the modified example obtained by such a configuration, it is possible to notify the distribution user of information regarding the fact that the value related to the reaction of the viewing user has satisfied the change condition. This allows the distribution user to know, by way of example and not by way of limitation, that there was a scene in which the reaction of the viewing user improved to a certain extent and the timing of this improvement.

[0175] In this modified example, the above-mentioned information (not limited to this, but an example of information regarding the value regarding the reaction of the viewing user satisfying the change condition) includes information regarding the time in the content at which the number of viewing users satisfied the set increase condition (not limited to this, but an example of information regarding the time in the content at which the value regarding the reaction of the viewing user satisfied the change condition). As an example of the effect of the modified example obtained by such a configuration, information regarding the time in the content where the value related to the reaction of the viewing user satisfies the change condition can be notified to the distribution user. This allows the distribution user to grasp, by way of example and not of limitation, the timing when the reaction of the viewing user has improved to a certain extent.

[0176] <First Modification (3)> In the above embodiment, the number of viewing users is taken as an example of a value related to the reaction of viewing users, but the present invention is not limited to this. As a value relating to the reaction of the number of viewing users, any of the following may be used, by way of example and not by way of limitation. Number of viewers - Number of comments made by viewing users (hereinafter referred to as "Number of viewing user comments") - The level of excitement among viewers (hereinafter referred to as "user excitement")

[0177] The number of viewing user comments may be calculated and tallied by the server 10 based on the comment information transmitted from the terminal 20 of the viewing user, for example and without limitation. The degree of excitement of the viewing user may be calculated and tallied by the server 10 based on, for example and without limitation, information such as “like,” “heart mark,” and “applause” sent from the viewing user's terminal 20, and the content of the viewing user's comments identified from the comment information sent from the viewing user's terminal 20.

[0178] In addition, the number of reactions from viewing users (hereinafter referred to as the "number of reactions from viewing users") may be calculated based on any combination of the various values ​​described above, and this may be used to perform processing similar to that in the above embodiment.

[0179] In this case, the number of viewing user responses may be calculated by weighting the values ​​used to calculate the number of viewing user responses and taking a weighted average, etc. As a non-limiting example, if the number of viewing users is emphasized, the weight for the number of viewing users may be set larger than the weights for other values ​​to calculate the number of viewing user responses.

[0180] In this modification, the values ​​relating to the reactions of the viewing users include information on the number of viewing users, the number of comments made by the viewing users, and the degree of enthusiasm of the viewing users, in addition to the number of viewing users. As an example of the effect of this modified example obtained by such a configuration, it is possible to notify the distributor user of an increase or decrease in the number of comments made by viewing users, the level of excitement of viewing users, and the like.

[0181] <First Modification (4)> In addition to the above, as a non-limiting example, the server 10 may tally up the number of times the number of viewing users satisfies the set decrease condition or the set increase condition, and transmit that information to the broadcast user's terminal 20 for display.

[0182] <First Modification (5)> In the above embodiment and modified examples, the content included in the live content information may be any one of the following. Still images Video ·sound Still image + sound Video + sound

[0183] The methods of the above embodiments can be applied in the same way even when the content to be included in the live content information is any of the above. As a non-limiting example, even when only still images or only sounds (which may include voice) are distributed, the number of viewing users increases and decreases, so the above various methods can be applied in the same way.

[0184] <Second Example> The second embodiment is an example, not a limitation, of the first embodiment, in which the cause of the number of viewing users satisfying the set decrease condition is estimated and the distribution user is notified of this.

[0185] The contents described in the second embodiment are applicable to any of the other embodiments and other modified examples. Furthermore, the same components as those already mentioned are given the same reference numerals and will not be described again.

[0186] <Data Structure> FIG. 2-1 is a diagram showing an example of a data configuration of the viewing user decrease determination data in the live distribution management data stored in the storage unit 15 of the server 10 in this embodiment. In the viewing user number decrease determination data, in addition to the number (No) and the decrease determination time, as a non-limiting example, an NG expression flag and the corresponding NG expression are stored in association with each other.

[0187] As a non-limiting example, the NG expression flag may be a flag that is set to "ON" when the number of viewing users meets a set reduction condition and a statement that corresponds to an NG expression is made by a broadcasting user within a specified period of time from that point in time.

[0188] As a non-limiting example, when a broadcast user makes a statement that corresponds to an NG expression, an NG expression corresponding to that NG expression may be stored as the relevant NG expression. The NG expression may be a word or a sentence.

[0189] In this embodiment, by way of example and not limitation, keywords, words, sentences, etc. that correspond to NG expressions (which may include, by way of example and not limitation, discriminatory terms, offensive terms, negative terms, etc.) may be stored in the memory unit 15 of the server 10 as a database of NG expressions (hereinafter, for convenience, referred to as the "NG expression database"). Then, the control unit 11 of the server 10 may, as an example and not a limitation, transcribe the voice of the broadcast user from the above-mentioned specified past period and estimate the NG expressions by comparing the text information obtained thereby with the NG expressions stored in the NG expression database.

[0190] <Display screen> In this embodiment, when a determination is made in the analytics information generation process that the number of viewing users has decreased, and a distribution user of terminal 20 performs a live broadcast in which an NG expression determination has been made corresponding to that decrease determination, the distribution user may be notified, by way of example and not of limitation, of information regarding NG words that are NG expressions included in the analytics information (hereinafter referred to as "NG word notification information" as appropriate).

[0191] Examples of timing for notifying the NG word notification information include, but are not limited to, the following: -Notification when analytics screen is displayed -Notification when the next live stream starts

[0192] The "alert when the analytics screen is displayed" may, for example and not by way of limitation, be such that when the analytics screen is displayed after a live broadcast has ended, NG word alert information is displayed near the viewing user count history graph information or superimposed on the viewing user count history graph information.

[0193] In addition, the "notification at the start of the next live broadcast" may, for example and not by way of limitation, be such that when the next live broadcast is about to start after one live broadcast has ended, NG word notification information is displayed on a live broadcast start screen for starting the live broadcast. In addition, this is not limited to the start of the next live broadcast, but may be configured to display NG word notification information determined in the broadcaster's past live broadcasts at the start of a new live broadcast after the next one.

[0194] FIG. 2-2 is a diagram showing an example of a screen displayed on the display unit 24 of the terminal 20A in this embodiment. This screen diagram shows, by way of example and not by way of limitation, an example in which a decrease in viewing users is determined in the analytics information generation process corresponding to one live broadcast (the 5th XX broadcast), and a live broadcast in which an NG word determination corresponding to that decrease determination is made is performed by a broadcasting user of terminal 20, in which NG word notification information is notified to the broadcasting user when the analytics screen is displayed. However, this is merely an example and is not limited to this example.

[0195] Regarding the explanation of FIG. 2-2, the explanation of the parts that are the same as the screen of FIG. 1-8 described above will be omitted. In this example, near the information for highlighting the time when the number of viewing users was determined to have decreased in the viewing user count history graph information (in this example, the part where the background display color of the line graph is highlighted), as a non-limiting example, NG word notification information (in this example, speech bubble-type information containing the text "Say the word 'XXX'", which includes the NG word "XXX") is displayed.

[0196] Note that the NG word notification information here is, by way of example and not of limitation, information that only notifies the broadcast user of the contents of the NG words, but is not limited to this example. As an example and not as a limitation, the NG word notification information may not only notify the broadcasting user of the content of the NG word, but may also be information that warns the broadcasting user not to utter NG words, and as an example and not as a limitation, the NG word notification information may be information that suggests to the broadcasting user alternative words that are similar to the NG word but will not be determined to be NG words.

[0197] FIG. 2-3 is a diagram showing an example of transition of a screen displayed on the display unit 24 of the terminal 20A in this embodiment. This screen diagram shows, as an example and not a limitation, an example in which a decrease in the number of viewing users is determined in the analytics information generation process corresponding to one live broadcast (the 5th XX Live), and a live broadcast in which an NG word determination corresponding to that decrease determination is made is performed by a broadcasting user of terminal 20, in which NG word notification information is notified to the broadcasting user at the start of the next live broadcast (the start of the 6th XX Live). However, this is merely an example and is not limited to this example.

[0198] The left side of FIG. 2-3 is the same as the screen in FIG. 1-8 described above, so the explanation will be omitted.

[0199] As an example and not a limitation, when a user taps a button to transition to a live streaming start screen for starting the next live streaming (the 6th XX Live), the display changes to the screen in the center, as an example and not a limitation. This live distribution start screen includes an area containing the text "Live Distribution" indicating the current screen.

[0200] Below that, a live content information display area LCR for displaying live content information is configured. In the live content information display area LCR, by way of example and not limitation, live content information at the start of live streaming includes information regarding a thumbnail, information regarding the title of the live streaming, information regarding comments on the live streaming, information regarding various buttons in the live streaming, and a live streaming start button LSBT for starting the live streaming.

[0201] By way of example and not limitation, when the live streaming start button LSBT is tapped by a user, the display on the right side of the screen changes, by way of example and not limitation.

[0202] In this example, above the live streaming start button LSBT, for example and not limitation, NG word notification information (in this example, information including the text "Be careful of the word 'XXX'", which includes the NG word "XXX", and link information including the text "Details" for checking detailed information about the NG word) is displayed.

[0203] Note that the NG word notification information here is, by way of example and not limitation, information that notifies the broadcasting user of the content of the NG word and warns the broadcasting user not to utter the NG word, but is not limited to such an example. As an example and not as a limitation, the NG word notification information may be information that simply notifies the distribution user of the content of the NG word, or as an example and not as a limitation, it may be information that suggests to the distribution user alternative words that are similar to the NG word but will not be determined to be NG words.

[0204] <Processing> FIG. 2-4 is a flowchart showing an example of the flow of a second analytics information generation process, which is an example of the analytics information generation process executed by the control unit 11 of the server 10 in this embodiment.

[0205] After step S1520, the control unit 11 of the server 10 performs the process of loop A for each decrease determination time acquired in step S1510 (S2530 to S2570).

[0206] In the process of loop A, the control unit 11 of the server 10 sets an analytics period for the target decrease determination time (S2540). Specifically, as a non-limiting example, a period of a set time ("30 seconds" as an example and not a limitation) before the decrease determination time is set as the analytics period. In addition, a period of a set time prior to the decrease determination time may be set as the analytics period.

[0207] Next, the control unit 11 of the server 10 performs a transcription process using the data portion of the set analytics period among the sound (including voice) data included in the recorded (recorded) live content information (S2550). Specifically, the control unit 11 performs a voice recognition process on the data portion, and obtains text information of the voice based on the result.

[0208] Thereafter, the control unit 11 of the server 10 performs an inappropriate expression determination process (S2560). Specifically, as a non-limiting example, the text information acquired in step S2550 is compared with the information stored in the NG expression database of storage unit 15 to determine whether or not the NG expression is included in the broadcast user's comment. If it is determined that the NG expression is included, the NG expression flag of the record corresponding to the target decrease determination time in the viewing user number decrease determination data is set to "ON," and the corresponding NG expression is stored in the corresponding NG expression. If the NG expression is not included, the NG expression flag is left at "OFF." Then, the control unit 11 of the server 10 continues the process at the next decrease determination time.

[0209] When steps S2540 to S2560 have been performed for all decrease determination times, the control unit 11 of the server 10 ends the processing of loop A (S2570).

[0210] Next, the control unit 11 of the server 10 generates analytics information (S2580) that includes, by way of example and not limitation, the viewing user count history graph information generated in step S1520 and viewing user decrease reason information that associates the corresponding NG expression with the decrease determination time when the NG expression occurred, and associates the information with the live broadcast information. Then, the control unit 11 of the server 10 ends the second analytics information generation process.

[0211] <Effects of the second embodiment> This embodiment shows a configuration in which the server 10 performs an estimation process, by the control unit 11, for estimating the cause why the number of viewing users has satisfied the set decrease condition, and performs a process for notifying the distribution user of information regarding the estimated cause. As an example of the effect of an embodiment obtained by such a configuration, it is possible to infer the cause why a value related to a reaction of a viewing user satisfies a change condition, and then notify the distributor user of the inferred cause.

[0212] In this embodiment, the estimation process is performed by the control unit 11 of the server 10 based on audio (not limited to, but an example of content) for a predetermined period of time distributed by a distribution user before or before the decrease determination time (not limited to, but an example of the first time). As an example of an effect of an embodiment obtained by such a configuration, based on content distributed by a distribution user prior to a first time or a predetermined time period prior to the first time, it is possible to appropriately estimate the cause of why a value related to the reaction of a viewing user satisfies a change condition.

[0213] In this embodiment, the live content includes audio, and the estimation process may be performed by the control unit 11 of the server 10 based on audio (not limited to, but an example of content) for a predetermined period of time before or prior to the decrease determination time (not limited to, but an example of the first time). As an example of an effect of an embodiment obtained by such a configuration, based on audio distributed by a distribution user before a first time or a predetermined time period before the first time, it is possible to appropriately estimate the cause of why a value related to the reaction of a viewing user satisfies a change condition.

[0214] In this case, the estimation process may include a process of estimating the cause based on text information acquired based on the voice information. As an example of an effect of an embodiment obtained by such a configuration, it is possible to appropriately estimate the cause of why a value related to a reaction of a viewing user satisfies a change condition, based on text information acquired based on audio information.

[0215] In this case, the estimation process may include processing based on the above text information and predetermined inappropriate language information. As an example of the effect of an embodiment obtained by such a configuration, by processing based on text information obtained based on audio information and predetermined inappropriate language information, it is possible to simply and appropriately estimate the reason why a value related to the reaction of the viewing user satisfies a change condition.

[0216] In this embodiment, the process for notifying the distribution user is configured to include a process for displaying information regarding the cause on the distribution user's terminal 20 (not limited to this, but an example of a process for displaying information regarding the cause on the distribution user's terminal). As an example of the effect of an embodiment obtained by such a configuration, information regarding the cause why a value related to the reaction of the viewing user satisfied a change condition can be displayed on the broadcast user's terminal, thereby notifying the broadcast user of the cause.

[0217] In addition, the live content may include an image, and the process of displaying the information regarding the cause on the broadcast user's terminal 20 may include a process of displaying the information regarding the cause superimposed on the image. As an example of the effect of an embodiment obtained by such a configuration, it is possible for a distributor user to check the reason why a value related to the reaction of a viewing user satisfies a change condition while viewing an image that the distributor user distributes.

[0218] Furthermore, the process of displaying the information relating to the cause on the broadcast user's terminal 20 may include a process of displaying the information relating to the cause in the form of advice. As an example of the effect of an embodiment obtained by such a configuration, it is possible to notify the distributor user of the cause why the value relating to the reaction of the viewing user satisfied the change condition in an easy-to-understand advice format.

[0219] Furthermore, the process of displaying the information regarding the cause on the broadcast user's terminal 20 may include a process of displaying information regarding the cause when the broadcast user broadcasts new content. As an example of the effect of an embodiment obtained by such a configuration, when a distributor user distributes new content, information regarding the cause is displayed on the distributor user's terminal, so that the distributor user can be notified of the cause at the timing when the distributor user is about to distribute new content. This allows the distributor user to be careful about his / her own comments, etc.

[0220] <Second Modification Example (1)> As in the first modified example (1), during live distribution by the broadcaster user, the broadcaster user may be notified that the number of viewing users has satisfied the set decrease condition and the estimated cause thereof.

[0221] In this case, as an example and not a limitation, in step S124 of the processing of Figure 1-12 described above, the control unit 11 of the server 10 may perform the following third analytics information generation processing, as an example and not a limitation.

[0222] FIG. 2-5 is a flowchart showing an example of the flow of the third analytics information generation process. The control unit 11 of the server 10 acquires the time when it is determined that the number of viewing users satisfies the set decrease condition as a decrease determination time (S2510). Then, the control unit 11 of the server 10 performs the same processes as S2540, S2550, S2560, and S2580 in FIG. 2-4 for the acquired decrease determination time to generate analytics information. Analytics information may include, by way of example and not limitation, messages such as "Please refrain from saying 'XXX'" (where XXX is the relevant inappropriate expression) as shown in Figure 2-6. Then, the control unit 11 of the server 10 ends the third analytics information generation process.

[0223] After performing the third analytics information generation process, the control unit 11 of the server 10 transmits the analytics information generated in the third analytics information generation process to the terminal 20A via the communication I / F 14 in step S126 of the processing of Figure 1-12.

[0224] After step A120, the control unit 21 of the terminal 20A determines whether or not the analytics information has been received from the server 10 via the communication I / F 22 (A122). If it is determined that the analytics information has been received (A122: YES), the control unit 21 of the terminal 20A outputs the analytics information by, for example, displaying it on the display unit 24 (A126). In this case, the sound output unit 26 of the terminal 20A may output a voice or a warning sound to inform the user that the number of viewing users has satisfied the set reduction condition. Also, a voice such as "Please refrain from saying 'XXX'" may be output from the sound output unit 26 of the terminal 20A.

[0225] In this modified example, when a decrease in the number of viewing users is determined in the analytics information generation process during live streaming and an NG word determination is made corresponding to that decrease determination, by way of example and not limitation, NG word notification information may be notified to the broadcasting user during the live streaming.

[0226] Specifically, as a non-limiting example, when live distribution is being performed, NG word notification information may be displayed so as to be superimposed on live broadcast information.

[0227] FIG. 2-6 is a diagram showing an example of a screen displayed on the display unit 24 of the terminal 20A in this modified example.

[0228] This screen diagram shows, by way of example and not limitation, an example in which NG word notification information is displayed during a live broadcast when a decrease in the number of viewing users is determined during the analytics information generation process during the live broadcast (5th XX Live) and an NG word determination is made corresponding to that decrease determination. However, this is merely an example and is not limited to this example.

[0229] FIG. 2-6 is an example, by way of example and not limitation, of a live streaming screen that is displayed when a live stream is being performed in a live streaming application. This screen includes a live broadcast information display area LRR for displaying live broadcast information.

[0230] In the live broadcast information display area LRR, as an example and not a limitation, moving images (moving image content) distributed by the broadcasting user are displayed as live broadcast information, and audio (audio content) distributed by the broadcasting user is output from the audio output unit 26. The content distributed by the broadcasting user may be both moving image content and audio content, or only one of them.

[0231] In addition, at the top of the live broadcast information display area LRR, for example and not limitation, information regarding the status of the live broadcast (an icon containing the word "Live" indicating that the live broadcast is in progress, an icon image of the broadcasting user, the username (AA) of the broadcasting user, information regarding the broadcast time of the live broadcast, etc.), information for making various settings regarding the live broadcast, and information for ending the live broadcast are displayed.

[0232] Also, by way of example and not limitation, information including the title of the live broadcast, camera mode information indicating whether the camera is on or off during the live broadcast (in this example, camera is on), and microphone mode information indicating whether the microphone is on or off during the live broadcast (in this example, microphone is on) are displayed.

[0233] A comment input area CIR is provided at the bottom of the live broadcast information display area LRR. Comments input into the comment input area CIR are displayed in a comment display area CR provided above the comment input area CIR, superimposed on the video content, in association with identification information (icon image and user name) of the broadcasting user or viewing user who input the comment. Note that the comment display area CR may display not only the comments input into the comment input area CIR, but also questions from the viewing user to the broadcasting user, and answers from the broadcasting user to the viewing user.

[0234] In this example, as an example and not a limitation, NG word notification information (in this example, caption-type information including the text "Caution: Please refrain from saying 'XXX'", which includes the NG word "XXX") is displayed above the comment display area CR of the live broadcast information display area LRR, superimposed on the video content. Note that, as an example and not a limitation, this NG word notification information during live broadcast is displayed in the live broadcast information displayed on the broadcasting user's terminal 20, but is not displayed in the live broadcast information displayed on the viewing user's terminal 20.

[0235] Note that the NG word notification information here is, by way of example and not limitation, information that notifies the broadcasting user of the content of the NG word and warns the broadcasting user not to utter the NG word, but is not limited to such an example. As an example and not as a limitation, the NG word notification information may be information that simply notifies the distribution user of the content of the NG word, or as an example and not as a limitation, it may be information that suggests to the distribution user alternative words that are similar to the NG word but will not be determined to be NG words.

[0236] <Second Modification Example (2)> As described in the first modified example (2), an increase in the number of viewing users to a certain level during live streaming of a live event may also be of concern to some streaming users. Therefore, as a non-limiting example, positive keywords, words, sentences, etc. may be stored as positive expressions in a database (hereinafter, for convenience, referred to as a "positive expression database") in the memory unit 15 of the server 10, and the cause of the number of viewing users satisfying the set increase condition may be estimated and notified using a method similar to that of the above embodiment. Also, the cause may be estimated and notified by emotion analysis, facial expression analysis, or the like, which will be described later.

[0237] Also, as a non-limiting example, if a broadcaster makes an inappropriate comment during a live broadcast, this may result in a certain decrease in the number of viewing users, but conversely, it is also possible that the number of viewing users may increase to some extent. One case is when a viewing user who was watching a live broadcast posts on SNS that the broadcaster made an inappropriate comment, and people who saw the post flock to the live broadcast, causing the number of viewing users to suddenly increase. In other words, since the number of broadcast users may increase not only when a broadcast user makes a positive comment, but also when a broadcast user makes an inappropriate comment, as an example and not a limitation, the cause may be inferred and notified using both the NG expression database and the positive expression database. Also, the cause may be estimated and notified by emotion analysis, facial expression analysis, or the like, which will be described later.

[0238] In this modified example, the estimation process includes, in addition to the various processes described above, a process based on text information and predetermined positive language information, by way of example and not limitation. As an example of the effect of the modified example obtained by such a configuration, by processing based on text information obtained based on audio information and predetermined positive language information, it is possible to simply and appropriately estimate the reason why a value related to the reaction of the viewing user satisfies a change condition.

[0239] <Second Modification Example (3)> In the above embodiment, a method is exemplified for estimating the reason why the number of viewing users meets the set reduction condition by determining whether or not text information obtained from audio data included in live content information corresponds to an inappropriate expression, but the present invention is not limited to this.

[0240] As a non-limiting example, emotion analysis may be performed on audio data (as a non-limiting example, the data portion of the analytics period described above) to visualize and estimate the emotions of the distribution users, thereby estimating the reason why the number of viewing users has met the set decrease condition. As a non-limiting example, if the emotion of the distribution user is determined to be a bad mood or anger, it may be presumed that this is the cause of the number of viewing users satisfying the set decrease condition.

[0241] Also, as a non-limiting example, the cause of the number of viewing users satisfying the set decrease condition may be estimated based on the video data included in the live content information. As a non-limiting example, an analysis of the facial expression of the broadcasting user may be performed based on video data (as a non-limiting example, the data portion of the analytics period described above), and if the facial expression of the broadcasting user is a displeased or angry expression, it may be inferred that this is the cause of the number of viewing users satisfying the set condition for a decrease.

[0242] Also, the reason why the number of viewing users has satisfied the set reduction condition may be estimated based on both the audio data and the video data.

[0243] In these cases, by way of example and not limitation, the server 10 may transmit information in the form of advice, such as "Stop acting in a bad mood" or "Stop acting angry," to the broadcast user's terminal 20. The broadcast user's terminal 20 may then display the received information on the display unit 24 to notify the broadcast user.

[0244] In this modified example, the estimation process is performed by the control unit 11 of the server 10 based on live content for a predetermined period of time before or prior to the decrease determination time (not limited to, an example of the first time). As an example of the effect of the modified example obtained by such a configuration, by using content distributed by a distribution user before a first time or for a predetermined period of time before the first time, it is possible to appropriately estimate the reason why a value related to the reaction of a viewing user satisfies a change condition.

[0245] In addition, this modified example shows a configuration in which the live content includes audio, and the estimation process is performed by the control unit 11 of the server 10 based on audio (not limited to, but an example of content) for a predetermined period of time before or prior to the decrease determination time (not limited to, but an example of the first time). As an example of the effect of the modified example obtained by such a configuration, by using audio distributed by a distribution user before a first time or for a predetermined period of time before the first time, it is possible to appropriately estimate the reason why a value related to the reaction of a viewing user satisfies a change condition.

[0246] <Second Modification Example (4)> In addition to the above, as a non-limiting example, the server 10 may tally up the number of times the number of viewing users satisfies the set decrease condition or the set increase condition, and transmit that information to the broadcast user's terminal 20 for display. Also, as a non-limiting example, the server 10 may tally up the number of times that the cause of the number of viewing users satisfying the set decrease condition or the set increase condition was estimated (the number of times that it was judged to be NG), and transmit that information to the terminal 20 of the distribution user to display it. Also, as a non-limiting example, the server 10 may compile frequently occurring NG expressions (as a non-limiting example, expressions that have been judged to be NG a set number of times or more) and transmit that information to the distribution user's terminal 20 for display.

[0247] <Second Modification (5)> In the above embodiment and modified examples, the live content may be any of the contents shown in the first modified example (5).

[0248] <Third Example> The third embodiment is an embodiment that makes it possible to, for example, fill in the gaps by displaying an image different from the live broadcast image on the terminal 20 when the broadcast user is no longer detected (recognized) during live broadcasting.

[0249] The contents described in the third embodiment are applicable to any of the other embodiments and other modified examples. Furthermore, the same components as those already mentioned are given the same reference numerals and will not be described again.

[0250] In the embodiments described below, the broadcast user becoming undetectable may include, by way of example and not limitation, at least one of the following: The existence of the broadcasting user will no longer be detected (recognized). The face of the broadcaster will no longer be detected (recognized).

[0251] The broadcast user's presence becoming undetectable may include, but is not limited to, a case where the broadcast user moves out of the imaging area of ​​imaging unit 27, causing the broadcast user's presence to become undetectable. As a non-limiting example, a broadcast user may temporarily leave the live broadcast for some reason. In this case, the viewing user may be shown an image in which the broadcast user is absent until the broadcast user returns. In this case, a masking video, which will be described later, may be displayed.

[0252] The face of the broadcasting user may not be detected, for example and without limitation: The broadcaster's face moves out of the imaging area (for example, when the broadcaster suddenly stands up) The broadcast user's face is no longer recognized (such as when the broadcast user turns around, when the broadcast user tries to drink a drink and the drink is placed between the broadcast user's face and the imaging unit 27, the face is recognized but the broadcast user looks up and the eyes and nose cannot be recognized, etc.) etc. may be included.

[0253] In addition, a broadcasting user may apply various effect functions (such as, but not limited to, an object addition function, a facial beautification function, a skin beautification function, an eye emphasis function, etc.) provided as functions of a live broadcasting application to their own face while broadcasting live, for example and not by way of limitation. In such cases, if the above-mentioned situation occurs, the effect may be removed, and as a result, the viewing user may unintentionally see an image with the effect removed (an image including the broadcasting user's real face).

[0254] As one approach, and by way of example and not limitation, effects processing may be performed when the face is facing forward and when the head, ears, eyes, nose, mouth, etc. are recognized. As a non-limiting example, when a specific object (such as, for example and not limitation, an animal's ears, nose, whiskers, etc.) is added to the broadcast user's face in the captured image area using the object addition function, if the broadcast user's face cannot be recognized due to facial recognition processing on the captured image area (the target of facial recognition is the broadcast user's real face), a masking video, described below, can be displayed.

[0255] In the following, an image based on image data acquired by the imaging unit 27 of the broadcast user's terminal 20 and relating to the detected broadcast user may be referred to as the "first image," and the masking image may be referred to as the "second image."

[0256] The second image delivered to the viewing user's terminal 20 when the broadcasting user is not detected may be an image different from the first image delivered to the viewing user's terminal 20 when the broadcasting user is detected (as an example, and not a limitation, a live image of the broadcasting user with an object added).

[0257] Here, the first image is an image based on image data acquired by the broadcast user's terminal 20, which is an imaging device, and is an image related to the detected broadcast user (including the broadcast user, by way of example and not by way of limitation), whereas the second image may be (i) an image that is not based on image data acquired by the broadcast user's terminal 20, (ii) an image based on image data acquired by the broadcast user's terminal 20, but not related to the detected broadcast user (by way of example and not by way of limitation, not including the broadcast user), or (iii) an image based on image data acquired by the broadcast user's terminal 20, and related to the detected broadcast user. By way of example and not limitation, examples of (i) may be, as described below, an image encouraging the viewing user to wait, a moving image of an advertisement, or an image taken immediately before the broadcasting user was no longer detected (the last image taken when the broadcasting user was detected, which is different from a live image (an image based on image data acquired by the broadcasting user's terminal 20)), etc.; an example of (ii) may be an image in which only an area recognized as a background area is visible based on image data acquired by the broadcasting user's terminal 20, etc.; and an example of (iii) may be an image in which the overall resolution of the image data acquired by the broadcasting user's terminal 20 has been reduced (an image in which the face of the broadcasting user cannot be clearly identified, even if the broadcasting user is included), etc.

[0258] In this embodiment, when a broadcasting user is broadcasting live, if the imaging unit 27 of the broadcasting user's terminal 20 detects (determines) that the broadcasting user is not present (not detecting the broadcasting user's presence, leaving the room), then, by way of example and not limitation, a masking image may be displayed as moving image content of the live broadcast. Then, when the imaging unit 27 of the broadcasting user's terminal 20 detects (determines) the broadcasting user's presence (detects the broadcasting user's presence, sitting down), as a non-limiting example, the display of the masking video as the moving image content of the live broadcast may be terminated.

[0259] This masking image may be, by way of example and not by way of limitation, an image different from the image displayed by the imaging unit 27 of the distribution user's terminal 20 (hereinafter referred to as "camera image" as appropriate), and, by way of example and not by way of limitation, may be either a still image or a moving image.

[0260] When a masking image is displayed, for example and not by way of limitation, the masking image may be an image displayed superimposed on the camera image. In this case, for example and not by way of limitation, although the camera image is displayed on the display unit 24, the user may be able to view only the masking image, without being able to view the camera image, based on the masking image having a higher display priority than the camera image being displayed on the display unit 24.

[0261] When the masking video is displayed, for example and not by way of limitation, the display of the camera video may be terminated. In this case, for example and not by way of limitation, the masking video may be made visible based on the fact that the camera video is not displayed on the display unit 24 and only the masking video is displayed.

[0262] Masking images may include, by way of example and not limitation, the following: Exclusive video - User promotional video Live streaming company advertising video

[0263] The dedicated video is, by way of example and not limitation, a video that notifies the viewing user that the broadcasting user has paused the live broadcast. Specifically, the video may include information informing the viewing user that the broadcasting user has paused the live broadcast (messages such as "Please wait a moment..." or "Please hold on a moment"), etc.

[0264] By way of example and not limitation, the broadcast user promotional video may be a video that notifies the viewing user that the broadcast user has suspended live broadcasting, and may also be a video promoting the broadcast user himself / herself or a product or service provided by the broadcast user. Specifically, the video may include information informing viewing users that the broadcasting user has suspended live broadcasting (a message such as "Please wait until broadcasting resumes"), or video promoting the broadcasting user himself or herself or products or services provided by the broadcasting user (promotion of a book published by the broadcasting user), etc.

[0265] The live streaming service provider advertisement video may be, for example and not limited to, a video that notifies the viewing user that the broadcast user has suspended the live streaming, and may be a video related to an advertisement provided by the live streaming service provider (hereinafter, appropriately referred to as "advertising video"). This advertising video may be, for example and not limited to, a video that is not related to the broadcast user. Specifically, the video may include information notifying the viewing user that the broadcasting user has suspended live broadcasting (a message such as "Please wait until broadcasting resumes"), advertising video (advertising video for a travel agency, bank, insurance company, etc.), etc. It may also be advertising video provided by an advertiser or advertising agency that is affiliated with the live broadcasting service provider.

[0266] In this embodiment, when a streaming user is live streaming and the imaging unit 27 of the streaming user's terminal 20 detects that the streaming user's person has not been detected and a masking video is displayed as moving image content for the live stream, then, by way of example and not by way of limitation, the imaging unit 27 of the terminal 20 may be automatically disabled (the camera may be automatically turned off), and by way of example and not by way of limitation, the sound input unit 25 of the terminal 20 may be automatically disabled (the microphone may be automatically turned off). As a non-limiting example, when a masking video is displayed as moving image content of a live stream, audio associated with the dedicated video may be output as audio content of the live stream.

[0267] Then, when the imaging unit 27 of the broadcasting user's terminal 20 detects the presence of the broadcasting user and the display of the masking video as the moving image content of the live broadcast is terminated, by way of example and not by way of limitation, the imaging unit 27 of the terminal 20 may be automatically enabled (the camera may be automatically turned on), and by way of example and not by way of limitation, the sound input unit 25 of the terminal 20 may be automatically enabled (the microphone may be automatically turned on).

[0268] By way of example and not limitation, the period during which the masking video is displayed may be when some event has occurred that prevents the broadcasting user from broadcasting using camera footage, and therefore, by controlling the camera and microphone to be automatically turned off during that period, convenience for the broadcasting user can be improved.

[0269] Examples of events that may prevent a broadcast user from broadcasting using camera footage include, but are not limited to, the following events: If a parcel arrives at the user's home

[0270] A non-limiting example of a case where a parcel is delivered to a broadcasting user's home is a case where a parcel is delivered to the broadcasting user's home while the broadcasting user is live streaming from their home, and there is a risk that the broadcasting user's real name, etc. will be called out by the delivery company.

[0271] <Display screen> FIG. 3-1 is a diagram showing an example of the transition of a screen displayed on the display unit 24 of the terminal 20 (terminal 20A) of the broadcast user (user AA) in this embodiment. In this screen diagram, by way of example and not by way of limitation, when a broadcast user's person is not detected during a live broadcast (the 5th XX broadcast), a dedicated video is displayed as a masking video. However, this is merely an example and is not limited to this example.

[0272] The left side of FIG. 3-1 is the same as the screen in FIG. 2-6 described above, so a description thereof will be omitted. At this time, it is assumed, by way of example and not limitation, that camera footage (footage including the broadcast user's face) is displayed as live broadcast information in the live broadcast information display region LRR.

[0273] By way of example and not limitation, when non-detection of a broadcast user is detected, the display changes to the center screen, by way of example and not limitation. In this example, in the live broadcast information display area LRR, by way of example and not limitation, a dedicated video (video containing messages such as "Please wait a moment..." and "Please hold on a moment") is displayed, replacing the camera video.

[0274] At this time, based on the fact that the imaging unit 27 and the sound input unit 25 of the terminal 20 are disabled, camera mode information indicating that the camera is in the OFF mode and microphone mode information indicating that the microphone is in the OFF mode are displayed.

[0275] By way of example and not limitation, when human detection of a broadcast user is detected, the display on the screen on the right side will change. In this example, by way of example and not limitation, the camera image is switched from the dedicated image and is displayed in the live broadcast information display area LRR. At this time, based on the fact that the imaging unit 27 and the sound input unit 25 of the terminal 20 are enabled, camera mode information indicating that the camera is in the ON mode and microphone mode information indicating that the microphone is in the ON mode are displayed.

[0276] FIG. 3-2 is a diagram showing an example of transition of a screen displayed on the display unit 24 of the terminal 20 (terminal 20B) of the viewing user (user BB) in this embodiment. In this screen diagram, by way of example and not by way of limitation, when a broadcast user's person is not detected during a live broadcast (the 5th XX broadcast), a dedicated video is displayed as a masking video. However, this is merely an example and is not limited to this example.

[0277] Regarding the explanation of FIG. 3-2, the explanation of the parts that are the same as the screen of FIG. 3-1 described above will be omitted. In this example, based on the fact that this is a screen displayed on the display unit 24 of the terminal 20 of the viewing user (user BB), the live broadcast information display area LRR does not display, by way of example and not limitation, information for making various settings related to live streaming, camera mode information, microphone mode information, etc.

[0278] FIG. 3-3 is a diagram showing an example of transition of a screen displayed on the display unit 24 of the terminal 20A in this embodiment. In this screen diagram, by way of example and not by way of limitation, when a broadcast user's person is not detected during a live broadcast (the 5th XX broadcast), a broadcast user promotional video is displayed as a masking video. However, this is merely an example and is not limited to this example.

[0279] The left side of FIG. 3-3 is the same as the screen on the left side of FIG. 3-1 described above, so a description thereof will be omitted.

[0280] By way of example and not limitation, when non-detection of a broadcast user is detected, the display changes to the center screen, by way of example and not limitation. In this example, by way of example and not limitation, a distribution user promotional video (video including information including the message "Please wait until distribution resumes" and information regarding the promotion of books published by the distribution user) is displayed in the live broadcast information display area LRR, switching from the camera video.

[0281] At this time, based on the fact that the imaging unit 27 and the sound input unit 25 of the terminal 20 are disabled, camera mode information indicating that the camera is in the OFF mode and microphone mode information indicating that the microphone is in the OFF mode are displayed.

[0282] By way of example and not limitation, when human detection of a broadcast user is detected, the display on the screen on the right side will change. This screen is similar to the screen on the right side of FIG. 3-1 described above, so a description thereof will be omitted.

[0283] FIG. 3-4 is a diagram showing an example of transition of a screen displayed on the display unit 24 of the terminal 20A in this embodiment. In this screen diagram, by way of example and not by way of limitation, when a broadcast user's person is not detected during a live broadcast (the 5th XX broadcast), an advertising video of the live broadcasting provider is displayed as a masking video. However, this is merely an example and is not limited to this example.

[0284] The left side of FIG. 3-4 is the same as the screen on the left side of FIG. 3-1 described above, so a description thereof will be omitted.

[0285] By way of example and not limitation, when non-detection of a broadcast user is detected, the display changes to the center screen, by way of example and not limitation. In this example, in the live broadcast information display area LRR, as a non-limiting example, a live broadcasting provider advertising video (video including information including a message "Please wait until broadcasting resumes" and information regarding travel agency advertisements) is displayed, replacing the camera video.

[0286] At this time, based on the fact that the imaging unit 27 and the sound input unit 25 of the terminal 20 are disabled, camera mode information indicating that the camera is in the OFF mode and microphone mode information indicating that the microphone is in the OFF mode are displayed.

[0287] By way of example and not limitation, when human detection of a broadcast user is detected, the display on the screen on the right side will change. This screen is similar to the screen on the right side of FIG. 3-1 described above, so a description thereof will be omitted.

[0288] <Processing> 3-5 is a flowchart showing an example of the flow of processing executed by each device in this embodiment. The diagram can be read in the same way as FIG. 1-9. In this process, when the use of the effect function of the live distribution application is selected via the input / output unit 23 or when the setting for use is configured, the effect processing can be performed by the control unit 21 of the terminal 20A. Incidentally, the control unit 11 of the server 10 may perform the effect processing instead of the terminal 20A. The same can be done for canceling the effect.

[0289] After step A120, the control unit 21 of the terminal 20A starts executing the human detection process and the face detection process (A330).

[0290] After that, a first delivery control process is performed between the terminal 20A and the server 10 (A340, S340).

[0291] FIG. 3-6 is a flowchart showing an example of the flow of the first delivery control process. In this figure, the left side shows the processing executed by the control unit 11 of the server 10, and the right side shows the processing executed by the control unit 21 of the terminal 20A.

[0292] The control unit 21 of the terminal 20A determines whether or not a person has been detected based on the image data acquired by the imaging unit 27 (A3410). Detection of whether or not a person is detected may be realized based on a moving object detection process (a moving object detection algorithm) or the like, for example and not for limitation. For example and not for limitation, the determination may be made based on whether or not the torso of a person's body is detected.

[0293] If it is determined that a person has not been detected (A3410: YES), the control unit 21 of the terminal 20A determines whether the person non-detection flag is "ON" (A3420). If it is determined that the flag is not “ON” (A3420: NO), the control unit 21 of the terminal 20A sets the human non-detection flag to “ON” (A3430). The human non-detection flag may be, for example and without limitation, a flag that is set to “ON” when a human is not detected. Note that a similar process may be performed using a human detection flag ("ON" if a human is detected, and "OFF" if a human is not detected).

[0294] Next, the control unit 21 of the terminal 20A transmits person non-detection information indicating that a person has not been detected to the server 10 via the communication I / F 22 (A3440).

[0295] The control unit 11 of the server 10 determines whether or not the non-detection information has been received from the terminal 20A via the communication I / F 14 (S3410). If it is determined that the information has been received (S3410: YES), the control unit 11 of the server 10 acquires the first masking content information from the memory unit 15 etc., stops the transmission of the live broadcast information, and transmits the acquired first masking content information to the viewing user's terminals 20, including terminal 20A and terminal 20B, via the communication I / F 14 (S3420).

[0296] Here, the first masking content information may include the various images described above. In addition to images, sound may also be included.

[0297] Alternatively, the control unit 11 of the server 10 may acquire the first masking content information by receiving it from the terminal 20 of the broadcast user.

[0298] After step A3440, the control unit 21 of the terminal 20A determines whether the human non-detection flag is "ON" (A3450). If it is determined to be "ON" (A3450: YES), the control unit 21 of the terminal 20A determines whether or not a person has been detected (A3460).

[0299] If it is determined that a person has been detected (A3460: YES), the control unit 21 of the terminal 20A sets the person non-detection flag to "OFF" (A3470). Then, the control unit 21 of the terminal 20A transmits person detection information indicating that a person has been detected to the server 10 via the communication I / F 22 (A3480). Then, the control unit 21 of the terminal 20A ends the first delivery control process.

[0300] After step S3420, the control unit 11 of the server 10 determines whether or not human detection information has been received from terminal 20A via the communication I / F 14 (S3450), and if it is determined that human detection information has been received (S3450: YES), starts transmitting live broadcast information to the terminals 20 of the viewing users, including terminal 20A and terminal 20B (S3460). Then, the control unit 11 of the server 10 ends the first delivery control process.

[0301] Returning to FIG. 3-5, after steps A340 and S340, a second delivery control process is performed between the terminal 20A and the server 10 (A340, S340).

[0302] FIG. 3-7 is a flowchart showing an example of the flow of the second delivery control process. In this figure, the left side shows the processing executed by the control unit 11 of the server 10, and the right side shows the processing executed by the control unit 21 of the terminal 20A.

[0303] The control unit 21 of the terminal 20A determines whether or not a face is detected based on the information output from the imaging unit 27 (A3510). Detection of face detection / non-detection may be realized based on the face recognition process (face recognition algorithm) as described above, for example and not by way of limitation.

[0304] If it is determined that a face has not been detected (A3510: YES), the control unit 21 of the terminal 20A determines whether the face non-detection flag is "ON" (A3520). If it is determined that the face detection flag is not “ON” (A3520: NO), the control unit 21 of the terminal 20A sets the face non-detection flag to “ON” (A3530). The face non-detection flag may be, for example and not limited to, a flag that is set to “ON” when a face is not detected. Note that a similar process may be performed using a face detection flag ("ON" if a face is detected, and "OFF" if a face is not detected).

[0305] Next, the control unit 21 of the terminal 20A transmits face non-detection information indicating that a face has not been detected to the server 10 via the communication I / F 22 (A3540).

[0306] The control unit 11 of the server 10 determines whether or not face non-detection information has been received from the terminal 20A via the communication I / F 14 (S3510). If it is determined that the information has been received (S3510: YES), the control unit 11 of the server 10 acquires the second masking content information from the memory unit 15 etc., stops the transmission of the live broadcast information, and transmits the acquired second masking content information to the viewing user's terminals 20, including terminal 20A and terminal 20B, via the communication I / F 14 (S3520).

[0307] Here, the second masking content information may include various images (image data) such as those shown in the display screen examples. In addition to images, sound (sound data) may also be included.

[0308] Alternatively, the control unit 11 of the server 10 may acquire the second masking content information by receiving it from the terminal 20 of the broadcast user.

[0309] Furthermore, the first masking content information and the second masking content information may be entirely the same information, may be partially different information, or may be entirely different information.

[0310] After step A3540, the control unit 21 of the terminal 20A determines whether the face non-detection flag is "ON" (A3550). If it is determined to be "ON" (A3550: YES), the control unit 21 of the terminal 20A determines whether or not a face has been detected (A3560).

[0311] If it is determined that a face has been detected (A3560: YES), the control unit 21 of the terminal 20A sets the face non-detection flag to "OFF" (A3570). Then, the control unit 21 of the terminal 20A transmits face detection information indicating that a face has been detected to the server 10 via the communication I / F 22 (A3580). Then, the control unit 21 of the terminal 20A ends the first delivery control process.

[0312] After step S3520, the control unit 11 of the server 10 determines whether or not face detection information has been received from terminal 20A via the communication I / F 14 (S3550), and if it is determined that face detection information has been received (S3550: YES), starts transmitting live broadcast information to terminals 20 of viewing users, including terminal 20A and terminal 20B (S3560). Then, the control unit 11 of the server 10 ends the second delivery control process.

[0313] In addition, in a case where the live content information includes sound, if the user is no longer detected, the server 10 may perform control to stop the distribution of sound, and if the user is detected, the server 10 may perform control to start the distribution of sound.

[0314] Returning to FIG. 3-5, after these processes, the control unit 21 of the terminal 20B performs output based on the information received from the server 10 (B360). Similarly, the control unit 21 of the terminal 20A performs output based on the information received from the server 10 (A360).

[0315] If it is determined in step A130 that the live distribution should not end (A130: NO), the control unit 21 of the terminal 20A returns the process to step A340, for example and not for limitation. If it is determined in step S130 that the live distribution end request information has not been received (S130: NO), the control unit 11 of the server 10 returns the process to step S340, for example and not for limitation. If it is determined in step B130 that the live streaming end information has not been received (B130: NO), the control unit 21 of the terminal 20B returns the process to before step B360, for example and not by way of limitation.

[0316] <Effects of the third embodiment> This embodiment illustrates a configuration in which, when a broadcast user (not limited to, but an example of a user) is detected based on image data acquired by an imaging unit 27 (not limited to, but an example of an imaging device) of a terminal 20 of a broadcast user, a control unit 11 controls the transmission of first data of a first image related to the detected broadcast user, which is an image based on the image data, and, when a broadcast user is not detected, the control unit controls the transmission of second data of a second image different from the first image. As an example of an effect of an embodiment obtained by such a configuration, when a user is detected, first data of a first image relating to the detected user, which is an image based on image data acquired by an imaging device, can be transmitted so that the first image is displayed, whereas when a user is not detected, second data of a second image different from the first image can be transmitted so that the second image is displayed.

[0317] This embodiment shows a configuration in which, when server 10 detects a broadcast user after the broadcast user has ceased to be detected, control unit 11 performs control to transmit the first data. As an example of an effect of an embodiment obtained by such a configuration, when a user is detected after the user is no longer detected, first data of a first image can be transmitted and the first image can be displayed.

[0318] In this embodiment, detection of a broadcast user involves detecting the presence of the broadcast user and detecting the face of the broadcast user, and if the presence of the broadcast user is not detected, server 10 has control performed by control unit 11 to transmit second data of a third image different from the first image, and if the face of the broadcast user is not detected, control unit 11 has control to transmit second data of a fourth image different from the third image. As an example of an effect of an embodiment obtained by such a configuration, when the presence of a user is not detected and when the user's face is not detected, second data of different images can be transmitted and the corresponding images can be displayed.

[0319] In this embodiment, the detection of a broadcast user is the detection of the presence of the broadcast user, and the second image is a moving image. As an example of an effect of the embodiment obtained by such a configuration, when the presence of a user is not detected, the second data of the moving image can be transmitted and the moving image can be displayed.

[0320] The second image may also be a video related to the broadcast user, or a video of an advertisement. As an example of the effect of the embodiment obtained by such a configuration, when the presence of a user is not detected, second data of a video related to the user or an advertising video can be transmitted and the video can be displayed. This makes it possible, by way of example and not of limitation, to inform or appeal to people who view the video about the user, or to advertise a product or service in the advertisement to people who view the video.

[0321] In this embodiment, detection of the broadcast user is detection of the broadcast user's face, and the second image is a still image. As an example of the effect of the embodiment obtained by such a configuration, when the user's face is not detected, the second data of the still image can be transmitted and the still image can be displayed.

[0322] This embodiment shows a configuration in which, when a user is detected in the server 10, the control unit 11 controls the transmission of sound data acquired by the sound input unit, and, when a user is not detected, the control unit 11 controls the stopping of the transmission of the sound data. As an example of the effect of an embodiment obtained by such a configuration, when a user is detected, sound data acquired by the sound input unit can be transmitted so that sound is output, whereas when a user is not detected, the transmission of the sound data can be stopped so that sound is not output.

[0323] <Third Modification (1)> In the above embodiment, the broadcast user's terminal 20 may perform a person detection process based on the sound data acquired by the sound input unit 25, for example and not by way of limitation.

[0324] Furthermore, in the above embodiment, if it is determined that the user is not detected, the broadcast user's terminal 20 may stop transmitting live content information to the server 10. In this case, the control unit 11 of the server 10 may acquire and transmit masking content information based on receiving non-detection information from a distribution user or based on no longer receiving live content information.

[0325] Similarly, in the above embodiment, when it is determined that the user has been detected, the broadcast user's terminal 20 may start transmitting live content information to the server 10. In this case, the control unit 11 of the server 10 may transmit live broadcast information based on receiving detection information from the broadcast user, or based on receiving live content information.

[0326] This may be the same for both images and sounds.

[0327] In addition, image data acquired by the imaging unit 27 of the distribution user's terminal 20 may be transmitted from the distribution user's terminal 20 to the server 10, and the server 10 may perform person detection processing or face detection processing based on the received image data.

[0328] In addition, sound data acquired by the sound input unit 25 of the distribution user's terminal 20 may be transmitted from the distribution user's terminal 20 to the server 10, and the control unit 11 of the server 10 may perform person detection processing, for example and not limitation, based on the received sound data.

[0329] <Third Modification (2)> When a broadcast user is detected, processing may be performed to confirm with the broadcast user that the display of the masking video should be ended, and the display of the masking video may be ended based on the result of that confirmation.

[0330] FIG. 3-8 is a diagram showing an example of transition of a screen displayed on the display unit 24 of the terminal 20A in this modified example. In this screen diagram, as an example and not a limitation, a case is shown in which, during a live broadcast (the 5th XX broadcast), non-detection of the broadcast user's figure is detected, and, as an example and not a limitation, a case is shown in which, after a dedicated video is displayed as a masking video, detection of the broadcast user's figure is detected, the display of the dedicated video as the masking video is ended, as an example and not a limitation. However, this is merely an example and is not limited to this example.

[0331] The left side of FIG. 3-8 is the same as the screen in the center of FIG. 3-1 described above, so a description thereof will be omitted.

[0332] By way of example and not limitation, when non-detection of a broadcast user is detected, the display changes to the center screen, by way of example and not limitation. In this example, in the live broadcast information display area LRR, by way of example and not limitation, information to confirm with the broadcasting user whether it is OK to end the display of the masking video (in this example, the message "Are you sure you want to end the display of the masking video?", a YES button YBT (a button containing the word "yes") for answering YES to this question, and a NO button NBT (a button containing the word "no") for answering NO to this question, etc.) is displayed superimposed on the masking video.

[0333] At this time, based on the fact that the imaging unit 27 and the sound input unit 25 of the terminal 20 continue to be disabled, camera mode information indicating that the camera is in the OFF mode and microphone mode information indicating that the microphone is in the OFF mode continue to be displayed.

[0334] As a non-limiting example, when the YES button YBT on the center screen is tapped by the broadcast user, the display changes to the screen on the right, as a non-limiting example. This screen is similar to the screen on the right side of FIG. 3-1 described above, so a description thereof will be omitted.

[0335] <Third Modification (3)> There may be cases where a distribution user erroneously disables the effect function by their own operation. Therefore, as a non-limiting example, when a user inputs to disable the effect to the input / output unit 23, the transmission of the live content information may be stopped and the masking video may be displayed, as in the above embodiment.

[0336] In this case, when a user input to cancel the effect is made to the input / output unit 23, the terminal 20 of the distributor user may stop transmitting the live content information, control the display unit 24 of the terminal 20 of the distributor user to display effect cancellation confirmation information for confirming with the distributor user whether or not to cancel the effect. Then, when the distributor user selects "OK to cancel the effect," the transmission of the live content information may be started, and when the distributor user selects "NG to cancel the effect," the display of the masking video may be maintained (live content information may not be transmitted).

[0337] Furthermore, image data of a live image in which an object is superimposed on an image based on image data acquired by the broadcast user's terminal 20 may be distributed to the viewing user's terminal 20, so that the live image can be viewed in a manner in which the viewing user cannot view the broadcast user's face. This object may be made removable based on an input from the broadcast user's terminal 20, and as a non-limiting example, a screen may be displayed on the broadcast user's terminal 20 to allow the broadcast user to select whether or not to remove the object, and based on the broadcast user performing a selection operation to remove the object, image data acquired by the broadcast user's terminal 20 (image data of an image in which the object is not superimposed and the viewing user can view the broadcast user's face) may be distributed to the viewing user's terminal 20.

[0338] With this configuration, if the broadcasting user does not want to use an object, for example and not by way of limitation, if the broadcasting user wants to show the viewing user his or her own face, an image without the object superimposed (the image based on the image data acquired by the broadcasting user's terminal 20 (the image being captured) itself) can be displayed on the viewing user's terminal 20 by inputting the image into the broadcasting user's terminal 20.

[0339] Here, based on the broadcast user performing an operation to remove the object, the image without the object superimposed may not be immediately displayed on the viewing user's terminal 20, and an image prompting the viewing user to wait, an advertising video image, or the like may be temporarily displayed on the viewing user's terminal 20. In other words, the server 10 may be configured to cause the control unit 11 to perform control to transmit the second data based on an input by the broadcast user regarding the transmission of an image not including the object.

[0340] With this configuration, for example and not by way of limitation, if the broadcasting user mistakenly inputs an object to be removed, it is possible to prevent the broadcasting user's face from being seen by viewing users against their will.

[0341] Furthermore, based on the distribution user performing an operation to remove an object, an image prompting the viewing user to wait, an advertising video image, etc. may be displayed on the viewing user's terminal 20, and then based on the distribution user performing an input to confirm removing the object, an image without the object superimposed may be displayed on the viewing user's terminal 20.

[0342] As a non-limiting example, a screen may be displayed on the distributing user's terminal 20 to prompt the user to confirm whether or not it is OK to display the image with the object removed (the image being captured by the distributing user's terminal 20) as is on the viewing user's terminal 20, and based on the distributing user performing a confirmation operation to remove the object, image data of the image with the object removed may be distributed to the viewing user's terminal 20. That is, after performing control to transmit the second data, the server 10 may perform, via control unit 11, a process to confirm with the user that image data of the image not including the object is to be transmitted, and based on the process related to the confirmation, the control unit 11 may control the transmission of the image data of the image not including the object.

[0343] With this configuration, by way of example and not limitation, it is possible to ensure that an image without any objects superimposed is displayed on the viewing user's terminal after it is confirmed that this is not an operational error and is in line with the distribution user's intention.

[0344] Fig. 3-9 is a diagram showing an example of a screen displayed on display 24 of terminal 20B of user BB, who is a viewing user. On the left side of Fig. 3-9, a live image of user AA, who is a distribution user, is displayed on display 24 of terminal 20B. Because the broadcasting user has set an effect on his / her face area, an object OB is displayed superimposed on the broadcasting user's face area. This prevents the viewing user from identifying the broadcasting user's face, and the broadcasting user can broadcast live without revealing his / her face.

[0345] As shown on the left side of Figure 3-9, the object OB is automatically superimposed on the face area based on the fact that the face area of ​​the broadcasting user is continuously detected. Therefore, if the face area of ​​the broadcasting user is no longer detected, the object OB becomes hidden, and live broadcasting may be carried out against the broadcasting user's intentions without any effects applied to the broadcasting user's face.

[0346] In this embodiment, as shown in the center of Fig. 3-9, a masking image is displayed in the live broadcast information display area LRR based on the fact that the face area is no longer detected. This makes it possible to prevent the broadcast user's face from being made public against their will. Then, based on the fact that the face area is detected again, the broadcasting user will be displayed in the live broadcast information display area LRR with the object OB superimposed on the face area, as shown on the right side of Figure 3-9, and live broadcasting will again be performed with effects applied.

[0347] 3-10 is an example of a screen displayed on display unit 24 of terminal 20A of user AA, who is a broadcast user. The broadcast user can set whether or not to apply an effect to their own face area during live broadcasting by inputting information into their own terminal 20A.

[0348] As shown on the left side of FIG. 3-10, for example, when a broadcasting user performs a predetermined operation (for example, tapping on a setting icon) during live broadcasting, an effect cancel icon ERI is displayed in the live broadcast information display area LRR. In this example, the icon ERI displays a message saying "Do you want to cancel the effect?" along with a "YES" button and a "NO" button.

[0349] When the broadcasting user taps the "YES" button, as shown in the center of Figure 3-10, the masking video is displayed in the live broadcast information display area LRR, along with a confirmation icon CFI for confirming whether or not to continue live broadcasting with effects disabled. In this example, the icon CFI displays a "YES" button and a "NO" button along with the message "Do you want to disable effects and broadcast?"

[0350] When the broadcasting user taps the "YES" button, the broadcasting user will be displayed in the live broadcast information display area LRR without the object OB superimposed on their face area, as shown on the right side of Figure 3-10, and live broadcasting will be performed without any effects applied.

[0351] In this way, when the broadcasting user performs an operation to cancel the effect, the masked image is displayed for a while, which prevents the broadcasting user from immediately revealing their face if they perform the operation by mistake, and also gives the broadcasting user time to confirm whether or not they want to perform live streaming with the effect canceled. Then, based on the broadcasting user's confirmation operation to cancel the effect and perform live streaming, the live streaming will be performed without the effect applied.

[0352] <Fourth Example> The fourth embodiment relates to outputting different masking content information when a certain amount of time has passed since the broadcast user was no longer detected in the third embodiment.

[0353] The contents described in the fourth embodiment are applicable to any of the other embodiments and other modified examples. Furthermore, the same components as those already mentioned are given the same reference numerals and will not be described again.

[0354] <Display screen> FIG. 4-1 is a diagram showing an example of transition of a screen displayed on the display unit 24 of the terminal 20 in this embodiment. This screen diagram shows, by way of example and not by way of limitation, an example in which, if a broadcast user's non-detection is detected during a live broadcast (the 5th XX broadcast), and, after a dedicated video is displayed as a masking video, if a set time has elapsed while the user's non-detection continues, then, by way of example and not by way of limitation, the display switches to a masking video that is different from the dedicated video. However, this is merely an example and is not limited to this example.

[0355] The left and center screens in FIG. 4-1 are similar to those in FIG. 3-1 described above, so their explanation will be omitted.

[0356] As a non-limiting example, if the set time elapses while non-detection of the broadcast user continues, the display will change to the screen on the right side of Figure 4-1, as a non-limiting example. This screen is similar to the screen in the center of FIG. 3-3 described above, so a description thereof will be omitted.

[0357] <Processing> FIG. 4-2 is a flowchart showing an example of the flow of a third delivery control process that the control unit 21 of the delivery user's terminal 20A in this embodiment executes in place of the first delivery control process of FIG. 3-6.

[0358] If it is determined in step A3460 that no person has been detected (A3460: NO), the control unit 21 of the terminal 20A determines whether or not a set time has elapsed since the person non-detection flag was set to "ON" (A4470).

[0359] If it is determined that the set time has elapsed (A4470: YES), the control unit 21 of the terminal 20A transmits, via the communication I / F 22 to the server 10, certain-time person non-detection information indicating that a person has not been detected for a certain time (A4480). Then, the control unit 21 of the terminal 20A ends the process.

[0360] In this case, when the control unit 11 of the server 10 receives person non-detection information for a certain period of time from the terminal 20A, it can, by way of example and not limitation, obtain third masking content information different from the first masking content information from the memory unit 15, etc., and transmit it to the terminals 20 of the viewing users, including the terminal 20A and the terminal 20B.

[0361] The second delivery control process shown in FIG. 3-7 may be performed in a similar manner to the above. In other words, when a set time has elapsed since the face detection flag was set to “ON”, the control unit 21 of the terminal 20A may be configured to send face non-detection information for a certain period of time, indicating that a face has not been detected for a certain period of time, to the server 10 via the communication I / F 22.

[0362] In this case, when the control unit 11 of the server 10 receives face non-detection information for a certain period of time from the terminal 20A, for example and not limitation, the control unit 11 may obtain fourth masking content information different from the second masking content information from the memory unit 15, etc., and transmit it to the terminals 20 of the viewing users including the terminal 20A and the terminal 20B.

[0363] Note that the third masking content information and the fourth masking content information may include, by way of example and not limitation, the following images (either still images or moving images) as described above. Exclusive video - User promotional video Live streaming company advertising video Sound may also be included.

[0364] Also, by way of example and not limitation, the first masking content information may include a still image as the image, and the third masking content information may include a moving image as the image. Similarly, by way of example and not limitation, the second masking content information may include a still image as the image, and the fourth masking content information may include a moving image as the image.

[0365] Also, the first masking content information and the third masking content information may be, for example and without limitation, content information of different images. Similarly, the second masking content information and the fourth masking content information may be, for example and not by way of limitation, content information of different images. The same can be said about sound.

[0366] <Effects of the Fourth Embodiment> This embodiment shows a configuration in which, when a set time has elapsed since the server 10 stopped detecting the distribution user, the control unit 11 controls the transmission of third data of a third image different from the first image and the second image instead of the second data. As an example of the effect of an embodiment obtained by such a configuration, when a certain amount of time has passed since the distribution user was no longer detected, third data of a third image different from the first image and the second image can be transmitted and the third image can be displayed.

[0367] The second image may be a still image, and the third image may be a moving image. As an example of the effect of an embodiment obtained by such a configuration, when a certain amount of time has passed since the distribution user was no longer detected, third data of the moving image can be transmitted and the third image can be displayed.

[0368] In this embodiment, the third image is a moving image of an advertisement. As an example of the effect of an embodiment obtained by such a configuration, when a certain amount of time has passed since the broadcast user was no longer detected, third data of the advertising video can be transmitted and the third image can be displayed.

[0369] <Fifth Example> The fifth embodiment relates to an embodiment in which, when a broadcasting user is performing live broadcasting and the imaging unit 27 of the broadcasting user's terminal 20 detects that the broadcasting user is not present, the broadcasting user can arbitrarily set the type of masking video to be displayed as moving image content of the live broadcast.

[0370] The contents described in the fifth embodiment are applicable to any of the other embodiments and other modified examples. Furthermore, the same components as those already mentioned are given the same reference numerals and will not be described again.

[0371] In this embodiment, the timing when the distributor user arbitrarily sets the type of masking video may include, by way of example and not limitation, the following timing. Timing before the live broadcast begins Timing during live streaming

[0372] The timing before the start of live distribution may be, by way of example and not limitation, any timing before the start of live distribution. Specifically, before live streaming begins on a live streaming service, the type of masking video may be set on a screen for setting up the live streaming of the live streaming service (see the left side of Figure 5-1).

[0373] The timing during the live distribution may be, by way of example and not limitation, any timing while the live distribution is taking place. Specifically, when live streaming is being performed by a live streaming service, the type of masking video may be set on a screen (not shown) for setting the live streaming of the live streaming service.

[0374] <Display screen> FIG. 5-1 is a diagram showing an example of transition of a screen displayed on the display unit 24 of the terminal 20A in this embodiment. This screen diagram shows, as an example and not a limitation, an example in which a broadcasting user sets a dedicated video as a type of masking video on a live streaming setting screen, which allows settings regarding the live streaming of a live streaming service, before the start of a live streaming session (the 5th XX broadcast). However, this is merely an example and is not limited to this example.

[0375] The left side of FIG. 5-1 is an example, by way of example and not limitation, of a live streaming setting screen that is displayed when no live streaming is being performed in a live streaming application (live streaming service). This screen is configured so that the name of the live streaming application, "Live Streaming App," is displayed in the top center of the screen. Below that is an area containing the text "Live Streaming Settings" showing the current screen.

[0376] Below that, a live distribution setting information display area LSR for displaying live distribution setting information is configured. The live streaming setting information display area LSR displays, by way of example and not limitation, information for setting the type of masking video for live streaming (information regarding the types of masking video that the broadcasting user can select, information regarding a preview of the type of masking video selected by the broadcasting user, etc.) and a decision button DBT for deciding to use the type of masking video selected by the broadcasting user in the actual live streaming.

[0377] As an example and not as a limitation, when a dedicated video is selected by the user on the screen on the left side of Figure 5-1 and the user taps the decision button DBT, as an example and not as a limitation, information is displayed (not shown) indicating that the dedicated video has been set as the masking video.

[0378] And, as a non-limiting example, when a live broadcast (the 5th XX Live) is started by a broadcasting user, the display on the center screen changes. This screen is similar to the screen shown on the left side of FIG. 3-1 described above, so a description thereof will be omitted.

[0379] By way of example and not limitation, when non-detection of a broadcast user is detected, the display on the screen on the right side will change, by way of example and not limitation. This screen is similar to the screen in the center of FIG. 3-1 described above, but is not limited thereto, and therefore will not be described.

[0380] In this example, based on the fact that a dedicated video is set as masking video on the live streaming setting screen before the live streaming starts, the dedicated video (video including messages such as "Please wait a moment..." and "Please hold on a moment") is displayed in the live broadcast information display area LRR, by way of example and not limitation, replacing the camera video.

[0381] <Fifth Modification (1)> When a live distribution provider advertisement video is displayed as a masking video during live distribution, as a non-limiting example, a remuneration (compensation) may be paid to the distribution user from the live distribution provider.

[0382] Furthermore, when a live streaming provider advertisement video is displayed as a masking video during live streaming, the broadcaster may be notified that a reward will be paid to the broadcaster by the live streaming provider, for example and not by way of limitation. Hereinafter, information regarding the payment of a reward to the broadcaster by the live streaming provider will be appropriately referred to as "reward notification information" or the like.

[0383] Examples of timing when the live streaming provider notifies the broadcaster that a remuneration will be paid to the broadcaster include, but are not limited to, the following: Timings when there is no live broadcast Timing of live streaming

[0384] The timing when no live streaming is taking place may be, by way of example and not limitation, a predetermined timing when no live streaming is taking place. Specifically, as an example and not as a limitation, the broadcast user may be notified by displaying reward notification information on a live streaming setting screen before a live stream is made, and as an example and not as a limitation, the broadcast user may be notified by displaying reward notification information on an analytics screen before a live stream is made.

[0385] The timing when live streaming is being performed may be, for example and without limitation, a predetermined timing in a situation where live streaming is being performed. Specifically, as an example and not by way of limitation, the broadcast user may be notified by displaying reward notification information included in the live broadcast information on a live broadcast screen while a live broadcast is being performed.

[0386] FIG. 5-2 is a diagram showing an example of a screen displayed on the display unit 24 of the terminal 20A in this modified example. This screen diagram shows, as an example and not as a limitation, an example in which, before a live broadcast (the 5th XX broadcast) begins, a live broadcast setting screen, which allows users to set up the live broadcast of a live broadcast service, notifies the broadcast user that a remuneration will be paid to the broadcast user by the live broadcasting provider. However, this is merely an example and is not limited to this example.

[0387] Regarding the screen in FIG. 5-2, the explanation of the parts that are similar to the screen on the left side of FIG. 5-1 described above will be omitted. In this example, in the live streaming setting information display area LSR, next to information regarding the live streaming provider's advertising video (the words "operated advertising video") among the information regarding the types of masking video that the streaming user can select, information to inform the streaming user that a reward will be paid to the streaming user by the live streaming provider (the words "(advertising reward will be granted)") is displayed, by way of example and not limitation.

[0388] According to this configuration, it is possible to make it easier for the broadcast user to select the live broadcasting provider advertising video as the masking video on the live broadcasting setting screen where the type of masking video can be set.

[0389] Note that, as a non-limiting example, the remuneration paid by the live distribution provider to the distribution user may be determined by the server 10. In this case, as a non-limiting example, the remuneration may be determined based on at least one of the following: · The number of times the live streaming service's advertising video was viewed by viewers (total number of times, etc.) The time (total time, etc.) that the live streaming service's advertising video was viewed by the viewing user Sales volume and sales amount of the products or services featured in the live streaming service advertising video (total sales volume, total sales amount, etc.) Number of clicks on the live streaming service's advertising video (total number of clicks, etc.) Note that, by way of example and not limitation, the number of sales, sales amount, and number of clicks of the above-mentioned products or services may be examples of the reaction of the viewing user based on the display of the moving image of the advertisement.

[0390] The reward may be paid in legal currency or corporate currency (which may include points, coupons, service vouchers, etc.), or may be paid in crypto assets (virtual currency), etc. Also, the amount of the reward may be set to a larger amount as the various values ​​described above increase, for example and not for limitation. Remuneration may also be provided in the form of goods or services.

[0391] Although the meaning is slightly different from that described above, the reaction of the viewing users based on the display of the advertisement video may or may not include the number of viewing users, the number of viewing user comments, the viewing user enthusiasm, etc., as described above.

[0392] In this modified example, the second image is a moving image of an advertisement, and the server 10 is configured to determine, via the control unit 11, a reward to be granted to the distribution user, which is based on the display (or playback) of the second image on the viewing user's terminal 20 (not limited to this, but an example of a terminal to which the second data is transmitted). As an example of the effect of the modified example obtained by such a configuration, a reward can be determined and awarded to the user based on viewing the second image, which is a moving image of an advertisement, on the terminal to which the second data was transmitted based on the fact that the user was not detected.

[0393] In this case, the reward may be determined by the control unit 11 based on the display time (which may be called the playback time) of the second image, which is the moving image of the advertisement, or the reaction of the viewing user based on the display of the moving image of the advertisement. As an example of the effect of the modified example obtained by such a configuration, by way of example and not limitation, it becomes possible to set a higher reward the longer the display time of the second image, which is a moving image of the advertisement, or the greater the response of the user of the terminal, the higher the reward.

[0394] In this modified example, the third image is a moving image of an advertisement, and the server 10 is configured to determine, via the control unit 11, a reward to be granted to the user based on the display of the second image on the terminal to which the third data was transmitted. As an example of the effect of the modified example obtained by such a configuration, a reward can be determined and awarded to the user based on the display of a third image, which is a moving image of an advertisement, on the terminal to which the third data was transmitted when a set time has elapsed since the user was no longer detected.

[0395] In this case, the reward may be determined based on the display time of the third image or the reaction of the user of the terminal based on the display of the third image. As an example of the effect of the modified example obtained by such a configuration, by way of example and not limitation, it becomes possible to set a higher reward the longer the display time of the third image, which is the advertising moving image, or the greater the response of the user of the terminal, the higher the reward.

[0396] <Sixth Example> The sixth embodiment relates to an embodiment in which a broadcasting user can manually switch between a camera image and a masking image while performing live broadcasting. Moreover, the sixth embodiment is an embodiment relating to allowing a broadcasting user to manually switch the type of masking video while the broadcasting user is performing live broadcasting.

[0397] The contents described in the sixth embodiment are applicable to any of the other embodiments and other modified examples. Furthermore, the same components as those already mentioned are given the same reference numerals and will not be described again.

[0398] <Display screen> FIG. 6-1 is a diagram showing an example of transition of a screen displayed on the display unit 24 of the terminal 20A in this embodiment. In this screen diagram, by way of example and not by way of limitation, when a broadcasting user operates to switch from camera footage to masking footage during a live broadcast (the 5th XX broadcast), a dedicated video is displayed as the masking video. However, this is merely an example and is not limited to this example.

[0399] Regarding the screen on the left side of FIG. 6-1, the description of the parts that are similar to the screen on the left side of FIG. 3-1 described above will be omitted. In this example, at the top of the live broadcast information display area LRR, as an example and not a limitation, camera mode information and microphone mode information are displayed, along with information for switching to masking video (masking video switching button MBT) as information for making various settings related to live streaming. At this time, the masking image switching button MBT is, by way of example and not by way of limitation, displayed as an OFF state masking image switching button MBT (in this example, a button including an illustration of a coffee cup and the word "OFF") based on the fact that a mode for switching to masking image has not been selected.

[0400] By way of example and not limitation, when the masking video switch button MBT is tapped by a user, the display changes to the screen on the right, by way of example and not limitation. In this example, a masking video switching button MBT in the ON state (in this example, a button including an illustration of a coffee cup and the word "ON") is displayed at the top of the live broadcast information display area LRR, by way of example and not limitation.

[0401] FIG. 6-2 is a diagram showing an example of transition of a screen displayed on the display unit 24 of the terminal 20A in this embodiment. In this screen diagram, as an example and not a limitation, when a masking video is displayed during a live broadcast (the 5th XX broadcast), the type of masking video is switched by the operation of the broadcasting user. However, this is merely an example and is not limited to this example.

[0402] Regarding the screen on the left side of FIG. 6-2, the explanation of the parts that are similar to the screen on the right side of FIG. 6-1 described above will be omitted. In this example, by way of example and not limitation, information for changing the type of masking video (a masking video change area including information for specifying the type of masking video to be changed and a masking video change button MSBT for actually changing to the specified type of masking video) is displayed in the lower right corner of the live broadcast information display area LRR.

[0403] By way of example and not limitation, when the broadcast user taps in the masking video change area so that the type of masking video becomes the broadcast user promotional video, by way of example and not limitation, the display on the center screen changes. In this example, the information for specifying the type of masking video to be changed displays the words "promotional video" as an example and not a limitation.

[0404] As an example and not as a limitation, when the type of masking video in the masking video change area is specified by the broadcast user to be a broadcast user promotional video, and the masking video change button MSBT is tapped by the broadcast user, the display on the screen on the right changes, as an example and not a limitation. In this example, similar to the screen on the left side of FIG. 6-2, information for changing the type of masking video is displayed in the lower right corner of the live broadcast information display area LRR, by way of example and not limitation.

[0405] <Other Examples> (1) Content In the above embodiment and modified examples, the content to be distributed may include live commerce content.

[0406] In addition, the content to be distributed may include, by way of example and not limitation, virtual content that distributes images and the like using a 2D or 3D avatar (virtual character). In this case, the distribution user who distributes the content may include this avatar. As an example and not by way of limitation, when applying the contents of the third embodiment, it may be possible to determine whether the effect of an avatar drawn in 2D or 3D has been removed using a method similar to that of the above embodiment, and if it is determined that the effect has been removed, to transmit masking content information in the same manner as in the above embodiment. The same may be true for other embodiments and modifications.

[0407] (2) Information processing device In the above embodiment, the information processing device may be, by way of example and not limitation, the broadcast user's terminal 20. At least a part of the processing performed by the server 10 may be performed by the broadcast user's terminal 20.

[0408] Also, instead of using one server 10, the server 10 may be divided into a plurality of servers, and these plurality of servers may be regarded as the information processing device of the present disclosure. Furthermore, a server system may be formed from a plurality of servers, and the processes shown in the above embodiments and modifications may be realized by this server system.

[0409] Furthermore, instead of a server, a terminal such as a management PC or a management smartphone may be used as the information processing device of the present disclosure.

[0410] (3)Other As described above, the contents described in each of the above embodiments, each of the modifications, other embodiments, etc. can be applied in combination with each other. [Explanation of symbols]

[0411] 1. Communication Systems 10 Server 20 Terminals 30 Network

Claims

1. A program executed by an information processing device, acquiring, by a control unit of the information processing device during distribution, a value related to a reaction of a viewing user who views content distributed by a distributor user; The information processing device executes, by the control unit, a process related to notifying the broadcast user of information regarding the fact that the value has satisfied a change condition.

2. The program according to claim 1, The information regarding the value satisfying the change condition includes information regarding the time in the content at which the value satisfied the change condition.

3. The program according to claim 1, The information processing device executes, by the control unit, an estimation process for estimating a cause of the value satisfying the change condition; The information regarding the value satisfying the change condition includes information regarding the cause.

4. The program according to claim 3, the information regarding the value satisfying the change condition includes information regarding a time in the content at which the value satisfied the change condition; the time is a first time, The estimation process is performed by the control unit based on the content for a predetermined time period before the first time or before the first time.

5. The program according to claim 3, the information regarding the value satisfying the change condition includes information regarding a time in the content at which the value satisfied the change condition; the content includes audio; the time is a first time, The estimation process is performed by the control unit based on the voice for a predetermined time period before the first time or before the first time.

6. The program according to claim 5, The estimation process includes processing based on text information obtained based on the voice information.

7. The program according to claim 6, The estimation process includes a process based on the text information and predetermined inappropriate language information.

8. The program according to claim 3, The process related to the notification includes a process related to displaying information related to the cause on the broadcast user's terminal.

9. The program according to claim 8, the content includes an image; The process relating to the display includes a process relating to displaying information relating to the cause by superimposing the information on the image.

10. The program according to claim 8, The process relating to the display includes a process relating to the display of the information relating to the cause in the form of advice.

11. The program according to claim 8, The process relating to the display includes a process relating to displaying information regarding the cause when new content is distributed by the distribution user.

12. The program according to any one of claims 1 to 11, The value includes a number of viewing users viewing the content, The information regarding the value satisfying a change condition includes information regarding the number of viewing users satisfying a decrease condition.

13. An information processing method of an information processing device, acquiring, by a control unit of the information processing device during distribution, a value related to a reaction of a viewing user who views content distributed by a distributor user; The control unit performs a process to notify the broadcast user of information indicating that the value has satisfied a change condition.

14. An information processing device, The control unit is configured to acquire, during distribution, a value relating to a reaction of a viewing user who views content distributed by a distribution user, and to perform processing related to notifying the distribution user of information regarding the fact that the value satisfies a change condition.

15. A program executed by a terminal of a distribution user who distributes content, receiving information by a communication unit of the terminal that a value related to a reaction of a viewing user who views the content during distribution of the content satisfies a change condition; The control executed by the terminal is to cause a control unit of the terminal to display information on the fact that the value satisfies a change condition on a display unit of the terminal.

16. The program according to claim 15, The control unit controls the display of information indicating that the value satisfies the change condition on the display unit based on a setting condition related to display.

Images