Distributor terminal, display method, and program for displaying video during live distribution

Abstract

To provide a distributor terminal capable of appropriately supporting a distributor.SOLUTION: A generation unit 251 generates a viewer video in which an object is combined in a live video captured by an imaging unit 210. The generation unit 251 also generates a distributor video in which an object is combined in a mirror video obtained by inverting the live video. A change unit 253 changes a display mode of an object to be combined in the live video and the mirror video according to an operation from the distributor on the object in the distributor video. A distribution unit 252 transmits the viewer video with the changed display mode of the object to a distribution server for distribution to a viewer terminal. A display unit 260 displays the distributor video with the changed display mode of the object.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present disclosure relates to a distributor terminal, a display method, and a program for displaying video during live distribution. [Background technology]

[0002] In recent years, a type of e-commerce called "live commerce" has been gaining attention. Live commerce is a form of e-commerce in which a broadcaster broadcasts a live video introducing a product, and viewers watching the live video can purchase the product.

[0003] For example, Patent Document 1 discloses an online commerce support system in which a seller (distributor) distributes live video (live footage) via his or her own terminal (distributor terminal), and viewers watching the live video can purchase products while asking questions to the seller. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-42551 A Summary of the Invention [Problem to be solved by the invention]

[0005] Not limited to the above-mentioned live commerce, when a distributor distributes his / her own live video, it is common for the display unit of the distributor's terminal to display a mirror image of the live video, inverted (mirror-reversed) rather than displaying the live video captured by the camera (shooting unit) as is. In other words, the distributor distributes while checking the mirror image displayed on the display unit of the distributor's terminal, just as if he / she were checking his / her appearance in front of a mirror.

[0006] In such live video, for example, an object containing text information to inform viewers (such as a product purchase button or subtitles describing the product's features in the case of live commerce) may be synthesized. In such cases, such objects are also displayed inverted on the display unit of the distributor's terminal, which causes a problem that the readability of the text information contained in the object is significantly reduced for the distributor. It is also possible to synthesize an object onto a mirror image of the live video after flipping it, but if the object is simply synthesized in the same position as the live video, when the distributor makes a motion to point to the object, it may end up pointing to a different position from the object in the live image that the viewer is watching.

[0007] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a distributor terminal, a display method, and a program that can appropriately support distributors. [Means for solving the problem]

[0008] A distributor terminal according to a first aspect of the present disclosure includes: transmitting a viewer video for distribution to a viewer terminal, the viewer video being a live video being captured by a capture unit and an object being composited into the live video; displaying a distributor's video obtained by synthesizing the object with a mirror image obtained by inverting the live video; and changing a display mode of the object to be composited with the live video and the mirror image in accordance with an operation from a distributor on the object in the distributor video; a processor executing The present invention is characterized by comprising:

[0009] In addition, in the distributor terminal according to the above aspect, The change in the display mode may include a change in at least one of the size, shape, color, pattern, brightness, and luminance of the object.

[0010] In addition, in the distributor terminal according to the above aspect, The processor, When the object in the distributor's video is moved to a new position by an operation from the distributor, the object to be composited into the live video may be further changed to a position of a right-image relative to the new position.

[0011] In addition, in the distributor terminal according to the above aspect, The object may include transition information added thereto for transitioning to a sales server that sells the product.

[0012] In addition, in the distributor terminal according to the above aspect, The object may include text information.

[0013] In addition, in the distributor terminal according to the above aspect, The object in the distributor video may be composited at a mirror image position relative to a composite position of the object in the viewer video.

[0014] A display method according to a second aspect of the present disclosure includes: The computer transmitting a viewer video for distribution to a viewer terminal, the viewer video being a live video being captured by a capture unit and an object being composited into the live video; displaying a distributor's video obtained by synthesizing the object with a mirror image obtained by inverting the live video; and changing a display mode of the object to be composited with the live video and the mirror image in accordance with an operation from a distributor on the object in the distributor video; The present invention is characterized by carrying out the following steps.

[0015] A program according to a third aspect of the present disclosure includes: On the computer, Transmitting a viewer's video, which is a video obtained by synthesizing an object into a live video being shot by a shooting unit, for distribution to a viewer terminal; Displaying a video for a distributor in which the object is synthesized with a mirror image obtained by inverting the live video; changing a display mode of the object to be composited with the live video and the mirror image in accordance with an operation from a distributor on the object in the distributor video; The present invention is characterized in that the above-mentioned is executed. Effect of the Invention

[0016] According to the present disclosure, it is possible to appropriately support distributors. [Brief description of the drawings]

[0017] [Figure 1] 1 is a schematic diagram illustrating an example of the overall configuration of a live distribution system according to a first embodiment of the present disclosure. FIG. [Diagram 2] FIG. 1 is a block diagram showing an example of a schematic configuration of a typical information processing device in which a distributor terminal or the like is realized. [Diagram 3] 2 is a block diagram showing an example of a functional configuration of a distribution server. FIG. [Figure 4] FIG. 2 is a block diagram showing an example of a functional configuration of a distributor terminal according to the first embodiment. [Diagram 5] FIG. 13 is a schematic diagram showing an example of how a distributor is photographed. [Figure 6] FIG. 2 is a schematic diagram showing an example of a live video being shot. [Figure 7] FIG. 13 is a schematic diagram showing an example of an image for viewers in which an object is synthesized with a live video. [Figure 8] 11 is a schematic diagram showing an example of a case where a distributor video in which an object is composited with a mirror image video is displayed on a distributor terminal. FIG. [Figure 9] 11 is a schematic diagram showing a state in which an object in a video for a distributor is pinched (pinch out) by the distributor. FIG. [Figure 10]13 is a schematic diagram showing how the size of an object to be composited into a viewer's video changes in response to a distributor's pinch operation. FIG. [Figure 11] 13 is a schematic diagram showing a state in which an object in a video for a distributor is dragged by the distributor. FIG. [Figure 12] 13 is a schematic diagram showing how the position of an object to be composited into a viewer's video changes in response to a distributor's drag operation. FIG. [Figure 13] 4 is a flowchart for explaining a distribution process according to the first embodiment. [Figure 14] FIG. 11 is a schematic diagram illustrating an example of the overall configuration of a live distribution system according to a second embodiment of the present disclosure. [Figure 15] 2 is a block diagram showing an example of a functional configuration of a sales server. FIG. [Figure 16] FIG. 11 is a block diagram showing an example of a functional configuration of a distributor terminal according to the second embodiment. [Figure 17] FIG. 1 is a schematic diagram showing an example of live video footage being shot for live commerce. [Figure 18] FIG. 13 is a schematic diagram showing an example of an image for viewers in which a plurality of objects are combined with a live video. [Figure 19] 11 is a schematic diagram showing an example of a case where a distributor video in which a mirror image video and a plurality of objects are combined is displayed on a distributor terminal. FIG. [Figure 20] 1 is a schematic diagram showing an example of a viewer video displayed on a viewer terminal; [Figure 21] FIG. 13 is a schematic diagram showing an example of a sales page displayed on a viewer terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, an embodiment of the present disclosure will be described in detail with reference to the drawings. In addition, the same or corresponding parts in the drawings are given the same reference numerals. In addition, the following describes a case where a distributor terminal synthesizes an object with a video, but as described later, the present disclosure can be similarly applied to a case where a distribution server synthesizes an object with a video. In other words, the embodiment described below is for the purpose of explanation and does not limit the scope of the present disclosure. Therefore, a person skilled in the art can adopt an embodiment in which each or all of these elements are replaced with an equivalent, and these embodiments are also included in the scope of the present disclosure.

[0019] (Embodiment 1) 1 is a schematic diagram showing an example of the overall configuration of a live streaming system 1 according to a first embodiment of the present disclosure. As an example, this live streaming system 1 includes a streaming server 100 that manages streaming, a streamer terminal 200 used by a streamer, and a viewer terminal 300 used by a viewer, which are connected to each other so as to be able to communicate with each other via the Internet 900. It is assumed that there are a large number of viewer terminals 300, depending on the number of viewers using the system.

[0020] The distribution server 100 is, for example, a server computer or the like, and manages the entire live distribution system 1. The distribution server 100 receives video (video for viewers, described later) sent from the distributor terminal 200, and distributes it to the viewer terminal 300. Note that in the present disclosure, the video includes not only video data but also audio data, and the following description will be given accordingly.

[0021] The distributor terminal 200 is, for example, a terminal such as a smartphone, tablet, or PC (Personal Computer), and is used by a distributor who distributes live video. As described later, the distributor photographs himself / herself using a photographing unit (photographing unit 210 described later) of the distributor terminal 200 and distributes the live video. At that time, a mirror image of the photographed live video is displayed on a display unit (display unit 260 described later), and the distributor can check his / her own actions while looking at the mirror image.

[0022] The viewer terminal 300 is, for example, a smartphone, tablet, PC, or other terminal, and is used by a viewer who watches live streaming. The viewer operates the viewer terminal 300 to log in to the distribution server 100, and then watches the live video distributed from the distributor terminal 200 via the distribution server 100.

[0023] (General configuration of information processing device 400) A typical information processing device 400 in which the distribution server 100 according to the first embodiment of the present disclosure and the distributor terminal 200 and the like are realized will be described.

[0024] As shown in FIG. 2, the information processing device 400 includes a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, a NIC (Network Interface Card) 404, an image processing unit 405, an audio processing unit 406, an auxiliary memory unit 407, an interface 408, a photographing unit 409, an operation unit 410, and a display unit 411.

[0025] A CPU 401 controls the overall operation of the information processing device 400, and is connected to each component to exchange control signals and data.

[0026] The ROM 402 stores an IPL (Initial Program Loader) that is executed immediately after power is turned on. When this IPL is executed, a program stored in the auxiliary memory unit 407 is read into the RAM 403 and execution of the program by the CPU 401 begins.

[0027] The RAM 403 is for temporarily storing data and programs, and holds programs and data read from the auxiliary storage unit 407, as well as other data necessary for communication.

[0028] The NIC 404 is used to connect the information processing device 400 to a computer communication network such as the Internet, and may be configured as a 10BASE-T / 100BASE-T standard used in constructing a LAN (Local Area Network), an analog modem for connecting to the Internet using a telephone line, an ISDN (Integrated Services Digital Network) modem, an ADSL (Asymmetric Digital Subscriber Line) modem, a cable modem for connecting to the Internet using a cable television line, or the like.

[0029] The image processing unit 405 processes image data read from the auxiliary storage unit 407 or the like using an image calculation processor (not shown) provided in the CPU 401 or the image processing unit 405, and then records the processed image data in a frame memory (not shown) provided in the image processing unit 405. The image information recorded in the frame memory is converted into a video signal at a predetermined synchronous timing, and is output to the display unit 411 via the interface 408 or the like. In other words, under the control of the CPU 401, the image processing unit 405 generates images required in the progress of processing performed by the information processing device 400, and causes the display unit 411 to display the images.

[0030] The audio processing unit 406 converts music data and audio data read from the auxiliary storage unit 407, etc., into audio signals and outputs them to the outside via the interface 408, etc. If the information processing device 400 has an internal speaker, the audio processing unit 406 outputs the converted audio signals to the speaker. In other words, under the control of the CPU 401, the audio processing unit 406 generates musical sounds and sounds to be generated during the progress of processing performed by the information processing device 400, and outputs the musical sounds, etc. from an internal or external speaker.

[0031] The auxiliary storage unit 407 is a hard disk, a solid state drive (SSD), or the like, and stores various programs and various data necessary for controlling the operation of the entire information processing device 400. For example, the auxiliary storage unit 407 stores a program for implementing the distributor terminal 200 according to the embodiment, etc. Then, under the control of the CPU 401, the auxiliary storage unit 407 appropriately reads out the stored programs and data, and temporarily stores them in the RAM 403, etc.

[0032] The interface 408 complies with standards such as HDMI (registered trademark), USB (Universal Serial Bus), and I2C (Inter-Integrated Circuit), and is connected to a photographing unit 409, an operation unit 410, and a display unit 411. The interface 408 may transmit and receive necessary information to and from other connected external devices.

[0033] The photographing unit 409 is, for example, a single-focus lens and an image sensor (CMOS: Complementary Metal Oxide Semiconductor or CCD: Charge Coupled Device) with a predetermined number of pixels, and captures still images or moving images.

[0034] The operation unit 410 accepts operation inputs from an operator or the like who uses the information processing device 400 .

[0035] The display unit 411 renders an image according to the image data output by the image processing unit 405 , and displays it to an operator or the like who uses the information processing device 400 .

[0036] Additionally, the information processing device 400 may include a drive unit such as a DVD (Digital Versatile Disc)-ROM instead of the auxiliary storage unit 407. In this case, the information processing device 400 reads out programs and data from a DVD-ROM or the like that is loaded into the drive unit, and operates in the same manner as described above.

[0037] Hereinafter, the functions of the distribution server 100 and the distributor terminal 200 realized in the above-mentioned information processing device 400 will be described with reference to Fig. 3 to Fig. 12. When the information processing device 400 is powered on, a program that causes it to function as the distribution server 100 and the distributor terminal 200 according to the first embodiment is executed, and the distribution server 100 and the distributor terminal 200 according to the first embodiment are realized. Note that the viewer terminal 300 is also realized by the information processing device 400 in the same manner, but since it has almost the same configuration as the distributor terminal 200, a description thereof will be omitted.

[0038] (Functional configuration of distribution server 100) 3 is a block diagram showing an example of a functional configuration of distribution server 100. As shown in the figure, distribution server 100 includes a receiving unit 110, a transmitting unit 120, a storage unit 130, and a control unit 140.

[0039] The receiving unit 110 receives various information sent from the distributor terminal 200 and the viewer terminal 300 via the Internet 900. For example, the receiving unit 110 receives video (video for viewer, described below) sent from the distributor terminal 200. The receiving unit 110 also receives a login request, etc., from the viewer terminal 300. The above-mentioned NIC 404 can function as such a receiving unit 110.

[0040] The transmitting unit 120 transmits various information intended for the viewer terminal 300 and the like via the Internet 900. For example, the transmitting unit 120 is controlled by the control unit 140 (a distribution control unit 142 described later) and distributes the video received from the distributor terminal 200 to the viewer terminal 300. The above-mentioned NIC 404 can function as such a transmitting unit 120.

[0041] The storage unit 130 stores various information necessary for processing in the distribution server 100. For example, the storage unit 130 stores the ID, password, and the like of the viewer who uses the viewer terminal 300. Note that the above-mentioned auxiliary storage unit 407, etc., can function as such a storage unit 130.

[0042] The control unit 140 controls the entire distribution server 100. The control unit 140 includes, for example, a management unit 141 and a distribution control unit 142.

[0043] The management unit 141, for example, compares the ID, password, etc. sent from the viewer terminal 300 requesting login with the ID, password, etc. stored in the storage unit 130, and authenticates the viewer.

[0044] The distribution control unit 142 controls the receiving unit 110 and the transmitting unit 120 to distribute the video received from the distributor terminal 200 to the viewer terminal 300.

[0045] The above-mentioned CPU 401 and the like can function as the control unit 140 having such a configuration.

[0046] (Functional configuration of distributor terminal 200) 4 is a block diagram showing an example of a functional configuration of the broadcaster terminal 200 according to embodiment 1. As shown in the figure, the broadcaster terminal 200 includes a shooting unit 210, a transmitting / receiving unit 220, an operation receiving unit 230, a storage unit 240, a control unit 250, and a display unit 260.

[0047] The photographing section 210 is, for example, a camera arranged inside (on the display section 260 side) of the distributor terminal 200, and photographs the distributor. As an example, as shown in Fig. 5, the distributor terminal 200 supported by a tripod or the like is arranged in front of the distributor DI and photographs the distributor DI. Then, the photographing section 210 outputs the live video LV including the distributor DI as shown in Fig. 6. Note that the above-mentioned photographing unit 409 can function as such a photographing section 210.

[0048] Returning to Fig. 4, the transmission / reception unit 220 transmits and receives various information to and from the distribution server 100 via the Internet 900. For example, the transmission / reception unit 220 is controlled by the control unit 250 (a distribution unit 252 described later) and transmits viewer video described later to the distribution server 100 (distributes it to the viewer terminal 300 via the distribution server 100). Note that the above-mentioned NIC 404 can function as such a transmission / reception unit 220.

[0049] The operation reception unit 230 is a touch panel or a pointing device (such as a mouse), and receives various operations from the distributor. For example, the operation reception unit 230 receives operations for a distributor video (more specifically, an object described later) displayed on the display unit 260. Note that the above-mentioned operation unit 410 can function as such an operation reception unit 230.

[0050] The storage unit 240 stores various information necessary for processing in the distributor terminal 200. For example, the storage unit 240 stores information about an object to be composited into a live video or the like, a composite position of the object, and the like. As an example, the object is a subtitle (banner) containing text information for informing viewers in a live broadcast. The composite position is a position where the object is composited in the live video. In other words, the composite position is defined based on the live video. The above-mentioned auxiliary storage unit 407 or the like can function as such a storage unit 240.

[0051] The control unit 250 controls the entire distributor terminal 200. The control unit 250 includes, for example, a generation unit 251, a distribution unit 252, and a change unit 253.

[0052] The generating unit 251 generates a viewer's video in which an object is composited at a predetermined composite position in the live video captured by the capturing unit 210. For example, the generating unit 251 generates a viewer's video in which an object OJ is composited with the live video LV, as shown in Fig. 7, according to the object information and composite position stored in the storage unit 240. Note that Fig. 7 shows a case in which an object OJ containing simple text information such as "ABC" is composited, but this is for ease of explanation, and in reality, an object OJ containing text information necessary for notifying the viewer is composited.

[0053] At the same time, the generating unit 251 generates a distributor's video in which an object is composited into a mirror image video obtained by inverting the live video. The position where the object is composited into the mirror image video is different from the composite position described above. That is, the generating unit 251 composites the object into the mirror image video at a position of a mirror image relative to the composite position. For example, the generating unit 251 generates a distributor's video in which an object OJ is composited into the mirror image video MV as shown in FIG. 8 according to the information of the object stored in the storage unit 240 and the position of the mirror image relative to the composite position. Note that FIG. 8 shows a state where the distributor's video is displayed on the display unit 260. This allows the distributor DI to normally read the text information of the object OJ composited into the mirror image video MV displayed on the display unit 260, and by normally pointing to the object OJ, the object OJ is correctly pointed to in the viewer's video in FIG. 7 described above. As a result, it is possible to appropriately support the distributor who is performing live distribution.

[0054] Returning to Fig. 4, distribution unit 252 transmits the viewer video generated by generation unit 251 to distribution server 100 for distribution to viewer terminal 300. That is, distribution unit 252 controls transmission / reception unit 220 to transmit the viewer video as shown in Fig. 7 to distribution server 100, and distributes the viewer video to viewer terminal 300 via distribution server 100.

[0055] The change unit 253 changes the display mode of the object to be composited with the live video and the mirror image video in accordance with an operation from the distributor on the object in the distributor video. For example, the change unit 253 changes the size of the object OJ in accordance with a pinch operation on the object OJ in the distributor video as shown in FIG. 8 displayed on the display unit 260. Specifically, when the operation receiving unit 230 receives a pinch out on the object OJ by the distributor (an operation of spreading the fingers while pressing the object OJ with two fingers), the change unit 253 enlarges the size of the object OJ as shown in FIG. 9. Conversely, when the operation receiving unit 230 receives a pinch in on the object OJ by the distributor (an operation of closing the fingers while pressing the object OJ with two fingers), the change unit 253 reduces the size of the object OJ. When the change unit 253 changes the size of the object OJ in the distributor video, the change unit 253 also updates the information of the object stored in the storage unit 240. For example, as shown in FIG. 9, when the size of the object OJ is enlarged, the change unit 253 also increases the value of the object information (for example, display magnification) in the storage unit 240. As a result, the above-mentioned generation unit 251 also enlarges the size of the object and synthesizes it into the live video. That is, the generation unit 251 generates a viewer video in which the enlarged object OJ is synthesized into the live video LV, as shown in FIG. 10. Then, after the distributor releases his / her finger, the generation unit 251 generates a distributor video in which the object OJ is synthesized into the mirror image video MV according to the updated object information, etc., so that the enlarged object OJ is maintained in the distributor video as well.

[0056] Note that the change in the display mode of an object according to such an operation from the distributor is not limited to the size of the object. The change unit 253 may change any of the shape, color, pattern, brightness, and luminance of the object according to the operation from the distributor. In this way, the distributor can directly operate the object in the mirror image displayed on the display unit 260 during distribution to change the display mode of the object according to his / her intention.

[0057] In addition, when an object in the distributor video is moved to a new position by an operation from the distributor, the change unit 253 changes the position of the object to be composited into the live video to a position of a normal image relative to the new position. For example, when the operation reception unit 230 receives a drag operation on the object OJ (an operation of moving the object OJ while pressing it with a finger), the change unit 253 moves the object OJ to a new position according to the drag operation, as shown in FIG. 11. Note that when the change unit 253 moves the object OJ in the distributor video, it also updates the composite position of the object stored in the storage unit 240. Specifically, the change unit 253 changes the composite position to a position of a normal image relative to the new position of the object OJ moved in the distributor video. As a result, the generation unit 251 generates a viewer video in which the object OJ is appropriately moved and composited with respect to the live video LV, as shown in FIG. 12. Then, after the distributor releases his / her finger, the generation unit 251 generates a distributor video in which the object OJ is composited at the mirror image position in the mirror image video MV relative to the updated composite position, so that the position of the moved object OJ is maintained in the distributor video as well. In this way, the distributor can freely move an object in the mirror image video displayed on the display unit 260 by directly operating the object during distribution.

[0058] The above-mentioned CPU 401 and the like can function as the control unit 250 having such a configuration.

[0059] Returning to Fig. 4, the display unit 260 displays the video for distributor generated by the above-mentioned generation unit 251 etc. In other words, the display unit 260 displays the video for distributor as shown in Figs. 8, 9, and 11.

[0060] (Operation of distributor terminal 200) The operation of the distributor terminal 200 will be described below with reference to Fig. 13. Fig. 13 is a flowchart for explaining the distribution process according to the first embodiment. This distribution process starts when the distributor starts live distribution and ends when the live distribution ends. In other words, the distribution process is executed by the distributor terminal 200 throughout the entire time the live distribution is being performed.

[0061] First, the distributor terminal 200 generates a viewer video by compositing an object at a compositing position of the captured live video (step S11). That is, the control unit 250 (the generation unit 251) generates a viewer video by compositing an object OJ with the live video LV according to the information of the object and the compositing position stored in the storage unit 240, as shown in FIG. 7 described above.

[0062] The distributor terminal 200 generates a distributor video by compositing an object at a mirror image position relative to the composition position in the mirror image video (step S12). That is, the control unit 250 (generation unit 251) generates a distributor video by compositing an object OJ with the mirror image video MV according to the information of the object stored in the storage unit 240 and the position of the mirror image relative to the composition position, as shown in FIG. 8 described above.

[0063] The distributor terminal 200 distributes the viewer's video and displays the distributor's video on the display unit 260 (step S13). That is, the control unit 250 (distribution unit 252) transmits the viewer's video generated in the above-mentioned step S11 to the distribution server 100 for distribution to the viewer terminal 300. That is, the control unit 250 controls the transmission / reception unit 220 to transmit the viewer's video as shown in the above-mentioned FIG. 7 to the distribution server 100, and distributes the viewer's video to the viewer terminal 300 via the distribution server 100. Also, the display unit 260 displays the distributor's video generated in the above-mentioned step S12. That is, the display unit 260 displays the distributor's video as shown in the above-mentioned FIG. 8. As a result, the distributor DI can normally read the text information of the object OJ superimposed on the mirror image video MV, and by normally pointing to the object OJ, the object OJ is correctly pointed to in the viewer's video in FIG. 7. As a result, it is possible to appropriately support the distributor who is live streaming.

[0064] The distributor terminal 200 determines whether or not an operation has been performed on the object (step S14). That is, the control unit 250 determines whether or not an operation has been received by the operation receiving unit 230 for an object in the distributor video displayed on the display unit 260.

[0065] If the distributor terminal 200 determines that no operation has been performed on the object (step S14; No), the distributor terminal 200 returns the process to the above-mentioned step S11.

[0066] On the other hand, when it is determined that an operation has been performed on the object (step S14; Yes), the distributor terminal 200 determines whether the operation is a pinch operation or not (step S15).

[0067] When the distributor terminal 200 determines that the operation is a pinch operation (step S15; Yes), it changes the size of the object (step S16). That is, the control unit 250 (change unit 253) changes the size of the object in response to the pinch operation on the object in the distributor video. Specifically, if the pinch operation is on the object, the control unit 250 enlarges the size of the object OJ as shown in FIG. 9 described above. Conversely, if the pinch operation is on the object, the control unit 250 reduces the size of the object. When the control unit 250 changes the size of the object in the distributor video, it also updates the information of the object stored in the storage unit 240. For example, as shown in FIG. 9, when the size of the object OJ is enlarged, the control unit 250 also increases the value of the information of the object in the storage unit 240. As a result, the control unit 250 enlarges the size of the object in the live video and synthesizes it. That is, the control unit 250 generates a viewer video in which the enlarged object OJ is synthesized with the live video LV as shown in FIG. 10 described above. Then, after the broadcaster releases his / her finger, the control unit 250 will generate an image for the broadcaster in which the object is combined with the mirror image in accordance with the updated object information, etc., so that the enlarged object will be maintained in the image for the broadcaster as well.

[0068] After changing the size of the object in this way, the distributor terminal 200 returns the process to step S11 described above.

[0069] On the other hand, if it is determined that the operation is not a pinch operation (step S15; No), the distributor terminal 200 determines whether or not the operation is a drag operation (step S17).

[0070] If the distributor terminal 200 determines that the operation is not a drag operation (step S17; No), the distributor terminal 200 returns the process to the above-mentioned step S11.

[0071] On the other hand, when it is determined that the operation is a drag operation (step S17; Yes), the broadcaster terminal 200 changes the composite position of the object (step S18). That is, the control unit 250 (changing unit 253) moves the object OJ in the broadcaster video to a new position according to the drag operation, as shown in FIG. 11. When the control unit 250 moves the object OJ in the broadcaster video, it also updates the composite position of the object stored in the storage unit 240. Specifically, the control unit 250 changes the composite position to a position of a normal image relative to the new position of the object OJ moved in the broadcaster video. As a result, the control unit 250 (generating unit 251) generates a viewer video in which the object OJ is appropriately moved and composited with respect to the live video LV, as shown in FIG. 12. Then, after the broadcaster releases his / her finger, the control unit 250 generates a broadcaster video in which the object is composited at the position of the mirror image in the mirror image video relative to the updated composite position, so that the position of the moved object is maintained in the broadcaster video.

[0072] After changing the composite position of the object in this way, the distributor terminal 200 returns the process to step S11 described above.

[0073] In the distribution process shown in FIG. 13, the size of an object is changed in response to a pinch operation from the distributor. However, in addition to the size of the object, any of the shape, color, pattern, brightness, or luminance of the object may also be changed.

[0074] By this distribution process, the object OJ is composited at an appropriate position in the mirror image video MV as shown in Fig. 8, so the distributor can read the text information of the object OJ normally, and by pointing at the object OJ normally, the object OJ is also correctly pointed to in the viewer video of Fig. 7. As a result, it is possible to appropriately support the distributor who is live streaming.

[0075] Furthermore, the distribution process enables the distributor to directly operate an object in the mirror image displayed on the display unit 260 during distribution, thereby changing the display state of the object to one that meets the distributor's intention.

[0076] Furthermore, the distribution process allows an object in the mirror image displayed on display unit 260 to be directly operated during distribution, allowing the object to be moved freely.

[0077] (Embodiment 2) In the above embodiment 1, a simple live distribution system 1 has been described, but a live distribution system that supports live commerce may also be used. A live distribution system that supports live commerce will be described below.

[0078] 14 is a schematic diagram showing an example of the overall configuration of a live streaming system 2 according to the second embodiment of the present disclosure. This live streaming system 2 is a system compatible with live commerce, and as an example, a streaming server 100 that manages streaming, a sales server 500 that manages sales, a broadcaster terminal 600 used by broadcasters, and a viewer terminal 300 used by viewers are communicatively connected via the Internet 900. Note that the streaming server 100 and the viewer terminal 300 have the same configuration as the streaming server 100 and the viewer terminal 300 in the live streaming system 1 of FIG. 1 described above. It is assumed that a large number of viewer terminals 300 exist according to the number of viewers using the system.

[0079] The sales server 500 is, for example, a server computer, and sells the product introduced by the distributor during distribution from the distributor terminal 600. More specifically, the sales server 500 sells the product to the viewer terminal 300 (viewer) who has transitioned to the sales server 500 (more specifically, the product sales page) according to transition information.

[0080] The distributor terminal 600 is, for example, a smartphone, tablet, PC, or other terminal, and is used by a distributor who distributes live video. The distributor terminal 600 distributes to the viewer terminal 300 a viewer video in which an object (a purchase button described later) to which transition information for purchasing a product introduced in the distribution is added is mixed with the live video.

[0081] Hereinafter, the functions of the sales server 500 and the distributor terminal 600 realized in the information processing device 400 of Fig. 2 described above will be described with reference to Fig. 15 to Fig. 19. When the information processing device 400 is powered on, a program that causes the information processing device 400 to function as the sales server 500 and the distributor terminal 600 according to the second embodiment is executed, and the sales server 500 and the distributor terminal 600 according to the second embodiment are realized.

[0082] (Functional configuration of sales server 500) 15 is a block diagram showing an example of a functional configuration of sales server 500. As shown in the figure, sales server 500 includes a transmission / reception unit 510, a storage unit 520, and a control unit 530.

[0083] The transmitting / receiving unit 510 transmits and receives various information to and from the viewer terminal 300 via the Internet 900. For example, the transmitting / receiving unit 510 transmits a product sales page to the viewer terminal 300 in response to an access from the viewer terminal 300 in accordance with the transition information. The above-mentioned NIC 404 can function as such a transmitting / receiving unit 510.

[0084] The storage unit 520 stores various information necessary for processing in the sales server 500. For example, the storage unit 520 stores detailed information, price information, and inventory information about the products being sold. The storage unit 520 also stores personal information (ID, name, address, credit card number, etc.) of the viewer using the viewer terminal 300. Note that the above-mentioned auxiliary storage unit 407, etc., can function as such a storage unit 520.

[0085] The control unit 530 controls the entire sales server 500. The control unit 530 includes, for example, a sales processing unit 531.

[0086] The sales processing unit 531 confirms the sale of the product in accordance with an operation from the viewer terminal 300 (viewer) who has viewed the product sales page.

[0087] The above-mentioned CPU 401 and the like can function as the control unit 530 having such a configuration.

[0088] (Functional configuration of distributor terminal 600) Fig. 16 is a block diagram showing an example of a functional configuration of a broadcaster terminal 600 according to the second embodiment. As shown in the figure, the broadcaster terminal 600 includes a photographing unit 210, a transmitting / receiving unit 220, an operation receiving unit 230, a storage unit 640, a control unit 650, and a display unit 260. The photographing unit 210, the transmitting / receiving unit 220, the operation receiving unit 230, and the display unit 260 have the same configuration as the photographing unit 210, the transmitting / receiving unit 220, the operation receiving unit 230, and the display unit 260 in the broadcaster terminal 200 of Fig. 4 described above. The photographing unit 210 outputs a live video LV including a product PD to be introduced and a broadcaster DI as shown in Fig. 17.

[0089] Returning to Fig. 16, the storage unit 640 stores various information necessary for processing in the broadcaster terminal 600. For example, the storage unit 640 stores transition information for purchasing a product introduced during broadcasting, in addition to information about an object to be composited into live video footage, etc., and the composite position of the object. For example, the transition information is link information to a sales page of the corresponding product in the sales server 500. Note that the above-mentioned auxiliary storage unit 407, etc., can function as such a storage unit 640.

[0090] The control unit 650 controls the entire distributor terminal 600. The control unit 650 includes, for example, an addition unit 651, a generation unit 251, a distribution unit 252, and a change unit 253. The generation unit 251, the distribution unit 252, and the change unit 253 have the same configurations as the generation unit 251, the distribution unit 252, and the change unit 253 in the distributor terminal 200 (control unit 250) in FIG. 4 described above.

[0091] The adding unit 651 adds transition information of a product being introduced during distribution to a specific object (for example, a purchase button) stored in the storage unit 640. When transition information of a product that has already been introduced has been added to an object, the adding unit 651 overwrites the transition information of the product currently being introduced and adds it to the object. When an object to which such transition information has been added is tapped on the viewer terminal 300, a transition to the sales page of the corresponding product in the sales server 500 can be made.

[0092] The generating unit 251 then generates a viewer's video by compositing a necessary object at a predetermined compositing position in the live video captured by the capturing unit 210. For example, the generating unit 251 generates a viewer's video by compositing objects OJ1 and OJ2 with the live video LV as shown in FIG. 18 according to the object information and compositing position stored in the storage unit 640. The object OJ1 is a subtitle (banner) for explaining the product PD, and includes text information such as the product name and price. The object OJ2 is a purchase button, and includes text information of "purchase" and transition information added by the adding unit 651.

[0093] At the same time, the generating unit 251 generates a distributor's video in which an object is synthesized into a mirror image video inverted from the live video. For example, the generating unit 251 generates a distributor's video in which objects OJ1 and OJ2 are synthesized into a mirror image video MV as shown in FIG. 19 according to the information of the object stored in the storage unit 640 and the position of the mirror image relative to the synthesis position. Note that FIG. 19 shows a state in which the distributor's video is displayed on the display unit 260. This allows the distributor DI to normally read the text information of the objects OJ1 and OJ2 synthesized into the mirror image video MV displayed on the display unit 260, and by normally pointing out the objects OJ1 and OJ2, the objects OJ1 and OJ2 are correctly pointed out in the viewer's video in FIG. 18 described above. As a result, it is possible to appropriately support the distributor who is performing live streaming.

[0094] The change unit 253 changes the display mode of an object to be composited into the live video and the mirror image video in accordance with an operation from the distributor on the object in the distributor video, similar to the above-described embodiment 1. Also, when an object in the distributor video is moved to a new position by an operation from the distributor, the change unit 253 changes the object to be composited into the live video to a position of a normal image relative to the new position, similar to the above-described embodiment 1.

[0095] The above-mentioned CPU 401 and the like can function as the control unit 650 having such a configuration.

[0096] (Operation on viewer terminal 300) Hereinafter, the operation of the viewer at the viewer terminal 300 will be described with reference to FIG. 20 and FIG.

[0097] When the viewer video is distributed from the distributor terminal 600, the viewer terminal 300 displays the viewer video on the display unit, for example, as shown in Fig. 20. If the viewer wishes to purchase the product PD introduced during the distribution, the viewer taps the object OJ2.

[0098] When the viewer taps on the object OJ2, the viewer terminal 300 accesses the sales server 500 according to the transition information added to the object OJ2, and displays a sales page SP on the display unit as shown in Fig. 21. Before displaying the sales page, the viewer terminal 300 may display an authentication screen for logging in to the sales server 500. Then, when the purchase is confirmed on the sales page SP, the sale is completed.

[0099] In this way, even with the live distribution system 2 compatible with live commerce, the distributor can normally read the text information of the objects OJ1, OJ2 composited into the mirror image video MV as shown in Fig. 19 displayed on the display unit 260, and by normally pointing to the objects OJ1, OJ2, the objects OJ1, OJ2 are correctly pointed to in the viewer video of Fig. 18. As a result, it is possible to appropriately support the distributor who is conducting live distribution.

[0100] (Other embodiments) In the above-mentioned first and second embodiments, the control unit 250, 650 of the distributor terminal 200, 600 includes the generating unit 251, etc., and the distributor terminal 200, 600 has been described as compositing an object with a live video and a mirror image video. However, the same configuration as the generating unit 251, etc. may be added to the control unit 140 of the distribution server 100. In this case, the distribution server 100 side composites the object with the live video and the mirror image video, and the distributor terminal 200, 600 displays the distributor video returned from the distribution server 100 on the display unit 260. In this case, the distributor can also normally read the text information of the object composited with the mirror image video displayed on the display unit 260, and by normally pointing to the object, the object is correctly pointed to in the viewer video. As a result, the distributor who is performing live distribution can be appropriately supported.

[0101] In the above first and second embodiments, the case where an object containing text information is synthesized with a live video and a mirror image has been described, but the present invention can also be applied appropriately to the case where an object containing multiple images is synthesized with a live video and a mirror image. Specifically, when synthesizing an object of two bottle images with a live video and a mirror image, the distributor can check the object images and correctly explain, with the order of the objects as they are, that "the one on the right is a salt bottle, and the one on the left is a pepper bottle."

[0102] In the above-mentioned first and second embodiments, the programs executed by the distributor terminals 200, 600, etc. can be stored and distributed in computer-readable recording media such as CD-ROMs (Compact Disc Read Only Memory), DVDs (Digital Versatile Discs), MOs (Magneto-Optical Disks), USB memories, memory cards, etc. By installing such programs in a specific or general-purpose computer, the computer can function as the distributor terminals 200, 600 in the above-mentioned first and second embodiments.

[0103] The above-mentioned program may also be stored in a disk device of a server device on a communication network such as the Internet, and downloaded to a computer by, for example, superimposing the program on a carrier wave. The above-mentioned processing can also be achieved by starting and executing the program while transferring it via the communication network. Furthermore, the above-mentioned processing can also be achieved by executing all or a part of the program on a server device, and executing the program while the computer transmits and receives information related to the processing via the communication network.

[0104] In addition, when the above-mentioned functions are shared and realized by the OS (Operating System) or by the OS working together with an application, etc., only the parts other than the OS may be stored on the above-mentioned recording medium and distributed, or may be downloaded to a computer.

[0105] [1] transmitting a viewer video for distribution to a viewer terminal, the viewer video being a video in which an object is composited at a predetermined composite position within a live video being captured by a capture unit; displaying a distributor's video in which the object is composited with a mirror image obtained by inverting the live video, the mirror image being a composite image of the object at a mirror image position relative to the composite position; a processor executing A distributor terminal comprising: [2] The processor, and further executing a change in a display mode of the object to be composited with the live video and the mirror image in accordance with an operation by the distributor on the object in the distributor video. The distributor terminal according to [1], [3] The change in the display mode includes a change in at least one of the size, shape, color, pattern, brightness, and luminance of the object. The distributor terminal according to [2], [4] The processor, When the object in the distributor video is moved to a new position by an operation from the distributor, the control unit 101 further executes changing the position of the object to be composited into the live video to a position of a normal image relative to the new position. A distributor terminal according to any one of [1] to [3], [5] The object is added with transition information for transitioning to a sales server that sells the product. A distributor terminal according to any one of [1] to [4], [6] The object includes text information. A distributor terminal according to any one of [1] to [5], [7] The computer transmitting a viewer video for distribution to a viewer terminal, the viewer video being a video in which an object is composited at a predetermined composite position within a live video being captured by a capture unit; displaying a distributor's video in which the object is composited with a mirror image obtained by inverting the live video, the mirror image being a video in which the object is composited at a position that is a mirror image of the composite position; A display method comprising: [8] On the computer, Transmitting a viewer's video, which is a video obtained by compositing an object at a predetermined compositing position within a live video being shot by a shooting unit, for distribution to a viewer terminal; displaying a distributor's video in which the object is composited with a mirror image obtained by inverting the live video, the mirror image being a position of a mirror image of the composite position; A computer-readable program that records a program for executing a program. [Industrial Applicability]

[0106] The present disclosure can be suitably adopted in a distributor terminal, a display method, and a program that can appropriately support distributors. [Explanation of symbols]

[0107] 1,2 Live streaming system 100 Distribution Server 110 Receiving unit 120 Transmitter 130 Storage section 140 Control section 141 Management Department 142 Distribution control section 200,600 broadcaster terminals 210 Photography Department 220 Transmitter / receiver 230 Operation reception section 240,640 storage section 250,650 Control section 251 Generation part 252 Distribution Department 253 Changes 651 Additional section 260 Display 300 Viewer terminals 400 Information processing device 401 CPU 402 ROM 403 RAM 404 NIC 405 Image Processing Unit 406 Audio Processing Unit 407 Auxiliary storage 408 Interface 409 Photography Unit 410 Operation Unit 411 Display unit 500 Sales Server 510 Transmitter / receiver 520 Storage section 530 Control Unit 531 Sales Department 900 Internet

Claims

1. transmitting a viewer video for distribution to a viewer terminal, the viewer video being a live video being captured by a capture unit and an object being composited into the live video; displaying a distributor's video obtained by synthesizing the object with a mirror image obtained by inverting the live video; and changing a display mode of the object to be composited with the live video and the mirror image in accordance with an operation from a distributor on the object in the distributor video; a processor executing A distributor terminal comprising:

2. The change in the display mode includes a change in at least one of the size, shape, color, pattern, brightness, and luminance of the object.

2. The distributor terminal according to claim 1 .

3. The processor, When the object in the distributor video is moved to a new position by an operation from the distributor, the control unit 101 further executes changing the position of the object to be composited into the live video to a position of a normal image relative to the new position.

3. The distributor terminal according to claim 1 or 2.

4. The object is added with transition information for transitioning to a sales server that sells the product.

3. The distributor terminal according to claim 1 or 2.

5. The object includes text information.

3. The distributor terminal according to claim 1 or 2.

6. The object in the video for distributor is composited at a mirror image position with respect to a composite position of the object in the video for viewer.

3. The distributor terminal according to claim 1 or 2.

7. The computer transmitting a viewer video for distribution to a viewer terminal, the viewer video being a live video being captured by a capture unit and an object being composited into the live video; displaying a distributor's video obtained by synthesizing the object with a mirror image obtained by inverting the live video; and changing a display mode of the object to be composited with the live video and the mirror image in accordance with an operation from a distributor on the object in the distributor video; A display method comprising:

8. On the computer, Transmitting a viewer's video, which is a video obtained by synthesizing an object into a live video being shot by a shooting unit, for distribution to a viewer terminal; Displaying a video for a distributor in which the object is synthesized with a mirror image obtained by inverting the live video; changing a display mode of the object to be composited with the live video and the mirror image in accordance with an operation from a distributor on the object in the distributor video; A program for executing.

Images