Distribution system, live distribution device, live distribution method and program

Abstract

To provide a broadcast system, a live broadcast device, a live broadcast method and a program which allow a product sold by a live broadcaster to be easily recognized using a user terminal by a simple operation.SOLUTION: A broadcast system 1 comprises a broadcaster terminal 3 and a live broadcast device 2. The broadcaster terminal 3 comprises a first camera 321 and a second camera 322, and uses the first camera 321 to acquire a content for live broadcasting. The live broadcast device 2 uses the content acquired from the broadcaster terminal 3 to broadcast live to a user terminal 4. The broadcast system 1 comprises an image processing unit 22 that causes the user terminal 4 to display images. The image processing unit 22 causes the user terminal 4 to display video captured by the first camera 321 as live broadcast video, and to display an image of a product captured by the second camera 322 together with the live broadcast video after assigning thereto product information corresponding to the product.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a distribution system, a live distribution device, a live distribution method, and a program. [Background technology]

[0002] For some time now, live distribution has been used to sell products to users as viewers in real time, by live broadcasting the purchase of products or live broadcasting used or new products owned at home in a manner similar to television shopping. For example, live distribution is performed using the video distribution system described in Patent Document 1.

[0003] A distributor introduces a product through live distribution, and users who watch the product can use a comment field that can be sent to the distributor during the live distribution to leave a comment indicating their intention to purchase the product. After the live distribution ends, the distributor can review the history of the comment field and use, for example, a direct mail function of an application to process the delivery of the product.

[0004] In this way, by using the video distribution system described in Patent Document 1, even individuals who do not have broadcasting facilities like a television station can easily sell products in a manner similar to television shopping. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 6550549 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the video distribution system described in Patent Document 1 has a problem in that it is difficult for users to understand what products a distributor is selling during live distribution.

[0007] The present invention has been made in consideration of the above-mentioned circumstances, and its object is to provide a distribution system, a live streaming device, a live streaming method, and a program that enable products sold by live streamers to be easily viewed on a user terminal with simple operations. [Means for solving the problem]

[0008] A live streaming system according to one aspect of the present invention includes a broadcaster terminal and a live streaming device. The broadcaster terminal has a first camera and a second camera, and acquires content for live streaming using the first camera. The live streaming device performs live streaming to a user terminal using the content acquired from the broadcaster terminal. The live streaming system includes an image processing unit that causes the user terminal to display an image. The image processing unit causes the user terminal to display a moving image captured by the first camera as a moving image for live streaming, and causes an image of an item captured by the second camera to be assigned item information corresponding to the item and then displayed together with the moving image for live streaming.

[0009] A live streaming device according to one aspect of the present invention uses a broadcaster terminal having a first camera and a second camera to broadcast live to a user terminal using content acquired via the first camera. The live streaming device has an image processing unit that displays images on the user terminal. The image processing unit displays a video captured by the first camera on the user terminal as a video for live streaming, and displays an image of an item captured by the second camera together with the video for live streaming after allocating item information corresponding to the item.

[0010] A live streaming method according to one aspect of the present invention is a live streaming method in which a distributor terminal having a first camera and a second camera performs live streaming to a user terminal using content acquired via the first camera, the live streaming method displays a video captured by the first camera on the user terminal as a video for live streaming, and displays an image of an item captured by the second camera together with the video for live streaming after assigning item information corresponding to the item to the image.

[0011] A program according to one aspect of the present invention causes a computer to function as a distributor terminal having a first camera and a second camera, so as to execute live streaming to a user terminal using content acquired via the first camera. The program causes the computer to function as an image processing unit that displays images on the user terminal, and the processing unit displays a moving image captured by the first camera on the user terminal as a moving image for live streaming, and displays an image of an item captured by the second camera together with the moving image for live streaming after allocating item information corresponding to the item. Effect of the Invention

[0012] The distribution system, live distribution device, live distribution method, and program of the present invention have the advantage that products sold by live distributors can be easily displayed on a user terminal with simple operations. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a schematic configuration diagram of a distribution system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing a hardware configuration of the distribution system. [Diagram 3] FIG. 3 is a block diagram showing a functional configuration of the distribution system. [Figure 4] FIG. 4 is a front view showing a user terminal during live distribution in the distribution system. [Diagram 5] FIG. 5 is a block diagram showing a functional configuration of an image processing unit of the distribution system. [Figure 6] 6A and 6B are front views of a user terminal on which a purchase display section is displayed. [Figure 7] FIG. 7 is a diagram illustrating a state in which a user terminal is notified of a purchase in the distribution system according to the above embodiment. [Figure 8] FIG. 8 is a flow chart showing an example of an operation for creating a purchase button in the distribution system. [Figure 9] FIG. 9 is a flowchart showing an example of an operation performed by a user when making a purchase in the distribution system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] (1) Implementation form

[0015] The distribution system 1 according to this embodiment will be described in detail below.

[0016] (1.1) System Configuration

[0017] Fig. 1 is a diagram showing an example of the configuration of a distribution system 1 according to this embodiment. As shown in Fig. 1, the distribution system 1 includes a live distribution device 2, a payment server 5, a distributor terminal 3, and a plurality of user terminals 4. The live distribution device 2, the payment server 5, the distributor terminal 3, and the plurality of user terminals 4 are connected to each other via a network 7 so as to be able to transmit and receive data to and from each other. The network 7 is configured, for example, by the Internet, a dedicated communication line (for example, a CATV (Community Antenna Television) line), a mobile communication network (including base stations, etc.), a gateway, etc., or a combination of these.

[0018] The distributor terminal 3 is a communication terminal device owned by a person who performs live distribution and used to obtain content for live distribution. The distributor terminal 3 is preferably a portable communication terminal. Examples of portable communication terminals include smartphones, tablet terminals, PDAs (Personal Digital Assistants), mobile phones, and notebook PCs (Personal Computers), as well as wearable terminals such as smart watches and smart glasses. The distributor terminal 3 according to this embodiment is a smartphone.

[0019] The distributor terminal 3 includes a first camera 321 (FIG. 3) and a second camera 322 (FIG. 3). The first camera 321 is a front camera (in-camera), and in this embodiment, captures an image in the thickness direction of the smartphone from the back to the front (the surface on the display side). The second camera 322 is a rear camera (main camera), and captures an image in the direction from the front to the back. In the distributor terminal 3, image data captured by the first camera 321 and / or the second camera 322 is transmitted to the live streaming device 2 via the network 7.

[0020] In the distribution system 1, the live streaming device 2 uses content obtained from the distributor terminal 3 to perform live streaming to multiple user terminals 4. The live streaming device 2 is a server device. It is preferable that the live streaming device 2 is a server device for so-called cloud computing using, for example, a PC (Personal Computer) such as a PC / AT compatible machine or a MAC standard machine, a dedicated machine, a blade server, or the like.

[0021] Here, "live distribution" in this specification refers to a technology for distributing video images captured by the distributor terminal 3 to the user terminal 4 in real time by live streaming. The live distribution performed by the live distribution device 2 may adopt a registration system that limits the target users to specific users, or may target an unlimited number of users.

[0022] The payment server 5 is a server device that checks whether the card information entered by the user terminal 4 is correct and executes the payment process. When the user terminal 4 instructs the purchase of a product, the payment server 5 checks the validity of the card information such as a credit card or debit card, and executes the payment process. The card information is information such as the subscriber's name, card number, expiration date, and security code. When the payment process is completed, the payment server 5 displays a payment completion page to the user terminal 4 that is attempting to make the purchase.

[0023] The user terminal 4 is a terminal device owned by a user who uses the distribution system 1 to watch live distribution. Examples of the user terminal 4 include a smartphone, a tablet terminal, a PDA (Personal Digital Assistant), a mobile phone, a notebook PC (Personal Computer), a desktop PC, and an Internet TV.

[0024] The user terminal 4 and the broadcaster terminal 3 store application programs (hereinafter, sometimes referred to as apps) for using the services provided by the live streaming device 2. In the services, the apps execute, for example, displaying live streaming videos, displaying purchase screens, and processing payments. By executing the apps, the user terminal 4 and the broadcaster terminal 3 access the live streaming device 2 and the payment server 5, respectively, to transmit and receive information used to execute the apps.

[0025] (1.2) Hardware Configuration

[0026] Each of the live streaming device 2, the payment server 5, the broadcaster terminal 3, and the multiple user terminals 4 is realized by a computer 6 as shown in FIG. 2. The computer 6 includes a processor 61, a memory 62, a storage 63, an input / output interface (input / output I / F 64), and a communication interface (communication I / F 65). The processor 61, the memory 62, the storage 63, the input / output I / F 64, and the communication I / F 65 are connected to each other via a bus 66. The streaming system 1 can realize various functions through cooperation between the processor 61, the memory 62, the storage 63, the input / output I / F 64, and the communication I / F 65. The live streaming device 2, the payment server 5, the broadcaster terminal 3, and the multiple user terminals 4 all have approximately the same hardware configuration.

[0027] The processor 61 executes various functions according to programs stored in the storage 63. Examples of the processor 61 include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and a microprocessor.

[0028] The memory 62 temporarily stores a program read from the storage 63, and provides a working area for the processor 61. Examples of the memory 62 include a random access memory (RAM) and a read only memory (ROM).

[0029] The storage 63 stores programs. Examples of the storage 63 include a hard disk drive (HDD), a solid state drive (SSD), and a flash memory.

[0030] The input / output I / F 64 includes an input device for inputting various operations to the computer 6 and an output device for outputting processing results processed by the computer 6. The input / output I / F 64 may have the input device and the output device housed in a single housing, or each may be housed in a separate housing.

[0031] The input device is a device for inputting information to the processor 61. Examples of the input device include a touch panel, a touch display, hardware keys such as a keyboard, a pointing device such as a mouse, a camera, a microphone, and the like.

[0032] The output device is a device capable of outputting the processing result processed by the processor 61. When the processing result is output as an image or a video, the output device is a device capable of displaying the display data according to the display data written in the frame buffer. Examples of the output device include a touch panel, a touch display, a liquid crystal display, a head mounted display, a projector, a hologram, a projection mapping, a speaker, a printer, etc.

[0033] The communication I / F 65 transmits and receives various data via the network 7. Communication by the communication I / F 65 is performed wired or wirelessly. For example, the communication I / F 65 of the user terminal 4 communicates with the live streaming device 2 and the payment server 5 via the network 7, and the communication I / F 65 of the broadcaster terminal 3 communicates with the live streaming device 2 via the network 7. Information received here is transmitted to the processor 61.

[0034] (1.3) Functional Configuration

[0035] 3 is a block diagram showing an example of the functional configuration of the distribution system 1 according to this embodiment. Below, the functional configurations of the live distribution device 2, the distributor terminal 3, the user terminal 4, and the payment server 5 will be described in order.

[0036] (1.3.1) Live Streaming Devices

[0037] As shown in FIG. 3, the live distribution device 2 includes a communication unit 21, an image processing unit 22, a chat unit 23, a payment unit 24, a user information storage unit 25, and a distribution unit 26.

[0038] The communication unit 21 is connected to the distributor terminal 3, the user terminal 4, and the payment server 5 so as to be able to transmit data bidirectionally (i.e., be able to communicate with them). The communication unit 21 is connected to the image processing unit 22, the chat unit 23, the payment unit 24, and the distribution unit 26 so as to be able to input and output data.

[0039] The image processing unit 22 processes image data captured by the distributor terminal 3 to generate a video for live streaming, and displays the video for live streaming on the display unit 44 of the user terminal 4. When information related to the content transmitted from the distributor terminal 3 is input via the communication unit 21, the image processing unit 22 converts the information into a bit rate and video file suitable for live streaming. Then, the image processing unit 22 obtains destination information of the user terminal 4 that should perform live streaming from the distribution unit 26, and transmits data of the video for live streaming via the communication unit 21 to the user terminal 4 requesting the live streaming.

[0040] The term "image" used here means an image that is displayed on a display as a result of processing by the processor 61, and includes both still images and moving images.

[0041] The chat unit 23 may carry out a chat between the user terminal 4 and the broadcaster terminal 3 while broadcasting the video for live streaming. The chat unit 23 displays text information input from the user terminal 4 or the broadcaster terminal 3 on the display unit 44 of the user terminal 4 and the display unit 34 of the broadcaster terminal 3. For example, as shown in Fig. 4, the chat unit 23 displays the text input by the user terminal 4 and ID information of the user terminal 4 in a chat display area 81, and the chat display area 81 is superimposed on the video for live streaming. However, in the present invention, the display area 82 of the video for live streaming and the chat display area 81 may be displayed in separate locations.

[0042] It is preferable that chats are displayed in the chat display area 81 in chronological order in the vertical direction. In this embodiment, the most recently entered text information is displayed at the bottom. Also, it is preferable that the text information is displayed in order from the most recent (in the figure, five columns are displayed) rather than displaying all text information. In this case, all text information can be checked by swiping the chat display area 81 in the vertical direction to scroll the chat. This allows the broadcaster to check the user's requests, impressions, or questions while broadcasting live, and to communicate in real time.

[0043] Upon request from the user terminal 4 of the user who has decided to purchase, the settlement unit 24 transmits user information and product price information to the settlement server 5 and executes a settlement request. Upon receiving a settlement request from the settlement unit 24, the settlement server 5 checks the validity of the credit card and / or inquires about the credit balance.

[0044] The intention to purchase is expressed by pressing a purchase button 83 (FIG. 4) displayed on the user terminal 4. The purchase button 83, which will be described later, is created using a product image captured by the second camera 322 of the broadcaster terminal 3, and is displayed on the display unit 44 of the user terminal 4. When the user presses the purchase button 83 displayed on the display unit 44 of the user terminal 4, the live broadcasting device 2 executes the payment for the product, and the payment server 5 displays a message indicating that the payment has been completed, and the payment is completed.

[0045] As used herein, "press" includes, for example, using purchase button 83 as an example, tapping the part corresponding to purchase button 83, using a mouse to move the cursor over the part corresponding to purchase button 83 and click (double-click or single-click), and using a directional key or the like to move the cursor over purchase button 83 and press the Enter key.

[0046] User information is stored in advance in the user information storage unit 25. The user information is information in which card information and ID information are associated with each other. In response to a request from the user terminal 4, the payment unit 24 refers to the ID information corresponding to the user terminal 4, acquires the user information from the user information storage unit 25, and executes a request for payment to the payment server 5.

[0047] The distribution unit 26 distributes the live streaming moving image generated by the image processing unit 22 and the chat displayed by the chat unit 23 to the user terminal 4 that has accessed the live streaming device 2. The distribution unit 26 distributes the live streaming moving image and chat via the communication unit 21. As described above, the user terminal 4 that accesses the live streaming device 2 may be registered or may be open to the public.

[0048] The live streaming device 2 according to this embodiment generates a video for live streaming using the image processing unit 22, and as shown in Fig. 4, a purchase button 83 generated by the broadcaster in real time can be displayed together with the video for live streaming. As a result, for example, in the past, a user would express their intention to purchase using chat, and after the live streaming, the broadcaster would check the chat history to confirm the intention to purchase, but with the live streaming device 2 according to this embodiment, payment processing can be performed in real time. The image processing unit 22 will be described in more detail below.

[0049] As shown in FIG. 5, the image processing unit 22 includes a distribution moving image generating unit 221, a purchase button generating unit 222, a product information acquiring unit 223, a purchase screen display unit 224, a notification unit 225, and a purchaser number display unit 226.

[0050] The distribution video generation unit 221 processes the video transmitted from the distributor terminal 3 and converts it into a video for live distribution. The distribution video generation unit 221 can synthesize the video captured by the distributor terminal 3 via the first camera 321 and the audio captured by the microphone of the distributor terminal 3, and generates a video for live distribution including audio information. The distribution video generation unit 221 can adjust, for example, the file size, resolution, bit rate, brightness, saturation, and / or hue of the video captured by the first camera 321 of the distributor terminal 3, and convert it into a video suitable for live distribution.

[0051] The purchase button generation unit 222 displays an image of an item captured by the distributor terminal 3 via the second camera 322 together with the video for live streaming after allocating item information corresponding to the item. When a trigger operation for image capture is performed on the distributor terminal 3, the purchase button generation unit 222 starts the second camera 322 of the distributor terminal 3. Then, when the distributor captures an image of an item with the second camera 322 and the captured image data is input to the purchase button generation unit 222, the purchase button generation unit 222 detects the item using an object detection function and extracts a portion of the image data corresponding to the item. The purchase button generation unit 222 performs image recognition on the extracted item image to acquire item information corresponding to the item from the product information acquisition unit 223, assigns the item information to the item image, and generates a purchase button 83. The purchase button generation unit 222 displays the generated purchase button 83 together with the video for streaming.

[0052] The "trigger operation" here means an operation of activating the second camera 322. Examples of the trigger operation include an operation of pressing a specific key, an operation of tapping an icon on the screen, an operation of sliding an image on the screen, an operation by voice (voice command), an operation of tilting the distributor terminal or turning it sideways using a gyro sensor or the like, an operation by a physical button provided on the distributor terminal, etc. In addition, the image captured by the second camera 322 may be a still image or a moving image.

[0053] Furthermore, the purchase button generating unit 222 generates the purchase button 83 by embedding a link that calls up a purchase display field 85 (FIG. 6A) in the image of the item. Therefore, the image of the item is the purchase button 83, and when the image of the item is pressed, the purchase display field 85 is displayed. However, in the present invention, the image of the item and the purchase button 83 may be separate, and as long as the image of the item and the purchase button 83 are associated with each other, this falls within the category of "assigning item information." For example, text with an embedded link, such as "Purchase this item here" or "Purchase button," may be displayed immediately next to the image of the item, and the purchase display field 85 may be called up by pressing the link.

[0054] The purchase button 83 is displayed together with the live streaming video, but in this embodiment, as shown in FIG. 4, the purchase button 83 is displayed superimposed on the live streaming video. However, in the present invention, the purchase button 83 may be arranged below, below, left or right of the live streaming video, so that the purchase button 83 may be displayed together with the live streaming video. Also, the purchase button 83 is superimposed on the live streaming video in the upper left part of the display unit 44 as shown in FIG. 4, but there is no particular limitation on the position, and it may be in the upper right part, lower left part, lower right part or center part. Also, the distributor may be able to change the position of the purchase button 83. Also, the number of purchase buttons 83 displayed on one screen is not limited to one, and multiple types of purchase buttons 83 may be displayed.

[0055] The product information acquisition unit 223 acquires product information. The product information acquisition unit 223 may acquire the product information via the Internet, or may be information registered in advance by the distributor. The "product information" here means information related to the product, such as product attributes, product price, product name, manufacturer, etc.

[0056] When the purchase button 83 is pressed, the purchase screen display unit 224 calls up a purchase display field 85 as shown in FIG. 6A, and displays the purchase display field 85 on the display unit 44 of the user terminal 4. However, the purchase screen display unit 224 does not stop the playback of the live streaming video, but displays the purchase display field 85 superimposed on the live streaming video. In other words, when the user presses the purchase button 83 on the user terminal 4, the purchase screen display unit 224 does not transition from the live streaming video to a purchase screen, but displays the live streaming video as is, and displays the purchase display field 85 superimposed on the foreground of the live streaming video. This prevents the user from leaving the live streaming when making a purchase, and ensures that the user does not miss any product sales being live streamed.

[0057] The purchase screen display unit 224 displays the purchase display field 85 only for the user terminal 4 on which the purchase button 83 has been pressed. As shown in FIG. 6A, the purchase display field 85 displays a field for selecting the quantity (here, displayed as "Desired Quantity"), and when the "OK" button is pressed after entering the quantity, the unit price, quantity, and total amount are displayed, as shown in FIG. 6B, and a "Purchase" or "Cancel" button is displayed. When the "Purchase" button is pressed, the user can purchase the product. Note that when the "Cancel" button is pressed, the purchase display field 85 disappears.

[0058] The notification unit 225 notifies a user terminal 4 other than the user terminal 4 that pressed the purchase button 83 that the product corresponding to the purchase button 83 has been purchased. For example, as shown in FIG. 7, the notification unit 225 chronologically displays in the chat that the product has been purchased by a specific user. In this embodiment, a notification display 84 is shown as an example in which a user "Roberto" purchases a product. The notification by the notification unit 225 may be enclosed in a frame different from other text parts in the chat so as to be noticeable, or may be displayed together with a sound. Furthermore, the notification by the notification unit 225 may be displayed in a part other than the chat display.

[0059] The notification unit 225 notifies other users that a product has been purchased, thereby encouraging them to buy. In addition, since the time of purchase of a product is notified in real time, other users can know the popularity of the product.

[0060] The purchaser number display unit 226 displays the total number of items purchased during live streaming. The purchaser number display unit 226 is linked to the payment unit 24, and counts the quantity of items for which payment has been completed. The purchaser number display unit 226 then displays the total number of items sold for each item on the user terminal 4. The total number of items sold may be displayed constantly on the user terminal 4, or may be displayed when the purchase button 83 is pressed. By displaying the total number of items sold, it is possible to inform other users that the item is popular, and to stimulate other users' desire to purchase.

[0061] (1.3.2) Distributor terminal

[0062] As shown in FIG. 3, the distributor terminal 3 includes a communication unit 31, an imaging unit 32, a processing unit 33, a display unit , and an input unit .

[0063] The communication unit 31 is connected to the live distribution device 2 so as to be able to transmit data bidirectionally (i.e., to be able to communicate with the live distribution device 2). The communication unit 31 is connected to the processing unit 33 so as to be able to input and output data.

[0064] The processing unit 33 executes various processes of the broadcaster terminal 3, such as transmitting image data captured by the imaging unit 32 to the live streaming device 2 via the communication unit 31 and processing the display on the display unit 34. The processing unit 33 also controls the imaging unit 32 and the display unit 34 based on operations performed by the input unit 35. For example, the processing unit 33 can activate the second camera 322 of the imaging unit 32 and operate the shutter of the second camera 322 using a microphone serving as the input unit 35.

[0065] The imaging unit 32 obtains image data from the distributor terminal 3. The imaging unit 32 is composed of a first camera 321 and a second camera 322. The image data obtained by the imaging unit 32 is output to the processing unit 33 and transmitted to the live streaming device 2 via the communication unit 31.

[0066] The input unit 35 inputs information to the processing unit 33. In this embodiment, the input unit 35 is a touch panel and a microphone. The display unit 34 displays moving images for live distribution. The display unit 34 is configured by, for example, a display, a television, a monitor, etc.

[0067] (1.3.3) User terminals

[0068] As shown in FIG. 3, the user terminal 4 includes a communication unit 41, an input unit 42, a processing unit 43, and a display unit 44.

[0069] The communication unit 41 is connected to the live distribution device 2 so as to be able to transmit data bidirectionally (i.e., to be able to communicate with the same). The communication unit 41 is connected to the processing unit 43 so as to be able to input and output data.

[0070] The input unit 42 inputs information to the processing unit 43. In this embodiment, the input unit 42 is a touch panel, a keyboard and / or a pointing device such as a mouse.

[0071] The processing unit 43 executes various processes based on the information input by the input unit 42. The processing unit 43 also causes the display unit 44 to display the live streaming moving image transmitted from the live streaming device 2. The display unit 44 displays the live streaming moving image. The display unit 44 is configured by, for example, a display, a television, a monitor, etc.

[0072] (1.3.4) Payment Server

[0073] As shown in FIG. 3, the payment server 5 includes a communication unit 51 and an inquiry unit 52.

[0074] The communication unit 51 is connected to the live distribution device 2 so as to be able to transmit data bidirectionally (i.e., to be able to communicate with the same). The communication unit 51 is connected to the inquiry unit 52 so as to be able to input and output data.

[0075] The inquiry unit 52 checks the validity of the card information and executes the payment process in response to a request from the payment unit 24 of the live distribution device 2. When the payment is completed, the inquiry unit 52 causes the display unit 44 of the user terminal 4 to display a message indicating that the payment has been completed.

[0076] (1.4) Operation

[0077] Next, an example of the operation for generating purchase button 83 in this embodiment will be described with reference to the flowchart in FIG.

[0078] 8, a distributor operates the distributor terminal 3 and starts a live distribution function (e.g., an application) of the distributor terminal 3 (step 1). Then, the distributor uses the distributor terminal 3 to shoot a video for live distribution and obtain content for live distribution (step 2).

[0079] Next, the distributor issues a voice command to activate the purchase button 83 generation function (step 3). Then, the processing unit 33 of the distributor terminal 3 activates the second camera 322 (step 4). The distributor uses the distributor terminal 3 to capture an image of the item (i.e., the product) to be sold from the second camera 322 (step 5).

[0080] The processing unit 33 of the broadcaster terminal 3 transmits the image data captured by the second camera 322 to the live broadcasting device 2 via the communication unit 31, and the image processing unit 22 extracts a portion corresponding to the item from the image data (Step 6). After that, the live broadcasting device 2 displays a message to the broadcaster terminal 3 asking whether or not to accept the extracted image (Step 7).

[0081] When the distributor confirms the image extracted by the image processing unit 22, the distributor presses the "Confirm" button. The live streaming device 2 then assigns item information to the image. The live streaming device 2 displays the assigned item information on the distributor terminal 3, and inquires as to whether there are any additions or changes to the item information (steps 8 and 9).

[0082] On the other hand, if the distributor wishes to retake the image extracted by the image processing unit 22, the distributor presses the "Cancel" button. Then, the process returns to step 5 again.

[0083] When the generated purchase button 83 is confirmed in step 8, the live streaming device 2 causes the user terminal 4 to display the purchase button 83 superimposed on the live streaming video (step 10). In this way, the purchase button 83 is generated.

[0084] On the other hand, in step 8, if there is an addition or change to the item information assigned to the purchase button 83 ("No" in step 9), the live streaming device 2 displays a selection screen for the information to be added or changed, and once the broadcaster selects the item information to add or change, the process returns to step 8.

[0085] Next, an example of an operation performed when a user purchases a product will be described with reference to the flowchart in FIG.

[0086] 9, during live streaming, if a user wishes to purchase a product, the user presses the corresponding purchase button 83 displayed on the user terminal 4 (step 11). In response, the live streaming device 2 causes the user terminal 4 to display a purchase display field 85 while displaying the live streaming video (step 12).

[0087] The user enters the quantity that he or she wishes to purchase in the "Desired quantity" field described in purchase display field 85 (see FIG. 6A), and presses the "OK" or "Cancel" button (step 14).

[0088] When the "OK" button is pressed, the live distribution device 2 causes the user terminal 4 to display purchase information showing the total amount (step 15). After checking this purchase information, the user presses the "Purchase" button if he or she wishes to proceed with the purchase, or presses the "Cancel" button if he or she wishes to cancel the purchase (step 16).

[0089] When the "Purchase" button is pressed, the live distribution device 2 requests the payment server 5 to perform payment processing, and executes the payment processing (step 17). On the other hand, when the "Cancel" button is pressed in step 14 or step 16, the purchase display field 85 is cleared, and the process returns to step 11.

[0090] When the payment process is complete, the live distribution device 2 notifies the other user terminals 4 that a purchase has been made by a specific user (step 18). At this time, it is preferable that the name of the user who made the purchase is also displayed, but this does not have to be the case.

[0091] After that, the live distribution device 2 counts the total number of items sold for that product and displays it on the user terminal 4 (step 19).

[0092] (2) Variations

[0093] The above embodiment is merely one of various embodiments of the present invention. The embodiment can be modified in various ways depending on the design, etc., as long as the object of the present invention can be achieved. Modifications of the embodiment are listed below. The modifications described below can be applied in appropriate combination.

[0094] At least some of the functional blocks in Fig. 3 may be implemented as a computer program (e.g., a live streaming viewing application) including modules corresponding to the functional blocks. The computer program may be stored in a recording medium such as a DVD or downloaded from the network 7 and installed in the memory 62.

[0095] In the above embodiment, payment is made online to the payment server 5 by credit card or debit card, but the distribution system 1 may be one that allows payment by electronic money.

[0096] In the above embodiment, the image (including a moving image) captured by the second camera 322 is displayed as is as purchase button 83, but in the present invention, for example, the image captured by the second camera 322 may be converted to a hand-drawn image as purchase button 83, or a CG image may be searched for from the image captured by the second camera 322 and the searched image may be used as purchase button 83. Also, when multiple cameras are provided on the same surface (for example, when three cameras are provided on the back side of a smartphone or the like), one camera may capture content for live distribution and the other camera may capture an image for the purchase button.

[0097] In the above embodiment, the content for live streaming was captured by the rear camera, and the image for purchase button 83 was captured by the front camera. However, in the present invention, the content for live streaming may be captured by the front camera, and the image for purchase button 83 may be captured by the rear camera.

[0098] In the above embodiment, the live streaming device 2 includes the image processing unit 22. However, in the present invention, the image processing unit 22 may be realized by the processing unit 33 of the broadcaster terminal 3. In other words, the purchase button 83 may be generated by the broadcaster terminal 3. Similarly, the processing unit 33 of the broadcaster terminal 3 may convert image data captured by the broadcaster terminal 3 before transmitting the image data to the live streaming device 2 to generate a moving image for live streaming, and then have the live streaming device 2 display the moving image on the user terminal 4.

[0099] (3) Summary

[0100] As described above, the distribution system 1 according to the first aspect includes the distributor terminal 3 and the live streaming device 2. The distributor terminal 3 has a first camera 321 and a second camera 322, and acquires content for live streaming using the first camera 321. The live streaming device 2 performs live streaming to the user terminal 4 using the content acquired from the distributor terminal 3. The distribution system 1 includes an image processing unit 22 that causes the user terminal 4 to display an image. The image processing unit 22 causes the user terminal 4 to display a moving image captured by the first camera 321 as a moving image for live streaming, and causes the image of an item captured by the second camera 322 to be displayed together with the moving image for live streaming after assigning item information corresponding to the item.

[0101] According to this embodiment, while a video is being shot for live streaming, the products for sale can be displayed together with the video for live streaming, so that the products sold by the live streamer can be displayed in an easy-to-understand manner on the user terminal with a simple operation. Moreover, the products for sale can be displayed and added to the user terminal 4 in real time without stopping the live streaming. As a result, the streamer can prevent users from dropping out, and the users can easily understand the products being sold during the live streaming.

[0102] Furthermore, according to this aspect, since products for sale can be added to the user terminal during live streaming, for example, a foreigner can live stream from a shopping mall, flea market, department store, or other store and introduce products to users (viewers) in his / her home country, and the broadcaster can purchase products purchased during the live stream, take them back to his / her home country, and deliver them to users in his / her home country.

[0103] In the distribution system 1 according to the second embodiment, in the first embodiment, the distributor terminal 3 is a portable communication terminal having a front camera as the first camera 321 and a rear camera as the second camera 322.

[0104] According to this embodiment, the distributor can easily realize live distribution and the addition of products.

[0105] In the distribution system 1 according to the third aspect, in the first or second aspect, the image processing unit 22 causes the image of the item captured by the second camera 322 to be superimposed on the live distribution moving image.

[0106] According to this embodiment, the display area 82 for the live distribution video on the user terminal 4 can be made as large as possible.

[0107] In the distribution system 1 according to the fourth aspect, in any one of the first to third aspects, the image processing unit 22 displays an image of an item captured by the second camera 322 as a purchase button 83 together with the live distribution video.

[0108] According to this embodiment, an image of an item can be used as the purchase button 83, which provides the user with good operability when purchasing a product.

[0109] In the distribution system 1 according to the fifth aspect, in the fourth aspect, when a user presses the purchase button 83 on the user terminal 4, the image processing unit 22 does not transition from the live streaming video to a purchase screen, but displays the live streaming video as is.

[0110] According to this embodiment, it is possible to prevent a user who has proceeded to make a purchase from leaving the live broadcast, and to prevent the user from missing an opportunity to purchase a product.

[0111] In the distribution system 1 according to the sixth aspect, in any one of the first to fifth aspects, the image processing unit 22 displays images of a plurality of items captured by the second camera 322 together with the live distribution moving image.

[0112] According to this aspect, multiple products for sale during live streaming can be displayed on one screen, making it easier for users to purchase products.

[0113] The live streaming device 2 according to the seventh aspect is a live streaming device 2 that performs live streaming to a user terminal 4 using content acquired via a first camera 321 and a second camera 322 by a broadcaster terminal 3 having a first camera 321 and a second camera 322. This live streaming device 2 has an image processing unit 22 that displays images on the user terminal 4. The image processing unit 22 displays a moving image captured by the first camera 321 on the user terminal 4 as a moving image for live streaming, and displays an image of an item captured by the second camera 322 together with the moving image for live streaming after assigning item information corresponding to the item.

[0114] According to this embodiment, while a video is being shot for live streaming, products for sale can be displayed together with the video for live streaming, so that products for sale can be displayed and added in real time to the user terminal 4 without stopping the live streaming. As a result, the distributor can prevent users from dropping out, and users can easily understand the products being sold during the live streaming.

[0115] The live streaming method according to the eighth aspect is a live streaming method in which a distributor terminal 3 having a first camera 321 and a second camera 322 performs live streaming to a user terminal 4 using content acquired via the first camera 321. This live streaming method causes a moving image captured by the first camera 321 to be displayed on the user terminal 4 as a moving image for live streaming, and causes an image of an item captured by the second camera 322 to be displayed together with the moving image for live streaming after being assigned item information corresponding to the item.

[0116] According to this embodiment, while a video is being shot for live streaming, products for sale can be displayed together with the video for live streaming, so that products for sale can be displayed and added in real time to the user terminal 4 without stopping the live streaming. As a result, the distributor can prevent users from dropping out, and users can easily understand the products being sold during the live streaming. [Explanation of symbols]

[0117] 1. Distribution System 2. Live streaming equipment 22 Image processing section 3. Distributor terminal 321 First Camera 322 Second Camera 34 Display section 4. User terminal 83 Purchase Button

Claims

1. a purchase button generation unit that activates the second camera of a distributor terminal having a first camera and a second camera, assigns item information corresponding to an item to an image of the item captured by the second camera, generates a purchase button, and displays the generated purchase button in a superimposed manner on a display area of ​​a moving image for live streaming captured by the first camera, When there is an addition or change to the product information assigned to the purchase button, the purchase button generation unit displays a selection screen for the information to be added or changed and accepts selection of the product information to be added or changed. Live streaming system.

2. the purchase button generation unit activates the second camera when a predetermined operation is performed on the distributor terminal; The live distribution system according to claim 1 .

3. The predetermined operation is an operation of pressing a specific key, an operation of tapping an icon on the screen, an operation of sliding an image on the screen, an operation by a voice command, an operation of tilting or turning the broadcaster terminal sideways using a gyro sensor, or an operation by a physical button provided on the broadcaster terminal. The live distribution system according to claim 2 .

4. When the image data captured by the second camera is input, the purchase button generation unit detects an item using an object detection function and extracts a portion of the image data corresponding to the item. The live distribution system according to claim 1 .

5. the purchase button generation unit performs image recognition on an image of an item captured by the second camera to acquire item information corresponding to the item, assigns the item information to the image of the item, and generates a purchase button; The live distribution system according to claim 1 .

6. A live streaming program, comprising: A live distribution program for causing a computer to function as each part of the distribution system according to any one of claims 1 to 5.

7. A live distribution method executed by a distribution system, comprising: The distribution system according to any one of claims 1 to 5, further comprising: How to live stream.

Images