Content publishing server, content publishing method and content publishing system

By overlaying other content within the blank area of ​​the live content received and specified in the live content publishing server, the problem of insufficient advertising revenue in the existing technology is solved, and flexible advertising content reproduction and revenue enhancement are achieved.

CN114615517BActive Publication Date: 2024-11-15DOWANGO KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210264671.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2017-09-04
Filing Date
2018-08-23
Publication Date
2024-11-15
Estimated Expiration
2038-08-23

AI Technical Summary

Technical Problem

Existing technologies cannot effectively reproduce or publish advertisements or other content in the blank areas of live content, resulting in insufficient advertising revenue.

Method used

The system receives live content from a content publishing server, overlays and specifies areas of other content within the live content according to the instructions of the publisher's terminal, and generates published content to reproduce content within any area.

Benefits of technology

It enables the overlay of any content within any area of ​​live content, improving advertising revenue, and allows for switching or changing advertising content as needed.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114615517B_ABST
    Figure CN114615517B_ABST
Patent Text Reader

Abstract

A content publishing server includes: a communication unit that receives live content sent from a publisher terminal used by a publisher of the live content through a network; a designation unit that designates an area in the live content in which another content is superimposed and played; a selection unit that selects other content to be played in the designated area; and a control unit that generates distribution content by superimposing other content selected by the selection unit in an area designated by a designator in the live content, wherein the communicator distributes the distribution content to a viewer terminal through the network.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the application with application number 201880055631.X, invention name "Content publishing server, content publishing method and content publishing system", and application date of August 23, 2018. The priority document information of the original application is: September 4, 2017, JP2017-169299. Technical Field

[0002] This patent disclosure relates to a content publishing server, a content publishing method, and a content publishing program that can be used to watch and listen to live content. Background Art

[0003] As is known to all, the conventional technology is a technology of loading other contents such as advertisements on the published contents for publishing.

[0004] For example, as shown in Patent Document 1, there is a technology that obtains a QR code generated in a received video, specifies an area for an advertisement to be published based on the QR code, synthesizes an advertisement video corresponding to the QR code in the specified area, and then publishes the advertisement video synthesized by the synthesis means.

[0005] In recent years, this service has become widely used to distribute live content produced by ordinary users at home via the Internet.

[0006] Prior art literature

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Publication No. 2015-228585 Summary of the invention

[0009] Problems that the invention needs to solve

[0010] In the present invention, it is expected that a blank area of ​​a video that has not yet been touched to release live content can be first produced to be used for reproducing or releasing any content such as advertisements, so as to achieve the purpose of increasing advertising revenue.

[0011] However, Patent Document 1 does not provide a system in which a live content publisher can select any advertisement from a publisher terminal.

[0012] Therefore, an object of the present invention is to provide a content distribution server, a content distribution method, and a content distribution program that can reproduce any other content in any area of ​​content distributed by a publisher.

[0013] Means of solving the problem

[0014] To solve the above-mentioned problem, the content publishing server disclosed in the present invention includes a communication unit for receiving live content transmitted from a publishing terminal used by a publisher of the live content through a network, a designated unit for overlapping other content in the received live content according to an instruction issued by the publisher terminal, and making an area of ​​the space for reproduction be designated in the live content video, a selection unit for selecting other content for reproduction in the designated area, and a control unit for generating published content by making the designating unit overlap other content selected by the selection unit from the live content in the designated area, and the communication unit publishes the content to be published to the viewer terminal through the network.

[0015] According to the contents of the present disclosure, the content publishing method includes the following steps, namely, a publishing unit receives the transmitted live content from the publisher terminal used by the publisher of the live content through the network, and overlaps other content with the received live content according to the instruction issued by the publisher terminal, and specifies the area of ​​the space for reproduction in the live content video, a selection unit selects other content for reproduction in the specified area, a control unit overlaps the other content selected by the selection unit with the specified area in the live content, and generates the published content, and a communication unit publishes the content to be published to the viewer terminal through the aforementioned network.

[0016] According to the contents of the present disclosure, the content publishing program is a step of using a computer to implement the steps of receiving live content transmitted from a publisher terminal used by a publisher of live content through a network, and a step of overlapping other content with the received live content according to the instructions of the publisher terminal, and specifying an area of ​​the space for reproduction in the live content video, and a step of selecting other content for reproduction in the specified area, and a step of overlapping other content selected by a live content selection unit in the specified area to generate published content, and a step of publishing the content to be published to the viewer terminal through the network.

[0017] According to the above-mentioned content distribution server, content distribution method and content distribution program, it is known that any other content can be reproduced in any area of ​​the content distributed by the publisher. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a schematic block diagram showing the structure of a content distribution system 1 according to an embodiment disclosed in the present invention.

[0019] Figure 2 This is a diagram showing an example of a video of a live content shooting location according to the first embodiment.

[0020] Figure 3FIG. 1 is a diagram showing an example of a live content delivery video according to the first embodiment.

[0021] Figure 4 FIG. 1 is a diagram showing an example of a live content delivery video according to the first embodiment.

[0022] Figure 5 This is a flowchart for explaining the operation of the content distribution system 1 according to the first embodiment.

[0023] Figure 6 This is a diagram showing an example of a video of a live content shooting location according to the second embodiment.

[0024] Figure 7 This is a diagram showing an example of a video of a live content shooting location according to the second embodiment.

[0025] Figure 8 FIG. 1 is a diagram showing an example of a live content delivery video according to the second embodiment.

[0026] Fig. 9 This is a flowchart for explaining the operation of the content distribution system 1 according to the second embodiment.

[0027] Fig.10 This is a diagram showing an example of a video of a live content shooting location according to the third embodiment.

[0028] Fig.11 FIG. 1 is a diagram showing an example of a live content delivery video according to the third embodiment.

[0029] Fig.12 This is a flowchart for explaining the operation of the content distribution system 1 according to the third embodiment.

[0030] Fig.13 This is a diagram showing an example of a timetable of live content according to the fourth embodiment.

[0031] Fig.14 It is a block diagram showing the structure of a computer according to the embodiment.

[0032] Explanation of symbols

[0033] 1 Content Publishing System 111 Content Publishing Server

[0034] 112 communication unit 113 control unit

[0035] 114 Storage unit 115 Designation unit

[0036] 116 Selection Unit 121 Publisher Terminal

[0037] 131a Viewer terminal 131b Viewer terminal

[0038] 141 CM Content Server 201 Housing

[0039] 202 Furniture 203 Door

[0040] 204 Table 208 / 209 Garbage

[0041] 231 Face recognition area 241 Designated area A

[0042] 242 Designated area B 243 Designated area C

[0043] 244 Designated area D 251 Augmented reality logo a

[0044] 252 Augmented reality logo b 253 Augmented reality logo c

[0045] 254 Augmented reality logo d 255 Augmented reality logo e

[0046] 261 Live content 271 Specified time D

[0047] 272 Specified time E 273 Specified time F

[0048] 901 Computer 902 CPU

[0049] 903 Main storage device 904 Auxiliary storage device

[0050] 905 interface 205 cup DETAILED DESCRIPTION

[0051] The following is an explanation of the embodiments. The embodiments described below are not intended to limit the disclosure of the present document as described in the claims. All structures described in this embodiment are not limited to the essential components disclosed in this document.

[0052] (First embodiment)

[0053] As a first embodiment of the present invention, a content distribution system 1 for displaying and distributing advertisement content superimposed on live content in an area designated by a publisher will be described.

[0054] <constitute>

[0055] First, through Figure 1 The configuration and modules of the content publishing system 1 including the content publishing server 111 used by the publisher to publish live content to the audience are described. Live content refers to so-called live content that allows the audience to see the images and sounds of the content that the publisher wants to publish in real time.

[0056] like Figure 1 As shown, the content distribution system 1 of the present embodiment is configured such that a content distribution server 111 and a publisher terminal 121, viewer terminals 131a, 131b, and a CM content server 141 can be connected to a network NW such as the Internet.

[0057] The content distribution server 111 is a server for distributing live content transmitted from the publisher terminal 121 to the viewer terminals 131a and 131b. The content distribution server 111 is provided with a communication unit 112, a control unit 113, a storage unit 114, a designation unit 115, and a selection unit 116.

[0058] The communication unit 112 is a communication interface for establishing communication with the publisher terminal 121, the viewer terminals 131a, 131b, and the CM content server 141 via the network NW. The communication unit 112 receives live content transmitted from the publisher terminal 121 and overlapping content (other content) transmitted from the CM content server 141. In addition, the communication unit 112 distributes the distribution content generated by the control unit 113 described later to the viewer terminals 131a, 131b. In addition, the communication unit 112 can also send or receive login ID information for logging into the content distribution server 111 from the publisher terminal 121 and the viewer terminals 131a, 131b to the publisher and the viewer as needed.

[0059] The control unit 113 generates a list of overlapping contents that the publisher can browse and select from the overlapping contents stored in the storage unit 114 and the CM content server 141 described later. The control unit 113 generates the published contents that overlap the live contents and the overlapping contents. When the control unit 113 generates the published contents, the overlapping contents are overlapped on the live contents according to the area information and the allocation information stored in the storage unit 114 described later.

[0060] The storage unit 114 stores the overlapping content display area information specified by the designation unit 115 described later. In addition, it is also used to store the allocation information of the overlapping content selected by the selection unit 116 described later. The overlapping content produced by the operator and publisher of the content publishing server is saved. In addition, the overlapping content related to the advertisement transmitted from the CM content server 141 can also be temporarily saved. In addition, the overlapping content list generated by the control unit 113 can also be saved. The overlapping content list related to the overlapping content that can be published is saved. The overlapping content list includes the publisher information of the overlapping content and the equivalent remuneration information related to the publication of the overlapping content. The so-called equivalent remuneration information refers to information such as "If the video of the published live content is displayed in an area of ​​10% of the area for viewing for 30 minutes, 5,000 yen must be paid to the publisher."

[0061] The designation unit 115 designates an area in which the overlapping content is superimposed on the live content and displayed by an operation from the publisher terminal 121. The designated area is stored in the storage unit 114 as display area information. The area designation method may also designate a fixed position in the video as a certain area, or may use face recognition to designate a position and area relative to the recognition area. In addition, the shape of a cup or the like may be recognized, for example, a part of the cup may be designated. The designated area may be one or more locations in the video.

[0062] The selection unit 116 distributes the overlapping content selected from the overlapping content list to the area specified by the specification unit 115 through the operation of the publisher terminal 121. The specification unit 115 stores the distributed overlapping content in the storage unit 114 as distribution information.

[0063] Next, the composition and operation of the publisher terminal 121 will be described. The publisher terminal 121 is a terminal device used by a publisher of a content, that is, an information processing device such as a smart phone, a mobile phone, a PHS, a computer, a game console, a PDA, a portable game console, a watch, a smart watch, a head-mounted display, a wearable display, an image generating device, etc. In addition, the publisher terminal 121 is a device that can be connected to the content publishing server 111 through a network NW such as the Internet (WAN), a LAN, etc. Moreover, the communication line between the publisher terminal 121 and the content publishing server 111 can be wired or wireless. The publisher can use the publisher terminal 121 to produce live content of a live broadcast program. The publisher terminal 121 transmits the produced live content to the content publishing server 111 in real time.

[0064] Next, the structure and operation of the viewer terminals 131a and 131b are described. The viewer terminals 131a and 131b are terminal devices used by viewers, that is, information processing devices such as smart phones, mobile phones, PHS, computers, game consoles, PDAs, portable game consoles, watches, smart watches, head-mounted displays, wearable displays, and image generation devices. In addition, the viewer terminals 131a and 131b are devices that can be connected to the content distribution server 111 through a network NW such as the Internet (WAN) and LAN. Moreover, the communication line between the viewer terminals 131a and 131b and the content distribution server 111 can be wired or wireless.

[0065] The publisher terminal 121 and the viewer terminals 131a, 131b can also access the content distribution server 111 through the installed dedicated application software. In addition, the content distribution server 111 can also be accessed through the operating environment (API (application program interface), platform, etc.) provided by the content distribution server 111 and other servers.

[0066] The CM content server 141 stores the overlapping contents uploaded to the CM content server 141 by the advertising client. The CM content server 141 is a server device for transmitting to the content distribution server 111. For example, the CM content server 141 stores a plurality of CM contents such as corporate advertisements. The publisher can select which of the contents from the publisher terminal 121 to the CM content server 141 to use as overlapping contents from the overlapping content list. The publisher receives equivalent compensation from the content provider according to the time when the overlapping contents in the CM content server 141 are used as CM contents and the size of the display area.

[0067] 〈Content video〉

[0068] The video of the live content shooting location transmitted by the publisher terminal 121 according to the first embodiment of the present document and the video of the published content published by the content publishing server 111 are transmitted by Figure 2 to Figure 4 Provide explanation.

[0069] Figure 2 2 is an example diagram of a video showing a location where live content is shot. The shooting location is a publisher's home or living room, etc. A house 201 is equipped with furniture 202, a door 203, and a table 204. Figure 2 It is a network camera on the publisher terminal 121 such as a computer placed on a table, and displays the image captured in the house. The publisher sits facing the publisher terminal 121. A cup 205 is placed on the table.

[0070] The publisher can designate the area to publish the CM content while watching the image of the network camera at the publisher terminal 121. The space above the table is designated as designated area A241. The surface of the cup 205 is designated as designated area B242. The cup 205 is logged in to the content publishing server 111 from the publisher terminal 121, and the shape of the cup 205 is recognized. Therefore, when the cup 205 is moved, the designated area B242 on the surface of the cup 205 also moves with the image of the cup 205. Next, the designated area C243 is the T-shirt part transmitted by the publisher. The designated area C is the area designated in correspondence with the position of the publisher's face 231. The content publishing server 111 recognizes the publisher's face 231 by face scanning. The publisher designates an area of ​​250 mm in width and 100 mm in height as the designated area C at a position 300 mm downward from the publisher terminal 121 as the starting point and from the face 231 of the face scan as the starting point. The designated area C may also be reset to zero relative to the center point of the face 231, that is, the face 231 may be designated as the area. The designation unit 115 of the content distribution server 111 stores the designated area A 241, the designated area B 242, and the designated area C 243 in the storage unit 114 as display area information.

[0071] Figure 3 1 is an example diagram showing an image of published content. The published content is an image transmitted from the content distribution server 111 to the viewer terminals 131a and 131b, and is also displayed as a confirmation image on the publisher terminal 121. Since the publisher selects the content he wants to select from the overlapping content list transmitted by the content distribution server 111 on the publisher terminal 121, it is determined as overlapping content. Figure 3 In the designated area A241, the words "DEF Co., Ltd." are displayed as overlapping content. In the designated area B242, the words "GHI" are displayed as overlapping content. In addition, in the designated area C243, the words "ABC Co., Ltd." are displayed as overlapping content. The publisher can decide whether to allocate any overlapping content to each designated area from the publisher terminal 121. The selection unit 116 of the content publishing server 111 stores any overlapping content allocated to each designated area as allocation information in the storage unit 114. The control unit 113 overlaps the live content and the overlapping content based on the display area information and the allocation information to generate the published content.

[0072] Figure 4 It indicates the position of the publisher and cup 205 from Figure 3After the shape recognition of the cup 205, the text "HGI" is displayed on the surface of the designated area B242. Therefore, when the position of the cup 205 moves, the displayed text "HGI" also moves with the cup 205. Moreover, the designated area 243 depends on the relative position to the publisher's face 231. Therefore, when the publisher moves, the text "ABC Co., Ltd." also moves with the publisher. In addition, the designation unit 115 performs shape recognition on the cup 205, so when the cup 205 rotates, the display position of the text will also rotate. The designation unit 115 recognizes the gripper position by shape recognition, and can also calculate the relationship between the gripper position and the display position to change the display position. Similarly, the designation unit 115 performs T-shirt shape recognition, and can also deform the text and graphics displayed in combination with the wrinkles on the surface of the T-shirt. In this way, it can be displayed to the viewer that it looks like overlapping content is printed on the cup 205 and the T-shirt.

[0073] <Processing Flow>

[0074] Next, regarding the operation of the content distribution system 1 involved in the first embodiment of this document, while referring to Figure 5 The flowchart shown is used for explanation. Figure 5 The flowchart shows the related states of the content distribution server 111, the publisher terminal 121, and the viewer terminal 131a in each operating state.

[0075] In step S101 , the publisher takes a photo at a shooting location and transmits the video of the shooting location taken at the publisher terminal 121 to the content distribution server 111 from the publisher terminal 121 .

[0076] In step S102 , the publisher sends a request signal from the publisher terminal 121 to the content distribution server 111 to distribute the overlapping content.

[0077] In step S103, the content distribution server 111 sends the list of publishable overlapping contents to the publisher terminal 121 according to the request signal sent in step S102. The storage unit 114 can store the list of overlapping contents, and the contents stored in the CM content server 141 can also be transmitted through the content distribution server.

[0078] In step S104, the publisher uses the publisher terminal 121 to select the overlapping content that he wishes to publish from the overlapping content list transmitted in step S103.

[0079] In step S105, the publisher uses the publisher terminal 121 to specify the display area of ​​the overlapping content (with Figure 2The publisher terminal 121 transmits the designated display area to the content distribution server 111. The designation unit 115 stores the transmitted display area in the storage unit 114 as display area information.

[0080] In step S106, the publisher distributes the overlapping content selected in step S104 to the area designated in step S105 using the publisher terminal 121. Information on the distributed overlapping content is transmitted to the content distribution server 111.

[0081] In step S107, storage unit 114 stores the display area information transmitted in step S105. In addition, storage unit 114 stores the allocation information transmitted in step S106.

[0082] In step S108, the publisher shoots live content at the publisher terminal 121. The publisher terminal 121 transmits the shot live content to the content distribution server 111.

[0083] In step S109, the control unit 113 generates, for the live content transmitted in step S108, the distribution content (with the overlapping content) that overlaps the overlapping content according to the display area information and the allocation information stored in the storage unit 114. Figure 3 , Figure 4 corresponding).

[0084] The designation unit 115 determines the area in which the overlapping content is displayed in the image of the live content based on the display area information. For example, the designation unit 115 determines the designated area B242 on the surface of the cup 205 based on the display area information corresponding to the designated area B242. The designated area B242 is determined by recognizing the shape of the cup 205, and when the cup 205 is moved, the designated area B242 moves with it. The selection unit 116 allocates the overlapping content to each designated area (designated area A241 to designated area A243) based on the allocation information. For example, the selection unit 116 allocates the text "GHI" of the overlapping content to the designated area B242. Therefore, when the cup 205 is moved, the text "GHI" of the overlapping content will move with it (with the cup 205 moving). Figure 4 corresponding).

[0085] In step S110 , the communication unit 112 distributes the generated distribution content to the viewer terminal 131 a .

[0086] In step S111, the viewer terminal 131a displays the content distributed in step S110. The viewer terminal 131a may display a video with the superimposed content superimposed on the live content.

[0087] 〈Effect description〉

[0088] As described above, according to the content publishing system 1 involved in the first embodiment disclosed in this document, any overlapping content can be overlapped and reproduced in any area of ​​the live content published by the publisher. In this way, the blank area of ​​the image published with the live content can be used as an advertisement. It can also be included in the advertising income as an equivalent reward for displaying the advertisement.

[0089] Overlapping content includes not only text information, but also image and video information.

[0090] The overlapping content displayed in each designated area can also be switched according to the release time of the live content. For example, from the moment of release of the live content until 30 minutes have passed, the overlapping content displayed in the designated area B242 shows "GHI", and after 30 minutes, it can also be switched to show "JKL". The publisher can set the switchable overlapping content and the switchable time as the distribution information pre-acquired from the publisher terminal 121.

[0091] The overlapping contents displayed in each designated area can also be switched by the publisher through the publisher terminal 121. For example, when the published content is published, the overlapping contents displayed in the designated area B242 are displayed as "GHI". The control unit 113 receives the selection instruction signal sent by the publisher terminal 121 and switches the overlapping contents to display "JKL". The publisher can set the switchable overlapping contents as the allocation information pre-acquired from the publisher terminal 121.

[0092] The overlapping contents displayed in each designated area can also be switched according to the instructions of the contributor of the overlapping contents. For example, the contributor of the overlapping contents, that is, the advertising client, can also switch the overlapping contents to be displayed by operating the terminal device (not shown) used by the advertising client. When the published content starts to be published, the overlapping contents displayed in the designated area B242 are displayed as "GHI". The control unit 113 receives the instruction signal sent by the terminal device used by the advertising client and can also switch the overlapping contents to display "JKL".

[0093] When switching the overlapping content, the control unit 113 may also make the overlapping content before the switching fade out and make the overlapping content after the switching fade in. In addition, the switching display may be performed by smooth conversion. The overlapping content before and after the switching may also be switched by gradual change. In this way, the audience will not feel an unnatural sense of disobedience when switching the overlapping content.

[0094] In addition, overlapping content can also be published in various different ways according to the terminal device. For example, on the terminal device 131a, the overlapping content displayed in the designated area B242 is displayed as overlapping content "GHI", and on the terminal device 131b, the overlapping content "JKL" is displayed. The control unit 113 can analyze the preferences of the audience based on the registration ID information of each terminal device. The control unit 113 generates published content that overlaps various overlapping contents in combination with the preferences of the audience. The communication unit 112 transmits the generated published content to the viewer terminals 131a and 131b respectively. The control unit 113 can also analyze the preferences of the audience by using Cookie (HTTP cookie) information from the viewer terminal instead of using the registration information.

[0095] The contributor of overlapping content can also make a request to display the overlapping content produced by himself while viewing the published content. The specific steps are explained by example. The contributor of overlapping content, that is, the advertising client, can also use the terminal device (not shown) used by the advertising client to transmit a request signal for displaying the overlapping content produced by himself in the currently published content to the content publishing server 111. In addition, the overlapping content that is desired to be displayed is uploaded from the terminal device to the content publishing server 111. The display area where the overlapping content is desired to be displayed is selected in the image of the published content. The content publishing server 111 determines the equivalent remuneration amount related to the advertisement display with the request signal. When determining the equivalent remuneration, the content publishing server 111 can also compare the amount set by the publisher. In addition, in the same display area, it can also be compared with the equivalent remuneration provided by the other party who wants to display the advertisement. If the equivalent remuneration amount meets the conditions, the request is accepted. When the advertising client makes a request, the content publishing server 111 can switch the display with other overlapping contents in real time except for the overlapping contents produced by the advertising client.

[0096] (Second embodiment)

[0097] In the context of the shooting scene of the second embodiment disclosed in this document, a content distribution system 1 that displays other content in an overlapping manner will be described. In the second embodiment, the content distribution system 1 according to the first embodiment will be described.

[0098] 〈Live content video〉

[0099] pass Figure 6 to Figure 8 The video of the live content shooting location transmitted by the publisher terminal 121 and the distribution content video transmitted by the content distribution server 111 according to the second embodiment disclosed in this document will be described.

[0100] Figure 62 is an example diagram showing a shooting location image of live content. The shooting location is the publisher's home and living room, etc. House 201 is equipped with furniture 202, door 203, and table 204. In addition, garbage 208 and 209 are scattered on the floor of house 201. Figure 6 The publisher is not captured and the publisher brings items in the live content distribution. The publisher transmits the content distribution server 121 from the publisher terminal 121 to the content distribution server 121. Figure 6 images.

[0101] Figure 7 This is an example of an image of a shooting location showing a state where a publisher of live content is shooting a home image. This is also a state where a publisher is shooting a cup 205 brought in during the live content delivery.

[0102] Figure 8 1 is an example diagram showing an image of published content. The published content is an image transmitted from the content publishing server 111 to the viewer terminals 131a and 131b, and is also displayed as a confirmation image on the publisher terminal 121. The published content is content generated by overlapping live content and other content. Other content is content composed of images and images of overlapping content, objects, scenery, appearances, etc. Figure 8 In the video, images of scenery such as trees and the moon are displayed as other content.

[0103] <Processing Flow>

[0104] Next, regarding the operation of the content distribution system 1 involved in the second embodiment of the present disclosure, refer to Fig. 9 The flowchart shown is used for explanation. Fig. 9 The flowchart shows the related states of each operation of the content distribution server 111, the publisher terminal 121, and the viewer terminal 131a.

[0105] In step S201, the publisher takes a picture of the initial state of the shooting location. Furthermore, the publisher transmits the image of the initial state of the shooting location taken by the publisher terminal 121 to the content publishing server 111 through the publisher terminal 121. The image of the initial state of the shooting location refers to the image taken when the live content is published, for example, the image of the state of the publisher himself and the objects such as the cup is not captured (corresponding to the initial state of the shooting location). Figure 6 ).

[0106] In step S202, the publisher specifies the display area (corresponding to the display area of ​​the overlapping content) on the publisher terminal 121. Figure 6 The publisher terminal 121 transmits the designated display area to the content distribution server 111.

[0107] In step S203 , the specifying unit 115 stores the transferred display area in the storage unit 114 as display area information.

[0108] In step S204 , the publisher transmits a publishable overlapping content request signal to the content publishing server 111 via the publisher terminal 121 .

[0109] In step S205, the content distribution server 111 transmits the publishable overlapping content list to the publisher terminal 121 according to the request signal transmitted in step S204. The overlapping content list can be transmitted by the content distribution server as data stored in the storage unit 114 or as data stored in the CM content server 141.

[0110] In step S206, the publisher uses the publisher terminal 121 to select the overlapping content that he wishes to publish from the overlapping content list transmitted in step S103.

[0111] In step S207, the publisher distributes the overlapping content selected in step S206 in the area designated in step S202 using the publisher terminal 121. Information of the distributed overlapping content is transmitted to the content distribution server 111.

[0112] In step S208 , the storage unit 114 stores the allocation information transmitted in step S207 .

[0113] In step S209, the publisher shoots live content using the publisher terminal 121. The publisher terminal 121 transmits the shot live content to the content distribution server 111.

[0114] In step S210, the control unit 113 extracts the difference between the initial state image of the shooting location transmitted in step S201 and the live content image. The publisher himself and the cup 205 can be extracted from the live content image.

[0115] In step S211, the control unit 113 generates a distribution content (with the same content as the live content) superimposed with the overlapping content in the live content transmitted in step S209 according to the display area information and the allocation information stored in the storage unit 114. Figure 7 correspond).

[0116] The designation unit 115 determines the area in the live content image where the superimposed content is to be displayed based on the display area information, and the selection unit 116 allocates the superimposed content to the designated area based on the allocation information. Figure 7 In the image, the images of scenery such as trees and the moon are assigned to Figure 6 The designated area D244 is shown. The control unit 113 superimposes the publisher and the cup 205 extracted in step S120 on the image. The publisher is displayed in front of the landscape image.

[0117] In step S212 , the communication unit 112 distributes the generated distribution content to the viewer terminal 131 a .

[0118] In step S213, the viewer terminal 131a displays the content published in step S110. In this way, the viewer terminal 131a can display an image in which the overlapping content is overlapped with the live content.

[0119] 〈Explanation of Effect〉

[0120] As described above, according to the content publishing system 2 involved in the second embodiment disclosed in this document, it can be known that any overlapping content can be overlapped and reproduced in any field such as the background of the live content published by the publisher. For the background of the shooting location, there is no need to prepare a special environment such as a chroma key, and the background can be changed arbitrarily. In this way, for example: if the house used for shooting the live content is in a messy state, the publisher's background, etc., can be used as other content to display the image of the overlapping content, and the appearance of the messy house can be hidden. Other content displayed as the background, etc. can also display advertisements, etc. The equivalent reward for displaying advertisements can also be included in the advertising income.

[0121] The overlapping contents displayed in each designated area can also be switched according to the distribution time of the live content. The overlapping contents displayed in each designated area can also be switched by the publisher through the publisher terminal 121. In addition, the overlapping contents can also be distributed in various different contents according to the terminal device.

[0122] (Third embodiment)

[0123] The third embodiment disclosed in this document will be described with respect to a content distribution system 1 that recognizes an AR (augmented reality) mark in live content and reproduces it superimposed on other content. The third embodiment will be described using the content distribution system 1 according to the first embodiment.

[0124] 〈Content Image〉

[0125] The video of the shooting location of the live content transmitted by the publisher terminal 121 and the video of the distribution content distributed by the content distribution server 111 according to the third embodiment of the present document are transmitted by the publisher terminal 121. Fig.10 , Fig.11 Provide explanation.

[0126] Fig.10 2 is an example diagram showing an image of a location where live content is shot. The shooting location is the publisher's home and living room. House 201 is equipped with furniture 202, door 203, and table 204. A cup 205 is placed on the table. Garbage 208 and 209 are scattered on the floor of house 201. The publisher is sitting in front of the table.

[0127] exist Fig.10 In the figure, five augmented reality markers are listed. An augmented reality marker is a marker used to specify the location where other content is displayed. It is a built-in mode, for example, composed of a QR code. Augmented reality marker a251 is attached to the table, and augmented reality marker b252 is attached to the surface of cup 205. In addition, augmented reality marker c253 is printed on the chest of the publisher's T-shirt. In addition, augmented reality marker d254 and augmented reality marker e255 are attached to the table (not shown), respectively placed in front of the garbage 208 and 209.

[0128] The publisher can allocate overlapping content to each augmented reality marker in the image while watching the image of the network camera on the publisher terminal 121. Fig.10 In the example, the publisher assigns the advertisement overlapping content "ABC Corporation" to the augmented reality identifier c253. Fig.11 As shown in the figure, the words "ABC Co., Ltd." in the released image can be photographed on the T-shirt printed with the augmented reality logo c253. Fig.10 The augmented reality logo d254 may be assigned an image of a "board" having the same color as the floor. The augmented reality logo e255 may be assigned an image of a "tree". Fig.11 As shown, in the published image, the image content of "board" can be captured at the place where the augmented reality mark d254 is assigned. In addition, the image content of "tree" can be captured at the place where the augmented reality mark e255 is assigned. In the distributed image, the garbage 208 and 209 scattered in the house 201 can be hidden.

[0129] <Processing Flow>

[0130] Next, regarding the operation of the content distribution system 1 according to the third embodiment of the present disclosure, refer to Fig.12 The flowchart shown is used for explanation. Fig.12 The flowchart shows the related states of each operation of the content distribution server 111, the publisher terminal 121, and the viewer terminal 131a.

[0131] In step S301 , the publisher transmits a request signal for publishable overlap content from the publisher terminal 121 to the content publishing server 111 .

[0132] In step S302, the content distribution server 111 transmits a publishable overlapping content list to the publisher terminal 121 in response to the request signal transmitted in step S301. The overlapping content list may be one stored in the storage unit 114 or one stored in the CM content server 141 and sent via an internal distribution server.

[0133] In step S303, the publisher uses the publisher terminal 121 to select the overlapping content that he wishes to publish from the overlapping content list transmitted in step S302.

[0134] In step S304 , the publisher uses the publisher terminal 121 to assign the superimposed content selected in step S303 to each augmented reality marker. The image of each augmented reality marker is retrieved and the retrieved image is associated with the superimposed content and registered. The information of the assigned superimposed content is transmitted to the content distribution server 111 .

[0135] In step S305 , the storage unit 114 stores the allocation information transmitted in step S304 .

[0136] In step S306, the publisher shoots live content using the publisher terminal 121. The publisher terminal 121 transmits the shot live content to the content distribution server 111.

[0137] In step S307, the specifying unit 115 identifies the augmented reality marker captured in the live content transmitted by the publisher terminal 121. The specifying unit 115 identifies the display position of each identified augmented reality marker and generates display area information.

[0138] In step S308 , control unit 113 generates distribution content on which overlapping content is overlapped, according to display area information and allocation information stored in storage unit 114 , with respect to the live content transmitted in step S306 .

[0139] The designation unit 115 determines the area in the live content image where the overlapping content is displayed based on the display area information. For example, the designation unit 115 affixes an augmented reality marker b252 on the surface of the cup 205, so the selection unit 116 assigns the overlapping content to each augmented reality marker based on the assignment information. For example, the selection unit 116 assigns the text "GHI" of the overlapping content to the augmented reality marker b252. In this way, when the cup 205 is moved, the augmented reality marker b252 is also moved, so the text "GHI" of the overlapping content assigned to the augmented reality marker b252 will also move.

[0140] In step S309 , the communication unit 112 distributes the generated distribution content to the viewer terminal 131 a .

[0141] In step S310, the viewer terminal 131a displays the published content according to step S310. The viewer terminal 131a may display an image in which the superimposed content is superimposed on the live content.

[0142] 〈Explanation of Effect〉

[0143] As described above, according to the content publishing system 1 involved in the third embodiment disclosed in this document, it can be known that the publisher can overlap and reproduce any content at the augmented reality mark position captured by the published live content.

[0144] The overlapping contents displayed in each designated area can also be switched according to the release time of the live content. In addition, the overlapping contents displayed in each designated area can also be switched by the publisher through the publisher terminal 121. The overlapping contents can also be distributed to various contents according to the terminal device.

[0145] (Fourth embodiment)

[0146] The fourth embodiment disclosed in this document, that is, a content distribution system 1 that reproduces live content by superimposing the sound of other content on the live content, will be described. The fourth embodiment will be described using the content distribution system 1 according to the first embodiment.

[0147] Fig.13 261 is a conceptual diagram of a timetable for allocating release times of live content 261. Fig.13 The time changes in the timetable are from the left side of the paper to the right side. Fig.13 The live content 261 shown is a 45-minute distribution content, and the content distribution server 111 distributes and reproduces the sound content three times.

[0148] The publisher can specify the time when the publisher terminal 121 reproduces the audio content as a time zone. The specified time zone is Fig.13 In the embodiment, the sound content is reproduced in the designated area of ​​the designated time D271, the designated area E272, and the designated time F273. The designated time D271 is the time area from 7 minutes 30 seconds to 8 minutes 30 seconds from the live content release time. Similarly, the designated time E272 is the time from 24 minutes 00 seconds to 25 minutes 00 seconds from the live content release time. Moreover, the designated time E273 is the time from 36 minutes 00 seconds to 38 minutes 00 seconds from the live content release time. The designation unit 115 stores each designated time as time area information (corresponding to the display area information in the first embodiment) in the storage unit 114.

[0149] The publisher can select from the content list and assign the sound content to be reproduced in each designated area specified as the time zone. The content publishing server 111 transmits the content list to the publisher terminal 121 in response to the request signal sent by the publisher terminal 121. The content list is a list of sound contents recorded in the storage unit 114 and the CM content server 141. The sound contents are advertising sounds, sticker sounds, ringtones, correct prompt sounds, etc. The publisher can assign the sound content selected from the content list to the designated time of the time zone using the publisher terminal 121. For example: Fig.13 In the example, the advertisement sound of the product of Company X can be allocated to the designated time F273. The selection unit 116 stores in the storage unit 114 whether any CM content is allocated in each designated area as allocation information.

[0150] The publisher transmits live content from the publisher terminal 121 to the content distribution server 111. The control unit 113 overlaps the live content and the audio content based on the time zone information and the distribution information to generate distribution content. The control unit 112 distributes the generated distribution content to the viewer terminal 131a.

[0151] The viewer terminal 131a displays the distributed content. In this way, the viewer terminal 131a can display the video with the audio content superimposed on the live content.

[0152] 〈Explanation of Effect〉

[0153] As described above, according to the content distribution system 1 according to the fourth embodiment disclosed in this document, it can be seen that the publisher can superimpose and reproduce any audio content in any area of ​​the live content being distributed.

[0154] The sound content reproduced in each designated area may be switched by the publisher through the publisher terminal 121. The publisher may set the switchable sound content as pre-assignment information through the publisher terminal 121.

[0155] The audio content can also be assigned various contents according to the terminal device. For example, the audio content reproduced at the designated time F273 can be assigned to the terminal device 131a for the advertisement of the product of Company X, and to the terminal device 131b for the advertisement of the service provider of Company Y. The control unit 113 can analyze the preferences of the audience according to the registration ID information of each terminal device. The control unit 113 combines the preferences of the audience to overlap various audio contents and generate the published content. The communication unit 112 transmits the generated published content to the viewer terminals 131a and 131b respectively. In addition, the control unit 113 can also analyze the preferences of the audience by using Cookie (HTTP cookie) information from the viewer terminal instead of using the registration information.

[0156] (program)

[0157] Fig.14 9 is a block diagram showing the configuration of a computer 901. The computer 901 includes a CPU 902, a main storage device 903, an auxiliary storage device 904, and an interface 905.

[0158] Here, a detailed description is given of the program for realizing each function of the content distribution server 111 involved in the embodiment disclosed in this document.

[0159] The content distribution server 111 is installed in the computer 901. The operation of each component of the content distribution server 111 is stored in the auxiliary storage device 909 in the form of a program. The CPU 902 reads the program from the auxiliary storage device 904, decompresses it to the main storage device 903, and performs the above-mentioned processing according to the program. In addition, the CPU 902 ensures that the storage area corresponding to the above-mentioned storage unit is stored in the main storage device 903 according to the program.

[0160] Specifically, the program is a content publishing program that is created to implement the steps of computer 901 receiving live content transmitted through a network from a publisher terminal used by a publisher of the live content, designating an area for overlapping other content for reproduction in the received live content, selecting other content for reproduction in the designated area, overlapping the other content selected in the live content in the designated area and generating published content, and publishing the content to a viewer terminal through a network.

[0161] The auxiliary storage device 904 is a non-temporary storage medium. Examples of other non-temporary storage media include a magnetic disk, an optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, etc. connected via the interface 905. When such a program is distributed to the computer 901 via a network, the computer 901 receiving the distribution may also decompress the program to the main storage device 903 and perform the above-mentioned processing.

[0162] This program can also be regarded as a program that realizes part of the functions described. Moreover, this program can realize the functions described in combination with other programs stored in the auxiliary storage device 904, that is, the so-called difference file (difference program).

[0163] These embodiments can be implemented in various other forms, and various omissions, substitutions, and changes can be made without exceeding the scope of the invention. If these embodiments and their variations are included in the scope and spirit of the invention, they are also included in the invention described in the claims and their equivalents.

Claims

1. A content publishing server, comprising a processor configured to: receiving live content from a first terminal via a network, wherein the live content is created by a publisher; generating a designated area within the video image of the live content in response to a first operation of the first terminal or the second terminal; In response to a second operation of the first terminal or the second terminal, another content provided by the second terminal is selected; wherein, The other content is uploaded to the content publishing server in real time by the second terminal according to a request sent by the second terminal; and generating distribution content by superimposing the other content on an area in the live content, wherein the processor is capable of distributing the distribution content to a third terminal via a network; Wherein, the first terminal is a publisher terminal; The second terminal is a terminal that provides the other content; The third terminal is a viewer terminal.

2. The content publishing server according to claim 1, wherein: The processor generates a designated area within a video image of the live content in response to the first operation of the first terminal.

3. The content publishing server according to claim 2, wherein: The processor selects the other content in response to the second operation of the first terminal. 4 . The content distribution server according to claim 2 , wherein the processor selects the other content in response to the second operation of the second terminal.

5. The content publishing server according to claim 1, wherein: The processor generates the designated area within the video image of the live content in response to the first operation of the second terminal.

6. The content publishing server according to claim 5, wherein: The processor selects the other content in response to the second operation of the first terminal. 7 . The content distribution server according to claim 5 , wherein the processor selects the other content in response to the second operation of the second terminal.

8. A content publishing method, comprising: receiving live content from a first terminal via a network, wherein the live content is created by a publisher; generating a designated area within the video image of the live content in response to a first operation of the first terminal or the second terminal; In response to a second operation of the content server or the first terminal or the second terminal, selecting another content provided by the second terminal; wherein the another content is uploaded to the content publishing server in real time by the second terminal according to the request sent by the second terminal; and generating distribution content by superimposing the other content on a designated area in the live content; and distributing the distribution content to a third terminal via a network; Wherein, the first terminal is a publisher terminal; The second terminal is a terminal that provides the other content; The third terminal is a viewer terminal.

9. A non-transitory computer-readable medium comprising a program for causing a computer to perform functions comprising: receiving live content from a first terminal via a network, wherein the live content is created by a publisher; generating a designated area within the video image of the live content in response to a first operation of the first terminal or the second terminal; In response to a second operation of the computer or the first terminal or the second terminal, selecting another content provided by the second terminal; wherein the another content is uploaded to a content publishing server in real time by the second terminal according to a request sent by the second terminal; and generating distribution content by superimposing the other content on a designated area in the live content, and distributing the distribution content to a third terminal through a network; Wherein, the first terminal is a publisher terminal; The second terminal is a terminal that provides the other content; The third terminal is a viewer terminal.