Image distribution device, method, program, and image distribution system

Abstract

The present invention provides an image distribution device, a method, a program, and an image distribution system which make it possible to extract a still image suitable for distribution from a moving image and distribute the still image to a user terminal. The image distribution device includes one or more processors, and performs bidirectional communication with a plurality of user terminals. The processor of the image distribution device distributes a moving image to a plurality of user terminals (step S12), and acquires reaction information (reaction) of a user with respect to a moving image distributed from one or more user terminals (step S16). The processor extracts one or more still images from the moving image on the basis of the reaction, and distributes the one or more still images to the user terminal.

Description

Image distribution device, method, program, and image distribution system

[0001] The present invention relates to an image distribution device, method, program, and image distribution system, and more particularly to a technique for extracting still images suitable for distribution from a moving image.

[0002] Patent Documents 1 and 2 each describe a technique for extracting still images from a moving image.

[0003] The service server described in Patent Document 1, when extraction conditions for extracting still images from a moving image are input, extracts still images according to the extraction conditions.

[0004] The extraction conditions for still images include the elapsed time from the beginning of the video, extraction interval information indicating the interval at which still images are extracted, the period during which the subject is changing over time or the period during which a person is being photographed, and combinations of these extraction conditions.

[0005] The image processing server described in Patent Document 2 converts high-resolution video into low-resolution video, delivers the low-resolution video to the user's terminal, and extracts still images from the high-resolution video according to timing information received from the terminal (timing information indicating when the user pressed the shutter button while watching the low-resolution video on the terminal).

[0006] JP 2005-198063 A JP 2003-333568 A

[0007] One embodiment of the technique of the present disclosure provides an image delivery device, method, program, and image delivery system that can extract still images suitable for delivery from a video and deliver them to a user terminal.

[0008] The invention of the first aspect is an image delivery device that has one or more processors and communicates with a plurality of user terminals, wherein the processor delivers a video to the plurality of user terminals, acquires user reaction information to the delivered video from the one or more user terminals, extracts one or more first still images from the video based on the reaction information, and delivers the one or more first still images to the user terminals.

[0009] In the image delivery device according to the second aspect of the present invention, in the first aspect, it is preferable that the processor analyzes the delivered video and extracts a first still image from the video based on the reaction information and the analysis results of the video.

[0010] In the image delivery device of the third aspect of the present invention, in either the first or second aspect, it is preferable that the processor accepts a first operation input from the deliverer, selects a second still image from the video, and delivers the second still image to the user terminal instead of the first still image, or delivers the first still image and the second still image to the user terminal.

[0011] In the fourth aspect of the present invention, it is preferable that the image delivery device in the third aspect includes a first display that displays a first still image, and when a second still image is selected, the processor causes the first display to display the first still image, accepts a first operation input that advances or rewinds the video frame by frame based on the first still image, displays the second still image on the first display in place of the first still image, and selects the second still image based on the first operation input.

[0012] In the image distribution device of the fifth aspect of the present invention, in the fourth aspect, it is preferable that the processor selects the second still image displayed on the first display by a first operation input for frame forward or frame rewind, when the processor receives a first operation input indicating a decision.

[0013] In the image delivery device of the sixth aspect of the present invention, in any of the first to fifth aspects, it is preferable that the processor accepts a second operation input from the deliverer and generates a third still image by editing the first still image, and delivers the third still image to the user terminal in place of the first still image, or delivers the first still image and the third still image to the user terminal.

[0014] In the image distribution device of the seventh aspect of the present invention, in any of the first to sixth aspects, it is preferable that the processor distributes the video within a limited distribution period and extracts a first still image from the video based on the magnitude of reaction information in the time axis direction of the video.

[0015] In the image delivery device of the eighth aspect of the present invention, in any of the first to seventh aspects, it is preferable that the processor delivers a video within a limited delivery period, counts the total number of reaction information pieces to the video, and determines the number of first still images to extract from the video based on the total number of reaction information pieces.

[0016] In the image delivery device of the ninth aspect of the present invention, in any of the first to eighth aspects, it is preferable that the processor sets the number of first still images to be extracted from the video to a set specified value when the total number of reaction information is less than a first threshold, and increases the number of first still images to be extracted from the video from the specified value when the total number of reaction information is equal to or greater than the first threshold.

[0017] In the image distribution device of a tenth aspect of the present invention, in any of the first to seventh aspects, it is preferable that the processor distributes a video for a limited distribution period, measures the magnitude of reaction information in the time axis direction of the video after distribution of the video has ended, counts the number of times the magnitude of the reaction information is equal to or greater than a second threshold, and determines the number of first still images to extract from the video based on the number of times.

[0018] In the image delivery device of the 11th aspect of the present invention, in any of the first to tenth aspects, it is preferable that the processor sets the number of first still images to be extracted from the video to a specified value when the number of times is less than a set specified value, and corresponds the number of first still images to be extracted from the video to the number of times when the number of times is equal to or greater than the specified value.

[0019] In the image delivery device of the 12th aspect of the present invention, in any of the 1st to 11th aspects, it is preferable that the processor determines a video to be associated with a first still image to be delivered to a user terminal, and embeds access information for accessing the video in the first still image.

[0020] In the image delivery device according to a thirteenth aspect of the present invention, in any one of the first to twelfth aspects, it is preferable that the access information is embedded in the first still image as a two-dimensional code or a digital watermark.

[0021] The invention of the 14th aspect is an image distribution system comprising an image distribution device of any one of the 1st to 13th aspects and a user terminal, wherein the user terminal comprises a second display that displays a video and a first still image distributed from the image distribution device, and receives user reaction information through user operation during the period when the video is displayed on the second display, and transmits the reaction information to the image distribution device.

[0022] In the image distribution system of the 15th aspect of the present invention, in the 14th aspect, the user terminal includes a first user terminal owned by a paying user and a second user terminal owned by a non-paying user, and it is preferable that the first user terminal accepts reaction information for a paying user different from the second user terminal through user operation and transmits the reaction information for the paying user to the image distribution device.

[0023] In the image distribution system of the 16th aspect of the present invention, in the 14th or 15th aspect, it is preferable that the processor transmits the aggregated results of the reaction information obtained from the multiple user terminals to the multiple user terminals, and the user terminals display the aggregated results of the reaction information on a second display.

[0024] An image distribution system according to a seventeenth aspect of the present invention, in any of the fourteenth to sixteenth aspects, preferably includes a printer connected to a user terminal, and when the user terminal receives a user operation to output the first still image displayed on the second display to the printer, it preferably causes the first still image to be printed out by the printer.

[0025] An eighteenth aspect of the present invention provides the image delivery system of the seventeenth aspect, wherein the user operation for causing the printer to output the first still image is an operation for purchasing the first still image.

[0026] In the image distribution system of the 19th aspect of the present invention, in the 17th or 18th aspect, the processor determines a video to be associated with a first still image to be distributed to a user terminal, embeds access information for accessing the video in the first still image, and upon receiving a video distribution request from the user terminal using the access information, transmits the video to the user terminal, and the user terminal preferably has a reader that reads the access information from a printed out photo print, and upon reading the access information using the reader, requests the image distribution device to distribute the video using the access information, and upon receiving the video from the image distribution device, displays the video on the second display.

[0027] In the image delivery system according to a twentieth aspect of the present invention, in the nineteenth aspect, it is preferable that the processor, when delivering a video, adds a special effect to the video according to the reaction information.

[0028] The invention of the 21st aspect is an image distribution method in which one or more processors execute each of the following steps: distributing a video to a plurality of user terminals; acquiring user reaction information to the distributed video from one or more user terminals; extracting one or more first still images from the video based on the reaction information; and distributing the one or more first still images to the user terminals.

[0029] The invention of the 22nd aspect is an image distribution program that causes a computer to realize the following functions: distributing a video to multiple user terminals; acquiring user reaction information to the video distributed from one or more user terminals; extracting one or more first still images from the video based on the reaction information; and distributing the one or more first still images to the user terminals.

[0030] FIG. 1 is a block diagram showing an image distribution system according to the present invention. FIG. 2 is a block diagram showing an embodiment of the hardware configuration of an image distribution device according to the present invention. FIG. 3 is a block diagram showing an embodiment of the hardware configuration of a user terminal constituting the image distribution system shown in FIG. 1. FIG. 4 is a diagram showing an example of an instax print. FIG. 5 is a diagram showing an example of information managed by a user management database (DB). FIG. 6 is a diagram showing an example of information managed by an image database (DB). FIG. 7 is a flowchart showing an embodiment of an image distribution method according to the present invention, particularly a flowchart used to explain the flow from the creation of a video to be distributed to the end of distribution of the video. FIG. 8 is a diagram showing an image of a screen displayed on a display device of a user terminal during video distribution. FIG. 9 is the same flowchart as FIG. 7, particularly a flowchart used to explain the flow from the end of video distribution to the extraction, editing, and distribution of still images for printing. FIG. 10 is a histogram showing the number of reactions to the playback time of a video. FIG. 11 is a diagram showing an image of a still image suggestion screen displayed on a display device of an image distribution device. FIG. 12 is a diagram showing an image of an editing screen displayed on a display device of an image distribution device. Fig. 13 is a diagram showing a screen proposing a distribution video to be associated with a still image displayed on the display of the image distribution device. Fig. 14 is the same flowchart as that shown in Fig. 7, and is used to explain the flow of purchasing / printing a distributed still image and viewing a video associated with a purchased still image. Fig. 15 is a diagram showing an image of the screen of a user terminal when purchasing / printing a still image.

[0031] Hereinafter, preferred embodiments of an image distribution device, method, program, and image distribution system according to the present invention will be described with reference to the accompanying drawings.

[0032] [Image Distribution System] FIG. 1 is a configuration diagram showing an image distribution system according to the present invention.

[0033] The image distribution system 10 shown in Figure 1 includes an image distribution device 100 that functions as a distribution server, a plurality of user terminals 200 that communicate with the image distribution device 100 via a network NW, and a distribution video creation device 300.

[0034] A printer 400 can be connected to the user terminal 200. The user terminal 200 transmits images (still images) to be printed, which are distributed from the image distribution device 100, to the printer 400 wirelessly or via a wired connection, and the printer 400 prints out the still images received from the user terminal 200.

[0035] The streaming video creation device 300 is a device with a video shooting function owned by an artist (singer, actor, talent, idol, etc.) in the fields of entertainment, music, etc. The artist uploads videos shot (created) using the streaming video creation device 300 to the image delivery device 100, or uploads a video selected from videos saved in the camera roll to the image delivery device 100. Note that the streaming video creation device 300 can be a smartphone, a digital camera, a tablet terminal with a video shooting function, etc.

[0036] The image delivery device 100 is a manager device that manages the image delivery system 10 and may also serve as the delivery video creation device 300 .

[0037] The image delivery device 100 creates, modifies, and delivers a video to be delivered, extracts still images for printing from the video, and proposes the extracted still images to the user terminal 200. Furthermore, when a delivery request for a still image for printing is received from a user terminal 200, the image delivery device 100 delivers the received still image to the corresponding user terminal 200.

[0038] The user terminal 200 is a terminal of a general user, such as a fan of an artist, and plays the video delivered from the image delivery device 100 and displays suggested still images for printing extracted from the video. When the general user wishes to obtain a desired still image as a photo print based on the suggested still image displayed on the user terminal 200 (when purchasing the right to print the photo), the general user specifies the desired still image and makes a request for delivery of the still image to the image delivery device 100.

[0039] When the image delivery device 100 receives a delivery request from a user terminal 200 , it delivers a still image corresponding to the delivery request to the corresponding user terminal 200 .

[0040] When the user terminal 200 receives a still image corresponding to the delivery request from the image delivery device 100, it transmits the received still image to the printer 400, and the printer 400 prints out the still image received from the user terminal 200 as a photographic print.

[0041] [Image Delivery Apparatus] FIG. 2 is a block diagram showing an embodiment of the hardware configuration of an image delivery apparatus according to the present invention.

[0042] In FIG. 2, the image delivery device 100 is configured, for example, by a computer, a workstation, etc., and includes a communication unit 110, one or more processors 120, a memory 130, an operation unit 140, a display (first display) 150, a user management database (DB) 160, an image database (DB), and an input / output interface (not shown), etc.

[0043] As shown in FIG. 1, the communication unit 110 communicates with the user terminal 200 and the streaming video production device 300 via the network NW, and exchanges necessary information.

[0044] The processor 120 is made up of a CPU (Central Processing Unit) and other components, and controls all the components of the image delivery device 100, and extracts still images suitable for printing from the video. Details of the extraction process for extracting still images for printing from the video will be described later.

[0045] The memory 130 includes a flash memory, a read-only memory (ROM), a random access memory (RAM), a hard disk drive, etc. The flash memory, ROM, or hard disk drive is a non-volatile memory that stores an operating system, various programs including an image distribution program that executes the image distribution method according to the present invention, etc.

[0046] The RAM functions as a work area for processing by the processor 120. It also temporarily stores various programs stored in flash memory, etc., and data used in arithmetic processing. Note that the processor 120 may incorporate part of the memory 130 (RAM).

[0047] The operation unit 140 includes a keyboard, a mouse, a touch panel, etc., and is a part that accepts various operational inputs from the manager, and the display unit 150 displays frames of video and still images extracted from the video, and also displays a screen for operation on the operation unit 140. In other words, the operation unit 140 and the display unit 150 function as a user interface.

[0048] The user management DB 160 is a database that manages information about users to whom videos and still images are delivered from the image delivery device 100, and the image DB 170 is a database that manages delivered videos, still images extracted from the delivered videos, and other content.

[0049] The details of the user management DB 160 and the image DB 170 will be described later. As hardware for storing the data sets of the user management DB 160 and the image DB 170, an internal memory of the image delivery device 100 or an external memory accessible by the image delivery device 100 can be applied.

[0050] Furthermore, the user interface including the operation unit 140 and the display unit 150 can use connected devices connected to the network NW.

[0051] [User Terminal] FIG. 3 is a block diagram showing an embodiment of the hardware configuration of a user terminal that constitutes the image distribution system shown in FIG.

[0052] The user terminal 200 shown in FIG. 3 is configured as a smartphone, a notebook computer, a tablet terminal, or the like owned by a general user, but the following description will be given taking a smartphone as an example.

[0053] The user terminal 200 includes a processor 210, a memory 220, an operation unit 230, a wireless communication unit 240, a display (second display) 250, a camera 260, a short-range wireless communication unit 270, a microphone, a speaker, etc. (not shown).

[0054] The processor 210 is composed of a CPU and other components, and controls each part of the user terminal 200 in an integrated manner, and also executes application software for receiving services provided by the image delivery device 100, thereby exchanging various types of information with the image delivery device 100.

[0055] The memory 220 includes a flash memory, a RAM, and another flash memory, etc. The flash memory is a rewritable non-volatile memory that stores an operating system, application software, etc.

[0056] The RAM functions as a work area for processing by the processor 210. It also temporarily stores various programs stored in flash memory or the like, data used for arithmetic processing, etc. The processor 210 may have a built-in RAM.

[0057] The operation unit 230 is a hardware key that includes key switches for turning the power on and off, adjusting the volume, etc., and receives instructions from the user.

[0058] The wireless communication unit 240 is a part that performs wireless communication with a carrier's base station, other access points, and external devices via the network NW.

[0059] The display 250 is a touch panel type display having a touch panel on the display surface, and displays images (moving images, still images) and also functions as a user interface that displays an operation screen and accepts operations on the touch panel.

[0060] Camera 260 captures still images and videos by selecting the shooting mode, but also functions as a reading device that reads two-dimensional codes (e.g., QR Code (registered trademark)) using code reading software and reads digital watermark information using digital watermark reading software.

[0061] The short-range wireless communication unit 270 is a part that uses, for example, Bluetooth (registered trademark) or the like and performs short-range wireless communication with a paired external device. In this example, the short-range wireless communication unit 270 performs short-range wireless communication with a printer 400 owned by the owner of the user terminal 200, and transmits an image to be printed to the printer 400.

[0062] Printer 400 uses instant film (for example, "Instax film" manufactured by Fujifilm Corporation ("Instax" is a registered trademark)) as a printing medium, and prints the image onto the Instax film by exposing an image onto the exposure area of ​​the Instax film using an exposure head and spreading a developer onto the exposure area, outputting it as a photographic print (Instax print).

[0063] FIG. 4 is a diagram showing an example of an instax print.

[0064] As shown in FIG. 4, the instax film has an exposure area 402a, a developing solution pod 402b containing a developing solution, and a trap portion 402c containing an absorbent material.

[0065] As the instax film is transported by the capstan roller of the printer 400, an exposure head exposes an exposure area 402a to image light. As the instax film passes between a pair of spreading rollers of the printer 400, the developing solution in the developing solution pod 402b is squeezed out of the instax film, which is then spread and developed in the exposure area 402a. During this development, excess developing solution is captured in a trap section 402c. In this way, the instax film is exposed and developed by the printer 400 and output as an instax print 402.

[0066] 4, reference numeral 404 denotes a QR code embedded in the image of the instax print, and the QR code 404 contains information related to the printed image. The use of this QR code 404 will be described later.

[0067] The printer 400 is not limited to an instax printer that uses instax film, but may be an inkjet printer, a thermal printer, or another type of printer.

[0068] <User Management DB> Next, an embodiment of the user management DB 160 shown in FIG. 2 will be described.

[0069] FIG. 5 is a diagram illustrating an example of information managed by the user management DB.

[0070] 5, the user management DB stores information such as the user name, user account, gender, age, and whether the user is a paying user or a non-paying user. Other information such as the terminal identification information of the user terminal 200 owned by the user and the printer identification information of the printer 400 (e.g., serial number) can also be registered.

[0071] When a user of the user terminal 200 receives an image delivery service from the image delivery device 100, the user downloads application software corresponding to the service. The application software can be downloaded from the image delivery device 100 or from other sites related to instax prints.

[0072] When the application software is downloaded to the user terminal 200 and executed, if the user is not yet registered, the process transitions to user registration, where the user operates the user terminal 200 to send the user information shown in Fig. 5 from the user terminal 200 to the image delivery device 100. As a result, the user is registered in the user management DB 160 as a new user.

[0073] Once user registration is complete, the application software can store the user's account and other information on the user terminal 200, and when the application software is subsequently executed, the user can receive the service.

[0074] <Image DB> Next, an embodiment of the image DB 170 shown in FIG. 2 will be described.

[0075] FIG. 6 is a diagram showing an example of information managed by the image DB.

[0076] As shown in Fig. 6, the image DB uses video identification information for uniquely identifying a video as a primary key, and stores videos (distributed videos), still images extracted from the videos, and audio and text messages related to the videos, all associated with the video identification information. Information about the creator of the distributed video can also be registered. The QR code 404 shown in Fig. 4 is a two-dimensional code that includes video identification information.

[0077] As described above, an artist who creates a video uploads a video taken using the video-on-demand creation device 300 (see FIG. 1 ) to the image delivery device 100, or uploads a video selected from videos saved in the camera roll to the image delivery device 100. The artist can also create a voice message, a text message, or the like as content to accompany the video to be uploaded, and send it to the video-on-demand creation device 300 together with the image.

[0078] When a video is uploaded from the video distribution creation device 300, the image distribution device 100 issues video identification information that uniquely identifies the video, and registers the video, still images extracted from the video, and content associated with the video in the image DB 170 in association with the video identification information.

[0079] As the moving image identification information, for example, a serial number, a time stamp, a GS1 code, etc. can be used.

[0080] [Image Distribution Method] FIG. 7 is a flowchart showing an embodiment of an image distribution method according to the present invention. Flow A shown in a box indicates the flow from the creation of a video to be distributed to the end of distribution of the video.

[0081] 7, the artist selects a distribution video from the camera roll of the distribution video creation device 300, which is the artist's smartphone, or acquires a video shot via the shooting function of application software, sets a desired distribution time (for example, several minutes to several days), and creates a distribution draft (step S10). Note that step S10 can be skipped.

[0082] The processor 120 of the manager's image distribution device 100 accepts the distribution draft created in step S10 from the distribution video creation device 300, or if step S10 is skipped, the manager creates a distribution draft in the distribution video creation device 300 in the same manner as described above, and distributes the distribution video to the user terminal 200 of the registered user according to the set distribution time (step S12).

[0083] The manager can use the editing function of the image delivery device 100 to generate a video to be delivered by performing color correction, noise removal, etc. Also, the manager can narrow down the destination users according to the user attributes and deliver the video to the user terminals 200 of the narrowed down users. For example, the destination users can be narrowed down to paying users, or by age, gender, etc.

[0084] When distributing a video, the processor 120 of the image delivery device 100 sends a push notification to the user terminal 200. When the push notification arrives at the application software of the user (fan)'s user terminal 200, the user terminal 200 transitions to a state in which the distributed video can be played. When an icon indicating playback of the distributed video is tapped on the screen of the display 250, the user terminal 200 starts playback of the distributed video (step S14).

[0085] FIG. 8 is a diagram showing a screen image displayed on the display of the user terminal during video distribution.

[0086] As shown in Figure 8, the screen of the display 250 of the user terminal 200 displays a display area 410 in which the distributed video is displayed, multiple icons 412, 414, 416 for inputting user reactions (reaction information), and the number of reactions for each type of reaction.

[0087] Here, icon 412 is an icon indicating "good," icon 414 is an icon indicating "bad," and icon 416 is a "special" icon that can only be selected by paying users.

[0088] That is, the user terminals 200 are divided into user terminals (first user terminals) owned by paying users and user terminals (second user terminals) owned by non-paying users, and the first user terminals owned by paying users can accept, through user operation, reaction information (reactions) for paying users that is different from that of the second user terminals owned by non-paying users, and the "Special" icon 416 can be displayed and operated only on the first user terminals owned by paying users.

[0089] The user can input a reaction by operating icons 412, 414, and 416 while viewing the distribution video displayed in display area 410. When a reaction is input, user terminal 200 transmits the type of reaction and a timestamp indicating the playback time of the video to image distribution device 100 (step S16).

[0090] It is preferable to limit the number of reactions that can be input using one user terminal 200, or the time interval between inputting one reaction and inputting the next reaction, in order to prevent one user from inputting multiple reactions to a particular scene or frame of the video being distributed.

[0091] FIG. 9 is a flowchart showing an embodiment of an image distribution method according to the present invention. Flow B shown in the box shows the flow from the end of distribution of a moving image to the extraction, editing, and distribution of a still image for printing.

[0092] 9 , the processor 120 of the image delivery device 100 ends the delivery of the video when a set delivery time has elapsed since the start of the video delivery (step S20). Subsequently, during the delivery time, the processor 120 acquires reactions (user reaction information) to the video from the user terminal 200, and automatically extracts one or more still images (first still images) from the delivered video based on the acquired reactions (step S22).

[0093] FIG. 10 is a histogram showing the number of reactions to the playback time of a video.

[0094] In the histogram shown in FIG. 10, the horizontal axis indicates the playback time of the video, and the vertical axis indicates the number of reactions (reaction information) per unit time along the time axis of the video.

[0095] The processor 120 of the image distribution device 100 can create the histogram shown in Figure 10 by counting, for example, the total number of reactions per unit time in the time axis direction of the video based on the type of reactions and timestamps received from multiple user terminals 200.

[0096] 10 is, for example, the number of times the "good" icon 412 is operated, but the number of times the "bad" icon 414 is operated may be counted as a negative number. Furthermore, the number of times the "special" icon 416, which can only be operated by paying users, is operated may be weighted and counted. For example, one operation of the "special" icon 416 may be counted as multiple operations of the "good" icon 412. This allows the reactions of paying users to be weighted more heavily than the reactions of non-paying users, allowing the reactions of paying users to be reflected more heavily in the total number of reactions than the reactions of non-paying users.

[0097] The types of reactions are not limited to those mentioned above, and weighting of reaction points according to the type of reaction can be set as appropriate. Furthermore, weighting of reaction points may be changed according to membership type (user attribute).

[0098] <When the number of still images is fixed> The number of still images extracted from one video can be fixed to a preset number (for example, six).

[0099] When a video is distributed for a limited period of time, the processor 120 of the image distribution device 100 extracts still images from the video based on the magnitude (frequency) of reaction information along the time axis of the video.

[0100] When extracting six still images from a moving image based on the histogram shown in FIG. 10, the processor 120 can extract the frames corresponding to the top six peaks in the histogram as still images.

[0101] In addition, it is preferable that the processor 120 distinguishes between scenes in the video and limits the selection of still images to one from each scene, or limits the selection of still images so that they are not concentrated in a specific time period in the video. Furthermore, in the case of a video of an idol group, it is preferable that all members of the idol group select at least one still image.

[0102] <Narrowing Down Still Images by Image Analysis> The processor 120 of the image delivery device 100 performs image analysis on the delivered video frame by frame, so as not to select any inappropriate frames (still images) for printing.

[0103] Still images that are unsuitable for printing include those with closed eyes, blown-out highlights, blocked-up shadows, out-of-focus images, ghost images, and the like.

[0104] The processor 120 analyzes the distributed video and extracts still images from the video based on the reaction information (reactions) and the analysis results of the video. That is, the processor 120 first analyzes the video and eliminates still images that are inappropriate as still images for printing, and then extracts still images from the remaining still images that match the user's reactions (preferences) based on the number of reactions, etc.

[0105] <When the number of still images is variable> When a video is distributed with a limited distribution period, the processor 120 of the image distribution device 100 counts the total number of reaction information (reactions) for the video and determines the number of still images to extract from the video based on that total number.

[0106] However, the minimum number of still images to be extracted from one moving image can be set to a predetermined value (for example, six).

[0107] The processor 120 counts the total number of reaction information (reactions) for one video, and if the total number of reactions is less than a first threshold, it sets the number of still images to be extracted from the video to a set default value, and if the total number of reactions is equal to or greater than the first threshold, it increases the number of still images to be extracted from the video from the default value.

[0108] In this case, the processor 120 can gradually increase the number of still images extracted from the video in accordance with the difference between the total number of reactions and the first threshold value. Also, an upper limit on the number of still images can be set, and the processor 120 can limit the number of still images to be added so that it does not exceed the upper limit.

[0109] Furthermore, the processor 120 can measure the magnitude of reaction information (reactions) along the time axis of the video after distribution of the video ends, count the number of times the reaction magnitude is equal to or greater than a second threshold, and determine the number of still images to extract from the video based on the number of times. For example, the processor 120 can create a histogram as shown in Figure 10, count the number of peaks in this histogram whose peak value is equal to or greater than a second threshold (threshold Th shown in Figure 10), and determine the number of still images to extract from the video based on the number of peaks.

[0110] In addition, if the number of times the magnitude of the reaction is greater than or equal to the second threshold is less than a set specified value (e.g., less than 6), the processor 120 can set the number of still images to be extracted from the video to a specified value (e.g., 6), and if the number of times the magnitude of the reaction is greater than or equal to the specified value, the processor 120 can increase the number of still images to be extracted from the video to correspond to that number (to more than the specified value).

[0111] Furthermore, if the total number of reactions exceeds a specified value, the distribution period of the video may be shortened.

[0112] Returning to FIG. 9, when the processor 120 of the image delivery device 100 extracts still images for printing from the moving image as described above, it automatically suggests the extracted still images (step S22).

[0113] FIG. 11 is a conceptual diagram of a still image proposal screen displayed on the display of the image delivery device.

[0114] The proposal screen shown in FIG. 11 displays reduced images (thumbnail images) of six still images automatically extracted from the video, and displays the message "How about these six images?"

[0115] The proposal screen also displays a distribution button 420 for instructing distribution of a still image, and an edit button 422 for instructing editing.

[0116] The manager decides whether or not to distribute the six still images displayed on the proposal screen, and if so, taps the distribution button 420; if he or she decides that editing (including changing to other still images) is necessary, he or she taps the edit button 422.

[0117] When the edit button 422 is tapped, the processor 120 of the image delivery device 100 edits and confirms the still image to be delivered based on the operational input of the manager (step S24).

[0118] FIG. 12 is a diagram showing an image of an editing screen displayed on the display of the image delivery device.

[0119] When a manager edits a still image on the still image proposal screen shown in Figure 11, he or she taps the thumbnail of the still image he or she wishes to edit and then taps the edit button 422, which transitions to the editing screen shown in Figure 12.

[0120] 12, the still image to be edited is displayed in a display area 430. The editing screen also displays a display area 424 that displays a timeline of the video, the number of reactions for each type of reaction to the still image to be edited displayed in the display area 430, and icon buttons for frame-forward and frame-reverse of the still image (video frame) to be edited displayed in the display area 430.

[0121] The processor 120 of the image delivery device 100 receives an operation input (first operation input) from the manager (deliverer) and selects a still image (second still image) to be delivered from the video. That is, the processor 120 selects the still image displayed on the display 150 in response to an operation input for frame forward or frame rewind, when the processor 120 receives an operation input indicating a decision.

[0122] This allows the processor 120 to set the second still image selected by the manager as the still image for distribution (printing) instead of the automatically selected still image (first still image), and to distribute the second still image selected by the manager, or multiple still images that are a mixture of the automatically selected first still image and the second still image selected by the manager, instead of the automatically selected first still image.

[0123] In the example shown in Figure 12, when the manager selects a second still image to be distributed, he displays the automatically selected still image to be edited (first still image) in the display area 430, and operates the frame forward button 426 or the frame back button 428 to advance or rewind the video frame by frame based on the first still image, thereby selecting another still image (second still image) near the first still image.

[0124] The manager can switch (select) the still image displayed in the display area 430 by operating the frame forward button 426 or the frame back button 428. In addition, the processor 120 can display the number of reactions for each type of reaction according to the current still image displayed in the display area 430, and the manager can refer to the number of reactions when selecting a still image.

[0125] In addition, when the still image displayed in the display area 430 is switched by operating the frame advance button 426 or the frame rewind button 428, the position of the still image to be edited on the timeline shown in the display area 424 (the position indicated by the diagonal line) can also be changed.

[0126] Furthermore, processor 120 can receive a second operation input from the manager (distributor) and generate a third still image by editing the still image to be edited (first still image). That is, the manager performs an operation to instruct brightness correction, color correction, trimming, etc. of the still image to be edited displayed in display area 430, thereby causing processor 120 to perform various image processing operations corresponding to the operation input.

[0127] When the editing is completed, the manager can operate an edit end button (not shown) to transition to the still image proposal screen shown in FIG.

[0128] In this way, the six automatically suggested still images can be edited individually. Note that this editing step can be skipped, in which case the still images automatically extracted from the video will be the still images that are distributed as they are.

[0129] Next, the processor 120 sets the video to be associated with the still image to be distributed (step S26 in FIG. 9).

[0130] FIG. 13 is a diagram showing a screen proposing a distribution video to be associated with a still image displayed on the display of the image distribution device.

[0131] 13, the distribution video suggestion screen displayed on the display 150 of the image distribution device 100 displays the message "Do you want to set an attached video?" for each of the six still images. The distribution video suggestion screen also displays a button 440 for instructing association of the still image to be distributed with the corresponding video, and a button 442 for not instructing association.

[0132] On this proposal screen, the manager can select whether or not to associate a video with the still image to be distributed by operating the association instruction button 440 or the no association instruction button 442. Here, the video to be associated with the still image to be distributed is a video extracted from that still image, and associating a video with a still image means embedding, in the still image, information required to access the "video" associated with the still image, as shown below.

[0133] The information embedded in the still image is moving image identification information that uniquely identifies the "moving image" corresponding to the still image, and in this example is a QR code in which the moving image identification information is coded.

[0134] In addition, the content to be associated with a still image can include the video used to extract the still image, as well as audio messages, text messages, etc. created by the artist or manager to associate with the video, and it is possible to set whether or not to associate these contents.

[0135] Once the setting of whether to associate a video with the still image to be distributed is complete, the processor 120 distributes the six still images extracted automatically / manually to the user terminal 200 of the registered user (step S28).

[0136] FIG. 14 is a flowchart showing an embodiment of an image distribution method according to the present invention, and flow C shown in the box indicates the flow of purchasing (printing out) a distributed still image and viewing a video accompanying the purchased still image.

[0137] 14 , when a still image is delivered, the processor 120 of the image delivery device 100 sends a push notification to the user terminal 200. When the application software of the user terminal 200 receives the push notification regarding the still image delivery, the user terminal 200 transitions to a screen where the delivered still image can be purchased / printed (step S30).

[0138] FIG. 15 is a diagram showing an image of the screen of a user terminal when purchasing / printing a still image.

[0139] In this example, still images for printing can be purchased within a certain period (for example, 10 minutes) set by the distributor, and after the certain period has elapsed, the distributed still images are deleted from the user terminal 200 by a function of the application software.

[0140] 15, the user swipes as indicated by the arrow on the screen of the user terminal 200 to select and display a desired still image from the six still images delivered in chronological order. In the example shown in Fig. 15, the currently selected still image is displayed in the center of the screen, with portions of the previous and next still images (still images that are smaller than the currently selected still image) displayed to the left and right of it. The remaining time available for purchasing (printing) the still image for printing is also displayed on the screen of the user terminal 200.

[0141] When the user selects a desired still image by swiping (displaying it in the center of the screen) and then taps button 452 instructing purchase of the still image, user terminal 200 transmits the still image selected by the user to printer 400. Printer 400 prints the still image to be printed received from user terminal 200 and outputs an instax print 402 (see FIG. 4 ) on which the still image is printed.

[0142] This allows the user to obtain the instax print 402 on which the purchased still image is printed (step S32).

[0143] Furthermore, when printing by the printer 400 is completed normally, the user terminal 200 transmits information such as the identification information of the printed still image and the time of printing to the image delivery device 100, and the image delivery device 100 performs billing processing for the sale of the still image.

[0144] In this example, when the distributed still images for printing are printed out by the printers 400 connected to the multiple user terminals 200, the image distribution device 100 sequentially calculates the tally results (number of prints) of purchases (response information) and transmits the tally results to each user terminal 200, thereby displaying the ever-changing tally results on the display (second display) of the user terminal 200. In addition, the user terminal 200, using the function of the application software that receives the tally results, ejects instax prints from the icon 460 representing the printer, and displays an animation showing the instax prints increasing in number.

[0145] In addition, when the image distribution device 100 sets a video to be associated with a still image on the distribution video proposal screen shown in Figure 13, the image distribution device 100 makes it possible to view the associated video, and the user can view the video on the user terminal 200 using the instax print 402 (step S34).

[0146] When a setting is made to associate a video with a still image, the processor 120 of the image delivery device 100 embeds a QR code containing access information for accessing the video in the still image to be printed, and delivers the still image with the embedded QR code.

[0147] The instax print 402 shown in Figure 4 was printed by a printer 400 that received a still image with an embedded QR code from the user terminal 200, and a QR code 404 is printed in the lower right position of the image in the exposure area 402a.

[0148] By using the instax print 402 on which the QR code 404 is printed, the user can view the video that was used to extract the still image printed on the instax print 402. When viewing the video, the user has the camera 260 of the user terminal 200, which functions as a reader that reads QR codes, read the QR code 404 embedded in the image of the instax print 402.

[0149] When the user terminal 200 reads the QR code 404 , it transmits a request to view the video identified by the video identification information contained in the QR code 404 to the image delivery device 100 .

[0150] In response to a request to view a video from the user terminal 200, the image delivery device 100 reads out a video corresponding to the request from the image DB 170, and delivers the read video to the user terminal 200. In this case, the processor 120 of the image delivery device 100 can add special effects according to reaction information (reactions) to the video and deliver it.

[0151] The user terminal 200 plays the distributed video and displays it on the display 250. This allows the user to view the video used to extract the still image printed on the instax print 402.

[0152] In addition to requesting viewing of a video, the user can also request viewing of other content such as a voice message or a text message associated with the video by reading the QR code 404 using the camera 260 of the user terminal 200.

[0153] Furthermore, the image delivery device 100 is not limited to embedding access information for accessing a video associated with a still image as a QR code in the still image to be delivered, but can also embed the access information as a digital watermark in the still image.

[0154] The digital watermark embedded in the still image cannot be seen by the naked eye on the instax print, but if the camera 260 is operated with a function (application software) that reads the digital watermark, the digital watermark can be read and a request to view the video can be made in the same way as with a QR code.

[0155] [Others] In this embodiment, the hardware structure of a processing unit that executes various processes, such as the processor 120 of the image delivery device 100, is the following various processors. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD), such as an FPGA (Field Programmable Gate Array), whose circuit configuration can be changed after manufacture, and a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing specific processes.

[0156] A single processing unit may be configured with one of these various processors, or may be configured with two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). Multiple processing units may also be configured with a single processor. Examples of multiple processing units configured with a single processor include: a first configuration, as typified by client or server computers, in which a single processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units; and a second configuration, as typified by system-on-chip (SoC), in which a processor is used to realize the functions of an entire system including multiple processing units on a single IC (Integrated Circuit) chip. In this way, the various processing units are configured with one or more of the above-mentioned various processors as a hardware structure.

[0157] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit made up of a combination of circuit elements such as semiconductor elements.

[0158] The present invention also includes an image delivery program that, when installed in a computer, causes the computer to function as the image delivery device according to the present invention, and a non-volatile storage medium on which this image delivery program is recorded.

[0159] Furthermore, the present invention is not limited to the above-described embodiment, and it goes without saying that various modifications are possible without departing from the spirit of the present invention.

[0160] 10...Image distribution system 100...Image distribution device 110...Communication unit 120, 210...Processor 130, 220...Memory 140, 230...Operation unit 150, 250...Display 160...User management DB 170...Image DB 200...User terminal 240...Wireless communication unit 260...Camera 270...Near-field wireless communication unit 300...Distribution video creation device 400...Printer 402...Instax print 402a...Exposure area 402b...Developing solution pod 402c...Trapping unit 404...QR code 410...Display area 412, 414, 416, 460...Icon 420...Distribution button 422...Edit button 424, 430...Display area 426...Frame advance button 428...Frame rewind button 440, 442, 452...Buttons NW...Network S10 to S34...Steps

Claims

1. An image delivery device having one or more processors and communicating with a plurality of user terminals, wherein the processor delivers a video to the plurality of user terminals, acquires user reaction information to the delivered video from one or more of the user terminals, extracts one or more first still images from the video based on the reaction information, and delivers the one or more first still images to the user terminals.

2. The image delivery device according to claim 1, wherein the processor analyzes the delivered video and extracts the first still image from the video based on the reaction information and the analysis results of the video.

3. The image distribution device of claim 1 or 2, wherein the processor receives a first operation input from the distributor to select a second still image from the video, and distributes the second still image to the user terminal instead of the first still image, or distributes the first still image and the second still image to the user terminal.

4. An image distribution device as described in claim 3, comprising a first display that displays the first still image, wherein the processor, when selecting the second still image, causes the first display to display the first still image, accepts the first operation input that advances or rewinds the video frame by frame based on the first still image, displays the second still image on the first display in place of the first still image, and selects the second still image based on the first operation input.

5. The image distribution device of claim 4, wherein the processor selects the second still image displayed on the first display by the first operation input for frame forward or frame rewind, when the processor receives the first operation input indicating a decision.

6. The image distribution device of claim 1 or 2, wherein the processor receives a second operation input from the distributor and generates a third still image by editing the first still image, and distributes the third still image to the user terminal in place of the first still image, or distributes the first still image and the third still image to the user terminal.

7. An image distribution device as described in claim 1 or 2, wherein the processor distributes the video for a limited distribution period, and extracts the first still image from the video based on the magnitude of the reaction information in the time axis direction of the video.

8. An image distribution device as described in claim 1 or 2, wherein the processor distributes the video for a limited distribution period, counts the total number of pieces of reaction information to the video, and determines the number of first still images to extract from the video based on the total number of pieces of reaction information.

9. The image distribution device described in claim 8, wherein the processor sets the number of first still images to be extracted from the video to a set specified value when the total number of reaction information pieces is less than a first threshold, and increases the number of first still images to be extracted from the video from the specified value when the total number of reaction information pieces is equal to or greater than the first threshold.

10. An image distribution device as described in claim 1 or 2, wherein the processor distributes the video for a limited distribution period, measures the magnitude of the reaction information in the time axis direction of the video after distribution of the video has ended, counts the number of times the magnitude of the reaction information is equal to or greater than a second threshold, and determines the number of first still images to extract from the video based on the number of times.

11. The image distribution device described in claim 10, wherein the processor sets the number of first still images to be extracted from the video to the specified value when the number of times is less than a set specified value, and when the number of times is equal to or greater than the specified value, corresponds the number of first still images to be extracted from the video to the number of times.

12. An image delivery device as described in claim 1 or 2, wherein the processor determines a video to be associated with the first still image to be delivered to the user terminal, and embeds access information for accessing the video in the first still image.

13. The image delivery device according to claim 12, wherein the access information is embedded in the first still image as a two-dimensional code or a digital watermark.

14. An image distribution system comprising the image distribution device of claim 1 and a user terminal, wherein the user terminal comprises a second display that displays the video and the first still image distributed from the image distribution device, and receives user reaction information through user operation while the video is displayed on the second display, and transmits the reaction information to the image distribution device.

15. The image distribution system described in claim 14, wherein the user terminals include a first user terminal owned by a paying user and a second user terminal owned by a non-paying user, and the first user terminal accepts reaction information for a paying user different from the second user terminal through user operation, and transmits the reaction information for the paying user to the image distribution device.

16. The image distribution system of claim 14, wherein the processor transmits the aggregated results of the reaction information obtained from the plurality of user terminals to the plurality of user terminals, and the user terminals display the aggregated results of the reaction information on the second display.

17. An image distribution system as described in claim 14 or 16, further comprising a printer connected to the user terminal, wherein the user terminal, upon receiving a user operation to output the first still image displayed on the second display to the printer, causes the printer to print out the first still image.

18. The image distribution system according to claim 17, wherein the user operation that causes the printer to output the first still image is an operation to purchase the first still image.

19. The image distribution system described in claim 17, wherein the processor determines a video to be associated with the first still image to be distributed to the user terminal, embeds access information for accessing the video in the first still image, and upon receiving a request for distribution of the video using the access information from the user terminal, transmits the video to the user terminal, and the user terminal is equipped with a reader that reads the access information from the printed out photo print, and upon reading the access information using the reader, requests the image distribution device to distribute the video using the access information, and upon receiving the video from the image distribution device, displays the video on the second display.

20. The image distribution system according to claim 19, wherein the processor adds a special effect to the video in accordance with the reaction information when distributing the video.

21. An image distribution method in which one or more processors execute each of the following steps: distributing a video to a plurality of user terminals; acquiring user reaction information to the distributed video from one or more of the user terminals; extracting one or more first still images from the video based on the reaction information; and distributing the one or more first still images to the user terminals.

22. An image distribution program that causes a computer to perform the following functions: a function to distribute a video to multiple user terminals; a function to acquire user reaction information to the distributed video from one or more of the user terminals; a function to extract one or more first still images from the video based on the reaction information; and a function to distribute one or more of the first still images to the user terminals.

23. A non-transitory computer-readable recording medium on which the program according to claim 22 is recorded.

Images