Device and method

Abstract

The purpose of the present invention is to provide a device and a method with which a break that does not hinder viewing of a video can be determined.　A video distribution server 100 of the present disclosure comprises: an acquisition unit 101 that acquires frames which constitute a video; and a selection unit 102 that acquires cut point frames on the basis of the magnitude of a change between adjacent frames among the frames, and that selects, as a break, a cut point frame that satisfies a break condition from among the cut point frames. In the present disclosure, the break is an insertion position for an advertisement, but it may be for something other than an advertisement. The break also may be a position indicating a break which simply indicates a change in the content of the video.

Description

Apparatus and method

[0001] The present invention relates to an apparatus and method for determining segments of a moving image.

[0002] Patent Document 1 describes that when the video advertisement playback time is reached, an advertisement is read and distributed. That is, the device described in Patent Document 1 includes means for playing a video program file transmitted from a program distribution server, means for measuring the playback time of the video program file, means for pausing playback of the video program file when the advertisement insertion time is reached, means for outputting a video advertisement file distribution request to the advertisement distribution server, means for playing the transmitted video advertisement file, and means for resuming playback of the video program file when playback of the video advertisement file is completed.

[0003] Japanese Patent Application Laid-Open No. 2003-244677

[0004] However, since advertisements are not inserted with consideration given to the content of the video, there are cases where advertisements are viewed during important scenes.

[0005] Therefore, an object of the present invention is to provide an apparatus and method that can determine divisions that do not interfere with the viewing of a video.

[0006] The present invention comprises an acquisition unit that acquires frames that constitute a moving image, and a selection unit that acquires cut point frames based on the magnitude of change between adjacent frames among the frames that constitute the moving image, and selects cut point frames from the cut point frames that satisfy a division condition as divisions.

[0007] According to the present invention, it is possible to determine breaks that do not interfere with the viewing of a video.

[0008] FIG. 1 is a diagram illustrating a system configuration of a video distribution system according to the present disclosure. FIG. 2 is a block diagram illustrating a functional configuration of a video distribution server 100 according to the present disclosure. FIG. 3 is an explanatory diagram illustrating a first approach (video analysis approach) for determining an advertisement insertion position. FIG. 4 is an explanatory diagram illustrating a second approach (another process of the video analysis approach) for determining an advertisement insertion position. FIG. 5 is a diagram illustrating an advertisement insertion recommendation position determined by the video analysis approach. FIG. 6 is an explanatory diagram illustrating a third approach (sound analysis approach) for determining an advertisement insertion position. FIG. 7 is a flowchart illustrating a scene division process in the operation of the video distribution server 100 according to the present disclosure. FIG. 8 is a flowchart illustrating a subsequent process of rounding similar images within a certain period of time. FIG. 9 is a flowchart illustrating a process for determining an advertisement insertion position based on the sound analysis results. FIG. 10 is a flowchart illustrating an approach using sound analysis. FIG. 11 is a diagram illustrating management of processing numbers and frame numbers. FIG. 12 is a diagram illustrating an example of a hardware configuration of the video distribution server 100 according to an embodiment of the present disclosure.

[0009] The present disclosure will be described with reference to the accompanying drawings. Whenever possible, the same parts are designated by the same reference numerals and redundant description will be omitted.

[0010] FIG. 1 is a diagram illustrating the system configuration of a video distribution system according to the present disclosure. As shown in the diagram, a video distribution server 100 distributes videos to a user terminal 200. In the distributed video, advertisements are inserted between frames that satisfy predetermined conditions. The video distribution server 100 detects whether a frame satisfies the conditions for inserting an advertisement and enables distribution of the video with the advertisement inserted after that frame. In the present disclosure, the video distribution server 100 is configured to determine the advertisement insertion position in the video and distribute the video, but the distribution process is not essential. It is sufficient for the video distribution server 100 to be configured as a device that determines the segmentation of the video, and a separate video distribution device may be configured to distribute the video using the determined segmentation.

[0011] 2 is a block diagram showing the functional configuration of the video distribution server 100 of the present disclosure. As shown in the figure, the video distribution server 100 includes an acquisition unit 101, a selection unit 102, a sound analysis unit 103, a presentation unit 104, a working data storage unit 105, a video DB 106, and a video distribution unit 107.

[0012] The acquisition unit 101 is a part that acquires all frames that make up a moving image from the moving image DB 106 and the working data storage unit 105 .

[0013] The selection unit 102 is a part that selects frames that satisfy a predetermined condition from all frames of the acquired moving image. When the similarity between adjacent frames is equal to or less than a predetermined condition, the selection unit 102 selects the next frame in chronological order from the adjacent frames. In other words, the selection unit 102 selects a frame where there is a large change between adjacent frames as a cutoff point frame.

[0014] Furthermore, if the similarity between adjacent frames when the multiple frames selected as cut point frames are arranged in chronological order is equal to or less than a predetermined value, the selection unit 102 selects the next frame in chronological order from the adjacent frames. In other words, the selection unit 102 selects a frame with a large change between adjacent frames as the first frame of the scene. The similarity is determined using imgsim.

[0015] Furthermore, when there are several frames with high similarity among the frames within a certain period of time, the selection unit 102 selects the first frame of those frames. In other words, when there are similar frames within a certain period of time, the selection unit 102 selects one first frame to round them up.

[0016] Furthermore, the selection unit 102 determines the frame into which a predetermined image or video such as an advertisement is to be inserted based on the selected frame and the frame acquired by the sound analysis unit 103, and determines the final insertion position.

[0017] The sound analysis unit 103 is a part that analyzes time periods that include sounds such as conversations from the video acquired by the acquisition unit 101 and acquires the time periods.

[0018] The presentation unit 104 is a part that presents to an operator or the like the advertisement insertion recommended position that has been determined as a scene break by the selection unit 102. The presentation is performed by displaying or outputting to an external terminal. Note that although the recommended position is referred to as the recommended position, it may also be determined.

[0019] The working data storage unit 105 is a part that stores the frame numbers of candidate positions for inserting advertisements, the frames (images), and processing numbers as working information. As will be described later, the processing numbers indicate the order in which similarity between frames is determined. This working information may also be stored in the video DB 106.

[0020] The video DB 106 is a part that stores videos to be distributed, information indicating the insertion position of advertisements (for example, frame numbers), and advertisements. The information indicating the insertion position of this video DB 106 is information that has finally been determined as a break and is information diverted from the working data storage unit 105.

[0021] The video distribution unit 107 distributes videos and advertisements stored in the video DB 106. When distributing, the video distribution unit 107 refers to insertion positions stored in the video DB 106, inserts advertisements into the positions, and distributes the advertisements.

[0022] Next, a method for determining the advertisement insertion position, which is a break, will be described. Fig. 3 is an explanatory diagram showing a first approach (video analysis approach) for determining the advertisement insertion position.

[0023] FIG. 3(a) is a diagram showing frames constituting a moving image. In the present disclosure, the frames constituting a moving image are arranged at 30 frames / s. Frames f1 to f7 are frames showing the same or almost the same image. Frames f8 to f10 are frames of an image different from frame f1 and the like. Frame fx is also a frame of a different image. The acquisition unit 101 acquires all frames constituting these moving images. The selection unit 102 selects, from all these frames, a frame that comes chronologically later and in which the similarity between adjacent frames is equal to or less than a predetermined value, as a cut point frame.

[0024] In the figure, the selection unit 102 compares frames f7 and f8, determines that the similarity is equal to or less than a predetermined value, and selects frame f8 as a candidate. Note that the first frame f1 of the video may or may not be selected as a candidate.

[0025] 3B shows frames selected as cut point frames. As shown in the figure, frames f1, f8, fx, and fx2 have been selected. If there are frames for which the similarity between adjacent frames is equal to or less than a predetermined value when these frames are arranged in chronological order, the selection unit 102 selects a frame that comes later in the chronological order. In other words, the selection unit 102 selects this later frame as the start of the scene. Note that the same processing may be performed on the start frame f1, but it may also be an exception (it may not be selected).

[0026] In the figure, the selection unit 102 determines that frames f1 and f8 are similar, but determines that frames f8 and fx are dissimilar, so the selection unit 102 selects frame fx, which is the subsequent frame, as a candidate.

[0027] 3C shows cut point frames that leave only the first frame f1 of the scene and the frame fx after frame f8, etc. In this way, cut point frames where there is a large change in the scene are selected.

[0028] FIG. 4 is an explanatory diagram showing a second approach (another process in the video analysis approach) for determining an advertisement insertion position. FIG. 4(a) shows several frames selected as the beginning of a scene. In other words, these are cut-point frames for which the process shown in FIG. 3(c) has been performed. Note that for convenience of illustration, the diagram differs from FIG. 3(c). In this diagram, frames fy1 to fy5 are frames included in a certain period of time T.

[0029] 4B shows the result of rounding up frames that have a similarity equal to or greater than a predetermined value within a certain period of time. Rounding up here means that the selection unit 102 selects only the first frame, fy1, and deletes the other frames fy2 to fy5.

[0030] As shown in the figure, frames fy1, fy3, and fy5 can be determined to be highly similar. Frames fy2 and fy4 can also be determined to be highly similar. If there are frames with high similarity within a certain period of time T, only the first frame among the frames included in that certain period of time T is selected.

[0031] During a certain period of time in a video, scenes may change in a short time. For example, when characters are conversing in a drama, the scene changes in accordance with the character's speech, as shown in Fig. 4(a). In the present disclosure, when such scene changes occur frequently, it is preferable to set the frame before the first frame as the break point (advertisement insertion position).

[0032] In the present disclosure, a fixed value is used as an example of the certain time period T, but the present invention is not limited to this. As described above, the frame in which the scene change has ended may be determined and used as the target for rounding.

[0033] 5 is a diagram showing recommended positions for advertisement insertion determined by a video analysis approach. As shown in the diagram, frames f1, fx, and fy1 are recommended positions for advertisement insertion. Note that the positions where images or videos such as advertisements are actually inserted are before these frames. The frame numbers of the frames selected in this way are presented by the presentation unit 104 as recommended positions for advertisement insertion.

[0034] 6A and 6B are explanatory diagrams showing a third approach (sound analysis approach) for determining an advertisement insertion position. Fig. 6A shows what kind of sound overlaps with each frame.

[0035] The sound analysis unit 103 performs sound analysis on the sound data included in the video using sound analysis AI, and can analyze what types of sounds are included in each time period, such as time periods when music is playing, time periods when people are talking, time periods when there is no sound, and other time periods. This sound analysis AI is a known technology. For example, an algorithm called inSpeechSegmenter is known.

[0036] The selection unit 102 determines whether to exclude a frame that the sound analysis unit 103 has determined to contain the sound of conversation from candidates for an insertion position.

[0037] 6B is a diagram showing frames that have been removed from the candidates for insertion positions based on sound analysis. As shown in the figure, if the selection unit 102 determines that the selected frames f1, fx, and fy1 are frames in which conversation occurs, it performs processing to remove the frames from the candidates for insertion positions. In the present disclosure, frame fy1 is determined to be a frame in which conversation occurs, and is therefore removed from the candidates for insertion positions.

[0038] Next, the operation of the video distribution server 100 of the present disclosure will be described with reference to Figs. 7 to 10. Fig. 7 is a flowchart showing the process of dividing scenes in the operation of the video distribution server 100 of the present disclosure. Fig. 8 is a flowchart showing the process of rounding similar images within a certain period of time that is performed thereafter. Fig. 9 is a flowchart showing the process of determining an advertisement insertion position based on the sound analysis result. Fig. 10 is a flowchart showing an approach using sound analysis.

[0039] First, a description will be given using FIG. 7 . The acquisition unit 101 acquires all frames (e.g., n frames) constituting a video from the video DB 106 (S101). Then, the selection unit 102 extracts the i-th frame from all frames, setting the initial value i = 1, and determines whether i < n (S102). If the answer to step S102 is YES, the selection unit 102 determines whether the similarity between adjacent frames (i-th frame and i+1-th frame) in order from the first frame (i = 1, i is the frame number) is equal to or less than threshold a (S103). For example, when i = 1, the selection unit 102 determines whether the similarity between the first frame and the second frame is equal to or less than threshold a. If the answer is YES, the selection unit 102 stores the i+1-th frame and its frame number in the working data storage unit 105 (S104). The selection unit 102 then increments i=i+1 to select the next frame number (S105). The process from S102 to S105 is repeated for all frames. The working data storage unit 105 stores m selected frames and their frame numbers.

[0040] Next, the acquisition unit 101 acquires m frames from the working data storage unit 105 (S106). The selection unit 102 then performs a similarity determination process on the acquired m frames. Note that in this process, it is assumed that the selection unit 102 has assigned a new processing number to each frame and frame number. As shown in FIG. 11( a), the working data storage unit 105 stores data for processing, and stores processing numbers, frame numbers, and frames (images) in association with each other. The selection unit 102 assigns processing numbers prior to similarity determination, and performs similarity determination processing according to the processing numbers thus managed.

[0041] The selection unit 102 then selects a frame and, with j = 1 as the initial value, determines whether j < m (S107). If the result of S107 is YES, the selection unit 102 determines whether the similarity between adjacent frames (the jth frame and the j+1th frame) in order from the first frame (j = 1, j is the processing number) is equal to or less than a threshold b (S108). For example, when j = 1, the selection unit 102 determines whether the similarity between the first frame and the second frame is equal to or less than a threshold. In other words, it determines whether there is a large change between adjacent frames. If the result is YES, the selection unit 102 stores the j+1th frame and its frame number in the working data storage unit 105 (S109). The selection unit 102 then increments j = j + 1 and processes the frame with the next processing number (S110). These steps S107 to S109 are repeated for the m frames acquired in step S106. The working data storage unit 105 stores p frames of acquired frames and their frame numbers.

[0042] It is to be noted that threshold value a is greater than threshold value b. It is important to extract cut point frames even if the degree of change is small.

[0043] Next, referring to FIG. 8 , the rounding process when similar images are found within a certain time period using p frames stored in the working data storage unit 105 will be described. The acquisition unit 101 acquires the p frames stored in process S109 (S111). The selection unit 102 acquires frames corresponding to frames within a certain time period from the frame at the processing start point (initially the first frame) from the acquired p frames (S112). The selection unit 102 then performs a process to determine the similarity of multiple frames within the certain time period. Note that the frames acquired in process S111 may be frames with long intervals between them. The selection unit 102 references the frame numbers to acquire multiple frames and frame numbers within the certain time period. Therefore, the number of frames is not necessarily constant.

[0044] The selection unit 102 then determines the similarity between a plurality of frames, and, depending on the determination result, stores the first frame number and the frame in the working data storage unit 105. For example, if a predetermined number or more of frames within a certain period of time have high similarity to one another, the selection unit 102 determines that the frames belong to the same scene (S113: YES).

[0045] If the answer is YES, the selection unit 102 stores the first frame of the given period and its frame number in the working data storage unit 105 (S114).The selection unit 102 then determines the frame that will be the next processing start point.If the selection unit 102 cannot determine the next processing start point (S116: NO), it assumes that processing of all frames has been completed and proceeds to the next step.

[0046] These steps S112 to S116 are repeated for the p frames acquired in step S111. The working data storage unit 105 stores q selected frames and their frame numbers.

[0047] In step S112, if the processing start point is near the end of the video (all frames), there may be no frames corresponding to the frame at the certain time, and the frame may not be acquired. In this case, the selection unit 102 acquires up to the last frame of the video.

[0048] Next, the process of acquiring frames without dialogue will be described. Fig. 9 is a flowchart showing the process of acquiring frames based on a comparison with frames with dialogue acquired by another process. The acquisition unit 101 acquires q frames from the working data storage unit 105 (S117). These q frames are assigned new processing numbers in order, starting from 1. Fig. 11(b) shows a table with processing numbers used when processing cut point frames for comparison with sound.

[0049] The selection unit 102 determines whether s≦q for the frame with processing number s, with an initial value of s=1 (S118). If the result is YES, the selection unit 102 determines whether the frame contains no conversation (S118, S119). The selection unit 102 determines whether the frame contains conversation by comparing the frame with a conversation-containing frame (frame number) obtained from a separately acquired voice analysis result.

[0050] If the frame does not contain any conversation, the selection unit 102 stores the frame and its frame number in the working data storage unit 105 (S120).

[0051] The selection unit 102 sets the processing number s=s+1 and makes a judgment on the next frame (S121).

[0052] By repeatedly performing steps S118 to S120, the selection unit 102 can acquire, for each scene, a position that does not interrupt the conversation as the advertisement insertion position. In the present disclosure, the presentation unit 104 presents the frame and frame number stored in the working data storage unit 105 to the operator as the advertisement insertion recommended position (S122). The operator can confirm the position. The operator can correct the insertion position (frame number) as necessary by operating the presentation unit 104.

[0053] Next, a process for determining frames based on sound analysis will be described. This process illustrates a method for acquiring frames to be compared in the process S119. FIG. 10 is a flowchart illustrating the process for determining frames based on sound analysis according to the present disclosure. The acquisition unit 101 acquires sound data from a video (S201). The sound analysis unit 103 acquires frames of conversational portions from the sound data superimposed on the video acquired by the acquisition unit 101 using a known algorithm, such as voice analysis AI. That is, the sound analysis unit 103 samples the sound data and determines whether the sound is conversation, music, or other sounds in sampling units. Here, the sampling unit is 22,000 Hz, but is not limited to this. The sound analysis unit 103 then selects frames from a time period containing conversation (S202). The sound analysis unit 103 stores the selected frames in the working data storage unit 105 (S203).

[0054] In this way, it is possible to identify frames where advertisements will be inserted. The advertisement insertion positions identified in this disclosure allow advertisements to be inserted without overlapping video scenes or conversations and without affecting video viewing.

[0055] In the present disclosure, it is important that the selection unit 102 selects at least cut point frames, and that it selects, as delimiters, cut point frames that satisfy predetermined conditions from the selected cut point frames. For example, the predetermined condition may be that the cut point frames do not contain sound. Another predetermined condition may be the similarity between the cut point frames. These predetermined conditions may be one or several may be combined. In the above disclosure, an example in which all conditions are combined is shown, but not all of them are necessarily required.

[0056] Next, the effects of the video distribution server 100 of the present disclosure will be described. The video distribution server 100 of the present disclosure includes an acquisition unit 101 that acquires frames constituting a video, and a selection unit 102 that acquires cut point frames based on the magnitude of change between adjacent frames among the frames, and selects cut point frames that satisfy a division condition from among the cut point frames as divisions. In the present disclosure, divisions are positions where advertisements are recommended for insertion, but they may be positions other than advertisements. Furthermore, they may simply be positions that indicate divisions that indicate changes in the content of the video.

[0057] The division condition in the present disclosure is whether or not a cut point frame contains a sound that is not suitable as a division.

[0058] Here, when there is a combination of frames in which there is a large change between adjacent frames, the selection unit 102 selects the frame that comes later in time sequence as the cut point frame.

[0059] With this configuration, the video distribution server 100 can select frames that separate video segments. These segments can be used to insert advertisements or other information. Furthermore, by determining the video segments, various video distribution services can be provided that utilize these segments.

[0060] Furthermore, the selection unit 102 selects one cut point frame based on the similarity between a plurality of cut point frames, and selects the one cut point frame as a delimiter.

[0061] Furthermore, the selection unit 102 selects a frame that is later in time series as a separator based on the similarity between cut point frames that are adjacent in time series.

[0062] By this process, it is possible to determine a certain coherent scene. That is, in the present disclosure, it is possible to divide a video into coherent scenes called scenes. Therefore, by using a scene as one of the divisions of the video, even if an advertisement is inserted there, it will not interrupt the content, making it easier to watch.

[0063] Furthermore, when there are a plurality of similar cut point frames within a certain period of time, the selection unit 102 selects the first cut point frame in chronological order.

[0064] Generally, in videos such as dramas, scenes may be switched to show characters alternately for conversation. When the characters repeatedly switch within a certain period of time (for example, the duration of a conversation), the above process may be used to group them into a single scene, which may be a good way to determine when the scene should end.

[0065] The video distribution server 100 of the present disclosure further includes a sound analysis unit 103 that analyzes the sound generation state in the video. If the acquired cut point frame and the sound generation state coincide with each other, the selection unit 102 does not select the cut point frame as a delimiter. For example, the sound generation state may be the state of conversation.

[0066] If the frame contains dialogue, it can be determined that it is in the middle of a scene or a scene, and is not a suitable frame for dividing a scene. In the present disclosure, by not determining such a cut point frame as a division, it is possible to prevent interruptions to viewing due to the insertion of advertisements, etc. In addition to dialogue, music and other sounds intended to prevent a change in scene are also included.

[0067] The video distribution server 100 of the present disclosure further includes a presentation unit 104 that presents cut point frames determined by the selection unit 102 to be break points as break candidates.

[0068] In the present disclosure, candidates for divisions can be set, and the candidates can be determined by an operator as necessary. Ultimately, an appropriate division can be determined by the judgment of a person such as an operator.

[0069] The device and method of the present disclosure have the following configuration.

[0070] [1] An apparatus comprising: an acquisition unit that acquires frames that constitute a moving image; and a selection unit that acquires cut point frames based on the magnitude of change between adjacent frames among the frames that constitute the moving image, and selects, as a separator, cut point frames that satisfy a separator condition from among the cut point frames.

[0071] [2] The device according to [1], wherein the segmentation condition is a condition based on whether the cut point frame includes a sound that is not suitable as a segmentation.

[0072] [3] The device according to [1] or [2], wherein the selection unit selects a frame that comes later in time sequence as a cut point frame when there is a combination of frames in which there is a large change between the adjacent frames.

[0073] [4] The device according to any one of [1] to [3], wherein the selection unit selects one cut point frame based on similarities between the acquired multiple cut point frames, and selects the one cut point frame as a delimiter.

[0074] [5] The device according to [4], wherein the selection unit selects a frame that is later in time series as a separator based on a similarity between cut point frames that are adjacent in time series.

[0075] [6] The device according to [5], wherein the selection unit selects the first cut point frame in chronological order as the delimiter when there are multiple cut point frames selected as delimiters within a certain period of time.

[0076] [7] The device according to any one of [1] to [6], further comprising a sound analysis unit that analyzes the sound generation state in the video, wherein the selection unit does not select the cut point frame as the delimiter if the cut point frame and the sound generation state are at the same timing.

[0077] [8] The device according to [7], wherein the sound analysis unit determines that the sound generation state is a conversation generation state.

[0078] [9] The device according to any one of [1] to [8], further comprising: a presentation unit that presents cut point frames determined as break points by the selection unit as break candidates.

[0079]

[10] A method comprising: an acquisition step of acquiring cut point frames based on the magnitude of change between adjacent frames among frames constituting a moving image; and a determination step of determining a cut point frame as a division based on a cut point frame that satisfies a division condition among the cut point frames.

[0080] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of hardware and / or software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are connected directly or indirectly (e.g., via wire, wirelessly, etc.) and these multiple devices. The functional block may also be realized by combining the single device or multiple devices with software.

[0081] Functions include, but are not limited to, judgment, determination, assessment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment. For example, a functional block (component) that performs transmission is called a transmitting unit or transmitter. As mentioned above, there are no particular limitations on how these functions are implemented.

[0082] For example, the video distribution server 100 according to an embodiment of the present disclosure may function as a computer that performs processing of the video distribution method of the present disclosure. Fig. 12 is a diagram illustrating an example of the hardware configuration of the video distribution server 100 according to an embodiment of the present disclosure. The video distribution server 100 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, etc.

[0083] In the following description, the term "apparatus" can be interpreted as a circuit, a device, a unit, etc. The hardware configuration of the video distribution server 100 may be configured to include one or more of the apparatuses shown in the figure, or may be configured to exclude some of the apparatuses.

[0084] Each function of the video distribution server 100 is realized by loading specific software (programs) onto hardware such as the processor 1001 and memory 1002, causing the processor 1001 to perform calculations, control communication via the communication device 1004, and control at least one of reading and writing data in the memory 1002 and storage 1003.

[0085] The processor 1001 controls the entire computer by running, for example, an operating system. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, the above-mentioned selection unit 102, sound analysis unit 103, etc. may be realized by the processor 1001.

[0086] The processor 1001 also reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002 and executes various processes in accordance with these programs. The programs used are those that cause a computer to execute at least some of the operations described in the above-described embodiments. For example, the selection unit 102 and the sound analysis unit 103 may be implemented by a control program stored in the memory 1002 and running on the processor 1001, and similar implementations may be used for other functional blocks. While the above-described various processes have been described as being executed by one processor 1001, they may also be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The programs may also be transmitted from a network via a telecommunications line.

[0087] The memory 1002 is a computer-readable recording medium and may be configured, for example, by at least one of a read-only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a random access memory (RAM), etc. The memory 1002 may also be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store executable programs (program codes), software modules, etc. for implementing the video distribution method according to one embodiment of the present disclosure.

[0088] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc. Storage 1003 may also be referred to as an auxiliary storage device. The above-mentioned storage medium may be, for example, a database, a server, or other appropriate medium including at least one of memory 1002 and storage 1003.

[0089] The communication device 1004 is hardware (transmission / reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, or a communication module. The communication device 1004 may be configured to include a high-frequency switch, a duplexer, a filter, a frequency synthesizer, etc. to realize at least one of frequency division duplex (FDD) and time division duplex (TDD). For example, the video distribution unit 107 described above may be realized by the communication device 1004. The communication device 1004 may be implemented with a transmission unit and a reception unit that are physically or logically separated.

[0090] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that receives input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).

[0091] Furthermore, each device, such as the processor 1001 and the memory 1002, is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.

[0092] The video distribution server 100 may also be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA), and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented using at least one of these pieces of hardware.

[0093] The notification of information is not limited to the aspects / embodiments described in the present disclosure and may be performed using other methods. For example, the notification of information may be performed by physical layer signaling (e.g., Downlink Control Information (DCI) and Uplink Control Information (UCI)), higher layer signaling (e.g., Radio Resource Control (RRC) signaling, Medium Access Control (MAC) signaling, broadcast information (Master Information Block (MIB) and System Information Block (SIB))), other signals, or a combination thereof. Furthermore, the RRC signaling may be referred to as an RRC message, and may be, for example, an RRC Connection Setup message, an RRC Connection Reconfiguration message, or the like.

[0094] The order of the procedures, sequences, flowcharts, etc. of each aspect / embodiment described in this disclosure may be changed unless it is consistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0095] Input and output information may be stored in a specific location (for example, memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be sent to another device.

[0096] The determination may be made based on a value represented by one bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0097] The aspects / embodiments described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0098] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0099] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0100] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0101] The information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0102] Note that terms described in this disclosure and terms necessary for understanding this disclosure may be replaced with terms having the same or similar meanings. For example, at least one of a channel and a symbol may be a signal (signaling). Furthermore, a signal may be a message. Furthermore, a component carrier (CC) may be called a carrier frequency, a cell, a frequency carrier, etc.

[0103] Furthermore, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, may be expressed using relative values ​​from a predetermined value, or may be expressed using other corresponding information. For example, a radio resource may be indicated by an index.

[0104] The names used for the above-described parameters are not intended to be limiting in any way. Furthermore, the mathematical expressions using these parameters may differ from those explicitly disclosed in this disclosure. The various channels (e.g., PUCCH, PDCCH, etc.) and information elements may be identified by any suitable names, and therefore the various names assigned to these various channels and information elements are not intended to be limiting in any way.

[0105] In this disclosure, the terms "Mobile Station (MS)," "user terminal," "User Equipment (UE)," "terminal," and the like may be used interchangeably.

[0106] A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable terminology.

[0107] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0108] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using one or more wires, cables, and / or printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0109] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0110] As used in this disclosure, any reference to an element using a designation such as "first," "second," etc. does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must in some way precede the second element.

[0111] When the terms "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, when the term "or" is used in this disclosure, it is not intended to be an exclusive or.

[0112] In this disclosure, where articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0113] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different."

[0114] 100...video distribution server, 200...user terminal, 101...acquisition unit, 102...selection unit, 103...sound analysis unit, 104...presentation unit, 105...working data storage unit, 106...video DB, 107...video distribution unit.

Claims

1. An apparatus comprising: an acquisition unit that acquires frames that constitute a moving image; and a selection unit that acquires cut point frames based on the magnitude of change between adjacent frames among the frames that constitute the moving image, and selects cut point frames from the cut point frames that satisfy a division condition as divisions.

2. The device according to claim 1, wherein the segmentation condition is a condition based on whether or not the cut point frame contains a sound that is not suitable as a segmentation.

3. The device according to claim 1, wherein the selection unit selects a frame that is later in time sequence as a cut point frame when there is a combination of frames in which there is a large change between the adjacent frames.

4. The device according to claim 1, wherein the selection unit selects one cut point frame based on the similarity between the acquired plurality of cut point frames, and selects the one cut point frame as a separator.

5. The device according to claim 4, wherein the selection section selects a frame that is later in time series as a separator based on the similarity between cut point frames that are adjacent in time series.

6. The device according to claim 5, wherein the selection unit selects the first cut point frame in chronological order as the delimiter when there are a plurality of similar cut point frames among the cut point frames selected as delimiters within a certain period of time.

7. The device according to claim 1, further comprising a sound analysis unit that analyzes the state of sound generation in the video, wherein the selection unit does not select the cut point frame as the delimiter if the sound generation state is included in the cut point frame.

8. The device according to claim 7, wherein the sound analysis unit determines that the sound generation state is a conversation generation state.

9. The device according to claim 1, further comprising: a presentation unit that presents cut point frames determined by said selection unit to be breaks as break candidates.

10. A method comprising: an acquisition step of acquiring cut point frames based on the magnitude of change between adjacent frames among the frames that make up a moving image; and a determination step of determining a cut point frame as a division based on which of the cut point frames satisfy a division condition.

Images