Server device, distribution system, information processing method, and program
The server device generates time-lapse playlists dynamically, addressing the inefficiencies of conventional methods by enabling flexible and rapid time-lapse data generation with adjustable parameters.
Patent Information
- Application Number
- JP2024043066
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-19
- Publication Date
- 2025-10-02
AI Technical Summary
Conventional techniques face challenges in generating time-lapse data quickly and flexibly.
A server device generates a first time-lapse playlist with associated reference information for data, extracts entries based on time-lapse conditions, and transmits a second time-lapse playlist in response to a request, allowing flexible and efficient time-lapse video generation.
Enables time-lapse data generation in a shorter time with flexible parameter adjustments, eliminating the need for converting pictures into time-lapse video files and allowing real-time adjustments.
Smart Images

Figure 2025143701000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a server device, a distribution system, an information processing method, and a program. [Background technology]
[0002] A video collection and distribution system has been known in the past in which a server device distributes time-lapse video to a viewer, for example, as an MP4 file. Also, a video collection and distribution system has been known in the past in which a viewer acquires video data (pictures) from a server device and generates time-lapse video from the video data on the viewer side. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-32639 [Non-patent literature]
[0004] [Non-Patent Document 1] How to use cloud security cameras for construction sites, [online], [searched March 13, 2024], Internet〈URL: https: / / safie.jp / construction / 〉 Summary of the Invention [Problem to be solved by the invention]
[0005] However, with conventional techniques, it has been difficult to generate time-lapse data in a shorter time and more flexibly. [Means for solving the problem]
[0006] In an embodiment, the server device includes a processing unit that generates a first time-lapse playlist including a plurality of entries each associated with reference information for second data included in first data and information about the second data, extracts entries from the first time-lapse playlist that include information about the second data that matches the time-lapse conditions in response to a request including time-lapse conditions, generates a second time-lapse playlist including the extracted entries, and transmits a response including the second time-lapse playlist. [Brief explanation of the drawings]
[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of a device configuration of a distribution system according to an embodiment. [Figure 2] 3A and 3B are diagrams illustrating examples of data configurations of segments and chunks of streaming data according to an embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a functional configuration of a server apparatus according to an embodiment. [Figure 4] 5A and 5B are diagrams illustrating an example of a relationship between streaming data and a full time lapse playlist according to an embodiment. [Figure 5] 6A and 6B are diagrams illustrating an example of the relationship between a full time lapse playlist and a time lapse playlist according to an embodiment. [Figure 6] 10 is a flowchart illustrating an example of processing by a processing unit of the embodiment. [Figure 7] 10A and 10B are diagrams showing examples of time lapse playlists according to a modified example of the embodiment. [Figure 8] FIG. 2 is a diagram illustrating an example of the hardware configuration of a server device and a receiving device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0008] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of a server device, a distribution system, an information processing method, and a program will be described in detail with reference to the accompanying drawings.
[0009] First, a distribution system to be used in the embodiment will be described.
[0010] 1 is a diagram illustrating an example of the device configuration of a distribution system 100 according to an embodiment. The distribution system 100 according to the embodiment includes a server device 1, a receiving device 2, and an image capturing device 3. The server device 1, the receiving device 2, and the image capturing device 3 are connected via a network 4.
[0011] The server device 1 is a video collection and distribution server that provides streaming data and a playlist containing reference information for the streaming data to a viewer 20 running on a receiving device 2 connected to a network 3. The streaming data is, for example, video data including video and audio. The reference information for the streaming data is, for example, a file path for referencing (identifying) the streaming data.
[0012] The server device 1 may be configured by, for example, a computer having a central processing unit (CPU), a memory, a communication function, or a cloud.
[0013] For example, the server device 1 receives video data from a photographing device 3 (an example of an acquisition device that acquires data) such as a camera connected to the network 4. From the received video data, the server device 1 generates streaming data (for example, segments or chunks) and a playlist that describes reference information for the streaming data. Then, the server device 1 provides the streaming data and the playlist to the receiving device 2 via the network 4.
[0014] The receiving device 2 is a client device that receives the streaming data and playlist output from the server device 1.
[0015] The receiving device 2 may be configured by, for example, a computer equipped with a central processing unit (CPU), memory, and communication functions, etc. The receiving device 2 may also be a terminal (device) such as a television receiving device or a smartphone, as long as it has computer functions and communication functions that allow it to connect to the network 4.
[0016] The receiving device 2 decodes the received streaming data and outputs the resulting video to the viewer 20. The user watches the video through the viewer 20.
[0017] The viewer 20 has a function of receiving and analyzing a playlist that describes information about streaming data (a parsing function), a function of receiving and decoding the streaming data based on the parsing results (a decoding function), etc. The viewer 20 is application software installed in the receiving device 2, and may be, for example, a web application that runs on the browser of the receiving device 2.
[0018] The network 4 is a network such as the Internet to which the server device 1, the receiving device 2, the photographing device 3, etc. are connected. A relay server device, etc. may also be connected to the network 4. The relay server device is, for example, a proxy server equipped with functions such as caching and transferring data.
[0019] Fig. 2 is a diagram showing an example of the data structure of segments and chunks of streaming data according to an embodiment. In the example of Fig. 2, a segment (segment.m4s) is made up of a Segment Type Box (styp) indicating the type of segment, a Movie Fragment Box (moof) indicating meta information of the stored picture data, and a Media Data Box (mdat) in which the picture data itself is stored.
[0020] An I-picture is a picture that is complete in itself (can be decoded as a single picture). A P-picture is a differential image from the previous I-picture, and cannot be decoded without referring to the previous I-picture. There is a restriction that an I-picture must be stored at the beginning of mdat, but whether or not subsequent I-pictures are stored depends on the encoding parameters. Only the first I-picture may be stored, or multiple I-pictures may be stored in mdat.
[0021] The example in FIG. 2 shows an example of a data structure defined as a chunked segment (chunked.m4s) by the Common Media Application Format (CMAF), a standard media format specification aimed at low latency.
[0022] In chunked.m4s, styp is followed by one or more chunks (CMAF chunks). Chunks are generated by dividing a segment into smaller time lengths (usually less than one second). Each chunk stores video data.
[0023] Each chunk consists of moof and mdat. There is a restriction that the mdat of the first chunk that makes up a segment must store an I picture, but this restriction does not apply to subsequent chunks, and they may store a P picture at the beginning.
[0024] The viewer 20 of the receiving device 2 receives the streaming data in units of segments or chunks output by the server device 1, and plays back the video by inputting the streaming data into a decoding function.
[0025] 3 is a diagram showing an example of the functional configuration of the server device 1 according to the embodiment. The server device 1 according to the embodiment includes a processing unit 10, communication units 11a and 11b, and a storage unit 12.
[0026] The processing unit 10 performs various processes to realize the functions of the server device 1. The processing unit 10 is realized by at least one processing unit. This processing unit includes, for example, a control unit and an arithmetic unit, and is realized by analog or digital circuits, etc. The processing unit may be a central processing unit (CPU), a general-purpose processor, a microprocessor, a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof.
[0027] The processing unit 10 includes a collection and distribution control unit 13 and a time lapse distribution control unit 14. The collection and distribution control unit 13 collects video data and distributes it as live / archive streaming data.
[0028] The time lapse delivery control unit 14, in cooperation with the distribution and collection control unit 13, generates a time lapse playlist in response to a time lapse request and transmits it to the receiving device 2. The time lapse delivery control unit 14 includes a reception control unit 101, an extraction unit 102, a generation / update unit 103, a reception control unit 104, a generation unit 105, and a transmission control unit 106.
[0029] The reception control unit 101 receives, from the distribution and collection control unit 13, streaming data (segments / chunks) and a playlist describing reference information for the streaming data.
[0030] The extraction unit 102 extracts picture information from the received streaming data. The picture information is meta-information such as the type of picture (e.g., I-picture), the data size of the picture, the timestamp of the picture, and the storage position (byte offset) within a segment or chunk. The picture information may be extracted by analyzing picture data such as image data.
[0031] The generating / updating unit 103 generates or updates a full-time playlist from the playlist and picture information. The full-time lapse playlist includes reference information for all pictures included in the streaming data.
[0032] The reception control unit 104 receives a time lapse request that includes time lapse conditions. The time lapse conditions are information used to generate a time lapse playlist. For example, the time lapse conditions include a stream data identifier, a time lapse period, and a compression rate (thinning interval).
[0033] The stream data identifier is identification information that uniquely identifies a large number of videos collected and distributed by the server device 1. For example, the stream data identifier is a stream name that is not allowed to be duplicated. Also, for example, the stream data identifier is a URL included in a playlist output from the distribution collection control unit 13.
[0034] The time lapse period is determined, for example, by specifying the start and end times of the time lapse.
[0035] The time lapse request may include not only the time lapse conditions but also information useful for generating a time lapse playlist. For example, if security camera footage has already been analyzed using AI (Artificial Intelligence), the time lapse request sent may further include a specification of pictures that include people, which is information useful for generating a time lapse playlist.
[0036] The generating unit 105 references the full time lapse playlist stored in the storage unit 12 and generates a time lapse playlist based on the time lapse conditions.
[0037] The transmission control unit 106 transmits the time lapse playlist generated in response to the time lapse request to the receiving device 2.
[0038] The communication units 11a and 11b transmit and receive communication data to and from other devices. The communication units 11a and 11b are realized by a wireless IF (Interface) or a wired IF. The communication units 11a and 11b may be realized by one interface or by two different interfaces.
[0039] The storage unit 12 is realized by a combination of, for example, a main storage device such as a read-only memory (ROM) and a random access memory (RAM), and an auxiliary storage device such as a hard disk drive (HDD) and a memory card.
[0040] The storage unit 12 stores, for example, a full time lapse playlist generated or updated by the generating / updating unit 103. Note that the storage unit 12 may further store a time lapse playlist generated by the generating unit 105.
[0041] 4 is a diagram showing an example of the relationship between streaming data and a full-time lapse playlist according to an embodiment, where the left side of Fig. 4 shows the full-time lapse playlist, and the right side of Fig. 4 shows the streaming data.
[0042] The full-time lapse playlist on the left of Figure 4 is an example of a playlist (M3U8 playlist) used in the video distribution protocol HTTP Live Streaming (HLS), a standard developed by Apple.
[0043] 4 is merely an example, and this embodiment is applicable to any playlist format of a video distribution protocol. For example, this embodiment is applicable to a playlist (MPD playlist) of Dynamic Adaptive Streaming HTTP (DASH), which is standardized as part of the MPEG standard.
[0044] To distinguish full time lapse playlists from other playlists (playlists for live / archive video distribution), full time lapse (FULL-TIMELAPSE) is written in the playlist type field (#EXT-X-PLAYLIST-TYPE in Figure 4).
[0045] In a full time lapse playlist, information about the pictures in a video segment is described in the URL of the segment. Figure 4 shows an example of the relationship between regular segments (pictures stored in segments) and a full time lapse playlist, but a full time lapse playlist can also be generated for segments that are chunked internally. In other words, the data format of the streaming data used to generate a full time lapse playlist can be either segments or chunks.
[0046] The full time lapse playlist on the left in Figure 4 contains reference information for the first I-picture stored in the mdat of each segment. For example, the following two lines on the left in Figure 4 indicate the information for the I-picture in segment1.m4s on the right in Figure 4. #EXTINF:5.0, / archive / segment1.m4s, 2024-01-01T00:00:00.000+09:00,0~543210
[0047] "5.0" indicates the number of seconds in the segment (5.0 seconds). " / archive / segment1.m4s" indicates reference information for the segment. "2024-01-01" indicates the date, and "T00:00:00.000+09:00" indicates the time information. "0-54321" indicates that the portion of the data included in segment1.m4s that corresponds to the I-picture data is bytes 0-54321.
[0048] If there are multiple I-pictures in each segment, the reference information for the multiple I-pictures may be written separated by commas (,).
[0049] 5 is a diagram showing an example of the relationship between a full time lapse playlist and a time lapse playlist according to an embodiment, where the left side of Fig. 5 shows the full time lapse playlist, and the right side of Fig. 5 shows the time lapse playlist.
[0050] In a time lapse playlist, time lapse (TIMELAPSE) is written in the playlist type field (#EXT-X-PLAYLIST-TYPE in the right side of Figure 5).
[0051] The full time lapse playlist describes a large amount of picture information in each segment (for example, information about all I pictures in a segment).
[0052] On the other hand, a time lapse playlist is created by extracting from the full time lapse the portion that meets the time lapse conditions included in the time lapse request.
[0053] Next, an example of the operation of the receiving device 2 and the photographing device 3 in this embodiment will be described. In this embodiment, it is assumed that a user is viewing streaming content provided by the server device 1 using the viewer 20 of the receiving device 2. For example, the streaming content is received by the server device 1 via the network 4 as video data captured by the photographing device 3, such as a live camera, and is live-streamed by the server device 1 to the receiving device 2. Alternatively, the streaming content may be archived and streamed to the viewer 20 of the receiving device 2 as past camera video stored in the server device 1 or another location (such as a cloud service).
[0054] The server device 1 receives video data from a shooting device 3, such as a live camera. The distribution collection control unit 13 generates streaming data (segments or chunks) and a full-time playlist that describes information about the streaming data. The distribution collection control unit 13 provides live distribution or archive distribution functions to the viewer 20 of the receiving device 2. The time lapse distribution control unit 14 generates a time lapse playlist in response to a time lapse request from the receiving device 2.
[0055] FIG. 6 is a flowchart showing an example of processing by the processing unit 10 of the embodiment. First, the reception control unit 101 performs data reception processing (step S101). Specifically, the reception control unit 101 receives streaming data (segments or chunks) and a playlist from the collection and distribution control unit 13. For example, the reception control unit 101 may constantly receive streaming data (segments or chunks) and a playlist that are generated and updated in real time during live distribution from a video collection and distribution system connected via the network 4. Alternatively, for example, the reception control unit 101 may collectively receive past streaming data (segments or chunks) and a playlist that have been accumulated during archive distribution at regular intervals or at a specific timing.
[0056] When the reception control unit 101 receives streaming data (segments or chunks) and a playlist, it inputs the streaming data to the extraction unit 102 and inputs the playlist to the generation / update unit 103 .
[0057] Next, the extracting unit 102 performs a picture information extracting process to extract picture information in the segment or chunk (step S102). The extracting unit 102 inputs the picture information to the generating / updating unit 103.
[0058] Next, the generating / updating unit 103 performs a full-time lapse playlist generating / updating process to generate or update a full-time lapse playlist based on the playlist and picture information (step S103). When a full-time lapse playlist is updated, picture information is added to the entries of the existing full-time lapse playlist. The generating / updating unit 103 determines whether to generate a new full-time lapse playlist based on, for example, the number of entries in the full-time playlist and the file size of the full-time lapse playlist. Furthermore, for example, the generating / updating unit 103 determines whether to generate a new full-time lapse playlist including a picture based on the time information of the picture in the full-time lapse playlist.
[0059] Next, the generating / updating unit 103 performs a full-time lapse playlist saving process to store the full-time lapse playlist generated or updated in step S103 in the storage unit 12 (step S104).
[0060] Next, the reception control unit 104 determines whether or not a time lapse request has been received from the receiving device 2 via the communication unit 11b (step S105). If a time lapse request has not been received (step S105, No), the process returns to step S101.
[0061] When a time lapse request is received (Yes at step S105), the generating unit 105 inputs the time lapse conditions included in the time lapse request to the generating unit 105.
[0062] Next, the generation unit 105 performs a time lapse playlist generation process (step S106). Specifically, the generation unit 105 extracts entries that meet the time lapse conditions from the storage unit 12, and generates a time lapse playlist that includes the extracted entries. The generation unit 105 inputs the time lapse playlist to the transmission control unit 106.
[0063] Note that if picture information that satisfies the time lapse conditions is contained in multiple full time lapse playlists, the generating unit 105 may refer to multiple full time lapse playlists.
[0064] Next, the transmission control unit 106 performs a time lapse playlist distribution process (step S107). Specifically, the time lapse playlist input from the generation unit 105 is transmitted to the receiving device 2 via the communication unit 11b. For example, the time lapse playlist may be transmitted by returning the time lapse playlist to the receiving device 2 as a reply (response) to the time lapse request.
[0065] As described above, in server device 1 of the embodiment, generating / updating unit 103 generates a full time lapse playlist (an example of a first time lapse playlist) including multiple entries, each of which associates reference information for a picture (an example of second data) included in streaming data (an example of first data) with picture information indicating the picture. In response to a time lapse request including time lapse conditions, generating unit 105 extracts from the full time lapse playlist entries that include picture information that matches the time lapse conditions, and generates a time lapse playlist (a second time lapse playlist) including the extracted entries. Then, transmission control unit 106 transmits a response including the generated time lapse playlist.
[0066] As a result, according to the server device 1 of the embodiment, time lapse data (for example, time lapse video) can be generated more flexibly in a shorter time. Specifically, the viewer 20 acquires picture information from the server device 1 based on a time lapse playlist that meets the time lapse conditions and plays it back, thereby enabling flexible playback of time lapse video.
[0067] Conventional methods for distributing time-lapse videos required the creation of the video as a file. This required the conversion process from pictures to time-lapse video files, making it impossible to shorten the time it took to create the video. Furthermore, parameters (such as the amount of video thinning) could not be changed while the video was playing. This meant that conventional methods required specifying different parameters and regenerating the video.
[0068] In the embodiment, the server device 1 generates a time-lapse playlist that describes picture information in the streaming data (segments or chunks), and the viewer 20 references the time-lapse playlist to acquire and play pictures as appropriate. This eliminates the need to convert pictures into time-lapse video files, enabling flexible time-lapse distribution in response to requests. Furthermore, because the server device 1 of the embodiment generates time-lapse video using a time-lapse playlist, parameters (such as the amount of video thinning) can be changed more flexibly and in a shorter time than before.
[0069] (Modification of the embodiment) Next, a modified example of the embodiment will be described. In the description of the modified example, the same description as in the first embodiment will be omitted, and only the differences from the first embodiment will be described.
[0070] The generation unit 105 may add new information to entries that meet the time lapse conditions and generate a time lapse playlist that includes the entries to which the new information has been added. For example, in a modified example, a case will be described in which the time lapse distribution control unit 14 notifies the decoding function of the viewer of the display time for each picture.
[0071] FIG. 7 shows an example of a time lapse playlist according to a modified example of the embodiment. The generation unit 105 of the modified example generates a time lapse playlist by extracting from the full time lapse the portion that meets the time lapse conditions included in the time lapse request. At this time, the generation unit 105 adds the display time (@?? (milliseconds)) for each picture to the time lapse playlist as new information. Specifically, for example, the picture displayed by segment1.m4s has a time value of @1000, so the viewer 20 displays the next picture 1000 milliseconds after the picture starts to be displayed.
[0072] Note that the viewer 20 does not have to display pictures for the exact display times specified in the time-lapse playlist, and the viewer 20 may further adjust the display times of the pictures. For example, the viewer 20 may continue to display pictures for longer than the specified display time due to the picture data reception status (e.g., a slowdown in reception speed, etc.). Also, for example, the user may adjust the display times of pictures during time-lapse playback using a UI (User Interface) for operating the viewer 20.
[0073] According to this modification, the viewer 20 can not only play monotonous time-lapse video in which pictures change at regular intervals, but also play flexible time-lapse video in which the playback granularity can be changed according to the purpose, such as by switching pictures quickly in some parts and slowly in other parts. This makes the modification applicable to use cases in which flexible time-lapse video playback is required. For example, the modification can be applied to a use case in which pictures taken by a security camera are usually played back with quick switching, but when a suspicious person is captured, the pictures are switched slowly to allow the viewer to understand the situation.
[0074] Furthermore, the extraction unit 102 of the server device 1 in this modified example may further include, as a function linked with the image capture device 3, an object / person extraction (recognition) function using AI, for example. For example, the extraction unit 102 performs extraction processing to extract at least one of a person and an object included in a picture. The extraction unit 102 inputs picture information further including the object / person extraction result to the generation / update unit 103. The generation / update unit 103 then generates picture information further including the object / person extraction result for each entry (picture) included in the full time lapse playlist. In this case, the generation unit 105 in this modified example adds the display time for each picture to the time lapse playlist as new information based on the object / person extraction result.
[0075] In addition, in a modified example, the reception control unit 104 may receive a time lapse request including a specification of a desired object or person from the receiving device 2, and the generation unit 105 may generate a time lapse playlist including the display time for each picture in response to the time lapse request.
[0076] For example, when the time lapse conditions include the specification of at least one of a target person and a target object, the generation unit 105 generates a time lapse playlist including entries in which the target is included in the result of the picture information extraction process, and sets the display time of pictures that include the target to be longer than the display time of pictures that do not include the target.
[0077] This enables time-lapse streaming of surveillance camera footage, etc., picking out the parts of the footage that capture desired objects or people. For example, it is possible to significantly thin out the parts that are not captured and switch between the captured parts at a specified display time (@ ?? (milliseconds)). According to this modification, for example, a person watching the surveillance camera can efficiently check the surveillance camera footage using a time-lapse playlist that includes the display time for each picture.
[0078] 8 is a diagram showing an example of the hardware configuration of the server device 1 and the receiving device 2 according to the embodiment. The server device 1 includes a control device 401, a main storage device 402, an auxiliary storage device 403, a display device 404, an input device 405, and a communication IF 406. The hardware configuration of the receiving device 2 is also the same as that shown in FIG.
[0079] The control device 401 , the main memory device 402 , the auxiliary memory device 403 , the display device 404 , the input device 405 and the communication IF 406 are connected via a bus 410 .
[0080] The control device 401 executes a program read from the auxiliary storage device 403 to the main storage device 402. The main storage device 402 is a memory such as a ROM and a RAM. The auxiliary storage device 403 is a HDD, a memory card, or the like.
[0081] The display device 404 displays the status of the server device 1, etc. The input device 405 accepts input from a user. The display device 404 and the input device 405 may be realized by a touch panel or the like having a display function and an input function. The display device 404 and the input device 405 may not be provided in the server device 1. In this case, for example, the display function and the input function of an external terminal connected to the server device 1 are used.
[0082] The communication IF 406 is an interface for connecting to the network 4 .
[0083] The program executed by the server device 1 of the embodiment is provided as a computer program product stored in an installable or executable file format on a computer-readable storage medium such as a CD-ROM, memory card, CD-R, or DVD (Digital Versatile Disc).
[0084] The program executed by the server device 1 may be stored on a computer connected to a network such as the Internet, and may be provided by being downloaded via the network.
[0085] The programs executed by the server device 1 may be provided via a network such as the Internet without being downloaded.The programs executed by the server device 1 may be provided by being pre-installed in a ROM or the like.
[0086] It should be noted that some or all of the functions of the server device 1 may be realized by hardware such as an integrated circuit (IC). The IC is, for example, a processor that executes dedicated processing.
[0087] Furthermore, when each function is realized using a plurality of processors, each processor may realize one of the functions, or may realize two or more of the functions.
[0088] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims.
[0089] (Addendum) The above-described embodiments can be summarized as the following technical proposals.
[0090] Technical proposal 1 generating a first time-lapse playlist including a plurality of entries in which reference information of the second data included in the first data and information of the second data are associated with each other; In response to a request including a time lapse condition, extracting from the first time lapse playlist an entry including information on the second data that matches the time lapse condition, and generating a second time lapse playlist including the extracted entry; a processor for sending a response including the second time-lapse playlist; A server device comprising: Technical proposal 2 the first time lapse playlist is a full time lapse playlist that includes reference information for all of the second data included in the first data; A server device according to Technical Proposal 1. Technical proposal 3 the first data is streaming data, the second data is a picture; A server device according to technical proposal 1 or 2. Technical proposal 4 the streaming data is in a data format of a segment or chunk, the reference information is information that references the segment or the chunk, the pictures are stored in the segments or chunks, the picture information includes at least one of a type of the picture, a data size of the picture, a timestamp of the picture, and a storage location of the picture; A server device according to Technical Proposal 3. Technical proposal 5 the processing unit further performs an extraction process to extract at least one of a person and an object included in the picture; the information about the picture includes a result of the extraction process on the picture; A server device according to technical proposal 3 or 4. Technical proposal 6 the time lapse conditions include designation of a target that is at least one of a target person and a target object; the second time-lapse playlist includes an entry whose target is included in the result of the extraction process of the picture information; A server device according to Technical Proposal 5. Technical proposal 7 the processing unit adds a display time indicating a time from when display of the picture included in the extracted entry starts to when display of the picture included in the extracted entry ends to information of the picture included in the extracted entry; The display time of the picture including the object is longer than the display time of the picture not including the object. A server device according to Technical Proposal 6. Technical proposal 8 A server device according to any one of technical proposals 1 to 7; an acquisition device that acquires the first data and transmits the first data to the server device; A distribution system comprising: Technical proposal 9 a server device generates a first time-lapse playlist including a plurality of entries in which reference information of second data included in the first data is associated with information of the second data; the server device extracts, in response to the request including the time lapse conditions, entries including information on the second data that matches the time lapse conditions from the first time lapse playlist, and generates a second time lapse playlist including the extracted entries; the server device transmits a response including the second time lapse playlist. An information processing method including: Technical proposal 10 On the computer, generating a first time-lapse playlist including a plurality of entries in which reference information of the second data included in the first data and information of the second data are associated with each other; In response to a request including a time lapse condition, extracting from the first time lapse playlist an entry including information on the second data that matches the time lapse condition, and generating a second time lapse playlist including the extracted entry; transmitting a response including the second time lapse playlist; program. [Explanation of symbols]
[0091] 1. Server device 2. Receiving device 3. Imaging equipment 4 Network 10 Processing section 11 Communications Department 12 Storage section 13 Collection and distribution control section 14 Time-lapse distribution control unit 20 Viewer 101 Reception control section 102 Extraction part 103 Generation / update section 104 Reception control section 105 Generation part 106 Transmission control section 401 Control device 402 Main storage 403 Auxiliary storage 404 Display device 405 Input Device 406 Communication Interface 410 Bus
Claims
1. generating a first time-lapse playlist including a plurality of entries in which reference information of the second data included in the first data is associated with information of the second data; In response to a request including a time lapse condition, extracting from the first time lapse playlist entries including information of the second data that matches the time lapse condition, and generating a second time lapse playlist including the extracted entries; a processor for sending a response including the second time-lapse playlist; A server device comprising:
2. the first time lapse playlist is a full time lapse playlist that includes reference information for all of the second data included in the first data; The server device according to claim 1 .
3. the first data is streaming data, the second data is a picture; 3. The server device according to claim 1 or 2.
4. the streaming data is in a data format of a segment or chunk, the reference information is information that references the segment or the chunk, the pictures are stored in the segments or chunks, the picture information includes at least one of a type of the picture, a data size of the picture, a timestamp of the picture, and a storage location of the picture; The server device according to claim 3 .
5. the processing unit further performs an extraction process to extract at least one of a person and an object included in the picture; the information about the picture includes a result of the extraction process on the picture; The server device according to claim 3 .
6. the time lapse conditions include designation of a target that is at least one of a target person and a target object; the second time-lapse playlist includes an entry whose target is included in the result of the extraction process of the picture information; The server device according to claim 5 .
7. the processing unit adds a display time indicating a time from when display of the picture included in the extracted entry starts to when display of the picture included in the extracted entry ends to information of the picture included in the extracted entry; The display time of the picture including the object is longer than the display time of the picture not including the object. The server device according to claim 6.
8. The server device according to claim 1 or 2; an acquisition device that acquires the first data and transmits the first data to the server device; A distribution system comprising:
9. a server device generates a first time-lapse playlist including a plurality of entries in which reference information of second data included in the first data is associated with information of the second data; the server device extracts, in response to the request including the time lapse conditions, entries including information on the second data that matches the time lapse conditions from the first time lapse playlist, and generates a second time lapse playlist including the extracted entries; the server device sends a response including the second time lapse playlist. An information processing method including:
10. On the computer, generating a first time lapse playlist including a plurality of entries in which reference information of the second data included in the first data is associated with information of the second data; In response to a request including a time lapse condition, extracting from the first time lapse playlist an entry including information on the second data that matches the time lapse condition, and generating a second time lapse playlist including the extracted entry; transmitting a response including the second time lapse playlist; program.
Citation Information
Patent Citations
System and method for processing information
JP2011150649A
System and method for reproducing moving image scene of medium and recording medium of moving image scene reproducing method
JP2014064263A
Apparatus and methods for presentation of key frames in encrypted content
US20200314461A1
Video generation system
JP2023032639A