Video distribution system

Abstract

To provide a video distribution system that when a specific event occurs, enables a user to select a viewing method flexibly depending on a situation at the event.SOLUTION: A video distribution system distributes video of an area in which a target exists. The video distribution system comprises one or a plurality of processors. When a specific viewing recommendation condition is satisfied, the one or plurality of processors provide a user terminal of a user with a notification showing that the specific viewing recommendation condition is satisfied. In cooperation with the provision of the notification, the one or plurality of processors provide the user terminal with selection request information for presenting a plurality of alternatives including whether to perform live viewing or recording viewing of the video. When receiving a user response showing a selection of performing live viewing of the video from the user terminal, the one or plurality of processors performs live distribution of the video to the user terminal.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a video distribution system that distributes video of an area where a target exists.

Background Art

[0002] Patent Document 1 discloses an image output device. When a predetermined event occurs, the image output device outputs a captured image if the predetermined event is continuing at the time when the output instruction is received. If the predetermined event is not continuing at the time when the output instruction is received, the image output device outputs a captured image captured during the continuation.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Consider a video distribution system that distributes video of an area where a target exists. A user of the video distribution system can view the video when a specific event occurs in the captured video. However, the user is not always in a situation where the video can be viewed when a specific event occurs.

[0005] One object of the present disclosure is to provide a video distribution system that allows a user to flexibly select a viewing method according to the situation at the time when a specific event occurs.

Means for Solving the Problems

[0006] The viewpoint of the present disclosure relates to a video distribution system that distributes video of an area where a target exists. The video distribution system includes one or more processors. When one or more processors determine that specific viewing recommendation conditions are met, they provide a notification indicating that the specific viewing recommendation conditions are satisfied to the user's user terminal. In conjunction with providing the notification, one or more processors provide selection request information to the user terminal that presents a plurality of options including live viewing or recorded viewing of the video. When one or more processors receive a user response from the user terminal indicating a selection to view the video live, they live stream the video to the user terminal.

Advantages of the Invention

[0007] According to the present disclosure, when the viewing recommendation conditions are met, selection request information is provided to the user terminal in conjunction with the notification. The user can flexibly select whether to view the video live or recorded in the form of a user response according to their situation at that time. This improves the convenience for the user.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0009] Embodiments of the present disclosure will be described with reference to the accompanying drawings. In this embodiment, the "target" is a "child attending school", the "area where the target exists" is a "classroom in the school", and the user is considered to be the "guardian of the child (target)". However, the scope of application of the present disclosure is not limited to the content of this embodiment.

[0010] 1. Video distribution system 1-1. Overall image of the video distribution system FIG. 1 is a schematic diagram showing a configuration example of a video distribution system 1. The video distribution system 1 includes a camera 20, a user terminal 30, and a management device 100.

[0011] The camera 20 is installed in a classroom in the school and captures the entire classroom where the target T is located. A plurality of cameras 20 may be installed in one classroom. They may be installed for each classroom in one school.

[0012] The user terminal 30 is an information terminal owned by the user U. The user terminal 30 includes a user interface that presents information to the user U and receives inputs from the user U. An example of the user interface is a touch panel. The user terminal 30 and the management device 100 can communicate with each other via a wireless or wired communication network. Specific examples of the user terminal 30 include smartphones, tablets, PCs, etc.

[0013] The management device 100 manages the video distribution system 1. Typically, the management device 100 is a management server on the cloud. The management device 100 may be composed of a plurality of servers that perform distributed processing.

[0014] The management device 100 communicates with the camera 20 and constantly collects and manages the video VID captured by the camera 20. Also, when the viewing recommendation conditions described later are satisfied, the management device 100 provides the user terminal 30 with a notification N indicating that the viewing recommendation conditions are satisfied. In conjunction with the provision of the notification N, the management device 100 provides the user terminal 30 with selection request information REQ including a plurality of options such as whether to view the video VID live or view it by recording. The user terminal 30 presents the notification N and the selection request information REQ to the user U through the user interface. The user U inputs a user response RES to the selection request information REQ through the user interface. The user terminal 30 transmits the user response RES indicating the content input by the user U to the management device 100. When the management device 100 receives the user response RES and the user response RES is "view live", the management device 100 live-distributes the video VID to the user terminal 30.

[0015] 1-2. Condition determination process FIG. 2 is a conceptual diagram for explaining the condition determination process in the video distribution system 1. The condition determination process refers to the process of determining whether the above-described viewing recommendation conditions are satisfied. The main body of the condition determination process is the condition determination unit 200. The video distribution system 1 includes the condition determination unit 200. Examples of the viewing recommendation conditions are given below.

[0016] As one form of the viewing recommendation conditions, conditions linked to the start of an activity that the target T is scheduled to participate in can be considered. When it is assumed that the target T is a child attending school, a class is a typical example of the activity that the target T is scheduled to participate in. For example, the condition determination unit 200 determines that the viewing recommendation conditions are satisfied in conjunction with the start timing of the class. The meaning of "in conjunction with" includes the time point (simultaneously) when the class starts, as well as a certain time before the class starts (e.g., 3 minutes before the class starts). The condition determination unit 200 executes the condition determination process based on the schedule information SCH, which is information regarding the schedule of the target T's planned participation. The schedule information SCH includes information such as the start time and end time of each class based on the class schedule, and the location where each class is held.

[0017] As another form of the viewing recommendation conditions, conditions based on the video VID captured by the camera 20 are conceivable. In this case, the condition determination unit 200 acquires the video VID and analyzes it. Examples of the viewing recommendation conditions based on the video VID include that the target T appears in the video VID and the target T performs a predetermined action. The "predetermined action" includes raising a hand or making a statement during a class, having a conversation with a teacher, playing a musical instrument, and the like. Further, as another example of the viewing recommendation conditions based on the video VID, it is mentioned that a predetermined situation appears in the video VID. The "predetermined situation" includes situations other than the actions of the target T itself, such as the target T being involved in a fight or an earthquake occurring.

[0018] When the condition determination process is executed based on the video VID, the condition determination unit 200 needs to determine whether the subject of the video VID is the target T. Therefore, the condition determination unit 200 needs to acquire the target feature amount information TFA for recognizing the target T. The target feature amount information TFA includes information such as the face, skeleton, and voice of the target. Thereby, the condition determination unit 200 can determine that the target T appears in the video VID, the target T is making a statement, and the like. Also, in cases where it is necessary to recognize a specific action or pose by motion capture or the like, pose information POS is required. The pose information POS includes three-dimensional data of the skeleton when raising a hand or playing a musical instrument.

[0019] The exemplified schedule information SCH, target feature amount information TFA, pose information POS, etc. can also be called condition determination information. The user U inputs the condition determination information (for example, the class schedule of the school attended by the target T, the image or voice data of the target T) through the user interface. The user terminal 30 transmits the condition determination information input by the user U to the management device 100. The condition determination unit 200 acquires the condition determination information from the management device 100 and uses it for the condition determination process.

[0020] Furthermore, the user U can set viewing recommendation conditions. Similar to the input of condition determination information, the information on the viewing recommendation conditions input by the user U is transmitted to the management device 100 via the user interface and the user terminal 30. The condition determination unit 200 acquires information indicating the viewing recommendation conditions set by the user U from the management device 100 and determines whether the viewing recommendation conditions are satisfied. As a result, specific viewing recommendation conditions can be set according to the preferences of the user U. For example, the user U can individually set the ON / OFF of the notification N for each class, or can set to provide the notification N for raising hands and speaking during the class regardless of which class it is.

[0021] 1-3. Configuration of the Management Device FIG. 3 is a block diagram showing a configuration example of the management device 100. The management device 100 includes a control device 110 and a communication device 140.

[0022] The communication device 140 communicates with the user terminal 30 and the camera 20.

[0023] The control device 110 controls the management device 100. The control device 110 includes one or more processors 120 (hereinafter simply referred to as the processor 120) and one or more storage devices 130 (hereinafter simply referred to as the storage device 130). The processor 120 executes various processes. For example, the processor 120 includes a CPU (Central Processing Unit). The processor 120 can also be referred to as processing circuitry. The storage device 130 stores various information necessary for the processes by the processor 120. Examples of the storage device 130 include a volatile memory, a non-volatile memory, an HDD (Hard Disk Drive), an SSD (Solid State Drive), etc.

[0024] The management program PROG is a computer program executed by the processor 120. By executing the management program PROG, the functions of the control device 110 are realized. The management program PROG is stored in the storage device 130. Alternatively, the management program PROG may be recorded on a computer-readable recording medium. The management program PROG may be provided via a network.

[0025] The control device 110 communicates with the camera 20 and the user terminal 30 via the communication device 140. The control device 110 acquires the video VID captured by the camera 20 and stores the acquired video VID in the storage device 130.

[0026] The storage device 130 stores the condition determination information necessary for the condition determination unit 200 to determine whether the viewing recommendation conditions are satisfied. As described above, specific examples thereof include schedule information SCH, target feature amount information TFA, pose information POS, etc.

[0027] Furthermore, the control device 110 has the functions of the above-described condition determination unit 200. In this case, the control device 110 executes condition determination processing based on the condition determination information acquired from the storage device 130. When the viewing recommendation conditions are satisfied, the control device 110 provides the user terminal 30 with a notification N indicating that specific viewing recommendation conditions are satisfied. The notification N is provided via the communication device 140.

[0028] In conjunction with the provision of the notification N, the control device 110 provides the user terminal 30 with selection request information REQ presenting a plurality of options including whether to view the video VID live or view it by recording. The user terminal 30 transmits a user response RES input by the user U to the management device 100.

[0029] Figure 4 is a flowchart showing an example of the processing path of the video distribution system 1. In step S10, the processor 120 performs a condition determination process to determine whether the viewing recommendation conditions are satisfied. If the viewing recommendation conditions are satisfied (step S10; Yes), the process proceeds to step S20. On the other hand, if the viewing recommendation conditions are not satisfied (step S10; No), the process returns to step S10.

[0030] In step S20, the processor 120 provides the user terminal 30 with a notification N indicating that the viewing recommendation conditions are satisfied, and in conjunction with the notification N, provides the user terminal 30 with selection request information REQ presenting options including whether to watch the video VID live or watch it by recording.

[0031] In step S30, the processor 120 executes processing based on the content of the user response RES. That is, if the user response RES is "watch live", the processor 120 live-distributes the video VID to the user terminal 30. On the other hand, if the user response RES is "watch by recording", the process returns to S10. Note that the video VID may always be stored in the storage device 130 regardless of the content of the user response RES, or recording of the video VID may be started from that point using the user response RES of "watch by recording" as a trigger.

[0032] Also, if there is no user response RES for a certain period of time or more after providing the notification N, the process may proceed assuming that "watch by recording" has been selected. This gives the user U an opportunity to watch the video VID even if the class that the user U wanted to watch has ended without noticing the notification N.

[0033] 1-4. Effects As described above, according to the present embodiment, when the viewing recommendation conditions are satisfied, the selection request information REQ is provided to the user terminal 30 in conjunction with the notification N. The user U can flexibly select whether to watch the video VID live or watch it by recording in the form of a user response RES according to their own situation at that time. Thereby, the convenience of the user U is improved.

[0034] In addition, by providing means for later viewing recorded videos, it is possible to disperse the timing of video viewing in the entire video distribution system 1 including other users, and to suppress an increase in the number of parallel streaming due to live distribution. This contributes to congestion suppression and saves communication resources. Further, when the user U views the video VID live while away from home, mobile communication charges are often incurred depending on the communication environment. If the option of viewing a recorded video is provided, it is often possible to use flat-rate communication at home, so the possibility of reducing communication charges is increased.

[0035] 2. Notification and Selection 2-1. Example of Notification Screen FIG. 5 is a schematic diagram showing an example of a screen of the user terminal 30 on which the notification N and the selection request information REQ are displayed. Here, the user terminal 30 is depicted as a smartphone owned by the user U. Selection request information REQ (options of "watch now" and "watch later") linked to the notification N is provided. By tapping either "watch now" or "watch later" by the user U, the user response RES is transmitted to the management device 100. Here, the icons of "watch now" and "watch later" correspond to the user response RES as "watch live" and "watch recorded video", respectively.

[0036] In the example of (A) in FIG. 5, the time when the notification N is provided and the selection request information REQ are displayed. By providing such options, the user U can more easily select whether to watch the video VID live or watch a recorded video according to their own busy schedule. Also, in (B) of FIG. 5, in addition to the time and the selection request information REQ, the content of the satisfied viewing recommendation conditions is displayed (a predetermined pose, a piano performance, a music lesson starts). When the content of the viewing recommendation conditions (that is, the reason why viewing is recommended) is also displayed together with the options, the basis for judgment of the selection increases, so a more appropriate selection becomes possible.

[0037] Although illustration is omitted, the following modes can also be considered as examples of other notification screens. For example, in conjunction with notification N, an image (a still image cut from video VID) when the viewing recommendation conditions are met may be displayed as a thumbnail. This allows user U to easily grasp the content of video VID and more easily select whether to watch it live or watch it by recording.

[0038] Before a user response RES is made to a certain selection request information REQ, if new viewing recommendation conditions are met, new notification N and selection request information REQ are additionally displayed. Typically, based on the timing when the viewing recommendation conditions are met, notification N and selection request information REQ are displayed in chronological order.

[0039] 2-2. Notification deletion conditions Notification N is deleted when specific conditions are met. This condition is called the notification deletion condition. Examples of the notification deletion condition and the processing when the notification deletion condition is met are shown below.

[0040] The notification deletion condition may be that the viewing recommendation condition that triggered the provision of notification N is no longer met. For example, if the viewing recommendation condition is a condition linked to the start of a class, the notification is deleted in conjunction with the end of that class. If the viewing recommendation condition is an action of playing the piano, the notification is deleted in conjunction with the end of that piano performance. Also, the notification deletion condition may be that no user response RES is made even after a predetermined time has elapsed after the provision of notification N.

[0041] The maximum number of notifications N that can be displayed on user terminal 30 may be preset. In that case, the notification deletion condition is that the number of displayed notifications N reaches the set number, and notification N is deleted according to the notification deletion order.

[0042] A typical example of the notification deletion order is the chronological order. In this case, the oldest notifications are deleted in sequence. On the other hand, based on an order different from the chronological order, notification N may be deleted. Examples of this case include methods based on viewing recommendation conditions preset by user U, past viewing histories, and selection histories for notification N. For example, if user U has previously specified the start of physical education and music classes as viewing recommendation conditions, and has viewed more videos of music classes so far, the notifications related to the videos of music classes are retained, and the videos of physical education classes are deleted.

[0043] 3. Handling of Videos 3-1. Saving and Recording / Viewing of Videos As described above, the data of video VID is stored in storage device 130. User U can view a video obtained by extracting a part of the stored video VID through user terminal 30 according to their own requirements. Specifically, control device 110 receives a request for recording / viewing of the stored video VID from user U (through user terminal 30). Control device 110 transmits the extracted part of the video VID for which a viewing request has been made to user terminal 30.

[0044] Let the extracted part of video VID that can be the target of recording / viewing be the extracted video VID-i. Here, since video VID is a series of videos captured by camera 20, in order to extract a part of it as the extracted video VID-i, it is necessary to set the start point and end point of the extraction. The start point of the extracted video VID-i is the time point when condition determination unit 200 determines that the viewing recommendation condition is satisfied. Also, the method for setting the end point of the extracted video VID-i is exemplified as follows.

[0045] If the viewing recommendation condition for a scheduled event with a determined time (mainly based on schedule information SCH) is satisfied, the end of that activity can be regarded as the end point of the extracted video VID-i. Also, if the viewing recommendation condition is based on the content of video VID, condition determination unit 200 can regard the time point when it recognizes the end of the event that triggered it as the end point.

[0046] The extracted video VID-i transmitted to the user terminal 30 may be appropriately edited. Examples of editing include a highlight video obtained by extracting particularly notable parts (such as the raising of hands or speaking of the target T) that are close to the recommended viewing conditions during the class, or a slide show that combines images (still images) of the notable parts. Also, the extracted video VID-i may be transmitted with the target T enlarged. The camera 20 is assumed to be installed with a wide-angle lens so that the entire space is captured. Therefore, if the extracted video VID-i for the user U is provided with the part of the target T enlarged, the user U can more easily grasp the state of the target T (their own child). Such editing is applicable not only in the case of recorded viewing but also in the case of live distribution.

[0047] 3-2. Deletion of Video When specific deletion conditions are met, the saved video VID is deleted. Examples of deletion conditions include the elapse of a certain period of time since being saved, or the storage capacity reaching a predetermined value or more. The process of deleting the video VID is deleted in units of the extracted video VID-i. In this case, different deletion conditions may be set for each of the extracted videos VID-i. A specific example is shown below.

[0048] FIG. 6 is a conceptual diagram for explaining an example of the deletion conditions of the extracted video VID-i. The extracted videos VID-1 to 3 are videos of each class on a certain day, for example. Here, the extracted video VID-1 is a video for which the recommended viewing conditions are not met. The extracted video VID-2 is a video that meets the recommended viewing conditions and for which the user U has selected to view live. The extracted video VID-3 is a video that meets the recommended viewing conditions and for which the user U has selected to view the recording. Let the deletion conditions set for the extracted videos VID-1 to 3 be the first deletion condition, the second deletion condition, and the third deletion condition, respectively. In this example, it is assumed that the first to third deletion conditions are set based on the elapsed time since being saved. The first deletion condition is set to one week after being saved, the second deletion condition is set to one month after being saved, and the third deletion condition is set to one year after being saved.

[0049] Therefore, the extracted video VID-1 is deleted based on the first deletion condition one week after it is saved. Similarly, the extracted video VID-2 and the extracted video VID-3 are deleted one month (second deletion condition) and one year (third deletion condition) after they are saved, respectively. That is, among these, the storage period of the extracted video VID-1, for which the needs of the user U are considered to be relatively small, is the shortest, and the storage period of the extracted video VID-3, for which the user U is considered to be most likely to record and view, is the longest. By setting such deletion conditions, it is possible to set the storage period for each of the extracted videos VID-i obtained by subdividing the series of videos VID, which contributes to the management of an appropriate data storage capacity according to the needs of the user U.

[0050] Here, for the extracted video VID-3, not only when the user U actively selects recording and viewing, but also as described in Section 1-3, it may include the case where recording and viewing are considered to have been selected because there was no user response RES for a predetermined time or more with respect to the notification N. Thereby, even in a case where the class ends without the user U being able to confirm the notification N and the notification N is deleted, the opportunity for recording and viewing is given over a long period.

Explanation of Signs

[0051] 1: Video distribution system, 20: Camera, 30: User terminal, 100: Management device, 110: Control device, 120: Processor, 130: Storage device, 140: Communication device, 200: Condition determination unit, T: Target, U: User, VID: Video, VID-i: Extracted video

Claims

1. A video distribution system for distributing video of an area where a target exists, comprising: one or more processors, wherein the one or more processors: when specific viewing recommendation conditions are met, provide a notification indicating that the specific viewing recommendation conditions are met to a user terminal of a user; in conjunction with the provision of the notification, provide selection request information for presenting a plurality of options including whether to view the video live or view it by recording to the user terminal; when receiving a user response indicating a selection to view the video live from the user terminal, live-distribute the video to the user terminal Video distribution system.

2. The video distribution system according to claim 1, further comprising: one or more storage devices for storing data of the video, wherein the one or more processors further: when receiving the user response indicating a selection to view the video by recording, hold the extracted video after the specific viewing recommendation conditions are met without deleting it from the one or more storage devices until specific deletion conditions are met Video distribution system.

3. The video distribution system according to claim 1, wherein the one or more processors further: obtain information indicating the specific viewing recommendation conditions preset by the user; determine whether the specific viewing recommendation conditions preset by the user are met Video distribution system.

4. The video distribution system according to claim 1, wherein the notification indicates the content of the specific viewing recommendation conditions that are met Video distribution system.

5. The video distribution system according to claim 1, wherein the specific viewing recommendation conditions include: the start of an activity that the target is scheduled to participate in, or a certain time until the start of an activity that the target is scheduled to participate in; the target shown in the video performing a predetermined action; and a predetermined situation being shown in the video including at least one of the above Video distribution system. ​ ​ ​

Images