Image transmission system

Abstract

The invention provides an image transmission system, which enables a user to flexibly select a viewing method according to the condition at the time when a specific phenomenon occurs. The image transmission system transmits an image of a region in which a target is present. The image transmission system includes one or more processors. When the specific recommended viewing condition is satisfied, the one or more processors provide a notification indicating that the specific recommended viewing condition is satisfied to the user terminal of the user. The one or more processors, in conjunction with the provision of the notification, provide selection request information to the user terminal, the selection request information presenting a plurality of options including whether to view the video in real time or to view the video in a recording manner. The one or more processors transmit the video to the user terminal in real time when receiving a user response indicating a selection of viewing the video in real time from the user terminal.

Description

Technical Field

[0001] The present disclosure relates to an image transmission system that transmits images of an area where a target exists. Background Art

[0002] Patent Document 1 discloses an image output device. When a prescribed phenomenon occurs and continues at the time when an output instruction is received, the image output device outputs a captured image. When the prescribed phenomenon does not continue at the time when an output instruction is received, the image output device outputs a captured image that was captured while the phenomenon was continuing.

[0003] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2017-212682

[0004] Consider an image transmission system that transmits images of an area where a target exists. When a specific phenomenon occurs in the captured image, a user of the image transmission system can view the image. However, when a specific phenomenon occurs, the user is not always in a situation where they can view the image. Summary of the Invention

[0005] One object of the present disclosure is to provide an image transmission system that allows a user to flexibly select a viewing method according to the situation at the time when a specific phenomenon occurs.

[0006] The viewpoint of the present disclosure relates to an image transmission system that transmits images of an area where a target exists.

[0007] The image transmission system includes one or more processors.

[0008] When specific recommended viewing conditions are satisfied, the one or more processors provide a notification indicating that the specific recommended viewing conditions have been satisfied to a user terminal of the user.

[0009] The one or more processors, in association with the provision of the notification, provide selection request information prompting a plurality of options including live viewing or recorded viewing of the image to the user terminal.

[0010] When the one or more processors receive a user response from the user terminal indicating a selection to view the image live, the one or more processors transmit the image to the user terminal in real time.

[0011] According to the present disclosure, when the recommended viewing conditions are satisfied, the selection request information is provided to the user terminal in association with the notification. The user can flexibly select whether to view the image live or recorded in the form of a user response according to their own situation at that time. As a result, the convenience of the user is improved. Brief Description of the Drawings

[0012] Figure 1 It is a schematic diagram showing a configuration example of an image transmission system.

[0013] Figure 2 It is a schematic diagram for explaining the condition determination process in the image transmission system.

[0014] Figure 3 It is a block diagram showing a configuration example of a management device.

[0015] Figure 4 It is a flowchart showing an example of the processing path of the image transmission system.

[0016] Figure 5 It is a schematic diagram showing an example of a screen of a user terminal that displays notification and selection request information.

[0017] Figure 6 It is a schematic diagram for explaining an example of the deletion condition for extracting an image. Detailed implementation mode

[0018] The implementation modes of the present disclosure will be described with reference to the accompanying drawings. Among them, in this implementation mode, the case where the "target" is "a school-going child", the "area where the target exists" is "a classroom in a school", and the user is "the guardian of the child (target)" is considered. However, the scope of application of the present disclosure is not limited to the content of this implementation mode.

[0019] 1. Image transmission system

[0020] 1-1. Overall view of the image transmission system

[0021] Figure 1 It is a schematic diagram showing a configuration example of the image transmission system 1. The image transmission system 1 includes a camera 20, a user terminal 30, and a management device 100.

[0022] The camera 20 is installed in a classroom in a school and captures the entire classroom where the target T is located. Multiple cameras 20 can be installed in one classroom. It can also be installed for each classroom in one school.

[0023] The user terminal 30 is an information terminal owned by the user U. The user terminal 30 has a user interface for presenting information to the user U and accepting input from the user U. As the user interface, a touch panel can be exemplified. The user terminal 30 and the management device 100 can communicate with each other via a wireless or wired communication network. As a specific example of the user terminal 30, a smart phone, a tablet computer, a PC, etc. are suitable.

[0024] The management device 100 manages the image transmission system 1. Typically, the management device 100 is a management server on the cloud. The management device 100 may be composed of multiple servers performing distributed processing.

[0025] The management device 100 communicates with the camera 20, always collecting and managing the images VID captured by the camera 20. Additionally, when the recommended viewing conditions described later are satisfied, the management device 100 provides the user terminal 30 with a notification N indicating that the recommended viewing conditions are met. In conjunction with the provision of the notification N, the management device 100 provides the user terminal 30 with selection request information REQ prompting multiple options including whether to view the image VID in real time or by recording. The user terminal 30 presents the notification N and the selection request information REQ to the user U through the user interface. The user U inputs a user response RES to the selection request information REQ through the user interface. The user terminal 30 sends the user response RES indicating the content input by the user U to the management device 100. When the user response RES is "view in real time", the management device 100 that receives the user response RES transmits the image VID to the user terminal 30 in real time.

[0026] 1-2. Condition determination process

[0027] Figure 2 It is a schematic diagram for explaining the condition determination process in the image transmission system 1. The condition determination process refers to the process of determining whether the above-mentioned recommended viewing conditions are met. The main body of the condition determination process is the condition determination unit 200. The image transmission system 1 includes a condition determination unit 200. Examples of the recommended viewing conditions are given below.

[0028] As a form of the recommended viewing conditions, consider the conditions linked to the start of a scheduled event that the target T participates in. When assuming that the target T is a school-going child, a typical example of the scheduled event that the target T participates in is a class. For example, the condition determination unit 200 determines that the recommended viewing conditions are met in conjunction with the start timing of the class. The meaning of "linked" includes not only the moment (simultaneously) when the class starts but also a certain time before the class starts (e.g., 3 minutes before the class starts). The condition determination unit 200 performs the condition determination process based on the schedule-related information SCH that the target T participates in. The schedule information SCH includes information such as the start time and end time of each class based on the class schedule, and the implementation location of each class.

[0029] As other forms of recommended viewing conditions, consider conditions based on the video VID captured by the camera 20. In this case, the condition determination unit 200 acquires the video VID and analyzes it. As an example of the recommended viewing condition based on the video VID, it can be cited that the target T appears in the video VID and the target T performs a specified action. The "specified action" includes raising a hand, speaking, having a conversation with the teacher, playing a musical instrument, etc. in the course. In addition, as another example of the recommended viewing condition based on the video VID, it can be cited that a specified situation appears in the video VID. The "specified situation" includes situations other than the actions of the target T itself, such as the target T being involved in an argument or an earthquake occurring.

[0030] In the case of performing the condition determination process based on the video VID, it is necessary for the condition determination unit 200 to determine whether the object captured in the video VID is the target T. Therefore, it is necessary for the condition determination unit 200 to acquire the target feature amount information TFA for identifying the target T. The target feature amount information TFA includes information such as the face, skeleton, and voice of the target. Thus, the condition determination unit 200 can determine that the target T appears in the video VID, the target T is speaking, etc. In addition, in a case where it is necessary to identify a specific action or posture by a motion capture device or the like, posture information POS is required. The posture information POS includes three-dimensional data of the skeleton in the case of raising a hand or playing a musical instrument.

[0031] The exemplified schedule information SCH, target feature amount information TFA, posture information POS, etc. can also be referred to as condition determination information. The user U inputs the condition determination information (for example, the class schedule of the school the target T goes to, the image of the target T, the data of the voice) through the user interface. The user terminal 30 sends the condition determination information input by the user U to the management device 100. The condition determination unit 200 acquires the condition determination information from the management device 100 and uses it in the condition determination process.

[0032] Moreover, the user U can set the recommended viewing conditions. Similar to the input of the condition determination information, the information on the recommended viewing conditions input by the user U is sent to the management device 100 via the user interface and the user terminal 30. The condition determination unit 200 acquires the information indicating the recommended viewing conditions set by the user U from the management device 100 and determines whether the recommended viewing conditions are satisfied. Thus, specific recommended viewing conditions corresponding to the intention of the user U can be set. For example, the user U can set the ON / OFF of the notification N independently for each class, and can set to provide the notification N for raising a hand and speaking in the class regardless of which class it is.

[0033] 1 - 3. Configuration of the Management Device

[0034] Figure 3FIG. 0 is a block diagram showing a configuration example of the management device 100. The management device 100 includes a control device 110 and a communication device 140.

[0035] The communication device 140 communicates with the user terminal 30 and the camera 20.

[0036] The control device 110 controls the management device 100. The control device 110 includes one or more processors 120 (hereinafter simply referred to as the processor 120) and one or more storage devices 130 (hereinafter simply referred to as the storage device 130). The processor 120 performs various processes. For example, the processor 120 includes a CPU (Central Processing Unit). The processor 120 can also be referred to as a processing circuit. The storage device 130 stores various information required for the processes related to the processor 120. Examples of the storage device 130 include a volatile memory, a non-volatile memory, an HDD (Hard Disk Drive), an SSD (Solid State Drive), etc.

[0037] The management program PROG is a computer program executed by the processor 120. By executing the management program PROG by the processor 120, the functions of the control device 110 can be realized. The management program PROG is stored in the storage device 130. Alternatively, the management program PROG can be recorded on a computer-readable recording medium. The management program PROG can be provided via a network.

[0038] The control device 110 communicates with the camera 20 and the user terminal 30 via the communication device 140. The control device 110 acquires the image VID captured by the camera 20 and stores the acquired image VID in the storage device 130.

[0039] The storage device 130 stores the condition determination information required for the condition determination unit 200 to determine whether the recommended viewing conditions are satisfied. As described above, specific examples thereof can include schedule information SCH, target feature amount information TFA, posture information POS, etc.

[0040] Moreover, the control device 110 has the functions of the above-described condition determination unit 200. In this case, the control device 110 performs condition determination processing based on the condition determination information acquired from the storage device 130. When the recommended viewing conditions are satisfied, the control device 110 provides the user terminal 30 with a notification N indicating that specific recommended viewing conditions are satisfied. The notification N is provided via the communication device 140.

[0041] The control device 110 provides the selection request information REQ that prompts a plurality of options including whether to watch the video VID in real time or by recording in association with the provision of the notification N to the user terminal 30. The user terminal 30 sends the user response RES input by the user U to the management device 100.

[0042] Figure 4 It is a flowchart showing an example of the processing path of the video transmission system 1. In step S10, the processor 120 performs a condition determination process for determining whether the recommended viewing conditions are satisfied. When the recommended viewing conditions are satisfied (step S10; yes), the process proceeds to step S20. On the other hand, when the recommended viewing conditions are not satisfied (step S10; no), the process returns to step S10.

[0043] In step S20, the processor 120 provides the notification N indicating that the recommended viewing conditions are satisfied to the user terminal 30, and provides the selection request information REQ that prompts an option of whether to watch the video VID in real time or by recording in association with the notification N to the user terminal 30.

[0044] In step S30, the processor 120 executes a process based on the content of the user response RES. That is, when the user response RES is "watch in real time", the processor 120 transmits the video VID to the user terminal 30 in real time. On the other hand, when the user response RES is "watch by recording", the process returns to S10. In addition, for the video VID, it can always be saved in the storage device 130 regardless of the content of the user response RES, or the user response RES of "watch by recording" can be used as a trigger to start recording the video VID from that moment.

[0045] In addition, when there is no user response RES for a certain period of time or more since the notification N was provided, it can be regarded as selecting to watch by recording to advance the process. Thus, even when the user U fails to notice the notification N and the course that the user U wants to watch ends, etc., an opportunity to watch the video VID will be given.

[0046] 1 - 4. Effects

[0047] As described above, according to the present embodiment, when the recommended viewing conditions are satisfied, the selection request information REQ is provided to the user terminal 30 in association with the notification N. The user U can flexibly select whether to watch the video VID in real time or by recording in the form of the user response RES according to his / her own situation at this time. Thereby, the convenience of the user U is improved.

[0048] In addition, by providing a means to view the recorded video later, the timing of video viewing of the entire video transmission system 1 including other users can be dispersed, suppressing an increase in the number of parallel streams caused by real-time transmission. This helps to suppress congestion and contributes to the conservation of communication resources. Also, when the user U views the video VID in real time during the out-of-home process, the mobile communication fee is often incurred depending on the communication environment. If an option to view the recorded video is provided, since it is often possible to use the flat-rate communication at home, the possibility of suppressing the communication cost becomes high.

[0049] 2. Notification and Selection

[0050] 2-1. Example of Notification Screen

[0051] Figure 5 FIG. is a schematic diagram showing an example of a screen of the user terminal 30 on which the notification N and the selection request information REQ are displayed. Here, the user terminal 30 is depicted as a smartphone owned by the user U. Selection request information REQ ("view now" and "view later" options) linked to the notification N is provided. By the user U clicking on either "view now" or "view later", the user response RES is sent to the management device 100. Here, the icons of "view now" and "view later" respectively correspond to the user response RES as "real-time viewing" and "recorded video viewing".

[0052] In Figure 5 the example of (A), the time when the notification N is provided and the selection request information REQ are displayed. By providing such options, the user U can more easily select whether to view the video VID in real time or as a recorded video according to their own busy or idle state. In addition, in Figure 5 (B), in addition to the time and the selection request information REQ, the content of the recommended viewing conditions satisfied (prescribed posture, piano performance, start of music lesson) is also displayed. When the content of the recommended viewing conditions (i.e., the reason for recommended viewing) is also displayed together with the options, since the judgment materials for selection increase, a more appropriate selection can be made.

[0053] Although not shown in the figure, as an example of other notification screens, the following method is also considered. For example, an image (a still image captured from the video VID) when the recommended viewing conditions are satisfied can be displayed as a thumbnail in association with the notification N. Thereby, the user U can easily grasp the content of the video VID and can more easily select whether to view it in real time or as a recorded video.

[0054] Before making a user response RES to a selection request message REQ, when new recommended viewing conditions are met, a new notification N and the selection request message REQ are additionally displayed. Typically, based on the timing when the recommended viewing conditions are met, the notification N and the selection request message REQ are displayed in chronological order.

[0055] 2-2. Conditions for eliminating the notification

[0056] If specific conditions are met, the notification N is eliminated. This condition is called the notification elimination condition. Examples of the notification elimination condition and the processing when the notification elimination condition is met are as follows.

[0057] The notification elimination condition can be the case where the recommended viewing conditions that triggered the provision of the notification N are no longer met. For example, when the recommended viewing condition is a condition linked to the start of a course, the notification is deleted in linkage with the end of the course. When the recommended viewing condition is the action of playing the piano, the notification is eliminated in linkage with the end of the piano performance. Additionally, the notification elimination condition can also be the case where no user response RES has been made even after a specified time has passed since the provision of the notification N.

[0058] The maximum number of notifications N that can be displayed on the user terminal 30 can be preset. In this case, the notification elimination condition is that the number of displayed notifications N reaches the set number, and the notification N is deleted according to the notification elimination order.

[0059] A typical example of the notification elimination order is the chronological order. In this case, the notifications are eliminated in order from the earlier ones. On the other hand, the notification N can be eliminated based on an order different from the chronological order. As an example in this case, a method based on the recommended viewing conditions preset by the user U, the past viewing history, and the selection history of the notification N can be cited. For example, when the user U has specified the start of sports and music courses as the recommended viewing conditions, but has watched more video of music courses so far, the notification related to the video of the music course is retained, and the notification related to the video of the sports course is eliminated.

[0060] 3. Processing of video

[0061] 3-1. Saving and video viewing of video

[0062] As described above, the data of the video VID is stored in the storage device 130. The user U can view, through the user terminal 30, a video that extracts a part of the stored video VID according to his own expectations. Specifically, the control device 110 receives, from the user U (through the user terminal 30), a request to view the recorded video of the stored video VID. The control device 110 sends the extracted part of the video VID with the viewing request to the user terminal 30.

[0063] The extracted part of the video VID that may be the object of viewing the recording is taken as the extracted video VID-i. Here, since the video VID is a series of videos captured by the camera 20, in order to extract a part of it as the extracted video VID-i, it is necessary to set the start point and the end point of the extraction. The start point of the extracted video VID-i is the moment when the condition determination unit 200 determines that the recommended viewing condition is satisfied. In addition, the method of setting the end point of the extracted video VID-i can be exemplified as follows.

[0064] In the case where the recommended viewing condition for a predetermined time (mainly based on the schedule information SCH) is satisfied, the end of the activity is regarded as the end point of the extracted video VID-i. In addition, in the case where the recommended viewing condition is a condition based on the content of the video VID, the condition determination unit 200 regards the moment when the end of the phenomenon that becomes the trigger for it is recognized as the end point.

[0065] The extracted video VID-i sent to the user terminal 30 can be appropriately edited. As an example of editing, forms such as a highlight video that extracts a part of interest (raising a hand, speaking, etc. of the target T) that is particularly close to the recommended viewing condition during class, and a slide that summarizes the images (still images) of the parts of interest can be exemplified. In addition, the extracted video VID-i can be sent in a state where the target T is enlarged. It is assumed that the camera 20 is set in a wide angle to capture the entire space. Therefore, if the extracted video VID-i for the user U is provided with the part of the target T enlarged, the user U can more easily grasp the appearance of the target T (his own child). Such editing can be applied not only in the case of viewing the recording but also in the case of real-time transmission.

[0066] 3-2. Deletion of Video

[0067] If a specific deletion condition is satisfied, the stored video VID is deleted. As an example of the deletion condition, it can be cited that a certain time has passed since the storage, and the capacity of the storage destination is above a specified value. The deletion process of the video VID is deleted in units of the extracted video VID-i. In this case, different deletion conditions can be set for each of the extracted video VID-i. The following shows a specific example thereof.

[0068] Figure 6This is a schematic diagram for explaining examples of deletion conditions for the extracted video VID-i. The extracted videos VID-1 to 3 are, for example, videos of each course on a certain day. Here, the extracted video VID-1 is a video that does not meet the recommended viewing conditions. The extracted video VID-2 is a video that meets the recommended viewing conditions and is selected by the user U for live viewing. The extracted video VID-3 is a video that meets the recommended viewing conditions and is selected by the user U for recording and viewing. The deletion conditions set for the extracted videos VID-1 to 3 are respectively set as the first deletion condition, the second deletion condition, and the third deletion condition. In this example, it is assumed that the first deletion condition to the third deletion condition are set based on the elapsed time since storage. The first deletion condition is set to be 1 week after storage, the second deletion condition is set to be 1 month after storage, and the third deletion condition is set to be 1 year after storage.

[0069] Therefore, the extracted video VID-1 is deleted based on the first deletion condition 1 week after storage. Similarly, the extracted videos VID-2 and VID-3 are deleted 1 month after storage (second deletion condition) and 1 year after storage (third deletion condition), respectively. That is, the storage period of the extracted video VID-1, for which the demand of the user U is considered relatively small, is the shortest, and the storage period of the extracted video VID-3, for which the possibility of the user U recording and viewing is considered the highest, is the longest. By setting such deletion conditions, it is possible to set the storage period for each extracted video VID-i obtained by refining a series of videos VID, which contributes to the management of an appropriate data storage capacity corresponding to the demand of the user U.

[0070] Here, regarding the extracted video VID-3, it may include not only the case where the user U actively selects recording and viewing, but also, as described in paragraphs 1-3, the case where it is regarded as selecting recording and viewing because there is no user response RES to the notification N for a specified time or more. Thus, even in a situation where the user U cannot confirm the notification N and the course ends and the notification N is eliminated, the opportunity for recording and viewing can be given for a long time.

[0071] Explanation of reference numerals

[0072] 1: Video transmission system; 20: Camera; 30: User terminal; 100: Management device; 110: Control device; 120: Processor; 130: Storage device; 140: Communication device; 200: Condition determination unit; T: Target; U: User; VID: Video; VID-i: Extracted video.

Claims

1. An image transmission system for transmitting an image of an area where a target exists, wherein: Have one or more processors, When a specific recommended viewing condition is satisfied, the one or more processors provide a notification indicating that the specific recommended viewing condition is satisfied to a user terminal of the user, The one or more processors are linked with the provision of the notification to provide the user terminal with selection request information including a plurality of options of viewing the image in real time or in recorded form, The one or more processors transmit the video to the user terminal in real time when receiving a user response indicating a selection to view the video in real time from the user terminal.

2. The image transmission system according to claim 1, wherein: Also provided with one or more storage devices for storing the image data, Furthermore, when receiving the user response indicating a selection to record and watch the image, the one or more processors retain the extracted image after satisfying the specific recommended viewing condition without deleting it from the one or more storage devices until a specific deletion condition is satisfied.

3. The image transmission system according to claim 1, wherein: The one or more processors further acquire information indicating the specific recommended viewing condition preset by the user, and determine whether the specific recommended viewing condition preset by the user is satisfied.

4. The image transmission system according to claim 1, wherein: The notification indicates content that satisfies the specific recommended viewing condition.

5. The image transmission system according to claim 1, wherein: The specific recommended viewing condition includes at least one of the following: The time from the start of the scheduled activity in which the target participates to the start of the scheduled activity in which the target participates is a certain time; The target shown in the image performs a predetermined action; and A predetermined condition is shown on the image.

Images