Video distribution system and video distribution method
Patent Information
- Application Number
- JP2024217070
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-12-11
- Publication Date
- 2025-03-14
- Estimated Expiration
- 2040-08-27
AI Technical Summary
【0023】 このように、本開示に係る映像配信システム及び映像配信方法は、配信者に関する情報が意に反して公開されることを抑制することができる。
Smart Images

Figure 2025036448000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a video distribution system and a video distribution method. [Background technology]
[0002] There is known a technology for distributing an image displayed on a display of a user terminal on the distributor side via a network and displaying the image on a display of a user terminal on the viewer side in real time. For example, Patent Document 1 discloses a device for distributing information such as operation buttons superimposed on the image on the display of the user terminal on the distributor side via a network. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2015-41822 A Summary of the Invention [Problem to be solved by the invention]
[0004] In the above-mentioned technology, the video displayed on the display of the user terminal of the distributor is distributed as is to the user terminal of the viewer. Therefore, even if the content is not intended to be disclosed to others by the distributor, if the content is included in the video, it will be disclosed to the viewer. In particular, a notification screen such as a push notification may be displayed on the display of the user terminal of the distributor at a timing not expected by the distributor. Therefore, such a notification screen is likely to be viewed by the viewer against the distributor's will, and as a result, there is a risk that information about the distributor will be disclosed to the viewer.
[0005] Therefore, an object of the video distribution system and video distribution method according to the present disclosure is to prevent information about a distributor from being made public against his or her will. [Means for solving the problem]
[0006] A video distribution device (100) according to one embodiment of the present disclosure is a video distribution device (100) that distributes a video (V1) displayed on a display (3) of a distribution user terminal (200) to a viewing user terminal (300) in real time, and includes a notification information detection unit (12) that detects notification information related to a notification image (NP1) included in the video (V1), and a notification information processing unit (13) that processes the notification information so as to reduce the readability of the notification image (NP1) in the video (V1) when the notification information is detected by the notification information detection unit (12).
[0007] A video distribution program according to one embodiment of the present disclosure causes a computer of a video distribution device (100), which distributes a video (V1) displayed on a display (3) of a distribution user terminal (200) to a viewing user terminal (300) in real time, to function as a notification information detection unit (12) that detects notification information related to a notification image (NP1) included in the video (V1), and a notification information processing unit (13) that processes the notification information so as to reduce the readability of the notification image (NP1) in the video (V1) when notification information is detected by the notification information detection unit (12).
[0008] According to this video distribution device (100) or video distribution program, even if a notification image (NP1) is included in the video (V1) displayed on the display (3) of the distribution user terminal (200), the readability of the notification image (NP1) can be reduced when the video (V1) is distributed in real time to the viewing user terminal (300), making it difficult for the viewer to know the contents of the notification image (NP1). Therefore, this video distribution device (100) or video distribution program can prevent information about the distributor from being made public against his or her will.
[0009] A video distribution device (100) according to an embodiment of the present disclosure may be configured to include a server capable of communicating with each of the broadcast user terminal (200) and the viewer user terminal (300). This reduces the processing load of the broadcast user terminal (200) or the viewer user terminal (300) compared to a case in which all of the various processes are executed by the broadcast user terminal (200) or the viewer user terminal (300).
[0010] A video distribution device (100) according to an embodiment of the present disclosure includes a video information acquisition unit (10) that acquires video information related to a video (V1), and a notification information detection unit (12) may detect the notification information based on the video information acquired by the video information acquisition unit (10). This allows the operation and effect of the video distribution device (100) according to the present disclosure to be optimally achieved.
[0011] A video distribution device (100) according to one embodiment of the present disclosure includes a video analysis unit (11) that analyzes a video (V1) based on video information acquired by a video information acquisition unit (10), and a notification information detection unit (12) may detect notification information based on an analysis result of the video (V1) analyzed by the video analysis unit (11). In this manner, the device detects notification information by analyzing the video (V1), rather than analysis being performed by a separate device or the like. Therefore, analysis of the video (V1) and detection of notification information can be performed without being influenced by the performance of a separate device or the like.
[0012] In the video distribution device (100) according to an embodiment of the present disclosure, the video analysis unit (11) may analyze a part of the video (V1). This can reduce the processing load of the video distribution device (100) compared to the case where the entire video (V1) is analyzed.
[0013] In a video distribution device (100) according to an embodiment of the present disclosure, the video analysis unit (11) may analyze the video (V1) at multiple timings with a time interval between each other. Since the notification image (NP1) continues to be displayed on the distribution user terminal (200) for a certain period of time, even if the video (V1) is analyzed at successive timings with no time interval between each other, the analysis results are likely to be the same. Therefore, compared to the case where the video (V1) is analyzed at successive timings with no time interval between each other, the analysis accuracy is less likely to decrease even if the video (V1) is analyzed at multiple timings with a time interval between each other. On the other hand, by analyzing the video (V1) at multiple timings with a time interval between each other, it is not necessary to analyze the entire video (V1), so the processing load of the video distribution device (100) can be reduced. Therefore, it is possible to reduce the processing load of the video distribution device (100) and suppress the decrease in analysis accuracy.
[0014] In a video distribution device (100) according to an embodiment of the present disclosure, when notification information is detected by the notification information detection unit (12), the video analysis unit (11) does not need to analyze the video (V1) for a preset period of time. Since the notification image (NP1) continues to be displayed for a certain period of time on the distribution user terminal (200), it is highly likely that the notification information continues to be detected even immediately after the notification information is detected. Therefore, by stopping the analysis of the video (V1) immediately after the notification information is detected, the processing load of the video distribution device (100) can be reduced.
[0015] In a video distribution device (100) according to one aspect of the present disclosure, the notification information may include image shape information related to the image shape of the notification image (NP1), and the notification information detection unit (12) may detect the notification information based on the image shape information. That is, this device detects the notification information when an image shape characteristic of the notification image (NP1) is detected in the video (V1). This allows the action and effect of the video distribution device (100) according to the present disclosure to be optimally achieved.
[0016] In the video distribution device (100) according to an embodiment of the present disclosure, the image shape information may be information about the shapes of three preset locations in the notification image (NP1). This makes it possible to detect the notification information with high accuracy when detecting the notification information based on the image shape information, and also reduces the processing load of the video distribution device (100).
[0017] In a video distribution device (100) according to one aspect of the present disclosure, the notification information may include image color information related to the image color of the notification image (NP1), and the notification information detection unit (12) may detect the notification information based on the image color information. That is, an image color may be determined for each application that displays the notification image (NP1) on the display (3), and the device detects the notification information when the image color is detected in the notification image (NP1) in the video (V1). This allows the action and effect of the video distribution device (100) according to the present disclosure to be optimally achieved.
[0018] In a video distribution device (100) according to an embodiment of the present disclosure, the notification information may include icon information related to an icon (F4) included in a notification image (NP1), and the notification information detection unit (12) may detect the notification information based on the icon information. That is, an icon (F4) may be determined for each application that causes the notification image (NP1) to be displayed on the display (3), and the device detects the notification information when the icon (F4) is detected in the notification image (NP1) in the video (V1). This allows the action and effect of the video distribution device (100) according to the present disclosure to be optimally achieved.
[0019] A video distribution device (100) according to one embodiment of the present disclosure may include a processing target receiving unit (15) that receives information on a processing target, which is the content of a notification image (NP1) for which the notification information processing unit (13) should process the notification information, from a broadcast user terminal (200), and a processing target setting unit (16) that sets the processing target based on the information on the processing target received from the broadcast user terminal (200) by the processing target receiving unit (15). This makes it possible to specify the content of the notification image (NP1) that is not to be made public to viewers and the content of the notification image (NP1) that is to be made public, respectively, according to the wishes of the broadcaster.
[0020] In a video distribution device (100) according to an embodiment of the present disclosure, a broadcast user terminal (200) can select a display direction of a video (V1) on a display (3) of the broadcast user terminal (200) from a plurality of directions, and includes a display direction detection unit (17) that detects the display direction of the video (V1) selected on the display (3) of the broadcast user terminal (200), and the notification information detection unit (12) may detect the notification information by a detection pattern according to the display direction detected by the display direction detection unit (17). In general, the display direction of the video (V1) selected on the display (3) may vary in aspects such as the position, size, and shape of the notification image (NP1) displayed on the video (V1). Therefore, it is efficient to detect the notification information by a detection pattern optimized according to the display direction of the video (V1). This allows the notification information to be detected efficiently.
[0021] The video distribution device (100) according to an embodiment of the present disclosure may include a video information distribution unit (14) that distributes the video (V2) to the viewing user terminal (300). This allows the video (V1) with the readability of the notification image (NP1) reduced to be distributed to the viewing user terminal (300), thereby making it possible to preferably achieve the action and effect of the video distribution device (100) according to the present disclosure.
[0022] Note that the reference symbols in parentheses above are intended to indicate the reference symbols of components in the embodiments described below as an example of the present disclosure, and are not intended to limit the present disclosure to the aspects of the embodiments. Effect of the Invention
[0023] In this manner, the video distribution system and video distribution method according to the present disclosure can prevent information about the distributor from being made public against his or her will. [Brief description of the drawings]
[0024] [Figure 1] FIG. 1 is a block diagram showing a video distribution device according to this embodiment. [Diagram 2] FIG. 2 is a diagram showing a state in which a video in which only a content image is displayed is being distributed to a smartphone held vertically. [Diagram 3] FIG. 3 is a diagram showing a state in which a video displaying a content image and a notification image is being distributed to a smartphone held vertically. [Figure 4] FIG. 4 is a diagram showing a state in which a video displaying a content image and a notification image with reduced readability is being distributed to a smartphone held vertically. [Diagram 5] FIG. 5 is a diagram showing a state in which a video displaying only a content image is being distributed to a smartphone held horizontally. [Figure 6] FIG. 6 is a diagram showing a state in which a video displaying a content image and a notification image is being distributed to a smartphone held horizontally. [Figure 7] FIG. 7 is a diagram showing a state in which a video displaying a content image and a notification image with reduced readability is being distributed to a smartphone held horizontally. [Figure 8] FIG. 8 is a sequence diagram showing the flow of the processing target setting process. [Figure 9] FIG. 9 is a sequence diagram showing the flow of a process for delivering a video in which no notification image is displayed. [Figure 10] FIG. 10 is a sequence diagram showing the flow of a process for delivering a video on which a notification image is displayed. [Figure 11] FIG. 11 is a sequence diagram showing the flow of the detection pattern setting process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0025] Hereinafter, exemplary embodiments will be described with reference to the drawings. In addition, the same or corresponding parts in each drawing are given the same reference numerals, and duplicated explanations will be omitted.
[0026] [Video distribution device] FIG. 1 is a block diagram showing a video distribution device 100 according to the present embodiment. FIG. 2 is a diagram showing a state in which a video in which only a content image is displayed is distributed to a smartphone held vertically. FIG. 3 is a diagram showing a state in which a video in which a content image and a notification image are displayed is distributed to a smartphone held vertically. FIG. 4 is a diagram showing a state in which a video in which a content image and a notification image with reduced readability are displayed is distributed to a smartphone held vertically. As shown in FIGS. 1 to 4, the video distribution device 100 is a device that distributes a video V1 displayed on a display 3 of a broadcast user terminal 200 as a video V2 to a viewing user terminal 300 in real time after performing a process for reducing the readability of a notification image NP1 included in the video V1. A user who distributes the video V1 using the broadcast user terminal 200 is called a broadcaster, and a user who views the distributed video V2 using the viewing user terminal 300 is called a viewer.
[0027] Here, the "broadcast user terminal" refers to a user terminal on the broadcaster side. The broadcast user terminal may be any device that has at least a display 3 and is capable of communication (e.g., wireless communication) with other devices, and may be, for example, a smartphone, tablet, notebook computer, desktop computer, etc. Here, a smartphone is exemplified as the broadcast user terminal 200. Similarly, the "viewing user terminal" refers to a user terminal on the viewer side. The viewing user terminal may be any device that has at least a display 7 and is capable of communication (e.g., wireless communication) with other devices, and may be, for example, a smartphone, tablet, notebook computer, desktop computer, etc. Here, a smartphone is exemplified as the viewing user terminal 300.
[0028] Additionally, "video" refers to a moving image or still image displayed on the display 3 of the broadcasting user terminal 200 or the display 7 of the viewing user terminal 300. The video displayed on the display 3 of the broadcasting user terminal 200 is referred to as video V1, and the video displayed on the display 7 of the viewing user terminal 300 is referred to as video V2. Here, videos are exemplified as video V1 and video V2.
[0029] The video includes at least a content image. A "content image" is a display screen of an application being executed on the broadcast user terminal 200, and here, a display screen of a baseball game application is shown as an example. The video may also include a notification image. A "notification image" is an image displayed on the display 3 of the broadcast user terminal 200 of a notification sent from outside to the broadcast user terminal 200, and may be, for example, an image of a PUSH notification received by the broadcast user terminal 200. The notification image may be displayed on the display 3 of the broadcast user terminal 200 at a timing not intended by the broadcaster. The notification image may be displayed at one or more positions preset on the display 3 of the broadcast user terminal 200.
[0030] In the following description, the content image included in video V1, which is the video displayed on the display 3 of the broadcasting user terminal 200, is referred to as content image CP1, and the notification image included in video V1 is referred to as notification image NP1. Similarly, the content image included in video V2, which is the video displayed on the display 7 of the viewing user terminal 300, is referred to as content image CP2, and the notification image included in video V2 is referred to as notification image NP2. Since video V2 is video V1 broadcast to the viewing user terminal 300, content image CP2 has basically the same content as content image CP1. Also, notification image NP2 has basically the same content as notification image NP2, but as described below, there are cases in which notification image NP2 is a notification image with reduced readability.
[0031] Video V1, content image CP1, and notification image NP1, as well as video V2, content image CP2, and notification image NP2, are each a screen display displayed on the display 3 of the broadcast user terminal 200 or the display 7 of the viewing user terminal 300. Data (information) representing video V1, content image CP1, and notification image NP1, as well as video V2, content image CP2, and notification image NP2, are respectively called video information regarding video V1, content information regarding content image CP1, and notification information regarding notification image NP1, as well as video information regarding video V2, content information regarding content image CP2, and notification information regarding notification image NP2, and are each composed of, for example, digital signals.
[0032] The video V1 as a moving image is dynamically expressed by successively switching between the individual images (frames) constituting the video V1. The individual images (frames) constituting the video V1 are a series of content images CP1 when the video V1 does not include a notification image NP1, and are a series of content images CP1 and a series of notification images NP1 superimposed on each content image CP1 when the video V1 includes a notification image NP1. Similarly, the video V2 as a moving image is dynamically expressed by successively switching between the individual images (frames) constituting the video V2. The individual images (frames) constituting the video V2 are a series of content images CP2 when the video V2 does not include a notification image NP2, and are a series of content images CP2 and a series of notification images NP2 superimposed on each content image CP2 when the video V2 includes a notification image NP2.
[0033] The video information regarding the video V1 includes at least image data regarding the video V1, and may also include audio data accompanying the video V1. The content information regarding the content image CP1 includes at least image data regarding the content image CP1, and may also include audio data accompanying the content image CP1. The notification information regarding the notification image NP1 includes at least image data regarding the notification image NP1, and may also include audio data accompanying the notification image NP1. Similarly, the video information regarding the video V2 includes at least image data regarding the video V2, and may also include audio data accompanying the video V2. The content information regarding the content image CP2 includes at least image data regarding the content image CP2, and may also include audio data accompanying the content image CP2. The notification information regarding the notification image NP2 includes at least image data regarding the notification image NP2, and may also include audio data accompanying the notification image NP2.
[0034] "Image legibility" refers to the degree to which a user who sees an image can easily recognize the contents of the image. In other words, "reducing the image legibility" refers to making the image in a state in which the user has difficulty recognizing the contents of the image even when the image is within the user's field of vision. Specific aspects for reducing the image legibility will be described later. Note that reducing the ease with which a user can view an image (i.e., a user can view an image and recognize its contents) may also be referred to as "making an image invisible," and in this case, "making an image invisible" is synonymous with "reducing the image legibility."
[0035] Moreover, "delivering video in real time" means delivering acquired video sequentially, and video is generally delivered with a small time lag. Here, "delivering video sequentially" may mean, for example, not delivering acquired video at the timing of a request from a viewing user after accumulating the video, but delivering the individual images (frames) constituting the video sequentially after performing necessary processing as they are acquired. Furthermore, "sequential delivery" may mean live delivery or live broadcasting. Note that the individual images (frames) to be delivered may be delivered in units grouped according to a preset criterion.
[0036] The video delivery device 100 is configured as a server (computer) capable of communicating with each of the delivery user terminal 200 and the viewing user terminal 300. The video delivery device 100 is physically configured with a control arithmetic unit, a storage device, and an input / output device. The control arithmetic unit is configured with a controller 1 such as a CPU (Central Processing Unit), and executes arithmetic processing and controls the storage device and the input / output device. The storage device has, for example, a main storage device and an auxiliary storage device. The main storage device is configured with, for example, a RAM (Random Access Memory). The auxiliary storage device is configured with, for example, a ROM (Read Only Memory). The input / output device has, for example, an input device that receives data from the outside and transmits it to the storage device, and an output device that outputs to the outside the calculation results that have been calculated by the control arithmetic unit and stored in the storage device.
[0037] For example, the video distribution device 100 executes a predetermined process by loading a program stored in a ROM into a RAM and executing the program loaded into the RAM by a CPU. Note that the video distribution device 100 may have a configuration different from the above-mentioned configuration as long as it is configured as a computer.
[0038] Functionally, the controller 1 of the video distribution device 100 includes a video information acquisition unit 10, a video analysis unit 11, a notification information detection unit 12, a notification information processing unit 13, a video information distribution unit 14, a processing target receiving unit 15, a processing target setting unit 16, a display direction detection unit 17, and a detection pattern setting unit 18.
[0039] The video information acquisition section 10 acquires video information relating to the video V1. Specifically, the video information acquisition section 10 receives and acquires the video information relating to the video V1 transmitted from the broadcast user terminal 200 as described below.
[0040] The video analysis unit 11 analyzes the video V1 based on the video information (video information related to the video V1) acquired by the video information acquisition unit 10. Specifically, the video analysis unit 11 analyzes whether or not the video information related to the video V1 includes notification information (notification information related to the notification image NP1) by analyzing the video V1 based on the video information related to the video V1. The video analysis unit 11 may analyze the video V1 based on, for example, brightness information (such as brightness gradient information) included in the video information related to the video V1 (edge detection). When the video analysis unit 11 outputs an analysis result indicating that the video information related to the video V1 includes notification information related to the notification image NP1, this means that the video V1 includes the notification image NP1 (and the content image CP1). On the other hand, when the video analysis unit 11 outputs an analysis result indicating that the video information related to the video V1 does not include notification information related to the notification image NP1, this means that the video V1 does not include the notification image NP1 (the video V1 includes only the content image CP1).
[0041] The video analysis unit 11 analyzes a part of the video V1. Specifically, the video analysis unit 11 analyzes the video V1 at a plurality of timings spaced apart from one another by a time interval. More specifically, the video analysis unit 11 analyzes the video V1 only for the remaining frames (for example, one frame out of two or three frames) of the content images CP1 (and a series of notification images NP1 when displayed superimposed on each content image CP1), which are a series of frames constituting the video V1 as a moving image, after some of the frames have been thinned out. The video analysis unit 11 may thin out some of the frames at regular or irregular intervals in the time series.
[0042] Furthermore, when notification information (notification information related to notification image NP1) is detected by notification information detection unit 12 described below, video analysis unit 11 does not analyze video V1 for a preset period (e.g., 6 seconds). In other words, video analysis unit 11 does not analyze video V1 for a preset number of frames (e.g., 180 frames) after notification information related to notification image NP1 is detected. Here, "not analyzing video V1" means "stopping analysis of video V1". When a preset period (in other words, a preset number of frames) has elapsed after stopping analysis of video V1, video analysis unit 11 resumes analysis of video V1.
[0043] The notification information detection unit 12 detects notification information related to the notification image NP1 included in the video V1. The notification information detection unit 12 detects notification information related to the notification image NP1 based on the video information related to the video V1 acquired by the video information acquisition unit 10. Specifically, the notification information detection unit 12 detects notification information related to the notification image NP1 based on the analysis result of the video analysis unit 11 analyzing the video V1 after the video analysis unit 11 analyzes the video V1 based on the video information related to the video V1 acquired by the video information acquisition unit 10. That is, when the video analysis unit 11 outputs an analysis result indicating that the video information related to the video V1 includes notification information related to the notification image NP1, the notification information detection unit 12 detects notification information related to the notification image NP1 included in the video V1. On the other hand, when the video analysis unit 11 outputs an analysis result indicating that the video information related to the video V1 does not include notification information related to the notification image NP1, the notification information detection unit 12 does not detect notification information related to the notification image NP1 included in the video V1.
[0044] The notification information processing unit 13 processes the notification information regarding the notification image NP1 so as to reduce the legibility of the notification image NP1 in the video V1 when the notification information detection unit 12 detects the notification information regarding the notification image NP1. That is, the notification information processing unit 13 processes the notification information regarding the notification image NP1 so as to make it difficult for the user (e.g., a viewing user) to recognize the content of the notification image NP1 even when the notification image NP1 is included in the field of view of the user in the video V1.
[0045] As a specific embodiment for reducing the legibility of the image, the notification information processing unit 13 performs a process of blurring the area of the notification image NP1 in the video V1. "Blurring the image" may mean, for example, reducing the resolution of the image, or performing a mosaic process. As a specific embodiment for reducing the legibility of the image, the notification information processing unit 13 may perform a process of blurring an area of the video V1 that is larger than the area of the notification image NP1, or may perform a process of blurring the entire video V1. Alternatively, the notification information processing unit 13 may perform a process of filling in the area of the notification image NP1 in the video V1, may perform a process of filling in an area of the video V1 that is larger than the area of the notification image NP1, or may perform a process of filling in the entire video V1.
[0046] The video information distribution unit 14 transmits video information related to the video V2 to the viewing user terminal 300. Specifically, the video information distribution unit 14 transmits the video information related to the video V2 to the viewing user terminal 300, thereby distributing the video V2 to the viewing user terminal 300. For the video V1 in which the notification information related to the notification image NP1 is detected by the notification information detection unit 12, the video information distribution unit 14 sequentially transmits the video V2 in which the processing of the notification information related to the notification image NP1 has been completed by the notification information processing unit 13 to the viewing user terminal 300. On the other hand, for the video V1 in which the notification information related to the notification image NP1 is not detected by the notification information detection unit 12, the video information distribution unit 14 sequentially transmits the video V1 as it is as the video V2 to the viewing user terminal 300 without processing the notification information related to the notification image NP1 by the notification information processing unit 13.
[0047] The processing target receiving unit 15 receives information on the processing target from the broadcast user terminal 200. The "processing target" is the content of the notification image NP1 for which the notification information processing unit 13 is to process the notification information. The processing target may be specified, for example, by the type of application that displays the notification related to the notification image NP1 on the broadcast user terminal 200. In other words, only notifications transmitted (received by the broadcast user terminal 200) related to a specific application may be processed. The processing target is determined by a user (e.g., a broadcaster) in the broadcast user terminal 200 as described below, and is transmitted from the broadcast user terminal 200 to the video distribution device 100.
[0048] The processing target setting unit 16 sets the processing target based on the information on the processing target received from the broadcast user terminal 200 by the processing target receiving unit 15. As a result, the video distribution device 100 executes the following process. When the processing target is set by the processing target setting unit 16, the video analysis unit 11 analyzes whether or not the video information on the video V1 contains notification information on the notification image NP1 set as the processing target. When the video analysis unit 11 outputs an analysis result indicating that the video information on the video V1 contains notification information on the notification image NP1 set as the processing target, the notification information detection unit 12 detects the notification information on the notification image NP1 included in the video V1. Then, when the notification information detection unit 12 detects the notification information on the notification image NP1 set as the processing target, the notification information processing unit 13 processes the notification information on the notification image NP1 so as to reduce the readability of the notification image NP1 in the video V1.
[0049] The processing target may be specified by whether or not a preset word or pattern is included in the notification image NP1. For example, the processing target setting unit 16 may set the notification image NP1 including privacy-related words or patterns (privacy information) such as the name, address, and attributes of the distributor as the processing target. Alternatively, the processing target setting unit 16 may set the notification image NP1 including words or patterns such as "password" or "PW" as the processing target. Words or patterns such as "password" or "PW" indicate that the notification image NP1 including the words or patterns includes confidential information such as a password, and are referred to as confidential flag information here.
[0050] Among the notification images NP1, those that are set as targets for processing may be treated as targets for analysis of the video V1 in the processing of the video distribution device 100. On the other hand, among the notification images NP1, those that are set as not targets for processing may not be treated as targets for analysis of the video V1 in the processing of the video distribution device 100 (i.e., may be treated as not being notification images NP1).
[0051] The display direction detection unit 17 detects the display direction of the video V1 selected on the display 3 of the broadcast user terminal 200. Here, the "display direction" refers to the display direction of the video V1 automatically selected in the broadcast user terminal 200 based on the inclination (angle) of the broadcast user terminal 200 itself.
[0052] Specifically, when the broadcast user terminal 200 is held vertically (when the broadcast user terminal 200 is held so that the longer side of the broadcast user terminal 200 is aligned with the top-to-bottom direction), the display orientation is selected so that the longer side of the broadcast user terminal 200 is aligned with the top-to-bottom direction of the display 3 (so-called portrait display) (see Figs. 2 to 4). On the other hand, when the broadcast user terminal 200 is held horizontally (when the shorter side of the broadcast user terminal 200 is held so that the shorter side of the broadcast user terminal 200 is aligned with the top-to-bottom direction), the display orientation is selected so that the shorter side of the broadcast user terminal 200 is aligned with the top-to-bottom direction of the display 3 (so-called landscape display) (see Figs. 5 to 7). In the video broadcasting device 100, the video V2 may be displayed on the display 7 of the viewing user terminal 300 in the same orientation as the display orientation of the video V1 selected in the broadcast user terminal 200.
[0053] The detection pattern setting unit 18 sets a detection pattern for detecting notification information related to the notification image NP1 in the notification information detection unit 12. A "detection pattern" is a manner in which notification information related to the notification image NP1 contained in the video V1 is detected. The detection pattern is a pattern in which an area of the video V1 that should be analyzed with particular priority by the video analysis unit 11 is specified. Specifically, the detection pattern setting unit 18 sets a detection pattern according to the display direction on the display 3 of the broadcast user terminal 200 detected by the display direction detection unit 17. In this case, the notification information detection unit 12 detects notification information related to the notification image NP1 using a detection pattern according to the display direction detected by the display direction detection unit 17.
[0054] When the display orientation is selected such that the longer side of the broadcast user terminal 200 is the up-down direction of the display 3, the detection pattern setting unit 18 sets a detection pattern that preferentially detects the notification image NP1 in the first notification search area R1, which is the area on the upper end side in the longer side of the display 3 of the broadcast user terminal 200 (see FIG. 2). On the other hand, when the display orientation is selected such that the shorter side of the broadcast user terminal 200 is the up-down direction of the display 3, the detection pattern setting unit 18 sets a detection pattern that preferentially detects the notification image NP1 in the second notification search area R2, which is the area on the upper end side in the shorter side of the display 3 of the broadcast user terminal 200 (see FIG. 5).
[0055] [Distribution user device] The broadcast user terminal 200 is configured as a smartphone as described above, and can communicate with the video distribution device 100. The broadcast user terminal 200 is physically configured with a control arithmetic unit, a storage device, and an input / output device. The control arithmetic unit is configured with a controller 2 such as a CPU, and executes arithmetic processing and controls the storage device and the input / output device. The storage device has, for example, a main storage device and an auxiliary storage device. The main storage device is configured with, for example, a RAM. Moreover, the auxiliary storage device is configured with, for example, a ROM. The input / output device has, for example, an input device 5 that receives data from the outside and transmits it to the storage device, and an output device such as a display 3 that outputs to the outside the calculation results that are calculated by the control arithmetic unit and stored in the storage device. Moreover, the broadcast user terminal 200 has an angle sensor 4 that detects the inclination (angle) of the broadcast user terminal 200 itself. A known sensor such as a gyro sensor can be used as the angle sensor 4. The video distribution device 100 executes a predetermined process, for example, by loading a program stored in the ROM into the RAM and executing the program loaded into the RAM by the CPU.
[0056] The controller 2 of the broadcast user terminal 200 functionally comprises a video display unit 20, a notification receiving unit 21, a video information transmitting unit 22, a processing target receiving unit 23, a display direction selecting unit 24, and a display direction transmitting unit 25.
[0057] The video display unit 20 displays the video V1 on the display 3 of the broadcast user terminal 200. The video V1 includes at least a content image CP1, and when the broadcast user terminal 200 receives a notification such as a PUSH notification, it also includes a notification image NP1. The notification receiving unit 21 receives notifications such as a PUSH notification from outside (such as a server of an application that transmits the notification). The video information transmitting unit 22 sequentially transmits video information related to the video V1 to the video distribution device 100.
[0058] The processing target receiving unit 23 receives information (processing target information) related to the processing target selected by the distributor, for example, from the input device 5 operated by the distributor. Then, the processing target receiving unit 23 transmits the received processing target information to the video distribution device 100. The processing target received by the processing target receiving unit 23 is, for example, the type of application that displays a notification related to the notification image NP1 on the broadcast user terminal 200, or words or designs written in the notification image NP1, etc.
[0059] The display direction selection unit 24 selects a suitable display direction on the display 3 of the broadcast user terminal 200 according to the inclination (angle) of the broadcast user terminal 200 detected by the angle sensor 4. That is, the broadcast user terminal 200 can select from a plurality of directions for the display direction of the video V1 on the display 3 of the broadcast user terminal 200, and the display direction selection unit 24 sets the display direction according to, for example, the top-to-bottom direction of the display 3 of the broadcast user terminal 200. When the broadcast user terminal 200 is held vertically, the display direction selection unit 24 selects the display direction such that the longitudinal direction of the broadcast user terminal 200 is the up-to-down direction of the display 3. In this case, as shown in Figs. 2 to 4, the notification image NP1 is displayed in a first notification search area R1, which is the area on the top end side in the longitudinal direction of the display 3 of the broadcast user terminal 200.
[0060] On the other hand, FIG. 5 is a diagram showing a state in which a video displaying only a content image is distributed to a smartphone held horizontally. FIG. 6 is a diagram showing a state in which a video displaying a content image and a notification image is distributed to a smartphone held horizontally. FIG. 7 is a diagram showing a state in which a video displaying a content image and a notification image with reduced readability is distributed to a smartphone held horizontally. As shown in FIG. 5 to FIG. 7, when the broadcast user terminal 200 is held horizontally, the display direction selection unit 24 selects a display direction such that the short side direction of the broadcast user terminal 200 is the up-down direction of the display 3. In this case, the notification image NP1 is displayed in the second notification search area R2, which is the area on the upper end side in the short side direction of the display 3 of the broadcast user terminal 200.
[0061] 1 to 4, the display direction transmission unit 25 transmits information about the display direction selected by the display direction selection unit 24 to the video distribution device 100. For example, the display direction transmission unit 25 transmits information about the display direction selected by the display direction selection unit 24 upon receiving a display direction request from the video distribution device 100 requesting notification of the display direction. Note that the display direction transmission unit 25 may transmit information about the display direction selected by the display direction selection unit 24 at a preset timing, even if it does not receive a display direction request from the video distribution device 100.
[0062] [Viewer device] The viewing user terminal 300 is configured as a smartphone as described above, and can communicate with the video distribution device 100. The viewing user terminal 300 includes a control arithmetic device, a storage device, and an input / output device as physical components. The control arithmetic device is configured by a controller 6 such as a CPU, and executes arithmetic processing and controls the storage device and the input / output device. The storage device includes, for example, a main storage device and an auxiliary storage device. The main storage device includes, for example, a RAM. The auxiliary storage device includes, for example, a ROM. The input / output device includes, for example, an input device that receives data from the outside and transmits it to the storage device, and an output device such as a display 7 that outputs to the outside the calculation results that are calculated by the control arithmetic unit and stored in the storage device. The viewing user terminal 300 executes a predetermined process, for example, by loading a program stored in the ROM into the RAM and executing the program loaded into the RAM by the CPU.
[0063] The controller 6 of the viewer user terminal 300 functionally comprises a video information receiving section 60 and a distributed video display section 61.
[0064] The video information receiving unit 60 receives the video information about the video V2 transmitted by the video information delivering unit 14 of the video delivering device 100. Specifically, the video information receiving unit 60 sequentially receives the video information about the video V2 sequentially transmitted from the video information delivering unit 14 of the video delivering device 100.
[0065] The distributed video display unit 61 displays the video information related to the video V2 received by the video information receiving unit 60 on the display 7. When the notification information related to the notification image NP1 is detected by the notification information detection unit 12 of the video distribution device 100, the video V2 displayed on the display 7 by the distributed video display unit 61 is a video including the content image CP2 identical to the content image CP1, and a notification image NP2 in which the notification information related to the notification image NP1 has been processed so as to reduce the readability of the notification image NP1. On the other hand, when the notification information related to the notification image NP1 is not detected by the notification information detection unit 12 of the video distribution device 100, the video V2 displayed on the display 7 by the distributed video display unit 61 is a video including only the content image CP2 identical to the content image CP1.
[0066] [Detection method] A description will be given of a method for detecting the notification information related to the notification image NP1 by the notification information detection unit 12. As shown in Fig. 2 to Fig. 7, the notification information detection unit 12 detects the notification information related to the notification image NP1 by a detection method according to the aspect of the notification image NP1.
[0067] When the notification information regarding the notification image NP1 includes image shape information regarding the image shape of the notification image NP1, the notification information detection unit 12 may detect the notification information regarding the notification image NP1 based on the image shape information. The image shape information is the shape of a specific portion characterized in the notification image NP1. Here, the notification image NP1 is displayed as a rectangular window with four curved corners (i.e., chamfered) in the first notification search area R1 of the display 3 of the broadcast user terminal 200 held vertically. At this time, the notification information detection unit 12 detects the notification information regarding the notification image NP1 based on the image shape information regarding the shape of the window of the notification image NP1.
[0068] Specifically, the image shape information may be information about the shapes of three preset locations (first shape detection portion F1, second shape detection portion F2, and third shape detection portion F3) in the notification image NP1. More specifically, the notification information detection unit 12 detects an image whose shape and relative position match the shapes (corners formed by curved lines) of three of the four corners of the window of the notification image NP1 as notification information related to the notification image NP1. Here, the first shape detection portion F1, the second shape detection portion F2, and the third shape detection portion F3 are the three locations of the four corners of the window of the notification image NP1, respectively, but the first shape detection portion F1, the second shape detection portion F2, and the third shape detection portion F3 may be other locations (for example, locations inside the window) than these. The video analysis unit 11 may analyze whether an image whose shape and relative position match those of three of the four corners of the window of the notification image NP1 (corners formed by curved lines) exists within the screen display of the display 3, and the notification information detection unit 12 may detect notification information related to the notification image NP1 based on the analysis results. At this time, the video analysis unit 11 may preferentially analyze the first notification search area R1 of the display 3 of the broadcast user terminal 200.
[0069] When the notification information regarding the notification image NP1 includes image color information regarding the image color of the notification image NP1, the notification information detection unit 12 may detect the notification information regarding the notification image NP1 based on the image color information. The image color information is the color of a specific portion characterized in the notification image NP1. Here, the notification image NP1 is displayed in the first notification search area R1 of the display 3 of the broadcast user terminal 200 held vertically as a window configured to include a representative color (a color that characterizes the application and is frequently used on the screen of the application) of the application that issues the notification related to the notification image NP1. At this time, the notification information detection unit 12 detects the notification information regarding the notification image NP1 based on the image color information regarding the color of the window of the notification image NP1.
[0070] Specifically, the notification information detection unit 12 detects an image in which the window color of the notification image NP1 matches the representative color of a pre-stored application as notification information related to the notification image NP1. Note that the video analysis unit 11 may analyze whether or not an image in which the window color of the notification image NP1 matches the representative color of a pre-stored application is present within the screen display of the display 3, and the notification information detection unit 12 may detect the notification information related to the notification image NP1 based on the analysis result. At this time, the video analysis unit 11 may preferentially analyze the first notification search area R1 of the display 3 of the broadcast user terminal 200.
[0071] When the notification information regarding the notification image NP1 includes icon information regarding the icon F4 included in the notification image NP1, the notification information detection unit 12 may detect the notification information regarding the notification image NP1 based on the icon information. Icon information is information such as the shape or color of an icon characterized in the notification image NP1. Here, the notification image NP1 is displayed in the first notification search area R1 of the display 3 of the broadcast user terminal 200 held vertically as a window configured to include the icon F4 (icon of the application) of the application that provides the notification related to the notification image NP1. At this time, the notification information detection unit 12 detects the notification information regarding the notification image NP1 based on the image color information regarding the icon F4 of the notification image NP1.
[0072] Specifically, the notification information detection unit 12 detects an image in which the icon F4 included in the notification image NP1 matches the icon of a pre-stored application as notification information related to the notification image NP1. Note that the video analysis unit 11 may analyze whether or not an image in which the icon F4 included in the notification image NP1 matches the icon of a pre-stored application is present within the screen display of the display 3, and the notification information detection unit 12 may detect notification information related to the notification image NP1 based on the analysis results. At this time, the video analysis unit 11 may preferentially analyze the first notification search area R1 of the display 3 of the broadcast user terminal 200.
[0073] The video distribution device 100 may execute a detection method according to the OS (Operating System) of the broadcast user terminal 200. Alternatively, the video distribution device 100 may process only the video V1 received from a broadcast user terminal 200 equipped with a specific OS.
[0074] [Processing target setting process] The processing target setting process executed in the video distribution device 100 will be described. FIG. 8 is a sequence diagram showing the flow of the processing target setting process. In step S10 of FIG. 8, the broadcast user terminal 200 receives information (processing target information) related to the processing target selected by the broadcaster, for example, from the input device 5 operated by the broadcaster, via the processing target receiving unit 23. The processing target received by the processing target receiving unit 23 is, for example, the type of application that causes the broadcast user terminal 200 to display a notification related to the notification image NP1, or words or designs written in the notification image NP1. After that, the processing target setting process proceeds to step S12.
[0075] In step S12, the distribution user terminal 200 transmits the accepted processing target information via the processing target accepting section 23 to the video distribution device 100. After that, the processing target setting process proceeds to step S14.
[0076] In step S14, the video distribution device 100 receives information about the processing target from the broadcast user terminal 200 via the processing target receiving unit 15. After that, the video distribution device 100 sets the processing target via the processing target setting unit 16 based on the information about the processing target received from the broadcast user terminal 200 by the processing target receiving unit 15. This completes the processing target setting process by the video distribution device 100.
[0077] [Distribution process (distribution process without notification image)] Among the distribution processes executed in the video distribution device 100, a distribution process in which the video V1 does not include a notification image NP1 (distribution process without a notification image) will be described. FIG. 9 is a sequence diagram showing the flow of distribution processing for a video in which a notification image is not displayed. In step S20 of FIG. 9, the broadcast user terminal 200 causes the video display unit 20 to display the video V1 on the display 3. Here, the video V1 includes only a content image CP1, and does not include a notification image NP1. In the following step S22, the broadcast user terminal 200 sequentially transmits video information related to the video V1 to the video distribution device 100 by the video information transmission unit 22. Thereafter, the distribution process without a notification image proceeds to step S24.
[0078] In step S24, the video distribution device 100 acquires video information related to the video V1 transmitted from the video distribution device 100 through the video information acquisition unit 10. Thereafter, the video distribution device 100 analyzes the video V1 through the video analysis unit 11 based on the video information related to the video V1 acquired through the video information acquisition unit 10. Specifically, the video analysis unit 11 analyzes the video V1 based on the video information related to the video V1 to determine whether or not the video information related to the video V1 includes notification information related to the notification image NP1. In the following step S26, the video distribution device 100 does not detect notification information related to the notification image NP1 included in the video V1 through the notification information detection unit 12. Thereafter, the distribution process without notification image proceeds to step S28.
[0079] In step S28, the video distribution device 100 transmits video information about the video V2 to the viewing user terminal 300 via the video information distribution unit 14. Specifically, the notification information processing unit 13 does not process the notification information about the notification image NP1, and the video V1 is transmitted as is as the video V2 to the viewing user terminal 300 one by one. After that, the distribution process without a notification image proceeds to step S30.
[0080] In step S30, the viewing user terminal 300 receives, via the video information receiving unit 60, the video information related to the video V2 transmitted by the video information distribution unit 14 of the video distribution device 100. Specifically, the video information receiving unit 60 sequentially receives the video information related to the video V2 sequentially transmitted from the video information distribution unit 14 of the video distribution device 100. Thereafter, the viewing user terminal 300 causes the distributed video display unit 61 to display, on the display 7, the video information related to the video V2 received by the video information receiving unit 60. At this time, the video V2 displayed on the display 7 by the distributed video display unit 61 is a video including only the content image CP2 that is the same as the content image CP1. This completes the notification image-free distribution process by the video distribution device 100.
[0081] [Distribution process (distribution process with notification image)] Among the distribution processes executed in the video distribution device 100, the distribution process (distribution process with notification image) in which the video V1 includes a notification image NP1 will be described. FIG. 10 is a sequence diagram showing the flow of the distribution process for a video in which a notification image is displayed. In step S40 of FIG. 10, the broadcast user terminal 200 causes the video display unit 20 to display the video V1 on the display 3. At the time of step S40, the video V1 includes only the content image CP1, and does not include the notification image NP1. Thereafter, the distribution process with notification image proceeds to step S42.
[0082] In step S42, the broadcaster user terminal 200 receives a notification such as a PUSH notification from outside via the notification receiving unit 21. In the following step S44, the broadcaster user terminal 200 causes the video display unit 20 to display the video V1 on the display 3. At the time of step S42, the video V1 includes both a content image CP1 and a notification image NP1. In the following step S46, the broadcaster user terminal 200 sequentially transmits video information related to the video V1 to the video distribution device 100 via the video information transmitting unit 22. Thereafter, the distribution process with notification image proceeds to step S48.
[0083] In step S48, the video distribution device 100 acquires video information related to the video V1 transmitted from the video distribution device 100 through the video information acquisition unit 10. Thereafter, the video distribution device 100 analyzes the video V1 through the video analysis unit 11 based on the video information related to the video V1 acquired through the video information acquisition unit 10. Specifically, the video analysis unit 11 analyzes the video V1 based on the video information related to the video V1 to determine whether or not the video information related to the video V1 includes notification information related to the notification image NP1. In the following step S50, the video distribution device 100 detects notification information related to the notification image NP1 included in the video V1 through the notification information detection unit 12. Thereafter, the distribution process with notification image proceeds to step S52.
[0084] In step S52, the video distribution device 100 stops the analysis of the video V1 for a preset period (i.e., for a preset number of frames) by the video analysis unit 11. After that, the notification image delivery process proceeds to step S54.
[0085] In step S54, the broadcast user terminal 200 processes the notification information related to the notification image NP1 by the notification information processing unit 13 so as to reduce the readability of the notification image NP1 in the video V1. As a specific example for reducing the readability of the image, the notification information processing unit 13 executes a process of blurring the area of the notification image NP1 in the video V1. Thereafter, the broadcast process with notification image proceeds to step S56.
[0086] In step S56, the video distribution device 100 transmits the video V2, which has been processed to reduce the readability of the notification image NP1 in the video V1, to the viewer user terminal 300 by the video information distribution unit 14. Thereafter, the notification image delivery process proceeds to step S58.
[0087] In step S58, the viewing user terminal 300 receives the video information related to the video V2 transmitted by the video information distribution unit 14 of the video distribution device 100 through the video information receiving unit 60. Specifically, the video information receiving unit 60 sequentially receives the video information related to the video V2 sequentially transmitted from the video information distribution unit 14 of the video distribution device 100. Thereafter, the viewing user terminal 300 causes the distributed video display unit 61 to display the video information related to the video V2 received by the video information receiving unit 60 on the display 7. At this time, the video V2 displayed on the display 7 by the distributed video display unit 61 is a video including the content image CP2 identical to the content image CP1, and a notification image NP2 in which notification information related to the notification image NP1 has been processed so as to reduce the readability of the notification image NP1. With the above, the distribution process with notification image by the video distribution device 100 is completed.
[0088] [Detection pattern setting process] The detection pattern setting process executed in the video distribution device 100 will now be described. Fig. 11 is a sequence diagram showing the flow of the detection pattern setting process. In step S60 of Fig. 11, the broadcast user terminal 200 detects and acquires the inclination (angle) of the broadcast user terminal 200 itself using the angle sensor 4. In the following step S62, the broadcast user terminal 200 selects a suitable display direction on the display 3 of the broadcast user terminal 200 using the display direction selection unit 24, depending on the inclination (angle) of the broadcast user terminal 200 detected by the angle sensor 4. Thereafter, the detection pattern setting process proceeds to step S64.
[0089] In step S64, the video distribution device 100 transmits a display direction request to the broadcaster user terminal 200 to request notification of the current display direction. In the following step S66, the broadcaster user terminal 200 transmits information regarding the display direction selected by the display direction selection unit 24 to the video distribution device 100 via the display direction transmission unit 25. After that, the detection pattern setting process proceeds to step S68.
[0090] In step S68, the video distribution device 100 receives information regarding the display direction selected by the display direction selection unit 24 from the broadcast user terminal 200. As a result, the video distribution device 100 detects, via the display direction detection unit 17, the display direction of the video V1 selected on the display 3 of the broadcast user terminal 200. After that, the detection pattern setting process proceeds to step S70.
[0091] In step S70, the video distribution device 100 sets a detection pattern by the detection pattern setting unit 18 for detecting notification information related to the notification image NP1 in the notification information detection unit 12. The detection pattern is a pattern in which an area of the video V1 that should be analyzed with particular priority by the video analysis unit 11 is designated. Specifically, the detection pattern setting unit 18 sets the detection pattern according to the display direction of the display 3 of the broadcast user terminal 200 detected by the display direction detection unit 17. This completes the detection pattern setting process by the video distribution device 100.
[0092] [Video distribution program] A video distribution program for making a computer function as the video distribution device 100 will be described. The video distribution program includes a main module, a notification information detection module, and a notification information processing module. The main module is a part that controls the computer in an integrated manner. The functions realized by executing the notification information detection module and the notification information processing module are the same as the notification information detection unit 12 and the notification information processing unit 13 of the video distribution device 100 described above. As a result, the video distribution program can make the computer of the video distribution device 100, which distributes the video V1 displayed on the display 3 of the distribution user terminal 200 to the viewing user terminal 300 in real time, function as a notification information detection unit 12 that detects notification information related to the notification image NP1 included in the video V1, and a notification information processing unit 13 that processes the notification information related to the notification image NP1 so as to reduce the readability of the notification image NP1 in the video V1 when the notification information detection unit 12 detects the notification information related to the notification image NP1.
[0093] The video distribution program may include a video information acquisition module, a video analysis module, a video information transmission module, a processing target receiving module, a processing target setting module, a display direction detection module, and a detection pattern setting module. In this case, the functions realized by executing each of the video information acquisition module, the video analysis module, the video information transmission module, the processing target receiving module, the processing target setting module, the display direction detection module, and the detection pattern setting module are similar to the video information acquisition unit 10, the video analysis unit 11, the video information distribution unit 14, the processing target receiving unit 15, the processing target setting unit 16, the display direction detection unit 17, and the detection pattern setting unit 18 of the above-mentioned video distribution device 100, respectively.
[0094] [Action and Effects] As described above, the video distribution device 100 is a video distribution device that distributes the video V1 displayed on the display 3 of the distribution user terminal 200 to the viewing user terminal 300 in real time, and is equipped with a notification information detection unit 12 that detects notification information regarding a notification image NP1 contained in the video V1, and a notification information processing unit 13 that, when notification information is detected by the notification information detection unit 12, processes the notification information so as to reduce the readability of the notification image NP1 in the video V1.
[0095] In addition, the video distribution program causes the computer of the video distribution device 100, which distributes the video V1 displayed on the display 3 of the distribution user terminal 200 to the viewing user terminal 300 in real time, to function as a notification information detection unit 12 that detects notification information regarding the notification image NP1 contained in the video V1, and a notification information processing unit 13 that processes the notification information so as to reduce the readability of the notification image NP1 in the video V1 when notification information is detected by the notification information detection unit 12.
[0096] Even if the video V1 displayed on the display 3 of the broadcast user terminal 200 includes a notification image NP1, the video broadcast device 100 or the video broadcast program can reduce the readability of the notification image NP1 when the video V1 is broadcast in real time to the viewing user terminal 300, making it difficult for the viewer to know the contents of the notification image NP1. Therefore, the video broadcast device 100 or the video broadcast program can prevent information about the broadcaster from being made public against his or her will.
[0097] The video distribution device 100 is configured as a server capable of communicating with each of the broadcaster user terminal 200 and the viewing user terminal 300. This makes it possible to reduce the processing load on the broadcaster user terminal 200 or the viewing user terminal 300, compared to when various processes are executed by the broadcaster user terminal 200 or the viewing user terminal 300.
[0098] The video distribution device 100 includes a video information acquisition unit 10 that acquires video information related to the video V1, and the notification information detection unit 12 detects the notification information based on the video information acquired by the video information acquisition unit 10. This allows the video distribution device 100 to optimally exhibit its functions and effects.
[0099] The video distribution device 100 includes a video analysis unit 11 that analyzes the video V1 based on the video information acquired by the video information acquisition unit 10, and the notification information detection unit 12 detects the notification information based on the analysis result of the video V1 analyzed by the video analysis unit 11. As a result, the notification information is detected by the device analyzing the video V1, rather than analysis being performed by a separate device, etc. Therefore, the analysis of the video V1 and the detection of the notification information can be performed without being influenced by the performance of a separate device, etc.
[0100] In the video distribution device 100, the video analysis unit 11 analyzes a part of the video V1. This reduces the processing load on the video distribution device 100 compared to the case where the entire video V1 is analyzed.
[0101] In the video distribution device 100, the video analysis unit 11 analyzes the video V1 at multiple timings with a time interval between them. Since the notification image NP1 continues to be displayed on the distribution user terminal 200 for a certain period of time, even if the video V1 is analyzed at successive timings with no time interval between them, the analysis results are likely to be the same. Therefore, compared to the case where the video V1 is analyzed at successive timings with no time interval between them, the analysis accuracy is less likely to decrease even if the video V1 is analyzed at multiple timings with a time interval between them. On the other hand, by analyzing the video V1 at multiple timings with a time interval between them, it is not necessary to analyze the entire video V1, so the processing load of the video distribution device 100 can be reduced. Therefore, it is possible to reduce the processing load of the video distribution device 100 and suppress the decrease in analysis accuracy.
[0102] In the video distribution device 100, when notification information is detected by the notification information detection unit 12, the video analysis unit 11 does not analyze the video V1 for a preset period of time. Since the notification image NP1 continues to be displayed for a certain period of time on the broadcast user terminal 200, it is highly likely that the notification information continues to be detected even immediately after the notification information is detected. Therefore, by stopping the analysis of the video V1 immediately after the notification information is detected, the processing load of the video distribution device 100 can be reduced.
[0103] In the video distribution device 100, the notification information includes image shape information about the image shape of the notification image NP1, and the notification information detection unit 12 detects the notification information based on the image shape information. That is, this device detects the notification information when an image shape characteristic of the notification image NP1 is detected in the video V1. This allows the operation and effect of the video distribution device 100 to be optimally achieved.
[0104] In the video distribution device 100, the image shape information is information about the shapes of three preset locations in the notification image NP1. This makes it possible to detect the notification information with high accuracy when detecting the notification information based on the image shape information, and also reduces the processing load of the video distribution device 100.
[0105] In the video distribution device 100, the notification information includes image color information related to the image color of the notification image NP1, and the notification information detection unit 12 detects the notification information based on the image color information. That is, an image color may be determined for each application that displays the notification image NP1 on the display 3, and this device detects the notification information when the image color is detected in the notification image NP1 in the video V1. This allows the action and effect of the video distribution device 100 to be optimally achieved.
[0106] In the video distribution device 100, the notification information includes icon information about the icon F4 included in the notification image NP1, and the notification information detection unit 12 detects the notification information based on the icon information. That is, an icon F4 may be determined for each application that causes the notification image NP1 to be displayed on the display 3, and this device detects the notification information when the icon F4 is detected in the notification image NP1 in the video V1. This allows the operation and effect of the video distribution device 100 to be optimally achieved.
[0107] The video distribution device 100 includes a processing target receiving unit 15 that receives information on a processing target, which is the content of the notification image NP1 for which the notification information processing unit 13 should process the notification information, from the broadcast user terminal 200, and a processing target setting unit 16 that sets the processing target based on the information on the processing target received from the broadcast user terminal 200 by the processing target receiving unit 15. This makes it possible to specify the content of the notification image NP1 that is not to be made public to the viewer and the content of the notification image NP1 that is to be made public, according to the broadcaster's wishes.
[0108] In the video distribution device 100, the broadcast user terminal 200 can select from a plurality of directions as the display direction of the video V1 on the display 3 of the broadcast user terminal 200, and is provided with a display direction detection unit 17 that detects the display direction of the video V1 selected on the display 3 of the broadcast user terminal 200, and the notification information detection unit 12 detects the notification information using a detection pattern according to the display direction detected by the display direction detection unit 17. In general, the position, size, shape, and other aspects of the notification image NP1 displayed on the video V1 may differ depending on the display direction of the video V1 selected on the display 3. Therefore, it is efficient to detect the notification information using a detection pattern optimized according to the display direction of the video V1. This allows the notification information to be detected efficiently.
[0109] The video distribution device 100 includes a video information distribution unit 14 that distributes the video V1 to an external device such as a viewing user terminal 300. This allows the video V1 with the reduced readability of the notification image NP1 to be distributed to the viewing user terminal 300, thereby making it possible to optimally utilize the functions and effects of the video distribution device 100.
[0110] [Variations] The above-described embodiment can be implemented in various forms that are modified or improved based on the knowledge of those skilled in the art.
[0111] For example, in the above embodiment, the video delivery device 100 is configured as a single server, but the video delivery device 100 may be configured with functions distributed across multiple servers. Alternatively, the video delivery device 100 may be configured to include separate devices in addition to one or multiple servers. In other words, the video delivery device 100 may be configured to include a server that can communicate with each of the broadcast user terminal 200 and the viewer user terminal 300. In the video delivery device 100, some of the functions may be realized in the broadcast user terminal 200 or the viewer user terminal 300. Alternatively, in the video delivery device 100, all of the functions may be realized in the broadcast user terminal 200 or the viewer user terminal 300. Even in these cases, the video delivery device 100, as a video delivery system, provides the same actions and effects as the above-mentioned video delivery device 100.
[0112] Furthermore, the video distribution device 100 may have a function of recording the video V1 acquired by the video information acquisition unit 10. In other words, the video distribution device 100 may store the acquired video V1 in a non-volatile storage device. [Explanation of symbols]
[0113] 3. Display 10 Video information acquisition unit 11 Video Analysis Section 12 Notification information detection unit 13 Notification Information Processing Department 14 Video Information Distribution Department 15 Processing target receiving section 16 Processing target setting section 17 Display direction detection unit 100 Video distribution device 200 Distribution user terminal 300 Viewing user terminal CP1 Content Image F4 Icon NP1 notification image V1 Video
Claims
1. A broadcast user terminal; a video distribution device that distributes a video displayed on a display of the distribution user terminal by an application to a viewing user terminal in real time; the broadcast user terminal receives a notification image from a server of an application different from the application and different from the video broadcasting device; The video distribution device includes: a notification information detection unit that detects notification information regarding the notification image that is included in the video and that is received by the broadcast user terminal from the server; A video distribution system comprising: a notification information processing unit that processes the notification information so as to reduce the readability of the notification image in the video when the notification information is detected by the notification information detection unit.
2. the video distribution device includes a video information acquisition unit that receives and acquires video information related to the video displayed on the broadcast user terminal from the broadcast user terminal; 2. The video distribution system according to claim 1, wherein said notification information detection unit detects said notification information received by said broadcast user terminal from said server based on said video information acquired by said video information acquisition unit.
3. A step in which a video distribution device distributes a video displayed by an application on a display of a distribution user terminal to a viewing user terminal in real time; receiving a notification image from a server of an application different from the application, the server being different from the video distribution device, by the broadcast user terminal; a step of the video distribution device detecting notification information regarding the notification image included in the video and received by the broadcast user terminal from the server; When the notification information is detected, the video distribution device processes the notification information so as to reduce readability of the notification image in the video.
Citation Information
Patent Citations
System, method and program for distributing output screen of terminal device
JP2017021775A
Information processor and game image distribution method
JP2019097888A
System and method for blocking notification messages during screen sharing
US20190245819A1
Filtering Images of Live Stream Content
US20200077150A1
Image communication device and control method thereof
JP2015041822A