Video distribution system and video distribution method

The video distribution system addresses the issue of unintended information exposure by detecting and processing notification images to reduce their readability, ensuring privacy protection in real-time video distribution.

JP7730601B2Active Publication Date: 2025-08-28MIRATIV CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024217070
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-12-11
Publication Date
2025-08-28
Estimated Expiration
2040-08-27

AI Technical Summary

Technical Problem

Existing video distribution systems inadvertently expose sensitive information on distributor terminals to viewers, particularly through unexpected notification screens, violating the distributor's privacy.

Method used

A video distribution device and method that includes a notification information detection unit to identify notification images and a processing unit to reduce their readability, ensuring that such information is not publicly disclosed to viewers.

Benefits of technology

Prevents sensitive information from being unintentionally shared with viewers by reducing the readability of notification images in real-time video distribution, thereby protecting the distributor's privacy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007730601000001
    Figure 0007730601000001
  • Figure 0007730601000002
    Figure 0007730601000002
  • Figure 0007730601000003
    Figure 0007730601000003
Patent Text Reader

Abstract

To prevent information on a distributor from being made public against his or her will.SOLUTION: A video distribution device 100 distributes video displayed on a display 3 of a broadcasting user terminal 200 to a viewing user terminal 300 in real time. The video distribution device 100 includes: a notification information detection unit 12 that detects notification information related to a notification image included in the video; and a notification information processing unit 13 that processes the notification information so as to reduce the readability of the notification image in the video when the notification information is detected by the notification information detection unit 12.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a video distribution system and a video distribution method. [Background technology]

[0002] There is known a technology for distributing a video displayed on a display of a user terminal on the distributor side via a network and displaying the video on a display of a user terminal on the viewer side in real time. For example, Patent Document 1 discloses a device for distributing, via a network, information such as operation buttons superimposed on the video on the display of the user terminal on the distributor side. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2015-41822 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-described technology, the video displayed on the display of the user terminal of the distributor is distributed directly to the user terminal of the viewer. Therefore, even if the distributor does not intend for the content to be made public to others, if the content is included in the video, it will be made public to the viewer. In particular, notification screens, such as push notifications, may be displayed on the display of the user terminal of the distributor at times unexpected by the distributor. Therefore, such notification screens are likely to be viewed by viewers against the distributor's wishes, which could result in information about the distributor being made public to the viewer.

[0005] Therefore, the video distribution system and video distribution method according to the present disclosure aim to prevent information about distributors from being made public against their will. [Means for solving the problem]

[0006] A video distribution device (100) according to one embodiment of the present disclosure is a video distribution device (100) that distributes video (V1) displayed on a display (3) of a distribution user terminal (200) to a viewing user terminal (300) in real time, and includes a notification information detection unit (12) that detects notification information related to a notification image (NP1) included in the video (V1), and a notification information processing unit (13) that processes the notification information so as to reduce the readability of the notification image (NP1) in the video (V1) when the notification information detection unit (12) detects the notification information.

[0007] A video distribution program according to one embodiment of the present disclosure causes a computer of a video distribution device (100) that distributes video (V1) displayed on a display (3) of a distribution user terminal (200) to a viewing user terminal (300) in real time to function as a notification information detection unit (12) that detects notification information related to a notification image (NP1) included in the video (V1), and a notification information processing unit (13) that processes the notification information so as to reduce the readability of the notification image (NP1) in the video (V1) when the notification information detection unit (12) detects the notification information.

[0008] According to this video distribution device (100) or video distribution program, even if a notification image (NP1) is included in the video (V1) displayed on the display (3) of the broadcasting user terminal (200), the readability of the notification image (NP1) can be reduced when the video (V1) is distributed in real time to the viewing user terminal (300), making it difficult for viewers to learn the contents of the notification image (NP1). Therefore, this video distribution device (100) or video distribution program can prevent information about the broadcaster from being made public against their will.

[0009] A video distribution device (100) according to one embodiment of the present disclosure may be configured to include a server capable of communicating with each of the broadcast user terminal (200) and the viewer user terminal (300). This reduces the processing load on the broadcast user terminal (200) or the viewer user terminal (300) compared to when all of the various processes are performed by the broadcast user terminal (200) or the viewer user terminal (300).

[0010] A video distribution device (100) according to an embodiment of the present disclosure may include a video information acquisition unit (10) that acquires video information related to a video (V1), and a notification information detection unit (12) may detect the notification information based on the video information acquired by the video information acquisition unit (10). This allows the video distribution device (100) according to the present disclosure to optimally achieve its functions and effects.

[0011] A video distribution device (100) according to one embodiment of the present disclosure includes a video analysis unit (11) that analyzes a video (V1) based on video information acquired by a video information acquisition unit (10), and a notification information detection unit (12) may detect notification information based on the analysis results of the video (V1) analyzed by the video analysis unit (11). In this manner, the device detects notification information by analyzing the video (V1), rather than analysis being performed by a separate device or the like. Therefore, analysis of the video (V1) and detection of notification information can be performed without being affected by the performance of a separate device or the like.

[0012] In a video distribution device (100) according to an embodiment of the present disclosure, the video analysis unit (11) may analyze a portion of the video (V1), thereby reducing the processing load on the video distribution device (100) compared to analyzing the entire video (V1).

[0013] In a video distribution device (100) according to one embodiment of the present disclosure, the video analysis unit (11) may analyze the video (V1) at multiple timings spaced apart by a time interval. Because the notification image (NP1) continues to be displayed on the distribution user terminal (200) for a certain period of time, even if the video (V1) is analyzed at consecutive timings with no time interval between them, the analysis results are likely to be the same. Therefore, compared to analyzing the video (V1) at consecutive timings with no time interval between them, analyzing the video (V1) at multiple timings spaced apart by a time interval is less likely to result in a decrease in analysis accuracy. On the other hand, by analyzing the video (V1) at multiple timings spaced apart by a time interval between them, it is not necessary to analyze the entire video (V1), thereby reducing the processing load on the video distribution device (100). Therefore, it is possible to reduce the processing load on the video distribution device (100) while suppressing a decrease in analysis accuracy.

[0014] In a video distribution device (100) according to one embodiment of the present disclosure, the video analysis unit (11) does not need to analyze the video (V1) for a preset period of time when the notification information detection unit (12) detects notification information. Because the notification image (NP1) continues to be displayed on the distribution user terminal (200) for a certain period of time, it is highly likely that the notification information will continue to be detected even immediately after it is detected. Therefore, by stopping the analysis of the video (V1) immediately after the notification information is detected, the processing load of the video distribution device (100) can be reduced.

[0015] In a video distribution device (100) according to one aspect of the present disclosure, the notification information may include image shape information relating to the image shape of the notification image (NP1), and the notification information detection unit (12) may detect the notification information based on the image shape information. That is, this device detects the notification information when an image shape characteristic of the notification image (NP1) is detected in the video (V1). This allows the operation and effects of the video distribution device (100) according to the present disclosure to be optimally achieved.

[0016] In a video distribution device (100) according to an embodiment of the present disclosure, the image shape information may be information about the shapes of three preset locations in the notification image (NP1). This makes it possible to accurately detect notification information when detecting notification information based on the image shape information, and also reduces the processing load of the video distribution device (100).

[0017] In a video distribution device (100) according to one aspect of the present disclosure, the notification information may include image color information regarding the image color of the notification image (NP1), and the notification information detection unit (12) may detect the notification information based on the image color information. That is, an image color may be determined for each application that displays the notification image (NP1) on the display (3), and the device detects the notification information when the image color is detected in the notification image (NP1) in the video (V1). This allows the operation and effects of the video distribution device (100) according to the present disclosure to be optimally achieved.

[0018] In a video distribution device (100) according to one embodiment of the present disclosure, the notification information may include icon information about an icon (F4) included in a notification image (NP1), and the notification information detection unit (12) may detect the notification information based on the icon information. That is, an icon (F4) may be assigned to each application that displays the notification image (NP1) on the display (3), and the device detects the notification information when the icon (F4) is detected in the notification image (NP1) in the video (V1). This allows the operation and effects of the video distribution device (100) according to the present disclosure to be optimally achieved.

[0019] A video distribution device (100) according to one aspect of the present disclosure may include a processing target receiving unit (15) that receives, from a broadcast user terminal (200), information on a processing target, which is the content of a notification image (NP1) for which notification information should be processed by a notification information processing unit (13), and a processing target setting unit (16) that sets the processing target based on the information on the processing target received from the broadcast user terminal (200) by the processing target receiving unit (15). This makes it possible to specify, according to the broadcaster's wishes, the content of the notification image (NP1) that will not be made public to viewers and the content of the notification image (NP1) that will be made public.

[0020] In a video distribution device (100) according to one embodiment of the present disclosure, a broadcast user terminal (200) can select from multiple display directions for a video (V1) on a display (3) of the broadcast user terminal (200), and includes a display direction detection unit (17) that detects the display direction of the video (V1) selected on the display (3) of the broadcast user terminal (200). The notification information detection unit (12) may detect notification information using a detection pattern corresponding to the display direction detected by the display direction detection unit (17). Generally, the position, size, and shape of a notification image (NP1) displayed on the video (V1) may differ depending on the display direction of the video (V1) selected on the display (3). Therefore, it is efficient to detect notification information using a detection pattern optimized according to the display direction of the video (V1). This allows for efficient detection of notification information.

[0021] The video distribution device (100) according to an aspect of the present disclosure may include a video information distribution unit (14) that distributes the video (V2) to the viewer user terminal (300). This allows the video (V1) with the notification image (NP1) having reduced readability to be distributed to the viewer user terminal (300), thereby enabling the effects and advantages of the video distribution device (100) according to the present disclosure to be optimally achieved.

[0022] Note that the reference numerals in the parentheses above indicate the reference numerals of components in the embodiments described below as an example of the present disclosure, and do not limit the present disclosure to the aspects of the embodiments. [Effects of the Invention]

[0023] In this way, the video distribution system and video distribution method according to the present disclosure can prevent information about a distributor from being made public against his or her will. [Brief explanation of the drawings]

[0024] [Figure 1] FIG. 1 is a block diagram showing a video distribution device according to this embodiment. [Figure 2] FIG. 2 is a diagram showing a state in which a video displaying only a content image is being distributed to a smartphone held vertically. [Figure 3] FIG. 3 is a diagram showing a state in which a video displaying a content image and a notification image is being distributed to a smartphone held vertically. [Figure 4] FIG. 4 is a diagram showing a state in which a video is being distributed to a smartphone held vertically, on which a content image and a notification image with reduced readability are displayed. [Figure 5] FIG. 5 is a diagram showing a state in which a video displaying only a content image is being distributed to a smartphone held horizontally. [Figure 6] FIG. 6 is a diagram showing a state in which a video displaying a content image and a notification image is being distributed to a smartphone held horizontally. [Figure 7] FIG. 7 is a diagram showing a state in which a video displaying a content image and a notification image with reduced readability is being distributed to a smartphone held horizontally. [Figure 8] FIG. 8 is a sequence diagram showing the flow of the processing target setting process. [Figure 9] FIG. 9 is a sequence diagram showing the flow of a process for delivering a video in which no notification image is displayed. [Figure 10] FIG. 10 is a sequence diagram showing the flow of a process for delivering a video on which a notification image is displayed. [Figure 11] FIG. 11 is a sequence diagram showing the flow of the detection pattern setting process. DETAILED DESCRIPTION OF THE INVENTION

[0025] Hereinafter, exemplary embodiments will be described with reference to the drawings. Note that the same or corresponding parts in each drawing are designated by the same reference numerals, and redundant explanations will be omitted.

[0026] [Video distribution device] FIG. 1 is a block diagram showing a video distribution device 100 according to this embodiment. FIG. 2 is a diagram showing a state in which a video displaying only a content image is being distributed to a smartphone held vertically. FIG. 3 is a diagram showing a state in which a video displaying a content image and a notification image is being distributed to a smartphone held vertically. FIG. 4 is a diagram showing a state in which a video displaying a content image and a notification image with reduced readability is being distributed to a smartphone held vertically. As shown in FIGS. 1 to 4, the video distribution device 100 is a device that distributes video V1 displayed on the display 3 of the broadcaster user terminal 200 as video V2 to the viewer user terminal 300 in real time after processing the video V1 to reduce the readability of the notification image NP1 included in the video V1. A user who distributes video V1 using the broadcaster user terminal 200 is called a broadcaster, and a user who views the distributed video V2 using the viewer user terminal 300 is called a viewer.

[0027] Here, a "broadcast user terminal" refers to a user terminal on the broadcaster's side. A broadcast user terminal may be any device that has at least a display 3 and is capable of communication (e.g., wireless communication) with other devices, and may be, for example, a smartphone, tablet, laptop computer, desktop computer, etc. Here, a smartphone is exemplified as the broadcast user terminal 200. Similarly, a "viewing user terminal" refers to a user terminal on the viewer's side. A viewing user terminal may be any device that has at least a display 7 and is capable of communication (e.g., wireless communication) with other devices, and may be, for example, a smartphone, tablet, laptop computer, desktop computer, etc. Here, a smartphone is exemplified as the viewing user terminal 300.

[0028] Furthermore, "video" refers to a moving image or still image displayed on the display 3 of the broadcasting user terminal 200 or the display 7 of the viewing user terminal 300. The video displayed on the display 3 of the broadcasting user terminal 200 is called video V1, and the video displayed on the display 7 of the viewing user terminal 300 is called video V2. Here, videos are exemplified as video V1 and video V2.

[0029] The video includes at least a content image. A "content image" is the display screen of an application running on the broadcaster terminal 200, and here a display screen of a baseball game application is shown as an example. The video may also include a notification image. A "notification image" is an image displayed on the display 3 of the broadcaster terminal 200 of a notification sent to the broadcaster terminal 200 from outside, and may be, for example, an image of a push notification received by the broadcaster terminal 200. The notification image may be displayed on the display 3 of the broadcaster terminal 200 at a timing not intended by the broadcaster. The notification image may be displayed in one or more pre-set positions on the display 3 of the broadcaster terminal 200.

[0030] In the following description, the content image included in video V1, which is the video displayed on the display 3 of the broadcasting user terminal 200, will be referred to as content image CP1, and the notification image included in video V1 will be referred to as notification image NP1. Similarly, the content image included in video V2, which is the video displayed on the display 7 of the viewing user terminal 300, will be referred to as content image CP2, and the notification image included in video V2 will be referred to as notification image NP2. Because video V2 is video V1 broadcast to the viewing user terminal 300, content image CP2 has basically the same content as content image CP1. Furthermore, notification image NP2 has basically the same content as notification image NP2, but as will be described later, notification image NP2 may be a version of notification image NP1 with reduced readability.

[0031] Video V1, content image CP1, and notification image NP1, as well as video V2, content image CP2, and notification image NP2, are each screen displays that are displayed on the display 3 of the broadcasting user terminal 200 or the display 7 of the viewing user terminal 300. The data (information) representing video V1, content image CP1, and notification image NP1, as well as video V2, content image CP2, and notification image NP2, are respectively referred to as video information regarding video V1, content information regarding content image CP1, and notification information regarding notification image NP1, and video information regarding video V2, content information regarding content image CP2, and notification information regarding notification image NP2, and are each composed of, for example, digital signals.

[0032] Video V1 as a moving image is dynamically expressed by successively switching between the individual images (frames) that make up video V1. The individual images (frames) that make up video V1 are a series of content images CP1 if video V1 does not include a notification image NP1, and are a series of content images CP1 and a series of notification images NP1 superimposed on each content image CP1 if video V1 includes a notification image NP1. Similarly, video V2 as a moving image is dynamically expressed by successively switching between the individual images (frames) that make up video V2. The individual images (frames) that make up video V2 are a series of content images CP2 if video V2 does not include a notification image NP2, and are a series of content images CP2 and a series of notification images NP2 superimposed on each content image CP2 if video V2 includes a notification image NP2.

[0033] The video information regarding video V1 includes at least image data regarding video V1 and may also include audio data accompanying video V1. The content information regarding content image CP1 includes at least image data regarding content image CP1 and may also include audio data accompanying content image CP1. The notification information regarding notification image NP1 includes at least image data regarding notification image NP1 and may also include audio data accompanying notification image NP1. Similarly, the video information regarding video V2 includes at least image data regarding video V2 and may also include audio data accompanying video V2. The content information regarding content image CP2 includes at least image data regarding content image CP2 and may also include audio data accompanying content image CP2. The notification information regarding notification image NP2 includes at least image data regarding notification image NP2 and may also include audio data accompanying notification image NP2.

[0034] "Image legibility" refers to the degree to which a user who sees an image can easily recognize the content of the image. In other words, "reducing the image legibility" means making it difficult for the user to recognize the content of the image even when the image is within the user's field of vision. Specific aspects of reducing the image legibility will be described later. Note that reducing the ease with which a user can view an image (i.e., a user can view an image and recognize its content) may also be referred to as "making an image invisible," and in this case, "making an image invisible" is synonymous with "reducing the image legibility."

[0035] Furthermore, "delivering video in real time" means sequentially delivering acquired video, and video is generally delivered with a small time lag. Here, "sequentially delivering video" may mean, for example, not delivering acquired video at the timing of a request from a viewing user after accumulating the video, but rather sequentially delivering individual images (frames) that make up the video as they are acquired after performing necessary processing. Furthermore, "sequential delivery" may also mean live delivery or live broadcasting. Note that the individual images (frames) to be delivered may be delivered in units grouped according to a preset criterion.

[0036] The video distribution device 100 is configured as a server (computer) capable of communicating with each of the distribution user terminal 200 and the viewing user terminal 300. The video distribution device 100 is physically configured with a control arithmetic unit, a storage device, and an input / output device. The control arithmetic unit is configured with a controller 1 such as a CPU (Central Processing Unit), and executes arithmetic processing and controls the storage device and the input / output device. The storage device has, for example, a main storage device and an auxiliary storage device. The main storage device is configured with, for example, RAM (Random Access Memory). The auxiliary storage device is configured with, for example, ROM (Read Only Memory). The input / output device has, for example, an input device that inputs data from outside and transmits it to the storage device, and an output device that outputs, to the outside, the results of calculations performed by the control arithmetic unit and stored in the storage device.

[0037] For example, the video distribution device 100 executes predetermined processing by loading a program stored in a ROM into a RAM and executing the program loaded into the RAM by a CPU. Note that the video distribution device 100 may be configured as a computer and may have a configuration different from the above-described configuration.

[0038] The controller 1 of the video distribution device 100 functionally includes a video information acquisition unit 10, a video analysis unit 11, a notification information detection unit 12, a notification information processing unit 13, a video information distribution unit 14, a processing target receiving unit 15, a processing target setting unit 16, a display direction detection unit 17, and a detection pattern setting unit 18.

[0039] The video information acquisition unit 10 acquires video information relating to the video V1. Specifically, the video information acquisition unit 10 receives and acquires video information relating to the video V1 transmitted from the broadcast user terminal 200, as will be described later.

[0040] The video analysis unit 11 analyzes the video V1 based on the video information (video information related to the video V1) acquired by the video information acquisition unit 10. Specifically, the video analysis unit 11 analyzes the video V1 based on the video information related to the video V1 to determine whether or not the video information related to the video V1 includes notification information (notification information related to the notification image NP1). The video analysis unit 11 may analyze the video V1 based on, for example, brightness information (such as brightness gradient information) included in the video information related to the video V1 (edge ​​detection). When the video analysis unit 11 outputs an analysis result indicating that the video information related to the video V1 includes notification information related to the notification image NP1, this means that the video V1 includes the notification image NP1 (and the content image CP1). On the other hand, when the video analysis unit 11 outputs an analysis result indicating that the video information related to the video V1 does not include notification information related to the notification image NP1, this means that the video V1 does not include the notification image NP1 (i.e., the video V1 includes only the content image CP1).

[0041] The video analysis unit 11 analyzes a portion of the video V1. Specifically, the video analysis unit 11 analyzes the video V1 at multiple timings spaced apart by time intervals. More specifically, the video analysis unit 11 analyzes the video V1 only for the remaining frames (for example, one frame out of two or three frames) of the content images CP1 (and a series of notification images NP1 if displayed superimposed on each content image CP1), which are a series of frames that make up the video V1 as a moving image, after some of the frames have been thinned out. The video analysis unit 11 may thin out some of the frames at regular or irregular intervals in time series.

[0042] Furthermore, when notification information (notification information related to notification image NP1) is detected by notification information detection unit 12 (described later), video analysis unit 11 does not analyze video V1 for a preset period of time (e.g., 6 seconds). In other words, video analysis unit 11 does not analyze video V1 for a preset number of frames (e.g., 180 frames) after detection of notification information related to notification image NP1. Here, "not analyzing video V1" means "stopping analysis of video V1." When a preset period of time (in other words, a preset number of frames) has elapsed since video analysis unit 11 stopped analyzing video V1, video analysis unit 11 resumes analysis of video V1.

[0043] The notification information detection unit 12 detects notification information related to the notification image NP1 included in the video V1. The notification information detection unit 12 detects notification information related to the notification image NP1 based on the video information related to the video V1 acquired by the video information acquisition unit 10. Specifically, after the video analysis unit 11 analyzes the video V1 based on the video information related to the video V1 acquired by the video information acquisition unit 10, the notification information detection unit 12 detects notification information related to the notification image NP1 based on the analysis result of the analysis of the video V1 by the video analysis unit 11. That is, if the video analysis unit 11 outputs an analysis result indicating that the video information related to the video V1 includes notification information related to the notification image NP1, the notification information detection unit 12 will detect notification information related to the notification image NP1 included in the video V1. On the other hand, if the video analysis unit 11 outputs an analysis result indicating that the video information related to the video V1 does not include notification information related to the notification image NP1, the notification information detection unit 12 will not detect notification information related to the notification image NP1 included in the video V1.

[0044] When notification information related to notification image NP1 is detected by notification information detection unit 12, notification information processing unit 13 processes the notification information related to notification image NP1 so as to reduce the readability of notification image NP1 in video V1. In other words, notification information processing unit 13 processes the notification information related to notification image NP1 so that even if notification image NP1 is included in the field of view of a user (e.g., a viewing user) in video V1, the user finds it difficult to recognize the content of notification image NP1.

[0045] As a specific example of reducing the readability of an image, the notification information processing unit 13 performs a process of blurring the area of ​​the notification image NP1 in the video V1. "Blurring the image" may mean, for example, reducing the resolution of the image or performing a mosaic process. As a specific example of reducing the readability of an image, the notification information processing unit 13 may perform a process of blurring an area of ​​the video V1 that is larger than the area of ​​the notification image NP1, or may perform a process of blurring the entire video V1. Alternatively, the notification information processing unit 13 may perform a process of filling in the area of ​​the notification image NP1 in the video V1, or may perform a process of filling in an area of ​​the video V1 that is larger than the area of ​​the notification image NP1, or may perform a process of filling in the entire video V1.

[0046] The video information distribution unit 14 transmits video information about the video V2 to the viewing user terminal 300. Specifically, the video information distribution unit 14 distributes the video V2 to the viewing user terminal 300 by transmitting the video information about the video V2 to the viewing user terminal 300. For a video V1 in which the notification information detection unit 12 has detected notification information about the notification image NP1, the video information distribution unit 14 sequentially transmits the video V2, in which the notification information processing unit 13 has completed processing of the notification information about the notification image NP1, to the viewing user terminal 300. On the other hand, for a video V1 in which the notification information detection unit 12 has not detected notification information about the notification image NP1, the video information distribution unit 14 sequentially transmits the video V1 as is as video V2 to the viewing user terminal 300.

[0047] The processing target receiving unit 15 receives information regarding the processing target from the broadcaster user terminal 200. The "processing target" is the content of the notification image NP1 for which the notification information processing unit 13 is to process the notification information. The processing target may be specified, for example, by the type of application that displays the notification related to the notification image NP1 on the broadcaster user terminal 200. In other words, only notifications transmitted (received by the broadcaster user terminal 200) related to a specific application may be set as processing targets. The processing target is determined by the user (e.g., the broadcaster) in the broadcaster terminal 200, as will be described later, and is transmitted from the broadcaster terminal 200 to the video distribution device 100.

[0048] The processing target setting unit 16 sets the processing target based on information about the processing target received from the broadcast user terminal 200 by the processing target receiving unit 15. This causes the video distribution device 100 to execute the following process. When the processing target setting unit 16 sets the processing target, the video analysis unit 11 analyzes whether or not the video information about the video V1 contains notification information about the notification image NP1 set as the processing target. If the video analysis unit 11 outputs an analysis result indicating that the video information about the video V1 contains notification information about the notification image NP1 set as the processing target, the notification information detection unit 12 detects the notification information about the notification image NP1 included in the video V1. Then, if the notification information detection unit 12 detects notification information about the notification image NP1 set as the processing target, the notification information processing unit 13 processes the notification information about the notification image NP1 so as to reduce the readability of the notification image NP1 in the video V1.

[0049] The processing target may be determined based on whether or not predetermined words, designs, etc. are included in the notification image NP1. For example, the processing target setting unit 16 may set the notification image NP1 containing privacy-related words, designs, etc. (privacy information), such as the name, address, and attributes of the distributor, as the processing target. Alternatively, the processing target setting unit 16 may set the notification image NP1 containing words, designs, etc., such as "password" or "PW" as the processing target. Words, designs, etc., such as "password" or "PW" indicate that the notification image NP1 containing the words, designs, etc., contains confidential information, such as a password, and is referred to as confidential flag information here.

[0050] Among the notification images NP1, those set as those to be processed may be treated as those to be analyzed for the video V1 in the processing of the video distribution device 100. On the other hand, among the notification images NP1, those set as those not to be processed may not be treated as those to be analyzed for the video V1 in the processing of the video distribution device 100 (i.e., they may be treated as not being notification images NP1).

[0051] The display direction detection unit 17 detects the display direction of the video V1 selected on the display 3 of the broadcast user terminal 200. Here, the "display direction" refers to the display direction of the video V1 automatically selected in the broadcast user terminal 200 based on the tilt (angle) of the broadcast user terminal 200 itself.

[0052] Specifically, when the broadcaster user terminal 200 is held vertically (when the broadcaster user terminal 200 is held so that the longer side of the broadcaster user terminal 200 is aligned with the top-to-bottom direction), the display orientation is selected so that the longer side of the broadcaster user terminal 200 is aligned with the top-to-bottom direction of the display 3 (so-called portrait display) (see FIGS. 2 to 4). On the other hand, when the broadcaster user terminal 200 is held horizontally (when the shorter side of the broadcaster user terminal 200 is held so that the shorter side of the broadcaster user terminal 200 is aligned with the top-to-bottom direction), the display orientation is selected so that the shorter side of the broadcaster user terminal 200 is aligned with the top-to-bottom direction of the display 3 (so-called landscape display) (see FIGS. 5 to 7). In the video distribution device 100, video V2 may be displayed on the display 7 of the viewing user terminal 300 in the same orientation as the display orientation of video V1 selected on the broadcaster user terminal 200.

[0053] The detection pattern setting unit 18 sets a detection pattern for detecting notification information related to the notification image NP1 in the notification information detection unit 12. A "detection pattern" is a manner in which notification information related to the notification image NP1 contained in the video V1 is detected. The detection pattern is a pattern in which an area of ​​the video V1 that should be analyzed with particular priority by the video analysis unit 11 is designated. Specifically, the detection pattern setting unit 18 sets a detection pattern according to the display orientation of the display 3 of the broadcast user terminal 200 detected by the display orientation detection unit 17. In this case, the notification information detection unit 12 detects notification information related to the notification image NP1 using a detection pattern according to the display orientation detected by the display orientation detection unit 17.

[0054] When the display orientation is selected so that the longitudinal direction of the broadcaster user terminal 200 is the up-down direction of the display 3, the detection pattern setting unit 18 sets a detection pattern that preferentially detects the notification image NP1 in the first notification search area R1, which is the area on the upper end side in the longitudinal direction of the display 3 of the broadcaster user terminal 200 (see FIG. 2). On the other hand, when the display orientation is selected so that the lateral direction of the broadcaster user terminal 200 is the up-down direction of the display 3, the detection pattern setting unit 18 sets a detection pattern that preferentially detects the notification image NP1 in the second notification search area R2, which is the area on the upper end side in the lateral direction of the display 3 of the broadcaster user terminal 200 (see FIG. 5).

[0055] [Distribution user device] The broadcaster terminal 200 is configured as a smartphone as described above and is capable of communicating with the video distribution device 100. The broadcaster terminal 200 physically comprises a control and arithmetic unit, a storage device, and an input / output device. The control and arithmetic unit is configured with a controller 2 such as a CPU, which executes arithmetic processing and controls the storage device and input / output device. The storage device includes, for example, a main storage device and an auxiliary storage device. The main storage device is configured with, for example, RAM. The auxiliary storage device is configured with, for example, ROM. The input / output device includes, for example, an input device 5 that receives data from the outside and transmits it to the storage device, and an output device such as a display 3 that outputs the results of calculations performed by the control and arithmetic unit and stored in the storage device. The broadcaster terminal 200 also includes an angle sensor 4 that detects the tilt (angle) of the broadcaster terminal 200 itself. A known sensor such as a gyro sensor can be used as the angle sensor 4. The video distribution device 100 performs predetermined processing, for example, by loading a program stored in ROM into RAM and executing the program loaded into RAM using the CPU.

[0056] The controller 2 of the broadcast user terminal 200 functionally comprises a video display unit 20, a notification receiving unit 21, a video information transmitting unit 22, a processing target receiving unit 23, a display direction selecting unit 24, and a display direction transmitting unit 25.

[0057] The video display unit 20 displays video V1 on the display 3 of the broadcaster user terminal 200. The video V1 includes at least a content image CP1, and when the broadcaster user terminal 200 receives a notification such as a PUSH notification, it also includes a notification image NP1. The notification receiving unit 21 receives notifications such as PUSH notifications from outside (such as the server of the application that sends the notification). The video information sending unit 22 sequentially sends video information about video V1 to the video distribution device 100.

[0058] The processing target receiving unit 23 receives information (processing target information) related to the processing target selected by the distributor, for example, from the input device 5 operated by the distributor. Then, the processing target receiving unit 23 transmits the received processing target information to the video distribution device 100. The processing target received by the processing target receiving unit 23 is, for example, the type of application that displays the notification related to the notification image NP1 on the broadcast user terminal 200, or words or designs written in the notification image NP1.

[0059] The display direction selection unit 24 selects a suitable display direction on the display 3 of the broadcaster terminal 200 according to the tilt (angle) of the broadcaster terminal 200 detected by the angle sensor 4. In other words, the broadcaster terminal 200 can select from a plurality of directions for displaying the video V1 on the display 3 of the broadcaster terminal 200, and the display direction selection unit 24 sets the display direction according to, for example, the top-to-bottom orientation of the display 3 of the broadcaster terminal 200. When the broadcaster terminal 200 is held vertically, the display direction selection unit 24 selects the display direction so that the longitudinal direction of the broadcaster terminal 200 is the up-to-down direction of the display 3. In this case, as shown in Figures 2 to 4, the notification image NP1 is displayed in the first notification search area R1, which is the area on the top edge of the longitudinal direction of the display 3 of the broadcaster terminal 200.

[0060] On the other hand, FIG. 5 is a diagram showing a state in which video displaying only a content image is being distributed to a smartphone held horizontally. FIG. 6 is a diagram showing a state in which video displaying a content image and a notification image is being distributed to a smartphone held horizontally. FIG. 7 is a diagram showing a state in which video displaying a content image and a notification image with reduced readability is being distributed to a smartphone held horizontally. As shown in FIGS. 5 to 7, when the broadcaster user terminal 200 is held horizontally, the display direction selection unit 24 selects the display direction so that the widthwise direction of the broadcaster user terminal 200 is the up-down direction of the display 3. In this case, the notification image NP1 is displayed in the second notification search area R2, which is the area at the top end in the widthwise direction of the display 3 of the broadcaster user terminal 200.

[0061] 1 to 4, the display direction transmission unit 25 transmits information about the display direction selected by the display direction selection unit 24 to the video distribution device 100. For example, the display direction transmission unit 25 transmits information about the display direction selected by the display direction selection unit 24 upon receiving a display direction request from the video distribution device 100 requesting notification of the display direction. Note that the display direction transmission unit 25 may transmit information about the display direction selected by the display direction selection unit 24 at a preset timing, even if it does not receive a display direction request from the video distribution device 100.

[0062] [Viewer device] The viewing user terminal 300 is configured as a smartphone as described above and is capable of communicating with the video distribution device 100. The viewing user terminal 300 physically comprises a control arithmetic unit, a storage device, and an input / output device. The control arithmetic unit is configured by a controller 6 such as a CPU, which executes arithmetic processing and controls the storage device and the input / output device. The storage device includes, for example, a main storage device and an auxiliary storage device. The main storage device is configured by, for example, RAM. The auxiliary storage device is configured by, for example, ROM. The input / output device includes, for example, an input device that receives data from the outside and transmits it to the storage device, and an output device such as a display 7 that outputs to the outside the results of calculations performed by the control arithmetic unit and stored in the storage device. The viewing user terminal 300 executes predetermined processing, for example, by loading a program stored in the ROM into the RAM and executing the program loaded into the RAM using the CPU.

[0063] The controller 6 of the viewer user terminal 300 functionally comprises a video information receiving section 60 and a distributed video display section 61.

[0064] The video information receiving unit 60 receives the video information about the video V2 transmitted by the video information distribution unit 14 of the video distribution device 100. Specifically, the video information receiving unit 60 sequentially receives the video information about the video V2 sequentially transmitted from the video information distribution unit 14 of the video distribution device 100.

[0065] Distributed video display unit 61 displays video information about video V2 received by video information receiving unit 60 on display 7. When notification information detection unit 12 of video distribution device 100 detects notification information about notification image NP1, video V2 displayed on display 7 by distributed video display unit 61 is a video including a content image CP2 that is identical to content image CP1, and a notification image NP2 in which the notification information about notification image NP1 has been processed to reduce the readability of notification image NP1. On the other hand, when notification information detection unit 12 of video distribution device 100 does not detect notification information about notification image NP1, video V2 displayed on display 7 by distributed video display unit 61 is a video including only content image CP2 that is identical to content image CP1.

[0066] [Detection method] The following describes a method for detecting notification information related to notification image NP1 by notification information detection unit 12. As shown in Figures 2 to 7, notification information detection unit 12 detects notification information related to notification image NP1 using a detection method that corresponds to the aspect of notification image NP1.

[0067] If the notification information regarding notification image NP1 includes image shape information regarding the image shape of notification image NP1, notification information detection unit 12 may detect the notification information regarding notification image NP1 based on the image shape information. Image shape information is the shape of a specific portion characterized in notification image NP1. Here, notification image NP1 is displayed as a rectangular window with curved (i.e., chamfered) corners in first notification search area R1 on display 3 of broadcast user terminal 200 held vertically. At this time, notification information detection unit 12 detects the notification information regarding notification image NP1 based on image shape information regarding the shape of the window of notification image NP1.

[0068] Specifically, the image shape information may be information about the shapes of three preset locations (first shape detection location F1, second shape detection location F2, and third shape detection location F3) in the notification image NP1. More specifically, the notification information detection unit 12 detects, as notification information related to the notification image NP1, an image whose shape and relative position match the shapes (corners formed by curved lines) of three of the four corners of the window of the notification image NP1. Here, the first shape detection location F1, the second shape detection location F2, and the third shape detection location F3 are three of the four corners of the window of the notification image NP1, respectively, but the first shape detection location F1, the second shape detection location F2, and the third shape detection location F3 may be other locations (for example, locations inside the window). The video analysis unit 11 may analyze whether or not an image whose shape and relative position match the shapes (curved corners) of three of the four corners of the window of notification image NP1 exists within the screen display of display 3, and notification information detection unit 12 may detect notification information related to notification image NP1 based on the analysis results. At this time, the video analysis unit 11 may prioritize analysis of the first notification search area R1 on display 3 of broadcaster user terminal 200.

[0069] If the notification information regarding the notification image NP1 includes image color information regarding the image color of the notification image NP1, the notification information detection unit 12 may detect the notification information regarding the notification image NP1 based on the image color information. The image color information is the color of a specific portion that characterizes the notification image NP1. Here, the notification image NP1 is displayed in the first notification search area R1 of the display 3 of the broadcast user terminal 200 held vertically as a window configured to include the representative color of the application that provides the notification related to the notification image NP1 (a color that characterizes the application and is frequently used on the screen of the application, etc.). In this case, the notification information detection unit 12 detects the notification information regarding the notification image NP1 based on image color information regarding the color of the window of the notification image NP1.

[0070] Specifically, notification information detection unit 12 detects an image in which the window color of notification image NP1 matches the representative color of a pre-stored application as notification information related to notification image NP1. Note that video analysis unit 11 may analyze whether or not an image in which the window color of notification image NP1 matches the representative color of a pre-stored application is present on the screen display of display 3, and notification information detection unit 12 may detect notification information related to notification image NP1 based on the analysis results. At this time, video analysis unit 11 may preferentially analyze first notification search area R1 on display 3 of broadcaster user terminal 200.

[0071] If the notification information related to notification image NP1 includes icon information related to icon F4 included in notification image NP1, notification information detection unit 12 may detect the notification information related to notification image NP1 based on the icon information. Icon information is information such as the shape or color of an icon characterized in notification image NP1. Here, notification image NP1 is displayed in first notification search area R1 of display 3 of broadcast user terminal 200 held vertically as a window configured to include icon F4 (the icon of the application) of an application that provides a notification related to notification image NP1. At this time, notification information detection unit 12 detects the notification information related to notification image NP1 based on image color information related to icon F4 of notification image NP1.

[0072] Specifically, the notification information detection unit 12 detects an image in which icon F4 included in notification image NP1 matches the icon of a pre-stored application as notification information related to notification image NP1. Note that the video analysis unit 11 may analyze whether or not an image in which icon F4 included in notification image NP1 matches the icon of a pre-stored application is present on the screen display of display 3, and the notification information detection unit 12 may detect notification information related to notification image NP1 based on the analysis results. At this time, the video analysis unit 11 may preferentially analyze the first notification search area R1 on display 3 of the broadcaster user terminal 200.

[0073] The video distribution device 100 may execute a detection method according to the OS (Operating System) of the broadcast user terminal 200. Alternatively, the video distribution device 100 may process only the video V1 received from a broadcast user terminal 200 equipped with a specific OS.

[0074] [Processing target setting process] The processing target setting process executed in the video distribution device 100 will now be described. FIG. 8 is a sequence diagram showing the flow of the processing target setting process. In step S10 of FIG. 8, the broadcaster user terminal 200 receives, via the processing target receiving unit 23, information (processing target information) related to the processing target selected by the broadcaster, for example, from the input device 5 operated by the broadcaster. The processing target received by the processing target receiving unit 23 is, for example, the type of application that displays a notification related to the notification image NP1 on the broadcaster user terminal 200, or words or designs written in the notification image NP1. Thereafter, the processing target setting process proceeds to step S12.

[0075] In step S12, the distribution user terminal 200 transmits the accepted processing target information to the video distribution device 100 via the processing target accepting unit 23. After that, the processing target setting process proceeds to step S14.

[0076] In step S14, the video distribution device 100 receives information about the processing target from the broadcast user terminal 200 via the processing target receiving unit 15. Then, the video distribution device 100 sets the processing target via the processing target setting unit 16 based on the information about the processing target received from the broadcast user terminal 200 via the processing target receiving unit 15. This completes the processing target setting process by the video distribution device 100.

[0077] [Distribution process (distribution process without notification image)] Among the distribution processes executed by the video distribution device 100, the following describes a distribution process (distribution process without notification image) when the video V1 does not include a notification image NP1. FIG. 9 is a sequence diagram showing the flow of distribution processing for video in which a notification image is not displayed. In step S20 of FIG. 9, the broadcaster user terminal 200 causes the video display unit 20 to display the video V1 on the display 3. Here, the video V1 includes only the content image CP1, and does not include the notification image NP1. In the following step S22, the broadcaster user terminal 200 sequentially transmits video information related to the video V1 to the video distribution device 100 via the video information transmission unit 22. Thereafter, the distribution process without notification image proceeds to step S24.

[0078] In step S24, video distribution device 100 acquires video information about video V1 transmitted from video distribution device 100 using video information acquisition unit 10. Then, video distribution device 100 analyzes video V1 using video analysis unit 11 based on the video information about video V1 acquired by video information acquisition unit 10. Specifically, video analysis unit 11 analyzes video V1 based on the video information about video V1 to determine whether the video information about video V1 includes notification information about notification image NP1. In the following step S26, video distribution device 100 detects, using notification information detection unit 12, that notification information about notification image NP1 included in video V1. Then, the distribution process without a notification image proceeds to step S28.

[0079] In step S28, the video distribution device 100 transmits video information about the video V2 to the viewer user terminal 300 via the video information distribution unit 14. Specifically, the notification information processing unit 13 does not process the notification information about the notification image NP1, and the video V1 is transmitted as is as video V2 to the viewer user terminal 300. Thereafter, the distribution process without notification image proceeds to step S30.

[0080] In step S30, the viewing user terminal 300 receives, via the video information receiving unit 60, video information about the video V2 transmitted by the video information distribution unit 14 of the video distribution device 100. Specifically, the video information receiving unit 60 sequentially receives the video information about the video V2 sequentially transmitted from the video information distribution unit 14 of the video distribution device 100. Thereafter, the viewing user terminal 300 causes the distributed video display unit 61 to display, on the display 7, the video information about the video V2 received by the video information receiving unit 60. At this time, the video V2 displayed on the display 7 by the distributed video display unit 61 is a video including only the content image CP2 that is identical to the content image CP1. This completes the distribution process without a notification image by the video distribution device 100.

[0081] [Distribution process (distribution process with notification image)] Among the distribution processes executed by the video distribution device 100, the distribution process (distribution process with notification image) when the video V1 includes a notification image NP1 will be described. FIG. 10 is a sequence diagram showing the flow of the distribution process for a video in which a notification image is displayed. In step S40 of FIG. 10, the broadcast user terminal 200 causes the video display unit 20 to display the video V1 on the display 3. At the time of step S40, the video V1 includes only the content image CP1, and does not include the notification image NP1. Thereafter, the distribution process with notification image proceeds to step S42.

[0082] In step S42, the broadcaster user terminal 200 receives a notification such as a PUSH notification from outside via the notification receiving unit 21. In the following step S44, the broadcaster user terminal 200 causes the video display unit 20 to display video V1 on the display 3. At the time of step S42, video V1 includes both a content image CP1 and a notification image NP1. In the following step S46, the broadcaster user terminal 200 sequentially transmits video information related to video V1 to the video distribution device 100 via the video information transmitting unit 22. Thereafter, the distribution process with notification image proceeds to step S48.

[0083] In step S48, video distribution device 100 acquires video information about video V1 transmitted from video distribution device 100 using video information acquisition unit 10. Then, video distribution device 100 analyzes video V1 using video analysis unit 11 based on the video information about video V1 acquired by video information acquisition unit 10. Specifically, video analysis unit 11 analyzes video V1 based on the video information about video V1 to determine whether the video information about video V1 includes notification information about notification image NP1. In the following step S50, video distribution device 100 detects notification information about notification image NP1 included in video V1 using notification information detection unit 12. Then, the distribution process with notification image proceeds to step S52.

[0084] In step S52, video distribution device 100 stops analysis of video V1 for a preset period (i.e., for a preset number of frames) using video analysis unit 11. Thereafter, the distribution process with notification image proceeds to step S54.

[0085] In step S54, the broadcast user terminal 200 processes the notification information related to the notification image NP1 by the notification information processing unit 13 so as to reduce the readability of the notification image NP1 in the video V1. As a specific example of reducing the readability of the image, the notification information processing unit 13 performs a process of blurring the area of ​​the notification image NP1 in the video V1. Thereafter, the broadcast process with notification image proceeds to step S56.

[0086] In step S56, the video distribution device 100 transmits, via the video information distribution unit 14, video V2 that has been processed to reduce the readability of the notification image NP1 in the video V1 to the viewer user terminal 300. Thereafter, the distribution process with notification image proceeds to step S58.

[0087] In step S58, the viewing user terminal 300 receives, via the video information receiving unit 60, video information about the video V2 transmitted by the video information distribution unit 14 of the video distribution device 100. Specifically, the video information receiving unit 60 sequentially receives the video information about the video V2 sequentially transmitted from the video information distribution unit 14 of the video distribution device 100. Thereafter, the viewing user terminal 300 causes the distributed video display unit 61 to display, on the display 7, the video information about the video V2 received by the video information receiving unit 60. At this time, the video V2 displayed on the display 7 by the distributed video display unit 61 is a video including a content image CP2 identical to the content image CP1, and a notification image NP2 in which notification information about the notification image NP1 has been processed to reduce the readability of the notification image NP1. This completes the distribution process with notification image by the video distribution device 100.

[0088] [Detection pattern setting process] The detection pattern setting process executed in the video distribution device 100 will now be described. Figure 11 is a sequence diagram showing the flow of the detection pattern setting process. In step S60 of Figure 11, the broadcaster user terminal 200 uses the angle sensor 4 to detect and acquire the tilt (angle) of the broadcaster user terminal 200 itself. In the following step S62, the broadcaster user terminal 200 uses the display direction selection unit 24 to select a suitable display direction on the display 3 of the broadcaster user terminal 200 in accordance with the tilt (angle) of the broadcaster user terminal 200 detected by the angle sensor 4. Thereafter, the detection pattern setting process proceeds to step S64.

[0089] In step S64, the video distribution device 100 transmits a display direction request to the broadcaster user terminal 200, requesting that the broadcaster user terminal 200 be notified of the current display direction. In the following step S66, the broadcaster user terminal 200 transmits information regarding the display direction selected by the display direction selection unit 24 to the video distribution device 100 via the display direction transmission unit 25. Thereafter, the detection pattern setting process proceeds to step S68.

[0090] In step S68, the video distribution device 100 receives information regarding the display direction selected by the display direction selection unit 24 from the broadcaster user terminal 200. As a result, the video distribution device 100 detects the display direction of the video V1 selected on the display 3 of the broadcaster user terminal 200 using the display direction detection unit 17. After that, the detection pattern setting process proceeds to step S70.

[0091] In step S70, the video distribution device 100 sets a detection pattern by the detection pattern setting unit 18 for detecting notification information related to the notification image NP1 in the notification information detection unit 12. The detection pattern is a pattern in which an area of ​​the video V1 that should be analyzed with particular priority by the video analysis unit 11 is designated. Specifically, the detection pattern setting unit 18 sets the detection pattern according to the display orientation of the display 3 of the broadcast user terminal 200 detected by the display orientation detection unit 17. This completes the detection pattern setting process by the video distribution device 100.

[0092] [Video Streaming Program] A video distribution program for causing a computer to function as the video distribution device 100 will be described. The video distribution program includes a main module, a notification information detection module, and a notification information processing module. The main module is a part that controls the computer overall. The functions realized by executing the notification information detection module and the notification information processing module are similar to the notification information detection unit 12 and the notification information processing unit 13 of the video distribution device 100 described above. As a result, the video distribution program causes the computer of the video distribution device 100, which distributes the video V1 displayed on the display 3 of the broadcasting user terminal 200 to the viewing user terminal 300 in real time, to function as the notification information detection unit 12 that detects notification information regarding the notification image NP1 included in the video V1, and the notification information processing unit 13 that processes the notification information regarding the notification image NP1 so as to reduce the readability of the notification image NP1 in the video V1 when the notification information detection unit 12 detects the notification information regarding the notification image NP1.

[0093] The video distribution program may include a video information acquisition module, a video analysis module, a video information transmission module, a processing target receiving module, a processing target setting module, a display direction detection module, and a detection pattern setting module. In this case, the functions realized by executing the video information acquisition module, the video analysis module, the video information transmission module, the processing target receiving module, the processing target setting module, the display direction detection module, and the detection pattern setting module are the same as the video information acquisition unit 10, the video analysis unit 11, the video information distribution unit 14, the processing target receiving unit 15, the processing target setting unit 16, the display direction detection unit 17, and the detection pattern setting unit 18 of the above-mentioned video distribution device 100, respectively.

[0094] [Action and effect] As described above, the video distribution device 100 is a video distribution device 100 that distributes the video V1 displayed on the display 3 of the distribution user terminal 200 to the viewing user terminal 300 in real time, and is equipped with a notification information detection unit 12 that detects notification information regarding the notification image NP1 included in the video V1, and a notification information processing unit 13 that, when notification information is detected by the notification information detection unit 12, processes the notification information so as to reduce the readability of the notification image NP1 in the video V1.

[0095] In addition, the video distribution program causes the computer of the video distribution device 100, which distributes the video V1 displayed on the display 3 of the distribution user terminal 200 to the viewing user terminal 300 in real time, to function as a notification information detection unit 12 that detects notification information regarding the notification image NP1 included in the video V1, and a notification information processing unit 13 that, when notification information is detected by the notification information detection unit 12, processes the notification information so as to reduce the readability of the notification image NP1 in the video V1.

[0096] Even if the video V1 displayed on the display 3 of the broadcaster user terminal 200 includes a notification image NP1, the video broadcasting device 100 or the video broadcasting program can reduce the readability of the notification image NP1 when the video V1 is broadcast in real time to the viewer user terminal 300, making it difficult for viewers to learn the contents of the notification image NP1. Therefore, the video broadcasting device 100 or the video broadcasting program can prevent information about the broadcaster from being made public against their will.

[0097] The video distribution device 100 is configured as a server capable of communicating with both the broadcaster user terminal 200 and the viewer user terminal 300. This reduces the processing load on the broadcaster user terminal 200 or the viewer user terminal 300 compared to when various processes are executed by the broadcaster user terminal 200 or the viewer user terminal 300.

[0098] The video distribution device 100 includes a video information acquisition unit 10 that acquires video information related to the video V1, and a notification information detection unit 12 that detects the notification information based on the video information acquired by the video information acquisition unit 10. This allows the video distribution device 100 to optimally exhibit its functions and effects.

[0099] The video distribution device 100 includes a video analysis unit 11 that analyzes the video V1 based on the video information acquired by the video information acquisition unit 10, and a notification information detection unit 12 that detects the notification information based on the analysis results of the video V1 by the video analysis unit 11. As a result, the device detects the notification information by analyzing the video V1, rather than the analysis being performed by a separate device, etc. Therefore, the analysis of the video V1 and the detection of the notification information can be performed without being affected by the performance of a separate device, etc.

[0100] In the video distribution device 100, the video analysis unit 11 analyzes a portion of the video V1. This reduces the processing load on the video distribution device 100 compared to when the entire video V1 is analyzed.

[0101] In the video distribution device 100, the video analysis unit 11 analyzes the video V1 at multiple timings spaced apart by a time interval. Because the notification image NP1 continues to be displayed on the broadcast user terminal 200 for a certain period of time, even if the video V1 is analyzed at successive timings with no time interval between them, the analysis results are likely to be the same. Therefore, compared to analyzing the video V1 at successive timings with no time interval between them, analyzing the video V1 at multiple timings spaced apart by a time interval between them is less likely to result in a decrease in analysis accuracy. On the other hand, by analyzing the video V1 at multiple timings spaced apart by a time interval between them, it is not necessary to analyze the entire video V1, thereby reducing the processing load on the video distribution device 100. Therefore, it is possible to reduce the processing load on the video distribution device 100 while suppressing a decrease in analysis accuracy.

[0102] In the video distribution device 100, when notification information is detected by the notification information detection unit 12, the video analysis unit 11 does not analyze the video V1 for a preset period of time. Because the notification image NP1 continues to be displayed on the broadcast user terminal 200 for a certain period of time, there is a high possibility that the notification information will continue to be detected even immediately after it is detected. Therefore, by stopping the analysis of the video V1 immediately after the notification information is detected, the processing load of the video distribution device 100 can be reduced.

[0103] In video distribution device 100, notification information includes image shape information about the image shape of notification image NP1, and notification information detection unit 12 detects the notification information based on the image shape information. That is, this device detects the notification information when a characteristic image shape of notification image NP1 is detected in video V1. This allows the functions and effects of video distribution device 100 to be optimally achieved.

[0104] In the video distribution device 100, the image shape information is information about the shapes of three preset locations on the notification image NP1. This makes it possible to accurately detect notification information when detecting notification information based on the image shape information, and also reduces the processing load on the video distribution device 100.

[0105] In video distribution device 100, notification information includes image color information about the image color of notification image NP1, and notification information detection unit 12 detects the notification information based on the image color information. That is, an image color may be determined for each application that displays notification image NP1 on display 3, and this device detects the notification information when that image color is detected in notification image NP1 in video V1. This allows the functions and effects of video distribution device 100 to be optimally achieved.

[0106] In video distribution device 100, notification information includes icon information about icon F4 included in notification image NP1, and notification information detection unit 12 detects the notification information based on the icon information. That is, icon F4 may be determined for each application that causes notification image NP1 to be displayed on display 3, and this device detects the notification information when icon F4 is detected in notification image NP1 in video V1. This allows the functions and effects of video distribution device 100 to be optimally achieved.

[0107] The video distribution device 100 is equipped with a processing target receiving unit 15 that receives, from the broadcast user terminal 200, information regarding the processing target, which is the content of the notification image NP1 for which the notification information processing unit 13 should process the notification information, and a processing target setting unit 16 that sets the processing target based on the information regarding the processing target received from the broadcast user terminal 200 by the processing target receiving unit 15. This makes it possible to specify, according to the broadcaster's wishes, the content of the notification image NP1 that will not be made public to viewers and the content of the notification image NP1 that will be made public.

[0108] In the video distribution device 100, the broadcaster user terminal 200 can select from multiple directions for the display direction of the video V1 on the display 3 of the broadcaster user terminal 200, and is equipped with a display direction detection unit 17 that detects the display direction of the video V1 selected on the display 3 of the broadcaster user terminal 200, and the notification information detection unit 12 detects notification information using a detection pattern corresponding to the display direction detected by the display direction detection unit 17. Generally, the position, size, shape, and other aspects of the notification image NP1 displayed on the video V1 may differ depending on the display direction of the video V1 selected on the display 3. Therefore, it is efficient to detect notification information using a detection pattern optimized according to the display direction of the video V1. This allows for efficient detection of notification information.

[0109] The video distribution device 100 includes a video information distribution unit 14 that distributes the video V1 to an external device such as a viewer user terminal 300. This allows the video V1, in which the readability of the notification image NP1 has been reduced, to be distributed to the viewer user terminal 300, thereby enabling the functions and effects of the video distribution device 100 to be optimally achieved.

[0110] [Variations] The above-described embodiment can be implemented in various forms with modifications or improvements made based on the knowledge of those skilled in the art.

[0111] For example, while the video delivery device 100 is configured as a single server in the above-described embodiment, the video delivery device 100 may be configured with its functions distributed across multiple servers. Alternatively, the video delivery device 100 may be configured to include separate devices in addition to one or more servers. In other words, the video delivery device 100 may be configured to include a server capable of communicating with each of the broadcaster user terminal 200 and the viewer user terminal 300. Some of the functions of the video delivery device 100 may be implemented in the broadcaster user terminal 200 or the viewer user terminal 300. Alternatively, all of the functions of the video delivery device 100 may be implemented in the broadcaster user terminal 200 or the viewer user terminal 300. Even in these cases, the video delivery device 100, as a video delivery system, will exhibit the same functions and effects as the above-described video delivery device 100.

[0112] Furthermore, the video distribution device 100 may have a function of recording the video V1 acquired by the video information acquisition unit 10. In other words, the video distribution device 100 may store the acquired video V1 in a non-volatile storage device. [Explanation of symbols]

[0113] 3. Display 10 Video information acquisition unit 11 Video Analysis Section 12 Notification information detection unit 13 Notification Information Processing Department 14 Video Information Distribution Department 15 Processing target receiving unit 16 Processing target setting section 17 Display direction detection unit 100 Video distribution device 200 Distribution user terminal 300 Viewing user terminal CP1 content image F4 icon NP1 notification image V1 video

Claims

1. A distribution user terminal; a video distribution device that distributes video displayed by an application on a display of the distribution user terminal to a viewing user terminal in real time; the broadcast user terminal, in response to receiving a notification image from a server of an application different from the application and different from the video broadcasting device, displays the notification image superimposed on the video; The video distribution device is a video information acquisition unit that acquires video information transmitted from the broadcast user terminal, the video information being information about the video being displayed on the broadcast user terminal; a notification information detection unit that detects, based on the video information, notification information regarding the notification image that the broadcast user terminal has received from the server and displayed superimposed on the video; A video distribution system comprising: a notification information processing unit that processes the notification information so as to reduce the readability of the notification image in the video distributed to the viewing user terminal when the notification information is detected by the notification information detection unit.

2. a step in which the video distribution device distributes the video displayed by the application on the display of the distribution user terminal to the viewing user terminal in real time; a step in which the broadcast user terminal displays a notification image superimposed on the video in response to receiving the notification image from a server of an application different from the application and different from the video broadcasting device; a step in which the video distribution device detects notification information regarding the notification image that the broadcast user terminal has received from the server and displayed superimposed on the video, based on video information that is information regarding the video displayed on the broadcast user terminal and transmitted from the broadcast user terminal; When the notification information is detected, the notification information is processed so as to reduce the readability of the notification image in the video delivered to the viewing user terminal.

Citation Information

Patent Citations

  • Image communication device and control method thereof

    JP2015041822A

  • System, method and program for distributing output screen of terminal device

    JP2017021775A

  • Information processor and game image distribution method

    JP2019097888A

  • System and method for blocking notification messages during screen sharing

    US20190245819A1

  • Filtering Images of Live Stream Content

    US20200077150A1