Video distribution system and control program for the video distribution system

Abstract

We provide a video distribution system that can prevent the distribution of videos unrelated to the view from the car window. [Solution] The video distribution system comprises a distribution-side mobile terminal that transmits a video of the outside of a vehicle taken from inside the vehicle, and a distribution server that distributes the video of the outside of the vehicle received from the distribution-side mobile terminal to a viewing-side terminal, wherein the vehicle includes a vehicle driving data transmission unit that transmits vehicle driving data of the vehicle to the distribution server, and the distribution server includes a behavior estimation unit that estimates the behavior of the vehicle based on the vehicle driving data received from the vehicle driving data transmission unit, a video determination unit that determines whether the behavior estimated by the behavior estimation unit is consistent with the video of the outside of the vehicle received from the distribution-side mobile terminal, and a distribution control unit that stops distributing the video of the outside of the vehicle when the video determination unit determines that the behavior and the video of the outside of the vehicle are inconsistent.

Description

Technical Field

[0001] The present disclosure relates to a video distribution system and a control program for the video distribution system.

Background Art

[0002] Patent Document 1 discloses a video distribution system that uses a vehicle as an environment for content distribution. In such a video distribution system, content acquisition means for acquiring content including at least one of the video or audio of a content distributor who is a passenger is provided in an information processing apparatus mounted on the vehicle, and transmission means for transmitting the content acquired by the content acquisition means to a network for distribution to terminals of one or more viewers.

[0003] According to the video distribution system disclosed in Patent Document 1, a vehicle can be provided as an environment for content distribution.

[0004] Patent Document 2 discloses a video distribution server that distributes in real time a distribution video, which is a moving image of the scenery seen by passengers on a train, to terminals of viewers. Such a video distribution server includes acquisition means for acquiring a captured video, which is a video of the scenery seen by passengers on the train captured by a camera mounted on the train, creation means for creating a distribution video based on the captured video, distribution means for distributing the distribution video to terminals of viewers, and sudden braking detection means for detecting a sudden braking of the train. The creation means includes braking means for performing processing on at least a part of the captured video when a sudden braking is detected by the sudden braking detection means.

[0005] According to the video distribution server disclosed in Patent Document 2, it is not necessary to distribute a video of a train accident or the chaos associated with an accident.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

[0007] In the video distribution system disclosed in Patent Document 1, the content distributor, who is a crew member, can freely distribute the video or audio they desire, but there is a risk of distributing content that should not be distributed.

[0008] According to the video distribution server disclosed in Patent Document 2, it is possible to avoid distributing inappropriate videos such as train accidents and the resulting chaos, but if the scope of those who film the scenery is expanded to include ordinary people, there is a risk that videos unrelated to the scenery (window view) will also be distributed.

[0009] In view of the above circumstances, at least one embodiment of the present invention aims to provide a video distribution system and a control program for the video distribution system that can prevent the distribution of videos unrelated to the in-car window view. [Means for solving the problem]

[0010] A video distribution system according to at least one embodiment of the present invention comprises a distribution-side mobile terminal that transmits a video of a vehicle window taken from inside the vehicle window to the outside of the vehicle, and a distribution server that distributes the video of the vehicle window received from the distribution-side mobile terminal to a viewing-side terminal, wherein the vehicle includes a vehicle driving data transmission unit that transmits vehicle driving data of the vehicle to the distribution server, and the distribution server includes a behavior estimation unit that estimates the behavior of the vehicle based on the vehicle driving data received from the vehicle driving data transmission unit, a video determination unit that determines whether the behavior estimated by the behavior estimation unit is consistent with the video of the vehicle window received from the distribution-side mobile terminal, and a distribution control unit that stops distributing the video of the vehicle window when the video determination unit determines that the behavior and the video of the vehicle window are not consistent.

[0011] With the above configuration, the distribution server will stop distributing window view footage that does not match the vehicle's behavior, thus preventing the distribution of videos unrelated to the window view footage.

[0012] A control program for a video distribution system according to at least one embodiment of the present invention comprises a distribution-side mobile terminal that transmits a video of the outside of a vehicle taken from inside the vehicle, and a distribution server that distributes the video of the outside of the vehicle received from the distribution-side mobile terminal to a viewing-side terminal, wherein the video distribution system comprises a vehicle driving data transmission unit in the vehicle that transmits vehicle driving data of the vehicle to the distribution server, and the control program for the video distribution system causes the distribution server to execute the steps of: estimating the behavior of the vehicle based on the vehicle driving data received from the vehicle driving data transmission unit; determining whether the behavior estimated in the behavior estimation step is consistent with the video of the outside of the vehicle received from the distribution-side mobile terminal; and stopping the distribution of the video of the outside of the vehicle if it is determined in the determination step that the behavior and the video of the vehicle are not consistent.

[0013] According to the program described above, the distribution server is instructed to stop distributing window view footage that does not match the vehicle's behavior, thereby preventing the distribution of videos unrelated to the window view. [Effects of the Invention]

[0014] According to at least one embodiment of the present invention, it is possible to prevent the distribution of videos unrelated to the in-car window view. [Brief explanation of the drawing]

[0015] [Figure 1] This is a block diagram showing the configuration of the video distribution system according to Embodiment 1. [Figure 2] This is a flowchart showing the operation of the video distribution system according to Embodiment 1. [Figure 3] This is a block diagram showing the configuration of the distribution server of the video distribution system according to Embodiment 3. [Figure 4] It is a flowchart showing the operations of the image processing unit, movement amount calculation unit, and video determination unit of the video distribution system according to Embodiment 3. [Figure 5] It is a flowchart showing the operation of the video determination unit according to Embodiment 4. [Figure 6] It is a block diagram showing the configuration of the distribution server of the video distribution system according to Embodiment 5. [Figure 7] It is a flowchart showing the operations of the stationary object identification unit, relative movement speed calculation unit, and video determination unit of the video distribution system according to Embodiment 5. [Figure 8] It is a flowchart showing the operations of the behavior estimation unit and video determination unit of the video distribution system according to Embodiment 6. [Figure 9] It is a flowchart showing the operations of the behavior estimation unit and video determination unit of the video distribution system according to Embodiment 7. [Embodiments for Carrying Out the Invention]

[0016] Hereinafter, some embodiments of the present invention will be described with reference to the accompanying drawings. However, the dimensions, materials, shapes, relative arrangements, etc. of the components described as embodiments or shown in the drawings are not intended to limit the scope of the present invention, but are merely illustrative examples. For example, expressions representing relative or absolute arrangements such as "in a certain direction", "along a certain direction", "parallel", "orthogonal", "center", "concentric", or "coaxial" not only strictly represent such arrangements, but also represent a state of being relatively displaced with tolerances or at an angle or distance such that the same function can be obtained. Also, for example, expressions representing shapes such as a rectangular shape or a cylindrical shape not only represent the shapes of a geometrically strict rectangular shape or cylindrical shape, etc., but also represent shapes including concave and convex portions, chamfered portions, etc. within a range where the same effect can be obtained. On the other hand, the expressions "comprising", "having", "including", or "possessing" one component are not exclusive expressions excluding the existence of other components.

[0017] [Embodiment 1] [Configuration of Video Distribution System] As shown in FIG. 1, the video distribution system 1 according to Embodiment 1 includes a distribution-side mobile terminal 12 that transmits a window video captured from the inside of the vehicle compartment to the outside of the vehicle, and a distribution server 16 that distributes the window video received from the distribution-side mobile terminal 12 to the viewing-side terminal 14. The distribution-side mobile terminal 12 is installed, for example, on the instrument panel provided in the front of the vehicle compartment of the vehicle 10.

[0018] [Configuration of Distribution-Side Mobile Terminal] The distribution-side mobile terminal 12 is composed of a smartphone 18, a tablet PC (Personal Computer), a PDA (Personal Digital Assistant), or a wireless camera, but is not limited thereto. For example, the smartphone 18 is a mobile phone capable of communication and calling, and becomes the distribution-side mobile terminal 12 that transmits the window video to the distribution server 16 by opening distribution application software (distribution app). The smartphone 18 includes a camera 20 for taking pictures and videos, a microphone for picking up sounds, a communication interface connected to the communication network 22, and a control device for controlling the camera, the microphone, and the communication interface. By the distribution app, the control device constitutes a video processing unit 24 and an information processing unit 26, and the communication interface constitutes a video transmission unit 28. In the information processing unit 26, distribution processing of the window video and audio for distribution processed by the video processing unit 24 is performed. The distribution processing includes, for example, processing for encoding (encoding) the window video and audio for distribution. Note that the tablet PC, the PDA, and the wireless camera also become the distribution-side mobile terminal 12 that transmits the window video to the distribution server by opening the distribution app in the same manner.

[0019] [Operation of Distribution-Side Mobile Terminal] When a passenger in vehicle 10 starts streaming video and audio from their mobile terminal 12, the video captured by camera 20 (video from the vehicle window) and the audio picked up by the microphone are sequentially processed in the video processing unit 24 to become video and audio for streaming. The video and audio for streaming are sequentially processed in the information processing unit 26, and the video and audio for streaming are sequentially encoded. The encoded video and audio for streaming are sequentially transmitted from the video transmission unit 28 to the streaming server 16.

[0020] [Viewer terminal configuration] The viewing terminal 14 consists of, but is not limited to, a smartphone 30, a tablet PC, a PDA, or a PC (Personal Computer). For example, a smartphone 30 becomes a viewing terminal 14 to which the in-car video is streamed when the viewing application software (viewing app) is opened. The smartphone 30 is equipped with a communication interface connected to a communication network 22, a display 31 that displays photos and videos, a speaker that outputs sound, a communication interface, a microphone, and a control device that controls the display. Depending on the viewing app, the communication interface constitutes a video receiving unit 32, and the control device constitutes an information processing unit 34 and a video processing unit 36. The information processing unit 34 processes the in-car video and audio for streaming that are received by the video receiving unit 32, and the video processing unit 36 ​​outputs them to the display 31. The reception processing includes, for example, the decoding of the in-car video and audio for streaming. A tablet PC, PDA, and PC also become a viewing terminal 14 to which the in-car video is streamed when the viewing app is opened.

[0021] [Operation of the viewing device] When a viewer starts viewing the in-car video and audio from their viewing terminal 14, the in-car video and audio (encoded in-car video and audio) transmitted from the distribution server 16 are sequentially received by the video receiving unit 32. The received in-car video and audio are sequentially processed by the information processing unit 34, and the distributed in-car video and audio are sequentially decoded. The decoded in-car video is sequentially output to the display 31 by the video processing unit 36, and the decoded audio is sequentially output from the speaker.

[0022] [Outline configuration of the distribution server] The distribution server 16 is a general-purpose computer connected to a communication network, and includes a communication interface connected to the communication network, memory for storing computer programs and control data, a storage device for storing computer programs and various data, and a processor that enables the distribution of in-vehicle video by executing computer programs.

[0023] [Overview of the distribution server's operation] When the distribution server 16 receives the video and audio (encoded video and audio) for distribution from the distribution-side mobile terminal 12, it distributes the received video and audio to the viewing-side terminal 14.

[0024] [Vehicle configuration] In the video distribution system 1 according to Embodiment 1, the vehicle 10 is equipped with a vehicle driving data transmission unit 38 that transmits vehicle driving data of the vehicle 10 to the distribution server 16. For example, the vehicle 10 is provided with a wheel speed sensor 40, an angular velocity sensor 42, an acceleration sensor 44, and a steering angle sensor 46, and the vehicle driving data to be transmitted from the vehicle driving data transmission unit 38 is generated in a data processing unit 48 to which these are connected, but it is not limited to this, and for example, the vehicle speed displayed on the meter may be used as vehicle driving data. For example, a wheel speed sensor 40 is provided for each wheel, and the data processing unit 48 calculates vehicle speed data based on the average value of the wheel speed (rotational speed) measured by each wheel speed sensor 40. The vehicle driving data transmission unit 38 is configured by a communication interface connected to a communication network 22, and the data processing unit 48 is configured by an in-vehicle control device (in-vehicle ECU (Electronic Control Unit)) connected to the communication interface.

[0025] [Vehicle operation] In the video distribution system 1 according to Embodiment 1, when the distribution-side mobile terminal 12 starts distributing in-car video and audio, the vehicle 10 transmits vehicle driving data from the vehicle driving data transmission unit 38 to the distribution server 16. On the other hand, when the distribution-side mobile terminal 12 stops or terminates the distribution of in-car video and audio, the vehicle 10 stops or terminates the transmission of vehicle driving data from the vehicle 10.

[0026] [Detailed configuration of the distribution server] In the video distribution system 1 according to Embodiment 1, the distribution server 16 includes a data / video receiving unit 50, a video distribution processing unit 52, and a video transmission unit 54, as well as a data time adjustment unit 56, a behavior estimation unit 58, a video determination unit 60, and a distribution control unit 62.

[0027] The data / video receiving unit 50 is configured to receive vehicle driving data transmitted from the vehicle driving data transmission unit 38 and the in-vehicle video and audio for distribution transmitted from the distribution-side mobile terminal 12. The in-vehicle video and audio for distribution received by the data / video receiving unit 50 are decoded by the data / video receiving unit 50 and temporarily stored (cache storage) together with the vehicle driving data received by the data / video receiving unit 50.

[0028] The video distribution processing unit 52 is configured to process the video and audio (encoded video and audio) of the car window for distribution that is transmitted from the distribution-side mobile terminal 12. The video transmission unit 54 is configured to transmit the video and audio of the car window for distribution, which has been processed by the video distribution processing unit 52, to the viewing-side terminal 14.

[0029] The data time adjustment unit 56 is configured to align the time axis of the vehicle driving data with the time axis of the temporarily stored in-vehicle video (video data) for distribution (data time adjustment process). As a result, the time axis of the vehicle driving data matches the time axis of the video data for distribution.

[0030] The behavior estimation unit 58 is configured to estimate the behavior of the vehicle 10 based on temporarily stored vehicle driving data.

[0031] The video determination unit 60 is configured to determine whether the behavior estimated by the behavior estimation unit 58 matches the temporarily stored car window video (car window video received from the distribution-side mobile terminal 12). However, even if the behavior and the car window video do not match, the video determination unit 60 may determine that they match if the average sampling result within a predetermined period exceeds a predetermined threshold (for example, 80 points or more out of 100).

[0032] The distribution control unit 62 is configured to stop distributing the window view video if the video determination unit 60 determines that the behavior and the window view video are inconsistent. For example, if the video determination unit 60 determines that the behavior and the window view video are inconsistent, the distribution control unit 62 instructs the video distribution processing unit 52 to stop the distribution of the window view video and audio for distribution.

[0033] Furthermore, the distribution control unit 62 is configured to immediately stop the distribution of the window view video if the video determination unit 60 determines that the behavior and the window view video are inconsistent. However, it may also be configured to notify the distribution-side mobile terminal 12 of the inconsistency, and then stop the distribution of the window view video if it still determines that the behavior and the window view video are inconsistent. Alternatively, it may be configured to stop the distribution of the window view video if the number of times the inconsistency has been determined exceeds a predetermined number. In addition, if the number of times the inconsistency has been determined exceeds a predetermined number, the distribution-side mobile terminal 12 may be added to a blacklist, preventing video distribution from that distribution-side mobile terminal 12 for a certain period of time.

[0034] In the video distribution system 1 according to Embodiment 1, the distribution server 16 may include an administrator notification unit 64. The administrator notification unit 64 is configured to notify the administrator of the distribution server 16 when the video determination unit 60 determines that the behavior and the video view from the vehicle window are inconsistent. For example, the administrator notification unit 64 notifies an administrator-side system 66, which is provided separately from the distribution server 16, that the behavior and the video view from the vehicle window are inconsistent. Note that the administrator notification unit 64 is an optional configuration and is not a required configuration.

[0035] [Distribution server control program] The control program for the distribution server 16 is a control program that causes the distribution server 16 to execute the following steps: a behavior estimation unit 58 estimates the behavior of the vehicle based on vehicle driving data received from the vehicle driving data transmission unit 38; a video determination unit 60 determines whether the behavior estimated by the behavior estimation unit 58 matches the in-car video received from the distribution-side mobile terminal 12; and if the video determination unit 60 determines that the behavior and the in-car video do not match, the distribution control unit 62 stops the distribution of the in-car video and audio for distribution.

[0036] [Distribution server operation] In the video distribution system 1 according to Embodiment 1, as shown in Figure 2, when the distribution of in-car video and audio is started from the distribution-side mobile terminal 12 (step S1), the distribution server 16 sequentially receives the in-car video and audio for distribution (encoded in-car video and audio for distribution) and vehicle driving data of the vehicle 10 in the data / video receiving unit 50 (steps S2, S3). Next, the distribution server 16 sequentially processes the in-car video and audio for distribution (encoded in-car video and audio for distribution) received in the data / video receiving unit 50 in the video distribution processing unit 52 (step S4). Next, the distribution server 16 sequentially transmits the in-car video and audio processed by the video distribution processing unit 52 to the viewing-side terminal 14 from the video transmission unit 54 (step S5).

[0037] Furthermore, when the distribution server 16 receives the in-vehicle video and audio for distribution (encoded in-vehicle video and audio for distribution) in the data / video receiving unit 50 (steps S2, S3), the data / video receiving unit 50 sequentially decodes the encoded in-vehicle video and audio for distribution and temporarily stores them together with the vehicle driving data of the vehicle received in the data / video receiving unit 50 (cache storage) (step S6). Next, the distribution server 16 adjusts the time axis of the temporarily stored vehicle driving data of the vehicle to match the time axis of the temporarily stored in-vehicle video (video data) in the data time adjustment unit 56 (step S7). As a result, the time axis of the vehicle driving data matches the time axis of the video data for distribution.

[0038] Next, the distribution server 16 estimates the behavior of the vehicle 10 based on the vehicle driving data temporarily stored in the behavior estimation unit 58 (step S8).

[0039] Next, the distribution server 16 determines in the video determination unit 60 whether the behavior estimated by the behavior estimation unit 58 matches the temporarily stored video footage from the car window (step S9).

[0040] Next, if the distribution server 16 determines in the video determination unit 60 that the behavior and the video from the car window do not match, the distribution control unit 62 instructs the video distribution processing unit 52 to stop distributing the video from the car window and audio for distribution (step S10) (distribution stop command).

[0041] [Effectiveness of video distribution systems] According to the video distribution system 1 of Embodiment 1, the distribution server 16 stops distributing window view footage that does not match the behavior of the vehicle 10, thereby stopping the distribution of videos unrelated to the window view footage.

[0042] [Embodiment 2] As shown in Figure 1, the video distribution system 1B according to Embodiment 2 is the same as the video distribution system 1 according to Embodiment 1, except for the behavior estimation unit 58B. The behavior estimation unit 58B will be described below.

[0043] [Behavior Estimation Unit] When the vehicle driving data received and temporarily stored in the data / video receiving unit 50 is the vehicle speed of vehicle 10, the behavior estimation unit 58B estimates whether or not the vehicle is in motion based on the vehicle speed of vehicle 10. For example, the behavior estimation unit 58B estimates that vehicle 10 is in motion if the vehicle speed of vehicle 10 exceeds a predetermined speed, and estimates that the vehicle is not in motion if the vehicle speed is less than or equal to the predetermined speed. For example, if the predetermined speed is 4 [km / h], the behavior estimation unit 58B estimates that the vehicle is in motion if the vehicle speed exceeds 4 [km / h], and estimates that vehicle 10 is not in motion if the vehicle speed is 4 [km / h] or less.

[0044] [Operation of the behavior estimation unit] The behavior estimation unit 58B estimates whether or not the vehicle 10 is in motion based on the temporarily stored vehicle speed of the vehicle 10. For example, the behavior estimation unit 58B estimates that the vehicle 10 is in motion if the temporarily stored vehicle speed of the vehicle 10 exceeds a predetermined vehicle speed, and estimates that the vehicle 10 is not in motion if the vehicle speed is less than or equal to the predetermined vehicle speed.

[0045] [Effects of the behavior estimation unit] According to the behavior estimation unit 58B, it is possible to estimate whether or not the vehicle 10 is in motion based on the vehicle speed of the vehicle 10.

[0046] [Embodiment 3] The video distribution system 1C according to Embodiment 3 is the same as the video distribution system 1B according to Embodiment 2, except that the distribution server 16 includes an image processing unit 68 and a movement amount calculation unit 70, and the video determination unit 60C is included, as shown in Figure 3. The image processing unit 68, movement amount calculation unit 70, and video determination unit 60C will be described below.

[0047] [Image processing unit and movement calculation unit] The image processing unit 68 is configured to extract feature points from the car window video (car window video received from the distribution-side mobile terminal 12) that is received by the data / video receiving unit 50 and temporarily stored. The image processing unit 68 may use pattern matching or machine learning to extract feature points from the car window video, as long as it does so. The displacement amount calculation unit 70 is configured to calculate the pixel displacement amount of the feature points extracted by the image processing unit 68.

[0048] [Video Judgment Unit] The video determination unit 60C determines that the behavior and the window image are inconsistent if the behavior estimation unit 58B estimates that the vehicle 10 is in motion, and the amount of pixel movement of the feature points calculated by the movement amount calculation unit 70 is less than a predetermined amount of pixel movement. The amount of pixel movement compared with the amount of pixel movement of the feature points (a predetermined amount of pixel movement) is the amount of pixel movement necessary to determine whether or not there is movement in the window image, and can be set arbitrarily. The determination that the behavior and the window image are inconsistent is not limited to the above, and may also be based on a determination such as "the difference between the amount of pixel movement corresponding to the movement of the vehicle's wheels and the actually calculated amount of pixel movement." Furthermore, the determination may be based not only on the amount of pixel movement of the feature points, but also on the amount of pixel movement of each point in the entire window image. The determination may also be based on the amount of pixel movement of points randomly extracted from the entire window image.

[0049] [Operation of the image processing unit, movement amount calculation unit, and video determination unit] As shown in Figure 4, first, the image processing unit 68 extracts feature points contained in the window image from the temporarily stored window image (step S31). Next, the movement amount calculation unit 70 calculates the pixel movement amount of the feature points extracted by the image processing unit 68 (step S32). Then, the behavior estimation unit 58B estimates that the vehicle 10 is moving, and if the pixel movement amount of the feature points calculated by the movement amount calculation unit 70 is greater than or equal to a predetermined pixel movement amount (threshold) (step S33: Yes), the video determination unit 60C determines that the behavior and the window image are consistent (step S34). If the pixel movement amount of the feature points is less than the threshold (step S33: No), the video determination unit 60C determines that the behavior and the window image are not consistent (step S35).

[0050] [Effects of the image processing unit, movement amount calculation unit, and video determination unit] If vehicle 10 is presumed to be in motion, but the amount of pixel movement of feature points is less than a predetermined amount of pixel movement, it is determined that the vehicle's behavior and the window view image are inconsistent. This makes it possible to exclude window view images with little pixel movement (window view images with little movement) from distribution, even though vehicle 10 is in motion.

[0051] [Embodiment 4] As shown in Figure 3, the video distribution system 1D according to Embodiment 4 is the same as the video distribution system 1C according to Embodiment 3, except for the video determination unit 60D. The video determination unit 60D will be described below.

[0052] [Video Judgment Unit] The video determination unit 60D determines that the behavior and the video in the car window are consistent if the direction of pixel movement of the feature points included in the video in the car window is the same as the direction of travel of the vehicle, the amount of pixel movement of the feature points is less than or equal to the maximum amount of pixel movement calculated from the vehicle speed of the vehicle 10, and greater than or equal to the minimum amount of pixel movement calculated from the vehicle speed of the vehicle 10. In other words, the video determination unit 60D determines that the behavior and the video in the car window are inconsistent if the direction of pixel movement of the feature points included in the video in the car window is different from the direction of travel of the vehicle 10, if the amount of pixel movement of the feature points exceeds the maximum amount of pixel movement, or if the amount of pixel movement of the feature points is less than the minimum amount of pixel movement.

[0053] [Operation of the video judgment unit] As shown in Figure 5, first, the video determination unit 60D determines whether the pixel movement direction of the feature points included in the car window image is the same as the direction of travel of the vehicle (step S41). If it is determined that the pixel movement direction of the feature points is the same as the direction of travel of the vehicle (step S41: Yes), the video determination unit 60D determines whether the amount of pixel movement of the feature points is less than or equal to the maximum pixel movement amount Smax and greater than or equal to the minimum pixel movement amount Smin (step S42). If the amount of pixel movement of the feature points is less than or equal to the maximum pixel movement amount Smax and greater than or equal to the minimum pixel movement amount Smin (step S42: Yes), the video determination unit 60D determines that the behavior and the car window image are consistent (step S43).

[0054] On the other hand, if the pixel movement direction of the feature point differs from the driving direction of the vehicle 10 (step S41: No), if the amount of pixel movement of the feature point exceeds the maximum pixel movement amount Smax, or if the amount of pixel movement of the feature point is less than the minimum pixel movement amount Smin (step S42: No), the video determination unit 60D determines that the behavior and the video from the car window are not in sync (step S44).

[0055] [Effects of the video judgment unit] If, despite the vehicle 10 being estimated to be in motion, the pixel movement direction of the feature points differs from the vehicle's direction of travel, the amount of pixel movement of the feature points exceeds the maximum amount of pixel movement, or the amount of pixel movement of the feature points falls short of the minimum amount of pixel movement, the video determination unit 60D determines that the behavior and the window image are inconsistent. This makes it possible to exclude from distribution window images where, despite the vehicle 10 being in motion, the pixel movement direction of the feature points differs from the vehicle's direction of travel, where the amount of pixel movement of the feature points exceeds the maximum amount of pixel movement (window images where the movement is excessive compared to the vehicle speed), and where the amount of pixel movement of the feature points falls short of the minimum amount of pixel movement (window images where the movement is insufficient compared to the vehicle speed).

[0056] [Embodiment 5] The video distribution system 1E according to Embodiment 5 is the same as the video distribution system 1B according to Embodiment 2, except that the distribution server 16 includes a stationary object identification unit 72 and a relative movement speed calculation unit 74, and the video determination unit 60E is included, as shown in Figure 6. The stationary object identification unit 72, relative movement speed calculation unit 74, and video determination unit 60E will be described below.

[0057] [Still object identification unit and relative movement velocity calculation unit] The stationary object identification unit 72 is configured to identify stationary objects contained in the window view video (window view video received from the distribution-side mobile terminal 12) that is received and temporarily stored in the data / video receiving unit 50. Stationary objects include, but are not limited to, curbs, traffic lights, street trees, or road markings (for example, dashed white lines indicating lanes other than no-passing zones). The stationary object identification unit 72 may use pattern matching or machine learning to identify stationary objects contained in the window view video.

[0058] The relative speed calculation unit 74 is configured to calculate the relative speed of a stationary object to the vehicle 10 based on the speed of movement of the stationary object in the vehicle window image. In a vehicle window image taken from inside the vehicle 10 looking forward, the amount of movement of a stationary object located outside the center of the vehicle window image is greater than the amount of movement of a stationary object located in the center of the vehicle window image. For example, the amount of movement of a street tree located outside the center of the vehicle window image is greater than the amount of movement of a building located in the center of the vehicle window image. Therefore, the relative speed calculation unit 74 may calculate the speed of movement of a stationary object in the vehicle window image based on the amount of movement of a stationary object located outside the center of the vehicle window image rather than the amount of movement of a stationary object located in the center of the vehicle window image, or it may calculate the speed of movement of a stationary object in the vehicle window image by weighting the amount of movement of a stationary object located in the center of the vehicle window image and the amount of movement of a stationary object located outside the center of the vehicle window image.

[0059] [Video Judgment Unit] The video determination unit 60E is configured to determine that the vehicle behavior and the in-vehicle window image are consistent if the temporarily stored vehicle driving data is the vehicle speed, and the vehicle speed of the vehicle 10 is less than or equal to the maximum allowable speed determined based on the relative movement speed of a stationary object relative to the vehicle 10, and greater than or equal to the minimum allowable speed determined based on the relative movement speed. In other words, the video determination unit 60E is configured to determine that the vehicle behavior and the in-vehicle window image are inconsistent if the vehicle speed of the vehicle 10 exceeds the maximum allowable speed or is less than the minimum allowable speed.

[0060] [Operation of the stationary object identification unit, relative movement speed calculation unit, and image judgment unit] As shown in Figure 7, first, the stationary object identification unit 72 identifies stationary objects included in the window image from the temporarily stored window image (step S51). Next, the relative speed calculation unit 74 calculates the relative speed of the stationary objects with respect to the vehicle (step S52). Then, the behavior estimation unit 58B estimates that the vehicle 10 is in motion (step S53: Yes), and if the vehicle speed Vr of the vehicle 10 is less than or equal to the maximum allowable speed Vmax determined based on the relative speed calculated by the relative speed calculation unit 74, and greater than or equal to the minimum allowable speed Vmin determined based on the relative speed (step S54: Yes), the video determination unit 60E determines that the behavior and the window image are consistent (step S55).

[0061] On the other hand, if the vehicle speed Vr of vehicle 10 exceeds the maximum allowable speed Vmax and falls below the minimum allowable speed Vmin (step S53: No), the video determination unit 50E determines that the behavior and the video from the vehicle window are not consistent (step S56).

[0062] [Effects of the stationary object identification unit, relative movement speed calculation unit, and image judgment unit] If the vehicle speed Vr of vehicle 10 is estimated to be in motion, but the vehicle speed Vr exceeds the maximum allowable speed Vmax, or falls below the minimum allowable speed Vmin, the video determination unit 60E determines that the behavior and the video from the vehicle window are inconsistent. This makes it possible to exclude from distribution video footage where the vehicle speed Vr of vehicle 10 exceeds the maximum allowable speed Vmax (video footage where the relative speed of stationary objects to the vehicle is greater than the vehicle speed), and where the relative speed of stationary objects to the vehicle is less than the minimum allowable speed Vmin (video footage where the relative speed of stationary objects to the vehicle is less than the vehicle speed), even though vehicle 10 is in motion.

[0063] [Embodiment 6] As shown in Figure 3, the video distribution system 1F according to Embodiment 6 is the same as the video distribution system 1 according to Embodiment 3, except that the vehicle driving data consists of the vehicle's steering angle, vehicle angular velocity, and vehicle speed, and the behavior estimation unit 58F and video determination unit 60F are included. The behavior estimation unit 58F and video determination unit 60F will be described below.

[0064] [Behavior Estimation Unit] The behavior estimation unit 58F is configured to estimate whether or not the vehicle 10 is entering a curve based on the steering angle of the vehicle 10, the angular velocity of the vehicle 10, and the vehicle speed of the vehicle 10. For example, the behavior estimation unit 58F estimates that the vehicle 10 is entering a curve when the steering angle of the vehicle 10 and the angular velocity of the vehicle 10 gradually increase, and the vehicle speed of the vehicle 10 gradually decreases.

[0065] [Video Judgment Unit] The video determination unit 60F is configured to determine that the vehicle behavior and the video footage are inconsistent if the behavior estimation unit 58F estimates that the vehicle 10 is entering a curve and the pixel movement speed of the feature points included in the video footage from the vehicle window does not decrease.

[0066] [Operation of the behavior estimation unit and the video judgment unit] As shown in Figure 8, the behavior estimation unit 58F estimates whether the vehicle 10 is entering a curve based on the temporarily stored steering angle, angular velocity, and vehicle speed of the vehicle 10 (step S61). For example, the behavior estimation unit 58F estimates that the vehicle 10 is entering a curve when the steering angle and angular velocity of the vehicle 10 gradually increase, and the vehicle speed of the vehicle 10 gradually decreases.

[0067] If the behavior estimation unit 58F estimates that the vehicle 10 is entering a curve (step S61: Yes), and the pixel movement speed of the feature points included in the window image is decreasing (step S62: Yes), the image determination unit 60F determines that the window image matches the behavior (step S63).

[0068] On the other hand, even if the behavior estimation unit 58F estimates that the vehicle 10 is entering a curve, if the pixel movement speed of the feature points included in the window image has not decreased, the image determination unit 60F determines that the window image does not match the behavior (step S64).

[0069] [Effects of the behavior estimation unit and the video judgment unit] If it is estimated that vehicle 10 is entering a curve, but the movement speed of feature points included in the window view video does not decrease, the video determination unit 60F determines that the window view video does not match the vehicle's behavior. This makes it possible to exclude from distribution window video where the movement speed of feature points does not decrease despite vehicle 10 entering a curve.

[0070] [Embodiment 7] As shown in Figure 3, the video distribution system 1G according to Embodiment 7 is the same as the video distribution system 1 according to Embodiment 3, except that the vehicle driving data is the vehicle's angular velocity and vehicle speed, and the behavior estimation unit 58G and the video determination unit 60G are included. The behavior estimation unit 58G and the video determination unit 60G will be described below.

[0071] [Behavior Estimation Unit] The behavior estimation unit 58G is configured to estimate whether or not the vehicle 10 is traveling on a curve based on the angular velocity and vehicle speed of the vehicle 10. For example, the behavior estimation unit 58G estimates that the vehicle 10 is traveling on a curve if the angular velocity of the vehicle 10 is greater than or equal to a predetermined angular velocity and the vehicle speed of the vehicle 10 exceeds a predetermined vehicle speed.

[0072] [Video Judgment Unit] The video determination unit 60G is configured to determine that the vehicle behavior and the video footage are inconsistent when the behavior estimation unit 58G estimates that the vehicle 10 is traveling on a curve, and the amount of pixel movement of feature points included in the video footage from the vehicle window is less than a predetermined amount of pixel movement.

[0073] [Operation of the behavior estimation unit and the video judgment unit] As shown in Figure 9, the behavior estimation unit 58G estimates whether or not the vehicle 10 is traveling on a curve based on the temporarily stored angular velocity and vehicle speed of the vehicle 10 (step S71). For example, the behavior estimation unit 58G estimates that the vehicle 10 is traveling on a curve if the angular velocity of the vehicle 10 is greater than or equal to a predetermined angular velocity and the vehicle speed of the vehicle 10 exceeds a predetermined vehicle speed.

[0074] If the behavior estimation unit 58G estimates that the vehicle 10 is traveling on a curve (Step S71: Yes), and the amount of pixel movement calculated by the movement amount calculation unit 70 is equal to or greater than a predetermined amount of pixel movement (threshold) (Step S72: Yes), the video determination unit 60G determines that the behavior and the video from the car window are in agreement (Step S73). If the amount of pixel movement of the feature points is less than the threshold (Step S72: No), the video determination unit 60G determines that the behavior and the video from the car window are not in agreement (Step S74).

[0075] [Effects of the behavior estimation unit and the video judgment unit] If it is estimated that vehicle 10 is traveling on a curve, but the amount of pixel movement of feature points included in the window view video is less than a predetermined amount of pixel movement, the video determination unit 60G determines that the window view video does not match the vehicle's behavior. This makes it possible to exclude from distribution window view videos where the amount of pixel movement of feature points is less than a predetermined amount of pixel movement, even though vehicle 10 is traveling on a curve (window view videos where the movement is less than the vehicle speed).

[0076] The present invention is not limited to the embodiments described above, and includes modified forms of the embodiments described above, as well as forms that combine these forms as appropriate.

[0077] For example, vehicle driving data may include driving operations such as braking and steering. [Explanation of symbols]

[0078] 1,1B,1C,1D,1E,1F,1G Video Distribution System 10 vehicles 12. Mobile device on the distribution side 14 Viewing device 16 Distribution Server 18. Smartphone (distributing mobile device) 20 cameras 22 Communication Networks 24 Video Processing Unit 26 Information Processing Section 28 Video transmission unit 30. Smartphone (viewing device) 31 displays 32 Video receiving unit 34 Information Processing Section 36. Video Processing Section 38 Vehicle Driving Data Transmission Unit 40 Wheel speed sensor 42 Angular velocity sensor 44 Accelerometer 46. ​​Steering angle sensor 48 Data Processing Unit 50 Data / Video Receiver 52 Video Distribution Processing Unit 54 Video transmission unit 56 Data Time Adjustment Unit 58, 58B, 58F, 58G Behavior Estimation Unit 60, 60C, 60D, 60E, 60F, 60G Video Judgment Unit 62 Distribution Control Unit 64 Administrator Notification Department 66 Administrator System 68 Image Processing Unit 70 Travel amount calculation section 72 Stationary Object Identification Unit 74 Relative movement speed calculation unit

Claims

1. A mobile terminal on the distribution side transmits video footage taken from inside the vehicle looking outwards, A distribution server that distributes the in-car video received from the distribution-side mobile terminal to the viewing-side terminal, A video distribution system equipped with, The vehicle includes a vehicle driving data transmission unit that transmits the vehicle's driving data to the distribution server. The aforementioned distribution server is A behavior estimation unit that estimates the behavior of the vehicle based on the vehicle driving data received from the vehicle driving data transmission unit, A video determination unit determines whether the behavior estimated by the behavior estimation unit matches the car window video received from the distribution-side mobile terminal, A distribution control unit that stops distributing the vehicle window video when the video determination unit determines that the behavior and the vehicle window video are inconsistent, including, Video distribution system.

2. The aforementioned vehicle driving data is the vehicle speed of the vehicle, The behavior estimation unit estimates whether or not the vehicle is moving based on the vehicle speed. The video distribution system according to claim 1.

3. The video determination unit determines that the behavior and the video are inconsistent if the behavior estimation unit estimates that the vehicle is in motion and the amount of pixel movement of feature points included in the video from the car window is less than a predetermined amount of pixel movement. The video distribution system according to claim 2.

4. The video determination unit determines that the behavior and the video from the car window are consistent if the direction of pixel movement of the feature points included in the video from the car window is the same as the direction of travel of the vehicle, the amount of pixel movement of the feature points is less than or equal to the maximum amount of pixel movement calculated from the vehicle's speed, and greater than or equal to the minimum amount of pixel movement calculated from the vehicle's speed. The video distribution system according to claim 2.

5. The aforementioned distribution server is A stationary object identification unit that identifies stationary objects included in the window image from the window image, A relative movement speed calculation unit calculates the relative movement speed of the stationary object with respect to the vehicle based on the movement speed of the stationary object in the vehicle window image, Includes, The video determination unit determines that the vehicle's behavior and the in-vehicle window image are consistent when the vehicle's speed is less than or equal to the maximum permissible speed determined based on the relative speed, and greater than or equal to the minimum permissible speed determined based on the relative speed. The video distribution system according to claim 2.

6. The aforementioned vehicle driving data includes the steering angle of the vehicle, the angular velocity of the vehicle, and the vehicle speed of the vehicle. The behavior estimation unit estimates whether the vehicle is entering a curve based on the vehicle's steering angle, the vehicle's angular velocity, and the vehicle's speed. The video determination unit determines that the behavior and the video from the vehicle window are inconsistent if the behavior estimation unit estimates that the vehicle is entering a curve and the movement speed of the feature points included in the video from the vehicle window does not decrease. The video distribution system according to claim 1.

7. The vehicle driving data includes the angular velocity of the vehicle and the speed of the vehicle, The behavior estimation unit estimates whether the vehicle is traveling on a curve based on the vehicle's angular velocity and vehicle speed. The video determination unit determines that the behavior and the video from the car window do not match if the behavior estimation unit estimates that the vehicle is traveling on a curve and the amount of pixel movement of feature points included in the video from the car window is less than a predetermined amount of pixel movement. The video distribution system according to claim 1.

8. A mobile terminal on the distribution side transmits video footage taken from inside the vehicle looking outwards, A distribution server that distributes the in-car video received from the distribution-side mobile terminal to the viewing-side terminal, A control program for a video distribution system equipped with, The video distribution system includes a vehicle driving data transmission unit in the vehicle that transmits the vehicle's driving data to the distribution server. The control program of the aforementioned video distribution system is: The steps include: estimating the behavior of the vehicle based on the vehicle driving data received from the vehicle driving data transmission unit; A step to determine whether the behavior estimated in the step of estimating the behavior is consistent with the car window video received from the distribution-side mobile terminal, If the determination step determines that the behavior and the in-vehicle window image are inconsistent, the distribution of the in-vehicle window image is stopped. A control program for a video distribution system that causes the aforementioned distribution server to execute the following.

Images