Distribution system, program, and distribution method

Abstract

To prevent motion sickness in the viewer (U) of the image. [Solution] The distribution system (1) comprises a distribution unit (356) that distributes images obtained by taking pictures with a camera (200A) installed on a vehicle (3), a display device (200A) installed outside the vehicle that displays the images distributed by the distribution unit, and a first estimation unit (351) that estimates the first time from when the vehicle starts turning until it finishes turning, based on information about the area around the vehicle. The display device displays the first time estimated by the first estimation unit along with the images distributed by the distribution unit.

Description

Technical Field

[0001] The present invention relates to a distribution system, a program, and a distribution method.

Background Art

[0002] In recent years, efforts have been actively made to provide access to a sustainable transportation system that takes into account people in vulnerable positions such as the elderly, disabled, and children among transportation participants. In order to achieve this, research and development have focused on further improving traffic safety and convenience through the development of means of transportation for vulnerable road users. As access to the transportation system for people in vulnerable positions, there is a method of not only boarding a moving body by oneself but also viewing a moving image distributed by an image distributor (for example, see Patent Document 1).

[0003] Patent Document 1 discloses that an imaging device provided in a vehicle processes an image captured by the imaging device to generate a composite image, and transmits the generated composite image to a remote terminal. Further, Patent Document 1 discloses that, by making the moving image displayed in the panning area have a smaller number of captured images per predetermined time than the focus image displayed in the focus area, the generated composite image suppresses motion sickness of viewers.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the configuration of Patent Document 1, when the vehicle turns, the amount of change in the focus image displayed in the focus area may also increase. Therefore, even if the number of captured images displayed in the focus area and the panning area is changed, there is a possibility that motion sickness may occur in the viewers of the image. This invention has been made in view of the circumstances described above, and aims to suppress motion sickness in viewers of images. Furthermore, it will contribute to supporting good connections between urban areas and rural areas, including suburban areas, through services that connect remote locations with vehicles, and will also contribute to the development of a sustainable transportation system. [Means for solving the problem]

[0006] One aspect of the present invention includes a distribution unit that distributes images obtained by taking images with a camera installed on a vehicle, a display device installed outside the vehicle that displays the images distributed by the distribution unit, and a first estimation unit that estimates the first time from when the vehicle starts turning until it finishes turning, based on information about the surroundings of the vehicle. A second estimation unit estimates the second time until the vehicle begins to turn, based on map information of the area surrounding the vehicle, or images obtained from an external camera installed on the vehicle that takes pictures of the area outside the vehicle. The display device is equipped with, The distribution unit displays the image it distributes, and before the vehicle begins to turn, it displays the second time estimated by the second estimation unit along with the image, and when the vehicle begins to turn, it stops displaying the second time and displays the previous time along with the image. The first time estimated by the first estimation unit is displayed. The display of the first hour stops when the vehicle has finished turning. It is a distribution system. [Effects of the Invention]

[0007] According to one aspect of the present invention, it is possible to suppress motion sickness in viewers of images. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 shows the system configuration of the distribution system. [Figure 2] Figure 2 shows an example of how a broadcaster's terminal can be installed in a vehicle. [Figure 3] Figure 3 shows an example of how a broadcaster's terminal can be installed in a vehicle. [Figure 4] Figure 4 shows the configuration of the vehicle and the distribution server. [Figure 5] Figure 5 shows the functional section of the first processor. [Figure 6] Figure 6 shows an example of the first composite image. [Figure 7] Figure 7 shows an example of a second composite image. [Figure 8]Figure 8 shows the configuration of the user information database. [Figure 9] Figure 9 shows the configuration of the distribution management database. [Figure 10] Figure 10 is a block diagram showing the configuration of the viewer terminal. [Figure 11] Figure 11 is a flowchart showing the operation of the in-vehicle device, the distribution server, and the viewer terminal. [Figure 12] Figure 12 is a flowchart illustrating the operation of the in-vehicle device. [Figure 13] Figure 13 is a flowchart illustrating the operation of the viewer terminal. [Figure 14] Figure 14 is a diagram illustrating the processing of the image processing unit. [Modes for carrying out the invention]

[0009] [1. First Embodiment] [1-1. Configuration of the distribution system] Figure 1 shows the system configuration of distribution system 1. The distribution system 1 includes a vehicle 3, a broadcaster terminal 200A, a distribution server 100, and a viewer terminal 200B, and is a system that live-streams content including images obtained by the broadcaster terminal 200A. Live streaming means that images captured by the broadcaster's terminal 200A are streamed in real time to the viewer's terminal 200B. The images may be still images or moving images. The broadcaster terminal 200A is an example of a "recording device." The viewer terminal 200B is an example of a "display device."

[0010] The vehicle 3 is equipped with an in-vehicle device 30. The in-vehicle device 30 is wirelessly connected to a distributor terminal 200A held by a distributor S who is an occupant of the vehicle 3 through short-range wireless communication or the like. The in-vehicle device 30 receives an image obtained by shooting with a camera provided in the distributor terminal 200A from the distributor terminal 200A. The in-vehicle device 30 uploads content data including the received image to the distribution server 100. Note that the content data may include sound collected inside the vehicle cabin of the vehicle 3 or sound outside the vehicle 3.

[0011] The distributor terminal 200A may be a smartphone or a tablet PC (Personal Computer), or may be a camera such as a digital camera or a 360-degree camera capable of shooting the entire surroundings.

[0012] The distributor terminal 200A is provided inside the vehicle 3. FIG. 2 and FIG. 3 are diagrams showing an example of attaching the distributor terminal 200A to the vehicle 3.

[0013] FIG. 2 and FIG. 3 show an example of attaching the distributor terminal 200A to the seat 10 of the passenger seat of the vehicle 3. The distributor terminal 200A is attached to the seat 10 by an attachment 50. The attachment 50 is attached to a headrest stay 13 that fixes the headrest 12 of the seat 10 of the passenger seat to the seat back 11.

[0014] FIG. 2 shows an example of attaching the distributor terminal 200A to the seat 10 of the passenger seat so that the front of the vehicle 3 is included in the shooting angle of the distributor terminal 200A. This attachment position of the distributor terminal 200A is referred to as the first position. FIG. 3 shows an example of attaching the distributor terminal 200A to the seat 10 of the passenger seat so that the distributor S sitting in the driver's seat is included in the shooting angle of the distributor terminal 200A. This attachment position of the distributor terminal 200A is referred to as the second position.

[0015] One end of the attachment 50 is provided with a first fastener 51 for fixing the broadcaster terminal 200A to the attachment 50, and the other end of the attachment 50 is provided with a second fastener for fixing the attachment 50 to the headrest stay 13. The second fastener is not shown in the illustration. After changing the mounting direction of the attachment 50 to the headrest stay 13, the broadcaster terminal 200A is mounted on the passenger seat 10 in the first or second position by fixing the attachment 50 to the headrest stay 13 with the second fastener.

[0016] Returning to the explanation of Figure 1, the distribution server 100 distributes the content distributed from vehicle 3 to viewer terminal 200B of viewer U. This distribution technology can be implemented using well-known technologies such as HLS (HTTP Live Streaming), CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), and RTMP (Real-Time Messaging Protocol).

[0017] The viewer terminal 200B is a display device owned by viewer U, who views content distributed from the distribution server 100. Figure 1 shows N viewers U, namely U1, U2, ..., UN, where N is any natural number. The viewer terminal 200B may be a portable or mobile terminal device such as a smartphone, tablet PC, or notebook PC, or a stationary terminal device such as a desktop PC. Alternatively, the viewer terminal 200B may be a television receiver, or a head-mounted display device in which an image display unit is attached to the viewer U's head, and the display of the image display unit is positioned in front of the viewer U's eyes. The head-mounted display device only needs to be capable of viewing content distributed from the distribution server 100, and may be transparent or opaque. In this embodiment, the case where the viewer terminal 200B is an opaque head-mounted display device is illustrated.

[0018] The viewer terminal 200B is equipped with a display 240 (see Figure 10), which displays images distributed from the distribution server 100, and a speaker 260 which outputs audio distributed from the distribution server 100.

[0019] Communication network 5 is a wired or wireless transmission path for information transmitted from devices connected to communication network 5. For example, communication network 5 may include public networks such as the Internet, mobile communication networks, and satellite communication networks, as well as various LANs (Local Area Networks) and WANs (Wide Area Networks), including Ethernet®. Communication network 5 may also include dedicated network lines such as IP-VPN (Internet Protocol-Virtual Private Network).

[0020] [1-2. Vehicle Configuration] Figure 4 shows the configuration of vehicle 3 and distribution server 100. First, let's explain the configuration of vehicle 3 with reference to Figure 4. Vehicle 3 is equipped with an in-vehicle device 30, an external communication interface 31, a first short-range wireless communication interface 32, an in-vehicle communication interface 33, a touch panel 34, an audio processing unit 35, a speaker 36, an external camera 37, a turn signal switch 38, and a group of sensors 39. Hereinafter, interfaces will be abbreviated as I / F. First, the external communication interface 31, the first short-range wireless communication interface 32, the in-vehicle communication interface 33, the touch panel 34, the voice processing unit 35, the speaker 36, the external camera 37, the turn signal switch 38, and the sensor group 39 will be described.

[0021] The external communication interface (I / F31) is a communication module that performs wireless communication according to mobile communication standards such as LTE (Long Term Evolution), 4G (Generation), 5G, and Wi-Fi (registered trademark). The external communication interface (I / F31) connects to the communication network 5 via an antenna (not shown) and transmits and receives data with the distribution server 100. The external communication interface (I / F31) is, for example, a TCU (Telematics Control Unit).

[0022] The first short-range wireless communication interface (I / F32) is a communication device that performs wireless communication in accordance with short-range wireless communication standards such as Bluetooth® and Wi-Fi. The first short-range wireless communication interface (I / F32) is a communication module that communicates in accordance with NFC (Near Field Communication) communication standards such as Bluetooth and Wi-Fi. The first short-range wireless communication interface (I / F32) performs short-range wireless communication with a terminal device carried by the crew and receives images and audio captured by the terminal device.

[0023] The in-vehicle communication interface (I / F33) is an input / output interface connected to an in-vehicle network (not shown). The in-vehicle network uses a communication bus that supports communication standards such as CAN (Control Area Network), CAN-FD (CAN with Flexible Data Rate), and Ethernet. The in-vehicle communication interface (I / F33) communicates data with the vehicle's ECU (Engine Control Unit) 40 and other in-vehicle equipment such as relay devices via the in-vehicle network.

[0024] The touch panel 34 includes a display panel such as a liquid crystal panel or an organic EL (Electro-Luminescence) panel, and a touch sensor. The touch sensor detects the viewer U's touch operation on the touch panel 34 and outputs position information indicating the location of the detected touch operation to the first control unit 330.

[0025] The audio processing unit 35 converts, for example, the digital audio data output by the first control unit 330 into an analog audio signal. The audio processing unit 35 then amplifies the converted analog audio signal and outputs the amplified audio signal through the speaker 36.

[0026] The external camera 37 is installed in front of the vehicle 3 and photographs the area in front of the vehicle 3. The external camera 37's shooting range includes the road surface on which the vehicle 3 travels. The external camera 37 takes pictures at predetermined intervals and outputs the image data obtained from the shooting to the in-vehicle device 30.

[0027] The turn signal switch 38 is a switch that controls the flashing and extinguishing of the turn signals installed on the vehicle 3. When the driver operates the turn signal to flash, the turn signal switch 38 instructs the turn signal to flash and outputs data indicating that the turn signal has been flashed to the on-board device 30. Also, when the driver operates the turn signal to extinguish, the turn signal switch 38 instructs the turn signal to extinguish and outputs data indicating that the turn signal has been extinguished to the on-board device 30.

[0028] The sensor group 39 comprises various sensors. In this embodiment, the sensor group 39 includes an acceleration sensor, a vehicle speed sensor, a GNSS (Global Navigation Satellite System) unit, and a steering angle sensor. The acceleration sensor is a sensor that detects the acceleration of the vehicle 3. The acceleration sensor detects the acceleration of the vehicle 3 at predetermined intervals and outputs the detected value to the on-board device 30 each time it detects the acceleration of the vehicle 3. The vehicle speed sensor is a sensor that detects the speed of vehicle 3. The vehicle speed sensor detects the speed of vehicle 3 at predetermined intervals and outputs the detected value to the on-board device 30 each time it detects the speed of vehicle 3. The GNSS unit determines the current position of vehicle 3. The GNSS unit generates position data indicating the current position of vehicle 3 and outputs the generated position data to the on-board device 30. The yaw rate sensor is a sensor that detects the yaw angle of vehicle 3. The yaw rate sensor detects the yaw angle at a predetermined period and outputs the detected value to the on-board device 30.

[0029] The in-vehicle device 30 includes an input / output interface 310 and a first control unit 330.

[0030] The input / output interface (I / F) 310 functions as a connection point between the external communication interface (I / F) 31, the first short-range wireless communication interface (I / F) 32, the in-vehicle communication interface (I / F) 33, the touch panel (I / F) 34, the voice processing unit (I / F) 35, the external camera (I / F) 37, the turn signal switch (I / F) 38, and the sensor group (I / F) 39, and the first control unit (I / F) 330. The I / F 310 includes a connector and interface circuit and outputs data input from the external communication interface (I / F) 31, the first short-range wireless communication interface (I / F) 32, the in-vehicle communication interface (I / F) 33, the touch panel (I / F) 34, the voice processing unit (I / F) 35, the external camera (I / F) 37, the turn signal switch (I / F) 38, and the sensor group (I / F) 39 to the first control unit (I / F) 330. The I / F 310 also outputs data input from the first control unit (I / F) 330 to the external communication interface (I / F) 31, the first short-range wireless communication interface (I / F) 32, the in-vehicle communication interface (I / F) 33, the touch panel (I / F) 34, and the voice processing unit (I / F) 35.

[0031] The first control unit 330 is a computer device comprising a first memory 340 and a first processor 350.

[0032] The first memory 340 is composed of, for example, a volatile semiconductor memory and a non-volatile semiconductor memory. The first memory 340 may also consist only of non-volatile semiconductor memory. Alternatively, the first memory 340 may be configured to include an auxiliary storage device such as an SSD (Solid State Drive). The first memory 340 stores control programs 345 executed by the first processor 350, map data 346, setting data that defines the operation of the in-vehicle device 30, and the like.

[0033] Map data 346 is data that stores road map information, building information, etc. The road map information consists of a road network that represents roads on the map with lines, and includes information about links that define the parts between each node, with intersections and junctions being nodes and the parts between each node being links. The building information shows the location of the building, the name of the building, and the shape of the building when viewed from above.

[0034] The first processor 350 is, for example, a computing device such as a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The first processor 350 may consist of a single processor or multiple processors. Alternatively, the first processor 350 may consist of a part or all of the first memory 340 or a System-on-a-chip (SoC) integrated with other circuits.

[0035] Figure 5 shows the functional section of the first processor 350. The first processor 350 functions as a first estimation unit 351, a second estimation unit 352, a determination unit 353, a correction unit 354, an image processing unit 355, and a distribution unit 356 by reading and executing a control program 345 stored in the first memory 340.

[0036] [1-2-1. 1st estimation part] The first estimation unit 351 estimates the time from when the vehicle 3 starts turning until it finishes turning (hereinafter referred to as "first time") based on information about the vehicle 3's surroundings.

[0037] The first estimation unit 351 estimates the first time when the in-vehicle device 30 receives data from the turn signal switch 38 indicating that the turn signal has been activated, that is, when the turn signal has been operated. An example of a situation in which the first time is estimated in this case is when the vehicle 3 turns at an intersection. The first estimation unit 351 estimates the first time by adding time to a predetermined reference time (for example, 5 or 6 seconds) according to the number of other vehicles and pedestrians around the vehicle 3.

[0038] The first estimation unit 351 obtains the number of other vehicles present around vehicle 3 as information about the area surrounding vehicle 3 by performing pattern matching or the like on images obtained from the external camera 37 and by performing vehicle-to-vehicle communication. The first estimation unit 351 also obtains the number of pedestrians present around vehicle 3 as information about the area surrounding vehicle 3 by performing pattern matching or the like on images obtained from the external camera 37. The first estimation unit 351 may also obtain the number of pedestrians through vehicle-to-infrastructure communication.

[0039] The first estimation unit 351 obtains the number of other vehicles and the number of pedestrians, and then calculates an additional time to be added to the base time using a predetermined algorithm. The first estimation unit 351 then estimates the first time by adding the additional time to the base time. This predetermined algorithm is such that the additional time increases as the number of other vehicles and pedestrians increases.

[0040] The first estimation unit 351 estimates the first time if the vehicle 3 is positioned a predetermined distance before the curve it is scheduled to enter. The first estimation unit 351 acquires map information about the area around the vehicle 3 based on the map data 346 and the current position of the vehicle 3 determined by the GNSS unit. The first estimation unit 351 then refers to the acquired map information to determine whether the vehicle 3 is positioned a predetermined distance before the curve it is scheduled to enter. This determination is made based on the links that make up the curve (the link that the vehicle 3 is scheduled to enter first) and the current position of the vehicle 3. If the first estimation unit 351 determines that the vehicle 3 is positioned a predetermined distance before the curve it is scheduled to enter, it estimates the first time. The first estimation unit 351 calculates the length of the curve it is scheduled to enter based on the number of links that make up the curve and the length of each link. Next, the first estimation unit 351 calculates the speed of the vehicle 3 when it is turning the curve by subtracting a predetermined speed from the vehicle speed detected by the vehicle speed sensor. The first estimation unit 351 then estimates the first time by multiplying the calculated curve length by the speed of the vehicle 3 when it turns the curve.

[0041] When the first estimation unit 351 estimates the first time, it outputs the estimated first time to the image processing unit 355.

[0042] [1-2-2.Second estimation part] The second estimation unit 352 estimates the time until the vehicle 3 begins to turn (hereinafter referred to as "second time").

[0043] The second estimation unit 352 estimates the second time when it receives data from the turn signal switch 38 indicating that the in-vehicle device 30 has flashed the turn signal, that is, when the turn signal has been operated. In this case, the situation in which the second time is estimated is assumed to be when the vehicle 3 is about to turn at an intersection. The second estimation unit 352 acquires map information of the area around the vehicle 3 based on the map data 346 and the current position of the vehicle 3 determined by the GNSS unit. Then, the second estimation unit 352 calculates the distance between the current position of the vehicle 3 and the intersection by referring to the acquired map information. This calculation is performed based on the node corresponding to the intersection and the current position of the vehicle 3. Next, the second estimation unit 352 estimates the second time by dividing the calculated distance between the vehicle 3 and the intersection by the vehicle speed detected by the vehicle speed sensor of the sensor group 39.

[0044] The method for estimating the second time by the second estimation unit 352 is not limited to this method. The second estimation unit 352 may calculate the distance between the vehicle 3 and the intersection based on the size of objects captured in the image obtained by the external camera 37, and estimate the second time based on the calculated distance and the speed of the vehicle 3. For example, the second estimation unit 352 calculates the distance between the vehicle 3 and the intersection by comparing the size of the traffic lights captured in the image obtained by the external camera 37 with a threshold value.

[0045] The second estimation unit 352 estimates the second time if the vehicle 3 is positioned a predetermined distance before the curve it is scheduled to enter. Similar to the first estimation unit 351, the second estimation unit 352 determines whether or not the vehicle 3 is positioned a predetermined distance before the curve it is scheduled to enter. If the second estimation unit 352 determines that the vehicle 3 is positioned a predetermined distance before the curve it is scheduled to enter, it estimates the second time. The second estimation unit 352 calculates the distance between the curve and the vehicle 3 based on the links that make up the curve (the link that the vehicle 3 is scheduled to enter first among the links that make up the curve) and the current position of the vehicle 3. Next, the first estimation unit 351 estimates the second time by dividing the calculated distance by the vehicle speed detected by the vehicle speed sensor of the sensor group 39.

[0046] When the second estimation unit 352 estimates the second time, it outputs the estimated second time to the image processing unit 355.

[0047] [1-2-3. Judgment section] The determination unit 353 determines whether or not there are irregularities on the road surface of the road on which the vehicle 3 is traveling.

[0048] The determination unit 353 detects irregularities in the road surface captured by the external camera 37 through image processing such as pattern matching, and determines whether there are a predetermined number of irregularities exceeding a predetermined depth or height. If the determination unit 353 determines that there are a predetermined number of irregularities exceeding a predetermined depth or height, it determines that there are irregularities on the road surface on which the vehicle 3 is traveling. If it determines that there are not a predetermined number of irregularities exceeding a predetermined depth or height, it determines that there are no irregularities on the road surface on which the vehicle 3 is traveling. Irregularities on the road surface include gravel laid on the road, sinkholes, scattered debris, ruts, etc.

[0049] The determination unit 353 outputs the determination result to the correction unit 354.

[0050] [1-2-4. Correction Section] The correction unit 354 acquires the image obtained from the broadcasting terminal 200A via the first short-range wireless communication I / F 32. If the judgment result acquired from the determination unit 353 indicates that there are no irregularities on the road surface, the correction unit 354 corrects the blur of the image acquired from the broadcasting terminal 200A. On the other hand, if the judgment result acquired from the determination unit 353 indicates that there are no irregularities on the road surface, the correction unit 354 does not correct the blur of the image acquired from the broadcasting terminal 200A and outputs the image acquired from the broadcasting terminal 200A to the image processing unit 355.

[0051] The correction unit 354 corrects the blur in the image acquired from the broadcaster terminal 200A using an existing electronic image stabilization method. This electronic image stabilization method corrects image misalignment by shifting pixels by comparing one image with the next image obtained after that image. After correcting the blur in the image acquired from the broadcaster terminal 200A, the correction unit 354 outputs the corrected image to the image processing unit 355.

[0052] [1-2-5. Image Processing Section] The image processing unit 355 adds various information to the image acquired from the correction unit 354. If the correction unit 354 corrects the blur of the image, the image processing unit 355 adds the various information to the corrected image. If the correction unit 354 does not correct the blur of the image, the image processing unit 355 adds the various information to the image that has not been corrected by the correction unit 354.

[0053] [1-2-5-1. Addition of the first hour] When the image processing unit 355 obtains the first time from the first estimation unit 351, it adds the first time information J1 and the turning information J2 to the image obtained from the correction unit 354 to generate the first composite image CP1. The first time information J1 is information that includes the first time. The turning information J2 is information that indicates that the vehicle 3 is in the middle of turning.

[0054] Figure 6 shows an example of the first composite image CP1. Figure 6 illustrates the case where the first time information J1 is added to image P1. Image P1 shown in Figure 6 is an image taken from the passenger seat of vehicle 3, and shows the front of vehicle 3 through the windshield.

[0055] In Figure 6, the first time information J1 is the string "Time to complete the turn: approximately 5 seconds". The first time indicated by the first time information J1 in Figure 6 is "5 seconds". Note that the position where the first time information J1 is added is not limited to the position in Figure 6. However, from the viewpoint of visibility, it is preferable that the first time information J1 is in an area other than the windshield of the image to which it is added.

[0056] Furthermore, in Figure 6, the turning information J2 is the string "Turning". Note that the position where the turning information J2 is added is not limited to the position in Figure 6. However, from the viewpoint of visibility, it is preferable that the turning information J2 is added to an area other than the windshield within the area of ​​the image to which it is added.

[0057] The image processing unit 355 generates a first composite image CP1 with an added indication that the turn signal has been operated, if the turn signal is operated. Figure 6 illustrates a case where an arrow image YG is added to image P1 to indicate that the turn signal has been operated. The direction indicated by the arrow image YG corresponds to the operated turn signal.

[0058] When the image processing unit 355 obtains the first time from the first estimation unit 351, it adds the first time information J1 and the turning information J2 to the image obtained from the correction unit 354 until the vehicle 3 has finished turning. Furthermore, when the turn signal is operated, the image processing unit 355 adds an arrow image YG to the image obtained from the correction unit 354 until the in-vehicle device 30 receives data indicating that the turn signal has been turned off.

[0059] When the image processing unit 355 generates the first composite image CP1, it outputs the first composite image CP1 to the distribution unit 356.

[0060] [1-2-5-2. Addition of the second hour] When the image processing unit 355 obtains the second time from the second estimation unit 352, it adds the second time information J3 to the image obtained from the correction unit 354 to generate the second composite image CP2. The second time information J3 is information that includes the second time.

[0061] Figure 7 shows an example of the second composite image CP2. Figure 7 illustrates the case where second time information J3 is added to image P2. Image P2 shown in Figure 7 is an image taken from the passenger seat of vehicle 3, and shows the front of vehicle 3 through the windshield.

[0062] In Figure 7, the second time information J3 is the string "Time until turning begins: approximately 10 seconds". The second time indicated by the second time information J3 in Figure 7 is "10 seconds". Note that the position where the second time information J3 is added is not limited to the position in Figure 7. However, from the viewpoint of visibility, it is preferable that the second time information J3 is in an area other than the windshield within the area of ​​the image to which it is added.

[0063] The image processing unit 355 generates a second composite image CP2, which includes an additional indication that the turn signal has been operated, if the turn signal is operated. Figure 7 illustrates a case where an arrow image YG is added to image P2 to indicate that the turn signal has been operated. The direction indicated by the arrow image YG corresponds to the operated turn signal.

[0064] When the image processing unit 355 obtains the second time from the second estimation unit 352, it adds the second time information J3 to the image obtained from the correction unit 354 until the vehicle 3 has finished turning. Also, when the turn signal is operated, the image processing unit 355 adds the arrow image YG to the image obtained from the correction unit 354 until the in-vehicle device 30 receives data indicating that the turn signal has been turned off.

[0065] When the image processing unit 355 generates the second composite image CP2, it outputs the second composite image CP2 to the distribution unit 356.

[0066] If the first time information J1, the second time information J3, and the arrow image YG are not added, the image processing unit 355 outputs the image acquired from the correction unit 354 to the distribution unit 356 without performing any processing on the image acquired from the correction unit 354.

[0067] [1-2-6. Distribution Department] The distribution unit 356 distributes the images acquired from the image processing unit 355 to the viewer terminal 200B via the external communication interface 31. More specifically, the distribution unit 356 uploads content data, including the images acquired from the image processing unit 355, along with the distribution ID (Identification), to the distribution server 100 via the external communication interface 31.

[0068] [1-3. Configuration of the distribution server] Next, the configuration of the distribution server 100 will be described with reference to Figure 4. The distribution server 100 consists of a network communication interface 110 and a second control unit 130.

[0069] The network communication I / F110 includes, for example, a communication card such as a NIC (Network Interface Card), and communicates data with the vehicle 3 and the viewer terminal 200B via the communication network 5.

[0070] The second control unit 130 is a computer device comprising a second memory 140 and a second processor 150.

[0071] The second memory 140 may consist of, for example, a volatile semiconductor memory and a non-volatile semiconductor memory. The second memory 140 may also consist only of non-volatile semiconductor memory. Alternatively, the second memory 140 may be configured to include an auxiliary storage device such as an HDD (Hard Disk Drive) or SSD.

[0072] The second memory 140 stores the control program 141 executed by the second processor 150, the user information database 143, and the distribution management database 145. Hereafter, databases will be abbreviated as DB.

[0073] Figure 8 shows the configuration of the user information DB143. A single record in User Information DB143 contains User ID, APP_ID, device information, and user information. APP is an abbreviation for Application Program.

[0074] The User ID is identification information that identifies users who use the distribution service provided by the distribution server 100. Users include the broadcaster S and the viewer U.

[0075] The APP_ID is identification information that identifies the application program downloaded to the broadcaster terminal 200A or the viewer terminal 200B. Streamer S and viewer U download the app from the designated website and install it on streamer terminal 200A and viewer terminal 200B, respectively.

[0076] Device information pertains to the viewer terminal 200B. This device information indicates, for example, whether the viewer terminal 200B is a smartphone, a PC, a head-mounted display device, or a camera. For instance, a model number might be used. The device information also includes communication information for communicating with the viewer terminal 200B. Address information is an example of this communication information.

[0077] User information includes personal information of the user, broadcaster S, and viewer U, such as name, address, gender, and age.

[0078] Figure 9 shows the configuration of the distribution management DB145. A single record in the distribution management DB145 includes a distribution ID that identifies the distribution, the user ID of the distributor S, the user ID of the viewer U, and the date and time the distribution started.

[0079] Returning to Figure 4, we will continue to explain the configuration of the distribution server 100. The second processor 150 is, for example, a processing unit such as a CPU or an MPU. The second processor 150 may consist of a single processor or multiple processors. Alternatively, the second processor 150 may consist of part or all of the second memory 140 or an integrated SoC with other circuits.

[0080] The second control unit 130 performs various operations when the second processor 150 reads and executes the control program 141.

[0081] [1-4. Viewer Terminal Configuration] Figure 10 is a block diagram showing the configuration of viewer terminal 200B. The viewer terminal 200B includes a wireless communication interface 210, a second short-range wireless communication interface 220, a motion sensor 230, a display 240, a microphone 250, a speaker 260, and a third control unit 270.

[0082] The wireless communication interface (I / F210) is a communication module that performs wireless communication according to mobile communication standards such as LTE, 4G, 5G, and Wi-Fi. The wireless communication interface (I / F210) connects to the communication network 5 via an antenna (not shown) and transmits and receives data with the distribution server 100.

[0083] The second short-range wireless communication interface (I / F) 220 is a communication module that communicates according to NFC communication standards such as Bluetooth and Wi-Fi. The second short-range wireless communication interface (I / F) 220 can transmit audio input from the microphone 250 to the in-vehicle device 30 via short-range wireless communication with the in-vehicle device 30 through the distribution server 100.

[0084] The motion sensor 230 is a 9-axis sensor that detects acceleration (3 axes), angular velocity (3 axes), and geomagnetic field (3 axes). When the motion sensor 230 is attached to the head of viewer U, it detects the movement of viewer U's head. The motion sensor 230 performs detection at predetermined intervals and outputs the detected value to the third control unit 270.

[0085] Microphone 250 is an audio input device that receives the voices of broadcaster S and viewer U, and speaker 260 is an audio output device that outputs the voices of broadcaster S and viewer U.

[0086] The display 240 comprises a display panel such as an LCD panel or an OLED panel, and a touch sensor. The display 240 functions as a display unit for displaying images and as a reception unit for receiving operations from the broadcaster S and the viewer U.

[0087] The third control unit 270 is a computer device comprising a third memory 280 and a third processor 290. The third processor 290 is an example of a "processor".

[0088] The third memory 280 is equipped with non-volatile semiconductor memory. The third memory 280 may also be configured to include an auxiliary storage device such as an SD card. The third memory 280 stores control programs such as the OS (Operating System) 281 and APP 283. APP 283 is an application program that communicates data with the distribution server 100 to display images included in the content distributed by the distribution server 100 on the display 240 and output audio included in the content to the speaker 260. APP283 is an example of a "program".

[0089] The third processor 290 is, for example, a processing unit such as a CPU or an MPU. The third processor 290 may consist of a single processor or multiple processors.

[0090] The third control unit 270 communicates with the distribution server 100 via the wireless communication interface 210 by having the third processor 290 read and execute APP283. The third control unit 270 causes the third processor 290 to read and execute APP 283, thereby displaying images included in the content distributed by the distribution server 100 on the display 240. Furthermore, the third control unit 270 causes the third processor 290 to read and execute APP283, thereby outputting the audio included in the content distributed by the distribution server 100 to the speaker 260. Furthermore, the third control unit 270 detects the orientation of the viewer terminal 200B while it is attached to the viewer U, based on the detection value of the motion sensor 230, by reading and executing APP 283 from the third processor 290. The orientation of the viewer terminal 200B corresponds to the direction in which the viewer U's face is facing, relative to the viewer U wearing it, and is the orientation in the left-right direction relative to the viewer U wearing it.

[0091] [1-5. Operation] Next, the operation of each part of the distribution system 1 according to this embodiment will be described. First, we will explain the operation of each part of the distribution system 1 involved in content distribution. Figure 11 is a flowchart showing the operation of the in-vehicle device 30, the distribution server 100, and the viewer terminal 200B. In Figure 11, flowchart FA shows the operation of the in-vehicle device 30, flowchart FB shows the operation of the distribution server 100, and flowchart FC shows the operation of the viewer terminal 200B.

[0092] As shown in flowchart FA, the distribution unit 356 determines whether or not to start distributing the content (step SA1). For example, if the touch panel 34 receives a command to start distribution, the distribution unit 356 makes a positive determination in step SA1. Furthermore, for example, if the in-vehicle device 30 receives distribution start information from the distributor terminal 200A, the distribution unit 356 makes a positive determination in step SA1. The distribution start information is information indicating the start of distribution.

[0093] If the distribution unit 356 determines that it is time to start distributing content (Step SA1: YES), it starts distributing the content (Step SA2). Once the distribution unit 356 starts distributing content, it uploads the content data to the distribution server 100 at predetermined intervals (Step SA3). Step SA3 is an example of a "delivery step".

[0094] As shown in the flowchart FB, the second control unit 130 of the distribution server 100 receives content data from the in-vehicle device 30 (step SB1).

[0095] Next, the second control unit 130 of the distribution server 100 transmits the received content data to the viewer terminal 200B (step SB2). Step SB2 is described in detail. The second control unit 130 identifies a record with a distribution ID received along with the content data from the distribution management DB 145, and obtains the user ID of viewer U from the identified record. Next, the second control unit 130 obtains device information for each obtained user ID of viewer U. Then, the second control unit 130 transmits the received content data based on the communication information contained in the obtained device information.

[0096] As shown in flowchart FC, the third control unit 270 of the viewer terminal 200B receives content data from the distribution server 100 (step SC1).

[0097] Next, the third control unit 270 displays the image contained in the content indicated by the received content data on the display 240, and outputs the audio contained in the content indicated by the received content data on the speaker 260 (step SC2). Step SC2 is an example of a "display step".

[0098] Returning to the explanation of flowchart FA, the distribution unit 356 determines whether or not to terminate the distribution of content (step SA4). For example, if the touch panel 34 receives a message to end distribution, the distribution unit 356 makes a positive determination in step SA4. Furthermore, for example, if the in-vehicle device 30 receives distribution termination information from the distributor terminal 200A, the distribution unit 356 makes a positive determination in step SA4. The distribution termination information is information indicating the end of distribution.

[0099] If the distribution unit 356 determines that it does not want to terminate the distribution of content (step SA4: NO), it returns to step SA3 and performs the processing from step SA3 onward again. The distribution unit 356 will continue distributing content until it makes a positive determination in step SA4.

[0100] On the other hand, if the distribution unit 356 determines that it is time to stop distributing the content (step SA4: YES), it terminates the distribution of the content (step SA5).

[0101] As described above, various information is added to the image distributed to the viewer terminal 200B, that is, the image obtained by the broadcaster terminal 200A through photography, by the image processing unit 355. Next, the operation of the in-vehicle device 30 will be described. Figure 12 is a flowchart showing the operation of the in-vehicle device 30.

[0102] The first estimation unit 351 determines whether or not to estimate the first time (step SD1).

[0103] Step SD1 will be described in detail. When the in-vehicle device 30 receives data indicating that the turn signal has been flashed, the first estimation unit 351 makes a positive determination in step SD1. Furthermore, if vehicle 3 is positioned a predetermined distance before the curve it is scheduled to enter, the first estimation unit 351 makes a positive determination in step SD1.

[0104] If the first estimation unit 351 determines that it does not estimate the first time (step SD1: NO), it performs the determination in step SD1 again.

[0105] On the other hand, if the first estimation unit 351 determines that it is appropriate to estimate the first time (step SD1: YES), it estimates the first time (step SD2). Step SD2 is an example of an "estimation step".

[0106] The second estimation unit 352 determines whether or not to estimate the second time (step SD3). The determination in step SD3 is performed in parallel with the determination in step SD1.

[0107] Step SD3 will be described in detail. If the in-vehicle device 30 receives data indicating that the turn signal has been flashed, the second estimation unit 352 makes a positive determination in step SD3. Furthermore, if vehicle 3 is positioned a predetermined distance before the curve it is scheduled to enter, the second estimation unit 352 makes a positive determination in step SD3.

[0108] If the second estimation unit 352 determines that it does not estimate the second time (step SD3: NO), it performs the determination in step SD3 again.

[0109] On the other hand, if the second estimation unit 352 determines that it is appropriate to estimate the second time (step SD3: YES), it estimates the second time (step SD4).

[0110] Next, the image processing unit 355 determines whether or not the turn signal has been operated (step SD5). When the in-vehicle device 30 receives data indicating that the turn signal has been flashed, the image processing unit 355 makes a positive determination in step SD5.

[0111] If the image processing unit 355 determines that the turn signal is not being operated (step SD5: NO), it starts adding the second time information J3 (step SD6). This allows the viewer terminal 200B to display the second time period along with the image captured by the broadcaster terminal 200A before vehicle 3 begins to turn.

[0112] The image processing unit 355 determines whether or not the vehicle 3 has started to turn (step SD7). In more detail, step SD7 is determined by the image processing unit 355 based on the detection value of the yaw rate sensor of the sensor group 39.

[0113] If the image processing unit 355 determines that the vehicle 3 has not yet started to turn (step SD7: NO), it performs the determination in step SD7 again.

[0114] On the other hand, if the image processing unit 355 determines that the vehicle 3 has started to turn (step SD7: YES), it stops adding the second time information J3 and starts adding the first time information J1 and the turning information J2 (step SD8). As a result, the viewer terminal 200B can display the image obtained from the broadcaster terminal 200A, along with the fact that it is the first hour and that vehicle 3 is in the middle of turning.

[0115] Next, the image processing unit 355 determines whether or not the vehicle 3 has finished turning (step SD9). In more detail, step SD9 is determined to be true based on the detection value of the yaw rate sensor of the sensor group 39.

[0116] If the image processing unit 355 determines that the vehicle 3 has not finished turning (step SD9: NO), it performs the determination in step SD9 again.

[0117] On the other hand, if the image processing unit 355 determines that the vehicle 3 has finished turning (step SD9: YES), it terminates the addition of the first time information J1 and the turning information J2 (step SD10).

[0118] Returning to the explanation of step SD5, if the image processing unit 355 determines that the turn signal has been operated (step SD5: YES), it starts adding the second time information J3 and the arrow image YG (step SD11). As a result, the viewer terminal 200B can display the second time and the fact that the turn signal was operated, along with the image obtained from the broadcaster terminal 200A's photography, before vehicle 3 begins to turn.

[0119] The image processing unit 355 determines whether or not the vehicle 3 has started to turn (step SD12). The determination in step SD12 is performed in the same manner as the determination in step SD7.

[0120] If the image processing unit 355 determines that vehicle 3 has not yet started turning (step SD12: NO), it performs the determination in step SD12 again. On the other hand, if the image processing unit 355 determines that vehicle 3 has started turning (step SD12: YES), it stops adding the second time information J3 and starts adding the first time information J1 and the turning information J2 (step SD13). As a result, the viewer terminal 200B can display, along with the image captured by the broadcaster terminal 200A, that vehicle 3 is in the process of turning at the first hour, and that the turn signal has been activated.

[0121] Next, the image processing unit 355 determines whether or not the vehicle 3 has finished turning (step SD14). The determination in step SD14 is performed in the same way as the determination in step SD9.

[0122] If the image processing unit 355 determines that the vehicle 3 has not finished turning (step SD14: NO), it performs the determination in step SD14 again.

[0123] On the other hand, if the image processing unit 355 determines that the vehicle 3 has finished turning (step SD14: YES), it terminates the addition of the first time information J1, the turning information J2, and the arrow image YG (step SD15).

[0124] Next, we will explain the operation of the viewer terminal 200B while the content being distributed is being output. Figure 13 is a flowchart showing the operation of viewer terminal 200B. The operation shown in Figure 13 is performed repeatedly while the viewer terminal 200B is outputting the content being streamed.

[0125] The third control unit 270 determines whether the vehicle 3 is curved or not in the image displayed on the display 240 (step SE1). In step SE1, the third control unit 270 may determine whether the vehicle 3 is curved or not by performing image analysis (for example, analysis by optical flow) on the image displayed on the display 240. Alternatively, in step SE1, the third control unit 270 may determine whether the vehicle 3 is curved or not based on whether the display 240 is displaying first time information J1. Alternatively, in step SE1, the third control unit 270 may determine whether the vehicle 3 is curved or not based on whether the display 240 is displaying intermediate curve information J2. Alternatively, in step SE1, the third control unit 270 may determine whether the vehicle 3 is curved or not based on the yaw rate of the vehicle 3. In a configuration where the vehicle 3 is curved or not based on the yaw rate, the vehicle 3 transmits the detected value of the yaw rate sensor to the viewer terminal 200B via the distribution server 100, and the viewer terminal 200B determines whether the vehicle 3 is curved or not based on the detected value of the yaw rate sensor received.

[0126] If the third control unit 270 determines that the vehicle 3 is not turning (step SE1: NO), it performs the determination in step SE1 again.

[0127] If the third control unit 270 determines that the vehicle 3 is turning (step SE1: YES), it determines, based on the detection value of the motion sensor 230, whether the orientation of the viewer terminal 200B is opposite to the direction in which the vehicle 3 is turning in the displayed image (step SE2). In step SE2, the third control unit 270 detects the direction in which the vehicle 3 is turning by performing image analysis on the image displayed on the display 240, and determines whether the orientation of the viewer terminal 200B is opposite. For example, if the image displayed on the display 240 shows the vehicle 3 turning to the right and the viewer terminal 200B is facing left, the third control unit 270 makes a positive determination in step SE2. Alternatively, for example, if the image displayed on the display 240 shows the vehicle 3 turning to the left and the viewer terminal 200B is facing left, the third control unit 270 makes a negative determination in step SE2.

[0128] The third control unit 270 terminates this process if it determines that the orientation of the viewer terminal 200B is not opposite to the direction in which the vehicle 3 is turning (step SE2: NO).

[0129] On the other hand, if the third control unit 270 determines that the orientation of the viewer terminal 200B is opposite to the direction in which the vehicle 3 is turning (step SE2: YES), it issues a notification prompting the viewer to look in the direction in which the vehicle 3 is turning (step SE3). The notification for step SE3 may be given via display 240 or via speaker 260.

[0130] In the flowchart shown in Figure 13, the process ends when a negative result is obtained in step SE2 or when a notification is issued in step SE3. However, if a negative result is obtained in step SE2 or a notification is issued in step SE3, the third control unit 270 may determine whether or not the vehicle 3 has finished turning. If it determines that the vehicle 3 has finished turning, the process ends. If it determines that the vehicle 3 has not finished turning, the process may start again from step SE1. In this case, the third control unit 270 may determine whether the vehicle 3 has finished turning by performing image analysis (for example, analysis by optical flow) on the image displayed on the display 240. Alternatively, the third control unit 270 may determine whether the vehicle 3 has finished turning by whether the display 240 is displaying the first time information J1. Alternatively, the third control unit 270 may determine whether the vehicle 3 has finished turning by whether the display 240 is displaying the turning information J2. Alternatively, the third control unit 270 may determine whether the vehicle 3 has finished turning based on the yaw rate of the vehicle 3. Alternatively, the third control unit 270 may determine that the vehicle 3 has finished turning if the vehicle 3 has been moving straight for a certain period of time (for example, about 0.5 to 5 seconds) based on image analysis or the yaw rate of the vehicle 3.

[0131] [2. Second Embodiment] Next, a second embodiment will be described. In the description of the second embodiment, components that are the same as those in the distribution system 1 of the first embodiment are denoted by the same reference numerals, and detailed descriptions are omitted as appropriate. The following will mainly describe the differences from the first embodiment.

[0132] In the second embodiment, the operation of the image processing unit 355 differs from that of the first embodiment. In the second embodiment, the image processing unit 355 generates a first composite image CP1 by blacking out the area A1 outside the vehicle of the image acquired from the correction unit 354 while the vehicle 3 is turning. The external area A1 is the area that shows the outside of vehicle 3, for example, the windshield area in Figure 6.

[0133] Figure 14 is a diagram illustrating the operation of the image processing unit 355 in the second embodiment. Figure 14 illustrates the case where the external area A1 of image P3 is blacked out. Image P3 shown in Figure 14 is an image taken from the passenger seat of vehicle 3, and shows the front of vehicle 3 through the windshield.

[0134] The top of Figure 14 shows the image output by the image processing unit 355 to the distribution unit 356 when vehicle 3 begins to turn. The middle section of Figure 14 shows the image output by the image processing unit 355 to the distribution unit 356 while vehicle 3 is turning. The bottom section of Figure 14 shows the image output by the image processing unit 355 to the distribution unit 356 when vehicle 3 has finished turning. Note that the dashed line indicating the external area A1 and the leader line of the external area A1 are not included in the image output by the image processing unit 355 to the distribution unit 356.

[0135] When the vehicle 3 begins to turn, the image processing unit 355 blacks out the area A1 outside the vehicle in image P3, as shown in the upper and middle sections of Figure 14. Alternatively, the image processing unit 355 may black out the area A1 outside the vehicle in a fade-out manner.

[0136] When the vehicle 3 finishes turning, the image processing unit 355 stops the blackout of the external region A1 of image P3, as shown in the middle to lower section of Figure 14. Alternatively, the image processing unit 355 may stop the blackout of the external region A1 in a fade-in manner.

[0137] Thus, in the second embodiment, the visibility of areas with large changes in the delivered image is reduced while the vehicle is turning, thereby further suppressing motion sickness in viewers of the image.

[0138] [3. Other Embodiments] The embodiments described above are merely examples and can be modified and applied as needed.

[0139] In the embodiment described above, the operation of the turn signal is indicated by an arrow image YG. In other embodiments, the operation of the turn signal may be indicated by a method other than the arrow image YG. For example, in other embodiments, the operation of the turn signal may be indicated by a string of characters such as "Turn signal activated".

[0140] In the second embodiment described above, the external area A1 is blacked out. In other embodiments, the brightness of the external area A1 may be lowered compared to when the vehicle 3 is not turning. More specifically, in other embodiments, the brightness of the external area A1 may be lowered compared to when the first time information J1 is not added. In this case as well, the same effect as in the second embodiment is achieved.

[0141] In other embodiments relating to the second embodiment described above, the configuration may be such that the turning information J2 and the arrow image YG are not displayed.

[0142] In the embodiment described above, the addition of the first time information J1 begins when the vehicle 3 starts to turn. However, the timing at which the addition of the first time information J1 begins is not limited to when the vehicle 3 starts to turn, but may start before the vehicle 3 starts to turn.

[0143] In the above-described embodiment, the in-vehicle device 30 is configured to add first time information J1, turning information J2, second time information J3, and arrow image YG to the distributed image. In another embodiment, the distribution server 100 may be configured to add the first time information J1, turning information J2, second time information J3, and arrow image YG. In this configuration, the distribution server 100 receives information necessary for adding the information, such as the current position of the vehicle 3 and the detected values ​​of the sensor group 39, from the in-vehicle device 30. In this configuration, the second processor 150 functions as the first estimation unit 351, the second estimation unit 352, and the image processing unit 355, and the distribution server 100 adds various information to the image distributed from the in-vehicle device 30 and distributes it to the viewer terminal 200B. In yet another embodiment, the distribution server 100 may black out the area outside the vehicle A1. In another embodiment, the second processor 150 may function as a determination unit 353 and a correction unit 354.

[0144] Furthermore, in the above-described embodiment, the in-vehicle device 30 is configured to add first time information J1, turning information J2, second time information J3, and arrow image YG to the distributed image. In another embodiment, the viewer terminal 200B may be configured to add the first time information J1, turning information J2, second time information J3, and arrow image YG. In this configuration, the viewer terminal 200B receives information necessary for adding information, such as the current position of the vehicle 3 and the detected values ​​of the sensor group 39, from the in-vehicle device 30 via the distribution server 100. In this configuration, the third processor 290 functions as the first estimation unit 351, the second estimation unit 352, and the image processing unit 355, and the viewer terminal 200B adds various information to the image distributed from the in-vehicle device 30 and outputs content. In yet another embodiment, the viewer terminal 200B may black out the area outside the vehicle A1. In another embodiment, the third processor 290 may function as a determination unit 353 and a correction unit 354.

[0145] In the above-described embodiment, the distribution unit 356 of the in-vehicle device 30 uploads content data to the distribution server 100 via the external communication I / F 31. In other embodiments, the distribution terminal 200A may upload content data to the distribution server 100. More specifically, in this case, the distribution terminal 200A uploads content data, including images captured by the camera provided by the distribution terminal 200A and audio input by the microphone provided by the distribution terminal 200A, to the distribution server 100.

[0146] Furthermore, the configurations of the parts of the distribution system 1 shown in Figures 4 and 10 are merely examples, and the specific implementation is not particularly limited. In other words, it is not necessarily required that hardware corresponding to each part be implemented individually; it is certainly possible to configure the system so that a single processor executes a program to realize the functions of each part. Also, some of the functions realized by software in the above-described embodiment may be implemented as hardware, or some of the functions realized by hardware may be implemented as software.

[0147] Furthermore, the operation step units shown in Figures 11, 12, and 13 are divided according to the main processing content, and the present invention is not limited by the way the processing units are divided or by their names. Depending on the processing content, it may be further divided into more step units. Also, it may be divided so that one step unit includes even more processing. In addition, the order of the steps may be changed as appropriate, as long as it does not impede the spirit of the present invention.

[0148] [4. Configurations supported by the above embodiments] The above embodiment supports the following configuration:

[0149] (Composition 1) A distribution system comprising: a distribution unit that distributes images obtained by taking photographs with a camera installed on a vehicle; a display device installed outside the vehicle that displays the images distributed by the distribution unit; and a first estimation unit that estimates the first time from when the vehicle starts turning until it finishes turning, based on information about the vehicle's surroundings, wherein the display device displays the first time estimated by the first estimation unit together with the images distributed by the distribution unit.

[0150] According to the distribution system of Configuration 1, viewers of the image can understand how long it will take for the vehicle to complete the turn. Therefore, when the vehicle is turning, viewers can take appropriate measures such as not looking at the image. Thus, motion sickness in viewers can be suppressed.

[0151] (Configuration 2) The distribution system according to configuration 1, wherein the display device displays a message indicating that the turn signal of the vehicle has been operated when the turn signal of the vehicle has been operated.

[0152] According to the distribution system of Configuration 2, a message indicating that the turn signal has been activated is displayed, allowing viewers to understand that the vehicle is about to turn. Therefore, viewers can easily take measures such as not looking at the image when the vehicle is turning. Thus, motion sickness among viewers can be further suppressed.

[0153] (Composition 3) The distribution system according to configuration 1 or 2, wherein the display device indicates that the vehicle is in the process of turning while the vehicle is turning.

[0154] According to the distribution system of Configuration 3, a message indicating that the vehicle is turning is displayed, allowing viewers to easily understand why the image they are viewing is changing so rapidly. Furthermore, because viewers understand that the image is changing rapidly because the vehicle is turning, it is possible to prevent situations where viewers stop watching due to the rapid changes in the image.

[0155] (Composition 4) A distribution system according to any one of configurations 1 to 3, comprising a second estimation unit that estimates the second time until the vehicle begins to turn based on map information of the area surrounding the vehicle or images obtained from an external camera installed on the vehicle that takes pictures of the area outside the vehicle, and the display device displays the second time estimated by the second estimation unit before the vehicle begins to turn.

[0156] According to the distribution system of Configuration 4, viewers of the image can easily grasp the timing when the vehicle begins to turn. Therefore, when the vehicle is turning, viewers can easily take measures such as not watching the distributed image. Thus, motion sickness in viewers can be further suppressed.

[0157] (Composition 5) The distribution system according to any one of configurations 1 to 4, wherein the imaging device is installed inside the vehicle, the image includes an external region showing the outside of the vehicle, and the display device displays the image in which the brightness of the external region is reduced or the external region is blacked out while the vehicle is turning.

[0158] According to the distribution system of Configuration 5, while the vehicle is turning, the visibility of areas with large changes in the distributed image is reduced, thereby further suppressing motion sickness in viewers of the image.

[0159] (Composition 6) The distribution system according to any one of configurations 1 to 5, wherein the display device is a head-mounted display device, and when the orientation of the display device changes to the opposite direction to the direction in which the vehicle is turning in the image, the display device outputs a notification prompting the user to look in the direction in which the vehicle is turning in the image.

[0160] According to the distribution system of configuration 6, even when viewers view images using a head-mounted display device, motion sickness caused by the images can be suppressed.

[0161] (Composition 7) A distribution system according to any one of configurations 1 to 6, comprising: a determination unit that determines whether or not there are irregularities on the road surface of the road on which the vehicle is traveling; and a correction unit that corrects the blur of the image when the determination unit determines that there are irregularities, wherein the distribution unit distributes the image corrected by the correction unit.

[0162] According to the distribution system of Configuration 7, since images with blur correction are distributed, motion sickness in viewers can be further suppressed.

[0163] (Composition 8) A program that causes the processor of a display device to display an image obtained by taking a photograph with a camera installed on the vehicle, and, together with the image, displays the first hour, estimated based on information about the vehicle's surroundings, from when the vehicle starts turning until it finishes turning.

[0164] According to the program in Configuration 8, it will have the same effect as the distribution system in Configuration 1.

[0165] (Composition 9) A distribution method comprising: a distribution step of distributing an image obtained by taking a photograph with a camera installed on a vehicle; a display step of displaying the image distributed in the distribution step using a display device; and an estimation step of estimating a first time from when the vehicle starts turning until it finishes turning, based on information about the vehicle's surroundings, wherein the display step displays the first time estimated in the estimation step together with the image distributed in the distribution step.

[0166] The distribution method of Configuration 9 produces the same effect as the distribution system of Configuration 1. [Explanation of symbols]

[0167] 1…Distribution system, 5…Communication network, 10…Seat, 11…Seat back, 12…Headrest, 13…Headrest stay, 30…In-vehicle device, 31…External communication I / F, 32…First short-range wireless communication I / F, 33…In-vehicle communication I / F, 34…Touch panel, 35…Audio processing unit, 36…Speaker, 37…External camera, 38…Turn signal switch, 39…Sensor group, 40…Vehicle ECU, 50…Attachment, 51…First fixing device, 100…Distribution server, 110…Network communication I / F, 130…Second control unit, 140…Second memory, 141…Control program, 143…User information database, 145…Distribution management database, 150…Second processor, 200A…Distributor terminal (camera), 200B…Viewer terminal (display device), 210…Wireless communication I / F, 220…Second short-range wireless communication I / F F, 230…Motion sensor, 230…Camera, 240…Display, 250…Microphone, 260…Speaker, 270…Third control unit, 280…Third memory, 281…OS, 283…APP (program), 290…Third processor (processor), 310…Input / Output I / F, 330…First control unit, 340…First memory, 345…Control program, 346…Map data, 350…First processor, 351...First estimation unit, 352...Second estimation unit, 353...Determination unit, 354...Correction unit, 355...Image processing unit, 356...Distribution unit, A1...External area, CP1...First composite image, CP2...Second composite image, J1...First time information, J2...In-turn information, J3...Second time information, P1~P3...Image, S...Distributor, SA3...Distribution step, SC3...Display step, SD2...Estimation step, U...Viewer, YG...Arrow image.

Claims

1. A distribution unit that distributes images obtained by taking pictures with a camera installed on the vehicle, A display device provided in a vehicle other than the aforementioned vehicle, which displays the image distributed by the distribution unit, A first estimation unit estimates the first time from when the vehicle starts turning until it finishes turning, based on information about the vehicle's surroundings. The system includes a second estimation unit that estimates a second time until the vehicle begins to turn, based on map information of the area surrounding the vehicle, or images obtained from an external camera installed on the vehicle that takes pictures of the area outside the vehicle. The aforementioned display device is The image distributed by the distribution unit is displayed, Before the vehicle begins to turn, the second time estimated by the second estimation unit is displayed along with the image. When the vehicle begins to turn, the display of the second time is stopped, and the first time estimated by the first estimation unit is displayed along with the image. The display of the first hour stops when the vehicle has finished turning. Distribution system.

2. The aforementioned display device is When the turn signal of the aforementioned vehicle is operated, a message indicating that the turn signal has been operated is displayed. The distribution system according to claim 1.

3. The aforementioned display device is While the vehicle is turning, a sign indicating that the vehicle is in the process of turning will be displayed. The distribution system according to claim 1 or 2.

4. The aforementioned photographic device is installed inside the vehicle. The aforementioned image includes an external area showing the outside of the vehicle, The display device displays, while the vehicle is turning, an image in which the brightness of the area outside the vehicle is lower than when the vehicle is not turning, or an image in which the area outside the vehicle is blacked out. The distribution system according to claim 1 or 2.

5. A distribution unit that distributes images obtained by taking images with a camera installed on a vehicle, A display device provided in a vehicle other than the aforementioned vehicle, which displays the image distributed by the distribution unit, The system includes a first estimation unit that estimates the first time from when the vehicle starts turning until it finishes turning, based on information about the vehicle's surroundings. The aforementioned display device is a head-mounted display device, The display device outputs a notification prompting the viewer wearing the display device to look in the direction the vehicle is turning if the viewer's face is facing in the opposite direction to the direction the vehicle is turning in the image. Distribution system.

6. A determination unit that determines whether or not there are irregularities on the road surface of the road on which the vehicle is traveling, The system includes a correction unit that corrects the blur of the image when the determination unit determines that there are irregularities, The distribution unit distributes the image corrected by the correction unit. The distribution system according to claim 1 or 2.

7. The processor of the display device, The image obtained by the camera installed on the vehicle is displayed. Based on map information of the area surrounding the vehicle or images obtained from an external camera installed on the vehicle that captures images of the area outside the vehicle, the estimated second time until the vehicle begins to turn is displayed along with the image before the vehicle begins to turn. When the vehicle begins to turn, the display of the second time is stopped, and the first time, estimated based on the information surrounding the vehicle, from when the vehicle begins to turn until it finishes turning, is displayed along with the image. The display of the first hour is stopped when the vehicle has finished turning. program.

8. The processor of a display device which is a head-mounted display device, The image obtained by the camera installed on the vehicle is displayed. Along with the aforementioned image, the first hour, estimated based on information surrounding the vehicle, from the time the vehicle begins to turn until it finishes turning, is displayed. If the viewer wearing the display device is facing in the opposite direction to the direction the vehicle is turning in the image, a notification prompting the viewer to look in the direction the vehicle is turning will be output. program.

9. A distribution step involves distributing images obtained by taking pictures with a camera installed on the vehicle, A display step in which a display device displays the image distributed in the distribution step, A first estimation step involves estimating the first time from when the vehicle starts turning until it finishes turning, based on information about the vehicle's surroundings. The second estimation step includes estimating a second time until the vehicle begins to turn, based on map information of the area surrounding the vehicle, or images obtained from an external camera installed on the vehicle that takes pictures of the area outside the vehicle. The aforementioned display step is, The image distributed in the aforementioned distribution step is displayed, Before the vehicle begins to turn, the second time estimated in the second estimation step is displayed along with the image. When the vehicle begins to turn, the display of the second time is stopped, and the first time estimated in the first estimation step is displayed along with the image. The display of the first hour stops when the vehicle has finished turning. Distribution method.

10. A distribution step of distributing an image obtained by taking a photograph with a camera installed on a vehicle, A display step in which a display device displays the image distributed in the distribution step, The estimation step includes estimating a first time from when the vehicle starts turning until it finishes turning, based on information about the vehicle's surroundings. The aforementioned display device is a head-mounted display device, The aforementioned display step is, Along with the image distributed in the distribution step, the first time estimated in the estimation step is displayed. If the viewer wearing the display device is facing in the opposite direction to the direction the vehicle is turning in the image, the device outputs a notification prompting the viewer to look in the direction the vehicle is turning. Distribution method.

Images