Distribution system, computer program product and distribution method

Abstract

The present application provides a distribution system, a computer program product, and a distribution method, which can suppress the image viewer (U) from having a visual vertigo. The distribution system (1) includes: a distribution unit (356) that distributes an image obtained by photographing by a photographing device (200A) provided in a vehicle (3); a display device (200A) that is provided outside the vehicle and displays the image distributed by the distribution unit; and a first estimation unit (351) that estimates a first time from when the vehicle starts a turn to when the turn ends based on information about the surroundings of the vehicle, and the display device displays the first time estimated by the first estimation unit together with the image distributed by the distribution unit.

Description

Technical Field

[0001] This invention relates to distribution systems, computer program products, and distribution methods. Background Technology

[0002] In recent years, initiatives to provide sustainable transportation systems that take into account the use of vulnerable groups among traffic participants, such as the elderly, disabled, and children, have become increasingly active. To realize these initiatives, research and development efforts are focused on further improving the safety and convenience of transportation through the development of mobility means for vulnerable traffic users. The use of transportation systems by vulnerable groups includes not only riding in the vehicle themselves, but also methods for viewing dynamic images distributed by image distributors (e.g., see Patent Document 1).

[0003] Patent Document 1 discloses a method for processing images captured by a camera mounted on a vehicle to generate a composite image, and then sending the generated composite image to a remote terminal. Furthermore, Patent Document 1 discloses a method for suppressing viewer dizziness by comparing the generated composite image with the focused image displayed in the focused area, and setting the focused image displayed in the tracking focus area to be an image with a smaller number of shots taken per predetermined time interval.

[0004] [Existing Technical Documents]

[0005] [Patent Literature]

[0006] Patent Document 1: Japanese Patent Application Publication No. 2024-064361 Summary of the Invention

[0007] [The problem the invention aims to solve]

[0008] However, in the structure of Patent Document 1, when the vehicle is turning, the amount of change in the focused image displayed in the focus area may increase. Therefore, even if the number of shots displayed in the focus area and the tracking focus area is changed, the viewer of the image may experience image dizziness.

[0009] The present invention was made in view of the above circumstances, and its purpose is to suppress image vertigo in viewers. Furthermore, by connecting remote locations and vehicles, it helps to support good connectivity between urban areas and local regions, represented by urban peripheries, and contributes to the development of sustainable transportation systems.

[0010] [Methods used to solve problems]

[0011] One aspect of the present invention is a distribution system comprising: a distribution unit that distributes images captured by a camera mounted on a vehicle; a display device disposed at a location outside the vehicle that displays the images distributed by the distribution unit; and a first estimation unit that estimates a first time from the start of a turn to the end of the turn based on information about the vehicle's surroundings, wherein the display device displays the first time estimated by the first estimation unit together with the images distributed by the distribution unit.

[0012] [Invention Effects]

[0013] According to one aspect of the present invention, it is possible to suppress visual vertigo in viewers of images. Attached Figure Description

[0014] Figure 1 This is a diagram showing the system architecture of the distribution system.

[0015] Figure 2 This is a diagram showing an example of a distributor terminal installed in a vehicle.

[0016] Figure 3 This is a diagram showing an example of a distributor terminal installed in a vehicle.

[0017] Figure 4 This is a diagram showing the structure of the vehicle and the distribution server.

[0018] Figure 5 This is a diagram showing the functional units of the first processor.

[0019] Figure 6 This is a diagram showing an example of the first synthesized image.

[0020] Figure 7 This is a diagram illustrating an example of a second synthesized image.

[0021] Figure 8 This is a diagram showing the structure of the user information database.

[0022] Figure 9 This is a diagram showing the structure of the distribution management database.

[0023] Figure 10 This is a block diagram showing the structure of the viewer terminal.

[0024] Figure 11 This is a flowchart illustrating the actions of the vehicle-mounted device, distribution server, and viewer terminal; Figure 12 This is a flowchart illustrating the operation of the vehicle-mounted device.

[0025] Figure 13 This is a flowchart illustrating the actions of the viewer's terminal.

[0026] Figure 14 This is a diagram used to illustrate the processing of the image processing unit. Detailed Implementation

[0027] [1. First Implementation Method]

[0028] [1-1. Structure of the Distribution System]

[0029] Figure 1 This is a diagram showing the system architecture of distribution system 1.

[0030] The distribution system 1 includes a vehicle 3, a distributor terminal 200A, a distribution server 100, and a viewer terminal 200B. It is a system for live streaming content containing images captured by the distributor terminal 200A.

[0031] Live streaming refers to the real-time distribution of images captured by the distributor terminal 200A to the viewer terminal 200B. The images can be still images or moving images.

[0032] Distributor terminal 200A is an example of a "shooting device". Viewer terminal 200B is an example of a "display device".

[0033] Vehicle 3 is equipped with an on-board unit 30. The on-board unit 30 is wirelessly connected to a distributor terminal 200A held by a distributor S, who is an occupant of vehicle 3, via near-field communication or the like. The on-board unit 30 receives images captured by a camera mounted on the distributor terminal 200A. The on-board unit 30 uploads content data containing the received images to the distribution server 100. The content data may include sound collected inside the vehicle compartment or sound from outside the vehicle.

[0034] The distributor terminal 200A can be a smartphone or tablet PC (Personal Computer), or a digital camera or a camera capable of capturing the entire surroundings in 360 degrees.

[0035] The distributor terminal 200A is installed inside vehicle 3.

[0036] Figure 2 and Figure 3 This is a diagram showing an installation example of the distributor terminal 200A installed in vehicle 3.

[0037] Figure 2 and Figure 3 An example is shown where the distributor terminal 200A is installed in the passenger seat 10 of the vehicle 3.

[0038] The distributor terminal 200A is installed on the seat 10 via the mounting accessory 50. The mounting accessory 50 is installed on the headrest support 13 that secures the headrest 12 of the seat 10, which serves as the front passenger seat, to the seat back 11.

[0039] Figure 2 An example is shown where the distributor terminal 200A is mounted on the passenger seat 10, with the front of the vehicle 3 visible from the distributor terminal 200A's perspective. This mounting position of the distributor terminal 200A is referred to as the first position. Figure 3 This illustration shows an example where the distributor terminal 200A is installed on the passenger seat 10, which is the front passenger seat, from the perspective of the distributor terminal 200A, including the distributor S sitting in the driver's seat. This installation position of the distributor terminal 200A is referred to as the second position.

[0040] A first fastener 51 is provided at one end of the mounting accessory 50 to secure the distributor terminal 200A to the mounting accessory 50, and a second fastener is provided at the other end of the mounting accessory 50 to secure the mounting accessory 50 to the headrest support 13. The second fastener is omitted from the illustration. After changing the mounting direction of the mounting accessory 50 to the headrest support 13, the mounting accessory 50 is secured to the headrest support 13 by the second fastener, thereby allowing the distributor terminal 200A to be mounted in either a first or second position on the passenger seat 10.

[0041] return Figure 1 As explained, the distribution server 100 distributes the content distributed from vehicle 3 to the viewer terminal 200B of viewer U. This distribution can be implemented using known technologies such as HLS (HTTP Live Streaming), CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), and RTMP (Real-Time Messaging Protocol).

[0042] Viewer terminal 200B is a display device held by viewer U who is watching content distributed from distribution server 100. Figure 1 In the diagram, N audience members U are represented as U1, U2, ..., UN. N is any natural number.

[0043] The viewer terminal 200B can be a portable or mobile terminal device such as a smartphone, tablet, or laptop, or a fixed terminal device such as a desktop computer. Alternatively, the viewer terminal 200B can be a television receiver or a head-mounted display device in which an image display unit is worn on the viewer's head and a display screen of that unit is positioned in front of the viewer's eyes. The head-mounted display device can be either transmissive or non-transmissive, as long as it can be capable of viewing and listening to content distributed from the distribution server 100. In this embodiment, a non-transmissive head-mounted display device is described as an example.

[0044] Viewer terminal 200B is equipped with display 240 (see reference) Figure 10 The display 240 shows the image distributed from the distribution server 100, and the speaker 260 outputs the sound distributed from the distribution server 100.

[0045] Communication network 5 is a wired or wireless transmission path for information sent from devices connected to communication network 5. For example, communication network 5 may also include public networks such as the Internet, mobile communication networks, and satellite communication networks, as well as various LANs (Local Area Networks) and WANs (Wide Area Networks) including Ethernet. Additionally, communication network 5 may also include private networks such as IP-VPN (Internet Protocol-Virtual Private Network).

[0046] [1-2. Vehicle Structure]

[0047] Figure 4 A diagram illustrating the structure of vehicle 3 and distribution server 100.

[0048] First, refer to Figure 4 The structure of vehicle 3 will be explained.

[0049] Vehicle 3 is equipped with an on-board unit 30, an external communication interface 31, a first short-range wireless communication interface 32, an internal communication interface 33, a touch panel 34, a sound processing unit 35, a speaker 36, an external camera 37, a turn signal switch 38, and a sensor group 39.

[0050] First, the following components will be described: external communication interface 31, first short-range wireless communication interface 32, internal communication interface 33, touch panel 34, sound processing unit 35, speaker 36, external camera 37, turn signal switch 38, and sensor group 39.

[0051] The external communication interface 31 is a communication module that performs wireless communication according to mobile communication standards such as LTE (Long Term Evolution), 4G (Generation), 5G, and Wi-Fi. The external communication interface 31 is connected to the communication network 5 via an antenna (not shown) and exchanges data with the distribution server 100. Furthermore, the external communication interface 31 may be, for example, a TCU (Telematics Control Unit).

[0052] The first near-field wireless communication interface 32 is, for example, a communication device that performs wireless communication according to near-field wireless communication standards such as Bluetooth (registered trademark) and Wi-Fi. The first near-field wireless communication interface 32 is, for example, a communication module that communicates according to NFC (Nearfield communication) communication standards such as Bluetooth and Wi-Fi. The first near-field wireless communication interface 32 performs near-field wireless communication with a terminal device held by the occupant, and receives images and sounds captured by the terminal device.

[0053] The in-vehicle communication interface 33 is an input / output interface connected to an in-vehicle network (not shown). The in-vehicle network may use a communication bus corresponding to communication standards such as CAN (Controller Area Network), CAN-FD (CAN with Flexible Data Rate), or Ethernet. The in-vehicle communication interface 33 communicates with vehicle ECU 40, other relay devices, and other in-vehicle equipment via the in-vehicle network.

[0054] The touch panel 34 includes a display panel such as a liquid crystal panel or an organic EL (Electro-Luminescence) panel, and a touch sensor. The touch sensor detects the touch operation of the viewer U on the touch panel 34 and outputs position information indicating the location of the detected touch operation to the first control unit 330.

[0055] The sound processing unit 35, for example, converts the digital sound data output by the first control unit 330 into an analog sound signal. The sound processing unit 35 amplifies the converted analog sound signal and outputs the amplified sound signal through the speaker 36.

[0056] An exterior camera 37 is positioned at the front of the vehicle 3 to capture images of the area in front of the vehicle 3. The field of view of the exterior camera 37 includes the road surface on which the vehicle 3 travels. The exterior camera 37 captures images at predetermined intervals and outputs the data from the captured images to the onboard device 30.

[0057] The turn signal switch 38 is a switch that indicates the flashing and extinguishing of the turn indicator installed on the vehicle 3. When the driver performs an operation to flash the turn indicator, the turn signal switch 38 instructs the turn indicator to flash and outputs data indicating that the turn indicator is flashing to the on-board unit 30. Conversely, when the driver performs an operation to extinguish the turn indicator, the turn signal switch 38 instructs the turn indicator to extinguish and outputs data indicating that the turn indicator is extinguished to the on-board unit 30.

[0058] The sensor group 39 is equipped with various sensors. In this embodiment, the sensor group 39 includes an acceleration sensor, a vehicle speed sensor, a GNSS (Global Navigation Satellite System) unit, and a steering angle sensor.

[0059] The accelerometer is a sensor that detects the acceleration of vehicle 3. The accelerometer detects the acceleration of vehicle 3 at a predetermined period, and outputs the detected value to the on-board unit 30 each time the acceleration of vehicle 3 is detected.

[0060] The vehicle speed sensor is a sensor that detects the speed of vehicle 3. The vehicle speed sensor detects the speed of vehicle 3 at a predetermined period, and outputs the detected value to the on-board unit 30 each time the speed of vehicle 3 is detected.

[0061] The GNSS unit locates the current position of vehicle 3. The GNSS unit generates position data representing the current position of vehicle 3 and outputs the generated position data to the on-board device 30.

[0062] The yaw rate sensor is a sensor that detects the yaw angle of vehicle 3. The yaw rate sensor detects the yaw angle at a specified period and outputs the detected value to the on-board unit 30.

[0063] The vehicle-mounted device 30 includes an input / output interface 310 and a first control unit 330.

[0064] The input / output interface 310 functions as a connection point between the external communication interface 31, the first short-range wireless communication interface 32, the in-vehicle communication interface 33, the touch panel 34, the sound processing unit 35, the external camera 37, the turn signal switch 38, and the sensor group 39, and the first control unit 330. The input / output interface 310 includes connectors and interface circuitry, and outputs data input from the external communication interface 31, the first short-range wireless communication interface 32, the in-vehicle communication interface 33, the touch panel 34, the sound processing unit 35, the external camera, the turn signal switch 38, and the sensor group 39 to the first control unit 330. Furthermore, the input / output interface 310 outputs data input from the first control unit 330 to the external communication interface 31, the first short-range wireless communication interface 32, the in-vehicle communication interface 33, the touch panel 34, and the sound processing unit 35.

[0065] The first control unit 330 is a computer device having a first memory 340 and a first processor 350.

[0066] The first memory 340 may be composed of, for example, volatile semiconductor memory and non-volatile semiconductor memory. The first memory 340 may also consist only of non-volatile semiconductor memory. Alternatively, the first memory 340 may have an auxiliary storage device such as an SSD (Solid State Drive). The first memory 340 stores control programs 345 executed by the first processor 350, map data 346, setting data specifying the operation of the vehicle-mounted device 30, etc.

[0067] Map data 346 stores road map information, building information, and other data. Road map information consists of a road network represented by lines on the map, including information related to road segments obtained by dividing the map into multiple parts as nodes such as intersections and branch points, and defining the parts between each node as road segments. Building information shows the location of buildings, the name of buildings, and the shape of buildings when viewed from above.

[0068] The first processor 350 is, for example, a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit) or other computing device. The first processor 350 may consist of a single processor or multiple processors. Alternatively, the first processor 350 may also consist of a System-on-a-Chip (SoC) that integrates part or all of the first memory 340 with other circuitry.

[0069] Figure 5 This is a diagram showing the functional units of the first processor 350.

[0070] The first processor 350 functions as a first estimation unit 351, a second estimation unit 352, a determination unit 353, a correction unit 354, an image processing unit 355, and a distribution unit 356 by reading and executing the control program 345 stored in the first memory 340.

[0071] [1-2-1. First Estimation Section]

[0072] The first estimation unit 351 estimates the time from when the vehicle 3 begins to turn until the turn ends (hereinafter referred to as "first time") based on information about the surroundings of the vehicle 3.

[0073] The first estimation unit 351 estimates a first time when the on-board unit 30 receives data from the turn signal switch 38 to flash the direction indicator, i.e., when the direction indicator is activated. As an example of estimating the first time in this situation, consider the case where vehicle 3 is turning at an intersection. The first estimation unit 351 estimates the first time by adding time to a predetermined reference time (e.g., 5 seconds, 6 seconds) based on the number of other vehicles and pedestrians around vehicle 3.

[0074] The first estimation unit 351 performs pattern matching or other methods on images captured by the external camera 37, or performs vehicle-to-vehicle communication, thereby obtaining the number of other vehicles present around the vehicle 3 as information about the vehicle 3's surroundings. Furthermore, the first estimation unit 351 performs pattern matching or other methods on images captured by the external camera 37 to obtain the number of pedestrians present around the vehicle 3 as information about the vehicle 3's surroundings. Additionally, the first estimation unit 351 can also obtain the number of pedestrians through road-to-road communication.

[0075] When the first estimation unit 351 obtains the number of other vehicles and the number of pedestrians, it calculates the summation time by adding it to a reference time using a predetermined algorithm. Then, the first estimation unit 351 estimates a first time by adding the summation time to the reference time. Furthermore, the predetermined algorithm is one in which the more other vehicles and pedestrians there are, the greater the summation time will be.

[0076] The first estimation unit 351 estimates a first time when the vehicle 3 is at a predetermined distance from the predetermined curve it is to enter. The first estimation unit 351 obtains map information about the surrounding area of ​​the vehicle 3 based on map data 346 and the current position of the vehicle 3 located by the GNSS unit. Then, the first estimation unit 351 determines, with reference to the obtained map information, whether the vehicle 3 is at a predetermined distance from the predetermined curve it is to enter. This determination is based on the road segment constituting the curve (the road segment in the road segment constituting the curve that the vehicle 3 is initially scheduled to enter) and the current position of the vehicle 3. When it is determined that the vehicle 3 is at a predetermined distance from the predetermined curve it is to enter, the first estimation unit 351 estimates a first time. The first estimation unit 351 calculates the length of the predetermined curve based on the number of road segments constituting the curve and the length of each road segment. Next, the first estimation unit 351 calculates the speed of the vehicle 3 when turning the curve by subtracting a predetermined speed from the vehicle speed detected by the vehicle speed sensor. Furthermore, the first estimation unit 351 estimates the first time by multiplying the calculated length of the curve by the speed of the vehicle 3 when turning the curve.

[0077] When estimating the first time, the first estimation unit 351 outputs the estimated first time to the image processing unit 355.

[0078] [1-2-2. Second Estimation Section]

[0079] The second estimation unit 352 estimates the time until vehicle 3 begins to turn (hereinafter referred to as "second time").

[0080] The second estimation unit 352 estimates a second time when it receives data from the turn signal switch 38 indicating that the vehicle-mounted device 30 has flashed the direction indicator, i.e., when the direction indicator is activated. In this case, the estimation of the second time assumes that the vehicle 3 is about to turn at an intersection. The second estimation unit 352 obtains map information about the surroundings of the vehicle 3 based on the map data 346 and the current position of the vehicle 3 located by the GNSS unit. Then, the second estimation unit 352 calculates the distance between the current position of the vehicle 3 and the intersection with reference to the obtained map information. This calculation is based on the node corresponding to the intersection and the current position of the vehicle 3. Next, the second estimation unit 352 estimates the second time by dividing the calculated distance between the vehicle 3 and the intersection by the vehicle speed detected by the vehicle speed sensor of the sensor group 39.

[0081] Furthermore, the method for estimating the second time by the second estimation unit 352 is not limited to this method. The second estimation unit 352 may also calculate the distance between the vehicle 3 and the intersection based on the size of the object presented in the image captured by the external camera 37, and estimate the second time based on the calculated distance and the speed of the vehicle 3. For example, the second estimation unit 352 calculates the distance between the vehicle 3 and the intersection by comparing the size of the traffic signal presented in the image captured by the external camera 37 with a threshold.

[0082] The second estimation unit 352 estimates a second time when the vehicle 3 is at a predetermined distance from the predetermined curve it is to enter. Similar to the first estimation unit 351, the second estimation unit 352 determines whether the vehicle 3 is at a predetermined distance from the predetermined curve it is to enter. If it is determined that the vehicle 3 is at a predetermined distance from the predetermined curve it is to enter, the second estimation unit 352 estimates a second time. The second estimation unit 352 calculates the distance between the predetermined curve and the vehicle 3 based on the road segment constituting the predetermined curve (the road segment in the road segment constituting the curve that the vehicle 3 is initially scheduled to enter) and the current position of the vehicle 3. Then, the second estimation unit 352 estimates the second time by dividing the calculated distance by the vehicle speed detected by the vehicle speed sensor of the sensor group 39.

[0083] After estimating the second time, the second estimation unit 352 outputs the estimated second time to the image processing unit 355.

[0084] [1-2-3. Judgment Section]

[0085] The determination unit 353 determines whether there are uneven surfaces on the road surface where vehicle 3 is traveling.

[0086] The determination unit 353 detects road surface irregularities based on images captured by the external camera 37, using image processing such as pattern matching, and determines whether the number of irregularities exceeding a predetermined depth or height is greater than a predetermined number. If the determination unit 353 determines that the number of irregularities exceeding the predetermined depth or height is greater than a predetermined number, it determines that the road surface on which the vehicle 3 is traveling has irregularities; if the determination unit 353 determines that the number of irregularities exceeding the predetermined depth or height is less than a predetermined number, it determines that the road surface on which the vehicle 3 is traveling does not have irregularities. Furthermore, road surface irregularities include gravel, depressions, debris, ruts, etc.

[0087] The determination unit 353 outputs the determination result to the correction unit 354.

[0088] [1-2-4. Correction Department]

[0089] The correction unit 354 acquires the image captured by the transmitter terminal 200A via the first near-field wireless communication interface 32. Furthermore, if the determination result obtained from the determination unit 353 indicates that the road surface has unevenness, the correction unit 354 corrects the jitter in the image acquired from the transmitter terminal 200A. On the other hand, if the determination result obtained from the determination unit 353 indicates that the road surface has no unevenness, the correction unit 354 does not correct the jitter in the image acquired from the transmitter terminal 200A and outputs the image acquired from the transmitter terminal 200A to the image processing unit 355.

[0090] The correction unit 354 corrects the jitter in the image acquired from the distributor terminal 200A using a conventional electronic shake correction method. This electronic shake correction method corrects image deviation by comparing a certain image with an image acquired after that image and using pixel offset. After correcting the jitter in the image acquired from the distributor terminal 200A, the correction unit 354 outputs the corrected image to the image processing unit 355.

[0091] [1-2-5. Image Processing Department]

[0092] The image processing unit 355 adds various information to the image acquired from the correction unit 354. Furthermore, if the correction unit 354 has corrected image jitter, the image processing unit 355 adds various information to the jitter-corrected image; if the correction unit 354 has not corrected image jitter, the image processing unit 355 adds various information to the image that has not been corrected by the correction unit 354.

[0093] [1-2-5-1. First-hand supplement]

[0094] Upon obtaining a first time from the first estimation unit 351, the image processing unit 355 adds first time information J1 and turning information J2 to the image obtained from the correction unit 354, generating a first composite image CP1. Furthermore, the first time information J1 includes information about the first time. The turning information J2 indicates that the vehicle 3 is turning.

[0095] Figure 6 This is a diagram showing an example of the first composite image CP1.

[0096] exist Figure 6 The example illustrates the case where first time information J1 is added to image P1. Figure 6 The image P1 shown is taken from the passenger seat of vehicle 3, and is an image of the front of vehicle 3 taken through the windshield.

[0097] exist Figure 6 In the middle, the first information J1 is the string "Time until the end of the turn: approximately 5 seconds". Figure 6 The first time information J1 indicates a time of "5 seconds". Furthermore, the location of the additional first time information J1 is not limited to... Figure 6 The location. However, from a visibility point of view, it is preferable that the first-time information J1 is in the area outside the windshield in the area presented in the image as an additional object.

[0098] In addition, Figure 6 In the text, the information J2 during the turn is the string "turning". Furthermore, the location of the appended information J2 during the turn is not limited to... Figure 6 The location. However, from a visibility point of view, the information J2 during the turn is preferably in the area outside the windshield in the area presented in the image as an additional object.

[0099] When the direction indicator is activated, the image processing unit 355 generates a first composite image CP1 that further indicates the direction indicator has been activated. Figure 6 The example illustrates the case where an arrow image YG is attached to image P1 as a direction indicator, signifying that the image has been manipulated. The direction indicated by the arrow image YG corresponds to the manipulated direction indicator.

[0100] When the image processing unit 355 obtains the first time from the first estimation unit 351, it adds first time information J1 and turning information J2 to the image obtained from the correction unit 354 until the vehicle 3 finishes turning. Additionally, when the direction indicator is activated, the image processing unit 355 adds an arrow image YG to the image obtained from the correction unit 354 until the vehicle-mounted device 30 receives data to turn off the direction indicator.

[0101] If the image processing unit 355 generates a first composite image CP1, it outputs the first composite image CP1 to the distribution unit 356.

[0102] [1-2-5-2. Additional information on the second time]

[0103] Upon obtaining the second time from the second estimation unit 352, the image processing unit 355 adds second time information J3 to the image obtained from the correction unit 354 to generate a second composite image CP2. Furthermore, the second time information J3 includes information containing the second time.

[0104] Figure 7 This is a diagram showing an example of the second composite image CP2.

[0105] exist Figure 7 The example shown illustrates the case where a second time information J3 is added to image P2. Figure 7Image P2 shown is a picture taken from the passenger seat of vehicle 3, and is a picture of the front of vehicle 3 taken through the windshield.

[0106] exist Figure 7 In the middle, the second time information J3 is the string "Time until the start of the turn: approximately 10 seconds". Figure 7 The second time information J3 indicates a second time of "10 seconds". Furthermore, the location of the additional second time information J3 is not limited to... Figure 7 The location. However, from a visibility point of view, it is preferable that the second time information J3 is the area outside the windshield in the area presented in the image as an additional object.

[0107] When the direction indicator is activated, the image processing unit 355 generates a second composite image CP2 that further indicates the direction indicator has been activated. Figure 7 The example illustrates the case where an arrow image YG is attached to image P2 as a direction indicator, signifying that the image has been manipulated. The direction indicated by the arrow image YG corresponds to the manipulated direction indicator.

[0108] When the image processing unit 355 obtains the second time from the second estimation unit 352, it adds second time information J3 to the image obtained from the correction unit 354 until the vehicle 3 finishes turning. Additionally, when the direction indicator is activated, the image processing unit 355 adds an arrow image YG to the image obtained from the correction unit 354 until the vehicle-mounted device 30 receives data to turn off the direction indicator.

[0109] If the image processing unit 355 generates a second composite image CP2, it outputs the second composite image CP2 to the distribution unit 356.

[0110] Without attaching the first time information J1, the second time information J3, and the arrow image YG, the image processing unit 355 outputs the image obtained from the correction unit 354 to the distribution unit 356 without performing any processing on the image obtained from the correction unit 354.

[0111] [1-2-6. Distribution Department]

[0112] The distribution unit 356 distributes the image obtained from the image processing unit 355 to the viewer terminal 200B via the external communication interface 31. More specifically, the distribution unit 356 uploads the content containing the image obtained from the image processing unit 355 along with the distribution ID (identifier) ​​to the distribution server 100 via the external communication interface 31.

[0113] [1-3. Structure of the distribution server]

[0114] Next, we will refer to Figure 4Describe the structure of distribution server 100.

[0115] The distribution server 100 includes a network communication interface 110 and a second control unit 130.

[0116] The network communication interface 110 is equipped with a communication card such as a NIC (Network Interface Card), and communicates with the vehicle 3 and the audience terminal 200B via the communication network 5.

[0117] The second control unit 130 is a computer device equipped with a second memory 140 and a second processor 150.

[0118] The second memory 140 may be configured as either a volatile semiconductor memory or a non-volatile semiconductor memory. Alternatively, the second memory 140 may only have a non-volatile semiconductor memory. Furthermore, the second memory 140 may also have a structure that includes auxiliary storage devices such as HDDs (Hard Disk Drives) or SSDs.

[0119] The second memory 140 stores the control program 141, the user information database 143, and the distribution management database 145 executed by the second processor 150.

[0120] Figure 8 This is a diagram showing the structure of the user information database 143.

[0121] A record in the user information database 143 includes the user ID, APP_ID, device information, and user information. APP is an abbreviation for application.

[0122] The user ID is identification information used to identify users who use the distribution service provided by the distribution server 100. Users include distributors S and viewers U.

[0123] APP_ID is identification information that identifies the application downloaded to the distributor terminal 200A or the viewer terminal 200B.

[0124] Distributor S and audience U download the APP from the designated website and install it on distributor terminal 200A and audience terminal 200B respectively.

[0125] The device information refers to information about the viewer terminal 200B. This device information includes, for example, information indicating whether the viewer terminal 200B is a smartphone, PC, head-mounted display device, or camera, such as its model number. Furthermore, the device information includes communication information used to communicate with the viewer terminal 200B. Address information is listed as an example of this communication information.

[0126] User information refers to the personal information of the distributor S and the audience U, such as name, address, gender, age, etc.

[0127] Figure 9 This is a diagram showing the structure of the distribution management database 145.

[0128] A record in the distribution management database 145 contains the distribution ID that identifies the distribution, the user ID of the distributor S, the user ID of the audience U, and the date and time the distribution started.

[0129] return Figure 4 Next, we will explain the structure of the distribution server 100.

[0130] The second processor 150 is, for example, a CPU, MPU, or other computing device. The second processor 150 can be composed of a single processor or multiple processors. Alternatively, the second processor 150 can also be composed of a System-on-a-Chip (SoC) that integrates part or all of the second memory 140 with other circuitry.

[0131] The second control unit 130 reads and executes the control program 141 through the second processor 150 to perform various actions.

[0132] [1-4. Structure of the viewer terminal]

[0133] Figure 10 This is a block diagram showing the structure of the viewer terminal 200B.

[0134] The audience terminal 200B includes a wireless communication interface 210, a second near-field wireless communication interface 220, a motion sensor 230, a display 240, a microphone 250, a speaker 260, and a third control unit 270.

[0135] The wireless communication interface 210 is a communication module that performs wireless communication according to mobile communication standards such as LTE, 4G, 5G, and Wi-Fi. The wireless communication interface 210 is connected to the communication network 5 via an antenna (not shown) and exchanges data with the distribution server 100.

[0136] The second near-field wireless communication interface 220 is, for example, a communication module that communicates according to NFC communication standards such as Bluetooth and Wi-Fi. The second near-field wireless communication interface 220 can transmit the sound input from the microphone 250 to the vehicle-mounted device 30 via the distribution server 100 through near-field wireless communication with the vehicle-mounted device 30.

[0137] The motion sensor 230 is a nine-axis sensor that detects acceleration (three-axis), angular velocity (three-axis), and geomagnetism (three-axis). When worn on the head of the spectator U, the motion sensor 230 detects the movement of the spectator U's head. The motion sensor 230 performs detection at predetermined intervals and outputs the detected values ​​to the third control unit 270.

[0138] Microphone 250 is a sound input device for inputting the sound of the transmitter S or the audience U, and speaker 260 is a sound output device for outputting the sound of the transmitter S or the audience U.

[0139] The display 240 includes a display panel such as a liquid crystal panel or an organic EL panel, and a touch sensor. The display 240 functions as a display unit for displaying images and a receiving unit for receiving operations from the distributor S and the viewer U.

[0140] The third control unit 270 is a computer device equipped with a third memory 280 and a third processor 290.

[0141] The third processor 290 is an example of a "processor".

[0142] The third memory 280 is a non-volatile semiconductor memory. Alternatively, the third memory 280 may also have an auxiliary storage device such as an SD card. The third memory 280 stores control programs such as the OS (operating system) 281 and APP 283. APP 283 is an application that communicates with the distribution server 100 to display images contained in the content distributed by the distribution server 100 on the display 240 and outputs sound contained in the content to the speaker 260.

[0143] APP 283 is an example of a "program".

[0144] The third processor 290 is, for example, a CPU, MPU, or other computing device. The third processor 290 can consist of a single processor or multiple processors.

[0145] When the third processor 290 reads and executes APP 283, the third control unit 270 communicates with the distribution server 100 via the wireless communication interface 210.

[0146] The third control unit 270 reads and executes APP 283 through the third processor 290, causing the display 240 to display images contained in the content distributed by the distribution server 100.

[0147] In addition, the third control unit 270 reads and executes APP 283 through the third processor 290, causing the speaker 260 to output the sound contained in the content distributed by the distribution server 100.

[0148] Furthermore, the third control unit 270 reads and executes APP 283 via the third processor 290, and detects the orientation of the audience terminal 200B worn by the audience member U based on the detection value of the motion sensor 230. The orientation of the audience terminal 200B corresponds to the orientation of the face of the audience member U relative to the wearing audience member U, and is the orientation in the left-right direction relative to the wearing audience member U.

[0149] [1-5. Actions]

[0150] Next, the operation of each part of the distribution system 1 according to this embodiment will be explained.

[0151] First, the actions of each part of the distribution system 1 involved in the content distribution will be explained.

[0152] Figure 11 This is a flowchart illustrating the operation of the vehicle-mounted device 30, the distribution server 100, and the viewer terminal 200B. Figure 11 In the flowchart, FA shows the operation of the vehicle-mounted device 30, FB shows the operation of the distribution server 100, and FC shows the operation of the viewer terminal 200B.

[0153] As shown in flowchart FA, the distribution unit 356 determines whether to start the distribution of content (step SA1).

[0154] For example, if the touch panel 34 receives a distribution start instruction, the distribution unit 356 makes an affirmative determination in step SA1.

[0155] Furthermore, for example, when the vehicle-mounted device 30 receives distribution start information from the distributor terminal 200A, the distribution unit 356 makes a positive determination in step SA1. Additionally, the distribution start information indicates that distribution has begun.

[0156] If the distribution unit 356 determines that the distribution of content has begun (step SA1: Yes), it begins the distribution of content (step SA2). When the distribution of content begins, the distribution unit 356 uploads the content data to the distribution server 100 at a predetermined period (step SA3).

[0157] Step SA3 is an example of a "distribution step".

[0158] As shown in flowchart FB, the second control unit 130 of the distribution server 100 receives content data from the vehicle-mounted device 30 (step SB1).

[0159] Next, the second control unit 130 of the distribution server 100 sends the received content data to the viewer terminal 200B (step SB2).

[0160] Step SB2 is described in detail. The second control unit 130 determines from the distribution management database 145 a record containing a distribution ID received along with the content data, and obtains the user ID of the viewer U from the determined record. Next, the second control unit 130 obtains device information for each obtained user ID of the viewer U. Then, the second control unit 130 transmits the received content data based on communication information included in the obtained device information.

[0161] As shown in flowchart FC, the third control unit 270 of the viewer terminal 200B receives content data from the distribution server 100 (step SC1).

[0162] Next, the third control unit 270 displays the image contained in the content represented by the received content data on the display 240, and outputs the sound contained in the content represented by the received content data through the speaker 260 (step SC2).

[0163] Step SC2 is an example of "Show Steps".

[0164] Returning to the description of flowchart FA, the distribution unit 356 determines whether to end the content distribution (step SA4).

[0165] For example, if the touch panel 34 receives a dispensing end instruction, the dispensing unit 356 makes a positive determination in step SA4.

[0166] Furthermore, for example, if the vehicle-mounted device 30 receives distribution completion information from the distributor terminal 200A, the distribution unit 356 makes a positive determination in step SA4. Additionally, the distribution completion information indicates that the distribution has ended.

[0167] If the distribution unit 356 determines that the content distribution should not be terminated (step SA4: No), it returns the process to step SA3 and performs the processing after step SA3 again. Alternatively, the distribution unit 356 continues distributing content until a positive result is determined in step SA4.

[0168] On the other hand, if the distribution unit 356 determines that the distribution of content has ended (step SA4: Yes), it ends the distribution of content (step SA5).

[0169] As described above, the image transmitted to the viewer terminal 200B, i.e. the image captured by the distributor terminal 200A, is supplemented with various information by the image processing unit 355.

[0170] Next, the operation of the vehicle-mounted device 30 will be explained.

[0171] Figure 12 This is a flowchart illustrating the operation of the vehicle-mounted device 30.

[0172] The first estimation unit 351 determines whether to estimate the first time (step SD1).

[0173] Step SD1 is described in detail.

[0174] Upon receiving data from the vehicle-mounted device 30 causing the direction indicator to flash, the first estimation unit 351 makes a positive determination in step SD1.

[0175] Furthermore, if vehicle 3 is within a predetermined distance of the curve to be entered, the first estimation unit 351 makes a positive determination in step SD1.

[0176] If the first estimation unit 351 determines that it does not estimate the first time (step SD1: no), it performs the determination of step SD1 again.

[0177] On the other hand, if the first estimation unit 351 determines that it is to estimate the first time (step SD1: yes), it estimates the first time (step SD2).

[0178] Step SD2 is an example of an "estimation step".

[0179] The second estimation unit 352 determines whether to estimate the second time (step SD3). The determination in step SD3 is performed in parallel with the determination in step SD1.

[0180] Step SD3 will be described in detail.

[0181] Upon receiving data from the vehicle-mounted device 30 causing the direction indicator to flash, the second estimation unit 352 makes a positive determination in step SD3.

[0182] Furthermore, if vehicle 3 is within a predetermined distance of the curve to be entered, the second estimation unit 352 makes a positive determination in step SD3.

[0183] If the second estimation unit 352 determines that it does not estimate the second time (step SD3: no), it performs the determination in step SD3 again.

[0184] On the other hand, the second estimation unit 352 estimates the second time when it is determined that it is to estimate the second time (step SD3: yes) (step SD4).

[0185] Next, the image processing unit 355 determines whether the direction indicator has been operated (step SD5).

[0186] Upon receiving data from the vehicle-mounted device 30 causing the direction indicator to flash, the image processing unit 355 makes a positive determination in step SD5.

[0187] If the image processing unit 355 determines that the direction indicator is not operated (step SD5: No), it begins to add the second time information J3 (step SD6).

[0188] Accordingly, the audience terminal 200B can display the second time image along with the image captured by the distributor terminal 200A before the vehicle 3 begins to turn.

[0189] The image processing unit 355 determines whether the vehicle 3 has started to turn (step SD7). Step SD7 is described in detail. The image processing unit 355 makes the determination in step SD7 based on the detection value of the yaw rate sensor of the sensor group 39.

[0190] If the image processing unit 355 determines that the vehicle 3 has not started turning (step SD7: No), it performs step SD7 again.

[0191] On the other hand, when the image processing unit 355 determines that the vehicle 3 has started to turn (step SD7: Yes), it stops the addition of the second time information J3 and starts the addition of the first time information J1 and the turning information J2 (step SD8).

[0192] Accordingly, the viewer terminal 200B can display the first moment and the meaning that vehicle 3 is turning, together with the image captured by the distributor terminal 200A.

[0193] Next, the image processing unit 355 determines whether the vehicle 3 has finished turning (step SD9). Step SD9 is described in detail. The image processing unit 355 makes an affirmative determination in step SD9 based on the detection value of the yaw rate sensor of the sensor group 39.

[0194] If the image processing unit 355 determines that the vehicle 3 has not finished turning (step SD9: No), it performs step SD9 again.

[0195] On the other hand, when the image processing unit 355 determines that the vehicle 3 has finished turning (step SD9: Yes), it ends the addition of the first time information J1 and the turning information J2 (step SD10).

[0196] Returning to the explanation of step SD5, if the image processing unit 355 determines that the direction indicator has been operated (step SD5: Yes), it starts adding the second time information J3 and the arrow image YG (step SD11).

[0197] Accordingly, the spectator terminal 200B can display information about the second time and direction indicator being operated, along with the image obtained by the distributor terminal 200A, before the vehicle 3 begins to turn.

[0198] The image processing unit 355 determines whether the vehicle 3 has started turning (step SD12). The determination in step SD12 is performed in the same way as the determination in step SD7.

[0199] If the image processing unit 355 determines that the vehicle 3 has not started turning (step SD12: No), it performs step SD12 again. On the other hand, if the image processing unit 355 determines that the vehicle 3 has started turning (step SD12: Yes), it stops adding the second time information J3 and starts adding the first time information J1 and the turning information J2 (step SD13).

[0200] Accordingly, the viewer terminal 200B can display information such as the first moment, when the vehicle 3 is turning, and when the direction indicator is operated, while displaying the image obtained by the distributor terminal 200A.

[0201] Next, the image processing unit 355 determines whether the vehicle 3 has finished turning (step SD14). The determination in step SD14 is performed in the same way as the determination in step SD9.

[0202] If the image processing unit 355 determines that the vehicle 3 has not finished turning (step SD14: No), it performs the determination in step SD14 again.

[0203] On the other hand, when the image processing unit 355 determines that the vehicle 3 has finished turning (step SD14: Yes), it ends the addition of the first time information J1, the turning information J2 and the arrow image YG (step SD15).

[0204] Next, the actions of the audience terminal 200B in the content output will be explained.

[0205] Figure 13 This is a flowchart illustrating the actions of the viewer terminal 200B.

[0206] Figure 13 The actions shown are those that are repeatedly performed during the output and distribution of content from the viewer terminal 200B.

[0207] The third control unit 270 determines whether the vehicle 3 is turning in the image displayed on the display 240 (step SE1). In step SE1, the third control unit 270 may also determine whether the vehicle 3 is turning by performing image analysis (e.g., optical flow-based analysis) on the image presented on the display 240. Additionally, in step SE1, the third control unit 270 may also determine whether the display 240 is currently displaying first time information J1. Furthermore, in step SE1, the third control unit 270 may also determine whether the display 240 is currently displaying turning information J2. Additionally, in step SE1, the third control unit 270 may also determine whether the vehicle 3 is turning based on the yaw rate of the vehicle 3. Furthermore, in the structure where the vehicle 3 is turning based on the yaw rate, the vehicle 3 sends the detection value of the yaw rate sensor to the viewer terminal 200B via the distribution server 100, and the viewer terminal 200B determines whether the vehicle 3 is turning based on the received detection value of the yaw rate sensor.

[0208] If the third control unit 270 determines that the vehicle 3 has not turned (step SE1: no), it will perform step SE1 again.

[0209] When the third control unit 270 determines that vehicle 3 is turning (step SE1: Yes), based on the detection value of motion sensor 230, it determines whether the orientation of the viewer terminal 200B is opposite to the direction in which vehicle 3 is turning in the currently displayed image (step SE2). In step SE2, the third control unit 270 performs image analysis on the image displayed on display 240 to detect the direction of vehicle 3 turning and determines whether the orientation of viewer terminal 200B is opposite. For example, if vehicle 3 is turning right in the image displayed on display 240 and viewer terminal 200B is turning left, the third control unit 270 makes a positive determination in step SE2. Furthermore, for example, if vehicle 3 is turning left in the image displayed on display 240 and viewer terminal 200B is turning left, the third control unit 270 makes a negative determination in step SE2.

[0210] If the third control unit 270 determines that the orientation of the spectator terminal 200B is not opposite to the turning direction of the vehicle 3 (step SE2: No), the process ends.

[0211] On the other hand, if the third control unit 270 determines that the orientation of the viewer terminal 200B is opposite to the turning direction of the vehicle 3 (step SE2: Yes), it will issue a notification urging the viewer to watch the turning direction of the vehicle 3 (step SE3).

[0212] The notification for step SE3 can be made via the display 240 or via the speaker 260.

[0213] In addition, Figure 13 In the flowchart shown, the process ends when a negative determination is made in step SE2 or when a notification for step SE3 is received. However, it can also be configured such that, when a negative determination is made in step SE2 or when a notification for step SE3 is received, the third control unit 270 determines whether the vehicle 3 has finished turning. If it determines that the vehicle 3 has finished turning, the process ends; if it determines that the vehicle 3 has not finished turning, the process starts again from step SE1.

[0214] In this case, the third control unit 270 can also determine whether the vehicle 3 has finished turning by performing image analysis (e.g., optical flow-based analysis) on the image presented on the display 240. The third control unit 270 can also determine whether the vehicle 3 has finished turning based on whether the display 240 shows the first time information J1. Additionally, the third control unit 270 can determine whether the vehicle 3 has finished turning based on whether the display 240 shows the turning information J2. Furthermore, the third control unit 270 can also determine whether the vehicle 3 has finished turning based on the yaw rate of the vehicle 3. Additionally, the third control unit 270 can determine that the vehicle 3 has finished turning based on image analysis and the yaw rate of the vehicle 3, provided that the vehicle 3 has traveled straight for a certain period (e.g., approximately 0.5 to 5 seconds).

[0215] [2. Second Implementation]

[0216] Next, the second embodiment will be described.

[0217] In the description of the second embodiment, the same reference numerals are used for the constituent elements that are the same as those of the distribution system 1 of the first embodiment, and detailed descriptions are omitted as appropriate.

[0218] The following mainly describes the differences from the first embodiment.

[0219] The second embodiment differs from the first embodiment in that the image processing unit 355 operates differently.

[0220] In the second embodiment, the image processing unit 355 generates a first composite image CP1 that blackens the exterior region A1 of the image obtained from the correction unit 354 during the turning of the vehicle 3.

[0221] The exterior area A1 is the area that presents the exterior of vehicle 3, for example... Figure 6 The front windshield section.

[0222] Figure 14 This is a diagram illustrating the operation of the image processing unit 355 in the second embodiment.

[0223] exist Figure 14 The example shown illustrates how the area A1 outside the vehicle in image P3 is made black. Figure 14 The image P3 shown is taken from the passenger seat of vehicle 3, and is an image of the front of vehicle 3 taken through the windshield.

[0224] Figure 14 The upper section shows the image output by the image processing unit 355 to the distribution unit 356 when vehicle 3 begins to turn. Additionally, Figure 14 The middle section shows the image output from the image processing unit 355 to the distribution unit 356 during the turning of vehicle 3. Additionally, Figure 14 The lower section shows the image output by the image processing unit 355 to the distribution unit 356 when the vehicle 3 finishes turning. Furthermore, the dashed line representing the external region A1 and the lead-out line of the external region A1 are not included in the image output by the image processing unit 355 to the distribution unit 356.

[0225] When the vehicle 3 begins to turn, the image processing unit 355, such as Figure 14 As shown in the upper to middle section, the exterior area A1 of image P3 is made black. Alternatively, the image processing unit 355 can also make the exterior area A1 black in a fade-out manner.

[0226] When vehicle 3 finishes turning, the image processing unit 355, such as Figure 14 As shown in the middle to lower section, the darkening of the exterior area A1 of image P3 is stopped. Alternatively, the image processing unit 355 can also stop the darkening of the exterior area A1 by fading in.

[0227] Thus, in the second embodiment, during the turning of vehicle 3, the visibility of areas with large changes in the distributed image is reduced, thereby further suppressing image dizziness in the viewer.

[0228] [3. Other Implementation Methods]

[0229] The above-described implementation method is merely one approach and can be arbitrarily modified and applied.

[0230] In the above embodiment, the arrow image YG indicates that the direction indicator has been operated. In other embodiments, the meaning of the direction indicator being operated may be displayed in a manner other than the arrow image YG. For example, in other embodiments, the meaning of the direction indicator being operated may be displayed using a string such as "turn signal activated".

[0231] In the second embodiment described above, the structure darkens the exterior area A1. In other embodiments, the brightness of the exterior area A1 may be reduced compared to when the vehicle 3 is not turning. More specifically, in other embodiments, the brightness of the exterior area A1 may be reduced compared to the case where the first time information J1 is not attached. In this case, the same effect as the second embodiment is achieved.

[0232] In other embodiments related to the second embodiment described above, the structure may also not display the information J2 and the arrow image YG during the turn.

[0233] In the above embodiment, the addition of the first time information J1 is configured to begin when the vehicle 3 begins to turn, but the timing of the addition of the first time information J1 is not limited to when the vehicle 3 begins to turn, and may also begin before the vehicle 3 begins to turn.

[0234] In the above-described embodiment, the vehicle-mounted device 30 is configured to add first time information J1, turning information J2, second time information J3, and an arrow image YG to the distributed image. In another embodiment, the distribution server 100 may be configured to add the first time information J1, turning information J2, second time information J3, and arrow image YG. In this configuration, the distribution server 100 receives additional information from the vehicle-mounted device 30, such as the current position of the vehicle 3 and the detection values ​​of the sensor group 39. In this configuration, the second processor 150 functions as a first estimation unit 351, a second estimation unit 352, and an image processing unit 355. The distribution server 100 adds various information to the image distributed from the vehicle-mounted device 30 and distributes it to the viewer terminal 200B. Additionally, in this other embodiment, the distribution server 100 may also darken the exterior area A1. Furthermore, in this other embodiment, the second processor 150 may function as a determination unit 353 and a correction unit 354.

[0235] In addition, in the above-described embodiment, the vehicle-mounted device 30 is configured to add first time information J1, turning information J2, second time information J3, and an arrow image YG to the distributed image. In other embodiments, the viewer terminal 200B may also be configured to add first time information J1, turning information J2, second time information J3, and an arrow image YG. In this configuration, the viewer terminal 200B receives additional necessary information such as the current position of the vehicle 3 and the detection values ​​of the sensor group 39 from the vehicle-mounted device 30 via the distribution server 100. In this configuration, the third processor 290 functions as the first estimation unit 351, the second estimation unit 352, and the image processing unit 355, and the viewer terminal 200B adds various information to the image distributed from the vehicle-mounted device 30 and outputs the content. Furthermore, in this other embodiment, the viewer terminal 200B may also darken the exterior area A1. In addition, in this other embodiment, the third processor 290 may also function as the determination unit 353 and the correction unit 354.

[0236] In the above embodiment, the distribution unit 356 of the vehicle-mounted device 30 uploads content data to the distribution server 100 via the external communication interface 31. In other embodiments, the distributor terminal 200A may also upload content data to the distribution server 100. More specifically, in this case, the distributor terminal 200A uploads content data to the distribution server 100, including images captured by a camera equipped on the distributor terminal 200A or sound input through a microphone equipped on the distributor terminal 200A.

[0237] in addition, Figure 4 as well as Figure 10 The structure of each part of the distribution system 1 shown is an example, and the specific installation method is not particularly limited. That is, it is not necessarily necessary to install hardware corresponding to each part separately; of course, it can also be configured so that the functions of each part are implemented by a processor executing a program. In addition, in the above embodiment, a part of the function implemented by software can be made into hardware, or a part of the function implemented by hardware can be implemented by software.

[0238] in addition, Figure 11 , Figure 12 as well as Figure 13 The steps shown are divided according to the main processing content, and the present invention is not limited to the method or name of the division of processing units. Depending on the processing content, it may also be divided into more step units. Alternatively, a single step unit may contain more processes. Furthermore, the order of these steps may be appropriately replaced without affecting the spirit of the present invention.

[0239] [4. Structure supported by the above embodiments]

[0240] The above implementation supports the following structures.

[0241] (Structure 1)

[0242] A distribution system comprising: a distribution unit that distributes images captured by a camera mounted on a vehicle; a display unit disposed outside the vehicle that displays the images distributed by the distribution unit; and a first estimation unit that estimates a first time from the start of a turn to the end of the turn based on information about the vehicle's surroundings, wherein the display unit displays the first time estimated by the first estimation unit together with the images distributed by the distribution unit.

[0243] According to the distribution system of Structure 1, viewers of the images can determine how long it will take for the vehicle to finish turning. Therefore, when the vehicle is turning, viewers can appropriately take countermeasures such as not watching the images. Thus, it is possible to suppress image dizziness in viewers.

[0244] (Structure 2)

[0245] According to the distribution system of Structure 1, the display device displays the meaning that the direction indicator of the vehicle has been operated when the direction indicator of the vehicle has been operated.

[0246] According to the distribution system of Structure 2, since the direction indicator is activated, viewers of the image can understand the upcoming vehicle turn. Therefore, when the vehicle turns, viewers can easily take measures such as not looking at the image. Thus, it is possible to further suppress image dizziness in viewers.

[0247] (Structure 3)

[0248] According to the distribution system of Structure 1 or Structure 2, the display device displays the meaning that the vehicle is turning during the turning process.

[0249] According to the distribution system of Structure 3, the system displays the meaning that the vehicle is turning, so viewers can easily understand the reason for the large changes in the image they are watching. Furthermore, since viewers can understand that the large changes in the image are caused by the vehicle turning, it can prevent viewers from stopping watching due to large image changes.

[0250] (Structure 4)

[0251] According to any one of structures 1 to 3, the distribution system includes a second estimation unit that estimates a second time up to the time the vehicle begins to turn based on map information around the vehicle or images obtained by an external camera installed on the vehicle and capturing images outside the vehicle, and the display device displays the second time estimated by the second estimation unit before the vehicle begins to turn.

[0252] According to the distribution system of Structure 4, viewers of the images can easily grasp the timing when the vehicle begins to turn. Therefore, when the vehicle is turning, viewers of the images can easily take countermeasures such as not watching the distributed images. Thus, it is possible to further suppress image dizziness in viewers of the images.

[0253] (Structure 5)

[0254] According to any one of structures 1 to 4, the distribution system wherein the capturing device is disposed inside the vehicle, the image includes an exterior area of ​​the vehicle, and the display device displays the image during the vehicle turning, which is either a reduced brightness of the exterior area compared to when the vehicle is not turning, or an image in which the exterior area is blacked out.

[0255] According to the distribution system of structure 5, during the vehicle's turning, the visibility of areas with large changes in the distributed image is reduced, thus further suppressing image dizziness in the viewer.

[0256] (Structure 6)

[0257] According to a distribution system of any one of structures 1 to 5, wherein the display device is a head-mounted display device, the display device outputs a notification urging observation of the direction in which the vehicle is turning when the display device is facing a direction opposite to the direction in which the vehicle is turning in the image.

[0258] According to the distribution system of structure 6, even when viewers are viewing images in a head-mounted display device, it is possible to suppress image vertigo in viewers.

[0259] (Structure 7)

[0260] According to any one of structures 1 to 6, the distribution system comprises: a determination unit that determines whether there is unevenness on the road surface of the road on which the vehicle is traveling; and a correction unit that corrects the jitter of the image when the determination unit determines that unevenness exists, and the distribution unit distributes the image corrected by the correction unit.

[0261] According to the distribution system of Structure 7, the jittered image is distributed, thus further suppressing image vertigo in the viewer.

[0262] (Structure 8)

[0263] A computer program product includes a program that causes a processor of a display device to perform the following processing: displaying an image obtained by a camera device located on a vehicle, and displaying a first time point estimated based on information about the vehicle's surroundings, from the start of the turn to the end of the turn, together with the image.

[0264] The computer program product based on Structure 8 has the same effect as the distribution system based on Structure 1.

[0265] (Structure 9)

[0266] A distribution method includes: a distribution step of distributing an image captured by a camera mounted on a vehicle; a display step of displaying the image distributed in the distribution step; and an estimation step of estimating a first time from the start of a turn to the end of the turn based on information about the vehicle's surroundings, wherein the first time estimated in the estimation step is displayed together with the image distributed in the distribution step in the display step.

[0267] The distribution method of Structure 9 achieves the same effect as the distribution system of Structure 1.

[0268] Explanation of reference numerals in the attached figures

[0269] 1…Distribution system, 5…Communication network, 10…Seat, 11…Seat backrest, 12…Headrest, 13…Headrest support, 30…Vehicle-mounted device, 31…External communication interface, 32…First short-range wireless communication interface, 33…In-vehicle communication interface, 34…Touch panel, 35…Sound processing unit, 36…Speaker, 37…External camera, 38…Turn signal switch, 39…Sensor group, 40…Vehicle ECU, 50…Mounting accessories, 51…First fastener, 100…Distribution server, 110…Network communication interface, 130…Second control unit, 140…Second memory, 141…Control program, 143…User information database, 145…Distribution management database, 150…Second processor, 200A…Distributor terminal (shooting device), 200B…Viewer terminal (display device), 210…Wireless communication interface, 220…Second short-range wireless communication interface, 230…Transportation… Motion sensor, 240…display, 250…microphone, 260…speaker, 270…third control unit, 280…third memory, 281…OS, 283…APP (program), 290…third processor (processor), 310…input / output interface, 330…first control unit, 340…first memory, 345…control program, 346…map data, 350…first processor, 351…first estimation unit, 352…second estimation unit, 353…determination unit, 354…correction unit, 355…image processing unit, 356…distribution unit, A1…exterior area, CP1…first composite image, CP2…second composite image, J1…first time information, J2…information during turning, J3…second time information, P1~P3…images, S:distributor, SA3:distribution step, SC3:display step, SD2:estimation step, U:viewer, YG:arrow image.

Claims

1. A distribution system, the distribution system comprising: The distribution unit distributes images obtained by a camera device installed on the vehicle; A display device, located outside the vehicle, displays the image distributed by the distribution unit; and The first estimation unit estimates the first time from when the vehicle begins to turn until when the turn ends, based on information about the vehicle's surroundings. The display device displays the first time estimated by the first estimation unit together with the image distributed by the distribution unit.

2. The distribution system according to claim 1, wherein, The display device indicates that the vehicle's direction indicator has been operated when the direction indicator is operated.

3. The distribution system according to claim 1 or 2, wherein, The display device indicates that the vehicle is turning during the turning process.

4. The distribution system according to claim 1 or 2, wherein, The distribution system includes a second estimation unit that estimates a second time estimating the time until the vehicle begins to turn, based on map information about the vehicle's surroundings or images obtained from an external camera mounted on the vehicle and capturing images outside the vehicle. The display device displays the second time estimated by the second estimation unit before the vehicle begins to turn.

5. The distribution system according to claim 1 or 2, wherein, The camera device is installed inside the vehicle. The image includes an exterior area showing the outside of the vehicle. The display device displays an image during the period when the vehicle is turning, showing either a reduced brightness of the area outside the vehicle compared to when the vehicle is not turning, or an image showing the area outside the vehicle as darker.

6. The distribution system according to claim 1 or 2, wherein, The display device is a head-mounted display device. When the display device is oriented in a direction opposite to the direction in which the vehicle is turning in the image, it outputs a notification urging the viewer to observe the direction in which the vehicle is turning.

7. The distribution system according to claim 1 or 2, wherein, This distribution system has the following features: The determination unit determines whether there are uneven surfaces on the road surface where the vehicle is traveling; and The correction unit corrects image jitter when the determination unit determines that unevenness exists. The distribution unit distributes the image corrected by the correction unit.

8. A computer program product comprising a program, The program causes the display device's processor to perform the following processing: Displays images captured by a camera device installed on the vehicle. The first time from when the vehicle begins to turn until when it finishes turning, estimated based on information about the vehicle's surroundings, is displayed along with the image.

9. A distribution method, the distribution method comprising: The distribution step involves distributing images captured by a camera device installed on the vehicle. The display step involves a display device displaying the image distributed in the distribution step. as well as The estimation step, based on information about the vehicle's surroundings, estimates the first time from when the vehicle begins to turn until when the turn ends. In the display step, the first time estimated in the estimation step is displayed together with the image distributed in the distribution step.

Images