Video distribution system, video distribution server, and video distribution method

Abstract

To provide a video distribution system, a video distribution server, and a video distribution method that make it easy for users to find real-time videos filming places where the users want to see.SOLUTION: A video distribution system according to an embodiment includes a transmission unit and a distribution unit. The transmission unit transmits, to a terminal device, a map showing the position of a camera mounted on a mobile body. The distribution unit distributes, in real time, a moving image captured by the camera selected from the cameras shown on the map to the terminal device.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a video distribution system, a video distribution server, and a video distribution method.

Background Art

[0002] There is a system that displays a video that is captured by a camera installed at a position different from the position where the viewer is located and is distributed in real time.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, it is difficult for a user to find a real-time video being captured at a location the user wants to see.

[0005] The problem to be solved by an embodiment of the present invention is to provide a video distribution system, a video distribution server, and a video distribution method that make it easy for a user to find a real-time video being captured at a location the user wants to see.

Means for Solving the Problems

[0006] The video distribution system according to the embodiment includes a transmission unit and a distribution unit. The transmission unit transmits a map indicating the position of a camera equipped on a moving object to a terminal device. The distribution unit distributes in real time to the terminal device a video captured by the selected camera from among the cameras shown on the map.

Effects of the Invention

[0007] The present invention makes it easy for a user to find a real-time video being captured at a location the user wants to see. [Brief explanation of the drawing]

[0008] [Figure 1] A block diagram showing an example of the distribution system according to the embodiment and the main components of the components included in the distribution system. [Figure 2] A flowchart showing an example of processing by the processor of the imaging device in Figure 1. [Figure 3] A flowchart showing an example of processing performed by the processor of the distribution server in Figure 1. [Figure 4] A flowchart showing an example of processing performed by the processor of the terminal device in Figure 1. [Figure 5] A diagram showing an example of a distribution location map. [Modes for carrying out the invention]

[0009] The distribution system according to the embodiment will be described below with reference to the drawings. Note that the scale of each part in the drawings used in the description of the embodiment below may have been changed as appropriate. Also, for illustrative purposes, some components may be omitted from the drawings used in the description of the embodiment below. Furthermore, in the drawings and this specification, the same reference numerals indicate the same elements.

[0010] Figure 1 is a block diagram showing an example of the main components of a distribution system 1 and its constituent elements according to an embodiment. Distribution system 1 is a system that provides a video distribution service. The video distribution service here is a service that distributes videos captured by the camera 100 to viewers in real time. Videos distributed in real time will be referred to as "real-time videos" below. Real-time videos can also be called live streams or live broadcasts. Viewers refer to users of the video distribution service who watch real-time videos. Users who distribute real-time videos among users of the video distribution service will be referred to as "distributing users". Distribution system 1 includes, as an example, a camera 100, a distribution server 200, and a terminal device 300. Although Figure 1 shows one of each device, the number of each device is not limited. Distribution system 1 typically includes multiple camera 100s and terminal devices 300. However, in the following explanation, one camera 100 and one terminal device 300 will be used as representative examples. Note that distribution system 1 is an example of a video distribution system.

[0011] The camera 100, distribution server 200, and terminal device 300 are connected to a network NW. The network NW is typically a communication network, including the Internet.

[0012] The recording device 100 is a device that records video and uploads the video in real time. The recording device 100 is a device equipped on a moving body. The moving body is, for example, a vehicle such as an automobile, motorcycle or bicycle, or other vehicle. In this case, the recording device 100 may be shared with a camera for autonomous driving. The recording device 100 may also be shared with a drive recorder. The moving body is also, for example, a person such as a pedestrian. The person is equipped with the recording device 100 by holding it or wearing it. The moving body may also be an autonomous vehicle or an unmanned aircraft such as a drone. The recording device 100 includes, as an example, a processor 101, ROM (read-only memory) 102, RAM (random-access memory) 103, auxiliary storage device 104, communication interface 105, input device 106, output device 107, recording unit 108, and positioning unit 109. A bus 110 or the like connects these parts.

[0013] The processor 101 is the central part of the computer that performs calculations and control necessary for the operation of the imaging device 100, and performs various calculations and processes. The processor 101 is, for example, a CPU (central processing unit), MPU (micro processing unit), SoC (system on a chip), DSP (digital signal processor), GPU (graphics processing unit), ASIC (application specific integrated circuit), PLD (programmable logic device), or FPGA (field-programmable gate array). Alternatively, the processor 101 is a combination of several of these. Furthermore, the processor 101 may also be a combination of these with hardware accelerators. Based on programs such as firmware, system software, and application software stored in ROM 102 or auxiliary storage device 104, the processor 101 controls each part to realize various functions of the imaging device 100. The processor 101 also executes the processes described later based on the said program. Note that some or all of the said program may be incorporated into the circuit of the processor 101.

[0014] ROM102 and RAM103 are the main memory of the computer, which is centered around processor 101. ROM102 is a non-volatile memory used exclusively for reading data. ROM102 stores, for example, firmware from the aforementioned programs. ROM102 also stores data used by the processor 101 for various processing tasks. RAM103 is memory used for reading and writing data. RAM103 is used as a work area to store data that the processor 101 temporarily uses when performing various processes. RAM103 is typically volatile memory.

[0015] The auxiliary storage device 104 is an auxiliary storage device of a computer centered around the processor 101. The auxiliary storage device 104 is, for example, an EEPROM (electric erasable programmable read-only memory), an HDD (hard disk drive), or a flash memory. The auxiliary storage device 104 stores, among the above programs, for example, system software and application software. Further, the auxiliary storage device 104 stores data used by the processor 101 to perform various processes, data generated by the processes in the processor 101, and various setting values.

[0016] Further, the auxiliary storage device 104 stores a user DB (database) and a video DB. The user DB is a database that stores and manages various information and various settings related to users of the video distribution service in association with a user ID (identifier). The user ID is identification information uniquely assigned to each user. The user DB stores, for example, the user name and the points held by each user. The video DB is a database that stores and manages information related to videos.

[0017] The communication interface 105 is an interface for the imaging device 100 to communicate via a network NW or the like.

[0018] [[ID=I7]]The input device 106 receives operations by the operator of the imaging device 100. The input device 106 is, for example, a keyboard, a keypad, a touch pad, a mouse, or a controller. Further, the input device 106 may be a device for voice input.

[0019] The output device 107 displays a screen for notifying various information to the operator of the imaging device 100. The output device 107 is, for example, a display such as a liquid crystal display or an organic EL (electro-luminescence) display. Also, a touch panel can be used as the input device 106 and the output device 107. That is, the display panel included in the touch panel can be used as the output device 107, and the touch pad included in the touch panel can be used as the input device 106.

[0020] The imaging unit 108 is a camera or the like that captures a video. The imaging unit 108 is an example of a camera equipped on a moving body.

[0021] The positioning unit 109 measures the position of the imaging device 100 using a GNSS (global navigation satellite system) such as GPS (Global Positioning System). That is, the positioning unit 109 measures the position of the imaging unit 108.

[0022] The bus 110 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged between the respective parts of the imaging device 100.

[0023] The distribution server 200 displays the positions of the respective imaging devices 100 on a map. Thereby, the distribution server 200 enables a viewing user to select a real-time video that the user wants to view from the map. Also, the distribution server 200 receives the video transmitted from the imaging device 100 and transmits it to the terminal device 300. The distribution server 200 includes, as an example, a processor 201, a ROM 202, a RAM 203, an auxiliary storage device 204, and a communication interface 205. And a bus 206 or the like connects these respective parts. Note that the distribution server 200 is an example of a video distribution server.

[0024] The processor 201 is the central part of the computer that performs calculations and control necessary for the operation of the distribution server 200, and performs various calculations and processes. The processor 201 is, for example, a CPU, MPU, SoC, DSP, GPU, ASIC, PLD, or FPGA. Alternatively, the processor 201 is a combination of several of these. Furthermore, the processor 201 may also be a combination of these with hardware accelerators. The processor 201 controls each part to realize various functions of the distribution server 200 based on programs such as firmware, system software, and application software stored in ROM 202 or auxiliary storage device 204. The processor 201 also executes the processes described later based on the said program. Note that some or all of the said program may be incorporated into the circuit of the processor 201.

[0025] ROM202 and RAM203 are the main memory of the computer, which is centered around processor 201. ROM202 is a non-volatile memory used exclusively for reading data. ROM202 stores programs such as firmware, among others. It also stores data used by the processor 201 for various processing tasks. RAM203 is memory used for reading and writing data. RAM203 is used as a work area to temporarily store data used by the processor 201 during various processes. RAM203 is typically volatile memory.

[0026] The auxiliary storage device 204 is an auxiliary storage device of a computer centered around the processor 201. The auxiliary storage device 204 is, for example, an EEPROM, HDD, or flash memory. The auxiliary storage device 204 stores, for example, system software and application software from the above-mentioned programs. The auxiliary storage device 204 also stores data used by the processor 201 in performing various processes, data generated by processing by the processor 201, and various setting values.

[0027] The communication interface 205 is an interface for the distribution server 200 to communicate via a network NW or the like.

[0028] Bus 206 includes a control bus, an address bus, and a data bus, and transmits signals exchanged between various parts of the distribution server 200.

[0029] Terminal device 300 is a device that displays real-time video. Terminal device 300 is a device operated by the viewing user. Terminal device 300 is, for example, a smartphone, tablet device, PC (personal computer), or television receiver. Terminal device 300 includes, as an example, a processor 301, ROM 302, RAM 303, auxiliary storage device 304, communication interface 305, input device 306, and output device 307. A bus 308 and the like connect these parts.

[0030] The processor 301 is the central part of the computer that performs calculations and control necessary for the operation of the terminal device 300, and performs various calculations and processes. The processor 301 is, for example, a CPU, MPU, SoC, DSP, GPU, ASIC, PLD, or FPGA. Alternatively, the processor 301 is a combination of several of these. Furthermore, the processor 301 may be a combination of these with a hardware accelerator. Based on programs such as firmware, system software, and application software stored in the ROM 302 or auxiliary storage device 304, the processor 301 controls each part to realize various functions of the terminal device 300. The processor 301 also executes the processes described later based on the said program. Note that some or all of the said program may be incorporated into the circuit of the processor 301.

[0031] ROM302 and RAM303 are the main memory of the computer, which is centered around the processor 301. ROM302 is a non-volatile memory used exclusively for reading data. ROM302 stores, for example, firmware from the aforementioned programs. ROM302 also stores data used by the processor 301 for various processing tasks. RAM303 is memory used for reading and writing data. RAM303 is used as a work area to store data that the processor 301 temporarily uses when performing various processes. RAM303 is typically volatile memory.

[0032] The auxiliary storage device 304 is an auxiliary storage device of a computer centered on the processor 301. The auxiliary storage device 304 is, for example, an EEPROM, HDD, or flash memory. The auxiliary storage device 304 stores, for example, system software and application software from the above-mentioned programs. The auxiliary storage device 304 also stores data used by the processor 301 in performing various processes, data generated by processing by the processor 301, and various setting values.

[0033] The communication interface 305 is an interface for the terminal device 300 to communicate via a network NW or the like.

[0034] The input device 306 accepts input from the operator of the terminal device 300. The input device 306 may be, for example, a keyboard, keypad, touchpad, mouse, or controller. The input device 306 may also be a device for voice input.

[0035] The output device 307 displays a screen for notifying the operator of the terminal device 300 of various information. The output device 307 is, for example, a display such as a liquid crystal display or an organic EL display. Alternatively, a touch panel can be used as both the input device 306 and the output device 307. That is, the display panel of the touch panel can be used as the output device 307, and the touchpad of the touch panel can be used as the input device 306.

[0036] Bus 308 includes a control bus, an address bus, and a data bus, and transmits signals exchanged between various parts of the terminal device 300.

[0037] The operation of the distribution system 1 according to this embodiment will be described below with reference to Figures 2 to 4. Note that the processing described below is just an example, and various processes that can obtain similar results can be used as appropriate. Figure 2 is a flowchart showing an example of processing by the processor 101 of the imaging device 100. The processor 101 executes the processing in Figure 2 based on a program stored in, for example, the ROM 102 or the auxiliary storage device 104. Figure 3 is a flowchart showing an example of processing by the processor 201 of the distribution server 200. The processor 201 executes the processing in Figure 3 based on a program stored in, for example, the ROM 202 or the auxiliary storage device 204. Figure 4 is a flowchart showing an example of processing by the processor 301 of the terminal device 300. The processor 301 executes the processing in Figure 4 based on a program stored in, for example, the ROM 302 or the auxiliary storage device 304.

[0038] In step ST11 of Figure 2, the processor 101 of the shooting device 100 determines whether or not to change the settings related to the distribution of real-time video. If the processor 101 determines that it does not want to change the settings, it determines No in step ST11 and proceeds to step ST12.

[0039] In step ST12, the processor 101 determines whether or not to start streaming real-time video. If the processor 101 does not decide to start streaming real-time video, it determines No in step ST12 and proceeds to step ST13.

[0040] In step ST13, the processor 101 determines whether or not acknowledgment information has been received via the communication interface 105. If acknowledgment information is not received, the processor 101 determines "No" in step ST13 and proceeds to step ST14. The acknowledgment information will be described later.

[0041] In step ST14, the processor 101 determines whether or not to terminate the distribution of real-time video. If the processor 101 does not terminate the distribution of real-time video, it determines No in step ST14 and proceeds to step ST15.

[0042] In step ST15, the processor 101 determines whether or not to display various information about the distribution user. If the processor 101 does not want to display the various information, it determines No in step ST15 and returns to step ST11. Thus, the processor 101 enters a waiting state, repeating steps ST11 to ST15 until it determines that it will change the settings, start distributing real-time video, receive confirmation information, end the distribution of real-time video, or display the various information.

[0043] If, for example, an operation is performed using the input device 106 to instruct the system to change the settings, the processor 101 determines that the settings should be changed. If the processor 101 determines that the settings should be changed while in the waiting state of steps ST11 to ST15, it determines Yes in step ST11 and proceeds to step ST16.

[0044] In step ST16, the processor 101 performs processing for changing settings. For example, the processor 101 displays a settings screen for changing settings on the output device 107. The operator of the shooting device 100 inputs the setting changes by operating the input device 106 while viewing the settings screen. The settings include, for example, viewing permission settings, viewing point settings, mobile device settings, and distribution prohibition settings. The viewing permission setting indicates whether the viewing user needs permission from the distribution user who distributes the real-time video in order to view the real-time video. The viewing point setting indicates whether points are required to view the real-time video, and settings related to the points required for viewing. The points required for viewing are, for example, points set at set intervals, points set for each viewing, or points set at predetermined intervals. Note that currency may be used instead of points. The mobile device setting indicates what kind of mobile device the shooting device 100 is mounted on. The distribution prohibition setting is a setting for locations where video distribution will not be performed. Distribution will automatically stop while the shooting device 100 is located within that location. For example, if you set your home area as the location, the broadcast will automatically stop while you are in that area. In this specification and in the claims, "viewing" does not necessarily mean that the viewing user is actually watching the video; it is considered to be viewed if the terminal device 300 is receiving the video.

[0045] After the configuration change details are entered, the processor 101 generates configuration information. The configuration information includes the user ID of the distribution user and the configuration change details. The configuration information is information that instructs the settings to be changed as indicated by the configuration change details. After generating the configuration information, the processor 101 instructs the communication interface 105 to send the configuration information to the distribution server 200. Upon receiving this instruction, the communication interface 105 sends the configuration information to the distribution server 200. The transmitted configuration information is received by the communication interface 205 of the distribution server 200. After processing in step ST16, the processor 101 returns to step ST11.

[0046] Meanwhile, in step ST31 of Figure 3, the processor 201 of the distribution server 200 determines whether or not configuration information has been received via the communication interface 205. If no configuration information has been received, the processor 201 determines "No" in step ST31 and proceeds to step ST32.

[0047] In step ST32, the processor 201 determines whether or not start information has been received via the communication interface 205. If start information has not been received, the processor 201 determines "No" in step ST32 and proceeds to step ST33.

[0048] In step ST33, the processor 201 determines whether or not a map request has been received via the communication interface 205. If no map request has been received, the processor 201 determines "No" in step ST33 and proceeds to step ST34.

[0049] In step ST34, the processor 201 determines whether or not a viewing request has been received by the communication interface 205. If no viewing request has been received, the processor 201 determines "No" in step ST34 and proceeds to step ST35.

[0050] In step ST35, the processor 201 determines whether or not to stop transmitting real-time video to the terminal device 300. If the processor 201 does not determine to stop transmitting real-time video to the terminal device 300, it determines No in step ST35 and proceeds to step ST36.

[0051] In step ST36, the processor 201 determines whether or not termination information has been received via the communication interface 205. If termination information has not been received, the processor 201 determines "No" in step ST36 and proceeds to step ST37.

[0052] In step ST37, the processor 201 determines whether or not an information request has been received via the communication interface 205. If no information request has been received, the processor 201 determines "No" in step ST37 and returns to step ST31. Thus, the processor 201 enters a waiting state, repeating steps ST31 to ST37 until it determines that it has received configuration information, start information, map request, viewing request, end information, or an information request, or to stop transmitting real-time video to the terminal device 300. Start information, map request, viewing request, end information, and information request will be described later.

[0053] If the processor 201 receives configuration information while in the waiting state of steps ST31 to ST37, it determines "Yes" in step ST31 and proceeds to step ST38.

[0054] In step ST38, the processor 201 stores the configuration changes in the user database based on the configuration information received. The processor 201 stores the configuration changes in the user database in association with the user ID in the configuration information. After processing in step ST38, the processor 201 returns to step ST31.

[0055] On the other hand, when a streaming user wants to start streaming real-time video, they perform an operation to instruct the system to start streaming real-time video, for example, using the input device 106 of the shooting device 100. The processor 101 determines that it will start streaming real-time video if this operation is performed. If the processor 101 determines that it will start streaming real-time video while in the waiting state of steps ST11 to ST15 in Figure 2, it determines Yes in step ST12 and proceeds to step ST17.

[0056] In step ST17, the processor 101 performs processing to start the distribution of real-time video. Specifically, if the processor 101 is not currently recording video, it controls the recording unit 108 to start recording video. The processor 101 then instructs the communication interface 105 to send start information to the distribution server 200. The start information includes the user ID of the distribution user. The start information is information indicating that the distribution of real-time video has started. Upon receiving the instruction to send, the communication interface 105 sends the start information to the distribution server 200. The transmitted start information is received by the communication interface 205 of the distribution server 200. Furthermore, the processor 101 instructs the communication interface 105 to start real-time transmission to the distribution server 200 of the video recorded by the recording unit 108 and location information indicating the current position of the recording device 100, which is determined by the positioning unit 109. Upon receiving the instruction to send, the communication interface 105 starts real-time transmission of the video and location information to the distribution server 200. The transmitted video is received by the communication interface 205 of the distribution server 200. The processor 101 also instructs the communication interface 105 to send navigation information to the distribution server 200 as needed. Navigation information is information obtained from a navigation system such as a car navigation system. Navigation information includes, for example, information indicating the destination of the moving object and the route to the destination. Upon receiving the instruction to send, the communication interface 105 sends the navigation information to the distribution server 200. The transmitted navigation information is received by the communication interface 205 of the distribution server 200. After processing in step ST17, the processor 101 returns to step ST11.

[0057] However, if the location of the camera 100 enters a location set as a distribution prohibition during real-time video distribution, the processor 101 will temporarily suspend distribution. That is, the processor 101 instructs the communication interface 105 to stop real-time transmission of real-time video and location information to the distribution server 200. Then, when the location of the camera 100 leaves the location set as a distribution prohibition, the processor 101 instructs the communication interface 105 to resume real-time transmission of real-time video and location information to the distribution server 200. The communication interface 105 stops and resumes transmission in accordance with these instructions.

[0058] If the processor 201 receives start information while in the waiting state of steps ST31 to ST37, it determines Yes in step ST32 and proceeds to step ST39.

[0059] In step ST39, the processor 201 controls the communication interface 205 to begin receiving video and location information transmitted from the camera 100 following the start information. The processor 201 also assigns a video ID to the video. The video ID is unique identification information for each video. The processor 201 associates the user ID in the received start information, the video ID, and the received location information and stores them in the video database. The processor 201 updates the location information in real time. After processing in step ST39, the processor 201 returns to step ST31.

[0060] On the other hand, if a viewer wants to watch real-time video using a video streaming service, they launch the application software for the video streaming service on the terminal device 300. The processor 301 of the terminal device 300 starts the process shown in Figure 4 when the software is launched. In step ST51 of Figure 4, the processor 301 of the terminal device 300 processes the specification of search conditions for searching for the shooting location of the real-time video. The viewer inputs, for example, the desired shooting location as a search condition using the input device 306. The location can be entered, for example, by address, place name, building name, or latitude and longitude. Alternatively, the viewer may input the location by specifying the location on the map displayed on the output device 307.

[0061] In step ST52, the processor 301 generates a map request. The map request includes the user ID and the search conditions entered in step ST51. The map request is information requesting the transmission of a distribution location map that includes the locations specified in the search conditions. The distribution location map is a map that shows the shooting locations of each real-time video being distributed, i.e., the locations of each shooting device 100 distributing the real-time video. The map request may also include information specifying the range of the map. After generating the map request, the processor 301 instructs the communication interface 305 to send the map request to the distribution server 200. Upon receiving this instruction, the communication interface 305 sends the map request to the distribution server 200. The transmitted map request is received by the communication interface 205 of the distribution server 200.

[0062] On the other hand, if the processor 201 of the distribution server 200 receives a map request while in the waiting state of steps ST31 to ST37 in Figure 3, it determines Yes in step ST33 and proceeds to step ST40.

[0063] In step ST40, the processor 201 generates a distribution location map that includes the locations specified in the search criteria in the map request. Figure 5 shows an example of a distribution location map M1. The distribution location map M1 displays, for example, area AR1, area AR2, icon I1, icon I2, and arrow A1 on map M2.

[0064] Map M2 is, for example, a map that includes the location specified in the search criteria. If the map request does not specify a map range, map M2 is a map of a predetermined scale centered on that location. However, if the map request specifies a map range, the range of map M2 is the range specified in the map request. In this case, if the map range does not include the location specified in the search criteria, then map M is a map that does not include that location. Area AR1 is a region that indicates the location of map M2 or a location specified by search criteria, such as a string of characters.

[0065] Icon I1 is an icon that indicates the location on map M2 of a camera 100 that is streaming real-time video within the area shown on map M2. The processor 201 identifies which camera 100 is streaming real-time video within map M2, for example, by using location information transmitted from the camera 100. Icon I1 is a button. By touching or clicking icon I1, it becomes selected, and it becomes possible to view the video being shot by the camera 100 indicated by icon I1. Icon I1 is associated with the video ID of the video in question. There are also different types of icons I1, such as icon I1-1 and icon I1-2.

[0066] Icon I1-1 is the icon I1 used when the mobile body equipped with the camera 100 is an automobile. Icon I1-2 is the icon I1 used when the mobile body equipped with the camera 100 is a pedestrian. If the mobile body equipped with the camera 100 is another type of mobile body such as a motorcycle, the icon I1 used will be the one corresponding to the type of mobile body.

[0067] Icon I2 is an icon on map M2 that indicates a location specified in the search criteria. The location indicated by icon I2 is an example of a location specified by terminal device 300.

[0068] Arrow A1 is an arrow indicating the direction of travel of the moving object shown by icon I1. The processor 201 determines the direction of travel of the moving object using navigation information transmitted from the imaging device 100. Alternatively, the processor 201 determines the direction of travel of the moving object using position information transmitted from the imaging device 100.

[0069] Region AR2 is displayed near arrow A1, which indicates the direction of travel of a moving object that is expected to pass the position indicated by icon I2. In Figure 5, region AR2 is displayed near arrow A1 of icons I1-1a, I1-2a, and I1-2b. Region AR2 displays the time it will take for the moving object to reach the position indicated by icon I2. The processor 201 determines this time using navigation information transmitted from the imaging device 100. Alternatively, the processor 201 determines this time using position information transmitted from the imaging device 100.

[0070] In step ST41, the processor 201 generates map information. The map information includes the distribution location map M1 generated in step ST40. The map information is information that instructs the display of the distribution location map M1. After generating the map information, the processor 201 instructs the communication interface 205 to transmit the map information to the terminal device 300. Upon receiving this transmission instruction, the communication interface 205 transmits the map information to the terminal device 300. The transmitted map information is received by the communication interface 305 of the terminal device 300. After processing in step ST41, the processor 201 returns to step ST31.

[0071] The distribution location map is an example of a map image in which the locations of cameras equipped on the mobile device are shown on map M2. Therefore, the processor 201 functions as an example of a display unit that displays the map image on the terminal device by performing the processing in step ST41.

[0072] Meanwhile, in step ST53 of Figure 4, the processor 301 of the terminal device 300 is waiting for map information to be received via the communication interface 305. If map information is received, the processor 301 determines Yes in step ST53 and proceeds to step ST54.

[0073] In step ST54, the processor 301 instructs the output device 307 to display the distribution location map M1. Upon receiving the instruction to display, the output device 307 displays the distribution location map M1. The processor 301 functions as an example of a display unit that displays the distribution location map M1 by performing the processing in step ST54.

[0074] Furthermore, the distribution location map M1 may be capable of changing the range of map M2. If an operation is performed to change the range of map M2, the processor 301 will, for example, make a map request corresponding to the changed range. Then, the processor 301 will display the distribution location map M1 with the changed range based on the map information sent as a response to the map request.

[0075] Viewers can select a video by manipulating the corresponding icon I1 for the real-time video they want to watch. In step ST55, the processor 301 waits for one of the icons I1 on the delivery location map M1 to be selected. If one of the icons I1 on the delivery location map M1 is selected, the processor 301 determines Yes in step ST55 and proceeds to step ST56.

[0076] In step ST56, the processor 301 generates a viewing request. The viewing request includes the user ID of the viewing user and the video ID corresponding to the selected icon I1. The viewing request is information requesting the transmission of the real-time video identified by the video ID. After generating the viewing request, the processor 301 instructs the communication interface 305 to send the viewing request to the distribution server 200. Upon receiving this instruction, the communication interface 305 sends the viewing request to the distribution server 200. The transmitted viewing request is received by the communication interface 205 of the distribution server 200.

[0077] Meanwhile, if the processor 201 of the distribution server 200 receives a viewing request while in the waiting state of steps ST31 to ST37, it determines "Yes" in step ST34 and proceeds to step ST42.

[0078] In step ST42, the processor 201 determines whether permission is required to view the real-time video identified by the video ID in the viewing request. The processor 201 refers to the viewing permission settings in the user DB and determines that permission is required to view the real-time video if the settings require permission from the distribution user who distributes the real-time video in order to view it. Note that these viewing permission settings are included in the settings associated with the user ID of the distribution user. If permission is required to view the real-time video, the processor 201 determines Yes in step ST42 and proceeds to step ST43.

[0079] In step ST43, the processor 201 performs a process to confirm whether or not to allow the distribution user to view the video. That is, the processor 201 generates confirmation information. The confirmation information includes, for example, the user ID and username of the viewing user. The confirmation information is information used to inquire whether to allow the viewing user to view the real-time video. After generating the confirmation information, the processor 201 instructs the communication interface 205 to send the confirmation information to the recording device 100. The destination recording device 100 is the recording device 100 that is recording the video identified by the video ID corresponding to the selected icon I1. Upon receiving this instruction to send, the communication interface 205 sends the confirmation information to the recording device 100. The transmitted confirmation information is received by the communication interface 105 of the recording device 100.

[0080] If the processor 101 receives confirmation information while in the waiting state of steps ST11 to ST15, it determines "Yes" in step ST13 and proceeds to step ST18.

[0081] In step ST18, the processor 101 generates an image corresponding to the confirmation screen. The processor 101 then instructs the output device 107 to display this generated image. Upon receiving the display instruction, the output device 107 displays the confirmation screen.

[0082] The confirmation screen includes, for example, a username, user ID, an allow button, and a deny button. The username and user ID on the confirmation screen are the same as the username and user ID in the confirmation information. The "Allow" button is used by the broadcaster to grant permission for the viewing user identified by the username and user ID displayed on the confirmation screen to view the content. The reject button is for the broadcaster to use if they do not want to allow the viewer identified by the username and user ID displayed on the confirmation screen to view the content.

[0083] In step ST19, the processor 101 determines whether an operation to allow viewing of real-time video has been performed, such as pressing the allow button. If an operation to allow viewing has been performed, the processor 101 determines Yes in step ST19 and proceeds to step ST20.

[0084] In step ST20, the processor 101 instructs the communication interface 105 to send permission information to the distribution server 200. The permission information is information indicating permission to view real-time video. Upon receiving this instruction, the communication interface 105 sends the permission information to the distribution server 200. The transmitted permission information is received by the communication interface 205 of the distribution server 200. After processing in step ST20, the processor 101 returns to step ST11.

[0085] In contrast, if an operation that does not permit viewing of real-time video is performed, such as pressing the reject button, the processor 101 determines that an operation to permit viewing was not performed. Also, if a predetermined time elapses without any operation to permit or deny viewing of real-time video being performed, the processor 101 considers it to have timed out and determines that an operation to permit viewing was not performed. If the processor 101 does not determine that an operation to permit viewing was not performed, it determines No in step ST19 and proceeds to step ST21.

[0086] In step ST21, the processor 101 instructs the communication interface 105 to send rejection information to the distribution server 200. Upon receiving this instruction, the communication interface 105 sends the rejection information to the distribution server 200. The transmitted rejection information is received by the communication interface 205 of the distribution server 200. After processing in step ST21, the processor 101 returns to step ST11.

[0087] Meanwhile, in step ST43 of Figure 3, the processor 201 of the distribution server 200 is waiting for permission information or denial information to be received via the communication interface 205. If permission information or denial information is received, the processor 201 determines Yes in step ST43 and proceeds to step ST44.

[0088] Based on the above, the processor 201, by performing the processing in step ST43, functions as an example of a confirmation unit that confirms with the streaming user whether to allow the user to view the real-time video when the user is viewing it.

[0089] In step ST44, the processor 201 determines whether or not viewing real-time video is permitted. If the processor 201 receives denial information in step ST43, it determines that viewing real-time video is not permitted. If the processor 201 determines that viewing real-time video is not permitted, it determines No in step ST44 and returns to step ST31. Before returning from step ST44 to step ST31, the processor 201 instructs the communication interface 205 to send a denial notice to the terminal device 300 indicating that viewing the real-time video was not permitted. Upon receiving this instruction, the communication interface 205 sends the denial notice to the terminal device 300. The denial notice is received by the communication interface 305 of the terminal device 300.

[0090] In contrast, if the processor 201 receives permission information in step ST43, it determines that viewing real-time video is permitted. If the processor 201 of the distribution server 200 determines that viewing real-time video is permitted, it determines Yes in step ST44 and proceeds to step ST45. Furthermore, if the processor 201 determines that permission is not required to view real-time video, it determines "No" in step ST42 and proceeds to step ST45.

[0091] In step ST45, the processor 201 instructs the communication interface 205 to begin transmitting the real-time video identified by the video ID in the viewing request to the terminal device 300. Upon receiving this transmission instruction, the communication interface 205 begins transmitting the real-time video to the terminal device 300. As a result, the distribution server 200 relays the real-time video transmitted from the camera 100 to the terminal device 300. The transmitted real-time video is then received by the communication interface 305 of the terminal device 300.

[0092] Furthermore, the processor 201 deducts the points required to view the real-time video, as set by the viewing point settings, from the viewer's points. For example, if the settings require a set number of points to be viewed at set intervals, the processor 201 will deduct the set number of points from the viewer's points each time the set interval has elapsed. For example, if the settings require points to be viewed once, the processor 201 will deduct those points from the viewer's points. Processor 201 adds the points deducted from the viewer's points to the broadcaster's points. The broadcaster is the broadcaster who is streaming the real-time video that the viewer is watching. In other words, the broadcaster is the broadcaster who is streaming the real-time video identified by the video ID in the viewing request. The broadcaster can exchange their points for cash or goods, etc. After processing step ST45, processor 201 returns to step ST31.

[0093] Processor 201 functions as an example of a points unit that increases the points or currency held by a broadcaster by adding the points or currency deducted from the points or currency held by a viewer to the points or currency held by the broadcaster. Furthermore, processor 201 also functions as an example of a points unit that decreases the points or currency held by a viewer by adding the points or currency deducted from the points or currency held by a broadcaster to the points or currency held by the viewer, and increases the points or currency held by the broadcaster according to the amount of decrease.

[0094] The processor 201, in cooperation with the communication interface 205, performs the processing in steps ST34 and ST45, and functions as an example of a distribution unit that distributes video captured by the camera selected from the map to the terminal device 300 in real time.

[0095] On the other hand, in step ST57 of Figure 4, the processor 301 of the terminal device 300 determines whether or not to start displaying the real-time video. For example, if a rejection notification is received, the processor 301 determines not to start displaying the real-time video. If the processor 301 determines not to start displaying the real-time video, it determines No in step ST57 and proceeds to step ST58.

[0096] In step ST58, the processor 301 displays an image on the output device 307 indicating that viewing real-time video was not permitted. After processing in step ST58, the processor 301 returns to step ST54.

[0097] In contrast, the processor 301 determines, for example, that it will start displaying the real-time video if it has started receiving the real-time video. If the processor 301 decides to start displaying the real-time video, it determines Yes in step ST57 and proceeds to step ST59.

[0098] In step ST59, the processor 301 controls the output device 307 to start displaying (playing) the real-time video received by the communication interface 305. The processor 301 plays the real-time video, for example, via live streaming.

[0099] In step ST60, the processor 301 determines whether or not to stop the playback of the real-time video that is currently playing. The processor 301 determines to stop the playback of the real-time video, for example, if the stop button is pressed by the viewer. If the processor 301 does not stop the playback of the real-time video that is currently playing, it determines No in step ST60 and repeats the process of step ST60. On the other hand, if the processor 301 decides to stop the playback of the real-time video that is currently playing, it determines Yes in step ST60 and proceeds to step ST61.

[0100] In step ST61, the processor 301 controls the output device 307 to stop playback of the real-time video that is currently being played. The processor 301 also controls the communication interface 305 to stop receiving the real-time video.

[0101] In step ST62, the processor 301 instructs the communication interface 305 to send stop information to the distribution server 200. The stop information includes the user ID of the viewing user and the video ID of the real-time video whose playback has been stopped. The stop information indicates that playback and viewing of the real-time video have been stopped. Upon receiving this instruction to send, the communication interface 305 sends the stop information to the distribution server 200. The transmitted stop information is received by the communication interface 205 of the distribution server 200. After processing in step ST62, the processor 301 returns to step ST54.

[0102] On the other hand, the processor 201 of the distribution server 200 determines to stop transmitting real-time video if it receives stop information. The processor 201 also determines to stop transmitting real-time video if it becomes impossible to transmit real-time video, such as when the communication connection with the terminal device 300 is lost. If the processor 201 determines to stop transmitting real-time video to the terminal device 300 while in the waiting state of steps ST31 to ST37, it determines Yes in step ST35 and proceeds to step ST46.

[0103] In step ST46, the processor 201 controls the communication interface 105 to stop the transmission of real-time video to the terminal device 300. The terminal device 300 is, for example, a terminal device 300 used by a viewer identified by the user ID in the stop information. The real-time video is the real-time video identified by the video ID in the stop information. Alternatively, the terminal device 300 is a terminal device 300 that is no longer able to transmit real-time video. The real-time video is the real-time video that can no longer be transmitted. Furthermore, for viewers who have stopped transmitting real-time video, the processor 201 stops the process of deducting the points set in the viewing point settings from the viewer's total points each time the time set in the viewing point settings has elapsed. After processing step ST46, processor 201 returns to step ST31.

[0104] When a streaming user wants to end the streaming of real-time video, they use the input device 106 of the shooting device 100 to instruct it to end the streaming of real-time video. The processor 101 determines, for example, that the streaming of real-time video should be ended when this operation is performed. If the processor 101 determines that the streaming of real-time video should be ended while in the waiting state of steps ST11 to ST15, it determines Yes in step ST14 and proceeds to step ST22.

[0105] In step ST22, the processor 101 performs processing to terminate the distribution of real-time video. Specifically, the processor 101 instructs the communication interface 105 to terminate the real-time transmission of real-time video and location information to the distribution server 200. Upon receiving this instruction, the communication interface 105 terminates the transmission. Furthermore, the processor 101 instructs the communication interface 105 to send termination information to the distribution server 200. The termination information includes, for example, the user ID of the distribution user and the video ID of the real-time video whose distribution is to be terminated. The termination information is information indicating that the distribution of real-time video has been terminated. Upon receiving the instruction to send, the communication interface 105 sends the termination information to the distribution server 200. The transmitted termination information is received by the communication interface 205 of the distribution server 200.

[0106] If the processor 201 receives termination information while in the waiting state of steps ST31 to ST37, it determines Yes in step ST36 and proceeds to step ST47.

[0107] In step ST47, the processor 201 controls the communication interface 205 to terminate the reception of real-time video and location information transmitted from the camera 100. The processor 201 also controls the communication interface 205 to stop transmitting the real-time video to each camera 100 that is receiving it. Furthermore, the processor 201 stops the process of deducting the points set in the viewing point settings from each viewer's points each time the time set in the viewing point settings has elapsed for each viewer who is viewing the real-time video. After processing in step ST47, the processor 201 returns to step ST31.

[0108] If a streaming user wants to check various information such as their points balance, they can, for example, use the input device 106 of the camera 100 to instruct it to display the information. The processor 101 determines that it will display the information once this operation is performed. If the processor 101 determines that it is in the waiting state of steps ST11 to ST15 in Figure 2 to display various information, it determines Yes in step ST15 and proceeds to step ST23.

[0109] In step ST23, the processor 101 performs a process to acquire various information. That is, the processor 101 generates an information request. The information request includes, for example, the user ID of the distribution user. The information request is information requesting that various information about the distribution user be sent. After generating the information request, the processor 101 instructs the communication interface 105 to send the information request to the distribution server 200. Upon receiving this instruction to send, the communication interface 105 sends the information request to the distribution server 200. The transmitted information request is received by the communication interface 205 of the distribution server 200.

[0110] On the other hand, if the processor 201 of the distribution server 200 receives an information request while in the waiting state of steps ST31 to ST37 in Figure 3, it determines "Yes" in step ST36 and proceeds to step ST47.

[0111] In step ST47, the processor 201 retrieves various information requested by the information request from the user database or the like. Then, the processor 201 instructs the communication interface 205 to transmit this information to the imaging device 100. Upon receiving this transmission instruction, the communication interface 205 transmits the information to the imaging device 100. The transmitted information is received by the communication interface 105 of the imaging device 100. After processing in step ST47, the processor 201 returns to step ST31.

[0112] Meanwhile, the processor 101 of the imaging device 100 is waiting for various information to be received via the communication interface 105. Upon receiving the various information, the processor 101 acquires it.

[0113] In step ST24, the processor 101 displays the various information acquired in step ST23 on the output device 107. After processing in step ST24, the processor 101 returns to step ST11.

[0114] In the embodiment of the distribution system 1, the location of the camera 100 is displayed on a map. Therefore, viewers can easily find the camera 100 that is taking pictures at the location they want to see.

[0115] Furthermore, the distribution system 1 of this embodiment distributes real-time video captured by a camera 100 mounted on a mobile vehicle. As a result, viewers can learn about the current situation in various locations.

[0116] Furthermore, in the distribution system 1 of this embodiment, users who watch real-time videos can earn points or currency. This allows users to earn income through the distribution of real-time videos.

[0117] Furthermore, in the embodiment of the distribution system 1, viewers who watch real-time videos pay points or currency. The points paid by the viewers are then paid to the distribution user. In this way, the embodiment of the distribution system 1 is able to pay points to the distribution user.

[0118] Furthermore, depending on the settings, the distribution system 1 of this embodiment requires permission from the distribution user for viewers to watch real-time videos. This allows the distribution user to prevent real-time videos from being viewed by viewers they do not want to see them. It also allows the distribution user to prevent real-time videos from being viewed at times they do not want to be seen.

[0119] Furthermore, the distribution system 1 of this embodiment displays an arrow A1 indicating the direction of travel of the moving object on the distribution location map M1. This allows viewers to know where the camera 100 is about to film.

[0120] Furthermore, the distribution system 1 of this embodiment displays the estimated time it takes for a moving object to reach the location of icon I2 on the distribution location map M1. This makes it easier for viewers to find real-time videos that capture their desired location.

[0121] The above embodiment can also be modified as follows: In the above embodiment, the recording device 100 starts transmitting real-time video even if no one is viewing the real-time video. However, the recording device 100 may start transmitting when the first viewer starts viewing. For example, the processor 201 of the distribution server 200 instructs the recording device 100 to start transmitting real-time video before processing in step ST45. In response to this instruction, the recording device 100 starts transmitting real-time video. The distribution server 200 also starts receiving the real-time video.

[0122] In the above embodiment, the distribution system 1 transmits real-time video from the shooting device 100 to the terminal device 300 via the distribution server 200. However, the distribution system 1 may also transmit real-time video from the shooting device 100 to the terminal device 300 without going through the distribution server 200 by using P2P or the like.

[0123] In the above embodiment, the points earned by the streaming user are the points deducted from the points held by the viewing user. However, the points earned by the streaming user are not limited to this. For example, the streaming user may earn points paid by the operator of a video streaming service. Such points may be paid, for example, from a portion of the advertising revenue earned by the operator of the video streaming service. The streaming system also determines the number of points to be paid by the operator to the streaming user, for example, based on the number of viewers of the real-time video. Processor 201 processes the payment of such points to the streaming user. Note that such points may also be represented by currency instead of points. Processor 201 functions as an example of a points unit that increases the points or currency held by a distribution user by performing the process of paying points or currency to the distribution user as described above.

[0124] Processors 101, 201, and 301 may implement some or all of the processing implemented by the program in the above embodiment through the hardware configuration of the circuit.

[0125] The program that implements the processing of the embodiment is transferred, for example, while stored in the device. However, the device may be transferred without the program stored in it. Alternatively, the program may be transferred separately and written to the device. This transfer of the program can be achieved, for example, by recording it on a removable storage medium or by downloading it via a network such as the Internet or a LAN.

[0126] The embodiments of the present invention have been described above, but these are merely examples and do not limit the scope of the invention. Embodiments of the present invention can be implemented in various ways without departing from the spirit of the invention. [Explanation of symbols]

[0127] 1. Distribution System 100 Imaging device 101,201,301 Processors 102,202,302 ROM 103,203,303 RAM 104,204,304 Auxiliary storage device 105,205,305 Communication Interfaces 106,306 Input Devices 107,307 Output devices 108 Photography Department 109 Positioning Unit 110, 206, 308 buses 200 distribution servers 300 terminal devices

Claims

1. A display unit that displays a map image on a terminal device showing the location of the camera equipped on the mobile device, A video distribution system comprising: a distribution unit that distributes video footage captured by a camera selected from among the cameras shown on the map to the terminal device in real time; Viewers of the aforementioned video can specify their desired imaging location in the search criteria. The moving object is a moving automobile that is expected to pass the location specified by the search conditions, and is located at a location separate from the location specified by the search conditions. The aforementioned map image shows the time it takes for the moving object to move to a location specified by the terminal device, in a video distribution system.

2. The video distribution system according to claim 1, further comprising a points section that increases the points or currency held by the distribution user distributing the video when the video is viewed.

3. The video distribution system according to claim 2, wherein the points unit reduces the points or currency held by the viewer user who watches the video, and increases the points or currency held by the distribution user in proportion to the amount of reduction.

4. The video distribution system according to any one of claims 1 to 3, further comprising a confirmation unit that confirms with the distribution user who distributes the video whether to allow the viewer to view the video when the viewer user views the video.

5. The video distribution system according to any one of claims 1 to 4, wherein the map image indicates the direction of travel of the moving object.

6. A display unit that displays a map image on a terminal device showing the location of the camera equipped on the mobile device, A video distribution server comprising: a distribution unit that distributes video footage captured by a camera selected from among the cameras shown on the map to the terminal device in real time; Viewers of the aforementioned video can specify their desired imaging location in the search criteria. The moving object is a moving automobile that is expected to pass the location specified by the search conditions, and is located at a location separate from the location specified by the search conditions. The aforementioned map image shows the time it takes for the moving object to move to a location specified by the terminal device, in a video distribution system.

7. The map image displays the locations of cameras mounted on the mobile vehicle. A video distribution method in which a processor processes and distributes in real time video captured by a camera selected from among the cameras shown on the map, Viewers of the aforementioned video can specify their desired imaging location in the search criteria. The moving object is a moving automobile that is expected to pass the location specified by the search conditions, and is located at a location separate from the location specified by the search conditions. A video distribution method wherein the map image shows the time it takes for the moving object to move to a location specified by the terminal device.

Images