Information processing apparatus

Abstract

To secure quality of communication of video data and communication of audio data during live distribution provided to a passenger of a vehicle while suppressing a communication cost.SOLUTION: The controller of the information processing apparatus performs communication of video data using the first line. Further, the control unit of the information processing apparatus performs communication of sound data using the second line. Here, the video data is data of at least one of a video for live distribution provided to the passenger of the vehicle and a video of the passenger of the vehicle. The sound data is data of at least one of sound for live streaming and voice of a passenger of the vehicle. The first line is a line having a higher throughput than the second line.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device. [Background technology]

[0002] Patent Document 1 discloses an information distribution system that distributes content information from a server device to a terminal device. In the information distribution system, the terminal device transmits request information for predetermined content information and disembarking information of a user boarding a means of transportation to the server device, and receives the predetermined content information from the server device. The terminal device also reproduces and displays the received predetermined content information. The server device also receives the request information and disembarking information from the terminal device, and transmits the predetermined content information to the terminal device in accordance with the request information. When the server device determines that the user is approaching the disembarking location based on the disembarking information, it controls the terminal device to stop reproducing the predetermined content information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-354489 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure aims to ensure the quality of communication of video data and audio data during live streaming provided to vehicle passengers while suppressing communication costs. [Means for solving the problem]

[0005] The information processing device according to the present disclosure includes: An information processing device including a control unit, The control unit Communicating video data using the first line; communicating sound data using the second line; configured to run the video data is at least one of video for live streaming provided to passengers of the vehicle and video of the passengers of the vehicle, the sound data is at least one of data of the sound for live distribution and data of the voices of passengers in the vehicle, The first line has a higher throughput than the second line. [Effects of the Invention]

[0006] The present disclosure makes it possible to reduce communication costs while ensuring the quality of communication of video data and audio data during live streaming provided to vehicle passengers. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a distribution system. [Figure 2] FIG. 2 is a diagram showing data transmitted and received by the distribution server. [Figure 3] FIG. 3 is a flowchart of the process executed by the processor. DETAILED DESCRIPTION OF THE INVENTION

[0008] Let us consider a case where live streaming is provided to passengers in a vehicle. In this case, the video for live streaming may be provided to passengers in the vehicle. Also, during the live streaming, In some cases, sound for live streaming may be provided by a vehicle. In addition, passengers in the vehicle may speak to the live streamer. In this case, if the video data for live streaming and the sound data for live streaming and / or the voice data of the passengers in the vehicle are communicated (transmitted or received) using a single line, a communication delay may occur in at least one of the data.

[0009] In addition, there are cases where video of passengers in a vehicle is distributed to a live streamer. In this case, when video data of the passengers in the vehicle and sound for the live stream and / or data of the passengers' voices (audio data) are communicated (transmitted or received) using a single line, a communication delay may occur in at least one of the video data and the audio data. The information processing device according to the present disclosure solves such a problem.

[0010] A control unit of an information processing device according to the present disclosure communicates video data using a first line. The control unit of the information processing device also communicates audio data using a second line. Here, the video data is at least one of video data for live streaming and video data of passengers in a vehicle. The audio data is at least one of audio data for live streaming and audio data of passengers in a vehicle. The first line has a higher throughput than the second line.

[0011] As described above, the information processing device communicates video data using the first line and audio data using the second line. This makes it possible to reduce communication delays compared to when video data and audio data are communicated using a single line. It is also assumed that the amount of video data is larger than the amount of audio data. Therefore, by communicating video data using the first line, which has a higher throughput than the second line, it is possible to reduce communication delays in video data. There are also cases where audio data is communicated without video data being communicated. In this case, the information processing device communicates audio data using the second line instead of the first line. This makes it possible to transmit audio data using the second line, which has a lower communication cost, rather than using the first line, which has a higher communication cost. As a result, it is possible to ensure the quality of video data communication and audio data communication while reducing communication costs.

[0012] Specific embodiments of the present disclosure will be described below with reference to the accompanying drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, etc. described in each embodiment are not intended to limit the technical scope of the disclosure to those configurations.

[0013] <Embodiment> (System Overview) A distribution system 1 in this embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a diagram showing a schematic configuration of the distribution system 1. The distribution system 1 includes an in-vehicle device 100 and a distribution server 200. In the distribution system 1, the in-vehicle device 100 and the distribution server 200 are connected to each other via a network N1 and a network N2.

[0014] In this embodiment, communication between the on-board device 100 and the distribution server 200 via the network N1 is performed using a single mobile line (hereinafter simply referred to as a "mobile line"). Furthermore, communication between the on-board device 100 and the distribution server 200 via the network N2 is performed using a line formed by bonding multiple mobile lines (hereinafter referred to as a "bonded line"). In this way, the bonded line for communication via the network N2 has a higher throughput than the mobile line for communication via the network N1. For example, a WAN (Wide Area Network), which is a global public communication network such as the Internet, or a telephone communication network such as a mobile phone may be adopted for the networks N1 and N2.

[0015] (In-vehicle device) The in-vehicle device 100 is a device mounted on a vehicle 10. Here, the vehicle 10 is a vehicle that transports visitors to an event venue. The in-vehicle device 100 is a device for providing a live streaming service to passengers of the vehicle 10. The in-vehicle device 100 receives video data for live streaming from the distribution server 200. The in-vehicle device 100 then outputs the received video data to a display of the in-vehicle device 100. The in-vehicle device 100 also receives sound data for live streaming from the distribution server 200. The in-vehicle device 100 then outputs the received sound data to a speaker of the in-vehicle device 100. The sound data for live streaming will be described in detail later.

[0016] Furthermore, the in-vehicle device 100 captures images of the passengers of the vehicle 10 using a camera of the in-vehicle device 100 and transmits the video data of the passengers (hereinafter, sometimes referred to as "passenger video data") in real time to the distribution server 200. This allows the live distributor to understand the state of the passengers of the vehicle 10.

[0017] Furthermore, passengers in the vehicle 10 can communicate with a broadcaster of the live broadcast (hereinafter, sometimes referred to as a "live broadcaster"). The passengers in the vehicle 10 can communicate with the live broadcaster during the live broadcast or at a predetermined timing during the live broadcast. At this time, the in-vehicle device 100 acquires the speech of the passengers in the vehicle 10 made into the microphone of the in-vehicle device 100, and transmits the voice data of the passengers in the vehicle 10 (hereinafter, sometimes referred to as "passenger voice data") to the distribution server 200 in real time. Furthermore, the in-vehicle device 100 outputs the voice data of the live broadcaster (described later) received from the distribution server 200 to the speaker of the in-vehicle device 100. In this way, a conversation takes place between the live broadcaster and the passengers in the vehicle 10.

[0018] (Distribution server) The distribution server 200 is a server device for providing live streaming to passengers of the vehicle 10. The distribution server 200 includes a computer having a processor 210, a main memory 220, an auxiliary memory 230, and a communication interface (communication I / F) 240. The processor 210 is, for example, a central processing unit (CPU) or a digital signal processor (DSP). The main memory 220 is, for example, a random access memory (RAM). The auxiliary memory 230 is, for example, a read-only memory (ROM). The auxiliary memory 230 is, for example, a hard disk drive (HDD) or a disc recording medium such as a CD-ROM, a DVD disc, or a Blu-ray disc. The auxiliary memory 230 may also be a removable medium (portable storage medium). Examples of removable media include a USB memory or an SD card.

[0019] In distribution server 200, auxiliary storage unit 230 stores an operating system (OS), various programs, various information tables, etc. In distribution server 200, processor 210 loads programs stored in auxiliary storage unit 230 into main storage unit 220 and executes them, thereby realizing various functions as described below. However, some or all of the functions of distribution server 200 may be realized by hardware circuits such as ASIC or FPGA.

[0020] The first communication I / F 240 is a LAN (Local Area Network) interface board for connecting the distribution server 200 to the network N1, or a wireless communication circuit for wireless communication. The second communication I / F 250 is a LAN (Local Area Network) interface board for connecting the distribution server 200 to the network N2, or a wireless communication circuit for wireless communication. The camera 260 is The camera 210 is a camera for capturing images of the live streamer. The microphone 270 is a microphone for capturing the voice of the live streamer. The display 280 is a display for displaying images to the live streamer. The speaker 290 is a speaker for outputting sound to the live streamer.

[0021] The distribution server 200 does not necessarily have to be realized by a single physical configuration, and may be configured by multiple computers that cooperate with each other. Like the distribution server 200, the in-vehicle device 100 is also a computer that includes a processor, a main memory, an auxiliary memory, a communication I / F for connecting the in-vehicle device 100 to the network N1, and a communication I / F for connecting the in-vehicle device 100 to the network N2. The in-vehicle device 100 is also a computer that includes a camera that captures images of passengers in the vehicle 10, a microphone that captures speech from the passengers in the vehicle 10, a display that displays images to the passengers in the vehicle 10, and a speaker that outputs sound to the passengers in the vehicle.

[0022] Fig. 2 is a diagram showing data transmitted and received by distribution server 200. As shown in Fig. 2, processor 210 transmits video data for live distribution (hereinafter, may be referred to as "video data for distribution") to in-vehicle device 100. Processor 210 also transmits audio data for live distribution (hereinafter, may be referred to as "audio data for distribution") to in-vehicle device 100. This allows passengers in vehicle 10 to view the video and audio for live distribution.

[0023] Here, the video data for distribution is data of a video of a live distributor captured by camera 260. The video data for distribution may also be data of a live distribution content video stored in advance in auxiliary storage unit 230. In this case, the video data for distribution may also include sound data that is output when the content video is played back. The video data for distribution may also be video data that includes a video of the live distributor and the content video.

[0024] The sound data for distribution is audio data of the live distributor acquired by microphone 270. The sound data for distribution may also be sound data stored in advance in auxiliary storage unit 230. In this case, the sound data for distribution is sound data such as background music used in live distribution. Processor 210 may also transmit sound data output during playback of video for distribution (content video) to in-vehicle device 100 as sound data for distribution.

[0025] Furthermore, processor 210 does not necessarily have to transmit both video data to be distributed and audio data to be distributed to in-vehicle device 100. Processor 210 may transmit audio data to be distributed to in-vehicle device 100 without transmitting video data to be distributed to in-vehicle device 100. In this case, the audio data to be distributed transmitted to in-vehicle device 100 may be, for example, background music to be played to passengers in vehicle 10 before the start of video distribution. Furthermore, if the live streamer does not communicate with passengers in vehicle 10, processor 210 may transmit video data to be distributed to in-vehicle device 100 without transmitting audio data to be distributed to in-vehicle device 100.

[0026] The processor 210 also receives passenger voice data from the in-vehicle device 100. The processor 210 outputs the passenger voices to the speaker 290 in accordance with the received passenger voice data. This allows the live streamer to understand what the passengers are saying. In this way, X201 transmits sound data to be distributed to the in-vehicle device 100 and receives passenger voice data from the in-vehicle device 100, allowing the live streamer to communicate with passengers in the vehicle 10.

[0027] The processor 210 also receives passenger video data from the in-vehicle device 100. The processor 210 outputs passenger video to the display 280 in accordance with the received passenger video data. This allows the live streamer to see what the passengers are doing.

[0028] The processor 210 does not necessarily have to receive both passenger video data and passenger voice data from the in-vehicle device 100. If the live streamer does not need video of the passengers in the vehicle 10, the processor 210 may receive passenger voice data from the in-vehicle device 100 without receiving passenger video data from the in-vehicle device 100. Also, if the live streamer checks the video of the passengers in the vehicle 10 but does not listen to the speech of the passengers in the vehicle 10, the processor 210 may receive passenger video data from the in-vehicle device 100 without receiving sound data to be distributed from the in-vehicle device 100.

[0029] In this case, it is assumed that transmission of both the video data to be distributed and the audio data to be distributed is performed using a mobile line via network N1. In this case, depending on the communication speed of the mobile line, delays may occur in the transmission of at least one of the video data to be distributed and the audio data to be distributed. Also, it is assumed that reception of both the passenger video data and the passenger audio data is performed using a mobile line via network N1. Even in this case, delays may occur in the reception of at least one of the passenger video data and the passenger audio data, depending on the communication speed of the mobile line.

[0030] Therefore, the processor 210 transmits sound data to be distributed to the in-vehicle device 100 via the network N1. The processor 210 also transmits video data to be distributed to the in-vehicle device 100 via the network N2. The processor 210 also receives passenger voice data from the in-vehicle device 100 via the network N1. The processor 210 also receives passenger video data from the in-vehicle device 100 via the network N2. In other words, the processor 210 transmits sound data to be distributed and receives passenger voice data using a mobile line, and transmits video data to be distributed and receives passenger video data using a bonding line.

[0031] In this embodiment, the transmission of the video data to be distributed and the reception of the passenger video data are performed using a bonding line. However, the transmission of the video data to be distributed and the reception of the passenger video data do not necessarily have to be performed using a bonding line. The transmission of the video data to be distributed and the reception of the passenger video data may be performed using, for example, a high-speed line dedicated to the transmission and reception of video data, as long as the line has a higher throughput than a mobile line.

[0032] (flowchart) Next, the processing executed by the processor 210 in the distribution server 200 in the distribution system 1 will be described with reference to FIG. 3. FIG. 3 is a flowchart of the processing executed by the processor 210. This processing is for transmitting video data and audio data for distribution and receiving passenger video data and passenger audio data. This processing is repeatedly executed at predetermined intervals after the start of live distribution. This allows the transmission of video data and audio data for distribution and the reception of passenger video data and passenger audio data to be performed in real time.

[0033] In the process shown in Fig. 3, first, in S101, video data to be distributed and audio data to be distributed are acquired. That is, in S101, video data of the distributor acquired by camera 260 and audio data of the distributor acquired by microphone 270 are acquired. Next, in S102, the video data to be distributed is transmitted to in-vehicle device 100 using a bonding line. Furthermore, in S103, the audio data to be distributed is transmitted to in-vehicle device 100 using a mobile line. Then, the process shown in Fig. 3 ends.

[0034] In parallel with the process of S101, in the process of S104, the passenger information transmitted by the in-vehicle device 100 is Video data is received. Here, the passenger video data is received using a bonding line. Also, passenger voice data transmitted by the in-vehicle device 100 in S105 is received. Here, the passenger voice data is received using a mobile line. Then, in S106, the received passenger voice data is output from the speaker of the in-vehicle device 100. Also, in S106, the received passenger video data is output to the display of the in-vehicle device 100. Then, the processing shown in FIG. 3 ends.

[0035] As described above, in the distribution system 1, video data for distribution is transmitted using a bonding line, and audio data for distribution is transmitted using a mobile line. Also, in the distribution system 1, passenger video data is received using a bonding line, and passenger audio data is received using a mobile line. In other words, video data (video data for distribution and passenger video data) is communicated (transmitted or received) using a bonding line, and audio data (audio data for distribution and passenger audio data) is communicated (transmitted or received) using a mobile line.

[0036] Here, it is assumed that the video data to be distributed and passenger video data (hereinafter simply referred to as "video data") have a larger data volume than the audio data to be distributed and passenger voice data (hereinafter simply referred to as "audio data"). Therefore, by communicating the video data using a bonding line, which has a higher throughput than a mobile line, it is possible to reduce communication delays of the video data.

[0037] As described above, there are cases where communication of audio data is performed without communication of video data. In this case, communication of audio data is performed using a mobile line without using a bonded line. This allows audio data to be transmitted using a mobile line with low communication costs, without using a bonded line with high communication costs. As a result, communication costs can be reduced while ensuring the quality of communication of video data and audio data.

[0038] The in-vehicle device 100 receives video data for distribution and transmits passenger video data using a bonding line, and receives audio data for distribution and transmits passenger audio data using a mobile line. Even in this case, the communication cost of the in-vehicle device 100 can be reduced while ensuring the quality of communication of video data and audio data.

[0039] <Other embodiments> The above-described embodiment is merely an example, and the present disclosure may be modified as appropriate within the scope of the present disclosure. Furthermore, the processes and means described in the present disclosure may be freely combined and implemented as long as no technical contradiction occurs.

[0040] Furthermore, a process described as being performed by one device may be shared and executed by multiple devices. Alternatively, a process described as being performed by different devices may be executed by a single device. In a computer system, the hardware configuration (server configuration) by which each function is realized can be flexibly changed.

[0041] The present disclosure can also be realized by supplying a computer program that implements the functions described in the above embodiments to a computer, and having one or more processors of the computer read and execute the program. Such a computer program may be provided to the computer by a non-transitory computer-readable storage medium that can be connected to the system bus of the computer, or may be provided to the computer via a network. Non-transitory computer-readable storage media include, for example, magnetic disks (floppy disks, hard disk drives (HDDs), etc.), optical disks (CD-ROMs, etc.), and the like. "includes any type of medium suitable for storing electronic instructions, such as any type of disk (e.g., USB, DVD disk, or Blu-ray disk), read-only memory (ROM), random-access memory (RAM), EPROM, EEPROM, magnetic card, flash memory, or optical card. [Explanation of symbols]

[0042] 1. Distribution System 10. Vehicle 100...In-vehicle equipment 200··Distribution Server 210 processor 220 Main memory 230...Auxiliary storage section 240··Communication I / F 260··Camera 270··Mike 280··Display 290··Speaker

Claims

[Claim 1] An information processing device including a control unit, The control unit communicating video data using a first line; communicating sound data using a second line; configured to run the video data is at least one of video for live streaming provided to passengers of the vehicle and video of the passengers of the vehicle, the sound data is at least one of data of the sound for live distribution and data of the voices of passengers in the vehicle, The first line has a higher throughput than the second line. Information processing device.

Images