Information processing apparatus

By using higher throughput lines to transmit video data and lower throughput but lower cost lines to transmit audio data in the real-time distribution system, the problems of latency and high cost in video and audio data communication are solved, achieving high-quality communication results.

CN121397281APending Publication Date: 2026-01-23TOYOTA JIDOSHA KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202510973438.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-07-22
Filing Date
2025-07-15
Publication Date
2026-01-23

AI Technical Summary

Technical Problem

In real-time distribution systems, communication between image and audio data is prone to delays, leading to decreased communication quality and higher communication costs.

Method used

Different communication lines are used to transmit image and audio data. Lines with higher throughput (bundled lines) are used to transmit image data, while lines with lower throughput but lower cost (mobile lines) are used to transmit audio data.

Benefits of technology

It effectively suppressed communication latency of image data, reduced communication costs, and ensured the communication quality of image and audio data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121397281A_ABST
    Figure CN121397281A_ABST
Patent Text Reader

Abstract

The purpose of the present disclosure is to ensure the quality of video data communication and voice data communication in real-time distribution provided to passengers of a vehicle while suppressing communication costs. A control unit of an information processing apparatus performs communication of video data using a first line. In addition, the control unit of the information processing apparatus performs communication of the audio data using the second line. The image data is at least one of an image for real-time distribution provided to an occupant of the vehicle and an image of the occupant of the vehicle. In addition, the voice data is data of at least one of voice for real-time distribution and voice of passengers of the vehicle. The first line has a higher throughput than the second line.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to an information processing apparatus. Background Technology

[0002] Patent Document 1 discloses an information distribution system that distributes content information from a server device to a terminal device. In this system, the terminal device sends a request for specified content information and disembarkation information of a user boarding a transportation vehicle to the server device, and receives the specified content information from the server device. Furthermore, the terminal device displays the received specified content information. Additionally, the server device receives the request information and disembarkation information from the terminal device, and in response to the request information, sends the specified content information to the terminal device. If, based on the disembarkation information, it is determined that the user's disembarkation location is approaching, the server device controls the cessation of the display of the specified content information on the terminal device.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2005-354489 Summary of the Invention

[0006] The purpose of this disclosure is to reduce communication costs and ensure the quality of communication of image data and audio data in real-time distribution to passengers in vehicles.

[0007] The information processing apparatus disclosed herein includes a control unit configured to perform the following operations: communicating image data using a first line; and communicating audio data using a second line, wherein the image data is data of at least one of an image for real-time distribution to passengers of a vehicle and an image of the passengers of the vehicle, and the audio data is data of at least one of the audio for real-time distribution and the voice of the passengers of the vehicle, and the first line is a line with a higher throughput than the second line.

[0008] Invention Effects

[0009] According to this disclosure, communication costs can be suppressed, and the quality of communication of image data and voice data in real-time distribution to passengers in the vehicle can be ensured. Attached Figure Description

[0010] Figure 1 It is a diagram showing the general structure of the distribution system.

[0011] Figure 2 It is a diagram representing the data sent and received by the distribution server.

[0012] Figure 3 It is a flowchart of the process executed by the processor.

[0013] Explanation of reference numerals in the attached figures

[0014] 1: Distribution system; 10: Vehicle; 100: Vehicle-mounted device; 200: Distribution server; 210: Processor; 220: Main storage unit; 230: Auxiliary storage unit; 240: First communication I / F; 250: Second communication I / F; 260: Camera; 270: Microphone; 280: Display; 290: Speaker. Detailed Implementation

[0015] Consider a scenario where live broadcasts are being provided to passengers in a vehicle. Sometimes, video footage for live broadcasts is also provided to the passengers. Furthermore, sometimes passengers may speak to the broadcaster. In this case, when the video data for live broadcasts, the audio data for live broadcasts, and / or the passengers' speech data are transmitted (sent or received) using a single line, communication delays for at least one data item may occur.

[0016] Furthermore, sometimes images of the vehicle's passengers are distributed to a real-time distributor. In this case, when the image data of the vehicle's passengers and the audio and / or voice data of the vehicle's passengers (audio data) are transmitted (sent or received) using a single line, communication delays sometimes occur in at least one of the image data and audio data. The information processing apparatus of this disclosure solves such a problem.

[0017] The control unit of the information processing apparatus of this disclosure uses a first line for communication of image data. Furthermore, the control unit of the information processing apparatus uses a second line for communication of audio data. Here, the image data is data of at least one of an image for real-time distribution and an image of the vehicle's passengers. Furthermore, the audio data is data of at least one of real-time distribution audio and the voice of the vehicle's passengers. Moreover, the first line has a higher throughput than the second line.

[0018] As described above, the information processing device performs communication of image data using a first line and communication of audio data using a second line. Therefore, compared to using only one line for both image and audio data communication, communication delays can be suppressed. Furthermore, it is assumed that the image data volume is larger than the audio data volume. Therefore, by using the first line, which has a higher throughput than the second line, for image data communication, communication delays can be suppressed. In addition, sometimes image data communication is not performed, but audio data communication is performed instead. In this case, the information processing device uses the second line instead of the first line for audio data communication. Therefore, the second line, which has lower communication costs, can be used to transmit audio data instead of the first line, which has higher communication costs. As a result, communication costs can be suppressed, and the quality of both image and audio data communication can be ensured.

[0019] Hereinafter, specific embodiments of the present disclosure will be described based on the accompanying drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, etc., described in each embodiment are not intended to limit the scope of the disclosed technology.

[0020] <Implementation Method>

[0021] (System Overview)

[0022] based on Figure 1 and Figure 2 The distribution system 1 in this embodiment will be described. Figure 1 This is a diagram showing the general configuration of distribution system 1. Distribution system 1 is configured to include an on-board unit 100 and a distribution server 200. In distribution system 1, the on-board unit 100 and the distribution server 200 are interconnected via networks N1 and N2.

[0023] In this embodiment, communication between the vehicle-mounted device 100 and the distribution server 200 via network N1 is performed using a single mobile line (hereinafter referred to as a "mobile line"). Furthermore, communication between the vehicle-mounted device 100 and the distribution server 200 via network N2 is performed using a line formed by bonding multiple mobile lines (hereinafter referred to as a "bonded line"). Thus, the throughput of the bonded line used for communication via network N2 is higher than the throughput of the mobile line used for communication via network N1. Networks N1 and N2 can be, for example, a WAN (Wide Area Network) or a telephone communication network such as a portable telephone, which can serve as a global public communication network.

[0024] (Vehicle-mounted device)

[0025] The vehicle-mounted device 100 is a device installed in vehicle 10. Here, vehicle 10 is a vehicle used to transport visitors to an event venue. The vehicle-mounted device 100 is used to provide real-time distribution services to passengers of vehicle 10. The vehicle-mounted device 100 receives video data for real-time distribution from the distribution server 200. Furthermore, the vehicle-mounted device 100 causes its display to output the received video data. Additionally, the vehicle-mounted device 100 receives audio data for real-time distribution from the distribution server 200. Furthermore, the vehicle-mounted device 100 causes its speakers to output the received audio data. It should be noted that details regarding the audio data for real-time distribution will be described later.

[0026] Furthermore, the in-vehicle device 100 uses its camera to capture images of the passengers in the vehicle 10 and transmits the passenger image data (hereinafter, sometimes referred to as "passenger image data") to the distribution server 200 in real time. Thus, the real-time distributor can monitor the situation of the passengers in the vehicle 10.

[0027] Furthermore, passengers of vehicle 10 can communicate with the real-time distributor (hereinafter, sometimes referred to as the "real-time distributor"). Passengers of vehicle 10 can communicate with the real-time distributor during real-time distribution or at a predetermined time during real-time distribution. At this time, the on-board unit 100 acquires the passenger's speech through its microphone and transmits the passenger's voice data (hereinafter, sometimes referred to as "passenger voice data") to the distribution server 200 in real time. Additionally, the on-board unit 100 outputs the voice data received from the distribution server 200 from the real-time distributor (described later) through its speaker. Thus, communication occurs between the real-time distributor and the passenger of vehicle 10.

[0028] (Distribution server)

[0029] The distribution server 200 is a server device for providing real-time distribution to passengers of vehicle 10. The distribution server 200 is configured to include a computer having a processor 210, main storage 220, auxiliary storage 230, a first communication interface (communication I / F) 240, a second communication I / F 250, a camera 260, a microphone 270, a display 280, and a speaker 290. The processor 210 is, for example, a central processing unit (CPU) or a digital signal processor (DSP). The main storage 220 is, for example, RAM (Random Access Memory). The auxiliary storage 230 is, for example, ROM (Read Only Memory). Furthermore, the auxiliary storage 230 may be, for example, a disc recording medium such as an HDD (Hard Disk Drive), CD-ROM (Compact Disc Read Only System), DVD (Digital Versatile Disc), or Blu-ray disc. Furthermore, the auxiliary storage unit 230 can also be a removable medium (removable storage medium). Here, examples of removable media include, for example, a USB (Universal Serial Bus) memory or an SD (Secure Digital) card.

[0030] In the distribution server 200, the auxiliary storage unit 230 stores the operating system (OS), various programs, and various information tables. Furthermore, in the distribution server 200, the processor 210 loads the programs stored in the auxiliary storage unit 230 into the main storage unit 220 and executes them, thereby enabling the various functions described later. However, some or all of the functions in the distribution server 200 can also be implemented using hardware circuits such as ASICs (Application Specific Integrated Circuits) or FPGAs (Field Programmable Gate Arrays).

[0031] The first communication I / F 240 is a LAN (Local Area Network) interface board for connecting the distribution server 200 to network N1, or a wireless communication circuit for wireless communication. The second communication I / F 250 is a LAN (Local Area Network) interface board for connecting the distribution server 200 to network N2, or a wireless communication circuit for wireless communication. The camera 260 is a camera used to capture images of the real-time distributor. The microphone 270 is a microphone used to capture the voice of the real-time distributor. The display 280 is a display used to display images to the real-time distributor. The speaker 290 is a speaker used to output sound to the real-time distributor.

[0032] It should be noted that the distribution server 200 does not necessarily need to be implemented through a single physical component; it can also be composed of multiple computers working together. Similarly, the vehicle-mounted device 100, like the distribution server 200, is a computer equipped with a processor, main storage, auxiliary storage, a communication I / F for connecting the vehicle-mounted device 100 to network N1, and a communication I / F for connecting the vehicle-mounted device 100 to network N2. Furthermore, the vehicle-mounted device 100 also includes a camera for capturing images of the passengers of the vehicle 10, a microphone for capturing the passengers' speech, a display for showing images to the passengers of the vehicle 10, and a speaker for outputting sound to the passengers of the vehicle.

[0033] Figure 2 This is a diagram representing the data sent and received by distribution server 200. For example... Figure 2 As shown, the processor 210 sends real-time distributed video data (hereinafter, sometimes referred to as "distribution video data") to the vehicle-mounted device 100. Furthermore, the processor 210 sends real-time distributed audio data (hereinafter, sometimes referred to as "distribution audio data") to the vehicle-mounted device 100. Thus, passengers of the vehicle 10 can view and listen to real-time distributed video and audio.

[0034] Here, the distribution image data is the data of the real-time distributor's image captured by the camera 260. Alternatively, the distribution image data can also be the data of the real-time distribution content image that has been pre-stored in the auxiliary storage unit 230. In this case, the distribution image data may also include audio data output during the reproduction of the content image. Furthermore, the distribution image data can also be image data that includes both the real-time distributor's image and the content image.

[0035] Furthermore, the audio data for distribution is the voice data of the distributor acquired in real time by the microphone 270. Alternatively, the audio data for distribution may be audio data pre-stored in the auxiliary storage unit 230. In this case, the audio data for distribution may be audio data such as background music (BGM) used in real-time distribution. Furthermore, the processor 210 may also send the audio data output during the reproduction of the distribution video (content video) to the vehicle-mounted device 100 as audio data for distribution.

[0036] Furthermore, the processor 210 may not necessarily send both the distribution video data and the distribution audio data to the vehicle-mounted device 100. The processor 210 may also choose not to send the distribution video data to the vehicle-mounted device 100, but instead send the distribution audio data. In this case, the distribution audio data sent to the vehicle-mounted device 100 may be, for example, background music played by passengers of the vehicle 10 before the video distribution begins. Furthermore, if the real-time distributor is not communicating with the passengers of the vehicle 10, the processor 210 may also choose not to send the distribution audio data to the vehicle-mounted device 100, but instead send the distribution video data.

[0037] Furthermore, the processor 210 receives passenger voice data from the in-vehicle device 100. Based on the received passenger voice data, the processor 210 causes the speaker 290 to output the passenger's voice. Thus, the real-time distributor can grasp the content of the passenger's speech. In this way, by sending distribution-related audio data to the in-vehicle device 100 and receiving passenger voice data from the in-vehicle device 100 via the processor 201, the real-time distributor can communicate with the passengers of the vehicle 10.

[0038] Furthermore, the processor 210 receives passenger image data from the in-vehicle device 100. Based on the received passenger image data, the processor 210 causes the display 280 to output the passenger's image. Thus, the real-time distributor can monitor the passenger's situation.

[0039] The processor 210 may not necessarily receive both passenger image data and passenger voice data from the in-vehicle device 100. If the real-time distributor does not need passenger images of vehicle 10, the processor 210 may receive passenger voice data from the in-vehicle device 100 instead. Furthermore, if the real-time distributor needs to confirm the passenger images of vehicle 10 without listening to the passengers' speech, the processor 210 may receive passenger image data from the in-vehicle device 100 instead of passenger voice data.

[0040] At this point, it is assumed that the transmission of both the distribution image data and the distribution voice data is carried out via network N1 using a mobile line. In this case, depending on the communication speed of the mobile line, the transmission of at least one of the distribution image data and the distribution voice data may sometimes be delayed. Furthermore, it is assumed that the reception of both passenger image data and passenger voice data is carried out via network N1 using a mobile line. In this case, depending on the communication speed of the mobile line, the reception of at least one of the passenger image data and passenger voice data may also be delayed.

[0041] Therefore, processor 210 transmits the audio data for distribution to vehicle-mounted device 100 via network N1. Furthermore, processor 210 transmits the video data for distribution to vehicle-mounted device 100 via network N2. Additionally, processor 210 receives passenger voice data from vehicle-mounted device 100 via network N1. Furthermore, processor 210 receives passenger video data from vehicle-mounted device 100 via network N2. In other words, processor 210 uses mobile lines to transmit the audio data for distribution and receive the passenger voice data, and uses bundled lines to transmit the video data for distribution and receive the passenger video data.

[0042] It should be noted that in this embodiment, the transmission of distribution image data and the reception of passenger image data are performed using a bundled line. However, the transmission of distribution image data and the reception of passenger image data do not necessarily have to be performed using a bundled line. As long as the throughput is higher than that of the mobile line, the transmission of distribution image data and the reception of passenger image data can, for example, be performed using a dedicated high-speed line for image data transmission and reception.

[0043] (flow chart)

[0044] Next, based on Figure 3 The processing performed by the processor 210 in the distribution server 200 in the distribution system 1 will be described. Figure 3 This is a flowchart of the process executed by processor 210. This process involves transmitting distribution image data and distribution sound data, as well as receiving passenger image data and passenger voice data. This process is repeatedly executed at predetermined intervals after real-time distribution begins. Therefore, the transmission of distribution image data and distribution sound data, as well as the reception of passenger image data and passenger voice data, can be performed in real time.

[0045] exist Figure 3In the process shown, firstly, in S101, image data and audio data for distribution are acquired. That is, in S101, image data of the distributor acquired by camera 260 and audio data of the distributor acquired by microphone 270 are acquired. Next, in S102, the image data for distribution is transmitted to the vehicle-mounted device 100 using a bundled line. Furthermore, in S103, the audio data for distribution is transmitted to the vehicle-mounted device 100 using a mobile line. Then, Figure 3 The processing shown is now complete.

[0046] In parallel with the processing in S101, in the processing in S104, passenger image data transmitted by the vehicle-mounted device 100 is received. Here, the passenger image data is received using a bundled cable. Furthermore, in S105, passenger voice data transmitted by the vehicle-mounted device 100 is received. Here, the passenger voice data is received using a mobile cable. Then, in S106, the received passenger voice data is output from the speaker 290. Furthermore, in S106, the received passenger image data is output to the display 280. Then... Figure 3 The processing shown is now complete.

[0047] As described above, in distribution system 1, distribution video data is transmitted using a bundled line, and distribution audio data is transmitted using a mobile line. Furthermore, in distribution system 1, passenger video data is received using a bundled line, and passenger voice data is received using a mobile line. In other words, video data (distribution video data and passenger video data) is transmitted (sent or received) using a bundled line, and audio data (distribution audio data and passenger voice data) is transmitted (sent or received) using a mobile line.

[0048] Here, it is assumed that the data capacity of the distribution image data and passenger image data (hereinafter, sometimes simply referred to as "image data") is larger than the data capacity of the distribution voice data and passenger voice data (hereinafter, sometimes simply referred to as "voice data"). Therefore, by using bundled lines with a higher throughput than mobile lines for image data communication, communication delays for image data can be suppressed.

[0049] Furthermore, as mentioned above, sometimes audio data communication is performed instead of video data communication. In this case, audio data communication using mobile lines is performed instead of using bundled lines. This allows audio data to be transmitted using low-cost mobile lines instead of bundled lines, which have high communication costs. As a result, communication costs can be reduced, and the quality of both video and audio data communication can be ensured.

[0050] It should be noted that the vehicle-mounted device 100 uses bundled lines to receive distributed video data and transmit passenger video data, and uses mobile lines to receive distributed audio data and transmit passenger voice data. In this case, the communication cost in the vehicle-mounted device 100 can be suppressed, and the quality of video data communication and audio data communication can be ensured.

[0051] <Other Implementation Methods>

[0052] The above-described embodiments are merely examples, and this disclosure can be implemented with appropriate modifications without departing from its spirit. Furthermore, the processes and units described in this disclosure can be freely combined and implemented as long as no technical contradictions arise.

[0053] Furthermore, processes described as being performed by one device can also be performed by multiple devices. Alternatively, processes described as being performed by different devices can also be performed by one device. In a computer system, the hardware configuration (server configuration) used to implement each function can be flexibly changed.

[0054] This disclosure can also be implemented by supplying a computer program that implements the functions described in the above embodiments to a computer, which then reads and executes the program using one or more processors. Such a computer program can be provided to the computer either via a non-transitory computer-readable storage medium that can be connected to the computer's system bus or via a network. Non-transitory computer-readable storage media include, for example, any type of disk suitable for storing electronic instructions, such as a disk (floppy disk or hard disk drive (HDD), optical disk (CD-ROM, DVD, or Blu-ray disc), read-only memory (ROM), random access memory (RAM), EPROM, EEPROM (Electrically Erasable Programmable Read Only Memory), magnetic card, flash memory, or optical card.

Claims

1. An information processing device comprising a control unit, wherein, The control unit is configured to perform the following actions: The first line is used for image data communication; and Use a second line for voice data communication. The image data is data from at least one of the images provided to the vehicle's passengers for real-time distribution and images of the vehicle's passengers. The sound data is data from at least one of the sound used for real-time distribution and the voice of the passengers in the vehicle. The first line has a higher throughput than the second line.

Citation Information

Patent Citations

  • Information distribution system and information distribution method

    JP2005354489A