Distribution apparatus, distribution method, and computer program product

Abstract

The present application provides a kind of distribution device, distribution method and computer program product, in the case where multiple display devices are used to watch distribution image, the convenience of audience watching distribution image is improved.Distribution server (200) obtains user identification information and device information contained in distribution request, in the case where the obtained user identification information corresponds to multiple device information, it is determined whether the device information of first display device (400A) and second display device (400B) is contained in multiple device information, in the case where the device information of first display device (400A) and second display device (400B) is contained, the second display mode in the display mode of first display device (400A) that is first display mode and the display mode of second display device (400B) is selected, and the distribution image corresponding to distribution request is distributed to first display device or second display device in the manner that display mode corresponds to the selected second display mode.

Description

Technical Field

[0001] This invention relates to a distribution device, a distribution method, and a computer program product. Background Technology

[0002] In recent years, initiatives to provide sustainable transportation systems that take into account vulnerable groups among transportation participants, such as the elderly, people with disabilities, and children, have become increasingly active. To realize these initiatives, research and development efforts are focused on further improving the safety and convenience of transportation through the development of mobility options for vulnerable groups.

[0003] For example, when people in a vulnerable position access transportation systems, they consider not only their own travel on the vehicle but also the methods by which audiovisual media are distributed. By watching these distributed media, they can experience the feeling of going out or traveling.

[0004] Patent Document 1 discloses a terminal device comprising: a sharing unit that shares a screen displayed at the first screen resolution in a head-mounted display at a second screen resolution lower than the first screen resolution; and a display unit that displays the screen shared by the sharing unit. When a specific usage condition is detected, the terminal device sets first resolution information in the head-mounted display for the sharing unit to share at the first screen resolution.

[0005] [Existing Technical Documents]

[0006] [Patent Literature]

[0007] Patent Document 1: International Publication No. 2017 / 138143 Summary of the Invention

[0008] [The problem the invention aims to solve]

[0009] However, there is room to improve user convenience when the distributed images distributed from the distribution server are also transmitted to other display devices and viewed on multiple display devices.

[0010] The present invention was made in view of the above circumstances, and its object is to improve the convenience of viewers of audiovisually distributed images when using multiple display devices for audiovisual distribution. Furthermore, by connecting remote locations and vehicles, it helps to support good connectivity between urban areas and local areas represented by urban peripheries, and contributes to the development of a sustainable transportation system.

[0011] [Methods used to solve problems]

[0012] The distribution device disclosed herein comprises: a communication unit for receiving a distribution request; a storage unit for storing user identification information that identifies a user and device information that identifies the display device used by the user; and a control unit for performing the following processes: generating a distribution image based on a captured image received from a distributor terminal; acquiring the user identification information and device information contained in the distribution request; if the acquired user identification information corresponds to multiple pieces of device information, determining whether the multiple pieces of device information include device information for a first head-mounted display device and a second display device other than the head-mounted display device; if the multiple pieces of device information include device information for both the first display device and the second display device, selecting a second display mode from a first display mode as the display mode for the first display device and a second display mode as the display mode for the second display device, and distributing the distribution image corresponding to the distribution request to the first display device or the second display device corresponding to the acquired device information in a manner that the display mode corresponds to the selected second display mode;

[0013] [Invention Effects]

[0014] According to this disclosure, when the display devices corresponding to the user identification information included in the distribution request include a first display device and a second display device, a second display mode is selected, and the distribution image corresponding to the distribution request is distributed to the first display device or the second display device in a manner that the display mode corresponds to the selected second display mode. Therefore, user convenience can be improved when the distribution image distributed from the distribution server is transferred to other display devices and the distribution image is viewed on multiple display devices. Attached Figure Description

[0015] Figure 1 This is a diagram showing the system architecture of the distribution system.

[0016] Figure 2 A block diagram illustrating the structure of the vehicle-mounted device and the distribution server.

[0017] Figure 3 This is a diagram showing the structure of the user registration database.

[0018] Figure 4 This is a diagram showing the structure of the distribution management database.

[0019] Figure 5 This is a structural block diagram of the distributor device.

[0020] Figure 6 This is a block diagram showing the structure of the first display device.

[0021] Figure 7 This is a block diagram showing the structure of the second display device.

[0022] Figure 8 This is a flowchart illustrating the first action of the distribution server.

[0023] Figure 9 This is a flowchart illustrating the second action of the distribution server.

[0024] Figure 10 This is a flowchart illustrating the operation of the first display device. Detailed Implementation

[0025] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0026] [Implementation Method]

[0027] [1. Structure of the distribution system]

[0028] Figure 1 This is a diagram showing the system architecture of distribution system 1.

[0029] The distribution system 1 includes a vehicle-mounted device 30, a distributor terminal 100 used by the distributor S, a distribution server 200, and a display device 400 used by the viewer U. It is a system for live streaming content containing images captured by the distributor terminal 100.

[0030] Live streaming refers to the real-time distribution of images captured by the distributor's terminal 100 to the display device 400, with the participation of both the distributor and an unspecified audience. The images can be still images or moving images.

[0031] The vehicle-mounted device 30 is mounted on the vehicle 3 and is wirelessly connected to the distributor terminal 100 held by the distributor S, who is an occupant of the vehicle 3, via near-field wireless communication or the like.

[0032] The vehicle-mounted device 30 receives content data from the distributor terminal 100, which includes images captured by the camera of the distributor terminal 100 and sound input from the microphone of the distributor terminal 100. The vehicle-mounted device 30 uploads the received content data to the distribution server 200.

[0033] The distributor terminal 100 can be a smartphone or tablet PC (Personal Computer), or a digital camera or a camera capable of capturing a 360-degree view of the surroundings. In this case, the microphone and camera can also be configured separately.

[0034] The distribution server 200 stores the content received from the vehicle-mounted device 30 in its server storage unit. The distribution server 200 distributes the uploaded content data to the display device 400 of the viewer U. Live streaming technologies can be implemented using well-known technologies such as HLS (HTTP Live Streaming), CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), and RTMP (Real-Time Messaging Protocol).

[0035] Display device 400 is a terminal device held by a viewer U who is watching content data distributed from distribution server 200. Figure 1 In the diagram, N audience members U are represented by U1, U2, ..., UN. N is an arbitrary natural number. Furthermore, in... Figure 1 In the middle, as a display device 400, a first head-mounted display device 400A worn on the head by viewers U1 and U2 and a second display device 400B held by viewer UN are shown.

[0036] Display device 400 includes a first display device 400A and a second display device 400B. The first display device 400A is a head-mounted display device that displays images and is worn on the head of the viewer U. The first display device 400A can be either transmissive or non-transmissive, as long as it can display content distributed from the distribution server 200.

[0037] The second display device 400B is a non-head-mounted display device whose image display unit is not worn on the head of the viewer U. The first display device 400A may be a portable or mobile terminal device such as a smartphone, tablet PC, or laptop PC, or a fixed terminal device such as a desktop PC.

[0038] Communication network 5 is a wired or wireless transmission path for information sent from devices connected to communication network 5. For example, communication network 5 may also include public networks such as the Internet, mobile communication networks, and satellite communication networks, as well as various LANs (Local Area Networks) and WANs (Wide Area Networks) including Ethernet. Additionally, communication network 5 may also include private networks such as IP-VPN (Internet Protocol-Virtual Private Network).

[0039] [2. Structure of the vehicle-mounted device]

[0040] Figure 2 A diagram illustrating the structure of the vehicle-mounted device 30 and the distribution server 200.

[0041] First, refer to Figure 2 The structure of the vehicle-mounted device 30 will be described.

[0042] The vehicle-mounted device 30 includes an external communication interface 31, an in-vehicle short-range wireless communication interface 32, an in-vehicle communication interface 33, a touch panel 34, a sound processing unit 35, a speaker 36, and an in-vehicle ECU (Electronic Control Unit) 300.

[0043] The external communication interface 31 is a communication module that performs wireless communication according to mobile communication standards such as LTE (Long Term Evolution), 4G (Generation), 5G, and Wi-Fi. The external communication interface 31 is connected to the communication network 5 via an antenna (not shown) and exchanges data with the distribution server 200.

[0044] The vehicle-mounted near-field wireless communication interface 32 is, for example, a communication module that communicates according to NFC (Nearfield communication) communication standards such as Bluetooth (registered trademark) and Wi-Fi. The vehicle-mounted near-field wireless communication interface 32 communicates wirelessly with a terminal device held by the occupant, and receives images and sounds captured by the terminal device.

[0045] The in-vehicle communication interface 33 is an input / output interface connected to an in-vehicle network (not shown). The in-vehicle network may use a communication bus corresponding to communication standards such as CAN (Controller Area Network), CAN-FD (CAN with Flexible Data Rate), or Ethernet. The in-vehicle communication interface 33 communicates with vehicle ECU 40, other relay devices, and other in-vehicle equipment via the in-vehicle network.

[0046] The touch panel 34 includes a display panel such as a liquid crystal panel or an organic EL (Electro-Luminescence) panel, and a touch sensor. The touch sensor detects touch operations performed by the distributor S on the touch panel 34 and outputs position information indicating the location of the detected touch operation to the first control unit 330.

[0047] The sound processing unit 35, for example, converts the digital sound data output by the first control unit 330 into an analog sound signal. The sound processing unit 35 amplifies the converted analog sound signal and outputs the amplified sound signal through the speaker 36.

[0048] The vehicle-mounted ECU 300 has an input / output interface 310 and a first control unit 330.

[0049] The input / output interface 310 functions as a connection between the external communication interface 31, the in-vehicle short-range wireless communication interface 32, the in-vehicle communication interface 33, the touch panel 34, the sound processing unit 35, and the first control unit 330. The input / output interface 310 includes connectors and interface circuitry, and outputs data input from the external communication interface 31, the in-vehicle short-range wireless communication interface 32, the in-vehicle communication interface 33, the touch panel 34, and the sound processing unit 35 to the first control unit 330. Furthermore, the input / output interface 310 outputs data input from the first control unit 330 to the external communication interface 31, the in-vehicle short-range wireless communication interface 32, the in-vehicle communication interface 33, the touch panel 34, or the sound processing unit 35.

[0050] The first control unit 330 is a computer device having a first memory 340 and a first processor 350.

[0051] The first memory 340 may include, for example, volatile semiconductor memory and non-volatile semiconductor memory. The first memory 340 may also include only non-volatile semiconductor memory. Alternatively, the first memory 340 may have an auxiliary storage device such as an SSD (Solid State Drive). The first memory 340 stores control programs 345 executed by the first processor 350, setting data specifying the operation of the vehicle-mounted device 30, etc.

[0052] The first processor 350 is, for example, a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit) or other computing device. The first processor 350 may consist of a single processor or multiple processors. Alternatively, the first processor 350 may also consist of a System-on-a-Chip (SoC) that integrates part or all of the first memory 340 with other circuitry.

[0053] The vehicle-mounted ECU 300 receives captured images and sounds from the distributor terminal 100 and uploads the received images and sounds to the distribution server 200.

[0054] [3. Structure of the distribution server]

[0055] Next, the structure of the distribution server 200 will be explained.

[0056] The distribution server 200 includes a network communication interface 210 and a second control unit 230.

[0057] The network communication interface 210, for example, is equipped with a communication card such as a NIC (Network Interface Card), and communicates with the vehicle-mounted device 30, the distributor terminal 100, and the display device 400 via the communication network 5. The network communication interface 210 is equivalent to the communication unit of the distributor device.

[0058] The second control unit 230 is a computer device equipped with a second memory 240 and a second processor 250.

[0059] The second memory 240 may include, for example, volatile semiconductor memory and non-volatile semiconductor memory. The second memory 240 may also be a structure that only includes non-volatile semiconductor memory. Alternatively, the second memory 240 may be a structure that includes auxiliary storage devices such as HDD (Hard Disk Drive) or SSD.

[0060] The second memory 240 stores the control program 241, the user registration database 243, the distribution management database 245, and the content database 247 executed by the second processor 250.

[0061] Figure 3 This is a diagram showing the structure of the user registration database 243.

[0062] A record in the user registration database 243 includes a user ID, the user's personal information, an APP_ID, device information, and priority ranking information. APP is an abbreviation for an application. Priority ranking information indicates the ranking of the user's priority.

[0063] The user ID is identification information used to identify users who use the image distribution service provided by the distribution server 200. Users include distributors S and viewers U.

[0064] Personal information refers to the personal information of the distributor S as the user and the viewer U, such as name, address, gender, age, etc.

[0065] APP_ID is identification information that identifies an application that has been downloaded to the distributor terminal 100 or display device 400 and installed.

[0066] Distributor S and viewer U download the APP from the designated website and install it on distributor terminal 100 and display device 400 respectively.

[0067] The device information indicates whether the display device 400 with the APP_ID installed is the first display device 400A or the second display device 400B. In other words, the device information indicates whether it is a head-mounted display device or a smartphone, tablet PC, or laptop PC other than a head-mounted display device. The device information also includes communication information with the display device 400, such as its IP address.

[0068] Priority ranking information indicates the priority ranking of the display device 400 corresponding to multiple device information entries when multiple device information entries are registered and associated with the same user ID. Priority ranking information is required when the display device 400 transfers a distribution image distributed from the distribution server 200 to other display devices 400 associated with the same user ID via mirroring. The distribution server 200 compares the priority ranking of the display device 400, which is the source of the distribution request, with the priority ranking of other display devices 400 from which the distribution image is transferred, and distributes the distribution image according to the display mode of the display device 400 with the higher priority ranking.

[0069] The display modes include a first display mode corresponding to the first display device 400A and a second display mode corresponding to the second display device 400B. Details of the first and second display modes will be described later.

[0070] Figure 4 This is a diagram showing the structure of the distribution management database 245.

[0071] A record in the distribution management database 245 contains a distribution ID that identifies the distribution, the user ID of the distributor S, the user ID of the audience U, and the date and time the distribution started.

[0072] return Figure 2 Next, we will explain the structure of the distribution server 200.

[0073] The second processor 250 is, for example, a processing unit such as a CPU or an MPU. The second processor 250 can be composed of a single processor or multiple processors. Alternatively, the second processor 250 can also be composed of a System-on-a-Chip (SoC) that integrates part or all of the second memory 240 with other circuitry.

[0074] The second control unit 230 registers the content data, including the distributed image and sound, uploaded from the distributor terminal 100 into the content database 249. Additionally, if the second control unit 230 receives a distribution request, it reads the content data specified by the received distribution request from the content database 249 and distributes the read content data to the display device 400, which is the source of the distribution request.

[0075] [4. Structure of the Distributor Terminal]

[0076] Figure 5 A block diagram illustrating the structure of the distributor terminal 100.

[0077] The distributor terminal 100 includes a wireless communication interface 110, a near-field wireless communication interface 120, a camera 130, a touch panel 140, a microphone 151, a speaker 153, and a third control unit 170.

[0078] The wireless communication interface 110 is a communication module that performs wireless communication according to mobile communication standards such as LTE, 4G, 5G, and Wi-Fi. The wireless communication interface 110 is connected to the communication network 5 via an antenna (not shown) and exchanges data with the distribution server 200.

[0079] The near-field wireless communication interface 120 is, for example, a communication module that communicates according to NFC communication standards such as Bluetooth and Wi-Fi. The near-field wireless communication interface 120 transmits the images captured by the camera 130 and the sound input by the microphone 151 to the vehicle device 30 through near-field wireless communication with the vehicle device 30.

[0080] The camera 130 is a shooting device equipped with an image sensor and a data processing circuit. The image sensor is composed of, for example, a CCD (Charge-Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor). The data processing circuit generates a captured image based on the output of the image sensor. The captured image generated by the camera 130 is sent to the vehicle-mounted device 30 under the control of the third control unit 170.

[0081] The touch panel 140 includes a display panel such as an LCD panel or an OLED panel and a touch sensor. The touch panel 140 functions as a display unit for displaying images and a receiving unit for receiving operations from the distributor S.

[0082] Microphone 151 is a sound input device for inputting the sound of the transmitter S, and speaker 153 is a sound output device for outputting the sound of the audience U, etc.

[0083] The third control unit 170 is a computer device equipped with a third memory 180 and a third processor 190.

[0084] The third memory 180 is a non-volatile semiconductor memory. Alternatively, the third memory 180 may also have an auxiliary storage device such as an SD card. The third memory 180 stores control programs such as an OS (operating system) 181 and an APP 183. The APP 183 is an application that communicates with the distribution server 200, displays dynamic images contained in the content distributed by the distribution server 200 on the touch panel 140, and outputs the sound contained in the content to the speaker 153.

[0085] The third processor 190 is, for example, a CPU, MPU, or other computing device. The third processor 190 can consist of a single processor or multiple processors.

[0086] [5. Structure of the display device]

[0087] Figure 6 This is a block diagram showing the structure of the first display device 400A.

[0088] The first display device 400A includes a near-field wireless communication interface 401A, an image display unit 403A, a sensor unit 405A, and a fourth control unit 410A.

[0089] The near-field wireless communication interface 401A is a communication module that communicates according to NFC communication standards such as Bluetooth and Wi-Fi. The near-field wireless communication interface 401A can wirelessly connect to the communication network 5 via a Wi-Fi router (not shown) installed at the viewer's home, etc. The near-field wireless communication interface 401A is equivalent to a device communication unit.

[0090] The image display unit 403A includes a display panel such as a liquid crystal panel or an organic EL panel (not shown), and a light guide plate that directs the image light emitted from the display panel toward the eyes of the viewer U, and is worn on the head of the viewer U.

[0091] Sensor unit 405A, for example, is mounted on image display unit 403A to detect the movement of the viewer U's head. Sensor unit 405A is, for example, a motion sensor including a three-axis accelerometer and a three-axis gyroscope. Alternatively, sensor unit 405A may also have a structure incorporating a three-axis magnetometer. In this case, sensor unit 405A may also be an IMU (Inertial Measurement Unit) modularly composed of a three-axis accelerometer, a three-axis gyroscope, and a three-axis magnetometer.

[0092] Microphone 407A collects the sound emitted by the audience U, and speaker 409A outputs the sound.

[0093] The fourth control unit 410A is a computer device equipped with a fourth memory 420A and a fourth processor 430A.

[0094] The fourth memory 420A is a non-volatile semiconductor memory. Alternatively, the fourth memory 420A can also be a structure combining volatile and non-volatile semiconductor memory. The fourth memory 420A stores OS 421A and APP 423A. APP 423A is an application that: communicates data with the distribution server 200, displays dynamic images contained in the content distributed by the distribution server 200 on the image display unit 403A, and outputs sound contained in the content to the speaker 153.

[0095] The fourth processor 430A is, for example, a CPU, MPU, or other arithmetic processing device. The fourth processor 430A can consist of a single processor or multiple processors.

[0096] Viewer U operates display device 400 to launch APP 423A, for example, by accessing a webpage provided by distribution server 200 and selecting a channel and program they wish to watch from the programs provided by distribution server 200. Additionally, viewer U selects whether to mirror the content distributed from distribution server 200 to another display device 400 for display. When mirroring to another display device 400, viewer U selects display device 400 as the mirroring destination. When viewer U selects the channel and program, the presence or absence of mirroring, and the display device 400 as the mirroring destination, the fourth control unit 410A of display device 400 sends a distribution request containing user ID, APP_ID, channel information, program information, and mirroring information to distribution server 200. Mirroring information includes information indicating the presence or absence of mirroring, and, if mirroring exists, device information or APP_ID of the display device 400 that is the mirroring counterpart.

[0097] Figure 7 This is a block diagram showing the structure of the second display device 400B.

[0098] like Figure 7 As shown, the second display device 400B includes a wireless communication interface 451B, a near-field wireless communication interface 452B, a camera 453B, a touch panel 454B, a microphone 455B, a speaker 456B, and a fifth control unit 460B. The structure of the second display device 400B is similar to... Figure 5 The structure of the distributor terminal 100 shown is the same, so the description is omitted.

[0099] [6. Actions of the distribution server]

[0100] Next, the operation of the distribution server 200 will be explained.

[0101] The second control unit 230 receives a distribution request from the display device 400. The distribution request includes the user ID, APP_ID, channel information, program information, and mirroring information.

[0102] APP_ID is information that indicates the APP installed on the display device 400, which is the source of the distribution request.

[0103] Mirroring information indicates whether a distribution image distributed from distribution server 200 will be transferred to another display device 400 corresponding to the same user ID via mirroring. If mirroring is enabled, the distribution request includes the device information or APP_ID of the display device 400 that is the mirror counterpart.

[0104] The second control unit 230 determines the priority of the display device 400, which is the source of the received distribution request (i.e., the display device 400 that sent the distribution request to the distribution server 200), and the display device 400, which is the destination of the mirror-based distribution image.

[0105] For example, suppose the display device 400 that is the source of the distribution request is the first display device 400A, and the display device 400 that is the destination of the distributed image is the second display device 400B. If the priority of the first display device 400A is higher than that of the second display device 400B, the second control unit 230 distributes the distributed image to the first display device 400A according to the display mode of the first display device 400A. Conversely, if the priority of the second display device 400B is higher than that of the first display device 400A, the second control unit 230 distributes the distributed image to the first display device 400A according to the display mode of the second display device 400B.

[0106] The display modes include a first display mode corresponding to the first display device 400A and a second display mode corresponding to the second display device 400B.

[0107] The first display mode is the display mode corresponding to the first display device 400A, which is a head-mounted display device.

[0108] The first display mode is a mode in which the range of the captured image distributed as a distributed image changes in response to the head movements of the user wearing the first display device 400A.

[0109] In the first display mode, the second control unit 230 continuously receives sensor data representing the user's head movements from the first display device 400A. Based on the sensor data received from the first display device 400A, the second control unit 230 calculates the direction of head rotation and the amount of rotation in that direction. Based on the calculated direction and amount of head rotation, the second control unit 230 adjusts the area cropped from the captured image for image distribution.

[0110] For example, if the user turns their head to the right, the second control unit 230 moves the area captured from the captured image to the right by an amount corresponding to the determined amount of head rotation.

[0111] Furthermore, if the user rotates their head to the left, the second control unit 230 moves the area captured from the captured image to the left by an amount corresponding to the determined amount of head rotation.

[0112] The second display mode is the display mode of the non-head-mounted second display device 400B. The second display mode is a display mode that does not change the depiction range of the distributed image distributed to the second display device 400B. When the display mode is the second display mode, the second control unit 230 always cuts a certain range of the captured image uploaded from the vehicle-mounted device 30 and distributes the cut image as a distributed image to the display device 400.

[0113] The priority ranking information registered in the user registration database 243 can be changed by receiving setting change information from the display device 400.

[0114] For example, when the display device 400 is a first display device 400A, the first display device 400A accepts operations from an operation panel such as a touchpad (not shown) and generates setting change information based on the accepted operations. The first display device 400A then sends the generated setting change information to the distribution server 200.

[0115] In addition, when the display device 400 is a second display device 400B, the second display device 400B accepts the operation of the viewer U via a remote control (not shown) or a touch panel 454 B, and generates setting change information based on the accepted operation. The second display device 400B sends the generated setting change information to the distribution server 200.

[0116] Furthermore, assuming that the distribution server 200 distributes a distribution image to the first display device 400A in a second display mode, and the first display device 400A forwards content to the second display device 400B via mirroring. When the wireless connection between the first display device 400A and the second display device 400B is severed, and the distribution of the distribution image to the second display device 400B ends, the first display device 400A sends a disconnection notification to the distribution server 200, indicating that the connection with the second display device 400B has been severed. Upon receiving the disconnection notification, the second control unit 230 changes the distribution image distributed to the first display device 400A from the second display mode back to the first display mode.

[0117] You can register priority settings in the user registration database 243.

[0118] For example, if the user does not assign a priority to any of the multiple display devices 400, the default selected display mode can be registered as setting information. Furthermore, if multiple device information entries are registered and associated with a single user ID, the second control unit 230 can determine the priority based on the types of devices represented by these multiple device information entries and store the priority as setting information in the second memory 240. Additionally, if the device information associated with the user ID included in the distribution request includes a display device 400 other than the first display device 400A, it can be set to display in the second display mode in the setting information.

[0119] Figure 8 This is a flowchart illustrating the first action of the distribution server 200.

[0120] Reference Figure 8 The flowchart shown illustrates the first action of the distribution server 200.

[0121] First, the second control unit 230 determines whether a distribution request has been received (step S1). If no distribution request has been received (step S1 / No), the second control unit 230 waits until a distribution request is received.

[0122] When the second control unit 230 receives a distribution request (step S1 / Yes), it obtains the user ID, APP_ID, and mirroring information contained in the received distribution request (step S2). Based on the obtained mirroring information, the second control unit 230 determines whether the display device 400, as the source of the distribution request, should mirror other display devices 400 (step S3).

[0123] When the second control unit 230 determines that the display device 400, which is the source of the distribution request, does not perform mirroring (step S3 / No), it retrieves device information corresponding to the obtained APP_ID from the user registration database 243. The second control unit 230 then distributes the distribution image in a display mode corresponding to the obtained device information (step S4). That is, if the obtained device information is the first display device 400A, the second control unit 230 distributes the distribution image in a first display mode; if the obtained device information is the second display device 400B, it distributes the distribution image in a second display mode.

[0124] Furthermore, when the second control unit 230 determines that mirroring is to be implemented (step S3 / Yes), it determines whether the display device represented by the device information corresponding to the obtained APP_ID is the first display device 400A (step S5). If the device information corresponding to the APP_ID is not the first display device 400A (step S5 / No), the second control unit 230 distributes the distribution image to the second display device 400B corresponding to the device information in the second display mode (step S7). That is, the second display device 400B is included in the display device 400 that distributes the distribution image, therefore, the distribution server 200 distributes the distribution image in the display mode of the second display device 400B, i.e., the second display mode.

[0125] In addition, if the device information corresponding to APP_ID is the first display device 400A (step S5 / Yes), the second control unit 230 determines whether the display device 400, which is the mirror destination, is the second display device 400B (step S6).

[0126] When the display device 400, which serves as the mirror destination, is a second display device (step S6 / Yes), the second control unit 230 distributes the distribution image to the first display device 400A corresponding to the device information in a second display mode (step S7). Since the second display device 400B is included in the display device 400 that distributes the distribution image, the distribution server 200 distributes the distribution image in the display mode of the second display device 400B, i.e., the second display mode.

[0127] In addition, if the display device 400 that serves as the mirror destination is the first display device 400A (step S6 / No), the second control unit 230 distributes the image to the first display device 400A corresponding to the device information in the first display mode (step S8).

[0128] Figure 9 This is a flowchart illustrating the second action of the distribution server 200.

[0129] Reference Figure 9The flowchart shown illustrates the second action of the distribution server 200. Furthermore, the actions of steps S21 to S24 are similar to... Figure 8 The first action shown is the same, so the explanation is omitted.

[0130] When the second control unit 230 determines that a mirroring operation is to be performed based on the mirroring information (step S23 / Yes), it refers to the user registration database 243 and compares the priority of the display device 400, which is the distribution destination of the distribution server 200, with the priority of the display device 400, which is the forwarding destination of the distribution image transferred by the display device 400 (step S24).

[0131] When the display device 400 with the highest priority is the display device 400 that is the destination of the transfer (step S25 / Yes), the second control unit 230 distributes the distribution image to the display device 400 that is the destination of the transfer in a display mode corresponding to the display device 400 that is the destination of the transfer (step S26).

[0132] In addition, if the display device 400 with the highest priority is the display device 400 that is the destination of the distribution (step S25 / No), the second control unit 230 distributes the distribution image to the display device 400 that is the destination of the distribution in a display mode corresponding to the display device 400 that is the destination of the distribution (step S27).

[0133] Figure 10 This is a flowchart illustrating the operation of the first display device 400A.

[0134] Reference Figure 10 The flowchart shown illustrates the operation of the first display device 400A.

[0135] Figure 10 The flowchart shown illustrates the following actions: distribution server 200 distributes a distribution image to first display device 400A in a first display mode, and first display device 400A forwards the distribution image to second display device 400B in mirror mode.

[0136] First, the fourth control unit 410A of the first display device 400A determines whether a distributed image distributed from the distribution server 200 has been received (step T1). If no distributed image is received (step T1 / No), the fourth control unit 410A waits until a distributed image is received.

[0137] When the fourth control unit 410A receives the distributed image (step T1 / Yes), it determines whether the first display device 400A is set to mirror mode (step T2). If it is not set to mirror mode (step T2 / No), the fourth control unit 410A causes the image display unit 403A to display the received distributed image (step T3). Then, the fourth control unit 410A determines whether the distribution of the distributed image has ended (step T4). If the distribution of the distributed image has not ended (step T4 / No), the fourth control unit 410A returns to step T3 and causes the image display unit 403A to display the distributed image received from the distribution server 200. Furthermore, when the distribution of the distributed image ends (step T4 / Yes), the fourth control unit 410A terminates the processing flow.

[0138] When the first display device 400A is set to mirror mode (step T2 / Yes), the fourth control unit 410A forwards the received distributed image to the second display device 400B, which is the forwarding destination (step T5), and causes the image display unit 403A to display the received distributed image (step T6).

[0139] Next, the fourth control unit 410A determines whether sensor data indicating the head movement of the audience member U has been input from the sensor unit 405A (step T7). If no sensor data has been input (step T7 / No), the fourth control unit 410A returns to the processing of step T1.

[0140] When the fourth control unit 410A inputs sensor data (step T7 / Yes), it determines, based on the input sensor data, whether the change in the movement of the spectator U's head is greater than a threshold (step T8).

[0141] If the change in the movement of the viewer U's head exceeds a threshold (step T8 / Yes), the fourth control unit 410A interrupts the transmission of the distributed image to the second display device 400B (step T9). Since the transmission of the distributed image from the first display device 400A is interrupted, the second display device 400B sets the display of the touch panel 454B to off.

[0142] Furthermore, if the amount of change in the movement of the viewer U's head is below a threshold (step T8 / No), the fourth control unit 410A determines whether the transmission of the distributed image to the second display device 400B is being interrupted (step T10).

[0143] Furthermore, if the image transmission to the second display device 400B is interrupted (step T10 / Yes), the fourth control unit 410A restarts the image transmission to the second display device 400B (step T11). Then, the fourth control unit 410A determines whether the image transmission from the distribution server 200 has ended (step T12). Additionally, if the image transmission to the second display device 400B is not interrupted (step T10 / No), the fourth control unit 410A also determines whether the image transmission from the distribution server 200 has ended (step T12).

[0144] If the image distribution from the distribution server 200 has not ended (step T12 / No), the fourth control unit 410A returns to the determination in step T7. Furthermore, if the image distribution from the distribution server 200 has ended (step T12 / Yes), the fourth control unit 410A terminates the processing flow.

[0145] [7. Variations]

[0146] The above embodiments are preferred embodiments of the present invention. However, the invention is not limited to the above embodiments, and various modifications can be made without departing from the spirit of the invention.

[0147] For example, Figure 8 and Figure 9 The processing units in the flowchart shown are divided according to the main processing content for easy understanding of the processing of the distribution server 200. This invention is not limited to... Figure 8 and Figure 9 The flowchart illustrates the method and name for dividing the processing units. Furthermore, the processing of the distribution server 200 can be divided into more processing units based on the processing content, or it can be divided into a single processing unit containing more processing. Additionally, the processing order in the flowchart is not limited to the example shown. Figure 10 The flowchart illustrating the operation of the first display device 400A is also shown.

[0148] Furthermore, in the above embodiment, the distribution server 200 distributed the distribution image to the first display device 400A. However, the distribution server 200 may also distribute the distribution image to both the first display device 400A and the second display device 400B. In this case, the first display device 400A also sends motion information representing the user's head movement to the distribution server 200. Based on the motion information received from the first display device 400A, the distribution server 200 determines the range of images to be distributed from the captured images.

[0149] For example, in the above embodiment, the situation of photographing the interior of vehicle 3 by one distributor terminal 100 was described, but it is also possible to configure multiple distributor terminals 100 to be installed in vehicle 3, and to photograph the interior of vehicle 3 by these multiple distributor terminals 100.

[0150] Furthermore, in the above embodiment, the following structure is shown: the distributor terminal 100 is connected to the vehicle-mounted device 30 via short-range wireless communication, and the distributor terminal 100 sends captured images to the vehicle-mounted device 30. However, it can also be configured such that the distributor terminal 100 uploads the captured images to the distribution server 200, and the distribution server 200 uploads the captured images to the vehicle-mounted device 30. The distributor S visually confirms the preview image of the captured image displayed on the touch panel 34 of the vehicle-mounted device 30, thereby adjusting the field of view of the distributor terminal 100, which serves as the capturing device.

[0151] Furthermore, in the above embodiment, the case where the captured image taken by the distributor terminal 100 is sent to the distribution server 200 via the vehicle-mounted device 30 has been described. However, it is also possible for the distributor terminal 100 to send the captured image taken by the distributor terminal 100 to the distribution server 200.

[0152] [8. Structure supported by the above embodiments]

[0153] The above implementation supports the following structures.

[0154] (Structure 1)

[0155] A distribution device includes: a communication unit for receiving a distribution request; a storage unit for storing user identification information that identifies a user and device information that identifies a display device used by the user; and a control unit for performing the following processes: generating a distribution image based on a captured image received from a distributor terminal; acquiring user identification information and device information included in the distribution request; if the acquired user identification information corresponds to a plurality of device information, determining whether the plurality of device information includes device information for a first head-mounted display device and a second display device other than the head-mounted display device; if the plurality of device information includes device information for both the first and second display devices, selecting a second display mode from a first display mode as a display mode for the first display device and a second display mode as a display mode for the second display device, and distributing the distribution image corresponding to the distribution request to the first or second display device corresponding to the acquired device information in a manner that the display mode corresponds to the selected second display mode.

[0156] When the distribution device of structure 1 matches multiple device information with user identification information and includes a first display device and a second display device among the multiple device information, it selects a second display mode and distributes the distribution image corresponding to the distribution request to the first display device or the second display device in a manner that the display mode corresponds to the selected second display mode. Therefore, when the distribution image distributed from the distribution server is also transferred to other display devices and viewed using multiple display devices, the user's convenience can be improved.

[0157] (Structure 2)

[0158] According to the distribution device of structure 1, when the device information of the first display device and the second display device are included in the plurality of device information, the control unit distributes the distribution image to the first display device or the second display device corresponding to the acquired device information in a display mode of the second display device that does not change the depiction range of the captured image used for the distribution image.

[0159] According to the distribution device of structure 2, when the device information of a first display device and a second display device are included in the multiple device information, the distribution image is distributed to either the first display device or the second display device in a display mode that does not change the depiction range of the captured image used for distributing the image. Therefore, since the depiction range of the distribution image used for distributing the image is not changed, dizziness of viewers viewing the distribution image can be reduced.

[0160] (Structure 3)

[0161] According to the distribution device of structure 1, the storage unit stores setting information related to the display mode of the display device, and when the control unit selects the first display mode as the display mode according to the setting information, it receives motion information from the first display device indicating the movement of the head of the user wearing the first display device, generates the distribution image based on the received motion information, and distributes the generated distribution image to the first display device or the second display device.

[0162] The distribution device of structure 3 receives motion information representing the movement of the head of a user wearing the first display device from the first display device, generates a distribution image based on the received motion information, and distributes the generated distribution image. Therefore, it is possible to distribute a distribution image corresponding to the movement of the head of a user wearing the first display device.

[0163] (Structure 4)

[0164] According to the distribution device of structure 3, in which the setting information includes priority information of a plurality of display devices corresponding to the same user identification information, when the device information of the plurality of device information includes device information of the first display device and the second display device, the control unit distributes the distribution image according to the display mode of the display device with higher priority as indicated by the priority information, the priority information is set such that the priority of the second display device is higher than the priority of the first display device, and the second display mode is a display mode that does not change the depiction range of the captured image used for the distribution image.

[0165] When the distribution device of structure 4 includes device information for both a first and a second display device in the multiple device information, it distributes the image according to the display mode of the display device with the higher priority as indicated by the priority information. The priority information is set so that the priority of the second display device is higher than that of the first display device. Therefore, when the device information for both the first and second display devices is included in the multiple device information, the image is distributed in a display mode that does not change the depiction range of the distributed image on the second display device. As a result, the range of the captured image used as the distributed image is not changed, thus reducing dizziness caused by viewing the distributed image.

[0166] (Structure 5)

[0167] According to the distribution device of structure 4, the control unit changes the priority information stored in the storage unit according to the operation information received from at least one of the first display device and the second display device.

[0168] The distribution device of structure 5 changes the priority information stored in the storage unit according to the operation information received from at least one of the first display device and the second display device. Therefore, the priority information stored in the storage unit can be changed, thereby improving user convenience.

[0169] (Structure 6)

[0170] According to the distribution device of structure 3, the control unit distributes the distribution image according to the first display mode of the first display device when the distribution image is distributed to the first display device and the first display device does not transfer the received distribution image to the second display device.

[0171] In structure 6, the distribution device distributes the distribution image according to the first display mode of the first display device when the first display device does not transfer the distribution image received from the distribution device to the second display device. Therefore, even when the viewer does not use the second display device to view the distribution image, it is possible to display an image as the distribution image that corresponds to the range of head movements of the user wearing the first display device.

[0172] (Structure 7)

[0173] According to the distribution device of structure 3, the control unit, when determining the display mode as the first display mode according to the setting information, distributes the distribution image to the first display device and the first display device transfers the distribution image to the second display device, or when distributing the distribution image to both the first display device and the second display device, receives motion information from the first display device indicating the movement of the head of a user wearing the first display device on their head; when the movement of the user's head indicated by the received motion information is below a predetermined value, the control unit distributes the distribution image to the first display device, or to both the first display device and the second display device; when the movement of the user's head indicated by the motion information is greater than a predetermined value, the control unit stops distributing the distribution image to the first display device, or to both the first display device and the second display device.

[0174] The distribution device in structure 7, when distributing a distribution image to a first display device in a first display mode and the first display device transferring the distribution image to a second display device, or when distributing the distribution image to both the first and second display devices, receives motion information representing the user's head movement from the first display device. If the user's head movement indicated by the received motion information is below a predetermined value, the distribution image is then distributed to the first display device, or to both the first and second display devices. Conversely, if the user's head movement indicated by the motion information exceeds a predetermined value, the distribution of the distribution image to the first display device, or to both the first and second display devices, is stopped. Therefore, it is possible to suppress dizziness caused by viewing the distribution image by a viewer using the second display device.

[0175] (Structure 8)

[0176] A distribution method is executed by a computer mounted on a distribution device, the distribution device having a communication unit and a storage unit, the storage unit storing user identification information identifying a user in correspondence with device information identifying a display device used by the user, the distribution method comprising the following steps: generating a distribution image based on a captured image received from a distributor terminal; receiving a distribution request; obtaining user identification information and device information contained in the distribution request; if the obtained user identification information corresponds to a plurality of device information, determining whether the plurality of device information includes device information for a first head-mounted display device and a second display device other than the head-mounted display device; selecting a second display mode from a first display mode as a display mode for the first display device and a second display mode as a display mode for the second display device; and distributing the distribution image corresponding to the distribution request to the first display device or the second display device corresponding to the obtained device information in a manner that the display mode corresponds to the selected second display mode.

[0177] The distribution method of structure 8 achieves the same effect as the distribution device of structure 1.

[0178] (Structure 9)

[0179] A computer program product causes a processor mounted on a distribution device to perform processing. The distribution device includes a communication unit and a storage unit, the storage unit storing user identification information for identifying a user in correspondence with device information for identifying a display device used by the user. The processing performed by the processor by the computer program product includes: generating a distribution image based on a captured image received from a distributor terminal; receiving a distribution request; obtaining user identification information and device information contained in the distribution request; determining, if the obtained user identification information corresponds to a plurality of device information, whether the plurality of device information includes device information for a first head-mounted display device and a second display device other than the head-mounted display device; selecting a second display mode from a first display mode as a display mode for the first display device and a second display mode as a display mode for the second display device; and distributing the distribution image corresponding to the distribution request to the first display device or the second display device corresponding to the obtained device information in a manner that the display mode corresponds to the selected second display mode.

[0180] The computer program product according to Structure 9 has the same effect as the distribution device of Structure 1.

[0181] Explanation of reference numerals in the attached figures

[0182] 1…distribution system, 3…vehicle, 5…communication network, 30…in-vehicle device, 31…external communication interface, 32…in-vehicle short-range wireless communication interface, 33…in-vehicle communication interface, 34…touch panel, 35…sound processing unit, 36…speaker, 40…vehicle ECU, 100…distributor terminal, 110…wireless communication interface, 120…short-range wireless communication interface, 130…camera, 140…touch panel, 151…microphone, 153…speaker, 170…Third Control Unit, 180…Third Memory, 181…OS, 183…APP, 190…Third Processor, 200…Distribution Server, 210…Network Communication Interface, 230…Second Control Unit, 240…Second Memory, 241…Control Program, 243…User Registration Database, 245…Distribution Management Database, 247…Content Database, 250…Second Processor, 300…Vehicle ECU, 310…Input / Output Interface, 330…First Control Unit, 340…First Memory, 345…Control Program, 350…First Processor, 4 00A…First display device, 400B…Second display device, 401A…Near-field wireless communication interface, 403A…Image display unit, 405A…Sensor unit, 407A…Microphone, 409A…Speaker, 410A…Fourth control unit, 420A…Fourth memory, 421A…OS, 423A…APP, 430A…Fourth processor, 451B…Wireless communication interface, 452B…Near-field wireless communication interface, 453B…Camera, 454B…Touch panel, 455B…Microphone, 456B…Speaker, 460B…Fifth control unit.

Claims

1. A dispensing device comprising: The communications department receives and distributes requests; The storage unit stores user identification information that identifies the user and device information that identifies the display device used by the user. as well as The control unit performs the following processing: Generate a distribution image based on the captured image received from the distributor's terminal; Obtain the user identification information and device information contained in the distribution request; When the obtained user identification information corresponds to multiple device information, it is determined whether the multiple device information includes device information of a first head-mounted display device and a second display device other than the head-mounted display device; In the case where the device information includes the device information of the first display device and the second display device, the second display mode is selected as the display mode of the first display device and the second display mode of the second display device. The distribution image corresponding to the distribution request is distributed to the first display device or the second display device corresponding to the obtained device information in such a way that the display mode corresponds to the selected second display mode.

2. The dispensing device according to claim 1, wherein, In the case where the device information of the first display device and the second display device are included in the multiple device information, the control unit distributes the distributed image to the first display device or the second display device corresponding to the acquired device information in a display mode of the second display device that does not change the depiction range of the captured image used for the distributed image.

3. The dispensing device according to claim 1, wherein, The storage unit stores setting information related to the display mode of the display device. When the control unit selects the first display mode as the display mode according to the setting information, it receives motion information from the first display device indicating the movement of the head of the user wearing the first display device, generates the distribution image based on the received motion information, and distributes the generated distribution image to the first display device or the second display device.

4. The dispensing device according to claim 3, wherein, The setting information includes priority information for multiple display devices that correspond to the same user identification information. When the device information includes both the first display device and the second display device, the control unit distributes the image according to the display mode of the display device with the highest priority as indicated by the priority information. The priority information is set such that the priority of the second display device is higher than that of the first display device. The second display mode is a display mode that does not change the depiction range of the captured image used for the distributed image.

5. The dispensing device according to claim 4, wherein, The control unit changes the priority information stored in the storage unit according to the operation information received from at least one of the first display device and the second display device.

6. The dispensing device according to claim 3, wherein, When the control unit distributes the distributed image to the first display device and the first display device does not transfer the received distributed image to the second display device, the control unit distributes the distributed image according to the first display mode of the first display device.

7. The dispensing device according to claim 3, wherein, When the control unit determines the display mode as the first display mode according to the setting information, distributes the distributed image to the first display device and the first display device forwards the distributed image to the second display device, or when the distributed image is distributed to both the first display device and the second display device, the control unit may be responsible for either this or the distribution of the image. The system receives motion information representing the movement of a user's head while wearing the first display device. If the movement of the user's head represented by the received motion information is below a predetermined value, the system distributes the distribution image to the first display device, or to both the first and second display devices. If the motion of the user's head, as indicated by the motion information, exceeds a predetermined value, the distribution of the image to the first display device, or the first display device and the second display device, is suspended.

8. A distribution method performed by a computer mounted on a distribution device, the distribution device having a communication unit and a storage unit, the storage unit storing user identification information identifying a user in correspondence with device information identifying a display device used by the user, the distribution method comprising the following steps: Generate a distribution image based on the captured image received from the distributor's terminal; Receive distribution request; Obtain the user identification information and device information contained in the distribution request; When the obtained user identification information corresponds to multiple device information, it is determined whether the multiple device information includes device information of a first head-mounted display device and a second display device other than the head-mounted display device; Select the second display mode, which is either the first display mode for the first display device or the second display mode for the second display device, and distribute the distribution image corresponding to the distribution request to the first display device or the second display device corresponding to the obtained device information in a manner that the display mode corresponds to the selected second display mode.

9. A computer program product that causes a processor mounted on a distribution device to perform processing, the distribution device having a communication unit and a storage unit, the storage unit storing user identification information identifying a user in correspondence with device information identifying a display device used by the user, the processing caused by the computer program product to be performed by the processor including: Generate a distribution image based on the captured image received from the distributor's terminal; Receive distribution request; Obtain the user identification information and device information contained in the distribution request; When the obtained user identification information corresponds to multiple device information, it is determined whether the multiple device information includes device information of a first head-mounted display device and a second display device other than the head-mounted display device; Select the second display mode, which is either the first display mode for the first display device or the second display mode for the second display device, and distribute the distribution image corresponding to the distribution request to the first display device or the second display device corresponding to the obtained device information in a manner that the display mode corresponds to the selected second display mode.

Images