Distribution system, distribution method and computer program product

Abstract

The present invention provides a distribution system, a distribution method, and a computer program product that enables an occupant (S) to know whether a third party other than a specific viewer (U) is viewing an image displayed on a terminal device (200B). The distribution system includes: a distribution unit (354) that distributes an image obtained by shooting by a first shooting device (200A) installed in a vehicle (3); a terminal device (200B) installed outside the vehicle that displays the distributed image; a viewing profile recognition unit (293) that recognizes a face based on the shooting result of a second shooting device (230) installed in the terminal device while the terminal device is displaying the distributed image; and a first notification unit (294) that, when the viewing profile recognition unit recognizes the face of a person other than a specific viewer (U), notifies the occupant of the vehicle to display a predetermined mark on the display device (34) installed in the vehicle.

Description

Technical Field

[0001] This invention relates to distribution systems, distribution methods, and computer program products. Background Technology

[0002] In recent years, initiatives to provide sustainable transportation systems that take into account vulnerable groups among transportation participants, such as the elderly, disabled, and children, have become increasingly active. To realize these initiatives, research and development efforts are focused on further improving the safety and convenience of transportation through the development of mobility means for vulnerable groups. One method for vulnerable individuals to use transportation systems is not only to ride the vehicle themselves but also to view dynamic images distributed by image distributors (e.g., see Patent Document 1). Patent Document 1 discloses a device for transmitting images captured by a camera unit installed in a vehicle to a location different from the vehicle.

[0003] [Existing Technical Documents]

[0004] [Patent Literature]

[0005] Patent Document 1: Japanese Patent Application Publication No. 2024-039763 Summary of the Invention

[0006] [The problem the invention aims to solve]

[0007] However, the behavior of the vehicle occupants during image distribution may change depending on whether a specific viewer is viewing the distributed image or a third party other than the specific viewer is viewing it. Patent Document 1 does not consider whether a third party other than the specific viewer is viewing the distributed image displayed on a terminal device located outside the vehicle along with the specific viewer. Therefore, in conventional technology like Patent Document 1, there is a problem that occupants cannot know whether a third party other than the specific viewer is viewing the image displayed on the terminal device.

[0008] In order to solve the above-mentioned problems, the present application aims to provide a distribution system, distribution method, and computer program product that enables passengers to know whether a third party other than a specific viewer is watching an image displayed on a terminal device.

[0009] Furthermore, by connecting remote locations and vehicles, services can help support better connectivity between urban areas and surrounding regions, and contribute to the development of a sustainable transportation system.

[0010] [Methods used to solve problems]

[0011] One aspect of the present invention is a distribution system comprising: a distribution unit that distributes images captured by a first shooting device disposed in a vehicle; a terminal device disposed at a location outside the vehicle that displays the distributed images; a viewing profile recognition unit that recognizes a face based on the shooting result of a second shooting device disposed in the terminal device while the distributed images are displayed on the terminal device; and a first notification unit that, when the viewing profile recognition unit recognizes the face of a person other than a specific viewer, notifies the occupants of the vehicle to display a predetermined mark on a display device disposed in the vehicle.

[0012] [Invention Effects]

[0013] According to the present invention, the occupant can know whether a third party other than a specific viewer is viewing an image displayed on the terminal device. Attached Figure Description

[0014] Figure 1 This is a diagram showing the system architecture of the distribution system.

[0015] Figure 2 This is a block diagram showing the structure of the vehicle-mounted device and the distribution server.

[0016] Figure 3 This is a diagram showing the detailed structure of the first control unit of the vehicle-mounted device.

[0017] Figure 4 This is a diagram showing the structure of the user information database.

[0018] Figure 5 This is a diagram showing the structure of the distribution management database.

[0019] Figure 6 This is a block diagram showing the structure of the viewer terminal.

[0020] Figure 7 This is a flowchart illustrating the actions of the vehicle-mounted device, the distribution server, and the viewer's terminal.

[0021] Figure 8 This is a flowchart illustrating the actions of the vehicle-mounted device, the distribution server, and the viewer's terminal. Detailed Implementation

[0022] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0023] [1. Structure of the distribution system]

[0024] Figure 1 This is a diagram showing the system architecture of distribution system 1.

[0025] Distribution system 1 includes a vehicle 3, an onboard device 30 mounted on the vehicle 3, a distributor terminal 200A installed on the vehicle 3, a distribution server 100, and a viewer terminal 200B installed outside the vehicle 3. It is a system for live streaming content containing images captured by the distributor terminal 200A. The viewer terminal 200B is an example of a "terminal device." The distributor terminal 200A is an example of a "first capturing device."

[0026] Live streaming refers to the real-time distribution of images captured by the distributor terminal 200A to the viewer terminal 200B. The images can be still images or moving images.

[0027] The vehicle-mounted device 30 is mounted on the vehicle 3 and wirelessly connects to the distributor terminal 200A held by the distributor S, who is an occupant of the vehicle 3, via near-field wireless communication or the like.

[0028] The vehicle-mounted device 30 receives content data from the distributor terminal 200A, which includes images captured by the camera of the distributor terminal 200A and sound input from the microphone of the distributor terminal 200A. The vehicle-mounted device 30 then uploads the received content data to the distribution server 100.

[0029] As an example of the first capturing device, the distributor terminal 200A is a smartphone or tablet PC (Personal Computer). The distributor terminal 200A can be installed anywhere inside the vehicle 3, as long as the distributor S is captured in the image obtained by the distributor terminal 200A. For example, the distributor terminal 200A is supported by a pre-defined support provided in the passenger seat of the vehicle 3.

[0030] Furthermore, the first camera installed on vehicle 3 can also be a digital camera capable of communicating with the onboard device 30, or a 360-degree camera capable of capturing the entire surrounding area. In this case, the microphone and camera can also be configured separately.

[0031] The distribution server 100 stores the content received from the vehicle-mounted device 30 in its server storage unit. The distribution server 100 then distributes the uploaded content data to the viewer terminal 200B of the viewer U. Live streaming technologies can be implemented using known technologies such as HLS (HTTP Live Streaming), CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), and RTMP (Real-Time Messaging Protocol).

[0032] Viewer terminal 200B is a terminal device held by viewer U who is watching content data distributed from distribution server 100. Figure 1 In the diagram, N audience members U are represented as U1, U2, ..., UN. N is any natural number.

[0033] Viewer terminal 200B can be a portable or mobile terminal device such as a smartphone, tablet, or laptop, or a fixed terminal device such as a desktop computer. Alternatively, viewer terminal 200B can be a television receiver or a head-mounted display device in which an image display unit is worn on the viewer's head and a display screen of the image display unit is positioned in front of the viewer's eyes. The head-mounted display device only needs to be able to view content distributed from the distribution server 100; it can be either transmissive or non-transmissive.

[0034] Viewer terminal 200B is equipped with display 240 (see reference) Figure 6 ) and speaker 260 (see reference) Figure 6 The system displays images distributed from the vehicle-mounted device 30 or the distribution server 100 via a display 240, and outputs sound distributed from the vehicle-mounted device 30 or the distribution server 100 via a speaker 260.

[0035] In addition, the audience terminal 200B has a microphone 250 (see reference). Figure 6 The microphone 250 collects the sound data of the audience U and uploads it to the distribution server 100. The distribution server 100 then sends the uploaded sound data of the audience U to the vehicle-mounted device 30. Furthermore, the vehicle-mounted device 30 transmits the sound data to the speaker 36 (see reference 1). Figure 2 The system outputs the received audio data of the audience U into the vehicle's interior. Thus, the audience U and the distributor S can engage in a conversation during content distribution.

[0036] Communication network 5 is a wired or wireless transmission path for information sent from devices connected to communication network 5. For example, communication network 5 may also include public networks such as the Internet, mobile communication networks, and satellite communication networks, as well as various LANs (Local Area Networks) and WANs (Wide Area Networks) including Ethernet. Additionally, communication network 5 may also include private networks such as IP-VPN (Internet Protocol-Virtual Private Network).

[0037] [2. Structure of the vehicle-mounted device]

[0038] Figure 2A diagram illustrating the structure of vehicle 3 and distribution server 100.

[0039] First, refer to Figure 2 The structure of vehicle 3 will be explained.

[0040] Vehicle 3 includes an on-board unit 30, an external communication interface 31, a first short-range wireless communication interface 32, an internal communication interface 33, a touch panel 34, a sound processing unit 35, a speaker 36, a vehicle ECU (Electronic Control Unit) 40, and an on-board ECU 300. The touch panel 34 is an example of a display device.

[0041] The external communication interface 31 is a communication module that performs wireless communication according to mobile communication standards such as LTE (Long Term Evolution), 4G (Generation), 5G, and Wi-Fi. The external communication interface 31 is connected to the communication network 5 via an antenna (not shown) and exchanges data with the distribution server 100.

[0042] The first near-field wireless communication interface 32 is, for example, a communication device that performs wireless communication according to near-field wireless communication standards such as Bluetooth (registered trademark) and Wi-Fi. The first near-field wireless communication interface 32 is, for example, a communication module that communicates according to NFC (Near Field Communication) communication standards such as Bluetooth and Wi-Fi. The first near-field wireless communication interface 32 performs near-field wireless communication with the distributor terminal 200A held by the distributor S (as a passenger), and receives images and sounds captured by the distributor terminal 200A.

[0043] The in-vehicle communication interface 33 is an input / output interface that connects to an in-vehicle network (not shown). The in-vehicle network may use a communication bus corresponding to communication standards such as CAN (Controller Area Network), CAN-FD (CAN with Flexible Data Rate), or Ethernet. The in-vehicle communication interface 33 communicates with vehicle ECU 40, other relay devices, and other in-vehicle equipment via the in-vehicle network.

[0044] The touch panel 34 includes a display panel such as a liquid crystal panel or an organic EL (Electro-Luminescence) panel, and a touch sensor. The touch sensor detects the touch operation of the viewer U on the touch panel 34 and outputs position information indicating the location of the detected touch operation to the first control unit 330.

[0045] The sound processing unit 35, for example, converts the digital sound data output by the first control unit 330 into an analog sound signal. The sound processing unit 35 amplifies the converted analog sound signal and outputs the amplified sound signal through the speaker 36.

[0046] The vehicle-mounted ECU 300 has an input / output interface 310 and a first control unit 330.

[0047] The input / output interface 310 functions as a connection between the external communication interface 31, the first short-range wireless communication interface 32, the in-vehicle communication interface 33, the touch panel 34, the sound processing unit 35, and the first control unit 330. The input / output interface 310 includes connectors and interface circuitry, and outputs data input from the external communication interface 31, the first short-range wireless communication interface 32, the in-vehicle communication interface 33, the touch panel 34, and the sound processing unit 35 to the first control unit 330. Furthermore, the input / output interface 310 outputs data input from the first control unit 330 to the external communication interface 31, the first short-range wireless communication interface 32, the in-vehicle communication interface 33, the touch panel 34, or the sound processing unit 35.

[0048] The first control unit 330 is a computer device having a first memory 340 and a first processor 350.

[0049] Figure 3 A diagram showing the detailed structure of the first control unit 330 of the vehicle-mounted device 30.

[0050] The first memory 340 may include, for example, volatile semiconductor memory and non-volatile semiconductor memory. The first memory 340 may also include only non-volatile semiconductor memory. Alternatively, the first memory 340 may have an auxiliary storage device such as an SSD (Solid State Drive). The first memory 340 stores control programs 345 executed by the first processor 350, setting data specifying the operation of the vehicle-mounted device 30, etc.

[0051] In addition, the first memory 340 stores the control program 345 and the vehicle side profile data 346.

[0052] Vehicle side face data 346 is data representing information related to the face of the distributor S. This face-related information is information representing facial features used in so-called facial recognition technology. The vehicle side face data 346 contains pre-stored face-related information corresponding to the distributor S for each vehicle 3.

[0053] The first processor 350 is, for example, a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit) or other computing device. The first processor 350 may consist of a single processor or multiple processors. Alternatively, the first processor 350 may also consist of a System-on-a-Chip (SoC) that integrates part or all of the first memory 340 with other circuitry.

[0054] The first processor 350 includes a vehicle-side display unit 351, a vehicle-side receiving unit 352, a vehicle-side facial recognition unit 353, and a distribution unit 354 as functional units. These functional units are implemented through hardware and software cooperation by the first processor 350 reading and executing the control program 345 stored in the first memory 340.

[0055] The vehicle side display unit 351 displays the screen via the touch panel 34.

[0056] The vehicle-side display unit 351 can also display images contained in the distributed content as a preview.

[0057] When the face recognition unit 293 on the viewing side of the audience terminal 200B (described later) identifies a third party other than the audience member U as being captured, the vehicle-side display unit 351 displays a predetermined marker. This predetermined marker is to inform the distributor S that a third party has been captured in the audience terminal 200B.

[0058] The specified marker may be, for example, a marker containing the string "a third party has been captured". Alternatively, the specified marker may be an image indicating that a third party has been captured. The specified marker is displayed overlaid on various screens displayed on the vehicle-side display unit 351. For example, the specified marker may be displayed overlaid on a screen that displays a preview of an image included in the distributed content.

[0059] The vehicle-side reception unit 352 accepts operations based on input from the touch panel 34 or other input units.

[0060] The vehicle-side reception unit 352 receives the input of the instruction to start distributing content from the prescribed screen reception display.

[0061] The vehicle-side receiving unit 352 receives an input from the designated screen indicating that the prohibition on the distribution of content has been lifted and that the distribution of content has begun.

[0062] The vehicle-side reception unit 352 receives an input from the prescribed screen indicating that the distribution of content has not yet begun.

[0063] The vehicle side face recognition unit 353 recognizes the face captured in the image obtained by the distributor terminal 200A.

[0064] In particular, the vehicle side face recognition unit 353 identifies whether the face shown in the vehicle side face data 346 corresponds to the distributor S. The face shown in the vehicle side face data 346 corresponding to the distributor S corresponds to the face of a specific occupant.

[0065] In addition, the vehicle side face recognition unit 353 recognizes the face of the user seated in the driver's seat. That is, the vehicle side face recognition unit 353 recognizes the face of the occupants, especially the driver. Furthermore, not limited to this, the vehicle side face recognition unit 353 can also recognize all faces inside the vehicle 3 captured in an image obtained by the distributor terminal 200A.

[0066] If a person other than the distributor S is captured in an image obtained by the distributor terminal 200A, the vehicle side face recognition unit 353 will prevent the distribution of content from starting.

[0067] The distribution unit 354 communicates with the distribution server 100 and the audience terminal 200B in accordance with the prescribed communication standards.

[0068] The distribution unit 354 uploads content data to the distribution server 100 via the external communication interface 31. The content data includes images captured by the distributor terminal 200A, sounds collected by the distributor terminal 200A, and distribution ID (Identification).

[0069] If the vehicle side face recognition unit 353 identifies a person other than the distributor S in the image captured by the distributor terminal 200A, the distribution unit 354 prohibits the distribution of the content. The distribution unit 354 is an example of a prohibition unit.

[0070] [3. Structure of the distribution server]

[0071] Next, the structure of the distribution server 100 will be described.

[0072] The distribution server 100 includes a network communication interface 110 and a second control unit 130.

[0073] The network communication interface 110 is equipped with a communication card such as a NIC (Network Interface Card), and communicates with the vehicle-mounted device 30 and the audience terminal 200B via the communication network 5.

[0074] The second control unit 130 is a computer device equipped with a second memory 140 and a second processor 150.

[0075] The second memory 140 may include, for example, volatile semiconductor memory and non-volatile semiconductor memory. The second memory 140 may also include only non-volatile semiconductor memory. Alternatively, the second memory 140 may have a structure that includes auxiliary storage devices such as HDD (Hard Disk Drive) or SSD.

[0076] The second memory 140 stores the control program 141, the user information database 143, the distribution management database 145, and the content database 147 executed by the second processor 150.

[0077] Figure 4 This is a diagram showing the structure of the user information database 143.

[0078] A record in the user information database 143 includes the user ID, APP_ID, device information, user information, and terminal identification information. APP is an abbreviation for application.

[0079] User ID is identification information that identifies a user using the distribution service provided by distribution server 100. Users include distributor S and viewers U.

[0080] APP_ID is identification information that identifies the application downloaded to the distributor terminal 200A or the viewer terminal 200B.

[0081] Distributor S and audience U download the APP from the designated website and install it on distributor terminal 200A and audience terminal 200B respectively.

[0082] Device information is the identification information used to identify the viewer terminal 200B. Device information may include, for example, whether the viewer terminal 200B is a smartphone, a PC, a head-mounted display device, or a camera, such as its model number.

[0083] User information refers to the personal information of the distributor S and the audience U, such as name, address, gender, age, etc.

[0084] As described above, the terminal identification information uniquely identifies the viewer terminal 200B. In the user information database 143, by associating user information with the terminal identification information, the viewer terminal 200B associated with the viewer U's information is uniquely identified.

[0085] Figure 5 This is a diagram showing the structure of the distribution management database 145.

[0086] A record in the distribution management database 145 contains the distribution ID that identifies the distribution, the user ID of the distributor S, the user ID of the audience U, and the date and time the distribution started.

[0087] return Figure 2 Next, we will explain the structure of the distribution server 100.

[0088] The second processor 150 is, for example, a CPU, MPU, or other computing device. The second processor 150 can be composed of a single processor or multiple processors. Alternatively, the second processor 150 can also be composed of a System-on-a-Chip (SoC) that integrates part or all of the second memory 140 with other circuitry.

[0089] [4. Viewer Terminal Configuration]

[0090] Figure 6 This is a structural block diagram of the 200B viewer terminal.

[0091] The audience terminal 200B includes a wireless communication interface 210, a light 201, a camera 230, a display 240, a microphone 250, a speaker 260, and a third control unit 270. The camera 230 is an example of a second shooting device.

[0092] Lamp 201 is an LED (Light Emitting Diode). Furthermore, lamp 201 can be any light-emitting component, not limited to LEDs.

[0093] The second near-field wireless communication interface 220 is, for example, a communication module that communicates according to NFC communication standards such as Bluetooth and Wi-Fi. The second near-field wireless communication interface 220 transmits the images captured by the camera 230 and the sound input by the microphone 250 to the vehicle-mounted device 30 via near-field wireless communication.

[0094] Camera 230 is a shooting device equipped with an image sensor and data processing circuitry. The image sensor is composed of, for example, a CCD (Charge-Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor). The data processing circuitry generates the captured image based on the output of the image sensor.

[0095] Microphone 250 is a sound input device for inputting the sound of the audience U, and speaker 260 is a sound output device for outputting the sound of the audience U.

[0096] The display 240 is equipped with a display panel such as an LCD panel or an OLED panel. In the case that the viewer terminal 200B is a smartphone or tablet computer, the display 240 is a touch panel with a touch sensor.

[0097] In this case, the display 240 functions as a display unit for displaying images and a receiving unit for receiving operations from the distributor S or the viewer U.

[0098] In addition, when the audience terminal 200B is a head-mounted display device, the detection unit that detects the direction in which the audience U's eyes or face are pointing or the audience U's gestures functions as a receiving unit.

[0099] The third control unit 270 is a computer device equipped with a third memory 280 and a third processor 290.

[0100] The third memory 280 is a non-volatile semiconductor memory. Alternatively, the third memory 280 may also have an auxiliary storage device such as an SD card. The third memory 280 stores control programs such as the OS (Operating System) 281 and APP 283, as well as viewing profile data 285. APP 283 is an application that communicates with the distribution server 100, displays dynamic images contained in the content distributed by the distribution server 100 on the display 240, and outputs sound contained in the content to the speaker 260. APP 283 is an example of such a program.

[0101] Viewing profile data 285 is data that displays information related to the face corresponding to the viewer U. The information related to the face is information representing facial features used in so-called facial recognition technology. Viewing profile data 285 contains pre-stored information related to the face of the viewer U corresponding to each viewer terminal 200B.

[0102] The third processor 290 is, for example, a CPU, MPU, or other computing device. The third processor 290 can consist of a single processor or multiple processors.

[0103] The third processor 290 includes an output unit 291, a viewing-side receiving unit 292, a viewing-side face recognition unit 293, a viewing-side first notification unit 294, a viewing-side second notification unit 295, and a viewing-side communication control unit 296 as functional units. These functional units are implemented by the third processor 290 reading and executing the APP 283 stored in the third memory 280 through hardware and software cooperation.

[0104] The first notification unit 294 on the viewing side is an example of a first notification unit. The second notification unit 295 on the viewing side is an example of a second notification unit.

[0105] The output unit 291 outputs the images contained in the content distributed by the vehicle-mounted device 30 or the distribution server 100, that is, displays them on the display 240.

[0106] In addition, the output unit 291 enables the speaker 260 to output the sound contained in the content distributed by the vehicle-mounted device 30 or the distribution server 100.

[0107] In addition, the output unit 291 outputs light via the lamp 201.

[0108] The viewing side reception department 292 accepts various inputs from the audience U.

[0109] The side-view face recognition unit 293 captures images via the camera 230 while the APP 283 is running. Based on the image captured by the camera 230, the side-view face recognition unit 293 identifies the face captured in the image.

[0110] Specifically, the viewing profile recognition unit 293 identifies whether the face shown in the viewing profile data 285 corresponds to the viewer U. The face shown in the viewing profile data 285 corresponding to the viewer U corresponds to the face corresponding to a specific viewer U.

[0111] The first notification unit 294 on the viewing side notifies the distributor S corresponding to the occupants of the vehicle 3 of the situation where a face corresponding to a person other than a specific viewer U is identified by displaying a predetermined mark on the touch panel 34 provided on the vehicle 3.

[0112] The second notification unit 295 on the viewing side notifies the viewer U that a face has been identified that corresponds to a person other than the specific viewer U.

[0113] The viewing-side communication control unit 296 communicates with the distribution server 100 via the wireless communication interface 210. Furthermore, the viewing-side communication control unit 296 communicates with the vehicle-mounted device 30 or the distributor terminal 200A via the wireless communication interface 210.

[0114] [5. Action]

[0115] Next, the actions of distribution system 1 will be described.

[0116] Figure 7 This is a flowchart illustrating the operation of the vehicle-mounted device 30, the distribution server 100, and the viewer terminal 200B.

[0117] exist Figure 7 The operation of the vehicle-mounted device 30, the distribution server 100, and the viewer terminal 200B described herein is based on the premise that communication is established between the vehicle-mounted device 30 and the distribution server 100 and the viewer terminal 200B, and the viewer terminal 200B is able to start watching the distributed images.

[0118] First, the actions of each part of the distribution system 1 involved in the content distribution will be explained.

[0119] exist Figure 7 In the flowchart, FA1 shows the operation of the vehicle-mounted device 30, FB1 shows the operation of the distribution server 100, and FC1 shows the operation of the viewer terminal 200B.

[0120] As shown in flowchart FA1, the distribution unit 354 determines whether to start the distribution of content (step SA1).

[0121] For example, if the touch panel 34 receives a distribution start instruction, the distribution unit 354 makes an affirmative determination in step SA1.

[0122] Furthermore, for example, if the vehicle-mounted device 30 receives distribution start information from the distributor terminal 200A, the distribution unit 354 makes a positive determination in step SA1. Additionally, the distribution start information indicates the start of distribution.

[0123] If the distribution unit 354 determines that the distribution of content has begun (step SA1: Yes), the vehicle side face recognition unit 353 determines whether to recognize a face corresponding to a person other than the distributor S based on the image obtained by the distributor terminal 200A (step SA2). Step SA2 is an example of the vehicle side face recognition step.

[0124] If the vehicle side face recognition unit 353 recognizes a face that corresponds to a person other than the distributor S (step SA2: Yes), it prohibits the distribution of content (step SA3). Step SA3 is an example of a prohibition step.

[0125] Next, the distribution unit 354 determines whether to lift the prohibition on content distribution (step SA4). For example, if the vehicle-side receiving unit 352 receives an instruction to lift the prohibition on content distribution, the distribution unit 354 makes an affirmative determination in step SA4. Then, if the vehicle-side receiving unit 352 receives an instruction not to start content distribution while content distribution is prohibited, the distribution unit 354 makes a negative determination in step SA4. In this case, for example, the vehicle-side display unit 351 outputs a screen prompting the occupant to input an instruction on whether to start content distribution.

[0126] If the distribution unit 354 determines that the prohibition on content distribution will not be lifted (step SA4: No), Figure 7 The action shown has ended.

[0127] If the distribution unit 354 determines that the prohibition of content distribution has been lifted (step SA4: Yes), and if the vehicle side face recognition unit 353 fails to recognize a face corresponding to a person other than the distributor S (step SA2: No), the distribution unit 354 begins content distribution (step SA5). When the distribution unit 354 begins content distribution, it uploads the content data to the distribution server 100 at a predetermined period (step SA6).

[0128] Step SA6 is an example of a "distribution step".

[0129] As shown in flowchart FB1, the second control unit 130 of the distribution server 100 receives content data from the vehicle-mounted device 30 (step SB1).

[0130] Next, the second control unit 130 of the distribution server 100 sends the received content data to the viewer terminal 200B (step SB2).

[0131] Step SB2 is described in detail. The second control unit 130 determines from the distribution management database 145 a record containing a distribution ID received along with the content data, and obtains the user ID of the viewer U from the determined record. Next, the second control unit 130 obtains device information for each obtained user ID of the viewer U. Then, the second control unit 130 transmits the received content data based on the communication information contained in the obtained device information.

[0132] As shown in flowchart FC, the viewing-side communication control unit 296 of the viewer terminal 200B receives content data from the distribution server 100 (step SC1).

[0133] Next, the output unit 291 displays the image contained in the content represented by the received content data on the display 240, and outputs the sound contained in the content represented by the received content data through the speaker 260 (step SC2).

[0134] Step SC2 is an example of the "viewing side display steps".

[0135] Returning to the description of flowchart FA1, the distribution unit 354 determines whether to end the content distribution (step SA7).

[0136] For example, if the touch panel 34 receives a dispensing end instruction, the dispensing unit 354 makes a positive determination in step SA7.

[0137] Furthermore, for example, if the vehicle-mounted device 30 receives distribution completion information from the distributor terminal 200A, the distribution unit 354 makes a positive determination in step SA7. Additionally, the distribution completion information indicates the end of the distribution process.

[0138] If the distribution unit 354 determines that the content distribution should not be terminated (step SA7: No), the process returns to step SA6, and the processing after step SA6 is performed again. Alternatively, the distribution unit 354 continues distributing content until a positive determination is made in step SA7.

[0139] On the other hand, if the distribution unit 354 determines that the distribution of content has ended (step SA7: Yes), it ends the distribution of content (step SA8).

[0140] Figure 8 This is a flowchart illustrating the operation of the vehicle-mounted device 30, the distribution server 100, and the viewer terminal 200B.

[0141] Reference Figure 8 The actions of each part of the distribution system 1 during the period when the APP 283 of the viewer terminal 200B can view content are explained. The period during which the APP 283 of the viewer terminal 200B can view content is not limited to the period when content is output to the viewer terminal 200B, but also includes the period when no content is output.

[0142] exist Figure 8 In the operation of the vehicle-mounted device 30, the distribution server 100, and the viewer terminal 200B described in the text, the relationship with... Figure 7 The same applies, provided that communication is established between the vehicle-mounted device 30 and the distribution server 100 and the viewer terminal 200B, and the viewer terminal 200B is able to start watching the distributed images.

[0143] As described above, the period during which the distributed image is not displayed on the viewer terminal 200B refers to the period during which the distributed image can be viewed using the APP 283 on the viewer terminal 200B.

[0144] exist Figure 8 In the flowchart, FA2 shows the operation of the vehicle-mounted device 30, FB2 shows the operation of the distribution server 100, and FC2 shows the operation of the viewer terminal 200B.

[0145] As shown in flowchart FC2, during the period when the APP 283 of the viewer terminal 200B can watch content, regardless of whether the viewer is watching the images and sounds contained in the content distributed by the distribution server 100, the viewing face recognition unit 293 identifies the face captured in the image based on the image captured by the viewer terminal 200B (step SC11).

[0146] Next, the side-view face recognition unit 293 determines whether a face corresponding to a person other than the viewer U has been recognized (step SC12). Steps SC11 and SC12 are examples of the side-view face recognition steps.

[0147] If the side face recognition unit 293 fails to recognize a face that corresponds to a person other than the viewer U (step SC12: No), the process returns to step SC11.

[0148] If the viewing-side face recognition unit 293 recognizes a face corresponding to a person other than the viewer U (step SC12: Yes), the viewing-side first notification unit 294 causes the viewing-side communication control unit 296 to send recognition data to the distribution server 100. This recognition data includes an instruction to display a specified mark on the screen of the touch panel 34 provided on the vehicle 3 (step SC13). Step SC13 is an example of the first notification step.

[0149] Next, the second notification unit 295 on the viewing side notifies the viewer U that a face corresponding to a person other than the viewer U has been identified (step SC14). Step SC14 is an example of the second notification step.

[0150] For example, the viewing-side second notification unit 295 illuminates the lamp 201 via the output unit 291 to indicate that a predetermined color of light has been identified corresponding to a face other than the viewer U, thereby performing the notification in step SC14. Alternatively, for example, the viewing-side second notification unit 295 displays a screen on the display 240 via the output unit 291, including a string or image indicating that a face other than the viewer U has been identified, thereby performing the notification in step SC14.

[0151] Next, the side-view face recognition unit 293 determines whether to end face recognition (step SC15). Specifically, the side-view face recognition unit 293 determines whether the APP 283 of the viewer terminal 200B can view the content, and if the APP 283 of the viewer terminal 200B cannot view the content, the side-view face recognition unit 293 makes an affirmative determination in step SC15.

[0152] The inability of the viewer terminal 200B to view content via APP 283 corresponds to situations such as APP 283 being stopped or communication between the viewer terminal 200B and the distribution server 100 or the vehicle-mounted device 30 being interrupted.

[0153] Next, if the side-face recognition unit 293 does not terminate face recognition (step SC15: No), it returns to step SC11 and performs the processing after step SC11 again. The side-face recognition unit 293 continues to recognize faces until a negative determination is made in step SC15.

[0154] As shown in flowchart FB2, the second control unit 130 of the distribution server 100 receives identification data from the audience terminal 200B (step SB11) and sends the received identification data to the vehicle-mounted device 30 (step SB12).

[0155] As shown in flowchart FA2, the distribution unit 354 of the vehicle-mounted device 30 receives identification data from the distribution server 100 (step SA11).

[0156] Next, the vehicle-side display unit 351 displays a designated mark indicating that a face corresponding to a person other than the spectator U has been identified (step SA12). Step SA12 is an example of the first notification step.

[0157] (Other implementation methods)

[0158] The above-described implementation is merely one approach, which can be arbitrarily modified and applied.

[0159] In the above-described embodiment, the vehicle-mounted device 30 identifies the facial structure based on the image captured by the first camera installed in the vehicle 3. In other embodiments, the distribution server 100 may also be configured to identify the face based on the image captured by the first camera installed in the vehicle 3. In this configuration, the distribution server 100 stores data corresponding to each vehicle 3, containing information related to the face of a specific occupant. Furthermore, in this configuration, the distribution server 100 obtains the image captured by the first camera from the vehicle-mounted device 30. Moreover, in this configuration, the second processor 150 functions as both a vehicle side face recognition unit 353 and a distribution unit 354, and the distribution server 100 identifies the face based on the image distributed from the vehicle-mounted device 30 and distributes the image to the viewer terminal 200B.

[0160] In the above embodiment, the viewer terminal 200B is configured to recognize faces based on the shooting results of the camera 230, which is an example of a second shooting device. In other embodiments, the distribution server 100 may also be configured to recognize faces based on the shooting results of the second shooting device. In this configuration, the distribution server 100 stores data corresponding to each viewer terminal 200B, containing information related to the face of a specific viewer. Furthermore, in this configuration, the distribution server 100 obtains the shooting results of the second shooting device from the viewer terminal 200B. Moreover, in this configuration, the second processor 150 functions as a viewing-side face recognition unit 293, and the distribution server 100 recognizes faces based on the shooting results obtained from the viewer terminal 200B.

[0161] In the above embodiment, as an example of a first notification unit, the viewing-side first notification unit 294 of the viewer terminal 200B generates an instruction to display a predetermined mark on the display device of the vehicle 3. In other embodiments, the vehicle-mounted device 30 may be configured to display a predetermined mark on the display device of the vehicle 3 when it receives a signal indicating that the viewing-side face recognition unit 293 has recognized the face of a person other than a specific viewer U. In this case, the first processor 350 of the vehicle-mounted device 30 functions as a first notification unit.

[0162] In the above embodiment, the distribution unit 354 of the vehicle-mounted device 30 uploads content data to the distribution server 100 via the external communication interface 31. In other embodiments, the distributor terminal 200A may also upload content data to the distribution server 100. More specifically, in this case, the distributor terminal 200A uploads content data to the distribution server 100, including images captured by the camera of the distributor terminal 200A and sound input through the microphone of the distributor terminal 200A.

[0163] Furthermore, the first processor 350 is configured to function as the vehicle side-face recognition unit 353, but it is not limited to this. In other embodiments, the processor of the distributor terminal 200A may also function as the vehicle side-face recognition unit 353.

[0164] The first processor 350 and the second processor 150 can be composed of multiple processors or a single processor. The first processor 350 and the second processor 150 can also be hardware programmed to implement the aforementioned functional units. In this case, these processors are, for example, composed of an ASIC (Application Specific Integrated Circuit) or a FPGA (Field Programmable Gate Array).

[0165] also, Figure 2 , Figure 3 as well as Figure 6 The structure of the distribution server 100, vehicle 3, and audience terminal 200B shown is an example, and the specific installation method is not particularly limited. That is, it is not necessary to install hardware corresponding to each part separately; of course, it is also possible to configure the functions of each part to be implemented by a processor executing a program. In addition, in the above embodiment, a part of the function implemented by software can be made into hardware, or a part of the function implemented by hardware can be implemented by software.

[0166] in addition, Figure 7 as well as Figure 8The steps shown are divided according to the main processing content, and the present invention is not limited to the method or name of the division of processing units. It is also possible to divide the process into more step units based on the processing content. Furthermore, a single step unit may contain more processes. Additionally, the order of these steps can be appropriately replaced without affecting the spirit of the invention.

[0167] [6. Structure supported by the above embodiments]

[0168] The above implementation supports the following structures.

[0169] (Structure 1)

[0170] A distribution system comprising: a distribution unit that distributes images captured by a first camera installed in a vehicle; a terminal device installed at a location outside the vehicle that displays the distributed images; a viewing profile recognition unit that recognizes a face based on the capture result of a second camera installed in the terminal device while the distributed images are displayed on the terminal device; and a first notification unit that, when the viewing profile recognition unit recognizes the face of a person other than a specific viewer, notifies the occupants of the vehicle to display a predetermined mark on a display device installed in the vehicle.

[0171] According to the distribution system of Structure 1, if a face corresponding to someone other than a specific viewer is identified, the passenger is notified that a face corresponding to someone other than a specific viewer has been identified. Therefore, the passenger can know whether a third party other than a specific viewer is viewing the image displayed on the terminal device.

[0172] (Structure 2)

[0173] According to the distribution system of structure 1, the distribution system includes a second notification unit that notifies the viewer that the face of a person other than the specific viewer has been identified when the face recognition unit on the viewing side identifies the face of the person other than the specific viewer.

[0174] According to the distribution system in Structure 2, when a face corresponding to someone other than a specific viewer is identified, the viewer is notified that a face corresponding to someone other than a specific viewer has been identified. Therefore, the viewer is able to confirm that a third party other than the specific viewer has been identified.

[0175] (Structure 3)

[0176] According to the distribution system of structure 1 or 2, the distribution system includes: a vehicle side face recognition unit that recognizes a face based on the shooting result of the first shooting device; and a blocking unit that blocks the distribution unit from sending the image when the vehicle side face recognition unit recognizes the face of a passenger other than a specific passenger.

[0177] According to the distribution system of Structure 3, the distribution of images to third parties other than specific occupants can be prohibited. Therefore, it is possible to suppress the unintentional distribution of images by third parties.

[0178] (Structure 4)

[0179] According to the distribution system of structure 1 or 2, the viewing side face recognition unit also recognizes the face based on the shooting result of the second shooting device during the period when the terminal device does not display the distributed image.

[0180] According to the distribution system of Structure 4, if a face corresponding to someone other than a specific viewer is identified, the occupant is notified of the identification of the face before the distributed image is displayed by the terminal device. Therefore, the occupant can know whether a third party other than a specific viewer is viewing the image displayed on the terminal device before the image is distributed.

[0181] (Structure 5)

[0182] A computer program product enables the processor of a terminal device to function as a viewing profile recognition unit and a first notification unit. The terminal device displays images captured and distributed by a first camera installed in a vehicle, and the terminal device is located outside the vehicle. The viewing profile recognition unit recognizes faces based on the capture results of a second camera installed in the terminal device. When the viewing profile recognition unit recognizes the face of a person other than a specific viewer, the first notification unit notifies the occupants of the vehicle to display a predetermined marker on the screen of the display device installed in the vehicle.

[0183] The computer program product based on Structure 5 has the same effect as the distribution system based on Structure 1.

[0184] (Structure 6)

[0185] A distribution method comprising: a distribution step of distributing an image captured by a first camera installed in a vehicle; a viewing-side display step of displaying the distributed image on a terminal device located outside the vehicle; a viewing-side face recognition step of recognizing a face based on a capture result from a second camera installed in the terminal device while the distributed image is displayed on the terminal device; and a first notification step of notifying occupants of the vehicle to display a predetermined marker on a display device installed in the vehicle when a face other than a specific viewer is recognized in the viewing-side face recognition step.

[0186] The distribution method of Structure 6 achieves the same effect as the distribution system of Structure 1.

[0187] Explanation of reference numerals in the attached figures

[0188] 1…distribution system, 3…vehicle, 5…communication network, 30…vehicle-mounted device, 31…external communication interface, 32…first short-range wireless communication interface, 33…in-vehicle communication interface, 34…touch panel (display device), 35…sound processing unit, 36…speaker, 40…vehicle ECU, 100…distribution server, 110…network communication interface, 130…second control unit, 140…second memory, 141…control program, 143…user information database, 145…distribution management database, 150…second processor, 200A…distributor terminal (first shooting device), 200B…audience terminal (terminal device), 201…lamp, 210…wireless communication interface, 230…camera (second shooting device), 240…display, 250…microphone, 260…speaker, 270…third… Control unit, 280… third memory, 281… OS, 283… APP (program), 285… viewing side face data, 290… third processor, 291… output unit (viewing side display unit), 292… viewing side receiving unit, 293… viewing side face recognition unit, 294… viewing side first notification unit (first notification unit), 295… viewing side second notification unit (second notification unit), 296… viewing side communication control unit, 300… vehicle ECU, 310… input / output interface, 330… first control unit, 340… first memory, 345… control program, 346… vehicle side face data, 350… first processor, 351… vehicle side display unit, 352… vehicle side receiving unit, 353… vehicle side face recognition unit, 354… distribution unit (prohibition unit), S… distributor (occupant), U… audience.

Claims

1. A distribution system, the distribution system comprising: The distribution unit distributes images obtained by capturing images through a first imaging device installed on the vehicle; A terminal device, located outside the vehicle, displays the distributed image; A side-view face recognition unit, during the display of the distributed image on the terminal device, recognizes a face based on the shooting result of a second shooting device installed on the terminal device; and When the viewing side face recognition unit recognizes the face of a person other than a specific viewer, the first notification unit notifies the occupants of the vehicle to display a predetermined mark on the display device installed in the vehicle.

2. The distribution system according to claim 1, wherein, The distribution system includes a second notification unit that notifies the viewer that the face of a person other than the specific viewer has been identified when the face recognition unit on the viewing side identifies the face of the person other than the specific viewer.

3. The distribution system according to claim 1 or 2, wherein, This distribution system has the following features: A vehicle side-face recognition unit that identifies a face based on the image captured by the first imaging device; and The blocking unit prevents the distribution unit from sending the image when the vehicle side face recognition unit recognizes the face of a passenger other than a specific passenger.

4. The distribution system according to claim 1 or 2, wherein, The viewing side face recognition unit also recognizes the face based on the shooting results of the second shooting device during the period when the terminal device does not display the distributed image.

5. A computer program product that enables the processor of a terminal device to function as a viewing profile recognition unit and a first notification unit. The terminal device displays images captured and distributed by a first camera installed in the vehicle, and the terminal device is located outside the vehicle. The side-view face recognition unit identifies the face based on the shooting results of the second shooting device equipped in the terminal device. When the viewing side face recognition unit recognizes the face of a person other than a specific viewer, the first notification unit notifies the occupants of the vehicle to display a specified mark on the screen of the display device installed in the vehicle.

6. A distribution method, the distribution method comprising: The distribution step involves distributing images obtained by capturing images through a first imaging device installed on the vehicle. In the viewing side display step, a terminal device located outside the vehicle displays the distributed image; During the viewing of the profile face recognition step, while the terminal device displays the distributed image, the face is recognized based on the shooting results of a second shooting device installed on the terminal device; and The first notification step involves notifying the occupants of the vehicle to display a specified marker on a display device installed in the vehicle when the face recognition step for viewing the side of the face is recognized.

Images