Vehicle communication device

Abstract

To enable smoother communication.SOLUTION: A vehicle communication device includes an occupant detection unit that detects multiple occupants who are on board a vehicle, a communication unit capable of wireless communication with one or more terminal devices among terminal devices carried by the multiple occupants, a vehicle state detection unit that detects that the vehicle has stopped, an input / output unit that outputs video signals from the terminal devices that are wirelessly communicating with the communication unit and is capable of inputting instructions from the occupants, and a control unit that, when the occupant detection unit detects that one or more of the multiple occupants have got off and that one or more of the multiple occupants continue to ride the vehicle, and the vehicle state detection unit detects that the vehicle has stopped, controls the communication unit to wirelessly communicate with the terminal devices carried by the occupants whose getting off has been detected and to send a signal to the terminal devices that are wirelessly communicating to request that the output destination of the video signal be set to the input / output unit.SELECTED DRAWING: Figure 3A

Description

[Technical Field]

[0001] The present invention relates to a vehicle communication device that enables communication both inside and outside a vehicle. [Background technology]

[0002] One such technology that has been developed is one that establishes a wireless communication connection between a wireless communication terminal outside the vehicle and an IVI (In-Vehicle Infotainment) device inside the vehicle to enable communication such as calls. For example, Patent Document 1 (JP 2002-171336 A) discloses a call system that switches between a hands-free call and an intercom call between a mobile phone and a hands-free device, allowing people inside and outside the vehicle to talk with each other with the vehicle windows closed, without using a dedicated vehicle intercom. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-171336 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology disclosed in Patent Document 1 only allows conversation between the vehicle and a mobile phone, and does not support communication using images or videos. Therefore, there has been a demand for a system that enables smoother communication using images. [Means for solving the problem]

[0005] A vehicle communication device according to one aspect of the present invention comprises an occupant detection unit that detects multiple occupants aboard the vehicle, a communication unit capable of wireless communication with one or more terminal devices carried by the multiple occupants, a vehicle state detection unit that detects when the vehicle is stopped, an input / output unit that outputs a video signal from the terminal device that is wirelessly communicating with the communication unit and is capable of inputting instructions from the occupants, and a control unit that, when the occupant detection unit detects that one or more of the multiple occupants have disembarked and one or more of the multiple occupants continue to ride the vehicle and, when the vehicle state detection unit detects that the vehicle has stopped, wirelessly communicates with the terminal device carried by the occupant whose disembarkation has been detected, and controls the communication unit to send a signal to the terminal device that is wirelessly communicating with the communication unit to request that the output destination of the video signal be set to the input / output unit. [Effects of the Invention]

[0006] According to the present invention, smoother communication is possible. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic diagram showing an example of an IVI system including a vehicle communication device. [Figure 2] FIG. 10 is a diagram illustrating an example of an operation menu screen. [Figure 3A] FIG. 1 is a block diagram illustrating a configuration of a main part of a vehicle communication device. [Figure 3B] FIG. 2 is a block diagram illustrating the main configuration of a terminal. [Figure 3C] FIG. 2 is a block diagram illustrating the main configuration of a vehicle sensor group and an in-vehicle camera. [Figure 3D] FIG. 2 is a block diagram illustrating the configuration of the main parts of an input device and an output device. [Figure 4] 10 is a flowchart illustrating the flow of control processing by a program. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. <Outline of vehicle communication device> The vehicle communication device according to the embodiment supports communication between passengers inside a vehicle such as an automobile and passengers outside the vehicle who have exited the vehicle. As an example, the vehicle can accommodate multiple passengers (for example, four passengers) including the driver. The vehicle communication device enables communication using video between the passengers who have disembarked and the remaining passengers in the vehicle after some of the passengers, such as family members or acquaintances, have disembarked. For example, a "following (video)" system is implemented in which the disembarking passengers show the passengers in the vehicle footage they have taken outside the vehicle, or the passengers in the vehicle show the disembarking passengers their favorite footage from the footage they have shown. The video outside the vehicle includes footage taken by a terminal used by the disembarking passenger. As outlined above, the vehicle communication device provides a service that allows occupants who remain in the vehicle cabin and occupants who have exited the vehicle to communicate smoothly without causing any inconvenience to the occupants.

[0009] In the embodiment, a vehicle communication device is provided as one of the functions of an IVI (In-Vehicle Infotainment) system provided in a vehicle. Such a vehicle communication device will be described in further detail below.

[0010] <System configuration example> 1 is a schematic diagram showing an example of an IVI system including a vehicle communication device. The IVI system includes a control device 20, a group of vehicle sensors 12 of a vehicle 100 as a moving body, a display unit 51, a projection unit 52, and audio playback units 53A to 53D that constitute an output device 50 provided in the vehicle 100, operation detection units 11A and 11B and microphones 111A and 111B that constitute an input device 11 provided in the vehicle 100, a front seat camera 131 and a rear seat camera 132 that constitute an interior camera 13 provided in the vehicle 100, a terminal 2A used by a front seat occupant P1 in the vehicle cabin, and a terminal 2B used by a rear seat occupant P2 in the vehicle cabin.

[0011] The control device 20 and the terminals 2A and 2B are configured to be capable of wireless communication. The control device 20, the output device 50, the input device 11, the vehicle sensor group 12, and the in-vehicle camera 13 are configured to be capable of wired communication using a CAN (Controller Area Network) or the like. The vehicle 100 is equipped with an air conditioning unit 80 that adjusts the temperature and humidity inside the vehicle cabin, a light-admitting device 70 (which may be called a light-admitting sunroof) that can adjust the amount of light entering the vehicle cabin using light-admitting glass that covers almost the entire ceiling of the vehicle cabin, and an ambient light 60A for the front seats and an ambient light 60B for the rear seats that constitute the lighting device 60.

[0012] As an example, the terminals 2A and 2B are configured by smartphones used by the occupants P1 and P2, respectively. The terminals 2A and 2B may be held in holders (not shown) installed on the seats where the occupants P1 and P2 sit. Although two terminals 2A and 2B are shown as terminals used by occupants P1 and P2, the actual number of terminals varies depending on the number of occupants, and is four when there are four occupants. Furthermore, the number of cameras constituting the in-vehicle camera 13, the number of operation detection units and microphones constituting the input device 11, and the number of display units, projection units and audio playback units constituting the output device 50 may also be changed as appropriate depending on the number of occupants.

[0013] 2 is a diagram illustrating an example of an operation menu screen of the IVI system of FIG. 1. In this embodiment, the operation menu screen is projected or displayed on output device 50 (projection unit 52, display unit 51). When a menu button (which may also be called an icon) displayed on output device 50 is touched or when a voice corresponding to the menu button is input from microphones 111A and 111B that constitute input device 11, control device 20 starts operation of a function corresponding to the menu selected by the touch operation or voice input.

[0014] The operation menu screen illustrated in FIG. 2 includes menu buttons corresponding to a "conversation promotion" function that assists conversations between occupants of vehicle 100, an "acoustic healing" function that provides soothing relief to occupants through sounds played by audio playback units 53A-53D, an "air conditioning healing" function that provides soothing relief to occupants using air conditioning unit 80, a "route guidance" function that provides guidance on the driving route to the destination, a "following (audio)" function that connects the terminal of an occupant who has exited vehicle 100 with the communication unit (described later) of control device 20 to transmit external audio to occupants in the vehicle cabin, a "following (video)" function that connects the terminal of an occupant who has exited vehicle 100 with the communication unit (described later) of control device 20 to transmit external video to occupants in the vehicle cabin, a "vehicle information" function that sets functions of vehicle 100 and operates auxiliary equipment, a "media playback" function that plays media containing content from output device 50, and other functions (description omitted).

[0015] The following description will focus on the functions of the control device 20 as a vehicle communication device when the "Chasing (Video)" button on the operation menu screen is operated. Figures 3A to 3D are diagrams for explaining configuration examples of the parts in Figure 1. <Vehicle communication device> 3A is a block diagram illustrating the configuration of the main parts of the control device 20. The control device 20 includes an arithmetic processing unit such as an MPU (Micro Processing Unit) (not shown), and performs various information processing, control processing, and the like required by the control device 20 by reading and executing predetermined programs stored in a storage unit (not shown).

[0016] The control device 20 includes, as functional components for the vehicle communication device 260, an occupant detection unit 261, a vehicle state detection unit 262, an output unit 263, an input unit 264, a control unit 265, and a communication unit 209, and controls the IVI system to function as the vehicle communication device 260.

[0017] In the embodiment, as an example, when occupants P1 and P2 get into vehicle 100, control device 20 speaks to occupants P1 and P2 via audio playback units 53A to 53D that constitute output device 50, and the voices that occupants P1 and P2 respond to (for example, stating their own names) are collected by microphones 111A and 111B that constitute input device 11, and images of occupants P1 and P2 are captured by front seat camera 131 and rear seat camera 132 that constitute interior camera 13. The control device 20 associates (or may associate) the faces of the occupants P1 and P2, the names of the occupants P1 and P2, and the frequency components of the voices emitted by the occupants P1 and P2.

[0018] (Occupant detection unit) The occupant detection unit 261 detects multiple occupants P1 and P2 riding in the vehicle 100. For example, the occupants P1 and P2 are detected based on camera images acquired by the front seat camera 131 and the rear seat camera 132 that configure the interior camera 13.

[0019] (Vehicle condition detection unit) The vehicle state detection unit 262 acquires vehicle speed information and position information as vehicle information of the vehicle 100 from the vehicle sensor group 12 via the communication unit 209. This enables the control device 20 to determine whether the vehicle 100 is stopped or not.

[0020] (output section) The output unit 263 constituting the input / output unit outputs a communication signal from a terminal (2B in this example) carried by the occupant (e.g., P2) who has disembarked, which is in wireless communication with the communication unit 209, to the output device 50. This allows the occupant (P1 in this example) who remains in the cabin of the vehicle 100 to check the content of the communication via a nearby output device 50 (projection unit 52 for occupant P1, and display unit 51 for occupant P2). More specifically, if the communication signal includes an audio signal, audio based on the audio signal output from the output unit 263 (control device 20) is reproduced by audio reproduction units (53A, 53B for occupant P1 in this example). Furthermore, if the communication signal includes a video signal, an image based on the video signal output from the output unit 263 (control device 20) is projected by the display unit (projection unit 52 onto occupant P1 in this example). When multiple images are transmitted consecutively from a terminal (2B in this example) carried by a passenger (e.g., P2) who has disembarked, the output unit 263 may project the multiple images side by side on the screen of the display unit (projection unit 52 for passenger P1 in this example). The image may include a two-dimensional code. When a two-dimensional code appears in the image from a terminal (2B in this example) carried by a passenger (e.g., P2) who has dismounted, the output unit 263 may project an image related to the two-dimensional code on the screen of the display unit (projection unit 52 for passenger P1 in this example). More specifically, if the two-dimensional code includes information indicating a uniform resource locator (URL), the control unit 265 (described later) acquires a video signal from a server or the like corresponding to the URL via the communication unit 209 (described later), and projects an image based on the video signal on the display unit (projection unit 52 for passenger P1 in this example). In other words, when a passenger (e.g., P2) who has dismounted holds a camera (not shown) of the terminal (2B in this example) carried by the passenger over the two-dimensional code, the passenger of the vehicle 100 (passenger P1 in this example) can view an image related to the two-dimensional code on the display unit (projection unit 52 for passenger P1 in this example). The image associated with the two-dimensional code may be an image introducing a product or the like.

[0021] (Input section) When the operation detection units 11A, 11B are operated by the occupants P1, P2 while a video signal is being output to the output device 50 (projection unit 52, display unit 51), the input unit 264 constituting the input / output unit inputs a signal indicating an object corresponding to the operation position among predetermined objects (e.g., objects, people, icons, two-dimensional codes, etc.) contained in the projected or displayed image from the operation detection units 11A, 11B as an instruction to select by the occupants P1, P2. Furthermore, when the projected or displayed video includes multiple thumbnail images (reduced images with reduced data size), the input unit 264 may input a signal indicating the thumbnail image corresponding to the operation position (a signal indicating the position of the thumbnail image on the projected or displayed screen, or a signal indicating the order in which the thumbnail images are projected or displayed) from the operation detection units 11A and 11B as an instruction for selection by the occupants P1 and P2. In other words, the occupant of the vehicle 100 (occupant P1 in this example) can view an image introducing a product or the like related to the two-dimensional code on the display unit (projection unit 52 for occupant P1 in this example) and input an instruction to select a favorite product or the like from the operation detection units 11A and 11B. Furthermore, the input unit 264 may input instructions by voice uttered by the occupants P1 and P2. More specifically, the input unit 264 inputs the voice signal of the front seat occupant P1 collected by the microphone 111A as an instruction. The input unit 264 also inputs the voice signal of the rear seat occupant P2 collected by the microphone 111B as an instruction.

[0022] (Control unit) When the occupant detection unit 261 detects that one or more of the multiple occupants P1, P2 have disembarked and one or more remain on board, and the vehicle state detection unit 262 detects that the vehicle 100 has stopped, the control device 20 as the control unit 265 controls the communication unit 209 to communicate wirelessly with a terminal (2B in this example) carried by the occupant (e.g., P2) whose disembarkation has been detected, and controls the communication unit 209 to send a signal to the wirelessly communicating terminal (2B in this example) requesting that the output destination of the video signal be set to the output unit 263. In addition, the control unit 265 may acquire terminal location information from a terminal (2B in this example) that is communicating wirelessly with the communication unit 209, and when the distance between the stopped position of the vehicle 100 and the position of the terminal (2B in this example) indicated by the terminal location information exceeds a predetermined distance (e.g., 200 m), the control unit 265 may control the communication unit 209 to send a signal to the wirelessly communicating terminal (2B in this example) requesting cancellation of the setting that outputs the video signal to the output unit 263. The control unit 265 may further control the communication unit 209 to transmit the audio signal input to the input unit 264 (in this example, the audio signal of the front seat occupant P1 collected by the microphone 111A) to a terminal (in this example, 2B), and may also control the output unit 263 to output the audio signal included in the communication signal from the terminal (in this example, 2B) communicating wirelessly to the output device 50 (in this example, audio playback units 53A, 53B for occupant P1) and to output the video signal included in the communication signal to the output device 50 (in this example, projection unit 52 for occupant P1). Furthermore, the control unit 265 may control the communication unit 209 to transmit to the terminal (2B in this example) a signal indicating a selection instruction by the occupant P1 input to the input unit 264. The signal indicating a selection instruction may be, for example, a signal indicating the position of a thumbnail image on a projected or displayed screen, the order in which the thumbnail images are displayed, a favorite product, or the like.

[0023] (Communications Department) The communication unit 209 includes a short-range wireless communication module (not shown) that performs wireless communication with the terminals 2A and 2B, and a wired communication module (not shown) that performs wired communication using a CAN or the like. The short-range wireless communication module may employ a wireless communication method that has a direction detection function.

[0024] <Device> 3B is a block diagram illustrating an example of the configuration of the main parts of terminal 2A. The configuration of terminal 2B is also similar to that of terminal 2A, and is therefore not shown. Terminal 2A includes an arithmetic processing unit such as an MPU (not shown), and performs various information processing, control processing, and the like required for the functional configuration described below by reading and executing a predetermined program (which may also be called an application) stored in a storage unit (not shown). Terminal 2A includes, as functional components, a personal information storage unit 21, a related information storage unit 22, a content storage unit 23, a biometric sensor group 24, and a communication unit 25. Generally, a smartphone is equipped with a display unit, an input unit, an audio playback unit, a camera, a position detection unit, etc., but illustrations and descriptions of these will be omitted. The terminal 2A may share functions with other devices such as a smart watch (not shown).

[0025] (Personal information storage unit) The personal information storage unit 21 stores personal information of the occupant P1 who carries the terminal 2A. When the IVI system functions as the vehicle communication device 260, personal information is not required.

[0026] (Relationship information storage unit) The relationship information storage unit 22 stores relationship level information of the occupant P1 who uses the terminal 2A. When relationship level information indicating the degree of intimacy between the occupants P1 and P2 in the vehicle cabin is transmitted from the control device 20, the relationship information storage unit 22 stores the information. When the IVI system functions as the vehicle communication device 260, the relationship level information is not required.

[0027] (Content storage unit) The content storage unit 23 stores content collected by the occupant P1 who owns the terminal 2A, or information necessary for playing the content (for example, cloud storage for storing the content, URL of a server for streaming the content, etc.). For example, sound content that the occupant P1 wants to listen to when he or she is tired may be stored in advance in the content storage unit 23. The sound content includes voice content and music content.

[0028] (Biosensor group) The biosensor group 24 includes, for example, a heart rate sensor that acquires the heart rate of the occupant P1 carrying the terminal 2A, a respiration sensor that acquires the respiration rate, a blood flow velocity sensor that acquires the blood flow velocity, and an electrical skin resistance sensor that acquires the electrical skin resistance value (all of which are not shown). When the IVI system functions as the vehicle communication device 260, the biosensor group 24 does not need the biosensor information collected by the biosensor group 24.

[0029] (Communications Department) The communication unit 25 includes a short-range wireless communication module (not shown) that performs wireless communication with the control device 20, and a wired communication module (not shown) that performs wired communication using a CAN or the like.

[0030] FIG. 3C is a block diagram illustrating the configuration of the main parts of the vehicle sensor group 12 and the interior camera 13 of the vehicle 100. As shown in FIG. <Vehicle sensors> The vehicle sensor group 12 includes a vehicle speed sensor 121, a positioning sensor 122, and a camera 123. Generally, the vehicle 100 is equipped with sensors such as an acceleration sensor and radar, but these will not be shown or described here.

[0031] (vehicle speed sensor) The vehicle speed sensor 121 detects the speed of the vehicle 100 and outputs vehicle speed information to the control device 20. When the IVI system functions as the vehicle communication device 260, the vehicle speed information is used to determine whether the vehicle 100 is stopped or not.

[0032] (positioning sensor) The positioning sensor 122 detects the current position of the vehicle 100 based on positioning signals from GPS (Global Positioning System) satellites, quasi-zenith satellites, etc. The positioning sensor 122 outputs a signal indicating the current position as position information to the control device 20. When the IVI system functions as the vehicle communication device 260, the information on the current position is used to determine whether the vehicle 100 is stopped or not.

[0033] (camera) The camera 123 captures images of the surroundings of the vehicle 100. The camera 123 outputs data of the subject image as image information to the control device 20. The camera 123 can capture both still images and moving images. When the IVI system functions as the vehicle communication device 260, image information of the surroundings of the vehicle 100 is not required.

[0034] <In-vehicle camera> The vehicle interior camera 13 includes a front seat camera 131 and a rear seat camera 132. The front seat camera 131 captures an image of the upper body of an occupant P1 sitting in the front seat, and outputs the subject image data as image information to the control device 20. The rear seat camera 132 captures an image of the upper body of an occupant P2 sitting in the rear seat, and outputs the subject image data as image information to the control device 20.

[0035] FIG. 3D is a block diagram illustrating the configuration of the main parts of the input device 11 and the output device 50 of the control device 20 of the vehicle 100. As shown in FIG. <Input device> The input device 11 includes operation detection units 11A and 11B and microphones 111A and 111B. (Operation detection unit) The operation detection unit 11A is operated by a front seat passenger P1 and outputs an operation signal to the control device 20. The operation detection unit 11A may be configured as a pointing device that works in conjunction with a projected image projected by a projection unit 52, which will be described later. The operation detection unit 11B is provided on the display surface of the display unit 51. The operation detection unit 11B is operated by a rear seat passenger P2 and outputs an operation signal indicating a touch position to the control device 20.

[0036] (microphone) The microphone 111A collects the voice uttered by the front seat passenger P1 and outputs an audio signal to the control device 20. The microphone 111B collects the voice uttered by the rear seat passenger P2 and outputs an audio signal to the control device 20.

[0037] <Output device> The output device 50 includes a display unit 51, a projection unit 52, and an audio playback unit 53. The output device 50 is used, for example, to display the operation menu screen of Fig. 2, to display video when a video signal is included in the communication signal of the vehicular communication device 260, or to play content. The video signal is output from the output unit 263 (control device 20) described above. The content to be played may be acquired via the communication unit 209 from terminals 2A and 2B carried by multiple occupants P1 and P2 in the vehicle cabin. The content may be acquired not only from the terminals 2A and 2B, but also from an external content management server via a communication network (not shown). The content management server includes a cloud storage that stores the content and a streaming server that plays the content. The content to be played is searched for and acquired by the control device 20 via the communication unit 209. The content to be played back may be video content (moving images, still images, text display, icon display, graphic display, etc.) or audio content.

[0038] (Display) The display unit 51 has a screen such as a liquid crystal display, and displays image information based on a display signal output from the control device 20. The image information includes the operation menu screen of FIG. 2, video from a terminal (2B in this example) with which the communication unit 209 communicates wirelessly, images of video content, and the like.

[0039] (projection section) The projection unit 52 is configured by a head-up display (HUD) that is projected onto the windshield, for example, and projects image information based on a projection signal output from the control device 20. The image information includes the operation menu screen of FIG. 2, video from a terminal (2B in this example) with which the communication unit 209 communicates wirelessly, images of video content, and the like.

[0040] (Audio playback section) The audio playback units 53A to 53D are configured as speakers that play back and output audio and the like, and play back audio, sound content, and the like from a terminal (2B in this example) with which the communication unit 209 communicates wirelessly, based on a playback signal output from the control device 20. Note that an audio output unit that outputs a content playback signal to headphones (not shown) or the like may also be provided.

[0041] <Explanation of the flowchart> Fig. 4 is a flowchart illustrating an example of control processing by a program executed by the MPU of the control device 20. When the "Follow (Video)" button is operated on the operation menu screen of Fig. 2, the MPU of the control device 20 executes a program that performs the processing shown in Fig. 4 to make the IVI system function as the vehicular communication device 260. While executing the program, the control device 20 functions as the control unit 265 of the vehicular communication device 260.

[0042] 4, the control device 20 detects the occupants P1 and P2 riding in the vehicle 100 using the occupant detection unit 261, and proceeds to step S2. Note that the detection of the occupants P1 and P2 may be performed by using a camera image acquired by the above-mentioned in-vehicle camera 13 (which may also be called a DMC (Driver Monitoring Camera)), or by using a seating sensor, or by detecting the terminals 2A and 2B carried by the occupants P1 and P2 inside the vehicle, or the like.

[0043] In step S2, the control device 20 starts acquiring vehicle speed information and position information as vehicle information of the vehicle 100 by the vehicle state detection unit 262, and then proceeds to step S3.

[0044] In step S3, the control device 20 determines whether or not the occupants P1 and P2 have dismounted based on the detection result by the occupant detection unit 261. If the control device 20 determines that at least one occupant has dismounted, it makes a positive judgment in step S3 and proceeds to step S4, whereas if the control device 20 does not determine that any occupants have dismounted, it makes a negative judgment in step S3 and proceeds to step S13.

[0045] In step S4, the control device 20 determines whether either of the occupants P1 and P2 remains in the vehicle cabin based on the detection result by the occupant detection unit 261. If at least one person remains in the vehicle cabin, the control device 20 makes a positive judgment in step S4 and proceeds to step S5, whereas if neither occupant P1 nor P2 is present in the vehicle cabin, the control device 20 makes a negative judgment in step S4 and proceeds to step S13.

[0046] In step S5, the control device 20 determines whether or not the vehicle 100 is stopped based on the detection result by the vehicle state detection unit 262. If the vehicle 100 is stopped, the control device 20 makes an affirmative judgment in step S5 and proceeds to step S6. If the vehicle 100 is not stopped, the control device 20 makes a negative judgment in step S6 and proceeds to step S13.

[0047] In step S13, which is reached when the determination is made in step S3, S4, or S5, the control device 20 determines whether or not to terminate the control process. If a predetermined termination operation has been performed, the control device 20 makes an affirmative determination in step S13 and proceeds to step S12, and if no termination operation has been performed, the control device 20 makes a negative determination in step S13 and returns to step S3. If returning to step S3, the control device 20 repeats the above-mentioned process. In other words, it waits for the occupants P1 and P2 to disembark.

[0048] In step S6, the control device 20 starts wireless communication with the external terminal (terminal 2A or 2B in this example) carried by the disembarking occupant P1 or P2 via the communication unit 209, and then proceeds to step S7.

[0049] In step S7, the control device 20 sends a signal via the communication unit 209 to the terminal outside the vehicle (terminal 2A or 2B in this example) carried by the disembarking occupant P1 or P2, requesting that the output destination of the video signal be set to the output device 50 of the vehicle 100, and then proceeds to step S8.

[0050] In step S8, the control device 20 outputs the video signal acquired from the terminal outside the vehicle (terminal 2A or 2B in this example) to the output device 50 via the output unit 263, and then proceeds to step S9.

[0051] In step S9, the control device 20 transmits a signal indicating the instructions of the occupant P1 or P2 inside the vehicle cabin input to the input unit 264 to a terminal outside the vehicle (terminal 2A or 2B in this example) via the communication unit 209, and proceeds to step S10.

[0052] In step S10, the control device 20 determines, by the control unit 265, whether or not the distance from the vehicle 100 to the terminal outside the vehicle (terminal 2A or 2B in this example) exceeds a predetermined distance. If the distance between the stopping position of the vehicle 100 and the terminal position indicated by the terminal position information from terminal 2A or 2B exceeds the predetermined distance, the control unit 265 makes a positive judgment in step S10 and proceeds to step S11. If proceeding to step S11, the control device 20 automatically proceeds to the termination process regardless of a predetermined termination operation. On the other hand, if the distance between the stopping position of vehicle 100 and the position of terminal 2A or 2B does not exceed the predetermined distance, control unit 265 makes a negative judgment in step S10 and returns to step S8. When returning to step S8, control unit 265 continues wireless communication (tracking (video)) between communication unit 209 and the terminal outside the vehicle (terminal 2A or 2B in this example).

[0053] In step S11, the control device 20 sends a signal via the communication unit 209 to the terminal outside the vehicle (terminal 2A or 2B in this example) carried by the occupant P1 or P2 who has disembarked, requesting cancellation of the setting that outputs the video signal to the output device 50 of the vehicle 100, and then proceeds to step S12.

[0054] In step S12, the control device 20 performs a termination process to terminate the process shown in Fig. 4. The termination process includes, for example, termination of the output of the video signal to the output device 50 and termination of wireless communication (following (video)) by the communication unit 209 with a terminal outside the vehicle (terminal 2A or 2B in this example).

[0055] According to the embodiment described above, the following advantageous effects are achieved. (1) The vehicle communication device 260 includes an occupant detection unit 261 that detects a plurality of occupants P1 and P2 aboard the vehicle 100, a communication unit 209 that can wirelessly communicate with one or more terminals 2A and 2B among the terminals 2A and 2B carried by the plurality of occupants P1 and P2, a vehicle state detection unit 262 that detects whether the vehicle 100 is stopped, and an input unit 264 that outputs a video signal from the terminal 2A or 2B that wirelessly communicates with the communication unit 209 and that can input instructions from the occupant P1 or P2. and a control unit 265 that, when the occupant detection unit 261 detects that one or more of the multiple occupants P1, P2 have disembarked and one or more of the multiple occupants P1, P2 continue to ride the vehicle and the vehicle state detection unit 262 detects that the vehicle 100 has stopped, wirelessly communicates with the terminal 2A or 2B carried by the occupant P1 or P2 whose disembarkation has been detected, and controls the communication unit 209 to send a signal to the wirelessly communicating terminal 2A or 2B requesting that the output destination of the video signal be set to the output unit 263 as an input / output unit. With this configuration, in all cases where (i) no one has exited vehicle 100, (ii) all occupants P1 and P2 have exited vehicle 100, or (iii) vehicle 100 has started moving, no wireless communication is performed between terminal 2A or 2B carried by occupant P1 or P2 whose exit is detected and communication unit 209 of vehicle 100. In other words, while preventing unnecessary communication connections, wireless communication (following (video)) is performed between communication unit 209 and a terminal outside the vehicle (terminal 2A or 2B in this embodiment), and video communication is performed between occupants remaining in the vehicle cabin and occupants who have exited the vehicle. In this way, smooth communication is possible without causing inconvenience to occupants.

[0056] (2) In the vehicle communication device 260 described in (1) above, the vehicle state detection unit 262 further detects the stopping position of the vehicle 100, and the control unit 265 acquires terminal position information from the terminal 2A or 2B that is wirelessly communicating with the communication unit 209. When the distance between the stopping position of the vehicle 100 and the position indicated by the terminal position information exceeds a predetermined distance, the control unit 265 controls the communication unit 209 to send a signal to the wirelessly communicating terminal 2A or 2B requesting cancellation of the setting that sets the output destination of the video signal to the output unit 263 as an input / output unit. With this configuration, when occupant P1 or P2, whose disembarking has been detected, moves away from vehicle 100 by a predetermined distance or more, the above setting is automatically cancelled in vehicle communication device 260 on vehicle 100. As a result, it is possible to prevent the image from terminal 2A or 2B of occupant P1 or P2 outside the vehicle from being continuously projected or displayed on the display unit (projection unit 52 for occupant P1, and display unit 51 for occupant P2) inadvertently.

[0057] (3) In the vehicle communication device 260 of (1) or (2) above, when an instruction from the occupant P1 or P2 regarding the image based on the video signal is input to the input unit 264 as an input / output unit while the output unit 263 as an input / output unit is outputting a video signal from the terminal 2A or 2B, the communication unit 209 is controlled to send a signal indicating the input instruction to the terminal 2A or 2B with which the communication unit 209 is communicating wirelessly. With this configuration, communication using video is supported between the occupant who remains in the vehicle (occupant P1 in this example) and the occupant who has disembarked (occupant P2 in this example). As a result, smooth communication using video is possible between the occupant who remains in the vehicle and the occupant who has disembarked.

[0058] The above embodiment can be modified in various ways, and modifications will be described below. (Variation 1) In the above-described embodiment, an example has been described in which the vehicle communication device 260 wirelessly communicates with the terminal 2B carried by one occupant (e.g., P2) who has disembarked via the communication unit 209. Alternatively, if there are multiple occupants who have disembarked (however, there is one or more occupants who remain in the vehicle), it is possible for the vehicle communication device 260 to be communicatively connected to each of the terminals carried by the occupants, i.e., the multiple terminals, via the communication unit 209. According to the first modification, even when a plurality of occupants who have disembarked leave the vehicle 100 and move in different directions, it is possible to support communication between each occupant and the occupants who remain in the vehicle.

[0059] (Variation 2) In the above embodiment, an example has been described in which four people including the driver are accommodated in the vehicle cabin, but the number of occupants is not limited to four, and may be six or ten.

[0060] (Variation 3) In the above-described embodiment, variant 1, and variant 2, the vehicle 100 as a moving body is given as an example of a vehicle compartment in which communication is supported by the vehicle communication device 260, but any cabin of a moving body carrying multiple occupants may be treated in the same way as the vehicle compartment described above.

[0061] The above description is merely an example, and the present invention is not limited to the above-described embodiment and modifications as long as the features of the present invention are not impaired. One or more of the above-described embodiment and modifications can be arbitrarily combined, and modifications can also be combined with each other. [Explanation of symbols]

[0062] 2A, 2B terminal, 11 input device, 11A, 11B operation detection unit, 12 vehicle sensor group, 13 in-vehicle camera, 20 control device, 50 output device, 51 display unit, 52 projection unit, 53A to 53D audio playback unit, 100 vehicle, 111A, 111B microphone, 131 front seat camera, 132 rear seat camera, 209 communication unit, 260 vehicle communication device, 261 occupant detection unit, 262 vehicle state detection unit, 263 output unit, 264 input unit, 265 control unit

Claims

1. an occupant detection unit that detects a plurality of occupants in the vehicle; a communication unit capable of wireless communication with one or more of the terminal devices carried by the plurality of occupants; a vehicle state detection unit that detects when the vehicle is stopped; an input / output unit that outputs a video signal from the terminal device that is wirelessly communicating with the communication unit and that is capable of inputting instructions from the occupant; a control unit that, when the occupant detection unit detects that one or more of the plurality of occupants have gotten off the vehicle and one or more of the plurality of occupants continue to be on the vehicle and the vehicle state detection unit detects that the vehicle has stopped, wirelessly communicates with the terminal device carried by the occupant whose getting off has been detected, and controls the communication unit to send a signal to the terminal device communicating wirelessly, requesting that the output destination of the video signal be set to the input / output unit; A vehicle communication device comprising:

2. 2. The vehicle communication device according to claim 1, The vehicle state detection unit further detects a stopping position of the vehicle, The control unit acquiring terminal location information from the terminal device wirelessly communicating with the communication unit; When the distance between the stopping position of the vehicle and the position indicated by the terminal position information exceeds a predetermined distance, the communication unit is controlled so as to send a signal to the terminal device communicating wirelessly to request cancellation of the setting that sets the output destination of the video signal to the input / output unit. A vehicle communication device comprising:

3. 3. The vehicle communication device according to claim 1, When an instruction from the occupant regarding the image based on the video signal is input to the input / output unit while the input / output unit is outputting the video signal from the terminal device, the communication unit is controlled to send a signal indicating the input instruction to the terminal device that is wirelessly communicating with the occupant. A vehicle communication device comprising:

Images