Video Chat System and Program

Abstract

A video chat system (1) of the present disclosure is for assisting communication in a chat group that includes: an occupant of a vehicle (10) in which an onboard computer has been installed; and a user that is not an occupant of the vehicle (10). The disclosed video chat system (1) comprises: a distribution means (3) for distributing video of vehicle surroundings captured by an imaging device (18) installed in the vehicle (10) to the chat group; and a control means for causing messages exchanged within the chat group and the video of vehicle surroundings to be displayed on chat screens of a terminal (10') within the vehicle (10) and a terminal (20) of the user.

Description

Technical Field

[0001] The present invention relates to a video chat system and a program for supporting communication.

Background Art

[0002] Conventionally, a chat system has been developed that realizes real-time communication using characters and images among passengers in a plurality of vehicles via a network such as a mobile phone line network or the Internet. For example, a chat system has been proposed in which a map image representing the driving position of a vehicle can be shared among a plurality of vehicles, and messages can be exchanged with each other. By sharing a map image within a chat group, it becomes easier to consult about a destination or a driving route, and smooth communication can be realized (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The above chat system is suitable for use when a plurality of people ride in a plurality of vehicles and drive while communicating. On the other hand, it is also conceivable to expand the chat group to include not only the passengers in the vehicle but also users who are not in the vehicle. However, in this case, there is a problem that it is difficult to convey the sense of presence and fun of driving felt by the passengers in the vehicle to the users who are not in the vehicle only by the exchange of characters, images, and map images, and it is difficult to realize good communication.

[0005] One of the objectives of this case was invented in light of the above-mentioned problems, and is to provide a video chat system and program that enables good communication. However, in addition to this objective, another objective of this case is to achieve effects derived from the various components shown in the "Mode for Carrying Out the Invention" below, which are not obtainable with conventional technology. [Means for solving the problem]

[0006] The disclosed video chat system and program can be realized as the following aspects or application examples, and solve at least some of the above problems. The disclosed video chat system is a system for communicating with an occupant of a vehicle equipped with an on-board computer, The aforesaid A video chat system for supporting communication in a chat group including users who are not passengers, comprising: a distribution means for distributing to the chat group images of the surroundings of the vehicle captured by an imaging device mounted on the vehicle; and a control means for displaying messages exchanged within the chat group and the images of the surroundings of the vehicle on the chat screens of a terminal in the vehicle and the user's terminal. The control means causes a map image including the position information of the vehicle to be displayed on the chat screen. The chat screen has a first mode in which the message and the vehicle surrounding video are simultaneously displayed, a second mode in which the message and the map image are simultaneously displayed, and a third mode in which the message, the vehicle surrounding video, and the map image are simultaneously displayed. The display area of the chat screen is divided into a first display area and a second display area adjacent to the first display area. The control means selects any one of the first mode, the second mode, and the third mode according to the operation of the occupant or the user. In the first mode, the vehicle surrounding video is displayed in the first display area. In the second mode, the map image is displayed in the first display area. In the third mode, the vehicle surrounding video and the map image are displayed in the first display area. In all of the first mode, the second mode, and the third mode, the message is displayed in the second display area.

[0007] The disclosed program includes: a vehicle occupant having an on-board computer; The aforesaid A program for supporting communication in a chat group including users who are not passengers, the program transmitting a vehicle periphery image captured by an imaging device mounted on the vehicle to the chat group, and displaying messages exchanged within the chat group and the vehicle periphery image on chat screens of a terminal in the vehicle and a terminal of the user. , causes a map image including the position information of the vehicle to be displayed on the chat screen, the chat screen has a first mode in which the message and the vehicle surrounding video are simultaneously displayed, a second mode in which the message and the map image are simultaneously displayed, and a third mode in which the message, the vehicle surrounding video, and the map image are simultaneously displayed, the display area of the chat screen is divided into a first display area and a second display area adjacent to the first display area, any one of the first mode, the second mode, and the third mode is selected according to the operation of the occupant or the user, in the first mode, the vehicle surrounding video is displayed in the first display area, in the second mode, the map image is displayed in the first display area, in the third mode, the vehicle surrounding video and the map image are displayed in the first display area, and in all of the first mode, the second mode, and the third mode, the message is displayed in the second display area The processing is executed by a computer. [Effects of the Invention]

[0008] According to the disclosed video chat system and program, by displaying the video of the vehicle surroundings captured by the imaging device mounted on the vehicle on the chat screen, the real scenery and the state of the environment seen by the vehicle occupants can be presented to the chat group, and the on-site feeling and fun of driving can be shared. Therefore, good communication can be realized.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0010] The disclosed video chat system and program can be implemented by the following embodiments. The video chat system is a system for assisting real-time communication (chat, conversation) among multiple users via a computer, and is a system in which at least one or more occupants of a vehicle can distribute the video of the vehicle surroundings (video, vehicle surroundings video) to other users. Specific means of communication include, for example, characters, emojis, images, videos, voices, music, etc.

[0011] Among these, visual information is output from a display device connected to a computer, and auditory information is output from an audio device connected to the computer. The screen on which visual information related to communication is displayed is called a "chat screen". A program for controlling the visual information and auditory information displayed on the chat screen is installed and executed on at least one or more computers.

[0012] As known examples of video chat systems, there are zoom (registered trademark), Microsoft Teams (registered trademark), LINE (registered trademark), etc. On the other hand, the disclosed video chat system has a function of distributing the video captured by an imaging device mounted on a vehicle. The video referred to here includes not only the real image (Raw data, live video) captured by the imaging device, but also the processed video obtained by performing image processing (synthesis processing, filter processing, effector processing, etc.) on the real image, and the animation video (avatar) in which the pattern is automatically generated to correspond to the movement and expression of the subject, etc.

[0013] In the disclosed video chat system, there can be a plurality of chat groups. A chat group means a group of users who share the content of communication (content of dialogue). Also, the place where communication is made within one chat group is regarded as a room and is also called a "chat room". Each user can belong to and leave a chat group using a known authentication method (for example, ID, password, invitation letter, etc.), and can belong to a plurality of chat rooms (a plurality of chat groups) at the same time.

Example

[0014] [1. System] Figs. 1(A) and (B) are schematic diagrams showing a configuration example of a video chat system 1 as an embodiment. The video chat system 1 shown in Fig. 1(A) includes a vehicle 10 equipped with an in-vehicle computer (terminal 10') and a terminal 20. The video chat system 1 shown in Fig. 1(B) includes a plurality of vehicles 10, a plurality of terminals 20, and a server 30. The number of each of the vehicle 10, the terminal 20, and the server 30 included in the video chat system 1 can be arbitrarily set. The video chat system 1 functions to assist communication in a chat group including the passengers of the vehicle 10 and users who are not passengers of the vehicle 10.

[0015] The in-vehicle computer means a computer (or a group of computers) installed in the vehicle 10 and includes, for example, IVI (in-vehicle infotainment) and TCU (telematics control unit). The terminal 20 means a computer (or a group of computers) not installed in the vehicle 10, such as a smartphone, a desktop personal computer, a notebook personal computer, or a PDA (personal digital assistant). The in-vehicle computer (terminal 10') of the vehicle 10 and the terminal 20 can be directly communicable, for example, by P2P (peer to peer) connection, or can be communicable via a network 40 such as a mobile phone line network or the Internet (for example, servers constituting the network 40, base stations of telecommunications carriers, wireless routers, etc.).

[0016] Figure 2 is a block diagram for explaining the device configurations of terminals 10', 20, and server 30 included in the video chat system 1. Although there may be multiple terminals 10', 20, and servers 30 in the video chat system 1, they are simplified in the figure. The terminal 10' is provided with an electronic control device 11, a display device 12, an input device 13, a storage device 14, a communication device 15, a positioning device 16, an acoustic device 17, an imaging device 18, and a microphone 19. In addition, sensors (not shown) for detecting driving information (such as vehicle speed and output information) representing the driving state of the vehicle 10 are also connected to the terminal 10'. In this embodiment, it is assumed that the above various elements 12 to 19 are included inside the terminal 10', but it is also possible to provide some (or all) of the various elements 12 to 19 outside the terminal 10'.

[0017] The electronic control device 11 is an electronic control device (computer) on which a processor and a memory are mounted. When multiple electronic control devices are mounted on the vehicle 10, their totality may be regarded as the electronic control device 11 in this embodiment. The display device 12 is one of the devices for visually outputting the calculation results of the electronic control device 11 and the chat screen, and is, for example, a liquid crystal display, an organic EL display, or a projector. The display device 12 is installed near the instrument panel or dashboard of the vehicle 10.

[0018] The input device 13 is a device for inputting information to the electronic control device 11, and is, for example, a touch panel or physical keys (physical buttons) attached in a superimposed state on the surface of the display device 12. Input of characters and emojis for communication in the chat group is performed via the input device 13. The storage device 14 is a memory device for storing data and programs to be retained long-term, and is, for example, a flash memory or a solid state drive, etc. The application program of the video chat system 1 may be saved in the storage device 14.

[0019] The communication device 15 is an electronic control device (such as a mobile communication device, a vehicle-to-road communication device, a vehicle-to-vehicle communication device, etc.) for performing wireless communication with other computers via the network 40. The communication device 15 may be provided as an independent single device, or may be provided integrally with the electronic control device 11. The positioning device 16 is an electronic control device (such as a car navigation device) that measures the position of the vehicle 10 based on detection information such as GNSS (Global Navigation Satellite System), a vehicle speed sensor, a steering angle sensor, and a yaw rate sensor. The positioning device 16 may be provided as an independent single device, or may be provided integrally with the electronic control device 11.

[0020] The audio device 17 (speaker) is a device that transmits auditory information such as voice and music to the passengers of the vehicle 10. The imaging device 18 is a device that captures images (vehicle surrounding images) of the scenery and environment around the vehicle 10. Specific examples of the imaging device 18 include a video camera, an infrared camera, a still camera, a radar, etc. The vehicle 10 of this embodiment is equipped with a plurality of video cameras with different shooting directions. For example, a front camera that shoots in the traveling direction of the vehicle 10, a rear camera that shoots the rear, a right camera that shoots the right side, and a left camera that shoots the left side are installed. The microphone 19 is a device for information input to the electronic control device 11 and is a device that converts sound into an electrical signal. Voice input for communication in a chat group is implemented via the microphone 19.

[0021] The device configuration of the terminal 20 is almost the same as that of the vehicle 10. The terminal 20 is provided with an electronic control device 21, a display device 22, an input device 23, a storage device 24, a communication device 25, a positioning device 26, an acoustic device 27, an imaging device 28, and a microphone 29 (microphone). The electronic control device 21 is an electronic control device (computer) on which a processor and a memory are mounted, and the display device 22 is, for example, a liquid crystal display or an organic EL display. Further, the input device 23 is a touch panel or physical keys, and the storage device 24 is a flash memory, a solid state drive, or the like.

[0022] The communication device 25 is an electronic control device for performing wireless communication with other computers via the network 40, and the positioning device 26 is an electronic control device for measuring the position of the terminal 20 based on detection information such as GNSS and wireless signal strength. The acoustic device 27 is a device for transmitting auditory information such as voice and music to the user of the terminal 20, the imaging device 28 is a device for acquiring the scenery around the terminal 20 and the image of the user of the terminal 20, and the microphone 29 is a device for converting sound into an electrical signal.

[0023] The device configuration of the server 30 is simpler compared to the vehicle 10 and the terminal 20, and corresponds to the one in which the positioning device 26, the acoustic device 27, the imaging device 28, and the microphone 29 are omitted from the terminal 20. The server 30 is provided with an electronic control device 31, a display device 32, an input device 33, a storage device 34, and a communication device 35. The electronic control device 31 is an electronic control device (computer) on which a processor and a memory are mounted, and the display device 32 is, for example, a liquid crystal display or an organic EL display. Further, the input device 33 is a touch panel or physical keys, the storage device 34 is a hard disk drive, a solid state drive, or the like, and the communication device 35 is an electronic control device for performing wireless communication with other computers via the network 40.

[0024] [2. Program] The disclosed program 2 is installed in each of, for example, the vehicle 10 and the terminal 20 and executed individually. Alternatively, it is installed and executed in at least one of the vehicle 10, the terminal 20, and the server 30. Also, among the vehicle 10, the terminal 20, and the server 30, it may be installed in a plurality of devices and executed in cooperation with each other. In the following description, it is assumed that the programs 2 installed in each of the vehicle 10 and the terminal 20 are executed in cooperation.

[0025] Figure 3 is a block diagram conceptually showing the functions of the program 2. The program 2 has a function of distributing messages, map images, videos, driving information, etc. to a chat group and displaying the information distributed within the chat group on the chat screens of the terminal 10' and the user's terminal 20. The messages here include, for example, characters, emojis, images (stamps), voices, music, etc. The map image is an image of a map including the position information of the vehicle 10 or the terminal 20 (information on the position measured by the positioning devices 16, 26). The video is a video of the surrounding area of the vehicle (real image or its processed image, etc.) taken by the imaging device 18. The driving information is information representing the driving state of the vehicle 10 where the video of the surrounding area of the vehicle is taken, for example, information on vehicle speed and output. The driving information includes information such as engine rotation speed, motor rotation speed, motor power consumption, energy consumption rate, remaining fuel, battery charge rate, etc.

[0026] The program 2 includes a distribution means 3 (second distribution means), a generation means 4, and a control means 5. These means are shown by classifying the functions of the program 2 for convenience, and each means may be described as an independent program, or may be described as a composite program having these functions. The program 2 is installed, for example, in the storage device 14 of the vehicle 10 or the storage device 24 of the terminal 20. It should be noted that the distribution means 3 and the generation means 4 of this embodiment are assumed not to function in the terminal 20.

[0027] The distribution means 3 has a function of distributing the surrounding vehicle video captured by the imaging device 18 mounted on the vehicle 10 to the chat group. In the vehicle 10, for example, the surrounding vehicle videos captured by each of the plurality of imaging devices 18 are distributed via the distribution means 3. The distribution means 3 of the present embodiment also distributes the bird's-eye view video of the vehicle 10 generated by the generation means 4 to the chat group. The distribution of messages, map images, and driving information may be covered by means other than the distribution means 3, or all information distribution may be entrusted to the distribution means 3. When the chat group includes the passengers of a plurality of vehicles 10, the distribution means 3 in each vehicle 10 distributes the surrounding vehicle video obtained by that vehicle 10.

[0028] The generation means 4 has a function of generating a bird's-eye view video of the vehicle 10 based on the surrounding vehicle videos captured by the plurality of imaging devices 18 mounted on the vehicle 10. The bird's-eye view video corresponds to a video obtained by projecting the scenery when looking in an arbitrary direction (line-of-sight direction) from a position (viewpoint) different from the positions where the plurality of imaging devices 18 are installed onto a two-dimensional plane, and can be generated using known image processing techniques (see, for example, Japanese Patent Application Laid-Open No. 2002-109697). Further, the generation means 4 has a function of synthesizing a CG image of the vehicle 10 on the bird's-eye view video based on the viewpoint and line-of-sight direction of the bird's-eye view video. That is, the vehicle 10 that cannot be reflected in the surrounding vehicle video of the imaging device 18 is synthesized as a CG image into the bird's-eye view video to improve the reality of the bird's-eye view video.

[0029] The control means 5 has a function of displaying the messages exchanged in the chat group and the surrounding vehicle video on the chat screens of the terminal 10' in the vehicle 10 and the user's terminal 20. In the vehicle 10, the surrounding vehicle video and the bird's-eye view video captured by the imaging device 18 of the own vehicle can be displayed on the chat screen. Also, in the terminal 20, the surrounding vehicle video and the bird's-eye view video distributed via the network 40 can be displayed on the chat screen. Further, not only the messages and the surrounding vehicle video, but also a map image including the position information of the vehicle 10 where the surrounding vehicle video was captured can be displayed on the chat screen.

[0030] The types of information displayed on the chat screen may be freely selected and set by the passengers of the vehicle 10 or the users of the terminal 20. For example, three types of modes may be prepared as the display modes of the chat screen, and the control means 5 may select any one of them according to the operations of the passengers of the vehicle 10 or the users of the terminal 20. · The first mode in which the message and the surrounding vehicle video are displayed simultaneously · The second mode in which the message and the map image are displayed simultaneously · The third mode in which the message, the surrounding vehicle video, and the map image are displayed simultaneously In addition, when the chat group includes passengers of a plurality of vehicles 10, any one of the surrounding vehicle videos distributed from each vehicle 10 may be freely selected and viewed by the passengers of the vehicle 10 or the users of the terminal 20.

[0031] [3. Flowchart] FIG. 4 is a flowchart showing the control flow related to information distribution and is executed in the vehicle 10. In step A1, the program 2 acquires the position information and driving information of the vehicle 10. The position information is detected by the positioning device 16, and the driving information is detected by sensors (not shown). If there are messages (characters, emojis, voices, etc.) detected by the input device 13 or the microphone 19, the program 2 also acquires those information.

[0032] In step A2, the program 2 acquires the surrounding vehicle video captured by the imaging device 18. Here, a plurality of surrounding vehicle videos captured by each of the plurality of imaging devices 18 are individually acquired. In the subsequent step A3, the generation means 4 generates an overhead view video of the vehicle 10 based on the plurality of surrounding vehicle videos. At this time, the CG image of the vehicle 10 may be synthesized on the overhead view video. In the subsequent step A4, the distribution means 3 distributes the driving information, message, map image, and video (real image or its processed video) to the chat group.

[0033] FIG. 5 is a flowchart showing the control flow related to information display, and is executed in vehicle 10 (a vehicle 10 different from the vehicle 10 that distributed information in step A4 of FIG. 4, hereinafter also referred to as "second vehicle 10") or terminal 20. In step A5, program 2 acquires driving information, messages, map images, and videos (real images and processed images thereof) via network 40. If there are messages (characters, emojis, voices, etc.) detected by input devices 13, 23 and microphones 19, 29, program 2 also acquires those pieces of information.

[0034] In step A6, when a plurality of vehicles 10 are distributing vehicle surrounding videos to a chat group, program 2 selects one of the vehicle surrounding videos. For example, one of the vehicle surrounding videos is selected according to the operation of the occupants of vehicle 10 or the user of terminal 20. Also, in step A7, according to the operation of the occupants of vehicle 10 or the user of terminal 20, one of the display modes of the first mode, the second mode, and the third mode is selected. In subsequent step A8, control means 5 causes a message or the like to be displayed on the chat screen.

[0035] [4. Display Examples] FIGS. 6(A) to (C) are schematic diagrams showing display examples of the chat screen. FIG. 6(A) is a display example of the first mode, FIG. 6(B) is a display example of the second mode, and FIG. 6(C) is a display example of the third mode. In the first mode, as shown in FIG. 6(A), the message 53 in the chat group and the vehicle surrounding video 54 distributed by vehicle 10 are displayed simultaneously. For example, the chat screen is divided into two parts vertically, and the message 53 is displayed on the lower screen. On the upper screen, the real image captured by the front camera of vehicle 10 is displayed as the vehicle surrounding video 54. At this time, preferably, the driving information 55 of vehicle 10 is displayed simultaneously. For example, information such as vehicle speed and engine rotation speed is superimposed and displayed on the vehicle surrounding video 54. In addition, icons representing users in the chat group (for example, self-icon 51 and other-icon 52) may be displayed on the chat screen simultaneously.

[0036] In the second mode, as shown in FIG. 6(B), the message 53 in the chat group and the map image 56 including the position information of the vehicle 10 are simultaneously displayed. For example, the chat screen is divided into two vertically, and the message 53 is displayed on the lower screen. On the upper screen, a map image 56 showing the surroundings centered on the current position of the vehicle 10 is displayed. At this time, an icon imitating an automobile may be displayed at the position of the vehicle 10 in the map image 56. The scale of the map image 56 may be made changeable by the user (or passenger) viewing the chat screen.

[0037] In the third mode, as shown in FIG. 6(C), the message 53 in the chat group, the vehicle surrounding video 57 distributed by the vehicle 10, and the map image 56 are simultaneously displayed. For example, the chat screen is divided into three vertically, the message 53 is displayed on the lower screen, and the map image 56 is displayed on the middle screen. On the upper screen, for example, an aerial video generated based on the vehicle surrounding videos taken by a plurality of imaging devices 18 is displayed as the vehicle surrounding video 57. Preferably, the driving information 55 of the vehicle 10 is simultaneously overlaid and displayed on the vehicle surrounding video 57. Instead of the vehicle surrounding video 57, the vehicle surrounding video 54 as shown in FIG. 6(A) may be displayed on the upper screen.

[0038] [5. Operations, Effects] (1) The video chat system 1 of the present embodiment is a video chat system 1 for assisting communication in a chat group including passengers of the vehicle 10 equipped with an in-vehicle computer (terminal 10') and a user using the terminal 20. This video chat system 1 includes a distribution means 3 for distributing the vehicle surrounding video taken by the imaging device 18 mounted on the vehicle 10 to the chat group, and a control means 5 for displaying the message and the vehicle surrounding video exchanged in the chat group on the chat screens of the terminal 10' in the vehicle 10 and the user's terminal 20.

[0039] In addition, Program 2 of this embodiment is a program 2 for assisting communication in a chat group including the passengers of vehicle 10 equipped with an in-vehicle computer (terminal 10') and the user using terminal 20. This Program 2 distributes the video of the surrounding area of the vehicle captured by the imaging device 18 mounted on the vehicle 10 to the chat group, and causes a computer (electronic control devices 11, 21) to execute a process of displaying the messages exchanged in the chat group and the video of the surrounding area of the vehicle on the chat screen of the terminal 10' in the vehicle 10 or the user's terminal 20.

[0040] According to the above video chat system 1 and Program 2, by displaying the video of the surrounding area of the vehicle captured by the imaging device 18 mounted on the vehicle 10 on the chat screen, the real scenery and environment that the passengers of the vehicle 10 are seeing can be presented to the chat group, and the excitement and fun of driving can be shared. In addition, compared with communication by characters and emojis, the reality of the virtual driving experience can be improved. Therefore, good communication can be realized.

[0041] For example, when a passenger of the vehicle 10 is driving alone, they can have a fun chat with friends in the chat group. In addition, the user of the terminal 20 can see the real scenery and environment that the passenger of the vehicle 10 is seeing, and can feel as if they are actually riding in the vehicle 10. When an elderly person or a novice driver is driving the vehicle 10, by utilizing the above video chat system 1 and Program 2, remote monitoring and greeting like a watching service can be realized, and the psychological burden and technical load on the driver can be reduced.

[0042] (2) As shown in FIG. 6(B), the control means 5 of this embodiment can display a map image 56 including the position information of the vehicle 10 on the chat screen. With such a configuration, the real current position of the vehicle 10 can be shared with high precision within the chat group, enhancing the immersive feeling of driving. Also, for example, the user of the terminal 20 can easily ask the passengers in the vehicle 10 questions about the destination or throw requests about the passing route while looking at the map image 56. Therefore, good communication can be realized.

[0043] (3) As shown in FIGS. 6(A) to 6(C), the control means 5 of this embodiment can display any one of a first mode, a second mode, and a third mode on the chat screen according to the operations of the passengers or users. With such a configuration, any one of the first mode with excellent immersion, the second mode with a large amount of information, and the third mode that balances both of them can be freely selected by the passengers in the vehicle 10 or the users of the terminal 20, improving convenience.

[0044] (4) As shown in FIG. 5, in this embodiment, when a plurality of vehicles 10 distribute the vehicle surrounding video to the chat group, any one of the vehicle surrounding videos can be selected. In other words, the video chat system 1 in which the chat group includes passengers (second passengers) of a second vehicle 10 different from the vehicle 10 can be provided with second distribution means 3 for distributing the second vehicle surrounding video captured by a second imaging device 18 mounted on the second vehicle 10 to the chat group. Also, the control means 5 of the second vehicle 10 can selectively display either the vehicle surrounding video or the second vehicle surrounding video according to the operation of the passenger, the second passenger, or the user.

[0045] With such a configuration, multiple drive environments can be shared within a single chat group, enabling good communication and further improving convenience. In addition, the user of terminal 20 can instantaneously change the viewing target between vehicle 10 and the second vehicle 10, just as if watching multiple TV programs while zapping. Therefore, an immersive virtual drive experience that cannot be achieved during an actual drive can be attained.

[0046] (5) In this embodiment, a generating means 4 for generating an overhead view image of vehicle 10 is provided based on the surrounding vehicle images captured by a plurality of imaging devices 18 mounted on vehicle 10. The control means 5 can display, for example, as shown in FIG. 6(C), the overhead view image generated by the generating means 4 on the chat screen. With such a configuration, the overhead view image can be distributed to the chat group, further enhancing the reality of the virtual drive experience. Also, compared to presenting the surrounding vehicle images captured by the imaging device 18 as they are, the drive environment of vehicle 10 can be viewed widely with a natural field of view. Therefore, the sense of presence during driving can be further enhanced, and better communication can be realized.

[0047] (6) As shown in FIG. 6(C), the generating means 4 of this embodiment can synthesize a CG image of vehicle 10 on the overhead view image based on the viewpoint and line-of-sight direction of the overhead view image. With such a configuration, the reality of the overhead view image can be improved, and for example, a sense of presence as if looking at the real vehicle 10 from diagonally behind and above can be enhanced. Therefore, better communication can be realized.

[0048] (7) The control means 5 of this embodiment can display driving information representing the driving state of the vehicle 10 on the chat screen. For example, as shown in FIGS. 6(A) and (C), driving information 55 such as vehicle speed and engine rotation speed is displayed superimposed on the vehicle surrounding images 54 and 57. With such a configuration, the driving state of the vehicle 10 can be shared with high precision within the chat group, and the sense of presence during driving and the reality of the virtual driving experience can be improved. Therefore, good communication can be realized.

[0049] [6. Others] The above embodiments are merely examples, and there is no intention to exclude various modifications and applications of technologies not explicitly stated in this embodiment. Each configuration of this embodiment can be variously modified and implemented without departing from their gist. Also, each configuration of this embodiment can be selected as needed, or can be appropriately combined with various configurations included in known technologies.

[0050] For example, in the above embodiment, a configuration in which the programs 2 installed in each of the vehicle 10 and the terminal 20 cooperate and execute is illustrated. However, instead of such a configuration, the program 2 may be installed only in the server 30, and the vehicle 10 and the terminal 20 may be controlled by this program 2. In other words, instead of the electronic control device 11 of the vehicle 10 and the electronic control device 21 of the terminal 20, the electronic control device 31 of the server 30 may be used as the control main body. At least, by providing the distribution means 3 and the control means 5 in the video chat system 1, the same operations and effects as those of the above embodiment can be obtained.

[0051] Also, in the above embodiment, the video chat system 1 including the terminal 10' and the terminal 20 as in-vehicle computers is illustrated. However, a video chat system 1 using the terminal 20 possessed by the passenger of the vehicle 10 instead of the terminal 10' may be constructed. That is, the computer used by the passenger of the vehicle 10 when chatting may be the terminal 10' mounted on the vehicle 10, or may be a terminal 20 such as a smartphone independent of the vehicle 10.

[0052] [7. Supplementary Note] Regarding the above embodiments and modifications, the following additional remarks are disclosed. [Additional Remark 1] A video chat system for assisting communication in a chat group including an occupant of a vehicle equipped with an in-vehicle computer and a user who is not an occupant of the vehicle, a distribution means for distributing vehicle surrounding video captured by an imaging device mounted on the vehicle to the chat group, and a control means for displaying, on a chat screen of a terminal in the vehicle and a terminal of the user, a message exchanged in the chat group and the vehicle surrounding video. A video chat system, characterized by comprising the above.

[0053] [Additional Remark 2] The control means causes a map image including the position information of the vehicle to be displayed on the chat screen. The video chat system according to Additional Remark 1, characterized by the above.

[0054] [Additional Remark 3] The chat screen has a first mode for simultaneously displaying the message and the vehicle surrounding video, a second mode for simultaneously displaying the message and the map image, and a third mode for simultaneously displaying the message, the vehicle surrounding video, and the map image, and the control means selects any one of the first mode, the second mode, and the third mode according to an operation of the occupant or the user. The video chat system according to Additional Remark 2, characterized by the above.

[0055] [Additional Remark 4] The video chat system, wherein the chat group includes a second occupant of a second vehicle different from the vehicle, comprising second distribution means for distributing second vehicle surrounding video captured by a second imaging device mounted on the second vehicle to the chat group. The control means selectively displays either the vehicle surrounding video or the second vehicle surrounding video in response to an operation by the occupant, the second occupant, or the user. The video chat system according to any one of appendices 1 to 3, characterized by the above.

[0056] [Appendix 5] It includes a generation means for generating an aerial view video of the vehicle based on the vehicle surrounding video captured by a plurality of the imaging devices mounted on the vehicle. The control means displays the aerial view video on the chat screen. The video chat system according to any one of appendices 1 to 4, characterized by the above.

[0057] [Appendix 6] The generation means synthesizes a CG image of the vehicle on the aerial view video based on the viewpoint and line-of-sight direction of the aerial view video. The video chat system according to appendix 5, characterized by the above.

[0058] [Appendix 7] The control means displays travel information indicating the travel state of the vehicle on the chat screen. The video chat system according to any one of appendices 1 to 6, characterized by the above.

[0059] [Appendix 8] A program for assisting communication in a chat group including an occupant of a vehicle equipped with an in-vehicle computer and a user who is not an occupant of the vehicle, distributing the vehicle surrounding video captured by the imaging device mounted on the vehicle to the chat group, and causing a computer to execute a process of displaying, on the chat screens of the terminal in the vehicle and the user's terminal, the messages exchanged in the chat group and the vehicle surrounding video. Program.

[0060] [Appendix 9] Cause a map image including the position information of the vehicle to be displayed on the chat screen The program according to appended note 8, which causes a computer to execute the process

[0061] [Appended note 10] The chat screen has a first mode for simultaneously displaying the message and the vehicle surrounding video, a second mode for simultaneously displaying the message and the map image, and a third mode for simultaneously displaying the message, the vehicle surrounding video, and the map image, Select any one of the first mode, the second mode, and the third mode according to the operation of the occupant or the user The program according to appended note 9, which causes a computer to execute the process

[0062] [Appended note 11] The chat group includes a second occupant of a second vehicle different from the vehicle, Distribute the second vehicle surrounding video captured by a second imaging device mounted on the second vehicle to the chat group, Selectively display either the vehicle surrounding video or the second vehicle surrounding video according to the operation of the occupant, the second occupant, or the user The program according to any one of appended notes 8 to 10, which causes a computer to execute the process

[0063] [Appended note 12] Generate an aerial view video of the vehicle based on the vehicle surrounding videos captured by a plurality of imaging devices mounted on the vehicle, Cause the aerial view video to be displayed on the chat screen The program according to any one of appended notes 8 to 11, which causes a computer to execute the process

[0064] [Appended note 13] Synthesize a CG image of the vehicle on the aerial view video based on the viewpoint and line-of-sight direction of the aerial view video The program according to appended note 12, which causes a computer to execute the process

[0065] [Appendix 14] Cause the computer to execute a process of displaying driving information representing the driving state of the vehicle on the chat screen The program according to any one of Appendices 8 to 13, which causes a computer to execute the process

Industrial Applicability

[0066] This case can be used in the manufacturing industry of video chat systems and programs and the service providing business. It can also be used in the manufacturing industry of in-vehicle computers applied to video chat systems, the manufacturing industry of terminals (such as smartphones, desktop personal computers, notebook personal computers, PDAs, etc.), and the manufacturing industry of servers

Explanation of Reference Numerals

[0067] 1 Video chat system 2 Program 3 Distribution means, second distribution means 4 Generation means 5 Control means 10 Vehicle, second vehicle 10′, 20 Terminal 30 Server 40 Network

Claims

1. A video chat system for assisting communication in a chat group including an occupant of a vehicle equipped with an in-vehicle computer and a user who is not the occupant, a distribution means for distributing vehicle surrounding video captured by an imaging device mounted on the vehicle to the chat group, a control means for displaying, on a chat screen of a terminal in the vehicle and a terminal of the user, messages exchanged in the chat group and the vehicle surrounding video, comprising: the control means displays a map image including the position information of the vehicle on the chat screen, the chat screen has a first mode for simultaneously displaying the message and the vehicle surrounding video, a second mode for simultaneously displaying the message and the map image, and a third mode for simultaneously displaying the message, the vehicle surrounding video, and the map image, a display area of the chat screen is divided into a first display area and a second display area adjacent to the first display area, the control means selects any one of the first mode, the second mode, and the third mode according to an operation of the occupant or the user, in the first mode, the vehicle surrounding video is displayed in the first display area, in the second mode, the map image is displayed in the first display area, in the third mode, the vehicle surrounding video and the map image are displayed in the first display area, in all of the first mode, the second mode, and the third mode, the message is displayed in the second display area A video chat system, characterized in that.

2. The video chat system, wherein the chat group includes a second occupant of a second vehicle different from the vehicle, comprising second distribution means for distributing second vehicle surrounding video captured by a second imaging device mounted on the second vehicle to the chat group, the control means selectively displays either the vehicle surrounding video or the second vehicle surrounding video according to an operation of the occupant, the second occupant, or the user The video chat system according to claim 1, characterized in that.

3. Comprising generation means for generating an aerial view video of the vehicle based on the vehicle surrounding video captured by a plurality of the imaging devices mounted on the vehicle, the control means displays the aerial view video on the chat screen The video chat system according to claim 1, characterized in that...

4. The generation means synthesizes a CG image of the vehicle on the bird's-eye view image based on the viewpoint and line-of-sight direction of the bird's-eye view image. The video chat system according to claim 3, characterized in that...

5. The control means causes driving information representing the driving state of the vehicle to be displayed on the chat screen. The video chat system according to claim 1, characterized in that...

6. A program for assisting communication in a chat group including a passenger of a vehicle equipped with an in-vehicle computer and a user who is not the passenger, distributes a video of the vehicle surroundings taken by an imaging device mounted on the vehicle to the chat group, displays a message exchanged in the chat group and the video of the vehicle surroundings on the chat screens of the terminal in the vehicle and the user's terminal, displays a map image including the position information of the vehicle on the chat screen, the chat screen has a first mode for simultaneously displaying the message and the video of the vehicle surroundings, a second mode for simultaneously displaying the message and the map image, and a third mode for simultaneously displaying the message, the video of the vehicle surroundings, and the map image, the display area of the chat screen is divided into a first display area and a second display area adjacent to the first display area, any one of the first mode, the second mode, and the third mode is selected according to an operation by the passenger or the user, in the first mode, the video of the vehicle surroundings is displayed in the first display area, in the second mode, the map image is displayed in the first display area, in the third mode, the video of the vehicle surroundings and the map image are displayed in the first display area, in all of the first mode, the second mode, and the third mode, the message is displayed in the second display area. A program for causing a computer to execute the process.

Images