Information processing device, information processing method, information processing program, and storage medium

Abstract

One purpose of the present invention is to provide an information processing device, an information processing method, an information processing program, and a storage medium that make it possible for suitable partners to match with each other during a phone call between a driver of a moving body and a user outside the moving body.　The information processing device performs information processing relating to audio communication between a first device that moves together with a moving body, and a second device which is a terminal outside the moving body, the information processing device comprising: a matching unit that performs matching between a user of the first device and a user of the second device on the basis of a plurality of desired information, including user type information indicating whether the user is the user of the first device or the user of the second device, desired type indicating a distinction between a guided person who desires to be guided and a guiding person who can guide, and a guiding-desired location of the guided person and a guiding-possible location of the guiding person; and a communication unit that performs the audio communication between the first device and the second device that have been matched.

Description

Information processing device, information processing method, information processing program, and storage medium

[0001] The present invention relates to an information processing device, an information processing method, an information processing program, and a storage medium, and more particularly to an information processing device, an information processing method, an information processing program, and a storage medium that process information relating to a call between a person inside a mobile body and a person outside the mobile body.

[0002] Patent document 1 discloses a vehicle information utilization system that references vehicle information transmitted from a mobile terminal installed in a vehicle, searches for vehicles within a specified range from the user's current location, and displays information about the vehicles on the display of the user's terminal.

[0003] Japanese Patent Application Laid-Open No. 2003-208462

[0004] For example, consider a virtual hitchhiking scenario in which a conversation takes place between a driver of a mobile vehicle and a user of a terminal outside the mobile vehicle without actually riding in the vehicle. In this case, it is preferable that the combination of the driver of the mobile vehicle and the user of the terminal outside the mobile vehicle is one in which both parties are satisfied with the content of the conversation. However, as in the above document, simply searching for vehicles traveling within a predetermined range from the user of the terminal outside the mobile vehicle may not result in a good combination depending on the purpose of the driver or the user, which is one of the problems.

[0005] The present invention has been made in consideration of the above-mentioned points, and one of its objectives is to provide an information processing device, an information processing method, an information processing program, and a storage medium that enable matching of a suitable partner when a driver of a mobile vehicle and a user outside the mobile vehicle communicate with each other.

[0006] The invention described in claim 1 is an information processing device that processes information regarding voice communication between a first device that moves with a mobile body and a second device that is a terminal outside the mobile body, and is characterized by having: a preference information acquisition unit that acquires multiple preference information including user type information indicating whether the user is the user of the first device or the user of the second device, and a preference type that indicates whether the user is a person who wishes to be guided or a guide who is able to provide guidance, and including a desired guidance location that is a place where the user wishes to be guided if the preference type is the person being guided, and a guideable location that is a place where the guide can provide the guidance if the preference type is the guide; a matching unit that matches users of the first device with users of the second device based on the preference information; and a communication unit that performs the voice communication between the matched first device and the second device.

[0007] The invention described in claim 11 is an information processing device that processes information regarding voice communication between a first device that moves with a mobile body and a second device that is a terminal outside the mobile body, and is characterized in that it has a desired information acquisition unit that acquires desired information to be guided, including a desired location to be guided, from a user of the second device, an extraction unit that extracts one or more of the first devices based on the desired information to be guided and the current location of the first device or a route set in the mobile body, and a communication unit that performs the voice communication between one of the extracted one or more first devices and the second device.

[0008] The invention described in claim 12 is an information processing device that processes information regarding voice communication between a first device that moves with a mobile body and a second device that is a terminal outside the mobile body, and is characterized by having: a desired information acquisition unit that acquires guided desired information including a guided location, which is a location where the user of the first device wishes to be guided; a guideable information acquisition unit that acquires guideable information including whether the user of the second device is available for guidance and, if so, a guideable location, which is a location where guidance is possible; an extraction unit that extracts one or more second devices based on the guided desired information and the guideable information; and a communication unit that performs the voice communication between one of the extracted one or more second devices and the first device.

[0009] The invention described in claim 13 is an information processing method executed by an information processing device that processes information regarding voice communication between a first device that moves with a mobile body and a second device that is a terminal outside the mobile body, and is characterized by including: a preference information acquisition step that acquires multiple preference information including user type information indicating whether the user is the user of the first device or the user of the second device, and a preference type that indicates whether the user is a person who wishes to be guided or a guide who is able to provide guidance, and including a desired guidance location that is a place where the guide wishes to be guided if the preference type is the person being guided, and a guideable location that is a place where the guide can provide the guidance if the preference type is the guide; a matching step that matches a user of the first device with a user of the second device based on the preference information; and a communication step that performs the voice communication between the matched first device and the second device.

[0010] The invention described in claim 14 is an information processing program executed by an information processing device that has a computer and processes information regarding voice communication between a first device that moves with a mobile body and a second device that is a terminal outside the mobile body, and causes the computer to execute the following information processing steps: a preference information acquisition step that acquires multiple preference information including user type information indicating whether the user is a user of the first device or a user of the second device, and a preference type that indicates whether the user is a person who wishes to be guided or a guide who is able to provide guidance, and which includes a desired guidance location that is a place where the guide wishes to be guided if the preference type is the person who is guided, and a guideable location that is a place where the guide can provide the guidance if the preference type is the guide; a matching step that matches a user of the first device with a user of the second device based on the preference information; and a communication step that performs the voice communication between the matched first device and the second device.

[0011] The invention described in claim 15 is a computer-readable storage medium that stores an information processing program to cause an information processing device that has a computer and processes information regarding voice communication between a first device that moves with a mobile body and a second device that is a terminal outside the mobile body to execute the following: a preference information acquisition step that acquires multiple preference information including user type information indicating whether the user is the user of the first device or the user of the second device, and a preference type that indicates whether the user is a person who wishes to be guided or a guide who is able to provide guidance, and including a desired guidance location that is a place where the guide wishes to be guided if the preference type is the person being guided, and a guideable location that is a place where the guide can provide the guidance if the preference type is the guide; a matching step that matches a user of the first device with a user of the second device based on the preference information; and a communication step that performs the voice communication between the matched first device and the second device.

[0012] 1 is a schematic diagram showing an overview of an information processing system according to an embodiment of the present invention; FIG. 1 is a diagram showing the configuration of a front seat portion of an automobile according to an embodiment; FIG. 2 is a block diagram showing an example of the configuration of an in-vehicle device according to an embodiment; FIG. 3 is a block diagram showing an example of the configuration of an external device according to an embodiment; FIG. 4 is a block diagram showing an example of the configuration of a server device according to an embodiment; FIG. 5 is a diagram showing an example of information related to a driver (user of the in-vehicle device) held by the server device according to the embodiment; FIG. 6 is a diagram showing an example of information related to a virtual passenger (user of the external device) held by the server device according to the embodiment; FIG. 7 is a diagram showing an example of request information received by the server device according to the embodiment; FIG. 8 is a schematic diagram showing an example of matching between a guideable location and a desired guide location when matching is performed in the information processing system according to the embodiment; FIG. 9 is a sequence diagram showing an example of information processing executed by the information processing system according to the embodiment; FIG. 10 is a sequence diagram showing an example of information processing executed by the information processing system according to the embodiment; FIG. 11 is a flowchart showing an example of a routine executed by the server device according to the embodiment; FIG. 12 is a flowchart showing an example of a subroutine executed by the server device according to the embodiment;

[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description and accompanying drawings, substantially the same or equivalent parts are designated by the same reference numerals.

[0014] The configuration of an information processing system 100 including an information processing apparatus according to an embodiment will be described with reference to the accompanying drawings.

[0015] Fig. 1 shows an overview of the configuration of an information processing system 100. As shown in Fig. 1, the information processing system 100 includes an in-vehicle device 10, an external device 30, and a server 50 as an information processing device. Fig. 1 shows a case where the in-vehicle device 10 is mounted on an automobile M as an example of a moving body. Fig. 1 also shows a smartphone as an example of the external device 30.

[0016] The in-vehicle device 10, the external device 30, and the server 50 can transmit and receive data to and from each other via a network NW using a communication protocol such as TCP / IP or UDP / IP. The network NW can be constructed using internet communication, including wireless communication such as a mobile communication network or Wi-Fi (registered trademark), and wired communication.

[0017] In the information processing system 100, audio-visual communication is possible in which video and audio of the automobile M acquired by the in-vehicle device 10 are transmitted to the external device 30, and audio acquired by the external device 30 is transmitted to the in-vehicle device 10.

[0018] In the information processing system 100 of this embodiment, after a voice call is established between the in-vehicle device 10 and the external device 30, the in-vehicle device 10 distributes video captured in the automobile M to the external device 30.

[0019] In the following description, the communication mode in which a voice call is established between the in-vehicle device 10 and the external device 30 while video captured in the automobile M is distributed from the in-vehicle device 10 to the external device 30 as described above will be referred to as video communication, which is one mode of audio-visual communication.

[0020] By performing such video communication, the user of the external device 30 watching the video transmitted from the in-vehicle device 10 can feel as if he or she is riding in the vehicle M with the driver of the vehicle M. In other words, the video communication can realize a virtual ride-along with the user of the external device 30 in the vehicle M. A system such as the information processing system 100 of this embodiment that can realize such video communication is also referred to as a virtual ride-along system.

[0021] In this embodiment, the in-vehicle device 10 and the external device 30 perform video communication via the server 50. The server 50 is capable of establishing a voice call between the in-vehicle device 10 and the external device 30, receiving from the in-vehicle device 10 an image captured in the automobile M and acquired by the in-vehicle device 10, and transmitting the image to the external device 30.

[0022] For example, during video communication between the in-vehicle device 10 and the external device 30, guidance regarding the location where the automobile M is traveling can be provided between the user of the in-vehicle device 10 and the user of the external device 30.

[0023] For example, while driving in a familiar location, the driver of the automobile M, who is the user of the in-vehicle device 10, can provide the user of the external device 30 with information about the location, such as tourist information about the area nearby. In this case, if the user of the external device 30 is unfamiliar with the location but wishes to be guided, for example, because they are planning a trip to the location, both parties can achieve their goals. Furthermore, the user of the external device 30 can receive guidance while watching actual driving footage via video communication.

[0024] On the other hand, the user of the external device 30 can also provide guidance. For example, while the driver of the automobile M is driving in an unfamiliar place, the user of the external device 30 who is familiar with the place can provide guidance about the place via video communication by providing tourist information in the vicinity of the place, information about the area such as places where caution is required when driving and places where traffic jams are always present.

[0025] In this embodiment, it is possible to pair the user of the in-vehicle device 10 with the user of the external device 30 so that video communication can be performed between the guide and the guided person as described above. The server 50 performs matching to determine the pairing of the user of the in-vehicle device 10 and the user of the external device 30, and can establish video communication between the determined users.

[0026] The occupants of the automobile M, including the driver and passengers, can be users of the in-vehicle device 10. In this embodiment, the case where the user of the in-vehicle device 10 is the driver of the automobile M will be mainly described.

[0027] In the following, in this embodiment, the in-vehicle device 10 is described as a car navigation device. Also, in this embodiment, the in-vehicle device 10 is described as a terminal device of a so-called cloud-based car navigation device that receives from a user a destination to which the user wishes to be guided, transmits the destination to a server 50, and the server 50 generates a route to the destination.

[0028] As described above, in this embodiment, the external device 30 is described as a smartphone. The touch panel 31 is, for example, a touch panel monitor that combines a display, such as a liquid crystal display, capable of displaying images with a touchpad. The touch panel 31 is capable of generating signals that represent input operations on the touch panel 31 received from a user.

[0029] In this embodiment, the touch panel 31 displays the video image delivered from the in-vehicle device 10 during the video communication. The user of the external device 30 can talk to the driver of the automobile M while watching the video image displayed on the touch panel 31 during the video communication.

[0030] Information related to video communication is also displayed on the touch panel 31. For example, the touch panel 31 displays a registration screen for the user of the external device 30 to register information necessary for video communication in the information processing system 100, a confirmation screen for whether or not to consent to video communication with the driver of the automobile M, and other screens. The user of the external device 30 can input information related to video communication by performing an input operation on the touch panel 31.

[0031] The speaker 33 is capable of emitting sounds such as music and voices. During video communication, the speaker 33 emits the sound from the in-car device 10 during voice communication.

[0032] The microphone 35 is a microphone device that receives sounds emitted toward the external device 30. During video communication, the sounds picked up by the microphone 35 are transmitted to the in-vehicle device 10 via the server 50 as voice communication sounds.

[0033] 2 is a perspective view showing the vicinity of the front seat of the automobile M equipped with the in-vehicle device 10. In FIG. 2, as an example of installation, the in-vehicle device 10 is installed in the dashboard DB of the front seat of the automobile M.

[0034] The GPS receiver 11 is a device that receives signals (GPS signals) from GPS (Global Positioning System) satellites. The GPS receiver 11 is disposed, for example, on a dashboard DB. The GPS receiver 11 may be disposed anywhere as long as it can receive GPS signals. The GPS receiver 11 is capable of transmitting the received GPS signals to the in-vehicle device 10. The in-vehicle device 10 acquires current location information of the automobile M using the GPS signals.

[0035] The exterior camera 13 is an imaging device that captures images of the area in front of the automobile M. In this embodiment, the exterior camera 13 is arranged on the dashboard DB so that the imaging direction faces forward. For example, the exterior camera 13 can capture images of the area in front of the automobile M through the windshield. The exterior camera 13 may be provided near the rearview mirror RM or attached to the inside of the windshield FG. During video communication, the images captured by the exterior camera 13 are distributed to the external device 30.

[0036] The in-vehicle camera 14 is an imaging device that captures images of the interior of the automobile M. In this embodiment, the in-vehicle camera 14 is provided at the top edge of the windshield FG or on the ceiling near the top edge. For example, the in-vehicle camera 14 is capable of capturing images of the driver of the automobile M. For example, the in-vehicle camera 14 may be provided so as to be able to capture images of the interior of the automobile M, including the passenger seat and rear seats.

[0037] For example, during video communication, the image captured by the in-vehicle camera 14 is distributed to the external device 30 together with the image captured by the exterior camera 13. For example, in the external device 30, the image from the exterior camera 13 and the image from the in-vehicle camera 14 may be switched and displayed at the user's discretion, or may be displayed side by side.

[0038] The touch panel 15 is, for example, a touch panel monitor that combines a display, such as a liquid crystal display, capable of displaying images, with a touchpad. The touch panel 15 is, for example, disposed in the center console of the dashboard DB. The touch panel 15 may be disposed in a location that is visible to the driver and within the driver's reach. For example, the touch panel 15 may be attached to the dashboard DB.

[0039] The touch panel 15 can display a screen based on the control of the in-vehicle device 10. The touch panel 15 can also transmit a signal representing an input operation to the touch panel 15 received from a user to the in-vehicle device 10. For example, the touch panel 15 may display a car navigation guide. Furthermore, operations related to the car navigation function, such as setting a destination, may be possible via the touch panel 15.

[0040] Furthermore, the touch panel 15 may display information about video communication, or may display a screen for accepting an operation to request the server 50 to match with a user of the external device 30, or a screen for inquiring whether or not video communication with the matched user of the external device 30 is possible. For example, the user of the in-vehicle device 10 can input information required for requesting matching with a user of the external device 30 or select whether or not to allow video communication in response to an inquiry about whether or not video communication is possible, by performing an input operation on the touch panel 15.

[0041] The speaker 17 is provided, for example, on the interior side of an A-pillar AP. The speaker 17 is capable of emitting sounds such as music and voices under the control of the in-vehicle device 10. During video communication, the speaker 17 emits sound from the external device 30 during a voice call.

[0042] Furthermore, when the notification regarding the video communication is made by voice, a voice inquiring about the availability of video communication with the user of the external device 30 determined by matching is emitted from the speaker 17. Furthermore, at the time of such inquiry, a pre-recorded message may be emitted in the voice of the user of the external device 30.

[0043] The microphone 19 is a microphone device that picks up sounds inside the vehicle and is located, for example, on the dashboard DB. The microphone 19 may be located anywhere, such as on the rearview mirror RM or the steering wheel, as long as it can pick up sounds inside the vehicle. During video communication, the sound picked up by the microphone 19 is transmitted to the external device 30 as the sound of the voice call.

[0044] Furthermore, operation inputs for requesting matching with a user of the external device 30 or selecting whether or not to accept a question about whether or not to accept video communication may be performed by voice via the microphone 19 .

[0045] 3 is a block diagram showing the configuration of the in-vehicle device 10. For example, the in-vehicle device 10 is a device in which a storage unit 23, a control unit 25, and a communication unit 27 cooperate with each other via a system bus.

[0046] The automobile M is also equipped with an acceleration sensor 21. The acceleration sensor 21 is capable of measuring the acceleration of the automobile M and outputting a signal indicating the measured acceleration. The acceleration sensor 21 is a sensor capable of detecting acceleration in the traveling direction of the automobile M, i.e., the front-to-rear direction, as viewed from above the automobile M. The acceleration sensor is also capable of detecting, for example, acceleration in the lateral direction (width direction) perpendicular to the traveling direction of the automobile M. The in-vehicle device 10 may acquire current position information of the automobile M based on the acceleration indicated by the sensor signal of the acceleration sensor 21, in addition to the GPS signal from the GPS receiver 11, for example.

[0047] The storage unit 23 is a storage device configured by, for example, a hard disk drive, a solid state drive (SSD), a flash memory, etc. The storage unit 23 stores various programs executed in the in-vehicle device 10, such as an operating system and terminal software.

[0048] The various programs may be acquired, for example, from another server device or the like via a network, or may be recorded on a recording medium and read via a drive device. In other words, the various programs stored in the storage unit 23 can be transmitted via a network, or can be recorded on a computer-readable recording medium and transferred.

[0049] The storage unit 23 also stores map information including road maps, which are used, for example, for displaying directions in car navigation systems.

[0050] The control unit 25 is configured with a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc., and functions as a computer. The control unit 25 realizes various functions by the CPU reading and executing various programs stored in the ROM and the storage unit 23. In this embodiment, the control unit 25 performs functions such as voice calling and video distribution during video communication, and car navigation functions.

[0051] The control unit 25 is communicably connected to various devices provided in the automobile M, namely, the GPS receiver 11, the exterior camera 13, the interior camera 14, the touch panel 15, the speaker 17, the microphone 19, and the acceleration sensor 21. The control unit 25 acquires data from the various devices provided in the automobile M. The control unit 25 also supplies data to the various devices provided in the automobile M.

[0052] Specifically, the control unit 25 sequentially acquires GPS signals from the GPS receiver 11. The control unit 25 also sequentially acquires signals indicating acceleration measured by the acceleration sensor 21. The control unit 25 acquires current position information of the automobile M based on, for example, the GPS signals and signals from the acceleration sensor.

[0053] The control unit 25 sequentially acquires images captured by the exterior camera 13 and the interior camera 14. The control unit 25 acquires signals representing input operations performed on the touch panel 15. The control unit 25 also supplies image data to be displayed on the touch panel 15. The control unit 25 also supplies audio data to the speaker 17. The control unit 25 also sequentially acquires audio in the automobile M picked up by the microphone 19.

[0054] The communication unit 27 is a communication device that transmits and receives data to and from external devices in accordance with instructions from the control unit 25. The communication unit 27 is, for example, a network interface card (NIC) for connecting to the network NW.

[0055] The communication unit 27 is connected to the network NW and transmits and receives various data to and from the server 50. The communication unit 27 also transmits and receives various data to and from the external device 30 via the server 50.

[0056] For example, the control unit 25 can transmit information including a destination input by a user of the in-vehicle device 10 to the server 50 via the communication unit 27, and receive route information or navigation information to the destination from the server 50.

[0057] During video communication, the control unit 25 sequentially transmits images captured by the exterior camera 13 or the interior camera 14 to the server 50 via the communication unit 27. During video communication, the control unit 25 also receives audio data from the external device 30 via the server 50 via the communication unit 27, and sequentially transmits audio from inside the automobile M picked up by the microphone 19 to the server 50.

[0058] For example, while the automobile M is traveling, the control unit 25 sequentially transmits the current position information of the automobile M obtained based on the GPS signal and the signal from the acceleration sensor to the server 50 via the communication unit 27 .

[0059] The control unit 25 transmits, for example, information related to video communication input by the occupant to the server 50 via the communication unit 27. For example, the control unit 25 transmits, to the server 50, information such as information input by the driver via the touch panel 15 or the microphone 19 indicating a request for matching with a user of the external device 30.

[0060] The control unit 25 receives information related to video communication from the server 50, for example, via the communication unit 27. For example, the control unit 25 receives an image for displaying a screen such as an inquiry screen about whether or not video communication is possible with the user of the external device 30 determined by matching, and supplies the received image to the touch panel 15. For example, the control unit 25 receives audio data such as an inquiry about whether or not video communication is possible with the user of the external device 30 with whom matching has been made, and supplies the received audio data to the speaker 17.

[0061] 4 is a block diagram showing an example of the configuration of the external device 30. For example, the external device 30 is a device in which a storage unit 37, a control unit 39, and a communication unit 41 cooperate with each other via a system bus (not shown).

[0062] The storage unit 37 is configured by, for example, a hard disk drive, a solid state drive (SSD), a flash memory, etc., and stores various programs such as an operating system and software for the external device 30.

[0063] The various programs may be acquired, for example, from another server device or the like via a network, or may be recorded on a recording medium and read via a drive device. That is, the various programs stored in the storage unit 37 can be transmitted via a network, or can be recorded on a computer-readable recording medium and transferred.

[0064] The control unit 39 is configured with a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc., and functions as a computer. The CPU reads and executes various programs stored in the ROM and the storage unit 37, thereby realizing various functions.

[0065] The control unit 39 is communicatively connected to the above-mentioned touch panel 31, speaker 33, and microphone 35. The control unit 39 can receive signals indicating input operations to the touch panel 31 and audio input signals from the microphone 35. The control unit 39 can also send video or image signals to the touch panel 31 to display the images, and send audio signals to the speaker 33 to output sounds.

[0066] Specifically, the control unit 39 causes the touch panel 31 to display the image during the video communication, and causes the speaker 33 to output the audio during the video communication that is collected in the automobile M.

[0067] The control unit 39 can also accept input operations related to video communication made by the user via the touch panel 31 or the microphone 35. For example, the control unit 39 can accept input operations via the touch panel 31 and the microphone 35, such as information indicating a request for matching with the user of the in-vehicle device 10 and information indicating whether or not to allow video communication with the user of the in-vehicle device 10 with whom a match has been made.

[0068] For example, the control unit 39 causes the touch panel 31 to display a screen for accepting an operation to request matching with the user of the in-vehicle device 10, a screen for inquiring whether or not video communication with the matched user of the in-vehicle device 10 is possible, or the like. For example, the control unit 39 may cause the speaker 33 to output a sound such as an inquiry about whether or not video communication with the matched user of the in-vehicle device 10 is possible.

[0069] The communication unit 41 is connected to the network NW and transmits and receives various data to and from the server 50. The communication unit 41 also transmits and receives various data, such as voice and route information transmitted from the in-vehicle device 10 and voice acquired by the external device 30, to and from the in-vehicle device 10 via the server 50.

[0070] The control unit 39 of the external device 30 can receive information via the communication unit 41 to display a screen such as an inquiry screen as to whether or not video communication is possible with the user of the in-vehicle device 10 that has been matched as described above.

[0071] During the video communication, the control unit 39 also receives, via the communication unit 41, images from the exterior camera 13 and the interior camera 14 that are transmitted from the in-vehicle device 10 via the server 50.

[0072] Furthermore, the control unit 39 can transmit audio data of the audio picked up by the microphone 35 to the in-vehicle device 10 via the communication unit 41 for audio communication in video communication. The control unit 39 can also receive audio data transmitted from the in-vehicle device 10 via the communication unit 41 for audio communication in video communication.

[0073] For example, the control unit 39 of the external device 30 can receive, via the communication unit 41, current location information of the automobile M transmitted from the in-vehicle device 10 via the server 50. Furthermore, for example, the control unit 39 can receive route information or navigation information of the automobile M from the server 50 via the communication unit 41. For example, navigation information of the automobile M may also be displayed on the external device 30 during video communication.

[0074] 5 is a block diagram showing the configuration of the server 50. For example, the server 50 is a device in which a storage unit 51, a communication unit 53, and a control unit 55 cooperate with each other via a system bus.

[0075] As described above, during video communication, the server 50 sequentially receives from the in-vehicle device 10 images captured by the exterior camera 13 or the interior camera 14 and acquired by the in-vehicle device 10. During video communication, the server 50 sequentially transmits the images received from the in-vehicle device 10 to the external device 30.

[0076] The server 50 also has a function similar to that of an SIP server that establishes a voice call between the in-car device 10 and the external device 30 during video communication and transfers data of the voice call.

[0077] In addition, the server 50 has the function of receiving current location information of the automobile M and information on a destination set by a user who is an occupant of the automobile M from the in-vehicle device 10, and generating a route to the destination based on the current information and the destination information.

[0078] Furthermore, the server 50 has the function of matching the user of the in-vehicle device 10 with the user of the external device 30, and performing video communication between the matched user of the in-vehicle device 10 and the user of the external device 30.

[0079] In this embodiment, the user of the in-vehicle device 10 who wishes to find a partner for video communication or the user of the external device 30 is referred to simply as a requester without distinction. For example, if the requester is a user of the in-vehicle device 10, the server 50 matches the requester with multiple users of the external devices 30 who are registered in advance on the server 50.

[0080] The storage unit 51 is configured with, for example, a hard disk drive and an SSD (solid state drive), and stores various programs such as an operating system and software for the server 50 .

[0081] The various programs may be acquired, for example, from another server device or the like via a network, or may be recorded on a recording medium and read via a drive device. That is, the various programs stored in the storage unit 51 can be transmitted via a network, or can be recorded on a computer-readable recording medium and transferred.

[0082] The memory unit 51 stores, for example, an information processing program that enables the server 50 to match a user of the in-vehicle device 10 with a user of the external device 30, and to perform video communication between the matched user of the in-vehicle device 10 and the user of the external device 30.

[0083] The storage unit 51 also has a registration information storage unit that stores registration information, which is information registered in the server 50 by users of the multiple in-vehicle devices 10 and the multiple external devices 30 .

[0084] As an example, we will explain a case where the registration information is stored separately as registration information for the user of the in-vehicle device 10 and registration information for the user of the external device 30, but the registration information may also be stored together in a single database.

[0085] 6 is a diagram showing data LD1, which is an example of the registration information of the users of the in-vehicle devices 10. The registration information of the users of the in-vehicle devices 10 is stored, for example, for each pair of an in-vehicle device ID that can identify each in-vehicle device 10 and a user ID that can identify each user of the in-vehicle device 10.

[0086] The registration information includes user type information, which is information indicating whether a user corresponding to each user ID is a user of the in-vehicle device 10 or a user of the external device 30. The registration information also includes a desired type, which is information indicating whether a user corresponding to each user ID is a "guide" who wishes to be guided or a "guide" who is able to provide guidance.

[0087] For example, in this embodiment, the user type of the user of the in-vehicle device 10 is set to "driver," and the user type of the user of the external device 30 is set to "passenger."

[0088] Furthermore, the registration information includes a desired guide location, which is information indicating a location where the guide is desired if the desired type is a guide recipient, and includes a possible guide location, which is information indicating a location where the guide can provide guidance if the desired type is a guider.

[0089] The guideable locations and guide-desired locations may be, for example, information indicating a location on a map or an address, or may be information indicating an area such as a city name, a municipality, or "near XX." For example, multiple locations may be registered as guideable locations or guide-desired locations.

[0090] As the navigable locations, for example, locations that are familiar to the user of the in-vehicle device 10 are registered in advance. For example, locations such as the user's hometown, workplace, or living area are registered as the navigable locations.

[0091] Furthermore, when the user of the in-vehicle device 10 is driving the automobile M, the current location of the in-vehicle device 10, i.e., the current location of the automobile M, may be set as a navigable location. For example, the server 50 may acquire current location information of the automobile M from the in-vehicle device 10 and set the current location information as a navigable location for the user of the in-vehicle device 10.

[0092] Furthermore, for example, when a route is set in the in-vehicle device 10, major waypoints on the route may be registered as navigable locations. The major waypoints may be specified by the server 50 as a predetermined area including navigable locations, such as intersections, buildings, and the like, that can serve as landmarks when providing guidance.

[0093] 6, a predetermined area including "X Temple" may be identified as a major route point. For example, the server 50 may receive route information for the automobile M from the in-vehicle device 10, identify a major route point based on the received route information, and set the identified major route point as a navigable location.

[0094] The desired location for guidance is set, for example, when the server 50 receives information indicating that the desired type is a person to be guided and the user of the in-vehicle device 10 requests matching with the user of the external device 30. For example, information input into the in-vehicle device 10 by the user of the in-vehicle device 10 or a major waypoint or destination on the route set by the user of the in-vehicle device 10 is set as the desired location for guidance of the user of the in-vehicle device 10 who is the person to be guided.

[0095] In addition, the desired location for guidance is registered by the user, for example, when the user of the in-vehicle device 10, whose desired type is to be guided, wishes to receive guidance upon a request from the user of the external device 30, whose desired type is to be a guide.

[0096] Note that the desired guide location may also include the current location or a major route point, similar to the guideable locations.

[0097] The registration information may further include, for example, information indicating the timing when video communication is possible. In the example shown in Fig. 6, information indicating the standby state of the in-vehicle device 10 is included in the registration information as the information indicating the timing when video communication is possible. For example, when the in-vehicle device 10 is powered on, the standby state is "ON". Furthermore, for example, when the standby state is "ON", a planned standby time indicating until when video communication is possible may be registered.

[0098] The registration information of the user of the in-vehicle device 10 may include, for example, if the desired type is to be guided, information indicating that the communication partner has high guidance skills for the desired location, such as information indicating whether or not a local person is desired. Also, if the desired type is to be a guide, information indicating guidance skills for the location to be guided, such as information indicating whether or not the location is the user's hometown, and information indicating driving skills such as driving history may be included.

[0099] 7 is a diagram showing data LD2, which is an example of the registration information of users of the external devices 30. The registration information of users of the external devices 30 is stored, for example, for each pair of an external device ID that can identify each external device 30 and a user ID that can identify each user of the external device 30.

[0100] Similar to the registration information of the user of the in-vehicle device 10, the registration information of the user of the external device 30 also includes user type information and a desired type. Similar to the registration information of the user of the in-vehicle device 10, the registration information of the user of the external device 30 also includes a desired guide location indicating a location to which the user wishes to be guided if the desired type is to be guided, and includes a guidable location indicating a location to which the guide can provide guidance if the desired type is to be a guide.

[0101] As the guidable places, for example, places that are familiar to the user of the external device 30 are registered in advance. For example, places such as the user's hometown, workplace, or living area are registered as the guidable places.

[0102] The desired location for guidance is registered, for example, when the user of the external device 30 whose desired type is to be guided transmits information to the server 50 indicating a request for matching with the user of the in-vehicle device 10 .

[0103] In addition, the desired location for guidance is registered by the user, for example, when the user of the external device 30, whose desired type is to be guided, wishes to receive guidance upon a request from the user of the in-vehicle device 10, whose desired type is to be a guide.

[0104] As described above, the registration information may further include, for example, information indicating when video communication is possible. In the example shown in Fig. 7, the registration information includes information indicating the standby state of the external device 30 as information indicating when video communication is possible for the user of the external device 30.

[0105] For example, the standby state is set to "ON" by a setting on an application for video communication used in the external device 30. For example, even when the standby state is OFF, the application may be able to receive a notification that a match has been made with the user of the in-vehicle device 10. Furthermore, for example, when the standby state is "ON", a planned standby time indicating how long video communication is possible may be registered.

[0106] The registration information of the user of the external device 30 may include, for example, if the desired type is a guide recipient, information indicating that the communication partner has high guidance skills for the desired location, such as information indicating whether or not a local person is desired. Also, if the desired type is a guide, information indicating guidance skills for the location to which guidance is possible, such as information indicating whether or not the location is the user's hometown, and information indicating driving advice skills such as driving history, etc.

[0107] The information stored in the registration information storage unit is not limited to the above example, and may include other information and be used for matching.

[0108] The memory unit 51 also stores map information including road maps. The map information is used by the server 50 when generating a route for car navigation. The map information is also used by the server 50 when acquiring major waypoints on the route of the vehicle M based on the current position of the vehicle M.

[0109] The communication unit 53 is connected to the network NW and transmits and receives various data between the in-vehicle device 10 and the external device 30 .

[0110] The control unit 55 is configured with a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc., and functions as a computer. The CPU reads and executes various programs stored in the ROM and the storage unit 51, thereby realizing various functions.

[0111] The control unit 55 has a function of acquiring registration information of the user of the in-vehicle device 10 or registration information of the user of the external device 30. The control unit 55 stores the acquired registration information in the registration information holding unit 51A.

[0112] The control unit 55 acquires the registration information by, for example, receiving the registration information transmitted from each of the in-vehicle devices 10 or each of the external devices 30 via the communication unit 53. For example, the registration information of the user of the in-vehicle device 10 or the registration information of the user of the external device 30 as illustrated in Fig. 6 and Fig. 7 is stored in the registration information holding unit 51A.

[0113] In addition, in the information processing system 100, the control unit 55 has the function of acquiring request information sent to the server 50 when a user of the in-vehicle device 10 or a user of the external device 30 as a requester requests the server 50 to search for a partner for video communication.

[0114] 8 is a diagram showing data RD1 as an example of request information. The request information includes an external device ID or an in-vehicle device ID and a user ID, similar to the registration information described above. The request information also includes information indicating a request to search for a partner for video communication.

[0115] Furthermore, similar to the registration information described above, the request information includes a user type indicating whether the user is the user of the in-vehicle device 10 or the user of the external device 30, and a desired type indicating whether the user is a person to be guided or a guide who is able to provide guidance.If the desired type is a person to be guided, the desired guidance location is the place where the user wishes to be guided, and if the desired type is a guide, the request information includes a guideable location is the place where the guide can provide guidance.

[0116] The request information is generated, for example, by a user's input operation on the in-vehicle device 10 or an input operation on the external device 30. For example, a guidance type is selected on an input screen for the request information, and a location where guidance is available or a desired location is input. Alternatively, the guidance type and a location where guidance is available or a desired location may be input by voice, for example, "Find a communication partner who can provide guidance within XX city."

[0117] For example, if the guidance type of the user of the in-vehicle device 10 is a person to be guided, the guidance type is set to a person to be guided and the desired location to be guided is set to Kyoto city by a voice such as "Find a communication partner who can guide you around Kyoto city."

[0118] Furthermore, even if the user of the in-vehicle device 10 does not input a desired location for guidance, if a route has been set, route information may be transmitted to the server 50 instead of the desired location for guidance. In this case, for example, the server 50 may set a major waypoint or a destination on the route as the desired location for guidance based on the route information.

[0119] For example, if the user of the external device 30 desires to be a guide, places where the user frequently drives, places such as frequently visited stores, and places in the user's living area are input as available guide locations. For example, the user of the external device 30 who is a guide may set the time when he / she will be recruiting people who wish to be guided, that is, the scheduled time when video communication is available, as the scheduled waiting time. In this case, for example, the scheduled waiting time is added to the request information and transmitted to the server 50.

[0120] In the example shown in Figure 8, the user sending the request information is the user of the external device 30, and the data RD1 includes the external device ID. For example, as shown in Figure 8, when the flag in the "Request" field is ON, it indicates a request to find a partner for video communication. Also, in the example shown in Figure 8, since the user is the user of the external device 30, the user type is "passenger." Note that if the user sending the request information is a user of the in-vehicle device 10, the request information includes the in-vehicle device ID instead of the external device ID, and the user type is "driver."

[0121] 8, the desired type is "person to be guided," and the desired location to which the requester, who is the person to be guided, wishes to be guided is included. Note that if the desired type is "guide," the request information includes locations to which the requester can be guided.

[0122] As described above, both the registration information and the request information include a user type, a desired type, and a place where guidance is possible or a desired place according to the desired type. In this embodiment, the user type, the desired type, and the place where guidance is possible or a desired place according to the desired type are referred to as desired information. The desired information is used to match the user of the in-vehicle device 10 with the user of the external device 30 in this embodiment.

[0123] The control unit 55 acquires registration information and request information to acquire desired information that can be used for matching in this embodiment, and functions as a desired information acquisition unit 57.

[0124] In other words, the control unit 55 functions as a desired information acquisition unit 57 that executes a step of acquiring a plurality of desired information (desired information acquisition step) including user type information indicating whether the user is the user of the in-vehicle device 10 as the first device or the user of the external device 30 as the second device, and a desired type indicating whether the user is a person who wishes to be guided or a guide who is able to provide guidance, and including a desired guidance place that is a place where the user wishes to be guided if the desired type is a person who is a guide, and including a navigable place that is a place where the guide can provide guidance if the desired type is a guide. In other words, the control unit 55 has the desired information acquisition unit 57 as a functional unit.

[0125] For example, when the desired information acquisition unit 57 receives request information from the user of the external device 30 with the desired type being a person to be guided, it functions as a desired information acquisition unit that acquires desired information to be guided, including the desired location to be guided, which is the location to which the user of the second device wishes to be guided.

[0126] For example, when receiving request information with a desired type of "recipient" from the user of the in-vehicle device 10, the desired information acquisition unit 57 functions as a desired information acquisition unit that acquires guidance-desired information, which is a guidance-desired place, from the user of the first device. In this case, the desired information acquisition unit 57 functions as a guidable information acquisition unit that acquires, for example, registration information of the user of the external device 30, thereby acquiring guidable information including whether the user of the second device can be guided and, if so, guidable places, which are places where guidance is possible.

[0127] The preference information may further include information indicating a timing when video communication is possible, such as information indicating a standby state, as described above. The preference information is used to match the user of the in-vehicle device 10 with the user of the external device 30.

[0128] When the control unit 55 acquires the request information, the control unit 55 executes processing as a matching unit 59 that matches the user of the in-vehicle device 10 with the user of the external device 30 based on the desired information included in the acquired request information and the desired information included in the registration information. In other words, the control unit 55 has the matching unit 59 as a functional unit.

[0129] For example, the matching unit 59 compares the desired guide location and the available guide location between the requester and each of the users of the in-vehicle devices 10 or the external devices 30 (also referred to as registrants) who have registered registration information. The matching unit 59 matches the users of the in-vehicle devices 10 and the users of the external devices 30 based on the comparison result.

[0130] For example, the matching unit 59 compares the desired location to be guided with the locations that can be guided to for each registered user whose desired location is different from the desired location indicated by the request information, among the registered users whose desired location is different from the desired location indicated by the request information.

[0131] As described above, for example, the desired guidance location and the guidable location are information indicating a location or information indicating an area. For example, the desired guidance location and the guidable location are matched based on criteria such as the distance between locations, the distance between areas, the distance between locations, or whether a location or area is included within an area.

[0132] For example, matching may be performed based on whether the area indicating the desired guide location (also referred to as the desired area) is included in the area indicating the guidable location (also referred to as the possible area), or whether the desired area and the possible area are within a predetermined distance (whether they are adjacent or nearby). Furthermore, if there are multiple desired areas, matching may be performed based on the number of overlapping areas between the desired area and the guidable area. For example, the matching result may be calculated as the degree of match between the desired guide location and the guidable location, and expressed as a numerical value.

[0133] An example of matching between a desired guide location and a guideable location will be described with reference to Fig. 9. Fig. 9 shows a case where an area AR including a temple T exists as a major waypoint on a route R along which a vehicle M is scheduled to travel from a point P to a point Q.

[0134] For example, a driver of a vehicle M (referred to as user A) who is a user of the in-vehicle device 10 plans to travel from a point P where the driver lives to a point Q where the driver works. For example, the driver has registered information with a desired type of "guide" and "Kyoto City" as a possible guide location. For example, when a route is set in the in-vehicle device 10, an area AR including "X Temple" is identified as a major stopover and added to the registration information.

[0135] For example, when a user of the external device 30 (let's call it User B) sends request information specifying the desired type as "person to be guided" and the desired location as "Kyoto City, Temple X," the area AR including Temple X T is identified as the desired location to be guided.

[0136] The matching unit 59 compares the desired guide location of user B with the available guide locations of the registrants who have a user type of "driver" and a desired guide location of "guide," i.e., each of the registrants including user A. In this case, the comparison result shows that the area AR, which is the desired guide location of user B, matches the available guide locations of user A.

[0137] For example, familiar locations do not need to be registered in advance as guidable locations, and in that case, the current location or a major route point is used for matching.

[0138] For example, when the matching unit 59 calculates the degree of match as a comparison result, it prioritizes each of the registered individuals whose degree of match is calculated in order of highest degree of match, and extracts a predetermined number of registered individuals from the highest priority as potential partners for video communication with the client.

[0139] For example, the matching unit 59 determines a partner for video communication of the requester from among the extracted partner candidates. For example, the matching unit 59 notifies the registrant with the highest priority among the extracted partner candidates for video communication, and if consent is obtained from the registrant, determines the registrant as the partner for video communication of the requester. In this manner, matching is performed between the user of the in-vehicle device 10 and the user of the external device 30.

[0140] In addition, when the user type is a driver and the current location or a major route point is registered as a navigable location in addition to a familiar area, a location that matches the current location or a major route point may be given a higher priority, making it easier to match. Also, when a familiar area is not set as a navigable location for the driver, the priority may be lowered, making it harder to match.

[0141] Furthermore, if a registrant is in a standby state, that is, if the registrant is registered as being available for video communication, priority may be given to matching of the registrant in a standby state.

[0142] When the matching unit 59 matches the user of the in-vehicle device 10 with the user of the external device 30, the control unit 55 establishes video communication between the matched in-vehicle device 10 and the external device 30. The control unit 55 functions as a communication unit that performs audio communication between the matched in-vehicle device 10 and the external device 30.

[0143] The communication sequence between the devices and the control routine by the server 50 executed in the information processing system 100 will be described below.

[0144] 10 is a sequence diagram showing an example of a sequence executed when a user of the external device 30 is a requester in the information processing system 100 of this embodiment. This sequence is based on the premise that multiple registered users have completed the registration of the registration information as described above.

[0145] First, the external device 30 accepts an input operation of request information from the user (step S11), and transmits the request information to the server 50 (step S12).

[0146] When the server 50 receives the request information, it performs a matching process (step S13 ) to match the user of the external device 30 with one of the multiple registered users who are users of the in-vehicle device 10 .

[0147] After completing the matching process, the server 50 transmits a notification of a desire to virtually ride in the automobile M via video communication to the matched in-vehicle device 10 (step S14).

[0148] When receiving the notification of the passenger's desire to ride, the in-vehicle device 10 accepts an input operation of consent from the driver of the automobile M (step S15), and transmits a notification of consent to the server 50 (step S16).

[0149] When the server 50 receives the notification of acceptance, it transmits a URL for starting video communication to the external device 30 (step S17). When the user of the external device 30 taps the URL and the external device 30 accesses the URL (step S18), the server 50 establishes a voice call between the in-vehicle device 10 and the external device 30 and starts video communication in which the in-vehicle device 10 distributes the video captured in the automobile M to the external device 30 (step S19).

[0150] For example, if the user of the external device 30 desires guidance, but the user of the matched in-vehicle device 10 has not set a location where guidance is available, the video communication may be configured to only deliver video without making a voice call, at least at the start.

[0151] For example, if the user type of the external device 30 in this sequence is a "guideee," one of the motivations for transmitting the request information may be to preview a trip. For example, a user of the external device 30 who is planning a trip may receive guidance from a driver who is familiar with the area to a place where the user wishes to be guided. For example, the user may receive information about the place where the user wishes to be guided via a voice call in video communication, or may do preliminary research for the trip by watching distributed video.

[0152] For example, if the user type of the external device 30 in this sequence is a "guide," the motivation for transmitting request information may include utilizing guidance skills or utilizing spare time. For example, by matching with a driver who is driving in an unfamiliar place, the guidance skills of the user of the external device 30 regarding that place can be actively utilized. For example, by including information indicating the timing at which guidance can be provided as part of the desired information in the request information, spare time can be effectively utilized. Furthermore, for example, by providing an incentive such as points to the provider of guidance, the user of the external device 30 can be motivated to become a requester who can provide guidance.

[0153] 11 is a sequence diagram showing an example of a sequence executed when the user of the in-vehicle device 10 is the requester in the information processing system 100 of this embodiment. First, the in-vehicle device 10 accepts an input operation of request information from the user (step S21). For example, a voice input operation such as "Find a communication partner who can guide me around Kyoto city" is accepted. Thereafter, the request information is transmitted to the server 50 (step S22).

[0154] When the server 50 receives the request information, it performs a matching process (step S23) to match the user of the in-vehicle device 10 with one of the multiple registered users who are users of the external device 30.

[0155] After completing the matching process, the server 50 sends a ride request notification to the matched external device 30, requesting the registered person to virtually ride along in the car M via video communication (step S24).

[0156] When the external device 30 receives the notification of the ride-along request, it accepts an input operation of acceptance by the user of the external device 30 (step S25), and transmits a notification of acceptance to the server 50 (step S26).

[0157] Upon receiving the notification of acceptance, the server 50 transmits the notification of acceptance to the in-vehicle device 10 (step S27) and transmits a URL for starting video communication to the external device 30 (step S28). When the user of the external device 30 taps the URL and the external device 30 accesses the URL (step S29), the server 50 establishes a voice call between the in-vehicle device 10 and the external device 30 and starts video communication in which the in-vehicle device 10 distributes the video captured in the automobile M to the external device 30 (step S30).

[0158] For example, when the user type of the in-vehicle device 10 in this sequence is a "guideee," one of the motivations for transmitting request information is to relieve anxiety about driving in an unfamiliar place.

[0159] For example, if the user type of the in-vehicle device 10 in this sequence is a "guide," one of the motivations for transmitting request information may be to add value to daily travel or to relieve boredom or drowsiness.

[0160] 12 is a flowchart showing a control routine RT1, which is an example of a control routine executed by the control unit 55 of the server 50 when matching a user of the in-vehicle device 10 with a user of the external device 30 and performing video communication between the matched in-vehicle device 10 and the external device 30. The control unit 55 repeatedly executes the control routine RT1, for example, when the server 50 is powered on.

[0161] When the control unit 55 starts the control routine RT1, it determines whether or not request information exists (step S101). In step S101, for example, the control unit 55 determines whether or not the desired information acquisition unit 57 has received request information that includes the desired information of the requester and information indicating a request to find a partner for video communication.

[0162] In step S101, if it is determined that no request information exists (step S101: NO), the control unit 55 ends the control routine RT1.

[0163] In step S101, if it is determined that request information exists (step S101: YES), the control unit 55 acquires the request information (step S102). In step S102, for example, the control unit 55 supplies the request information received by the desired information acquisition unit 57 to the matching unit 59.

[0164] After executing step S102, the control unit 55 causes the matching unit 59 to execute a partner candidate extraction subroutine to extract registered persons who can be partners in video communication with the requester (step S103).

[0165] After executing step S103, the control unit 55 determines whether or not one or more registrants have been extracted in step S103 (step S104).

[0166] If it is determined in step S104 that a registered person has not been extracted (step S104: NO), the control unit 55 notifies the requester that there is no matched person (step S105). In step S105, for example, information indicating that there is no matched person is transmitted to the in-vehicle device 10 or the external device 30 of the requester.

[0167] If it is determined in step S104 that a registered person has been extracted (step S104: YES), the control unit 55 executes a communication partner determination subroutine to execute processing for determining one registered person as a call partner for the requester (step S106). In step S106, for example, the control unit 55 causes the matching unit 59 to execute the communication partner determination subroutine. In step S106, for example, a notification requesting consent to conduct video communication with the requester is transmitted to the extracted registered people in descending order of the scores calculated in step S103.

[0168] After step S106 is executed, the control unit 55 determines whether or not a communication partner has been determined (step S107). In step S107, for example, if consent for video communication is not obtained from any of the registered users in step S106, it is determined that a communication partner has not been determined.

[0169] If it is determined in step S107 that a communication partner has not been determined (step S107: NO), the control unit 55 proceeds to step S105 and notifies the requester that there is no matched party.

[0170] In step S107, if it is determined that the communication partner has been determined (step S107: YES), the control unit 55 starts video communication between the in-vehicle device 10 and the external device 30 between the requester who sent the request information and the determined registered person (step S108).

[0171] After executing step S108 or step S105, the control unit 55 ends the control routine RT1.

[0172] In steps S103 to S106, the matching unit 59 executes a matching step of matching the user of the first device with the user of the second device based on the desired information.

[0173] In steps S107 and S108, the control unit 55 functions as a communication unit that executes a step (communication step) of performing voice communication between the matched in-vehicle device 10 and the external device 30.

[0174] In steps S106 to S108, for example, when one or more in-vehicle devices 10 are extracted for one external device 30 in step S103, the control unit 55 functions as a communication unit that performs voice communication between one of the extracted one or more in-vehicle devices 10 and one external device 30.

[0175] Also, in steps S106 to S108, when one or more external devices 30 are extracted for one in-vehicle device 10 in step S103, the control unit 55 functions as a communication unit that performs voice communication between one of the extracted one or more external devices 30 and one in-vehicle device 10.

[0176] FIG. 13 is a flowchart showing a partner candidate extraction subroutine RT2, which is an example of a routine executed by the matching unit 59 in step S103 of the control routine RT1.

[0177] When the matching unit 59 starts the partner candidate extraction subroutine RT2, it extracts registrants of a user type different from the user type of the requester (step S201). In step S201, the matching unit 59 reads registration information of registrants of a user type different from the user type indicated by the request information from the registration information holding unit 51A of the storage unit 51. For example, if the user type of the requester is a "passenger" indicating the user of the external device 30, the matching unit 59 reads registration information of a "driver" indicating the user of the in-vehicle device 10.

[0178] After executing step S201, the matching unit 59 extracts registrants with a desired type different from the desired type of the requester from among the registrants extracted in step S201 (step S202). In step S202, for example, if the user type indicated by the request information is "guided person," the matching unit 59 extracts registration information with a user type of "guide."

[0179] After step S202 is executed, the matching unit 59 calculates a degree of coincidence between the desired guidance location and the guidable location between the requester and each of the one or more registered users extracted in step S202 (step S203). In step S203, the matching unit 59 calculates a degree of coincidence between the desired guidance location and the guidable location between the user of one in-vehicle device 10 and each of the users of the multiple external devices 30, or between the user of one external device 30 and each of the users of the multiple in-vehicle devices 10.

[0180] In step S203, for example, as described above, the degree of coincidence is calculated based on the distance between the point or area indicating the desired guide location and the point or area indicating the guidable location.

[0181] After step S203 is executed, a priority is assigned to each of one or more registered users based on the degree of match calculated in step S203 (step S204). In step S204, for example, the priority is assigned in descending order of the degree of match. For example, if there is no difference in the degree of match, the priority may be assigned based on other parameters. For example, if the request information includes the requester's requirements regarding the level of guidance skills or driving skills, the priority may be assigned in descending order of the degree of suitability of the items in the registration information corresponding to the requirements.

[0182] In steps S203 and S204, the matching unit 59 generates multiple combinations between the requester and each of the extracted one or more registered users by combining a user of one in-vehicle device 10 with each of the users of multiple external devices 30, or by combining a user of one external device 30 with users of multiple in-vehicle devices 10, and prioritizes the multiple combinations based on the matching results between the desired location of guidance and the locations that can be guided to.

[0183] After step S204 is executed, the matching unit 59 extracts a predetermined number of registrants based on the priority assigned in step S204 (step S205). In step S205, for example, about 3 to 5 registrants are extracted. In step S205, for example, a threshold value of the degree of match may be set, and registrants whose degree of match exceeds the threshold may be extracted.

[0184] After executing step S205, the matching unit 59 ends the partner candidate extraction subroutine RT2.

[0185] In steps S203 to S205 of this routine, for example, when the user of the external device 30 is a requester whose desired type is to be guided, the matching unit 59 functions as an extraction unit that extracts one or more in-vehicle devices 10 based on the user's desired information to be guided of the external device 30 and the current location of the in-vehicle device 10 or the route set in the automobile M.

[0186] Furthermore, in steps S203 to S205 of this routine, for example, when the user of the in-vehicle device 10 is a requester whose desired type is to be guided, the matching unit 59 functions as an extraction unit that extracts one or more external devices 30 based on the guided information of the user of the in-vehicle device 10 and the guidability information including whether the external device 30 can be guided and, if so, the location where the external device 30 can be guided.

[0187] In this routine, for example, if the current location of the in-vehicle device 10 is too close to a desired guidance location of the user of the external device 30, the matching unit 59 may exclude the user of the in-vehicle device 10 from being extracted as a candidate for video communication. In other words, users of in-vehicle devices 10 that are within a predetermined distance (e.g., within 1 km, a range that can be reached within a few minutes) of the desired guidance location of the user of the external device 30 may be excluded from matching targets. This can prevent, for example, a situation in which the user arrives at the destination immediately after the start of video communication and the video communication ends without much guidance being provided.

[0188] For example, in this routine, the matching unit 59 may not match the user of the in-vehicle device 10 with the user of the external device 30 if the current location of the in-vehicle device 10 and the current location of the external device 30 are within a predetermined distance (for example, within 1 km).

[0189] For example, in this routine, when extracting video communication partners for a user of one in-vehicle device 10 from among a plurality of external devices 30, the matching unit 59 may acquire the current location of each external device 30. If the current location is too close to, for example, the current location of the automobile M or a major route point, which is a navigable location or a desired location for guidance, the user of the external device 30 may be excluded from the candidates to be extracted as video communication partners.

[0190] In other words, if the current location of the external device 30 is within a predetermined distance from a location including the current location of the automobile M equipped with the in-vehicle device 10, a destination, or a location on a route set in the automobile M, the user of the external device 30 may be excluded from matching targets. This, for example, can prevent the automobile M from being identified by the user of the external device 30, and protect the privacy of the user of the in-vehicle device 10. In another aspect, control may be performed so that the call is terminated when the current location of the external device 30 and the current location of the automobile M come within a predetermined distance during video communication.

[0191] As described above, the requester may be allowed to select whether or not to exclude registered persons who meet predetermined conditions from the matching targets.

[0192] FIG. 14 is a flowchart showing a communication partner determination subroutine RT3, which is an example of a routine executed by the matching unit 59 in step S106 of the control routine RT1.

[0193] When the matching unit 59 starts the communication partner determination subroutine RT3, it notifies the registered person with the highest priority among the registered people extracted in the partner candidate extraction subroutine RT2 of a video communication request (step S301). In step S301, for example, if the requester is a user of the external device 30, a notification of a ride-along request is sent to the user of the in-vehicle device 10, which has the highest priority. Also, in step S301, for example, if the requester is a user of the in-vehicle device 10, a notification of a ride-along request is sent to the user of the external device 30.

[0194] After executing step S301, the matching unit 59 determines whether the video communication has been accepted (step S302). In step S302, for example, if the server 50 receives a response indicating acceptance in response to the notification sent in step S301, it is determined that the video communication has been accepted. In step S301, for example, if a response indicating refusal of the video communication is received, or if a response indicating acceptance is not received within a predetermined time, it is determined that the video communication has not been accepted.

[0195] In step S302, if it is determined that the video communication has been accepted (step S302: YES), the matching unit 59 determines the accepted registrant as the communication partner with the requester (step S303). In step S303, the user of one in-vehicle device 10 or the user of one external device 30 is determined as the communication partner.

[0196] In step S302, if it is determined that the video communication has not been accepted (step S302: NO), it is determined whether or not there is a registered person with the next highest priority among the registered people extracted in the partner candidate extraction subroutine RT2 (step S304).

[0197] In step S304, if it is determined that there is no registrant with the next highest priority (step S304: NO), the matching unit 59 ends the communication partner determination subroutine RT3 without determining a communication partner.

[0198] In step S304, if it is determined that a registrant with the next highest priority exists (step S304: YES), the matching unit 59 transmits a video communication request notification to the registrant with the next highest priority (step S305).

[0199] After executing step S305, the matching unit 59 proceeds to step S302 and determines whether or not the video communication has been accepted.

[0200] This routine sends requests for video communication in descending order of priority, and if any registered person accepts the request, that registered person is selected as the communication partner. If no registered person accepts the request, no communication partner is selected, and as described above, in step S105 of control routine RT1, the requester is notified that there is no match.

[0201] In this routine, the matching unit 59 notifies the user of the in-vehicle device 10 or the user of the external device 30, in order of priority, of at least some of the multiple combinations generated in steps S203 and S204 of the partner candidate extraction subroutine RT2.

[0202] In this routine, the matching unit 59 may simply determine, for example, the registrant with the highest priority as the communication partner with the requester.

[0203] For example, in step S301 of this routine, the requester may be allowed to select a communication partner from one or more registered users extracted in the partner candidate extraction subroutine RT2.

[0204] As described above in detail, the information processing device of the present invention is an information processing device that processes information regarding voice communication between an in-vehicle device 10 as a first device that moves together with an automobile M as a mobile body, and an external device 30 as a second device that is a terminal outside the mobile body, and has a desired information acquisition unit that acquires multiple desired information including user type information indicating whether the user is a user of the first device or a user of the second device, and a desired type indicating whether the user is a person who wishes to be guided or a guide who is able to provide guidance, and including a desired guide location where the user wishes to be guided if the desired type is a person who is a guide, and a navigable location where the guide can provide guidance if the desired type is a guide; a matching unit that matches users of the first device with users of the second device based on the desired information; and a communication unit that performs voice communication between the matched first device and second device.

[0205] As described above, in the present invention, the desired information includes a desired type, so that, for example, a user whose desired information is to be a guide can be matched with a user whose desired type is to be guided based on the desired information. Therefore, through voice communication between the matched first device and second device, a user who wishes to be guided can receive guidance from a user who is able to provide guidance, and both the user of the first device and the user of the second device can achieve their goals through the voice communication.

[0206] Therefore, according to the present invention, it is possible to provide an information processing device, an information processing method, an information processing program, and a storage medium that enable matching of a suitable partner when a driver of a mobile vehicle and a user outside the mobile vehicle communicate with each other.

[0207] For example, the information processing device of this embodiment has a desired information acquisition unit that acquires desired information to be guided, including a desired location to be guided, from a user of a second device, an extraction unit that extracts one or more first devices based on the desired information to be guided and the current location of the first device or a route set in a mobile body, and a communication unit that performs voice communication between one of the extracted one or more first devices and the second device.

[0208] With this configuration, for example, it is possible to extract the in-vehicle devices 10 installed in the automobile M traveling along a route including a place for which guidance is desired by the user of the external device 30. The user of the external device 30 can receive guidance about the desired place through voice communication with the user of one of the extracted in-vehicle devices 10, for example.

[0209] For example, the information processing device of this embodiment has a desired information acquisition unit that acquires guided desired information including a guided location, which is a location to which the user of the first device wishes to be guided, a navigable information acquisition unit that acquires navigable information including whether the user of the second device is available for guidance and, if so, navigable locations, which are locations to which guidance is possible, an extraction unit that extracts one or more second devices based on the desired information to be guided and the navigable information, and a communication unit that performs voice communication between one of the extracted one or more second devices and the first device.

[0210] With this configuration, for example, it is possible to extract external devices 30 used by users of external devices 30 that can provide guidance to a place to which the user of the in-vehicle device 10 wishes to be guided. The user of the in-vehicle device 10 can receive guidance to the desired place through voice communication with the user of one of the extracted external devices 30, for example.

[0211] The configurations, routines, etc. of the in-vehicle device 10, the server 50, and the external device 30 in the above-described embodiment are merely examples, and can be appropriately selected or changed depending on the application, etc.

[0212] For example, in the above embodiment, the registration information is stored in the registration information storage unit of the server 50. However, this is not limiting. For example, the information stored in the registration information storage unit may be stored in an external server separate from the server 50.

[0213] In the above embodiment, an example in which video communication is performed in the information processing system 100 has been described, but the present invention is not limited to this. The present invention is applicable to a case in which only voice communication is performed between the external device 30 and the in-vehicle device 10 in the information processing system 100. In other words, the present invention is also applicable to communication in a mode in which no video is distributed from the in-vehicle device 10. Furthermore, only video distribution may be performed for a certain period of time immediately after the start of video communication, and the voice communication may be started later.

[0214] In the above embodiment, the in-car device 10 and the external device 30 perform video communication via the server 50. However, the video communication may be performed directly between the in-car device 10 and the external device 30.

[0215] Furthermore, during video communication, the above-mentioned video distribution may be performed from the in-vehicle device 10 to the external device 30, while a voice call may be established between the in-vehicle device 10 and the external device 30 in parallel via a path separate from the information processing system 100.

[0216] In the above embodiment, an example has been described in which the driver is mainly matched with the user of the external device 30 as the occupant of the automobile M, but occupants in the passenger seat or rear seat may also be matched with the user of the external device 30.

[0217] In the above embodiment, an example has been described in which video images of the front and interior of the automobile M are distributed, but this is not limiting. For example, the automobile M may be equipped with a camera that captures the side or rear of the automobile M, or a 360-degree camera, and video images captured by these cameras may be distributed during video communication.

[0218] In the above embodiment, the in-vehicle device 10 is an in-vehicle navigation device, but the in-vehicle device 10 does not have to have a navigation function. In that case, for example, the in-vehicle device 10 may transmit current position information of the automobile M to the server 50, thereby registering the current position as a navigable location, or may predict and register major intermediate points based on the transition of the current position.

[0219] For example, the in-vehicle device 10 may be configured by integrating a terminal device having a configuration similar to that of the in-vehicle device 10 with the exterior camera 13 and the touch panel 15. Specifically, the in-vehicle device 10 may be a terminal device such as a smartphone, tablet, or PC with a camera that is equipped with an application that performs the same functions as the in-vehicle device 10. In this case, the in-vehicle device 10 may be attached to the dashboard DB by, for example, a cradle or the like so that the built-in camera can capture an image of the area ahead of the vehicle M through the windshield of the vehicle M.

[0220] Furthermore, the in-vehicle device 10 may be configured not to display a screen to be presented to the driver of the automobile M. For example, the in-vehicle device 10 may have a configuration similar to that of a drive recorder, and may be a device integrated with the exterior camera 13. Specifically, the in-vehicle device 10 may be a device in which hardware that performs the video communication function of the in-vehicle device 10 is built into the housing of the exterior camera 13. In this case, the in-vehicle device 10 may not perform the various display outputs described above.

[0221] In the above embodiment, the external device 30 is described as a smartphone, but is not limited thereto. The external device 30 is a terminal device that the user of the external device 30 can use for video communication, and is configured to be able to display or present messages related to video communication, accept operation inputs necessary for video communication, send and receive audio data, and receive and display video. For example, the external device 30 may be a terminal device such as a tablet, a PC, or a wearable device.

[0222] In the above embodiment, the in-vehicle device 10 is mounted on the automobile M, but the in-vehicle device 10 may be mounted on other moving objects such as a bicycle, a motorbike, or a boat.

[0223] REFERENCE SIGNS LIST 10 In-vehicle device 13 Exterior camera 14 Interior camera 15 Touch panel 17 Speaker 19 Microphone 21 Acceleration sensor 23 Memory unit 25 Control unit 27 Communication unit 30 External device 31 Touch panel 33 Speaker 35 Microphone 37 Memory unit 39 Control unit 41 Communication unit 50 Server 51 Memory unit 53 Communication unit 55 Control unit 57 Desired information acquisition unit 59 Matching unit

Claims

1. An information processing device for processing information relating to voice communication between a first device that moves together with a mobile object and a second device that is a terminal outside the mobile object, a desire information acquiring unit that acquires a plurality of desire information including user type information indicating whether the user is a user of the first device or a user of the second device, and a desire type indicating whether the user is a guided person who wishes to be guided or a guide who is capable of providing guidance, and including a desired guide location where the user desires to be guided if the desire type is the guided person, and a guideable location where the guide is capable of providing guidance if the desire type is the guider; a matching unit that matches users of the first device with users of the second device based on the desired information; an information processing device comprising: a communication unit that performs the voice communication between the first device and the second device that have been matched;

2. The information processing apparatus according to claim 1 , wherein the matching unit matches a user whose desired type is the guide with a user whose desired type is the guided.

3. 3. The information processing device according to claim 1, wherein the matching unit matches the user of the first device with the user of the second device based on a comparison result between the guidable locations and the desired location to be guided.

4. The information processing device according to claim 1, characterized in that, in matching users of the first device with users of the second device, the matching unit generates multiple combinations by combining one user of the first device with each of multiple users of the second device, or by combining one user of the second device with each of multiple users of the first device, and prioritizes the multiple combinations based on the matching results between the guidable locations and the desired locations.

5. 5. The information processing device according to claim 4, wherein the matching unit notifies a user of the one of the first devices or a user of the one of the second devices of at least some of the plurality of combinations in descending order of priority.

6. 2. The information processing device according to claim 1, characterized in that, when the desired type of the user of the first device is the guide, the guidable locations include the current location of the mobile body, a destination, or a location on a route set in the mobile body.

7. 2. The information processing device according to claim 1, wherein the preference information includes information indicating a timing at which the user of the second device is available to provide guidance when the preference type of the user of the second device is to be a guide.

8. The information processing device according to claim 1, characterized in that, when matching a user of the first device with a user of the second device, the matching unit excludes from the matching a user of the first device who is within a predetermined distance from the desired location of the user of the second device.

9. The information processing device described in claim 1 or 6, characterized in that, when matching a user of the first device with a user of the second device, the matching unit excludes from the matching targets users of the second device whose current location is within a predetermined distance from a location including the current location, destination, or a location on a route set by the mobile body of the mobile body traveling with the first device.

10. The information processing device according to claim 1, characterized in that the matching unit does not match the user of the first device with the user of the second device when the distance between the current location of the first device and the current location of the second device is within a predetermined distance.

11. An information processing device for processing information relating to voice communication between a first device that moves together with a mobile object and a second device that is a terminal outside the mobile object, a desired information acquiring unit that acquires guided destination desired information including a guided destination desired location from a user of the second device; an extraction unit that extracts one or more of the first devices based on the guidance request information and a current location of the first device or a route set in the mobile body; an information processing device comprising: a communication unit that performs the voice communication between one of the extracted one or more first devices and the second device;

12. An information processing device for processing information relating to voice communication between a first device that moves together with a mobile object and a second device that is a terminal outside the mobile object, a desired information acquiring unit that acquires guided destination desired information including a guided destination desired location from a user of the first device; a guidable information acquisition unit that acquires guidable information including whether or not the user of the second device can be guided and, if so, guidable places that are places where guidance is possible; an extraction unit that extracts one or more of the second devices based on the guidance request information and the guidable information; a communication unit that performs the voice communication between one of the extracted one or more second devices and the first device, The information processing device, wherein the extraction unit excludes the second device that is within a predetermined distance of the first device from the extraction target.

13. An information processing method executed by an information processing device for processing information regarding voice communication between a first device that moves together with a mobile object and a second device that is a terminal outside the mobile object, comprising: a desire information acquisition step of acquiring a plurality of desire information including user type information indicating whether the user is a user of the first device or a user of the second device, and a desire type indicating whether the user is a guided person who wishes to be guided or a guide who is capable of providing guidance, and including a desired guide location where the user desires to be guided if the desire type is the guided person, and a guideable location where the user is capable of providing guidance if the desire type is the guider; a matching step of matching a user of the first device with a user of the second device based on the desired information; and a communication step of performing the voice communication between the first device and the second device after the matching.

14. An information processing program executed by an information processing device including a computer, the information processing device processing information relating to voice communication between a first device that moves together with a mobile object and a second device that is a terminal outside the mobile object, the information processing program including: a desire information acquisition step of acquiring a plurality of desire information including user type information indicating whether the user is a user of the first device or a user of the second device, and a desire type indicating whether the user is a guided person who wishes to be guided or a guide who is capable of providing guidance, and including a desired guide location where the user desires to be guided if the desire type is the guided person, and a guideable location where the user is capable of providing guidance if the desire type is the guider; a matching step of matching a user of the first device with a user of the second device based on the desired information; a communication step of performing the voice communication between the matched first device and the matched second device; An information processing program for executing the above.

15. An information processing device includes a computer and processes information relating to voice communication between a first device that moves together with a mobile object and a second device that is a terminal outside the mobile object, a desire information acquisition step of acquiring a plurality of desire information including user type information indicating whether the user is a user of the first device or a user of the second device, and a desire type indicating whether the user is a guided person who wishes to be guided or a guide who is capable of providing guidance, and including a desired guide location where the user desires to be guided if the desire type is the guided person, and a guideable location where the user is capable of providing guidance if the desire type is the guider; a matching step of matching a user of the first device with a user of the second device based on the desired information; a communication step of performing the voice communication between the matched first device and the matched second device; A computer-readable storage medium that stores an information processing program for executing the above.