Information processing device, reception device, information processing method, and program

JPWO2024135049A5Active Publication Date: 2025-01-29JVC KENWOOD CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2024565619
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-11-15
Publication Date
2025-01-29
Estimated Expiration
2043-10-10

AI Technical Summary

Technical Problem

Conventional technologies provide information to users heading to a common destination before they encounter each other, leading to reduced motivation for users with changing schedules, particularly affecting elderly people living alone, as others may not interact with them, resulting in fewer social outings.

Method used

An information processing device and method that determine if users have encountered each other based on location, sound, and image data, allowing specific information to be transmitted only when they are at the same destination, enhancing user interaction and motivation to socialize.

Benefits of technology

This solution allows users to grasp encounter situations, increasing motivation for social interactions and reducing unnecessary information transmission, thereby improving social opportunities for both elderly and socially avoidant individuals.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

This information processing device comprises: a first information acquisition unit that acquires first identification information for identifying a first user and first address information registered to a terminal possessed by the first user; a second information acquisition unit that acquires second identification information for identifying a second user and second address information registered to a terminal possessed by the second user; an encounter determination unit that determines, on the basis of the first identification information and the second identification information, whether the second user has encountered the first user; a user identification unit that, if the second user has encountered the first user, identifies, as a third user, a common user from among one or a plurality of users included in each of the first address information and the second address information; and an information transmission unit that transmits the first identification information and / or the second identification information to a terminal possessed by the third user.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing device, receiving device, information processing method, and program

[0001] The present disclosure relates to an information processing device, a receiving device, an information processing method, and a program.

[0002] 2. Description of the Related Art Conventionally, there have been known terminals that provide information about a destination and guide a user to a destination so that the user can easily reach the destination.

[0003] Patent Literature 1 discloses a technology for providing information that can be shared among multiple users heading to the same destination. The conventional technology disclosed in Patent Literature 1 acquires information about the destinations of multiple users and matches multiple users who share a common destination. By allowing the matched users to share information, it is possible to provide the matched users with information that may be of interest to them. This allows, for example, users who do not know each other but are participating in the same tour to share information, thereby facilitating smooth communication between users.

[0004] Japanese Patent Application Laid-Open No. 2022-085189

[0005] However, in conventional technology, specific information may be provided to users who may be heading to a destination before the users encounter each other at the destination. Therefore, even if specific information is provided, if the specific user's plans change, other users may not be able to interact with the specific user. Therefore, other users who were hoping to interact with the specific user may be less motivated to head to the destination. As a result, there is a problem that opportunities for elderly people living alone to go out may decrease.

[0006] Non-limiting examples of the present disclosure contribute to providing an information processing device, an information processing method, and a program that can grasp encounter situations between multiple users.

[0007] An information processing device according to one embodiment of the present disclosure includes a first information acquisition unit that acquires first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered in the first transmitting device; a second information acquisition unit that acquires second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered in the second transmitting device; an encounter determination unit that determines whether the first user and the second user have encountered each other based on the first identification information and the second identification information; a user identification unit that, when the first user and the second user encounter each other, identifies a third user based on the first address information and the second address information; and an information transmission unit that transmits at least one of the first identification information and the second identification information to a receiving device owned by the third user.

[0008] A receiving device according to one embodiment of the present disclosure is a receiving device that receives information from an information processing device, and receives from the information processing device at least one of first identification information including first location information indicating the location of a first transmitting device owned by a first user and second identification information including second location information indicating the location of a second transmitting device owned by a second user, and displays information about the first user and the second user on a display unit based on at least one of the first identification information and the second identification information.

[0009] An information processing method by an information processing device according to one embodiment of the present disclosure includes acquiring first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered on the first transmitting device, acquiring second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered on the second transmitting device, determining whether the first user and the second user have encountered each other based on the first identification information and the second identification information, and if the first user and the second user have encountered each other, identifying a third user based on the first address information and the second address information, and transmitting at least one of the first identification information and the second identification information to a receiving device owned by the third user.

[0010] A program according to one embodiment of the present disclosure causes a computer to perform the following operations: acquire first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered on the first transmitting device; acquire second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered on the second transmitting device; determine whether the first user and the second user have encountered each other based on the first identification information and the second identification information; if the first user and the second user have encountered each other, identify a third user based on the first address information and the second address information; and transmit at least one of the first identification information and the second identification information to a receiving device owned by the third user.

[0011] According to an embodiment of the present disclosure, it is possible to provide an information processing device, a receiving device, an information processing method, and a program that are capable of grasping encounter situations between multiple users.

[0012] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to a first embodiment. FIG. 2 is a diagram illustrating an example of the hardware configuration of an ECU of an in-vehicle device. FIG. 3 is a diagram illustrating an example of the functional configuration of the ECU of the in-vehicle device. FIG. 4 is a diagram illustrating an example of the hardware configuration and functional configuration of an information processing device of a server. FIG. 5 is a flowchart for explaining the operation of the information processing system. FIG. 6 is an external view of a mobile object 3. FIG. 7 is a diagram illustrating an example of information transmitted to a server and an example of information transmitted to a user. FIG. 8 is a diagram illustrating an example of information displayed on a first client device owned by a first user and a second client device owned by a second user, respectively. FIG. 9 is a diagram illustrating an example of a map displayed on a third client device owned by a third user. FIG. 10 is a diagram illustrating an example of information displayed on a third client device owned by a third user. FIG. 11 is a diagram illustrating an example of a route guidance display provided to a third user. FIG. 12 is a diagram illustrating an example of the configuration of an information processing device according to a second embodiment. FIG. 13 is a diagram illustrating an example of the configuration of an information processing device according to a third embodiment.

[0013] First Embodiment Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a diagram showing an example of the configuration of an information processing system according to a first embodiment.

[0014] The information processing system 1 includes an on-board device 30 mounted on each of a plurality of mobile objects 3, a plurality of terminals 2, and a server 5 capable of communicating with the on-board device 30 and the terminal 2. The on-board device 30 and the terminal 2 are also referred to as client devices. The type of client device may be only one of the on-board device 30 and the terminal 2. The information processing system 1 is configured by any client device from the plurality of on-board devices 30 and the plurality of terminals 2, and the server 5.

[0015] The mobile body 3 may be a mobility scooter, a passenger car, a freight vehicle, a motorcycle, etc. Hereinafter, the mobile body 3 may be simply referred to as a vehicle.

[0016] The vehicle-mounted device 30 includes a data communication module (DCM) 31, an electronic control unit (ECU) 32, a global navigation satellite system (GNSS) module 33, a sound pickup device 34, an imaging device 36, a display device 37, and the like.

[0017] The DCM 31 is a communication device that performs bidirectional communication with devices external to the vehicle via a communication network NW. The communication network NW may be a mobile phone network terminated by a large number of base stations, a satellite communication network using communication satellites, or the like. The DCM 31 is connected to the ECU 32 via a Controller Area Network (CAN) 38, which is an in-vehicle network, so as to be able to communicate with each other. The DCM 31 transmits various information to devices external to the vehicle in response to requests from the ECU 32, and also relays information transmitted from devices external to the vehicle to the ECU 32. The external devices may be a server 5, a terminal 2, a V2X (Vehicle to Everything) communication device (not shown), or the like. V2X is a communication technology that connects vehicles with various objects. V2X includes communications such as V2V (Vehicle to Vehicle), V2P (Vehicle to Pedestrian), V2I (Vehicle to Infrastructure), and V2N (Vehicle to Network).

[0018] The ECU 32 is an electronic control unit that performs various control processes related to predetermined functions of the vehicle, such as a motor ECU, a hybrid ECU, or an engine ECU. The ECU 32 collects vehicle information and inputs it to the DCM 31. The vehicle information includes vehicle position information, image information, sound information, and the like. The vehicle information may also include speed information, vehicle state information, and the like.

[0019] (Vehicle position information) Vehicle position information is information indicating the current position of the vehicle, for example, information indicating the latitude and longitude of the vehicle where the vehicle is traveling. The vehicle position information is transmitted from the GNSS module 33 or the like. The GNSS module 33 receives GNSS signals transmitted from satellites and determines the position of the vehicle in which the GNSS module 33 is installed. The GNSS module 33 is communicably connected to the ECU 32 via the CAN 38, and the vehicle position information is transmitted to the ECU 32. The GNSS module 33 may include a GNSS module 33 provided in a car navigation device, a drive recorder, a module mounted on the vehicle body, a module provided in the terminal 2 owned by the user, or the like. Hereinafter, vehicle position information may be simply referred to as position information.

[0020] (Imaging Information) The imaging information is information indicating the content of an image captured by the imaging device 36. The imaging information includes time information indicating the time when the image was generated. The imaging device 36 is a camera equipped with an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS).

[0021] The imaging device 36 includes an internal imaging device that captures images of the inside of the vehicle, an external imaging device that captures images of the outside of the vehicle, etc. The imaging device 36 may also include a camera provided in a drive recorder, a camera mounted on the vehicle body, a camera provided in the terminal 2 owned by the user, etc.

[0022] The internal image capturing device is disposed in a position where it can capture an image of the face of an occupant, etc. The number of internal image capturing devices is not limited to one, and multiple internal image capturing devices may be provided in the vehicle. The internal image capturing device outputs image capturing information indicating the captured image inside the vehicle.

[0023] The external imaging device may be a front camera, rear camera, omnidirectional camera, panoramic camera, or the like that captures the scenery around the vehicle. The scenery around the vehicle may be, for example, the scenery in front of the vehicle, the scenery to the side of the vehicle (the driver's door side or the passenger door side of the vehicle), the scenery behind the vehicle, or the like. The scenery may include, for example, the scenery at the destination of the user of terminal 2 (e.g., a meeting place, a park, or the like), the roadway on which the vehicle is traveling, objects on the roadway, the sidewalk facing the roadway, objects on the sidewalk, or the like. The external imaging device is, for example, disposed in a position where it can capture the scenery outside the vehicle. The external imaging device outputs imaging information indicating the captured outside-vehicle image.

[0024] (Sound Information) The sound information may include the voice (audio) of the first user, sounds around the first user, etc. collected by the sound collection device 34. The sound collection device 34 may include a microphone provided in a car navigation device, a microphone provided in a drive recorder, a microphone mounted on the vehicle body, a microphone provided in the terminal 2 owned by the user, etc.

[0025] The display device 37 is a liquid crystal display or the like. The display device 37 may include a device provided in a car navigation device, a device provided in a drive recorder, a device mounted on the vehicle body, a device provided in the terminal 2 owned by the user, and the like.

[0026] The server 5 is a server that collects information from a plurality of vehicles and transmits information (information distribution) to the occupants of the plurality of vehicles to provide various services. The server 5 can also be a server that collects information from the terminals 2 owned by the occupants of the plurality of vehicles or the in-vehicle devices 30 installed in the plurality of vehicles, and transmits information (information distribution) to the terminals 2 owned by the occupants of other vehicles or the in-vehicle devices 30 installed in other vehicles to provide various services.

[0027] The various services include an information transfer service, etc. The information transfer service may include, for example, transferring video data, audio data, location information, etc. collected by a specific terminal 2 or in-vehicle device 30 to another terminal 2 or another in-vehicle device 30. The various services are not limited to the information transfer service, but may also include a car sharing service, an authentication key service, a trunk delivery service, a B2C car sharing service, an advertisement distribution service, etc.

[0028] The server 5 includes a communication device 51 and an information processing device 52. The communication device 51 is a communication device that performs bidirectional communication with each of the multiple in-vehicle devices 30 or the multiple terminals 2 via the communication network NW under the control of the information processing device 52. The information processing device 52 executes various control processes in the server 5. The information processing device 52 is configured as a server computer including, for example, a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), an auxiliary storage device, an input / output interface, and the like.

[0029] Next, the hardware configuration of the ECU 32 of the vehicle-mounted device 30 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the hardware configuration of the ECU 32 of the vehicle-mounted device 30. The ECU 32 includes an auxiliary storage device 32A, a memory device 32B, a CPU 32C, and an interface device 32D, which are connected to one another by a bus line 32E.

[0030] The auxiliary storage device 32A is a hard disk drive (HDD), flash memory, or the like that stores files and data necessary for processing by the ECU 32. The memory device 32B reads and stores a program from the auxiliary storage device 32A when instructed to start the program. The CPU 32C executes the program stored in the memory device 32B and realizes various functions of the ECU 32 in accordance with the program. The interface device 32D is, for example, an interface that connects the CPU 32C to the DCM 31 via the CAN 38 and also connects the imaging device 36 and the like to the DCM 31 via the CAN 38.

[0031] Next, the functions of the ECU 32 of the vehicle-mounted device 30 will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the functional configuration of the ECU 32 of the vehicle-mounted device 30.

[0032] The CPU 32C of the ECU 32 includes a vehicle information transmitting / receiving unit 321, an imaging information management unit 322, and a display control unit 323.

[0033] The vehicle information transmitting / receiving unit 321 has a function of transmitting the above-mentioned vehicle position information, image information, sound information, etc. to the server 5 as vehicle information, and a function of receiving information from the server 5.

[0034] The imaging information management unit 322 inputs imaging information transmitted from the imaging device 36 for a certain period of time, and performs processing such as embedding time and vehicle position information in the imaging information. The display control unit 323 displays a map including the current position of the vehicle on the display, and displays the scenery outside the vehicle captured by the camera on the display.

[0035] Next, an example of the hardware configuration of the server information processing device will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the hardware configuration and functional configuration of the server information processing device. The information processing device 52 includes a CPU 520 and a storage unit (not shown).

[0036] The CPU 520 includes a communication processing unit 5201 , a first information acquisition unit 5202 , a second information acquisition unit 5203 , an encounter determination unit 5204 , a user identification unit 5205 , and an information transmission unit 5206 .

[0037] The communication processing unit 5201 transmits and receives signals to and from each of the multiple in-vehicle devices 30 and / or the multiple terminals 2. Specifically, the communication processing unit 5201 transmits and receives Protocol Data Units (PDUs) and Service Data Units (SDUs).

[0038] (First information acquisition unit 5202) The first information acquisition unit 5202 acquires, as the first information, first identification information that identifies the first user and first address information registered in the terminal 2 owned by the first user or the in-vehicle device 30 provided in the vehicle in which the first user is riding. The terminal 2 owned by the first user or the in-vehicle device 30 provided in the vehicle in which the first user is riding is also referred to as a first client device (first transmission device) owned by the first user. The first information acquisition unit 5202 may acquire the first address information stored in a storage unit (not shown) provided in the server 5.

[0039] Specifically, the first information acquisition unit 5202 acquires first location information indicating the location of the first client device as first identification information for identifying the first user. The first location information is information indicating the current location of the first client device, such as information indicating the latitude and longitude of the vehicle. The first location information is transmitted from a GNSS module 33 or the like provided in the first client device. The first information acquisition unit 5202 also acquires sound data collected by the first client device as first identification information for identifying the first user. The first information acquisition unit 5202 also acquires image data collected by the first client device as first identification information for identifying the first user.

[0040] By acquiring the location information, the server 5 can identify the general location of the first user's location, such as a meeting place where the first user is meeting a friend or the venue of an event the first user is attending with a friend, and transmit the identified location to the terminal 2 owned by a specific user (e.g., a third user) who is an acquaintance of the first user, or the in-vehicle device 30 in which the third user appears. The terminal 2 owned by the third user or the in-vehicle device 30 provided in the vehicle in which the third user is riding is also referred to as a third client device (receiving device) owned by the third user.

[0041] The sound data includes the voice (audio) of the first user, sounds around the first user, etc. The sound data is not limited to data collected by the first client device of the first user, but may also be data collected by a sound collection device other than a drive recorder or the on-board device 30 mounted on the vehicle body. By acquiring the sound data, the server 5 can transmit the voice of the first user, a conversation between the first user and his / her friend (e.g., a second user), sounds collected at the venue of an event in which the first user is participating, etc. to a third client device owned by a specific user (e.g., a third user) who is an acquaintance of the first user.

[0042] The image data includes an image of the first user, a landscape image including the first user, a landscape image around the first user, etc. The image data is not limited to data collected by the first client device owned by the first user, and may be data collected by an imaging device other than a drive recorder provided in the vehicle in which the first user is riding or the in-vehicle device 30 mounted on the vehicle body.

[0043] The first address information is information (such as name, telephone number, and address) that identifies one or more people and is recorded in an address book that is pre-registered in the first client device owned by the first user. The first address information may be address information that is managed by the server 5 as information about the first user. The first address information may be, for example, address information that is pre-registered by any one of the first user, the second user, and the third user, or another third party, and that is stored in a storage unit (not shown) provided in the server 5.

[0044] (Second information acquisition unit 5203) The second information acquisition unit 5203 acquires, as the second information, second identification information that identifies the second user and second address information registered in the terminal 2 owned by the second user or the in-vehicle device 30 provided in the vehicle in which the second user is riding. The terminal 2 owned by the second user or the in-vehicle device 30 provided in the vehicle in which the second user is riding is also referred to as a second client device (second transmission device) owned by the second user. The second information acquisition unit 5203 may acquire the second address information stored in a storage unit (not shown) provided in the server 5.

[0045] Specifically, similar to the first information acquisition unit 5202, the second information acquisition unit 5203 acquires second identification information for identifying the second user, such as second location information indicating the location of the second client device, sound data collected by the second client device, image data collected by the terminal 2, etc.

[0046] By acquiring the location information, the server 5 can determine the approximate location of the second user, such as a meeting place where the second user is meeting a friend, or the venue of an event the second user is attending with a friend, and notify the determined location to a third client device owned by a specific user (e.g., a third user) who is an acquaintance of the second user.

[0047] The sound data includes the voice (audio) of the second user, sounds around the second user, etc. The sound data is not limited to data collected by a second client device owned by the second user, and may be data collected by a sound collection device other than the in-vehicle device 30 installed in the vehicle in which the second user is riding. By acquiring the sound data, the server 5 can notify a third client device owned by a specific user (e.g., a third user) who is an acquaintance of the second user of the voice of the second user, a conversation between the second user and his / her friend (e.g., a first user), sounds collected at the venue of an event in which the second user is participating, etc.

[0048] The image data includes an image of the second user, a landscape image including the second user, a landscape image around the second user, etc. The image data is not limited to data collected by a second client device owned by the second user, and may be data collected by an imaging device other than a drive recorder provided in a vehicle in which the second user is riding or the in-vehicle device 30 mounted on the vehicle body.

[0049] The second address information is information (such as name, telephone number, and address) that identifies one or more people and is recorded in an address book that is pre-registered in the second client device owned by the second user. The second address information may be address information that is managed by the server 5 as information about the second user. The second address information may be, for example, address information that is pre-registered by any one of the first user, second user, and third user or another third party and that is stored in a storage unit (not shown) provided in the server 5.

[0050] (Encounter Determination Unit 5204) The encounter determination unit 5204 determines whether or not the first user and the second user have encountered each other, based on the first identification information and the second identification information.

[0051] (Determination Example 1) Specifically, the encounter determination unit 5204 determines whether the distance from the position of the first user acquired by the first information acquisition unit 5202 to the position of the second user acquired by the second information acquisition unit 5203 is shorter than a specific distance, based on first position information and second position information indicating the positions of the first client device and the second client device owned by the first user and the second user, respectively.

[0052] The specific distance is, for example, 5 m, 10 m, 30 m, etc. The specific distance may be automatically set to a value appropriate for the location where the user is located, or may be set to an arbitrary value by the user. When the encounter determination unit 5204 determines that the distance from the first user to the second user is shorter than the specific distance, it starts a timer and determines whether the distance is still shorter than the specific distance after a certain time has elapsed on the timer.

[0053] If the distance is still shorter than the specific distance after the timer has elapsed for a certain period of time, the encounter determination unit 5204 determines that the first user and the second user have encountered each other at their common destination. This allows the transmission of specific information to the third user only when the first user and the second user are gathering at a specific destination for the same purpose, that is, excluding a situation where the first user accidentally passes the second user on the road. Details of the specific information transmitted to the third user will be described later.

[0054] If the distance becomes longer than the specific distance before the timer expires, the encounter determination unit 5204 determines that the first user and the second user have not encountered each other. For example, if the first user and the second user meet by chance at a specific location, the first user may move away from the second user before the timer expires, causing the distance from the first user to the second user to become longer than the specific distance. In this way, if the distance becomes longer than the specific distance before the timer expires, the encounter determination unit 5204 determines that the first user and the second user have not encountered each other at their common destination. This makes it possible to suppress transmission of specific information to a third user if the first user and the second user are not gathering at a specific destination for the same purpose. This suppresses transmission of unnecessary information and prevents an increase in the load on the server 5 and the network NW.

[0055] (Determination Example 2) The encounter determination unit 5204 may use sound data instead of the first location information and the second location information, or together with the first location information and the second location information. Specifically, the encounter determination unit 5204 analyzes the sound included in the sound data acquired by the first information acquisition unit 5202, and if the analyzed sound matches the sound of a second user that has been registered in advance, determines that the second user is present around the first client device owned by the first user at a destination common to the first and second users. Note that a technique for analyzing sound and determining whether the sound matches is publicly known, as disclosed in, for example, Japanese Patent Application Laid-Open No. 2001-338069.

[0056] In this case, the encounter determination unit 5204 starts a timer as described above, and if the analyzed voice matches the voice of the second user that was previously registered after a certain period of time has elapsed on the timer, it determines that the second user is present around the first client device held by the first user, that is, that the first user and the second user have encountered each other.

[0057] If the voice of at least one of the second users is no longer extracted before the timer reaches a certain time, the encounter determination unit 5204 determines that the first user and the second user have not encountered each other.

[0058] By using the sound data, even when the first user and the second user are present indoors, underground, etc., the encounter determination unit 5204 can determine that the second user is present near the first client device, i.e., that there is a high possibility that the first user and the second user have encountered each other. In other words, this is particularly useful when the GNSS signal reception environment is poor. By using the sound data and the position information together, the reliability of the determination by the encounter determination unit 5204 can be improved.

[0059] (Determination Example 3) The encounter determination unit 5204 may use image data instead of the first location information and the second location information, or together with the first location information and the second location information. Specifically, the encounter determination unit 5204 analyzes the image data acquired by the first information acquisition unit 5202, and if the analyzed facial image matches a pre-registered facial image of the second user, determines that the second user is present in the vicinity of the first client device owned by the first user. Note that the technology for analyzing images and determining whether facial images match is publicly known, as disclosed in, for example, JP 2022-122098 A.

[0060] In this case, the encounter determination unit 5204 starts a timer as described above, and if the second user is still present in the image captured by the first client device owned by the first user after a certain period of time has elapsed on the timer, it determines that the first user and the second user have encountered each other.

[0061] If at least one of the second users is no longer present in the image captured by the first client device owned by the first user before the timer has elapsed a certain period of time, the encounter determination unit 5204 determines that the first user and the second user have not encountered each other.

[0062] By using image data, it is possible to obtain the same effect as when sound data is used. This is particularly useful when sound data cannot be used due to noise occurring around the user being imaged. By using both location information and image data, the reliability of the determination by the encounter determination unit 5204 can be improved.

[0063] The encounter determination unit 5204 may determine whether the first user and the second user have encountered each other by combining at least two of the first and second location information, sound data, and image data.

[0064] (User Identification Unit 5205) When the first user and the second user encounter each other, the user identification unit 5205 identifies the third user based on the first address information and the second address information.

[0065] Specifically, when the encounter determination unit 5204 determines that the first user and the second user have encountered each other, the user identification unit 5205 compares information identifying one or more people (e.g., names) contained in the first address information acquired by the first information acquisition unit 5202 with information identifying one or more people contained in the second address information acquired by the second information acquisition unit 5203.

[0066] If the comparison results in a match, the person with that name is identified as a mutual friend or acquaintance (third user) of the first and second users, and address information of the third client device owned by the third user included in the first address information or the second address information is obtained. The identified third user may be one or more.

[0067] (Information Transmitting Unit 5206) The information transmitting unit 5206 transmits at least one of the first identification information and the second identification information to the third client device owned by the third user.

[0068] Specifically, the information transmitting unit 5206 transmits at least one of the first location information or the second location information, the sound data collected by the first or second client device, and the image data collected by the first or second client device to the address of the third client device owned by the third user identified by the user identification unit 5205.

[0069] By transmitting the location information, the information transmitting unit 5206 can notify the third client device owned by the third user of the locations where the first user and the second user are located. It is also possible to cause the third client device owned by the third user to display a route from the locations where the first user and the second user are located to the third user's location.

[0070] By transmitting sound data, the information transmission unit 5206 can cause the third client device owned by the third user to play sounds around the location where the first and second users are present, the voices of the first and second users, etc.

[0071] By transmitting image data, the information transmission unit 5206 can display images of the surrounding area where the first and second users are located, the facial expressions of the first and second users, etc. on the third client device owned by the third user.

[0072] Next, the operation of the information processing system 1 will be described. Fig. 5 is a flowchart for explaining the operation of the information processing system. Fig. 6 is an external view of the mobile object 3. Fig. 6 shows a drive recorder DR, a navigation device NE, and the like as examples of the in-vehicle device 30 mounted on the mobile object 3.

[0073] 7 is a diagram showing an example of information transmitted to the server and information transmitted to the user. Fig. 7 shows information transmitted to the server 5 from an in-vehicle device 30 (first client device) provided in a mobile body 3 in which a first user is riding. Fig. 7 also shows information transmitted to the server 5 from an in-vehicle device 30 (second client device) provided in a mobile body 3 in which a second user is riding. Fig. 7 also shows information transmitted from the server 5 to a terminal 2 (third client device) of a third user. The information includes video of the facility in which the user is located, audio collected at the facility, text generated by transcribing the audio, the location of the user, and the like.

[0074] An example of an operation in which a first user and a second user on a moving object 3 encounter each other and transmit information to a third client device owned by a third user will be described below with reference to Fig. 5. The user of the moving object 3 uses specific application software installed on the client device to register his / her own information, such as his / her name and vehicle information, in advance (step S1).

[0075] When the first user and the second user move to their destinations using the mobile unit 3, video data, audio data, location information, etc. are transmitted from the first client device and the second client device owned by the first user and the second user to the server 5 (step S2). As a result, the server 5 acquires the video data, audio data, and location information acquired by the first client device and the second client device (step S3).

[0076] 8 is a diagram showing an example of information displayed on the first and second client devices owned by the first and second users, respectively. Each user of the mobile object 3 can select users with whom they are permitted to share information by using specific application software installed on the client device.

[0077] For example, when a first user wants to share information with a second user, the first user can allow the sharing of information with the second user by pressing an icon (allow / deny button) associated with an image that identifies the second user displayed on the screen.

[0078] When a first user wants to share information with a third user, the first user can allow the third user to share information by pressing an icon (permit / deny button) associated with an image that identifies the third user displayed on the screen. This allows the first user to specify one or more users with whom to share information.

[0079] If the information sharing is not permitted (step S4: NO), the process of step S4 is repeated until the information sharing is permitted. If the information sharing is permitted (step S4: YES), the process of step S5 is executed.

[0080] If the second user has not encountered the first user who is permitted to share information (step S5: NO), the processes from step S3 onward are repeated. If the second user has encountered the first user who is permitted to share information (step S5: YES), the process of step S6 is executed.

[0081] If the common user among one or more users included in each of the first address information and the second address information is not identified as the third user (step S6: NO), the processing from step S3 onward is executed. If the common user is identified as the third user (step S6: YES), the processing of step S7 is executed.

[0082] The server 5 transmits to the third client device of the identified third user at least one of first location information indicating the location of the first client device of the first user, sound data collected by the first client device, and image data collected by the first client device (step S7). Note that, instead of the first location information, second location information indicating the location of the second client device of the second user that encountered the first user may be transmitted.

[0083] FIG. 9 is a diagram showing an example of a map displayed on a third client device of a third user. FIG. 9 shows a map displayed on a third client device owned by a third user who is permitted to share information. The map also shows icons identifying each user who is permitted to share information. Each user's icon is associated with the location where the user is located. If the user is using a mobile object 3, the client device may display a combination of an icon of the mobile object 3 and an icon of the user. When information sharing is permitted, an icon identifying each user is displayed on the screen of each client device, superimposed on the map. This allows the user of each client device to easily check where each user is currently located.

[0084] By the processing of step S7, the server 5 transmits to the third client device owned by the third user, an image of the inside of the facility where the first user is present when the second user encounters the first user. As a result, the third client device displays the image of the facility. Similarly, the server 5 may transmit to the first client device owned by the first user an image of the inside of the facility where the third user is present, causing the first client device to display the image of the facility.

[0085] 10 shows an example of a display on the screen of a third client device owned by a third user. The third client device displays video of the facility where the first and second users are present (top row of FIG. 10), text generated by transcribing audio collected at the facility (middle row of FIG. 10), and the like. The third client device also plays audio collected at the facility. The third client device may also display an image showing the waveform of the audio being played (bottom row of FIG. 10).

[0086] 11 is a diagram showing an example of a route guidance display provided to a third user. After checking the video of the facility where the first and second users are located, the third user taps the icon of the first user displayed on the screen by an app installed on the third client device. As a result, the third client device automatically sets a route from the third user's location to the first user's location.

[0087] The set travel route may be transferred from the third client device to the navigation device, thereby allowing the third user to easily travel to the location of the first user while checking the screen of the navigation device without checking a smartphone or the like.

[0088] (Effect) As described above, the information processing device 52 of this embodiment is configured, when it determines that the first user and the second user have encountered each other based on the first identification information and the second identification information, to identify a third user who is a mutual friend of the first user and the second user, and to transmit at least one of the first identification information and the second identification information to a third client device owned by the third user.

[0089] In contrast, as described above, the conventional technology provides specific information to the third user at a timing a certain time before the first user and the second user actually meet at the destination. Therefore, even if the specific information is provided at that timing, if the first user and the second user's plans change thereafter, the third user may not be able to interact with the first user and the second user.

[0090] In contrast, with the information processing device 52 according to the present embodiment, the above configuration allows the third user to understand the encounter situations of multiple users. For example, the 23rd user can check the situation in which the first user and the second user actually encounter each other, which may increase the motivation to head to a destination to interact with the first user and the like. As a result, it is possible to obtain an effect that not only elderly people living alone but also young people who are socially avoidant (recluses) may have more opportunities to go out.

[0091] Furthermore, according to the information processing device 52 of this embodiment, when the first user and the second user encounter each other, information is automatically sent to the third user, thereby reducing the specific operation of the client device. The specific operation may be, for example, an operation in which either the first user or the second user inputs a message to invite the third user, or an operation to make a phone call. This reduces the burden on the first user and the second user. It also reduces the time and effort required to explain the current location, etc., to the third user.

[0092] Second Embodiment Next, a second embodiment of the present invention will be described. Fig. 12 is a diagram showing an example of the configuration of an information processing device according to the second embodiment. As shown in Fig. 12, the information processing device 52 according to the second embodiment includes a history information acquisition unit 5207 and a transmission destination determination unit 5208 in addition to the functions of the information processing device 52 according to the first embodiment.

[0093] The history information acquisition unit 5207 acquires the out-of-home history of the third user identified by the user identification unit 5205. Specifically, the history information acquisition unit 5207 transmits an out-of-home history transmission request message to the third client device owned by the identified third user. As a result, the third client device extracts out-of-home history of the third user moving to a place other than his / her home from the location information history recorded in the third client device, and transmits the extracted out-of-home history to the server 5. The out-of-home history may include the third user's out-of-home frequency, out-of-home destination, out-of-home date and time, out-of-home means, etc. The out-of-home history may correspond to multiple third users.

[0094] The transmission destination determination unit 5208 identifies a third user who satisfies a specific condition from among a plurality of third users based on the outing history acquired by the history information acquisition unit 5207, and determines the receiving device owned by the identified third user as a transmission destination of at least one of the first identification information and the second identification information. The transmission destination determination unit 5208 also instructs the information transmission unit 5206 to transmit at least one of the first identification information and the second identification information to the determined transmission destination.

[0095] Specifically, when there are multiple identified third users, the destination determination unit 5208 refers to each user's outing history and classifies them into third users who satisfy a specific condition, for example, a frequency of going out less than a specific number of times, and third users who do not satisfy the specific condition, for example, a frequency of going out more than a specific number of times.

[0096] The destination determination unit 5208 determines a third user that satisfies a specific condition as a destination of at least one of the first identification information and the second identification information for a certain period of time. The destination determination unit 5208 instructs the information transmission unit 5206 to transmit information to the determined destination (third user). The information transmission unit 5206 transmits the information to the determined destination (third user).

[0097] This narrows the transmission range to users who go out less frequently, allowing videos and the like to be distributed preferentially to them, thereby reducing the load on the network NW.

[0098] In addition, users who do not go out often may lose motivation to go out if a large number of videos are sent to them, so by sending videos etc. only for a certain period of time (i.e., just enough to pique their interest), it is possible to effectively encourage them to go out.

[0099] On the other hand, the destination determination unit 5208 may set a specific condition that the frequency of going out is equal to or greater than a specific number of times, and determine a third client device owned by a third user who satisfies the specific condition as a destination of at least one of the first identification information and the second identification information for a certain period of time. This allows users who go out frequently to have more opportunities to meet acquaintances.

[0100] 13 is a diagram showing an example of the configuration of an information processing device according to the third embodiment. As shown in Fig. 13, the information processing device 52 according to the third embodiment includes a biometric information acquisition unit 5209 and a transmission destination determination unit 5210 in addition to the functions of the information processing device 52 according to the first embodiment.

[0101] The biometric information acquisition unit 5209 acquires biometric information of the identified third user. Specifically, the biometric information acquisition unit 5209 receives biometric information transmitted (uploaded) from a third client device owned by the third user. The timing of receiving the biometric information may be at regular intervals or at a specific time. The third client device owned by the third user is, for example, a wearable device. The biometric information includes blood pressure, heart rate, body temperature, brain waves, voice, etc. The biometric information may be information that can identify the emotions, psychological state, etc. of the third user, but is not limited to these.

[0102] The destination determination unit 5210 determines a third user who satisfies a specific condition as a destination of at least one of the first identification information and the second identification information, based on the biometric information acquired by the biometric information acquisition unit 5209. The destination determination unit 5210 also instructs the information transmission unit 5206 to transmit at least one of the first identification information and the second identification information to the determined destination.

[0103] For example, if the specific condition is that the heart rate of the third user acquired by the biometric information acquisition unit 5209 is less than a threshold value of 100, the transmission destination determination unit 5210 determines that the emotions of the third user who satisfies the specific condition are stable, and determines the third client device owned by the third user as the destination of at least one of the first identification information and the second identification information. Then, the transmission destination determination unit 5210 transmits an instruction to the information transmission unit 5206 to permit the transmission of information to the third user.

[0104] On the other hand, if the heart rate of the third user acquired by the biometric information acquisition unit 5209 exceeds the threshold value of 100 and does not satisfy the specific condition, the transmission destination determination unit 5210 determines that the third user's emotions are unstable and excludes the third client device owned by the third user from the destinations of at least one of the first identification information and the second identification information. In this case, the transmission destination determination unit 5210 transmits an instruction to the information transmission unit 5206 to not permit transmission of information to the third user.

[0105] In addition, the destination determination unit 5210 may monitor whether the third user's blood pressure is below a threshold, whether the body temperature is normal, etc., and use the results of inferring whether the third user is in an irritated or impatient state as a specific condition, and then instruct whether or not to allow the transmission of information to the third user.

[0106] Furthermore, the transmission destination determination unit 5210 may use as the specific condition the result of estimating the state of the autonomic nervous system (whether the sympathetic nervous system is dominant or the parasympathetic nervous system is dominant) based on the third user's brain waves, etc. Furthermore, the transmission destination determination unit 5210 may use as the specific condition the result of estimating the state of the third user (whether the third user is excited, neutral, irritated, etc.) based on the third user's facial expression, voice intonation, etc.

[0107] By determining whether to send information to the third user by taking into consideration the emotions of the third user, it is possible to provide information about a location where the first user and others gather only to third users who are in a calm state. Therefore, it is possible to send information only to users who are likely to move to the location. This suppresses the transmission of information to third users who are unlikely to move to a location where the first user and others gather, and suppresses an increase in the load on the server 5 and the network NW.

[0108] (Fourth embodiment) In addition to the functions of the information processing device 52 according to the first embodiment, the information processing device 52 according to the fourth embodiment includes a transmission confirmation unit that confirms with the first user or the second user whether or not it is OK to transmit information to a third user, and a transmission instruction unit that instructs the information transmitting unit 5206 to execute transmission if the first user or the second user allows the transmission in response to an inquiry from the transmission confirmation unit.

[0109] The transmission confirmation unit may display a button such as "Send OK" or "Send NO" on the screen of the first client device owned by the first user or the second client device owned by the second user. When the "Send OK" button is pressed, the transmission instruction unit instructs the information sending unit 5206 to execute transmission. Note that the transmission instruction unit may be configured to instruct the information sending unit 5206 to execute transmission by a voice operation such as "Send OK to third user."

[0110] With this configuration, the first user or the second user can set whether to allow transmission before the information transmission unit 5206 transmits information to the third user. In other words, the first user or the second user can limit the transmission targets. Furthermore, compared to when information is always transmitted to the third user, an increase in the load on the server 5 and the network NW can be suppressed.

[0111] The functions of the server 5 shown in the first to fourth embodiments may be provided in either the terminal 2, which is a client device, or the vehicle-mounted device 30. The first to fourth embodiments may be combined with two or more of these.

[0112] (Additional Notes) The information processing device, receiving device, information processing method, or program of the present embodiment may be configured as an information processing device, information processing method, or program shown in the following sections.

[0113] (Clause 1) An information processing device comprising: a first information acquisition unit that acquires first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered in the first transmitting device; a second information acquisition unit that acquires second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered in the second transmitting device; an encounter determination unit that determines whether the first user and the second user have encountered each other based on the first identification information and the second identification information; a user identification unit that, when the first user and the second user encounter each other, identifies a third user based on the first address information and the second address information; and an information transmission unit that transmits at least one of the first identification information and the second identification information to a receiving device owned by the third user.

[0114] (Clause 2) An information processing device as described in Clause 1, comprising a history information acquisition unit that acquires the out-of-home history of the identified third user, and a destination determination unit that identifies a third user who meets specific conditions from among a plurality of third users based on the out-of-home history, and determines the receiving device owned by the identified third user as the destination of at least one of the first identification information and the second identification information, wherein the destination determination unit instructs the information sending unit to send at least one of the first identification information and the second identification information to the determined destination.

[0115] (Clause 3) An information processing device as described in clause 1 or 2, comprising a biometric information acquisition unit that acquires biometric information of the identified third user, and a destination determination unit that determines, based on the biometric information, the receiving device owned by the third user that meets certain conditions as the destination of at least one of the first identification information and the second identification information, wherein the destination determination unit instructs the information sending unit to send at least one of the first identification information and the second identification information to the determined destination.

[0116] (4) A receiving device that receives information from an information processing device, the receiving device receiving from the information processing device at least one of first identification information including first location information indicating the location of a first transmitting device owned by a first user and second identification information including second location information indicating the location of a second transmitting device owned by a second user, and displays information about the first user and the second user on a display unit based on at least one of the first identification information and the second identification information.

[0117] (Clause 5) An information processing method using an information processing device, comprising: acquiring first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered on the first transmitting device; acquiring second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered on the second transmitting device; determining whether the first user and the second user have encountered each other based on the first identification information and the second identification information; if the first user and the second user have encountered each other, identifying a third user based on the first address information and the second address information; and transmitting at least one of the first identification information and the second identification information to a device owned by the third user.

[0118] (Clause 6) A program that causes a computer to execute the following steps: acquire first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered on the first transmitting device; acquire second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered on the second transmitting device; determine whether the first user and the second user have encountered each other based on the first identification information and the second identification information; if the first user and the second user have encountered each other, identify a third user based on the first address information and the second address information; and transmit at least one of the first identification information and the second identification information to a receiving device owned by the third user.

[0119] Although the present embodiment has been described in detail above, it is clear to those skilled in the art that the present embodiment is not limited to the embodiment described herein. The present embodiment can be implemented in modified and altered forms without departing from the spirit and scope of the present embodiment as defined by the claims. Therefore, the description of the present embodiment is intended to be illustrative and does not have any limiting meaning on the present embodiment.

[0120] This application claims priority based on Japanese Patent Application No. 2022-202097, filed with the Japan Patent Office on December 19, 2022, the entire disclosure of which is incorporated herein by reference.

Claims

1. a first information acquisition unit that acquires first identification information including first location information indicating a location of a first transmission device owned by a first user and first address information registered in the first transmission device; a second information acquisition unit that acquires second identification information including second location information indicating a location of a second transmission device owned by a second user and second address information registered in the second transmission device; an encounter determination unit that determines whether or not the first user and the second user have encountered each other based on the first identification information and the second identification information; a user identification unit that identifies a third user based on the first address information and the second address information when the first user and the second user encounter each other; A history information acquisition unit that acquires the out-of-home history of the identified third user; a destination determination unit that identifies a third user who satisfies a specific condition from among a plurality of the third users based on the going-out history, and determines a receiving device owned by the identified third user as a destination of at least one of the first identification information and the second identification information; an information transmitting unit that transmits at least one of the first identification information and the second identification information to the receiving device of the third user determined as the destination; An information processing device comprising:

2. A first information acquisition unit that acquires first identification information including first location information indicating a location of a first transmission device owned by a first user and first address information registered in the first transmission device; a second information acquisition unit that acquires second identification information including second location information indicating a location of a second transmission device owned by a second user and second address information registered in the second transmission device; an encounter determination unit that determines whether or not the first user and the second user have encountered each other based on the first identification information and the second identification information; a user identification unit that identifies a third user based on the first address information and the second address information when the first user and the second user encounter each other; a biometric information acquisition unit that acquires biometric information of the identified third user; a destination determination unit that determines a receiving device owned by a third user that satisfies a specific condition based on the biological information as a destination of at least one of the first identification information and the second identification information; an information transmitting unit that transmits at least one of the first identification information and the second identification information to the receiving device of the third user determined as the destination; An information processing device comprising:

3. A receiving device for receiving information from an information processing device, Acquire an out-of-home history of a third user who operates the receiving device; Transmitting the outing history to the information processing device; When the information processing device determines the receiving device as a transmission destination, the information processing device receives at least one of first identification information including first location information indicating a location of a first transmitting device owned by a first user and second identification information including second location information indicating a location of a second transmitting device owned by a second user, Displaying information about the first user and the second user on a display unit based on at least one of the first identification information and the second identification information Receiving device.

4. An information processing method by an information processing device, comprising: Obtaining first identification information including first location information indicating a location of a first transmitting device owned by a first user and first address information registered in the first transmitting device; acquiring second identification information including second location information indicating a location of a second transmitting device owned by a second user and second address information registered in the second transmitting device; determining whether the first user and the second user have encountered each other based on the first identification information and the second identification information; When the first user and the second user encounter each other, a third user is identified based on the first address information and the second address information; Acquire the out-of-home history of the identified third user; Identifying a third user who satisfies a specific condition from among a plurality of the third users based on the going-out history, and determining a receiving device owned by the identified third user as a transmission destination of at least one of the first identification information and the second identification information; Transmitting at least one of the first identification information and the second identification information to the receiving device owned by the third user determined as the transmission destination. Information processing methods.

5. Obtaining first identification information including first location information indicating a location of a first transmitting device owned by a first user and first address information registered in the first transmitting device; acquiring second identification information including second location information indicating a location of a second transmitting device owned by a second user and second address information registered in the second transmitting device; determining whether the second user has encountered the first user based on the first identification information and the second identification information; When the first user and the second user encounter each other, identifying a third user based on the first address information and the second address information; Acquiring an out-of-home history of the identified third user; Identifying a third user who satisfies a specific condition from among a plurality of the third users based on the going-out history, and determining a receiving device owned by the identified third user as a transmission destination of at least one of the first identification information and the second identification information; Transmitting at least one of the first identification information and the second identification information to the receiving device of the third user determined as the transmission destination; A program that causes a computer to execute the following.