Information processing device, receiving device, information processing method, and program
The information processing system addresses the challenge of timely information sharing among users by determining encounters and transmitting relevant data only when users are at the same destination, enhancing interaction opportunities and motivation, especially for elderly and socially avoidant individuals.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- JVC KENWOOD CORP
- Filing Date
- 2023-10-10
- Publication Date
- 2026-04-21
AI Technical Summary
Conventional systems fail to provide timely and relevant information sharing among users heading to the same destination, leading to decreased motivation for interaction due to potential changes in individual plans, especially affecting elderly and socially avoidant individuals.
An information processing system that determines user encounters based on location, sound, and image data, identifying common acquaintances and transmitting relevant information only when users are confirmed to be at the same destination, using a server to manage and relay data between in-vehicle and terminal devices.
Enhances interaction opportunities by ensuring timely and relevant information sharing, increasing motivation for users to meet, particularly benefiting elderly and socially avoidant individuals, while reducing operational burden and network load.
Smart Images

Figure 0007848895000001 
Figure 0007848895000002 
Figure 0007848895000003
Abstract
Description
Technical Field
[0001] The present disclosure relates to an information processing apparatus, a receiving apparatus, an information processing method, and a program.
Background Art
[0002] Conventionally, there has been known a terminal that provides information regarding a destination and guides a route to the destination so that a user can easily reach the destination.
[0003] Patent Document 1 discloses a technique for providing information that can be shared among a plurality of users heading to the same destination. The conventional technique disclosed in Patent Document 1 acquires information regarding the respective destinations of a plurality of users and matches a plurality of users having a common destination. Then, by sharing information among the matched users, it is possible to provide information that the matched users are interested in. As a result, for example, users who do not know each other and participate in the same tour can share information, so that communication between users can be smoothly performed.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
[0005] However, in the conventional technique, specific information can be provided to users who may be heading to the destination at a timing earlier than when users encounter each other at the destination. Therefore, even if specific information is provided, if the action plan of a specific user changes, other users may not be able to communicate with the specific user. Accordingly, the motivation of other users who were expecting to communicate with a specific user to head to the destination of the specific user may decrease. As a result, there is a problem that the opportunity to go out, such as for elderly people living alone, may decrease.
[0006] Non-limiting embodiments of this disclosure contribute to the provision of an information processing device, an information processing method, and a program capable of understanding the encounter circumstances of multiple users.
[0007] An information processing device according to one embodiment of the present disclosure includes: a first information acquisition unit that acquires first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered in the first transmitting device; a second information acquisition unit that acquires second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered in the second transmitting device; an encounter determination unit that determines whether the first user and the second user have encountered each other based on the first identification information and the second identification information; a user identification unit that identifies a third user based on the first address information and the second address information if the first user and the second user have encountered each other; and an information transmission unit that transmits at least one of the first identification information and the second identification information to a receiving device owned by the third user.
[0008] A receiving device according to one embodiment of the present disclosure is a receiving device that receives information from an information processing device, and receives from the information processing device at least one of first specific information including first location information indicating the location of a first transmitting device owned by a first user and second specific information including second location information indicating the location of a second transmitting device owned by a second user. Based on at least one of the first specific information and the second specific information, information relating to the first user and the second user is displayed on the display unit.
[0009] An information processing method by an information processing device according to one embodiment of the present disclosure acquires first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered in the first transmitting device, acquires second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered in the second transmitting device, determines whether the first user and the second user have encountered each other based on the first identification information and the second identification information, identifies a third user based on the first address information and the second address information if the first user and the second user have encountered each other, and transmits at least one of the first identification information and the second identification information to a receiving device owned by the third user.
[0010] A program according to one embodiment of the present disclosure causes a computer to perform the following actions: acquire first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered in the first transmitting device; acquire second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered in the second transmitting device; determine whether the first user and the second user have encountered each other based on the first identification information and the second identification information; if the first user and the second user have encountered each other, identify a third user based on the first address information and the second address information; and transmit at least one of the first identification information and the second identification information to a receiving device owned by the third user. [Effects of the Invention]
[0011] According to one embodiment of this disclosure, an information processing device, a receiving device, an information processing method, and a program can be provided that can grasp the encounter status of multiple users. [Brief explanation of the drawing]
[0012] [Figure 1] Figure 1 shows an example of the configuration of an information processing system according to the first embodiment. [Figure 2]Figure 2 shows an example of the hardware configuration of an ECU in an in-vehicle device. [Figure 3] Figure 3 shows an example of the configuration of functions in an in-vehicle ECU. [Figure 4] Figure 4 shows an example of the hardware configuration and functional configuration of a server's information processing unit. [Figure 5] Figure 5 is a flowchart illustrating the operation of the information processing system. [Figure 6] Figure 6 is an external view of the mobile unit 3. [Figure 7] Figure 7 shows an example of information sent to the server and information sent to the user. [Figure 8] Figure 8 shows an example of the information displayed on the first and second client devices owned by the first and second users, respectively. [Figure 9] Figure 9 shows an example of a map displayed on a third-party client device owned by a third user. [Figure 10] Figure 10 shows an example of information displayed on a third-user's third-client device. [Figure 11] Figure 11 shows an example of a route guidance display provided to a third user. [Figure 12] Figure 12 shows an example of the configuration of an information processing device according to the second embodiment. [Figure 13] Figure 13 shows an example of the configuration of an information processing device according to the third embodiment. [Modes for carrying out the invention]
[0013] (First Embodiment) Embodiments of the present invention will be described below with reference to the drawings. Figure 1 is a diagram showing an example of the configuration of an information processing system according to the first embodiment.
[0014] The information processing system 1 includes in-vehicle devices 30 mounted on each of a plurality of moving bodies 3, a plurality of terminals 2, and a server 5 capable of communicating with the in-vehicle devices 30 and the terminals 2. The in-vehicle devices 30 and the terminals 2 are also referred to as client devices. The type of the client device may be only one of the in-vehicle devices 30 and the terminals 2. The information processing system 1 is composed of any client device among the plurality of in-vehicle devices 30 and the plurality of terminals 2 and the server 5.
[0015] The moving body 3 is a senior car, a passenger car, a freight car, a motorcycle, etc. Hereinafter, the moving body 3 may be simply referred to as a vehicle.
[0016] The in-vehicle device 30 includes a DCM (Data Communication Module) 31, an ECU (Electronic Control Unit) 32, a GNSS (Global Navigation Sattelite System) module 33, a sound collection device 34, an imaging device 36, a display device 37, etc.
[0017] The DCM 31 is a communication device that communicates bidirectionally with external devices of the vehicle through the communication network NW. The communication network NW is a mobile phone network with a number of base stations at the end, a satellite communication network using communication satellites, etc. The DCM 31 is communicably connected to the ECU 32 through a CAN (Controller Area Network) 38 which is an in-vehicle network. The DCM 31 transmits various information to external devices of the vehicle in response to requests from the ECU 32 and relays the information transmitted from external devices of the vehicle to the ECU 32. The external devices are the server 5, the terminal 2, a V2X (Vehicle to Everything) communication device (not shown), etc. V2X is a communication technology that connects vehicles to various things. V2X includes communications such as V2V (Vehicle to Vehicle), V2P (Vehicle to Pedestrian), V2I (Vehicle to Infrastructure), V2N (Vehicle to Network).
[0018] The ECU32 is an electronic control unit that performs various control processes related to predetermined functions in the vehicle, such as a motor ECU, hybrid ECU, or engine ECU. The ECU32, for example, collects vehicle information and inputs it to the DCM31. Vehicle information includes vehicle position information, image information, sound information, etc. Vehicle information may also include speed information, vehicle status information, etc.
[0019] (Vehicle location information) Vehicle location information is information indicating the current location of a vehicle, for example, information indicating the latitude and longitude of the vehicle. Vehicle location information is transmitted from a GNSS module 33 or the like. The GNSS module 33 receives GNSS signals transmitted from satellites and determines the position of the vehicle on which the GNSS module 33 is installed. The GNSS module 33 is connected to the ECU 32 for communication via CAN 38, and the vehicle location information is transmitted to the ECU 32. The GNSS module 33 may include those installed in a car navigation system, those installed in a drive recorder, those installed in the vehicle itself, and those installed in a terminal 2 owned by the user. Hereafter, vehicle location information may be simply referred to as location information.
[0020] (Image information) The imaging information is information that indicates the content of the image captured by the imaging device 36. The imaging information includes time information indicating the time when the image was generated. The imaging device 36 is a camera equipped with an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor).
[0021] The imaging device 36 includes an internal imaging device for imaging the interior of the vehicle, an external imaging device for imaging the exterior of the vehicle, and so on. The imaging device 36 may also include a camera equipped in a drive recorder, a camera mounted on the vehicle itself, a camera equipped in a terminal 2 owned by the user, and so on.
[0022] The interior imaging device is positioned to capture images of the occupants' faces and other features. The interior imaging device is not limited to one; multiple devices may be installed within the vehicle. The interior imaging device outputs imaging information indicating the captured interior image.
[0023] External imaging devices include front cameras, rear cameras, omnidirectional cameras, and panoramic cameras that capture the scenery around the vehicle. The scenery around the vehicle includes, for example, the scenery in front of the vehicle, the scenery to the side of the vehicle (driver's side door side or passenger side door side), and the scenery behind the vehicle. The scenery includes, for example, the scenery of the user's destination on terminal 2 (e.g., a meeting hall, a park), the road on which the vehicle is traveling, objects on the road, the sidewalk facing the road, and objects on the sidewalk. The external imaging device is positioned, for example, to capture the scenery outside the vehicle. The external imaging device outputs imaging information indicating the captured image of the outside of the vehicle.
[0024] (Audio information) The sound information may include the voice (speech) of the first user collected by the sound collection device 34, sounds around the first user, etc. The sound collection device 34 may include a microphone provided by a car navigation system, a microphone provided by a drive recorder, a microphone mounted on the vehicle itself, a microphone provided by a terminal 2 owned by the user, etc.
[0025] The display device 37 is an LCD display or the like. The display device 37 may include those installed in a car navigation system, those installed in a drive recorder, those mounted on the vehicle itself, and those installed in a terminal 2 owned by the user.
[0026] Server 5 is a server that provides various services by collecting information from multiple vehicles and transmitting (distributing) that information to the occupants of multiple vehicles. Server 5 may also be a server that provides various services by collecting information from terminals 2 held by the occupants of multiple vehicles, or from in-vehicle devices 30 installed in multiple vehicles, and transmitting (distributing) that information to terminals 2 held by the occupants of other vehicles, or to in-vehicle devices 30 installed in other vehicles.
[0027] Various services include information transfer services. Information transfer services may include, for example, transferring video data, audio data, location information, etc., collected by a specific terminal 2 or in-vehicle device 30 to another terminal 2 or another in-vehicle device 30. Various services are not limited to information transfer services and may include car sharing services, authentication key services, trunk delivery services, B2C car sharing services, advertising distribution services, etc.
[0028] Server 5 comprises a communication device 51 and an information processing device 52. The communication device 51 is a communication device that, under the control of the information processing device 52, communicates bidirectionally with each of the multiple in-vehicle units 30 or multiple terminals 2 via a communication network NW. The information processing device 52 executes various control processes in Server 5. The information processing device 52 is composed of a server computer, including, for example, a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), auxiliary storage device, input / output interface, etc.
[0029] Next, with reference to Figure 2, the hardware configuration of the ECU 32 of the in-vehicle unit 30 will be described. Figure 2 is a diagram showing an example of the hardware configuration of the ECU 32 of the in-vehicle unit 30. The ECU 32 comprises an auxiliary storage device 32A, a memory device 32B, a CPU 32C, and an interface device 32D. These are connected to each other by a bus line 32E.
[0030] The auxiliary storage device 32A is a hard disk drive (HDD), flash memory, etc., that stores files and data necessary for processing by the ECU 32. The memory device 32B reads the program from the auxiliary storage device 32A and stores it when a program startup command is received. The CPU 32C executes the program stored in the memory device 32B and realizes various functions of the ECU 32 according to the program. The interface device 32D is an interface that connects the CPU 32C to the DCM 31 via CAN 38, and also connects the imaging device 36, etc., to the DCM 31 via CAN 38.
[0031] Next, the functions of the ECU 32 of the in-vehicle unit 30 will be explained with reference to Figure 3. Figure 3 is a diagram showing an example of the configuration of the functions of the ECU 32 of the in-vehicle unit 30.
[0032] The CPU 32C of the ECU 32 includes a vehicle information transmission / reception unit 321, an image information management unit 322, and a display control unit 323.
[0033] The vehicle information transmission / reception unit 321 has the function of transmitting the aforementioned vehicle location information, image information, sound information, etc., as vehicle information to the server 5, and the function of receiving information from the server 5.
[0034] The imaging information management unit 322 processes the imaging information transmitted from the imaging device 36 by inputting it for a certain period of time and embedding time and vehicle position information into the imaging information. The display control unit 323 processes the display by displaying a map (map) including the vehicle's current position on the display and displaying the exterior scenery captured by the camera on the display.
[0035] Next, Figure 4 will be used to explain an example of the hardware configuration of the server's information processing unit. Figure 4 is a diagram showing an example of the hardware configuration and functional configuration of the server's information processing unit. The information processing unit 52 includes a CPU 520 and a storage unit (not shown).
[0036] The CPU 520 includes a communication processing unit 5201, a first information acquisition unit 5202, a second information acquisition unit 5203, an encounter determination unit 5204, a user identification unit 5205, and an information transmission unit 5206.
[0037] The communication processing unit 5201 transmits and receives signals between each of the multiple in-vehicle units 30 and / or the multiple terminals 2. Specifically, the communication processing unit 5201 transmits and receives Protocol Data Units (PDUs) and Service Data Units (SDUs).
[0038] (1st information acquisition unit 5202) The first information acquisition unit 5202 acquires, as first information, first identification information that identifies the first user and first address information that is registered in the terminal 2 owned by the first user or in the in-vehicle device 30 installed in the vehicle in which the first user is riding. The terminal 2 owned by the first user or the in-vehicle device 30 installed in the vehicle in which the first user is riding is also referred to as the first client device (first transmitting device) owned by the first user. The first information acquisition unit 5202 may also acquire first address information stored in the storage unit (not shown) installed in the server 5.
[0039] Specifically, the first information acquisition unit 5202 acquires first location information indicating the location of the first client device as first identification information for identifying the first user. The first location information is information indicating the current location of the first client device, for example, information indicating the latitude and longitude of the vehicle being traveled. The first location information is transmitted from the GNSS module 33 or the like installed in the first client device. The first information acquisition unit 5202 also acquires sound data collected by the first client device as first identification information for identifying the first user. The first information acquisition unit 5202 also acquires image data collected by the first client device as first identification information for identifying the first user.
[0040] By acquiring location information, server 5 can determine the approximate location of the first user, such as a meeting place where they are meeting friends or an event venue where they are attending with friends, and transmit the determined location to terminal 2 owned by a specific user (e.g., third user) who is an acquaintance of the first user, or to an in-vehicle device 30 in which the third user is present. Terminal 2 owned by the third user or an in-vehicle device 30 in the vehicle in which the third user is riding is also referred to as a third client device (receiving device) owned by the third user.
[0041] The sound data includes the voice (speech) of the first user, sounds from the first user's surroundings, etc. The sound data is not limited to data collected by the first user's first client device, but may also be collected by a drive recorder or a sound-collecting device other than the in-vehicle unit 30 installed in the vehicle itself. By acquiring the sound data, the server 5 can transmit the first user's voice, conversations between the first user and their friends (e.g., the second user), sounds collected at the venue of an event the first user is attending, etc., to a third client device owned by a specific user (e.g., the third user) who is an acquaintance of the first user.
[0042] Image data includes images of the first user, landscape images including the first user, and landscape images surrounding the first user. Image data is not limited to data collected by the first client device owned by the first user, but may also be collected by an imaging device other than a drive recorder in the vehicle in which the first user is riding or an in-vehicle device 30 mounted on the vehicle itself.
[0043] The first address information is information that identifies one or more people (such as name, telephone number, and address) recorded in an address book pre-registered on the first client device owned by the first user. The first address information may also be address information managed by the server 5 as information relating to the first user. The first address information may also be address information stored in a storage unit (not shown) provided by the server 5, which has been pre-registered by the first user, the second user, the third user, or any other third party.
[0044] (Second information acquisition unit 5203) The second information acquisition unit 5203 acquires, as second information, second identification information that identifies the second user and second address information registered in the terminal 2 owned by the second user or in the in-vehicle device 30 installed in the vehicle in which the second user is riding. The terminal 2 owned by the second user or the in-vehicle device 30 installed in the vehicle in which the second user is riding is also referred to as the second client device (second transmission device) owned by the second user. The second information acquisition unit 5203 may also acquire second address information stored in the storage unit (not shown) installed in the server 5.
[0045] Specifically, similar to the first information acquisition unit 5202, the second information acquisition unit 5203 acquires second identification information for identifying the second user, such as second location information indicating the location of the second client device, sound data collected by the second client device, and image data collected by the terminal 2.
[0046] By acquiring location information, server 5 can determine the approximate location of the second user, such as a meeting place where they are meeting friends or an event venue where they are attending with friends, and notify a third client device owned by a specific user (e.g., a third user) who is an acquaintance of the second user.
[0047] The sound data includes the voice (speech) of the second user, sounds from the second user's surroundings, etc. The sound data is not limited to data collected by the second client device owned by the second user, but may also be collected by sound-collecting devices other than the in-vehicle device 30 installed in the vehicle the second user is riding in. By acquiring sound data, the server 5 can notify a third client device owned by a specific user (e.g., the third user) who is an acquaintance of the second user of the second user's voice, conversations between the second user and their friends (e.g., the first user), sounds collected at the venue of an event the second user is attending, etc.
[0048] Image data includes images of the second user, landscape images including the second user, and landscape images surrounding the second user. The image data is not limited to data collected by the second client device owned by the second user, but may also be collected by an imaging device other than a drive recorder or an in-vehicle device 30 installed in the vehicle in which the second user is riding.
[0049] The second address information is information that identifies one or more people (such as name, telephone number, and address) recorded in an address book pre-registered on the second client device owned by the second user. The second address information may also be address information managed by the server 5 as information relating to the second user. The second address information may also be address information stored in a storage unit (not shown) provided by the server 5, which has been pre-registered by the first user, the second user, the third user, or any other third party.
[0050] (Encounter Judgment Department 5204) The encounter determination unit 5204 determines whether the first user and the second user have encountered each other based on the first identification information and the second identification information.
[0051] (Example of judgment 1) Specifically, the encounter determination unit 5204 determines, based on first and second location information indicating the locations of the first and second client devices owned by the first and second users respectively, whether the distance between the first user's location, acquired by the first information acquisition unit 5202, and the second user's location, acquired by the second information acquisition unit 5203, is shorter than a specific distance.
[0052] The specific distance can be, for example, 5m, 10m, or 30m. The specific distance may be automatically set to a value appropriate to the user's location, or it may be set to a value of any choice by the user. If the encounter detection unit 5204 determines that the distance from the first user to the second user is shorter than the specific distance, it starts a timer and determines whether the distance is still shorter than the specific distance after a certain period of time has elapsed.
[0053] The encounter detection unit 5204 determines that the first and second users have encountered each other at their common destination if the distance is shorter than a specific distance even after a certain period of time has elapsed. This makes it possible to transmit specific information to the third user only when the first and second users are gathered at a specific destination for the same purpose, that is, excluding situations such as the first user accidentally passing the second user on the road. Details of the specific information transmitted to the third user will be described later.
[0054] The encounter determination unit 5204 determines that the first user and the second user have not encountered each other if the distance between them exceeds a specific distance before the timer has elapsed for a certain period of time. For example, if the first user and the second user happen to meet at a specific location, the first user may move away from the second user before the timer has elapsed for a certain period of time, causing the distance between the first user and the second user to exceed the specific distance. In this way, if the distance exceeds the specific distance before the timer has elapsed for a certain period of time, the unit determines that the first user and the second user have not encountered each other at their common destination. This prevents the transmission of specific information to the third user if the first user and the second user are not gathered at a specific destination for the same purpose. This suppresses the transmission of unnecessary information and prevents an increase in the load on the server 5 and the network NW.
[0055] (Example of judgment 2) The encounter determination unit 5204 may use sound data instead of, or together with, the first and second location information. Specifically, the encounter determination unit 5204 analyzes the voice contained in the sound data acquired by the first information acquisition unit 5202, and if the analyzed voice matches the voice of a second user that has been registered in advance, it determines that the second user is present around the first client device owned by the first user at a common destination for the first and second users. The technology for analyzing voice and determining voice match is publicly known, as disclosed, for example, in Japanese Patent Application Publication No. 2001-338069.
[0056] In this case, the encounter determination unit 5204 starts the timer as described above, and if the analyzed voice matches the voice of the second user that was registered in advance even after the timer has elapsed for a certain period of time, it determines that the second user is in the vicinity of the first client device owned by the first user, that is, the first user and the second user have encountered each other.
[0057] If the voice of at least one of the second users is no longer extracted before the timer has elapsed for a certain period of time, the encounter determination unit 5204 determines that the first user and the second user have not encountered each other.
[0058] By utilizing sound data, even when the first and second users are located indoors or underground, the encounter determination unit 5204 can determine that the second user is near the first client device, meaning there is a high probability that the first and second users have encountered each other. In other words, it is particularly useful when the GNSS signal reception environment is poor. By using sound data and location information in combination, the reliability of the determination made by the encounter determination unit 5204 can be improved.
[0059] (Example of judgment 3) The encounter determination unit 5204 may use image data instead of, or together with, the first and second location information. Specifically, the encounter determination unit 5204 analyzes the image data acquired by the first information acquisition unit 5202, and if the analyzed face image matches a face image of a second user that has been registered in advance, it determines that the second user is present around the first client device owned by the first user. The technology for analyzing images and determining the match of face images is publicly known, as disclosed, for example, in Japanese Patent Application Publication No. 2022-122098.
[0060] In this case, the encounter determination unit 5204 starts the timer as described above, and if the second user is still present in the image captured by the first client device owned by the first user after a certain period of time has elapsed, it determines that the first user and the second user have encountered each other.
[0061] If, before the timer has elapsed for a certain period of time, at least one of the second users is no longer present in the image captured by the first client device owned by the first user, the encounter determination unit 5204 determines that the first user and the second user have not encountered each other.
[0062] By using image data, the same effect as using sound data can be obtained. This is particularly useful when sound data cannot be used due to noise or other factors occurring around the user being imaged. By using location information and image data together, the reliability of the encounter detection unit 5204's determination can be improved.
[0063] The encounter determination unit 5204 may also determine whether the first user and the second user have encountered each other by combining the first and second location information, sound data, and image data, at least two of these.
[0064] (User identification unit 5205) The user identification unit 5205 identifies a third user based on the first address information and the second address information when the first user and the second user encounter each other.
[0065] Specifically, if the encounter determination unit 5204 determines that the first user and the second user have encountered each other, the user identification unit 5205 compares the information identifying one or more people (e.g., names) contained in the first address information obtained by the first information acquisition unit 5202 with the information identifying one or more people contained in the second address information obtained by the second information acquisition unit 5203.
[0066] If the comparison reveals a matching name, the person with that name is identified as a friend or acquaintance (third user) common to both the first and second users, and the address information of the third client device owned by the third user included in the first or second address information is obtained. The identified third user may be one person or multiple people.
[0067] (Information transmission unit 5206) The information transmission unit 5206 transmits at least one of the first specific information and the second specific information to the third client device owned by the third user.
[0068] Specifically, the information transmission unit 5206 transmits at least one of the following to the address of the third client device owned by the third user identified by the user identification unit 5205: first location information or second location information, sound data collected by the first or second client device, and image data collected by the first or second client device.
[0069] By transmitting location information, the information transmission unit 5206 can inform the third user's third client device of the locations where the first and second users are located. It is also possible to display the route from the locations of the first and second users to the third user's location on the third user's third client device.
[0070] By transmitting sound data, the information transmission unit 5206 can cause the third user's third client device to reproduce sounds from the surrounding area where the first and second users are located, as well as the voices of the first and second users.
[0071] By transmitting image data, the information transmission unit 5206 can display images of the surrounding area where the first and second users are located, as well as the facial expressions of the first and second users, on a third client device owned by the third user.
[0072] Next, the operation of the information processing system 1 will be explained. Figure 5 is a flowchart illustrating the operation of the information processing system. Figure 6 is an external view of the mobile unit 3. Figure 6 shows an example of an in-vehicle device 30 mounted on the mobile unit 3, such as a drive recorder DR and a navigation system NE.
[0073] Figure 7 shows an example of information sent to the server and information sent to the user. Figure 7 shows information sent from the in-vehicle device 30 (first client device) of the mobile vehicle 3 carrying the first user to the server 5. Figure 7 also shows information sent from the in-vehicle device 30 (second client device) of the mobile vehicle 3 carrying the second user to the server 5. Furthermore, Figure 7 shows information sent from the server 5 to the terminal 2 (third client device) of the third user. This information includes video footage from the facility where the user is located, audio collected at the facility, text generated by transcribing the audio, and the user's location.
[0074] The following describes an example of operation when the first and second users, who are on board the mobile vehicle 3, encounter each other and transmit information to a third client device owned by the third user, with reference to Figure 5. The user of the mobile vehicle 3 pre-registers their own information, such as their name and vehicle information, using specific application software installed on the client device (Step S1).
[0075] When the first user and the second user move to their destination using the mobile device 3, video data, sound data, location information, etc. are transmitted from the first client device and the second client device owned by the first user and the second user to the server 5 (step S2). As a result, the server 5 acquires the video data, sound data, and location information acquired by the first client device and the second client device (step S3).
[0076] Figure 8 shows an example of the information displayed on the first and second client devices, respectively, owned by the first and second users. Each user of Mobile Unit 3 can select which users they are permitted to share information with using specific application software installed on their client device.
[0077] For example, if the first user wants to share information with the second user, they can grant permission to share information with the second user by pressing the icon (allow / deny button) associated with the image identifying the second user displayed on the screen.
[0078] When the first user shares information with a third user, they can grant permission to share information with the third user by pressing the icon (allow / deny button) associated with the image identifying the third user displayed on the screen. This allows the user to specify one or more users with whom they can share information.
[0079] If information sharing is not permitted (Step S4: NO), the process in Step S4 is repeated until permission is granted. If information sharing is permitted (Step S4: YES), the process in Step S5 is executed.
[0080] If the second user does not encounter the first user who has been authorized to share information (Step S5: NO), the process from Step S3 onwards is repeated. If the second user encounters the first user who has been authorized to share information (Step S5: YES), the process in Step S6 is executed.
[0081] If, among the one or more users included in the first address information and the second address information, a common user is not identified as the third user (step S6: NO), the processing from step S3 onwards is executed. If a common user is identified as the third user (step S6: YES), the processing in step S7 is executed.
[0082] Server 5 transmits to the third client device owned by the identified third user at least one of the following to the third client device owned by the first user: first location information indicating the location of the first client device owned by the first user, sound data collected by the first client device, and image data collected by the first client device (step S7). In addition, instead of the first location information, etc., second location information indicating the location of the second client device owned by the second user who encountered the first user may be transmitted.
[0083] Figure 9 shows an example of a map displayed on a third user's third client device. Figure 9 shows the map displayed on a third client device owned by a third user who has been granted permission to share information. The map also displays icons identifying each user who has been granted permission to share information. Each user's icon corresponds to their location. If a user is using mobile device 3, the client device may display a combination of the mobile device 3 icon and the user's icon. Once information sharing is permitted, each client device's screen displays icons identifying each user overlaid on the map. This allows users of each client device to easily see where each user is currently located.
[0084] In step S7, the server 5 transmits video footage of the facility where the first user is located to the third client device owned by the third user, in the event that the second user encounters the first user. As a result, the third client device displays the video footage of the facility. Similarly, the server 5 may transmit video footage of the facility where the third user is located to the first client device owned by the first user, so that the first client device displays the video footage of the facility.
[0085] Figure 10 shows an example of the screen display of a third client device owned by a third user. The third client device displays video of the facility where the first and second users are located (top of Figure 10), text generated by transcribing audio collected at the facility (middle of Figure 10), etc. The third client device also plays back the audio collected at the facility. The third client device may also display an image showing the waveform of the sound being played (bottom of Figure 10).
[0086] Figure 11 shows an example of a route guidance display provided to a third user. After viewing video footage of the facility where the first and second users are located, the third user taps the first user's icon displayed on the screen by an application installed on the third client device. As a result, the third client device automatically sets a travel route from the third user's location to the first user's location.
[0087] The configured travel route may be transferred from the third client device to the navigation device. This allows the third user to easily travel to the location of the first user by checking the navigation device screen without having to look at their smartphone or other device.
[0088] (effect) As described above, the information processing device 52 according to this embodiment is configured to identify a third user, such as a mutual friend of the first and second users, when it determines that the first user and the second user have encountered each other, based on the first and second identification information, and to transmit at least one of the first and second identification information to the third client device owned by the third user.
[0089] In contrast, conventional technology, as mentioned above, provides specific information to the third user at a certain time before the first and second users actually meet at their destination. Therefore, even if specific information is provided at that time, if the first and second users' plans change afterward, the third user may not be able to interact with them.
[0090] In contrast, according to the information processing device 52 of this embodiment, the above configuration allows a third user to grasp the encounter status of multiple users. For example, a 23rd user can confirm the situation in which the 1st and 2nd users are actually encountering each other, which may increase their motivation to head to their destination in order to interact with the 1st user and others. As a result, it is possible to obtain the effect that opportunities for going out will increase not only for elderly people living alone, but also for young people who are socially avoidant (hikikomori).
[0091] Furthermore, according to the information processing device 52 of this embodiment, information is automatically transmitted to the third user when the first and second users encounter each other, thus reducing the need for specific operations on the client device. Specific operations include, for example, the operation of either the first or second user entering a message to invite the third user, or the operation of making a phone call. This reduces the burden on the first and second users. It also reduces the time and effort required to explain the current location and other details to the third user.
[0092] (Second Embodiment) Next, a second embodiment of the present invention will be described. Figure 12 is a diagram showing an example of the configuration of an information processing device according to the second embodiment. As shown in Figure 12, the information processing device 52 according to the second embodiment includes, in addition to the functions of the information processing device 52 according to the first embodiment, a history information acquisition unit 5207 and a transmission destination determination unit 5208.
[0093] The history information acquisition unit 5207 acquires the outing history of the third user identified by the user identification unit 5205. Specifically, the history information acquisition unit 5207 sends an outing history transmission request message to the third client device owned by the identified third user. As a result, the third client device extracts the outing history of the third user's travel to a location other than their home from the location information history recorded in the third client device and sends it to the server 5. The outing history may include the third user's frequency of going out, destination, date and time of going out, and means of transportation. The outing history may correspond to multiple third users.
[0094] The destination determination unit 5208 identifies a third user who meets specific conditions from among multiple third users based on the outing history acquired by the history information acquisition unit 5207, and determines the receiving device owned by the identified third user as the destination for at least one of the first specific information and the second specific information. The destination determination unit 5208 also instructs the information transmission unit 5206 to transmit at least one of the first specific information and the second specific information to the determined destination.
[0095] Specifically, if there are multiple identified third users, the destination determination unit 5208 refers to each user's outing history and classifies them into, for example, third users who meet the specific condition (e.g., if their outing frequency is less than a certain number of times) and third users who do not meet the specific condition (e.g., if their outing frequency is greater than or equal to a certain number of times).
[0096] The destination determination unit 5208 determines a third user who meets specific conditions as the destination for at least one of the first specific information and the second specific information for a certain period of time. The destination determination unit 5208 instructs the information transmission unit 5206 to transmit the information to the determined destination (third user). The information transmission unit 5206 transmits the information to the determined destination (third user).
[0097] This allows for prioritizing the delivery of video and other content to users who are infrequently away from home, thereby reducing the load on the network.
[0098] Furthermore, users who do not go out often may lose their motivation to go out if they are bombarded with too many videos. Therefore, sending videos and other content only for a limited period (i.e., just enough to pique their interest) can effectively encourage them to go out.
[0099] On the other hand, the destination determination unit 5208 may, using the condition that the frequency of going out exceeds a certain number of times, determine a third client device owned by a third user that satisfies the specific condition as the destination for at least one of the first specific information and the second specific information for a certain period of time. This allows users who go out frequently to increase their opportunities to meet acquaintances.
[0100] (Third embodiment) Figure 13 shows an example of the configuration of an information processing device according to the third embodiment. As shown in Figure 13, the information processing device 52 according to the third embodiment includes, in addition to the functions of the information processing device 52 according to the first embodiment, a biometric information acquisition unit 5209 and a transmission destination determination unit 5210.
[0101] The biometric information acquisition unit 5209 acquires biometric information of the identified third user. Specifically, the biometric information acquisition unit 5209 receives biometric information transmitted (uploaded) from a third client device owned by the third user. The timing of receiving biometric information may be at regular intervals or at a specific time. The third client device owned by the third user may be, for example, a wearable device. The biometric information includes blood pressure, heart rate, body temperature, brain waves, voice, etc. The biometric information may be any information that can identify the third user's emotions, psychological state, etc., and is not limited to these.
[0102] The destination determination unit 5210 determines a third user who meets specific conditions, based on the biometric information acquired by the biometric information acquisition unit 5209, as the destination for at least one of the first specific information and the second specific information. The destination determination unit 5210 also instructs the information transmission unit 5206 to transmit at least one of the first specific information and the second specific information to the determined destination.
[0103] For example, if the specific condition is that the heart rate of the third user acquired by the biometric information acquisition unit 5209 is less than a threshold of 100, the destination determination unit 5210 determines that the emotions of the third user who meets the specific condition are stable, and determines the third client device owned by the third user as the destination for at least one of the first specific information and the second specific information. The destination determination unit 5210 then sends an instruction to the information transmission unit 5206 to authorize the transmission of information to the third user.
[0104] On the other hand, if the heart rate of the third user acquired by the biometric information acquisition unit 5209 exceeds the threshold of 100 and does not meet the specific conditions, the destination determination unit 5210 determines that the third user's emotions are unstable and excludes the third client device owned by the third user from the destinations of at least one of the first specific information and the second specific information. In this case, the destination determination unit 5210 sends an instruction to the information transmission unit 5206 to deny permission to transmit information to the third user.
[0105] In addition, the destination determination unit 5210 may monitor whether the third user's blood pressure is below a threshold, whether their body temperature is within the normal range, etc., and use the results of this estimation to determine whether the third user is irritated or anxious as specific conditions, and then instruct whether to permit or deny the transmission of information to the third user.
[0106] Furthermore, the destination determination unit 5210 may use the results of its estimation of the state of the autonomic nervous system (whether the sympathetic nervous system is dominant or the parasympathetic nervous system is dominant) based on the third user's brainwaves, etc., as a specific condition. Alternatively, the destination determination unit 5210 may use the results of its estimation of the third user's state (excited, normal, irritated, etc.) based on their facial expression, voice intonation, etc., as a specific condition.
[0107] By considering the emotions of third users and deciding whether or not to send information to them, it is possible to provide information about locations where first users and others gather only to third users who are in a calm state. Therefore, it is possible to send information only to users who are likely to move to that location. This suppresses the sending of information to third users who are unlikely to move to locations where first users and others gather, thereby preventing an increase in the load on server 5 and network NW.
[0108] (Fourth Embodiment) The information processing device 52 according to the fourth embodiment includes, in addition to the functions of the information processing device 52 according to the first embodiment, a transmission confirmation unit that confirms with the first user or second user whether or not it is permissible to transmit information to the third user, and a transmission instruction unit that, in response to an inquiry from the transmission confirmation unit, instructs the information transmission unit 5206 to execute the transmission if the first user or second user permits the transmission.
[0109] The transmission confirmation unit may display buttons such as "Transmit OK" or "Transmit NO" on the screen of the first client device owned by the first user or the second client device owned by the second user. When the "Transmit OK" button is pressed, the transmission instruction unit instructs the information transmission unit 5206 to execute the transmission. The transmission instruction unit may also be configured to instruct the information transmission unit 5206 to execute the transmission based on voice commands such as "Transmit OK to the third user."
[0110] This configuration allows the first or second user to set whether or not to allow the information transmission unit 5206 to transmit information to the third user before it is transmitted. In other words, the first or second user can restrict who receives the information. Furthermore, it helps to suppress the increase in load on the server 5 and the network NW compared to when information is always transmitted to the third user.
[0111] The functions of the server 5 shown in Embodiments 1 to 4 may be provided in either the client device, terminal 2, or the in-vehicle unit 30. Furthermore, two or more of Embodiments 1 to 4 may be combined.
[0112] (Note) The information processing device, receiving device, information processing method, or program of this embodiment may be configured as the information processing device, information processing method, or program described in the following sections.
[0113] (Clause 1) An information processing device comprising: a first information acquisition unit that acquires first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered in the first transmitting device; a second information acquisition unit that acquires second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered in the second transmitting device; an encounter determination unit that determines whether the first user and the second user have encountered each other based on the first identification information and the second identification information; a user identification unit that identifies a third user based on the first address information and the second address information if the first user and the second user have encountered each other; and an information transmission unit that transmits at least one of the first identification information and the second identification information to a receiving device owned by the third user.
[0114] (Clause 2) The information processing device according to paragraph 1, comprising: a history information acquisition unit that acquires the outing history of the identified third user; and a destination determination unit that, based on the outing history, identifies a third user who satisfies specific conditions from among a plurality of third users, and determines the receiving device owned by the identified third user as the destination for at least one of the first identification information and the second identification information, wherein the destination determination unit instructs the information transmission unit to transmit at least one of the first identification information and the second identification information to the determined destination.
[0115] (Clause 3) The information processing apparatus according to paragraph 1 or 2, comprising: a biometric information acquisition unit that acquires biometric information of the identified third user; and a destination determination unit that determines, based on the biometric information, a receiving device owned by the third user that satisfies specific conditions as the destination for at least one of the first identified information and the second identified information, wherein the destination determination unit instructs the information transmission unit to transmit at least one of the first identified information and the second identified information to the determined destination.
[0116] (Clause 4) A receiving device that receives information from an information processing device, which receives from the information processing device at least one of first specific information including first location information indicating the location of a first transmitting device owned by a first user and second specific information including second location information indicating the location of a second transmitting device owned by a second user, and displays information relating to the first user and the second user on a display unit based on at least one of the first specific information and the second specific information.
[0117] (Clause 5) An information processing method using an information processing device, comprising: acquiring first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered in the first transmitting device; acquiring second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered in the second transmitting device; determining whether the first user and the second user have encountered each other based on the first identification information and the second identification information; if the first user and the second user have encountered each other, identifying a third user based on the first address information and the second address information; and transmitting at least one of the first identification information and the second identification information to the device owned by the third user.
[0118] (Clause 6) A program that causes a computer to perform the following actions: obtain first identification information including first location information indicating the location of a first transmitting device owned by a first user and first address information registered in the first transmitting device; obtain second identification information including second location information indicating the location of a second transmitting device owned by a second user and second address information registered in the second transmitting device; determine whether the first user and the second user have encountered each other based on the first identification information and the second identification information; if the first user and the second user have encountered each other, identify a third user based on the first address information and the second address information; and transmit at least one of the first identification information and the second identification information to a receiving device owned by the third user.
[0119] Although this embodiment has been described in detail above, it will be clear to those skilled in the art that this embodiment is not limited to the embodiments described herein. This embodiment can be implemented as a modified and altered form without departing from the spirit and scope of this embodiment as defined by the claims. Therefore, the description of this embodiment is for illustrative purposes only and is not intended to be restrictive in any way.
[0120] This application claims priority based on Japanese Patent Application No. 2022-202097, filed with the Japan Patent Office on 19 December 2022, all of which are incorporated herein by reference.
Claims
1. A first information acquisition unit acquires first specific information, which includes first location information indicating the current location of the first transmitting device owned by the first user, and first address information, which is information from a first address book pre-registered in the first transmitting device. A second information acquisition unit acquires second identification information, which includes second location information indicating the current location of the second transmitting device owned by the second user, and second address information, which is information from the second address book pre-registered in the second transmitting device. An encounter determination unit determines that the first user and the second user have encountered each other if the time for which the distance between the first location information and the second location information is less than a predetermined distance is longer than a predetermined time, When the first user and the second user encounter each other, a user identification unit identifies one or more third users who are common users among the multiple users included in the first address information and the second address information, A history information acquisition unit that receives outing history, including frequency of going out, which is extracted from the location information history recorded in the receiving device owned by the identified third user, showing the history of the third user moving to a location other than their home, A destination determination unit that determines a third user to be the recipient from among one or more of the aforementioned third users based on the frequency of going out, An information transmission unit that transmits at least one of the first specific information and the second specific information to the receiving device owned by the third user determined as the recipient, An information processing device equipped with the following features.
2. A first information acquisition unit acquires first specific information, which includes first location information indicating the current location of the first transmitting device owned by the first user, and first address information, which is information from a first address book pre-registered in the first transmitting device. A second information acquisition unit acquires second identification information, which includes second location information indicating the current location of the second transmitting device owned by the second user, and second address information, which is information from the second address book pre-registered in the second transmitting device. An encounter determination unit determines that the first user and the second user have encountered each other if the time for which the distance between the first location information and the second location information is shorter than a predetermined distance is longer than a predetermined time, When the first user and the second user encounter each other, a user identification unit identifies one or more third users who are common users among the multiple users included in the first address information and the second address information, A biometric information acquisition unit that receives biometric information transmitted from a receiving device owned by the identified third user, A destination determination unit that determines a third user to be the recipient from among one or more third users based on the result of inferring the state of the third user from the biometric information, An information transmission unit that transmits at least one of the first specific information and the second specific information to the receiving device owned by the third user determined as the recipient, An information processing device equipped with the following features.
3. A computer-based information processing method, The system acquires first specific information, which includes first location information indicating the current location of the first transmitting device owned by the first user, and first address information, which is information from a first address book pre-registered in the first transmitting device. The system acquires second identification information, which includes second location information indicating the current location of the second transmitting device owned by the second user, and second address information, which is information from the second address book pre-registered in the second transmitting device. If the distance between the first location information and the second location information is less than a predetermined distance for a predetermined period of time or longer, it is determined that the first user and the second user have encountered each other. When the first user and the second user encounter each other, one or more third users who are common to each other are identified from among the multiple users included in the first address information and the second address information, From the location information history recorded in the receiving device owned by the identified third user, the history of the third user moving to a location other than their home is extracted and the outing history, including the frequency of going out, is received. Based on the frequency of going out, one or more of the aforementioned third users are selected as the recipient of the message. Transmit at least one of the first specific information and the second specific information to the receiving device owned by the third user determined to be the recipient. Information processing methods.
4. To acquire first specific information including first location information indicating the current location of the first transmitting device owned by the first user, and first address information which is information from a first address book pre-registered in the first transmitting device, To obtain second identification information, which includes second location information indicating the current location of the second transmitting device owned by the second user, and second address information, which is information from the second address book pre-registered in the second transmitting device; It is determined that the first user and the second user have encountered each other if the time for which the distance between the first location information and the second location information is less than a predetermined distance is longer than a predetermined time, When the first user and the second user encounter each other, one or more third users who are common to each other are identified from among the multiple users included in the first address information and the second address information, Receiving an outing history, including frequency of going out, which is obtained by extracting the history of the third user's movements to locations other than their home from the location information history recorded in the receiving device owned by the identified third user, Based on the frequency of going out, one or more of the aforementioned third users are selected as the recipient, Transmitting at least one of the first specific information and the second specific information to the receiving device owned by the third user determined as the destination, A program that causes a computer to execute something.
Citation Information
Patent Citations
Cooker
JP2010002170A
Program and information processing unit
JP2017006690A
Notification device, notification method and notification program
JP2018128744A
Information processing method, information processing unit and information processing program
JP2019068153A
Notification device and notification method
JP2020106907A