Location information visualization system, device, method, and program

Abstract

To allow the locations on a map of owners of user terminals and their communication partners to be identified and visualized.SOLUTION: A location information visualization system includes first acquisition means that acquires location information of another terminal that has sent or received messages to a user terminal via a network from a history of messages sent and received by the user terminal, second acquisition means that acquires location information of the user terminal based on information on a history of wireless communication used by the user terminal, and display control means that displays the location information acquired by the first acquisition means and the second acquisition means on one map.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a location information visualization system, apparatus, method, and program.

Background Art

[0002] In recent years, mobile terminals such as smartphones (hereinafter referred to as user terminals) that can exhibit various functions by executing programs have been widely used. Specifically, in such user terminals, in addition to the call function, communication using character information, display of map information using GPS (Global Positioning System), photographing of photos, acquisition of videos, recording of schedules, etc. are possible.

[0003] Patent Document 1 describes estimating the position of a chat inputter by analyzing a predetermined character string input in a group chat in the chat function of a messenger app available on a user terminal.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] There is a desire to conduct an investigation not only on the owner of the user terminal but also on the communication partner who has communicated via this user terminal from the information recorded on the user terminal. More specifically, there is a desire to identify and visualize the positions on the map of the owner of the user terminal and its communication partner.

Means for Solving the Problems

[0006] The position information visualization system of the present disclosure includes: a first acquisition means for acquiring the position information of other terminals that have transmitted and received messages to and from the user terminal via a network from the history of messages transmitted and received by the user terminal; a second acquisition means for acquiring the position information of the user terminal based on the information of the history of wireless communication used by the user terminal; and a display control means for displaying the position information acquired by the first acquisition means and the second acquisition means on one map.

[0007] The position information visualization apparatus of the present disclosure further includes: a first acquisition means for acquiring the position information of other terminals that have transmitted and received messages to and from the user terminal via a network from the history of messages transmitted and received by the user terminal; a second acquisition means for acquiring the position information of the user terminal based on the information of the history of wireless communication used by the user terminal; and a display control means for displaying the position information acquired by the first acquisition means and the second acquisition means on one map.

[0008] The position information visualization method of the present disclosure further includes: acquiring the position information of other terminals that have transmitted and received messages to and from the user terminal via a network from the history of messages transmitted and received by the user terminal as a first acquisition result, acquiring the position information of the user terminal as a second acquisition result based on the information of the history of wireless communication used by the user terminal, and displaying the position information estimated by the first acquisition result and the second acquisition result on one map.

[0009] The program of the present disclosure further includes: acquiring the position information of other terminals that have transmitted and received messages to and from the user terminal via a network from the history of messages transmitted and received by the user terminal as a first acquisition result, acquiring the position information of the user terminal as a second acquisition result based on the information of the history of wireless communication used by the user terminal, and displaying the position information estimated by the first acquisition result and the second acquisition result on one map.

Advantages of the Invention

[0010] According to one aspect, for the owner of the user terminal and its communication partner, the positions on the map can be identified and visualized on the map.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Modes for Carrying Out the Invention

[0012] The principles of the present disclosure are described with reference to several exemplary embodiments. These embodiments are described for illustrative purposes only and are intended to help those skilled in the art understand and implement the present disclosure without suggesting any limitation on the scope of the present disclosure. The disclosure described herein may be implemented in various ways other than those described below.

[0013] In the following description and claims, unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which the present disclosure belongs.

[0014] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that each drawing is merely an example for explaining one or more embodiments. Each drawing is not associated with only one specific embodiment, but may be associated with one or more other embodiments. As can be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with the features or steps shown in one or more other drawings to create, for example, embodiments not explicitly illustrated or described. Not all of the features or steps shown in any one drawing for explaining exemplary embodiments are necessarily essential, and some features or steps may be omitted. The order of the steps described in any drawing may be changed as appropriate.

[0015] Embodiment 1 The position information visualization system 1 according to Embodiment 1 will be described. FIG. 1 is a diagram showing an example of the configuration of the position information visualization system 1. As shown in FIG. 1, the position information visualization system 1 includes a position information visualization device 10 and a user terminal 20. In the example of FIG. 1, the position information visualization device 10 and the user terminal 20 are connected so as to be communicable via a network N. Note that the number of the position information visualization device 10 and the user terminal 20 is not limited to the example of FIG. 1.

[0016] Next, the configuration of the position information visualization device 10 will be described. FIG. 2 is a diagram showing an example of the configuration of the position information visualization device 10 according to Embodiment 1. The position information visualization device 10 includes a first acquisition unit 11, a second acquisition unit 12, and a display control unit 13. Each of these units may be realized by the cooperation of one or more programs installed in the position information visualization device 10 and hardware such as a processor 101 and a memory 102 (see FIG. 3) of the position information visualization device 10.

[0017] Examples of the network N include, for example, the Internet, mobile communication systems, wireless LAN (Local Area Network), LAN, and buses. Examples of mobile communication systems include, for example, the 5th generation mobile communication system (5G), the 6th generation mobile communication system (6G, Beyond 5G), the 4th generation mobile communication system (4G), the 3rd generation mobile communication system (3G), and the like.

[0018] The first acquisition unit 11 acquires the location information of another terminal 30 that has transmitted and received messages to and from the user terminal 20 via the network from the history of messages transmitted and received by the user terminal 20. Note that the location information estimated by the first acquisition unit 11 may be described as the first acquisition result.

[0019] Typically here, the other terminal 30 is a terminal having the same configuration as the user terminal 20. The number of other terminals 30 is not limited to one, and a plurality of terminals can be used.

[0020] Note that hereinafter, the location information of the person possessing the user terminal 20 may be described as the location information of the user terminal 20. The same applies to the other terminal 30.

[0021] The second acquisition unit 12 acquires at least one of the location information of the user terminal 20 and the other terminal 30 based on the information of the history of wireless communication used by the user terminal 20. Note that the location information estimated by the second acquisition unit 12 may be described as the second acquisition result.

[0022] The display control unit 13 performs control to display the location information of the user terminal 20 and the other terminal 30 acquired by the first acquisition unit 11 and the second acquisition unit 12 on a map. As will be described later, typically, the display control unit 13 plots the location information as icons on a map displayed on a display device such as a display connected to the location information visualization device 10, and can display information associated with each location information.

[0023] Embodiment 2 Next, a more detailed configuration example of the location information visualization system 1 will be described.

[0024] The location information visualization device 10 is a device such as a server, a cloud server, a personal computer, or a smartphone. The location information visualization device 10 can receive and analyze the history information of messages stored in the user terminal 20, the connection history information of wireless network connections, the information of photos, the information of registered users in the phone book, the incoming and outgoing call history information related to calls, and the information of the schedule.

[0025] Typically, the history information of messages is the history information of messages using the message sending and receiving function of a social networking service (SNS). In the following description, it is assumed that the message sending and receiving uses the message sending and receiving function of SNS, but it is not limited to this.

[0026] In particular, the location information visualization device 10 can perform analysis by AI (Artificial Intelligence, hereinafter referred to as knowledge graph AI) using a knowledge graph structure as will be described later. That is, the location information visualization device 10 can analyze who is at which location from the history information of messages using the message sending and receiving function.

[0027] The user terminal 20 is a terminal such as a smartphone, a tablet, or a personal computer held by the user. The user terminal 20 sends and receives messages using the message sending and receiving function of SNS in response to the user's operation, for example.

[0028] <Hardware Configuration> FIG. 3 is a diagram showing a hardware configuration example of the position information visualization device 10 according to the embodiment. In the example of FIG. 3, the position information visualization device 10 (computer 100) includes a processor 101, a memory 102, and a communication interface 103. These components may be connected by a bus or the like. The memory 102 stores at least a part of the program 104. The communication interface 103 includes an interface necessary for communication with other network elements.

[0029] When the program 104 is executed by the cooperation of the processor 101, the memory 102, etc., at least part of the processing of the embodiment of the present disclosure is performed by the computer 100. The memory 102 may be of any type suitable for a local technical network. The memory 102 may be, as a non-limiting example, a non-transitory computer-readable storage medium. Also, the memory 102 may be implemented using any suitable data storage technology such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory, and removable memory. Although only one memory 102 is shown for the computer 100, there may be several physically different memory modules in the computer 100. The processor 101 may be of any type. The processor 101 may include one or more of a general-purpose computer, a dedicated computer, a microprocessor, a digital signal processor (DSP), and, as a non-limiting example, a processor based on a multi-core processor architecture. The computer 100 may have a plurality of processors such as an application-specific integrated circuit chip that is temporally dependent on a clock that synchronizes the main processor.

[0030] Embodiments of the present disclosure may be implemented in hardware or dedicated circuitry, software, logic or any combination thereof. Some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor or other computing device.

[0031] The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer-readable storage medium. The computer program product includes computer-executable instructions, such as instructions included in program modules, that are executed on a device on a target actual processor or virtual processor to execute the processes or methods of the present disclosure. Program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The functions of the program modules may be combined or divided among the program modules as desired in various embodiments. The machine-executable instructions of the program modules can be executed within a local or distributed device. In a distributed device, the program modules can be arranged on both local and remote storage media.

[0032] The program code for executing the method of the present disclosure may be written in any combination of one or more programming languages. This program code is provided to a processor or controller of a general-purpose computer, a dedicated computer, or other programmable data processing device. When the program code is executed by the processor or controller, the functions / operations in the flowchart and / or the implementation block diagram are executed. The program code is executed entirely on the machine, partly on the machine as a stand-alone software package, partly on the machine, partly on a remote machine, or entirely on a remote machine or server.

[0033] The program can be stored using various types of non-transitory computer-readable media and supplied to a computer. Non-transitory computer-readable media include various types of tangible recording media. Examples of non-transitory computer-readable media include magnetic recording media, magneto-optical recording media, optical disk media, semiconductor memories, etc. Magnetic recording media include, for example, flexible disks, magnetic tapes, hard disk drives, etc. Magneto-optical recording media include, for example, magneto-optical disks, etc. Optical disk media include, for example, Blu-ray disks, CD (Compact Disc)-ROM (Read Only Memory), CD-R (Recordable), CD-RW (ReWritable), etc. Semiconductor memories include, for example, solid state drives, mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, RAMs (random access memories), etc. Also, the program may be supplied to the computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can supply the program to the computer via a wired communication path such as electric wires and optical fibers, or a wireless communication path.

[0034] Next, with reference to FIGS. 4 and 5, an example of the processing of the position information visualization system 1 according to the embodiment will be described. FIG. 4 is a flowchart showing an example of the processing of the position information visualization system 1 according to the embodiment.

[0035] First, in the position information visualization device 10, a procedure for estimating a target person and estimating the position information of the estimated target person using the message history of messages transmitted and received using the message transmission / reception function between the user terminal 20 and another terminal 30 will be described.

[0036] In step S101, the first acquisition unit 11 acquires the message history transmitted and received from the user terminal 20 using the message transmission / reception function, and extracts each message in the message history.

[0037] In step S102, the first acquisition unit 11 analyzes each of the extracted messages using the knowledge graph AI, and extracts at least one of the subject, predicate, and object from the text of the message. Thereby, the first acquisition unit 11 estimates the person who is the target for specifying the location information and the location information.

[0038] As an example, in the first acquisition unit 11, when each message in the message history acquired from the user terminal 20 is input as an element to the knowledge graph AI, the knowledge graph AI can analyze the relationship between the subject, predicate, and object in the message. For example, in the first acquisition unit 11, when the subject, predicate, and object are each extracted, it is possible to set the subject as the name of the source node, the object as the name of the destination node, and the predicate as the name of the link from the source node to the destination node. Also, for example, in the first acquisition unit 11, when the subject is not extracted from the text of the message, the user name of the message sender can be set as the name of the source node. Also, for example, in the first acquisition unit 11, when the object is not extracted from the text of the message, the user name or group name of the message destination can be set as the name of the destination node.

[0039] Particularly here, the knowledge graph AI of the first acquisition unit 11 shall extract information related to location information from the message history. As a specific example, when the owner of the user terminal 20 asks "Where are you?", and then the owner of another terminal 30 answers "At Kyobashi", the first acquisition unit 11 can estimate that the owner of the other terminal 30 is at Kyobashi.

[0040] From the above, typically in the first acquisition unit 11, messages extracted from the history of messages transmitted and received by the user terminal are determined by the knowledge graph AI, and it is possible to estimate who the target person is who possesses another terminal 30 that transmits and receives messages to and from the user terminal 20, and the location information of that target person.

[0041] Here, FIG. 5 is a diagram showing an example of the knowledge graph generated in the determination by the knowledge graph AI. In the location information visualization system 1, in the first acquisition unit 11, display changes on the map controlled by the display control unit 13 can be made according to the correlation between people such as the number of connections of nodes when the knowledge graph is generated.

[0042] Similarly, in the first acquisition unit 11, if the content of the message spoken at that location and who the speech was made to can be specified, these pieces of information can be stored. In the location information visualization system 1, the information on the speaker and the recipient of the message used for this location estimation can also be used as elements for changing the display on the map.

[0043] As a more specific example, in FIG. 5, in the knowledge graph 501, nodes 521 to 524 displayed as round figures, and links 511 to 513 displayed as arrows from the sender to the recipient, etc. are shown. In FIG. 5, the names (tags) of each of the nodes 521 to 524 are "gr", "Sato", "Watanabe", and "Ishida". Note that "gr" is an example of the name of a group (chat group) including a plurality of users. Note that the name may be set, for example, by one user included in the group or the user of the user terminal 20.

[0044] Here, in the example of FIG. 5, links 511 to 513 are highlighted, and the other links are not highlighted. Also, node 521 is highlighted, and the other nodes are not highlighted. In the example of FIG. 5, the size of the circular shape of each node is displayed larger as the number of links increases. The highlighting and the size of the circular shape in this FIG. 5 can be reflected as highlighting of who made a statement to whom and highlighting of the icon itself when the display control unit 13 described later displays an icon on the map.

[0045] Note that in the first acquisition unit 11, each message in the message history acquired from the user terminal 20 is analyzed by the knowledge graph AI to acquire position information, but the target person is not limited to the holder of another terminal 30 that has sent and received messages with the user terminal 20. That is, the target person can be the holder of the user terminal 20 itself or a third party mentioned in the message transmission and reception between the holder of the user terminal 20 and the holder of another terminal 30.

[0046] In step S103, the first acquisition unit 11 associates the estimated target person and the position information of the target person with the information on the time when the message transmission and reception that was particularly referred to when making these estimations was performed. That is, in the first acquisition unit 11, since the time when the message used for the estimation was transmitted and received is recorded together with the message history in the user terminal 20, this time is acquired by referring to the message history of the user terminal 20, and the time is associated with the position information. Thereby, the first acquisition unit 11 can estimate when, who, and at which position based on the message transmission and reception history.

[0047] In step S104, the display control unit 13 displays the target person estimated in step S103 and the position information of the target person on the map in a state where they are associated with time information. In other words, in step S103, the display control unit 13 displays on the map as if the target person was at the estimated position at the time associated with referring to the time of each message in the message history by the first acquisition unit 11. Note that this target person is typically a person who possesses another terminal 30.

[0048] In the display control by this display control unit 13, as described in step S102, the icon can be changed according to the correlation between people such as the number of connections of nodes when the knowledge graph is generated. As an example, the display control unit 13 can display the icon of a person with a large number of connected nodes conspicuously on the map.

[0049] Furthermore, in the map display by this display control unit 13, in step S102, using the content of the message spoken at that position and the information identifying who the speech was made to, which were stored by the first acquisition unit 11, these information can be visualized. For example, when the display control unit 13 displays the target person as an icon on the map, it can add as an annotation who the display of the icon is based on what speech from whom to whom.

[0050] Next, a procedure for the second acquisition unit 12 to estimate the position information of the owner of the user terminal 20 based on the information of the connection history of the wireless communication used by the user terminal 20 will be described. Here, in particular, the wireless communication will be described as a communication connection with Wi-Fi (registered trademark).

[0051] In step S201, the second acquisition unit 12 acquires the information of the Wi-Fi connection history stored in the user terminal 20. The information of the Wi-Fi connection history is also stored in association with the connection time.

[0052] In step S202, the second acquisition unit 12 identifies the communication location based on the information of the Wi-Fi connection history. For example, the second acquisition unit 12 uses the BSSID information, which is the identifier of the access point and the wireless network, and the location information of the base station of the carrier that provides the communication service when communicating with the user terminal 20 to estimate the location information when communication is performed by the user terminal 20.

[0053] In other words, the second acquisition unit 12 can acquire the location information according to the information of the wireless communication history used by the user terminal 20, the information of the time associated with the user terminal 20 as the time when the wireless communication is executed, and the information of the access point of the wireless communication acquired using the network identifier.

[0054] Note that the identification of the communication location of the user terminal 20 based on the information of the Wi-Fi connection history by the second acquisition unit 12 can also be executed by listing the information about the access point in advance and comparing it with the list.

[0055] In step S203, the display control unit 13 displays the location information estimated in step S202 on the map in a state associated with the time information for the owner of the user terminal 20.

[0056] Next, a procedure for estimating the location information and the like for a person who owns the user terminal 20 or another terminal 30 by a method other than the method of using the Wi-Fi connection history by the second acquisition unit 12 will be described. Note that steps S301 to S303 shown below may be performed simultaneously with the method of using the Wi-Fi communication history of steps S201 to S203 described above, or may proceed from step S104 to step S301 described below without executing the method of using the Wi-Fi communication history.

[0057] In step S301, the second acquisition unit 12 acquires from the user terminal 20 the photos stored in the user terminal 20, the information of the telephone directory registrants, the call history information, and the schedule information.

[0058] In step S302, the second acquisition unit 12 analyzes the information acquired using the analysis algorithm.

[0059] For example, if a photo is acquired from the user terminal 20 by the second acquisition unit 12 and the source of the photo is from another terminal 30, by analyzing the photo, position information such as the latitude and longitude of the owner of the other terminal 30 and time information can be acquired from the Exchangeable image file format information (Exif information) embedded in the photo.

[0060] Also, for example, the second acquisition unit 12 uses the information of the telephone directory registrants acquired from the user terminal 20 in combination with the call history information to analyze whether the contact with another terminal 30 is the same person, analyze the content of the conversation recorded during the call, analyze the information about the base station when making or receiving a call, and analyze the moving distance between multiple calls, etc., so as to estimate the position information of the owner of the user terminal 20 and the owner of the other terminal 30.

[0061] Also, for example, the second acquisition unit 12 can analyze the people and places described in the schedule from the schedule information acquired from the user terminal 20. For example, the second acquisition unit 12 can analyze the past position information of the owner of the user terminal 20 and the position information of the owner of the other terminal 30 that the owner of the user terminal 20 has met based on the acquired schedule information. Note that these analyses are examples, and other analysis methods may also be used.

[0062] In step S303, the display control unit 13 displays the position information estimated in step S302 on the map in a state where the time information is associated for the owner of the user terminal 20, the owner of the other terminal 30, etc.

[0063] In other words, when acquiring the position information, the second acquisition unit 12 can acquire and display at least one of the position information of the user terminal 20 and the other terminal 30 by using at least one of the latitude and longitude information of the photos stored in the user terminal 20, the information of the registered users in the phone book, the call incoming and outgoing history information, and the schedule information. Note that the second acquisition unit 12 may execute this by acquiring the position information based on the information of the wireless communication history instead of this, or may execute this in addition to acquiring the position information based on the information of the wireless communication history.

[0064] So far, the display control unit 13 has been described as sequentially performing the display on the map in step S104, step S203, and step S303, but it is not limited to this. For example, in the position information visualization system 1, the results of estimating the position information by the first acquisition unit 11 and the second acquisition unit 12 are temporarily stored, and after organizing the stored information, the display control unit 13 can also display the organized position information on the map.

[0065] Next, in step S401, the display control unit 13 changes the display content according to the operations of the designation unit 13a for designating the display content and the narrowing-down unit 13b for narrowing down the time to be the display target.

[0066] FIG. 6 is an example of a state where the display control unit 13 displays the estimated position information of the owner of the user terminal 20 and the owner of the other terminal 30 as icons on the map. Further, in FIG. 6, a designation unit 13a for performing an operation of designating the display content according to the operation of the user and a narrowing-down unit 13b for narrowing down the time to be the display target according to the operation of the user are arranged within the screen displaying this map.

[0067] First, the display of the icon of the target person on the map by the display control unit 13 will be described. As shown in FIG. 6, the display of the icon of the target person on the map by the display control unit 13 is executed based on the target person and the estimated position information estimated by the first acquisition unit 11 and the second acquisition unit, as described in step S104, step S203, and step S303. Note that, as described in step S102 and step S104, the display control unit 13 may distinguish the display of the icon of the person with a large number of connected nodes when it is made into a knowledge graph from other displays, and the display of the icon can be made such that it can be understood from whom to whom and based on what speech.

[0068] Here, when the display control unit 13 performs the icon display of the target person on the map, for example, up to a predetermined number of people such as up to 5 people, the icon colors can be painted and displayed. In FIG. 6, instead of the color painting display, the icon shapes are changed and displayed, and these display settings can be arbitrarily changed.

[0069] In FIG. 6, in the designation unit 13a arranged on the right side of the map, it is possible to designate the target person displayed on the map and whether to perform the display for each method of estimating the position of the target person.

[0070] In other words, in the designation unit 13a, the position information acquired by the first acquisition unit 11 and the position information acquired by the second acquisition unit 12 can be designated respectively. Then, in the display control unit 13, when at least one of the first acquisition unit 11 and the second acquisition unit 12 is selected by the designation unit 13a, the position information estimated by the selected acquisition unit can be displayed on the map.

[0071] Similarly, in the designation unit 13a, for the position information estimated by the first acquisition unit 11 and the second acquisition unit 12, it is possible to make a designation for each target person. Then, in the display control unit 13, when a target person is selected by the designation unit 13a, the position information of the selected target person can be displayed on the map.

[0072] Further, in FIG. 6, a narrowing-down section 13b is provided below the map. The user can perform a narrowing-down setting of the date and time for a target person to be displayed as an icon on the map by operating the narrowing-down section 13b provided as, for example, a seek bar. That is, the display control unit 13 can display only the target person at the time within the narrowing-down range on the map with reference to the time information associated with the estimated position information respectively.

[0073] In other words, the narrowing-down section 13b can perform a narrowing-down setting of the time to be a display target when displaying the position information on the map. In the display control unit 13, when the time associated with the position information estimated by the first acquisition unit 11 or the second acquisition unit 12 is within the range of the narrowed-down set time, it can be displayed on the map.

[0074] Note that the display control unit 13 can display the information associated with each position information on the map automatically or in response to an arbitrary operation by the user. Also typically, like the balloon on the map shown in FIG. 6, the display control unit 13 can display the information associated with the position information near each position information plotted on the map, but the display method is not limited to this method.

[0075] Thereby, in the position information visualization system 1, the user terminal 20 estimates the position information of the holder of another terminal 30 that performs transmission and reception of various types of information including transmission and reception of messages through the network line, using the information possessed by the user terminal 20, and can visualize it on the map to make it easier to understand.

[0076] In addition, in the location information visualization system 1, it is possible to perform narrowing down for the target person, narrowing down for each location information estimation method, narrowing down for each time, etc. for the estimated location information. That is, in the location information visualization system 1, it is possible to change the display so that it is easier for the user to visually judge the location information of the target person according to the designation by the user, and the convenience can be improved.

[0077] Note that it is also possible to estimate the location information of the holder of the user terminal 20 and the location information of a third party that appears in messages of communication between the user terminal 20 and other terminals 30.

[0078] As described above, the present disclosure has been described with reference to the embodiments, but the present disclosure is not limited to the above-described embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure. And each embodiment can be combined with other embodiments as appropriate.

[0079] Some or all of the above embodiments can be described as follows in the appended claims, but are not limited thereto. (Appended Claim 1) A first acquisition means for acquiring the location information of another terminal that has transmitted and received messages to and from the user terminal via a network from the history of messages transmitted and received by the user terminal; A second acquisition means for acquiring the location information of the user terminal based on the information of the history of wireless communication used by the user terminal; A display control means for displaying the location information acquired by the first acquisition means and the second acquisition means on one map. Location information visualization system. (Appended Claim 2) The first acquisition means Judges the messages extracted from the history of messages transmitted and received by the user terminal by AI, estimates the target person who holds another terminal that has transmitted and received messages to and from the user terminal, and the location where the target person is located, and Obtain the time when the message used for the estimation was transmitted and received from the history of the messages of the user terminal, and associate the time with the position information. The display control means At the time associated by the first acquisition means, display on the map as if the target person having the other terminal was at the estimated position. The position information visualization system according to Supplementary Note 1. (Supplementary Note 3) Further include a designation means capable of designating the position information acquired by the first acquisition means and the position information acquired by the second acquisition means respectively. The display control means When at least one of the first acquisition means and the second acquisition means is selected by the designation means, display the position information estimated by the selected acquisition means on the map. The position information visualization system according to Supplementary Note 1 or Supplementary Note 2. (Supplementary Note 4) The designation means can be designated for each target person with respect to the position information estimated by the first acquisition means and the second acquisition means. The display control means When a target person is selected by the designation means, display the position information of the selected target person on the map. The position information visualization system according to Supplementary Note 3. (Supplementary Note 5) Further include a narrowing-down means for performing a narrowing-down setting of the time to be the display target when displaying the position information on the map. The second acquisition means Acquire at least one of the position information of the user terminal and the position information of the other terminal, and acquire and associate the time associated with the position information from the user terminal. The display control means When the time is narrowed down by the narrowing-down means, display on the map when the time associated with the position information is within the range of the narrowed-down time. The position information visualization system according to Appendix 1 or Appendix 2. (Appendix 6) The second acquisition means acquires position information according to the information on the history of wireless communication used in the user terminal, the information on the time associated with the user terminal as the time when the wireless communication is executed, and the information on the access point of the wireless communication acquired using a network identifier. The position information visualization system according to Appendix 1 or Appendix 2. (Appendix 7) The second acquisition means When acquiring position information, at least one of the latitude and longitude information of the photos stored in the user terminal, the information of the registered users in the phone book, the information of the call history of incoming and outgoing calls, and the information of the schedule is further used, or instead of acquiring based on the information on the history of wireless communication used by the user terminal, at least one of the latitude and longitude information of the photos stored in the user terminal, the information of the registered users in the phone book, the information of the call history of incoming and outgoing calls, and the information of the schedule is used, acquires the position information of at least one of the user terminal and the other terminal. The position information visualization system according to Appendix 1 or Appendix 2. (Appendix 8) a first acquisition means for acquiring the position information of another terminal that has transmitted and received messages to and from the user terminal via a network from the history of messages transmitted and received by the user terminal; a second acquisition means for acquiring the position information of the user terminal based on the information on the history of wireless communication used by the user terminal; and a display control means for displaying the position information acquired by the first acquisition means and the second acquisition means on one map. Position information visualization device. (Appendix 9) acquires a first acquisition result of the position information of another terminal that has transmitted and received messages to and from the user terminal via a network from the history of messages transmitted and received by the user terminal, Based on the information of the history of wireless communication used by the user terminal, obtain the position information of the user terminal as a second acquisition result. Display the position information estimated from the first acquisition result and the second acquisition result on one map. Position information visualization method. (Appendix 10) From the history of messages transmitted and received by the user terminal, obtain the position information of other terminals that transmitted and received messages to and from the user terminal via the network as a first acquisition result. Based on the information of the history of wireless communication used by the user terminal, obtain the position information of the user terminal as a second acquisition result. Display the position information estimated from the first acquisition result and the second acquisition result on one map. Program.

Explanation of symbols

[0080] 1 Position information visualization system 10 Position information visualization device 11 First acquisition unit 12 Second acquisition unit 13 Display control unit 13a Designation unit 13b Narrowing-down unit 20 User terminal 30 Other terminal

Claims

1. A first acquisition means for acquiring position information of other terminals that have transmitted and received messages to and from the user terminal via a network from the history of messages transmitted and received by the user terminal; A second acquisition means for acquiring position information of the user terminal based on information on the history of wireless communication used by the user terminal; A display control means for displaying the position information acquired by the first acquisition means and the second acquisition means on one map; A position information visualization system.

2. The first acquisition means: Determine the messages extracted from the history of messages transmitted and received by the user terminal with AI, and estimate the target person who holds the other terminal that has transmitted and received messages to and from the user terminal and the position where the target person is located. At the same time, Obtain the time when the message used in the estimation was transmitted and received from the history of the messages of the user terminal, and associate the time with the position information. The display control means: Display on the map as if the target person who holds the other terminal was at the estimated position at the time associated by the first acquisition means. The position information visualization system according to Claim 1.

3. Further comprising a designation means capable of designating the position information acquired by the first acquisition means and the position information acquired by the second acquisition means respectively. The display control means: When at least one of the first acquisition means and the second acquisition means is selected by the designation means, display the position information estimated by the selected acquisition means on the map. The position information visualization system according to Claim 1 or Claim 2.

4. The specified means can be specified for each target person with respect to the position information estimated by the first acquisition means and the second acquisition means. The display control means When a target person is selected by the specified means, the position information of the selected target person is displayed on a map. The position information visualization system according to claim 3.

5. When displaying position information on a map, a narrowing means for performing a narrowing setting of the time to be displayed is further provided. The second acquisition means Acquires at least one of the position information of the user terminal and the position information of the other terminal, and acquires and associates the time associated with the position information from the user terminal. The display control means When the time is narrowed down by the narrowing means, if the time associated with the position information is within the range of the narrowed-down time, it is displayed on the map. The position information visualization system according to claim 1 or claim 2.

6. The second acquisition means The position information is acquired according to the information on the history of wireless communication used in the user terminal, the time associated with the user terminal as the time when the wireless communication is executed, and the information on the access point of the wireless communication acquired using the network identifier. The position information visualization system according to claim 1 or claim 2.

7. The second acquisition means When obtaining the location information, further utilize at least one of the latitude and longitude information of the photos stored in the user terminal, the information of the registered users in the phone book, the information of the call incoming and outgoing history, and the information of the schedule, or instead of obtaining based on the information of the wireless communication history used by the user terminal, utilize at least one of the latitude and longitude information of the photos stored in the user terminal, the information of the registered users in the phone book, the information of the call incoming and outgoing history, and the information of the schedule. Obtain the location information of at least one of the user terminal and the other terminal. The location information visualization system according to claim 1 or claim 2.

8. A first acquisition means for obtaining the location information of another terminal that has transmitted and received messages to and from the user terminal via a network from the history of the messages transmitted and received by the user terminal. A second acquisition means for obtaining the location information of the user terminal based on the information of the wireless communication history used by the user terminal. A display control means for displaying the location information obtained by the first acquisition means and the second acquisition means on one map. Location information visualization device.

9. Obtain, as a first acquisition result, the location information of another terminal that has transmitted and received messages to and from the user terminal via a network from the history of the messages transmitted and received by the user terminal. Obtain, as a second acquisition result, the location information of the user terminal based on the information of the wireless communication history used by the user terminal. Display the location information estimated from the first acquisition result and the second acquisition result on one map. Location information visualization method.

10. Obtain, as a first acquisition result, the location information of another terminal that has transmitted and received messages to and from the user terminal via a network from the history of the messages transmitted and received by the user terminal. Based on the information of the history of the wireless communication used by the user terminal, obtain the position information of the user terminal as a second acquisition result. Display the position information estimated from the first acquisition result and the second acquisition result on one map. Program.

Images