Information processing device, information processing method, and information processing program

Abstract

To allow a summary of contents of past interactions with a specific opposite party to be presented during communication with the specific opposite party.SOLUTION: An information processing device according to the present application includes: an identification unit that identifies a combination of a sending-side user and a receiving-side user; a management unit that accumulates and manages interactions between the sending-side user and the receiving-side user; an extraction unit that extracts another interaction related to a current interaction between the sending-side user and the receiving-side user; a creation unit that creates a summary of the extracted other interaction; and a provision unit that provides the summary of the other interaction to the sending-side user or the receiving-side user while the current interaction is taking place.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] A technology has been disclosed that receives a request from a chat room participant for previous chat data that was sent and received in the chat room before joining, and provides the participant with the previous chat data stored on a shared drive based on the access rights for the shared drive that are set corresponding to the type of chat room (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2023-086747 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, there is room for improvement in the above conventional technology. For example, the above conventional technology can provide previous chat data transmitted and received in a chat room before a participant joined the chat room, but there is room for improvement in providing previous chat data transmitted and received between specific participants. Therefore, there is a need for a means for presenting a summary of past exchanges between a specific person and the specific person during communication with the specific person.

[0005] The present application has been made in consideration of the above, and aims to present a summary of past exchanges between a specific person and the specific person during communication with the specific person. [Means for solving the problem]

[0006] The information processing device of the present application is characterized by comprising an identification unit that identifies a combination of a sending user and a receiving user, a management unit that accumulates and manages interactions between the sending user and the receiving user, an extraction unit that extracts another interaction related to a current interaction between the sending user and the receiving user, a creation unit that creates a summary of the extracted other interactions, and a provision unit that provides the summary of the other interactions to the sending user or the receiving user while the current interaction is taking place. Effect of the Invention

[0007] According to one aspect of the embodiment, during communication with a specific person, a summary of past exchanges between the specific person and the person can be presented. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram showing an overview of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of a terminal device according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of the configuration of a server device according to the embodiment. [Figure 4] FIG. 4 is a flowchart showing a processing procedure according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of a hardware configuration. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the information processing device, the information processing method, and the information processing program according to the present application will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to the embodiments. In addition, the same components in the following embodiments are denoted by the same reference numerals, and duplicated descriptions are omitted.

[0010] [1. Overview of the information processing system] First, an overview of an information processing system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is an explanatory diagram showing an overview of an information processing system according to an embodiment. As shown in Fig. 1, an information processing system 1 according to an embodiment includes a terminal device 10 and a server device 100. These various devices are connected to each other via a network N in a wired or wireless manner so as to be able to communicate with each other. This allows the terminal device 10 to cooperate with the server device 100. The network N is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network) such as the Internet.

[0011] The terminal device 10 is an information processing device used by a user U. For example, the terminal device 10 is a smart device such as a smartphone or a tablet terminal, a mobile phone such as a feature phone, a personal computer (PC), a personal digital assistant (PDA), a game machine or AV device equipped with a communication function, an information appliance or digital appliance, a car navigation system, a smart watch or a head-mounted display, a wearable device such as smart glasses, etc. The terminal device 10 may also be a house or building, a car, a home appliance, an electronic device, etc. that supports the Internet of Things (IOT).

[0012] In this embodiment, the terminal device 10 is a smart device such as a smartphone or tablet terminal used by a user U, and is a mobile terminal device that can communicate with any server device via a wireless communication network such as LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation: 5th generation mobile communication system). The terminal device 10 has a screen such as a liquid crystal display having a touch panel function, and accepts various operations on display data such as content, such as tapping, sliding, and scrolling, performed by a finger or a stylus from the user U. An operation performed on an area of ​​the screen where the content is displayed may be regarded as an operation on the content. The terminal device 10 may be not only a smart device, but also an information processing device such as a desktop PC (Personal Computer) or a notebook PC.

[0013] In addition, the terminal device 10 can connect to the network N via a wireless communication network such as LTE, 4G, or 5G, or short-range wireless communication such as Bluetooth (registered trademark) or wireless LAN (Local Area Network), and communicate with the server device 100.

[0014] The server device 100 is, for example, a computer such as a PC or a blade server, or a mainframe or a workstation, etc. The server device 100 may be realized by cloud computing.

[0015] In this embodiment, the server device 100 is an information processing device that cooperates with the terminal device 10 of each user U and provides API (Application Programming Interface) services for various applications (hereinafter, apps), etc., as well as various data, to the terminal device 10 of each user U, and is realized by a computer, a cloud system, etc.

[0016] The server device 100 may also be an information processing device that provides some kind of online Web service to the terminal device 10 of each user U. For example, the server device 100 may provide services such as Internet connection, search service, SNS (Social Networking Service), electronic commerce (EC), electronic payment, online games, online banking, online trading, hotel and ticket reservations, video and music distribution, news, maps, route search, route guidance, line information, operation information, and weather forecasts as Web services. In practice, the server device 100 may cooperate with various servers that provide the above-mentioned Web services, and may mediate the Web services or be responsible for processing the Web services.

[0017] The server device 100 can acquire user information about the user U. For example, the server device 100 acquires information about the attributes of the user U, such as the gender, age, and residential area of ​​the user U. The server device 100 then stores and manages the information about the attributes of the user U together with identification information (such as a user ID) indicating the user U.

[0018] The server device 100 also acquires various types of history information (log data) indicating the actions of the user U from the terminal device 10 of the user U or from various servers based on the user ID or the like. For example, the server device 100 acquires a location history, which is a history of the location and date and time of the user U, from the terminal device 10. The server device 100 also acquires a search history, which is a history of search queries input by the user U, from a search server (search engine). The server device 100 also acquires a browsing history, which is a history of content browsed by the user U, from a content server. The server device 100 also acquires a purchase history (payment history), which is a history of product purchases and payment processing by the user U, from an electronic commerce server or a payment processing server. The server device 100 may also acquire a listing history, which is a history of listings on the marketplace by the user U, and a sales history, from the electronic commerce server or the payment processing server. The server device 100 also acquires a posting history, which is a history of posts by the user U, from a posting server that provides a word-of-mouth posting service or an SNS server. The above-mentioned various servers and the like may be the server device 100 itself. That is, the server device 100 may function as the above-mentioned various servers and the like.

[0019] Furthermore, the number of devices included in the information processing system 1 shown in Fig. 1 is not limited to that shown in the figure. For example, in Fig. 1, for the sake of simplicity, only one terminal device 10 is shown, but this is merely an example and is not limiting, and two or more devices may be included.

[0020] [2. Message-based recollection display] In this embodiment, the server device 100 identifies and provides a message history that is highly relevant to a received message from the message histories of multiple users U who are communicating with each other. That is, the server device 100 uses a message exchanged (sent and received) in real time between a specific sender (sending user) and a receiver (receiving user) as a starting point, and displays a summary (list, summary, main points, etc.) of other exchanges (messages exchanged in the past other than the current exchange, etc.) related to the topic of the message on the terminal device 10 of the sender or receiver.

[0021] For example, the server device 100 accumulates messages (history of messages) exchanged (sent and received) in the past between a specific sender and receiver, creates a summary (list, summary, main points, etc.) of other exchanges related to keywords (people, animals, products / services, places / place names, stores / facilities, other names, or topic contents, etc.) or images contained in messages currently being exchanged between the sender and receiver, and displays it on the terminal device 10 of the sender or receiver.

[0022] The sender (sending user) and the receiver (receiving user) are both one of the users U. The other exchanges are messages exchanged between the same sender and receiver on a different occasion or on a different timeline from the message currently being exchanged. For example, it is an archive of the exchanges between the sender and receiver. The other exchanges may also be a history of past actions related to the topic of the current message. For example, the server device 100 may extract, from the history information, past actions involving both the same sender and receiver, such as product purchases, use of services, stores, and facilities, drinking parties, event participation, travel, visits (travel), posts, etc., as the other exchanges.

[0023] In addition, messages exchanged between users may be text messages such as emails, SNS, SMS (Short Message Service), chat rooms, or chat rooms, or they may be notes or comments, or they may be voice or video calls made via a calling app or conference system over a PC monitor or the like.

[0024] The sender or receiver continues exchanging messages with the current person by referring to summaries of other exchanges (lists, summaries, key points, etc.) to expand on the topic or to avoid misunderstandings or the content of other exchanges with different people (so-called "misfires").

[0025] At this time, the server device 100 may display a summary (list, summary, main points, etc.) of other exchanges related to the message only on the sender's terminal device 10 (visible only to the sender), or only on the receiver's terminal device 10 (visible only to the receiver), or may display it on both terminal devices 10. Furthermore, the server device 100 may display it on the terminal device 10 of the user who is the sender or receiver only when that user desires it (when the user sets it to be displayed, etc.).

[0026] The sender and the receiver may be members belonging to the same group. The sender and the receiver may each be multiple people (multiple members belonging to the same group). In this case, the server device 100 may display a summary (list, summary, main points, etc.) of another exchange related to the message on the terminal devices 10 of both senders and receivers only when the sender and the receiver belong to the same group. The group may also be a chat room.

[0027] For example, as shown in Fig. 1, the server device 100 identifies a sender (a sending user) (step S1). For example, the server device 100 identifies a first user U (UA) as the sender (a sending user). At this time, the server device 100 may perform user authentication on the sender.

[0028] The server device 100 also identifies the recipient (receiving user) (step S2). For example, the server device 100 identifies the second user U (UB) as the recipient (receiving user) (step S2). At this time, the server device 100 may perform user authentication on the recipient.

[0029] Next, the server device 100 identifies a combination of sender and receiver (step S3). The sender and receiver may be interchanged. However, when identifying which party sent the message, a different combination may be used if the sender and receiver are interchanged. For example, the server device 100 identifies the combination of a first user U (UA) and a second user U (UB) as a combination of sender and receiver. Also, if the sender and receiver belong to the same group, the combination of sender and receiver may be on a group basis.

[0030] Next, the server device 100 accumulates (the history of) messages exchanged (transmitted and received) between the sender and the receiver for each combination of sender and receiver (step S4).

[0031] Furthermore, on another occasion, the server device 100 analyzes the topic of the message (keywords, images, etc. included in the message) exchanged (sent and received) in real time between the sender and the receiver (step S5). For example, when a message is exchanged between a user U (UA) and a second user U (UB), the server device 100 analyzes the topic of the message (keywords, images, etc. included in the message) using image recognition, voice recognition, natural language processing, AI (Artificial Intelligence), etc.

[0032] Next, based on the combination of sender and receiver, the server device 100 extracts from the accumulated message (history) other exchanges related to the topic (keywords, images, etc. contained in the message) of the message being exchanged (sent and received) in real time between the sender and receiver (step S6).

[0033] Next, the server device 100 creates a summary (list, summary, main points, etc.) of the other exchanges (step S7).

[0034] Next, the server device 100 displays a summary (list, summary, main points, etc.) of the other exchange on the terminal device 10 of the sender or receiver together with the message being exchanged (sent and received) in real time between the sender and receiver (step S8). That is, the server device 100 provides a summary of the other exchange related to the current exchange while the current exchange is being carried out.

[0035] For example, when messages related to a past travel destination are exchanged between a specific sender and receiver, the server device 100 creates a summary of messages exchanged at the travel destination (or during the trip) from the past history and displays it on the sender's or receiver's terminal device 10. At this time, the server device 100 may display the date and time and the location (place) where the past messages were exchanged in the message summary.

[0036] In addition, the server device 100 may be configured to update (create / change) summaries of other exchanges in real time as the topic (content) of messages being exchanged (sent / received) in real time between a specific sender and receiver changes.

[0037] In addition, when the server device 100 creates a summary (list, summary, main points, etc.) of another exchange, it is preferable to display the summary (list, summary, main points, etc.) of the other exchange on the sender's terminal device 10 before the sender sends / posts the next message.

[0038] [3. Example of terminal device configuration] Next, the configuration of the terminal device 10 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the terminal device 10. As shown in Fig. 2, the terminal device 10 includes a communication unit 11, a display unit 12, an input unit 13, a positioning unit 14, a sensor unit 20, a control unit 30 (controller), and a storage unit 40.

[0039] (Communications Department 11) The communication unit 11 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the server device 100 via the network N. For example, the communication unit 11 is realized by a NIC (Network Interface Card), an antenna, or the like.

[0040] (Display section 12) The display unit 12 is a display device that displays various information such as position information. For example, the display unit 12 is a liquid crystal display (LCD) or an organic electro-luminescent display (OLED). The display unit 12 is a touch panel display, but is not limited to this.

[0041] (Input section 13) The input unit 13 is an input device that accepts various operations from the user U. For example, the input unit 13 has buttons for inputting characters, numbers, and the like. The input unit 13 may be an input / output port (I / O port), a USB (Universal Serial Bus) port, or the like. In addition, when the display unit 12 is a touch panel display, a part of the display unit 12 functions as the input unit 13. In addition, the input unit 13 may be a microphone that accepts voice input from the user U, or the like. The microphone may be wireless.

[0042] (Positioning unit 14) The positioning unit 14 receives a signal (radio wave) transmitted from a satellite of a GPS (Global Positioning System), and acquires position information (e.g., latitude and longitude) indicating the current position of the terminal device 10, which is the device itself, based on the received signal. That is, the positioning unit 14 measures the position of the terminal device 10. Note that the GPS is merely an example of a GNSS (Global Navigation Satellite System).

[0043] The positioning unit 14 can measure the position by various methods other than GPS. For example, the positioning unit 14 may measure the position by using various communication functions of the terminal device 10 as described below as an auxiliary positioning means for position correction or the like.

[0044] (Wi-Fi positioning) For example, the positioning unit 14 uses a Wi-Fi (registered trademark) communication function of the terminal device 10 or a communication network provided by each communication company to measure the position of the terminal device 10. Specifically, the positioning unit 14 performs Wi-Fi communication or the like and measures the distance to a nearby base station or access point to measure the position of the terminal device 10.

[0045] (Beacon positioning) The positioning unit 14 may measure the position by using a Bluetooth (registered trademark) function of the terminal device 10. For example, the positioning unit 14 measures the position of the terminal device 10 by connecting to a beacon transmitter connected by the Bluetooth (registered trademark) function.

[0046] (geomagnetic positioning) The positioning unit 14 also measures the position of the terminal device 10 based on a geomagnetic pattern of a structure measured in advance and a geomagnetic sensor included in the terminal device 10.

[0047] (RFID positioning) Furthermore, for example, if the terminal device 10 has a function of an RFID (Radio Frequency Identification) tag equivalent to a contactless IC card used at station ticket gates, stores, etc., or has a function of reading an RFID tag, the location of use is recorded together with information on a payment or the like made by the terminal device 10. The positioning unit 14 may obtain such information to measure the location of the terminal device 10. Furthermore, the location may be measured by an optical sensor, an infrared sensor, or the like provided in the terminal device 10.

[0048] The positioning unit 14 may, if necessary, measure the position of the terminal device 10 using one or a combination of the above-mentioned positioning means.

[0049] (Sensor unit 20) The sensor unit 20 includes various sensors mounted on or connected to the terminal device 10. The connection may be wired or wireless. For example, the sensors may be detection devices other than the terminal device 10, such as wearable devices and wireless devices. In the example shown in FIG. 2, the sensor unit 20 includes an acceleration sensor 21, a gyro sensor 22, an air pressure sensor 23, a temperature sensor 24, a sound sensor 25, a light sensor 26, a magnetic sensor 27, and an image sensor (camera) 28.

[0050] The above-mentioned sensors 21 to 28 are merely examples and are not intended to be limiting. That is, the sensor unit 20 may be configured to include some of the sensors 21 to 28, or may include other sensors such as a humidity sensor in addition to or instead of the sensors 21 to 28.

[0051] The acceleration sensor 21 is, for example, a three-axis acceleration sensor, and detects physical movements of the terminal device 10, such as the moving direction, speed, and acceleration of the terminal device 10. The gyro sensor 22 detects physical movements of the terminal device 10, such as tilts in three axial directions, based on the angular velocity, etc. of the terminal device 10. The air pressure sensor 23 detects, for example, the air pressure around the terminal device 10.

[0052] Since the terminal device 10 includes the above-mentioned acceleration sensor 21, gyro sensor 22, and air pressure sensor 23, it is possible to measure the position of the terminal device 10 using a technique such as Pedestrian Dead-Reckoning (PDR) that uses these sensors 21 to 23. This makes it possible to obtain indoor position information that is difficult to obtain using a positioning system such as GPS.

[0053] For example, the number of steps, walking speed, and distance walked can be calculated by a pedometer using the acceleration sensor 21. In addition, the moving direction, line of sight direction, and body inclination of the user U can be known by using the gyro sensor 22. In addition, the altitude and floor number on which the terminal device 10 of the user U is located can be known from the air pressure detected by the air pressure sensor 23.

[0054] The air temperature sensor 24 detects, for example, the air temperature around the terminal device 10. The sound sensor 25 detects, for example, the sound around the terminal device 10. The light sensor 26 detects the illuminance around the terminal device 10. The magnetic sensor 27 detects, for example, the geomagnetism around the terminal device 10. The image sensor 28 captures an image around the terminal device 10.

[0055] The above-mentioned air pressure sensor 23, temperature sensor 24, sound sensor 25, light sensor 26, and image sensor 28 can detect the air pressure, temperature, sound, and illuminance, and capture images of the surroundings, thereby detecting the environment and situation around the terminal device 10. In addition, the accuracy of the location information of the terminal device 10 can be improved based on the environment and situation around the terminal device 10.

[0056] (Control unit 30) The control unit 30 includes, for example, a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM, an input / output port, and various other circuits. The control unit 30 may also be configured with hardware such as an integrated circuit, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 30 includes a transmitting unit 31, a receiving unit 32, and a processing unit 33.

[0057] (Transmitter 31) The transmission unit 31 can transmit, for example, various information input by the user U using the input unit 13, various information detected by each sensor 21-28 mounted on or connected to the terminal device 10, and location information of the terminal device 10 measured by the positioning unit 14 to the server device 100 via the communication unit 11.

[0058] (Receiving unit 32) The receiving unit 32 can receive various types of information provided by the server device 100 and requests for various types of information from the server device 100 via the communication unit 11.

[0059] (Processing section 33) The processing unit 33 controls the entire terminal device 10, including the display unit 12, etc. For example, the processing unit 33 can output various information transmitted by the transmission unit 31 and various information received from the server device 100 by the reception unit 32 to the display unit 12 for display.

[0060] The processing unit 33 may identify a combination of a sending user (sender) and a receiving user (receiver) by identifying a communication partner with which messages and the like are exchanged via the communication unit 11, and may store and manage the exchanges (communication contents such as messages) between the sending user and the receiving user. In this case, the user U of the terminal device 10 and the communication partner are the sending user (sender) or the receiving user (receiver).

[0061] The processing unit 33 may also extract past interactions related to a current interaction between the sending user and the receiving user, create a summary of the extracted past interactions, and provide the summary of the past interactions to the sending user or the receiving user while the current interaction is taking place.

[0062] (Storage unit 40) The storage unit 40 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk drive (HDD), a solid state drive (SSD), an optical disk, etc. Various programs and various data are stored in the storage unit 40.

[0063] [4. Example of Server Device Configuration] Next, the configuration of the server device 100 according to the embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the server device 100 according to the embodiment. As shown in Fig. 3, the server device 100 includes a communication unit 110, a storage unit 120, and a control unit 130.

[0064] (Communication unit 110) The communication unit 110 is realized by, for example, a network interface card (NIC), etc. The communication unit 110 is also connected to a network N in a wired or wireless manner.

[0065] (Storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a HDD, an SSD, an optical disk, etc. The storage unit 120 may store attribute information and history information (log data) of the user U together with identification information (such as a user ID) indicating the user U.

[0066] The storage unit 120 may also store combinations of sending-side users and receiving-side users. The storage unit 120 may also store exchanges between sending-side users and receiving-side users. For example, the storage unit 120 may store the contents of messages or calls transmitted and received between the sending-side user and the receiving-side user for each combination of the sending-side user and the receiving-side user. The storage unit 120 may also store a summary (list, summary, main points, etc.) of past exchanges between the sending-side user and the receiving-side user.

[0067] (Control unit 130) The control unit 130 is a controller, and is realized by, for example, a central processing unit (CPU), a micro processing unit (MPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., executing various programs (corresponding to an example of an information processing program) stored in a storage device inside the server device 100 using a storage area such as a RAM as a working area. In the example shown in FIG. 3, the control unit 130 has an acquisition unit 131, a specification unit 132, a relay unit 133, a management unit 134, an extraction unit 135, a creation unit 136, and a provision unit 137.

[0068] (Acquisition part 131) The acquisition unit 131 acquires a search query input by a user U (user). For example, when the user U inputs a search query into a search engine or the like to perform a keyword search, the acquisition unit 131 acquires the search query via the communication unit 110. That is, the acquisition unit 131 acquires, via the communication unit 110, a keyword input by the user U into a search box of a search engine, a site, or an app.

[0069] Furthermore, the acquisition unit 131 acquires user information regarding the user U via the communication unit 110. For example, the acquisition unit 131 acquires identification information (such as a user ID) indicating the user U, location information of the user U, attribute information of the user U, and the like from the terminal device 10 of the user U. Furthermore, the acquisition unit 131 may acquire the identification information indicating the user U, attribute information of the user U, and the like when the user U is registered. Then, the acquisition unit 131 stores the user information in the storage unit 120.

[0070] Furthermore, the acquisition unit 131 acquires various types of history information (log data) indicating the behavior of the user U via the communication unit 110. For example, the acquisition unit 131 acquires various types of history information indicating the behavior of the user U from the terminal device 10 of the user U, or from various servers based on a user ID or the like. Then, the acquisition unit 131 stores the various types of history information in the storage unit 120.

[0071] Furthermore, the acquisition unit 131 acquires an exchange between a sending user (sender) and a receiving user (receiver) via the communication unit 110. For example, the acquisition unit 131 acquires the contents of a message or a call transmitted and received between the sending user and the receiving user.

[0072] (Specific Section 132) The identification unit 132 identifies a combination of a sending user and a receiving user. For example, the identification unit 132 identifies the sending user and the receiving user through user authentication or the like, and identifies the combination of the sending user and the receiving user. The identification unit 132 may also identify a group to which the sending user and the receiving user belong.

[0073] (Relay section 133) The relay unit 133 relays (transfers) communication between the sending user and the receiving user via the communication unit 110. In other words, the relay unit 133 enables two-way communication between the sending user and the receiving user. The relay unit 133 may provide a chat room in which the sending user and the receiving user can participate.

[0074] (Management Department 134) The management unit 134 accumulates and manages interactions (communication contents such as messages) between the sending user and the receiving user. For example, the management unit 134 stores an archive of interactions between the sending user and the receiving user. When storing interactions between the sending user and the receiving user, the management unit 134 may add information regarding the date and time and the place (location) at which the interactions between the sending user and the receiving user were performed and manage them. The management unit 134 may also accumulate and manage interactions between the sending user and the receiving user on a group basis.

[0075] (Extraction part 135) The extraction unit 135 extracts another exchange (past exchange, etc.) related to the current exchange between the sending user and the receiving user. For example, the extraction unit 135 extracts another exchange related to the topic of the message or call exchanged between the sending user and the receiving user. The extraction unit 135 also extracts another exchange related to a keyword or image included in the message exchanged between the sending user and the receiving user.

[0076] Alternatively, the extraction unit 135 extracts a common past behavior history between the sending user and the receiving user related to the current interaction as another interaction related to the current interaction between the sending user and the receiving user.

[0077] Furthermore, the extraction unit 135 checks whether the combination of the sending user and the receiving user is the same, and then extracts another exchange related to the current exchange between the sending user and the receiving user.

[0078] (Creation Department 136) The creation unit 136 creates a summary (a list, a summary, a main point, etc.) of the extracted other exchanges.

[0079] (Providing Department 137) The providing unit 137 provides a summary of another exchange to the sending user or the receiving user while a current exchange is being carried out.

[0080] In addition, the providing unit 137 confirms the identity of the combination of the sending user and the receiving user, and then provides a summary of another exchange to the sending user or the receiving user while the current exchange is in progress.

[0081] 5. Processing Procedure Next, a processing procedure by the server device 100 according to the embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the processing procedure according to the embodiment. Note that the processing procedure shown below is repeatedly executed by the control unit 130 of the server device 100.

[0082] For example, as shown in FIG. 4, the identifying unit 132 of the server device 100 identifies the sending user by user authentication or the like (step S101).

[0083] Next, the identification unit 132 of the server device 100 identifies the receiving user by user authentication or the like (step S102).

[0084] Next, the identifying unit 132 of the server device 100 identifies a combination of a sending user and a receiving user (step S103).

[0085] Next, the relay unit 133 of the server device 100 relays (transfers) the communication between the sending user and the receiving user via the communication unit 110 (step S104).

[0086] Next, the management unit 134 of the server device 100 accumulates and manages the exchanges between the sending user and the receiving user (step S105).

[0087] Next, the extracting unit 135 of the server device 100 extracts another exchange related to the current exchange between the sending-side user and the receiving-side user on another occasion (step S106).

[0088] Next, the creation unit 136 of the server device 100 creates a summary (a list, a summary, a main point, etc.) of the extracted other exchanges (step S107).

[0089] Next, the providing unit 137 of the server device 100 provides a summary of another exchange to the sending-side user or the receiving-side user while the current exchange is being carried out (step S108).

[0090] 6. Modifications The above-described terminal device 10 and server device 100 may be implemented in various different forms other than the above-described embodiment. Therefore, the following describes modifications of the embodiment.

[0091] In the above embodiment, some or all of the processing executed by the server device 100 may actually be executed by the terminal device 10. For example, the processing may be completed in a stand-alone manner (by the terminal device 10 alone). In this case, the terminal device 10 is assumed to have the functions of the server device 100 in the above embodiment. Also, in the above embodiment, since the terminal device 10 works in conjunction with the server device 100, from the perspective of the user U, it appears that the processing of the server device 100 is also executed by the terminal device 10. In other words, from another perspective, it can be said that the terminal device 10 is equipped with the server device 100.

[0092] In the above embodiment, the terminal device 10 of the sending user (sender) or the receiving user (receiver) may create a summary by extracting images that are highly related to images included in the current exchange between the sending user and the receiving user from a camera roll (an area for storing photo images). Alternatively, the server device 100 may create a summary by collecting images stored in the camera rolls of the terminal devices 10 of the sending user and the receiving user, or may create a summary by individually storing or sharing images in the camera rolls of each terminal device 10.

[0093] In the above embodiment, the server device 100 may extract content related to the current exchange between the sending user and the receiving user (related content), and create and provide a summary of the related content. For example, the server device 100 may create and provide a summary of article content such as news that is currently being discussed between the sending user and the receiving user as the related content.

[0094] In the above embodiment, the terminal device 10 of the sending user (sender) or the receiving user (receiver), or the server device 100, may accumulate and store interactions that have been performed in an app other than the app that is performing the current interaction between the sending user and the receiving user, and create and provide a summary of interactions that have been performed in the other app related to the current interaction. That is, the terminal device 10 or the server device 100 may create and provide a summary of interactions across apps.

[0095] [7. Effects] As described above, the information processing device (terminal device 10 and server device 100) of the present application is characterized by comprising an identification unit 132 that identifies a combination of a sending user and a receiving user, a management unit 134 that accumulates and manages interactions between the sending user and the receiving user, an extraction unit 135 that extracts another interaction related to a current interaction between the sending user and the receiving user, a creation unit 136 that creates a summary of the other extracted interactions, and a provision unit 137 that provides a summary of the other interactions to the sending user or the receiving user while the current interaction is taking place.

[0096] The identification unit 132 identifies a transmitting user, identifies a receiving user, and identifies a combination of the transmitting user and the receiving user.

[0097] The identifying unit 132 identifies the group to which the sending user and the receiving user belong. The management unit 134 accumulates and manages exchanges between the sending user and the receiving user on a group basis.

[0098] The extraction unit 135 extracts other exchanges related to the topic of the message or call being transmitted and received between the sending user and the receiving user.

[0099] The extraction unit 135 extracts other exchanges related to keywords or images included in messages exchanged between the sending user and the receiving user.

[0100] The extraction unit 135 extracts a common past behavior history between the sending user and the receiving user that is related to a current exchange between the sending user and the receiving user.

[0101] The extraction unit 135 checks whether the combination of the sending user and the receiving user is the same, and then extracts another exchange related to the current exchange between the sending user and the receiving user.

[0102] The providing unit 137 confirms the identity of the combination of the sending user and the receiving user, and then provides a summary of another exchange to the sending user or the receiving user while the current exchange is being carried out.

[0103] By using any one or a combination of the above-mentioned processes, the information processing device of the present application can present a summary of the content that has been exchanged in the past between the information processing device and a specific party while communicating with the specific party.

[0104] [8. Hardware Configuration] Moreover, the terminal device 10 and the server device 100 according to the above-described embodiment are realized by a computer 1000 having a configuration as shown in Fig. 5, for example. The server device 100 will be described below as an example. Fig. 5 is a diagram showing an example of a hardware configuration. The computer 1000 is connected to an output device 1010 and an input device 1020, and has a configuration in which a calculation device 1030, a primary storage device 1040, a secondary storage device 1050, an output I / F (Interface) 1060, an input I / F 1070, and a network I / F 1080 are connected by a bus 1090.

[0105] The arithmetic device 1030 operates based on programs stored in the primary storage device 1040 and the secondary storage device 1050, programs read from the input device 1020, and the like, and executes various processes. The arithmetic device 1030 is realized by, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like.

[0106] The primary storage device 1040 is a memory device such as a RAM (Random Access Memory) that primarily stores data used by the arithmetic device 1030 for various calculations. The secondary storage device 1050 is a storage device in which data used by the arithmetic device 1030 for various calculations and various databases are registered, and is realized by a ROM (Read Only Memory), an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. The secondary storage device 1050 may be an internal storage device or an external storage device. The secondary storage device 1050 may be a removable storage medium such as a USB (Universal Serial Bus) memory or an SD (Secure Digital) memory card. The secondary storage device 1050 may be a cloud storage (online storage), a NAS (Network Attached Storage), a file server, or the like.

[0107] The output I / F 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various types of information, such as a display, a projector, a printer, etc., and is realized by a connector conforming to a standard such as USB (Universal Serial Bus), DVI (Digital Visual Interface), or HDMI (registered trademark) (High Definition Multimedia Interface). The input I / F 1070 is an interface for receiving information from various input devices 1020, such as a mouse, a keyboard, a keypad, a button, a scanner, etc., and is realized by a USB, etc.

[0108] Furthermore, the output I / F 1060 and the input I / F 1070 may be wirelessly connected to the output device 1010 and the input device 1020, respectively. That is, the output device 1010 and the input device 1020 may be wireless devices.

[0109] The output device 1010 and the input device 1020 may be integrated into one device, such as a touch panel. In this case, the output I / F 1060 and the input I / F 1070 may also be integrated into one device, such as an input / output I / F.

[0110] The input device 1020 may be a device that reads information from, for example, an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0111] The network I / F 1080 receives data from other devices via the network N and sends it to the arithmetic device 1030, and also transmits data generated by the arithmetic device 1030 to other devices via the network N.

[0112] The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output I / F 1060 and the input I / F 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040 and executes the loaded program.

[0113] For example, when the computer 1000 functions as the server device 100, the arithmetic unit 1030 of the computer 1000 executes a program loaded onto the primary storage device 1040 to realize the functions of the control unit 130. The arithmetic unit 1030 of the computer 1000 may also load a program acquired from another device via the network I / F 1080 onto the primary storage device 1040 and execute the loaded program. The arithmetic unit 1030 of the computer 1000 may also cooperate with the other device via the network I / F 1080 and use functions and data of a program by calling them from another program of the other device.

[0114] [9. Others] Although the embodiments of the present application have been described above, the present invention is not limited to the contents of these embodiments. The above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments.

[0115] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

[0116] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0117] For example, the above-mentioned server device 100 may be realized by multiple server computers, and depending on the functions, the configuration can be flexibly changed, such as by calling an external platform using an API (Application Programming Interface) or network computing.

[0118] Furthermore, the above-described embodiments and modifications can be appropriately combined as long as the processing contents are not contradictory.

[0119] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit", etc. For example, an acquisition section can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0120] 1. Information Processing Systems 10 Terminal Equipment 100 Server device 110 Communications Department 120 Storage section 130 Control section 131 Acquisition Department 132 Specific part 133 Relay Section 134 Management Department 135 Extraction part 136 Creation Department 137 Provision Department

Claims

1. An identification unit that identifies a combination of a sending user and a receiving user; a management unit that accumulates and manages the exchanges between the sending user and the receiving user; an extractor for extracting another interaction related to a current interaction between the sending user and the receiving user; A creation unit that creates a summary of the extracted other exchanges; a providing unit for providing a summary of the other interaction to the sending user or the receiving user during a current interaction; An information processing device comprising:

2. The identification unit identifies the sending user, identifies the receiving user, and identifies a combination of the sending user and the receiving user.

2. The information processing apparatus according to claim 1,

3. The identification unit identifies a group to which the sending user and the receiving user belong; The management unit accumulates and manages exchanges between the sending users and the receiving users on a group basis.

2. The information processing apparatus according to claim 1,

4. The extraction unit extracts other exchanges related to the topic of the message or call being transmitted and received between the sending user and the receiving user.

2. The information processing apparatus according to claim 1,

5. The extraction unit extracts other exchanges related to a keyword or an image included in a message transmitted and received between the sending user and the receiving user.

2. The information processing apparatus according to claim 1,

6. The extraction unit extracts a common past behavior history between the sending user and the receiving user that is associated with a current exchange between the sending user and the receiving user.

2. The information processing apparatus according to claim 1,

7. The extraction unit confirms the identity of the combination of the sending user and the receiving user, and then extracts another exchange related to the current exchange between the sending user and the receiving user.

2. The information processing apparatus according to claim 1,

8. The providing unit confirms the identity of the combination of the sending user and the receiving user, and then provides the sending user or the receiving user with a summary of the other exchange while the current exchange is being performed.

2. The information processing apparatus according to claim 1,

9. An information processing method executed by an information processing device, a step of identifying a combination of a sending user and a receiving user; a management step of storing and managing the exchanges between the sending user and the receiving user; extracting another interaction related to a current interaction between the sending user and the receiving user; A creating step of creating a summary of the extracted other interactions; providing a summary of the other interaction to the sending user or the receiving user during a current interaction; 13. An information processing method comprising:

10. an identification procedure for identifying a combination of a sending user and a receiving user; a management procedure for storing and managing communications between the sending user and the receiving user; an extraction step for extracting another interaction related to a current interaction between the sending user and the receiving user; A creation step of creating a summary of the extracted other interactions; a providing step of providing a summary of the other exchange to the sending user or the receiving user during a current exchange; An information processing program characterized by causing a computer to execute the above.

Images