Systems, information processing methods, servers, and programs

Abstract

This helps to prevent situations where the relationship remains ambiguous regarding whether or not to continue. [Solution] The server matches two users based on information of two or more users associated with two or more terminals, and at each stage of the dating step which includes two or more stages, it performs the following processing: (a) transmits information of the call between the two users to the two terminals associated with the two users and displays the call screen; (b) receives a confirmation displayed on the two terminals in response to the end of the call between the two users, asking whether they wish to proceed to the next stage of the dating step; and (c) if a response indicating a desire to proceed to the next stage of the dating step is received from both terminals, it proceeds the dating step of the two users to the next stage. In the first stage of the dating step, the above processing is performed for voice-only calls.

Description

Technical Field

[0001] The present invention relates to a system, an information processing method, a server, and a program.

Background Art

[0002] Conventionally, matching services for encounters using the Internet have been provided. In particular, services that support the establishment of not only temporary matches but also continuous relationships have been provided.

[0003] For example, Patent Document 1 describes a mail transmission / reception system including a management computer including a Web server for user registration, a database for storing user information, and a mail server for providing a mailbox having a folder configuration according to the stage of courtship, and a user terminal. In the mail transmission / reception system, examples of the stages of courtship include application, mail courtship, telephone courtship, photo exchange, and arranged date. The user proceeds with courtship by exchanging mails with the courtship partner using the folder corresponding to the stage of courtship.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the technique described in Patent Document 1, there may be a situation where it is ambiguous whether to continue the courtship. For example, at the stage of mail courtship or telephone courtship, if there is no reply from the courtship partner to the mail from the user, the user falls into an ambiguous state as to whether to continue the courtship. And as long as no reply comes, that ambiguous state continues.

[0006] One of the objectives of this invention is to provide a system, information processing method, server, and program that can prevent situations from arising where it is unclear whether or not to continue a relationship. [Means for solving the problem]

[0007] A server according to one embodiment of the present invention comprises a communication unit and a control unit, the communication unit communicates with two or more terminals, the control unit matches two users from among the two or more users based on information of two or more users associated with each of the two or more terminals stored in a storage unit, and performs processing at each stage of a dating step including at least two stages, including (a) transmitting information of a call between the two users to each of the two terminals associated with the two users via the communication unit to display a call screen, (b) receiving a response from each of the two terminals via the communication unit to a confirmation displayed on the two terminals in response to the end of a call between the two users, asking whether they wish to proceed to the next stage of the dating step, and (c) if a response indicating a desire to proceed to the next stage of the dating step is received from both terminals, moving the two users to the next stage of the dating step, and in the first stage of the dating step, the above processing is performed for voice-only calls.

[0008] An information processing method according to one embodiment of the present invention involves a computer communicating with two or more terminals, matching two users from among the two or more users based on information of two or more users associated with each of the two or more terminals, and in each stage of a dating step that includes at least two stages, the computer performs the following processes: (a) transmits information about a call between the two users to each of the two terminals associated with the two users and displays a call screen; (b) receives a response from each of the two terminals to a confirmation displayed on the two terminals in response to the end of a call between the two users, asking whether they wish to proceed to the next stage of the dating step; and (c) if a response indicating a desire to proceed to the next stage of the dating step is received from both terminals, the computer moves the two users to the next stage of the dating step, and in the first stage of the dating step, the computer performs the above processing for voice-only calls.

[0009] A system according to another embodiment of the present invention includes two or more terminals and a server that communicates with the two or more terminals, and comprises a storage unit and a control unit, wherein the storage unit stores information of two or more users associated with each of the two or more terminals, and the control unit matches two users from among the two or more users based on the information of the two or more users, and performs processing at each stage of a dating step which includes at least two stages, including (a) displaying a call screen between the two users on each of the two terminals associated with the two users, (b) displaying a confirmation on each of the two terminals whether they wish to proceed to the next stage of the dating step in response to the end of the call between the two users, and (c) if a response indicating a desire to proceed to the next stage of the dating step is entered on both of the two terminals, the system performs processing for the two users in the dating step which is the next stage, and in the first stage of the dating step, the above processing is performed for voice-only calls.

[0010] A program according to another embodiment of the present invention is a program that causes a processor to perform the following processes at each stage of a dating step, which includes at least two stages: (a) receiving information from a server about a call between two users matched from among two or more users; (b) displaying a call screen based on the received call information; (c) displaying a confirmation as a series of processes following the termination of the call between the two users, asking whether the user wishes to proceed to the next stage of the dating step; and (d) sending the response entered to the confirmation of whether the user wishes to proceed to the next stage of the dating step to the server, wherein in the first stage of the dating step, the above processes are performed for voice-only calls. [Effects of the Invention]

[0011] According to one aspect of the present invention, it is possible to suppress the occurrence of a situation where it is unclear whether or not to continue the relationship. [Brief explanation of the drawing]

[0012] [Figure 1] This figure shows an example of the system configuration related to one embodiment of the present invention. [Figure 2] This figure shows an example of a user matching screen. [Figure 3] This is a diagram showing an example of a voice call screen. [Figure 4] This figure shows an example of confirming the continuation of a call. [Figure 5] This figure shows an example of confirming the continuation of a relationship. [Figure 6] This figure shows an example of a video call screen (without showing face). [Figure 7] This diagram shows an example of a video call screen (with face visible). [Figure 8] This figure shows an example of a message exchange screen. [Figure 9] A sequence diagram illustrating an example of the overall flow of processing performed by the system. [Figure 10] This is a sequence diagram showing an example of the user matching process flow. [Figure 11] It is a sequence diagram showing an example of the processing flow in the first voice call. [Figure 12] It is a sequence diagram showing an example of the processing flow in the second voice call. [Figure 13] It is a sequence diagram showing an example of the processing flow in a video call. [Figure 14] It is a sequence diagram showing an example of the processing flow in a real date.

Embodiments of the Invention

[0013] <1. Overview> Conventional matching services (so-called matching apps) mainly provide users with external information such as the appearance of matching candidates. Based on this external information, users make judgments regarding relationship building. However, little information other than external information is provided. Therefore, it is difficult for users to make judgments based on internal characteristics of people such as the personality or communication ability of matching candidates. This can be a factor that makes it difficult to have various encounters. Also, since conventional matching services mainly focus on having an encounter once, they have not been able to support the construction of a deep relationship (that is, the construction of a continuous relationship). Therefore, the system according to an embodiment of the present invention provides a voice-only call in the first call, provides a call including a camera image in calls after the second call, and confirms the transition to the next dating step in response to the end of each call. Note that the call includes a voice-only call (that is, a voice call) and a call including a camera image and voice (that is, a video call).

[0014] <2. Configuration> Referring to FIG. 1, a system according to an embodiment of the present invention will be described. FIG. 1 is a diagram showing an example of the configuration of system 1 according to this embodiment. System 1 includes terminals 100A and 100B (hereinafter also collectively referred to as terminal 100) and server 200.

[0015] The terminal 100 includes an input / output unit 110, a control unit 120, a storage unit 130, and a communication unit 140. For example, the terminal 100 may be a smartphone or a PC (Personal Computer).

[0016] The input / output unit 110 performs input / output in cooperation with the control unit 120. Specifically, the input / output unit 110 outputs the images and sounds provided by the control unit 120. Also, the input / output unit 110 receives various inputs and provides the input information to the control unit 120. The content of the input may be, for example, operations on the screen displayed by the input / output unit 110 as an image, video around the terminal 100 (e.g., camera video), and sounds around the terminal 100. The input / output unit 110 may be realized by a touch panel display, a speaker, a camera, and a microphone. Also, instead of or together with the touch panel display, a display and a keyboard or a mouse may be used.

[0017] The control unit 120 controls the processing of the terminal 100. Specifically, the control unit 120 causes the input / output unit 110 to output images and sounds based on the information received by the communication unit 140 from the server 200. Also, the control unit 120 generates information according to the input received by the input / output unit 110 and causes the communication unit 140 to transmit the generated information to the server 200. Also, the control unit 120 reads and writes information to and from the storage unit 130. The control unit 120 may be realized by a processor and a memory. The processor realizes the functions of the control unit 120 by reading and executing the program of the control unit 120 from the memory. For example, the processor may include a CPU (Central Processing Unit), and a GPU (Graphics Processing Unit) may be used in combination. The memory may include a ROM (Read Only Memory), a RAM (Random Access Memory), and a flash memory. Note that the control unit 120 may be an application that operates on an OS (Operating System) and may perform various controls by using the functions of the OS.

[0018] The storage unit 130 stores information used for processing by the terminal 100. Specifically, the storage unit 130 stores information received by the communication unit 140 from the server 200, information generated by the control unit 120, and input information from the input / output unit 110. The storage unit 130 may be implemented using storage such as flash memory, HDD (Hard Disk Drive), or SSD (Solid State Drive). The storage may also be external.

[0019] The communication unit 140 communicates with the server 200. Specifically, the communication unit 140 receives information from the server 200 to provide to the control unit 120, and transmits information provided by the control unit 120 to the server 200. For example, the communication unit 140 may be implemented by a communication module capable of wireless communication such as cellular communication using LTE (Long Term Evolution) (registered trademark) or 5G, or communication using WiFi (registered trademark) or Bluetooth (registered trademark). Alternatively, a communication module capable of wired communication may be used instead of or in conjunction with a communication module capable of wireless communication.

[0020] The server 200 comprises a communication unit 210, a control unit 220, and a storage unit 230. For example, the server 200 may be implemented by a single device, or by multiple devices using technologies such as cloud computing. The storage unit 230 may not be provided in the server 200, but may be another component connected to the server 200 in a communicative manner. For example, the storage unit 230 may be a NAS (Network Attached Storage).

[0021] The communication unit 210 communicates with multiple terminals 100. Specifically, the communication unit 210 receives information to be provided to the control unit 220 from multiple terminals 100 and transmits information provided by the control unit 220 to multiple terminals 100. For example, the communication unit 210 may have the functionality of a web server. The communication unit 210, like the communication unit 140, may be implemented by a communication module capable of wireless or wired communication.

[0022] The control unit 220 controls the processing of the server 200. Specifically, the control unit 220 processes information from the communication unit 210 and causes multiple terminals 100 to send information to the communication unit 210. The control unit 220 also reads and writes information to the storage unit 230. For example, the control unit 220 may include, as an application server function, a matching processing unit 221, a voice call processing unit 222, a video call processing unit 223, a message processing unit 224, a scheduling processing unit 225, and a topic provision processing unit 226. The operation of each processing unit will be described later. The control unit 220 may be implemented by one or more processors and one or more memories. The processor implements the functions of the control unit 220 by reading the program of the control unit 220 from memory and executing it. For example, the processor may include a CPU, and a GPU may be used in combination. The memory may include ROM, RAM, and flash memory.

[0023] The storage unit 230 stores information used for processing by the server 200. Specifically, the storage unit 230 stores user data D1, call data D2, message data D3, and topic data D4. User data D1 includes, for example, the user's ID (Identifier), profile information such as the user's age, address, hobbies, interests, likes and dislikes, income, education, occupation, and introductory text, the login status to system 1, a relationship status indicating the stage of a relationship step including at least two stages, and schedule information such as the date and time of the call. User data D1 may also include the user's account information in system 1. Call data D2 includes, for example, voice call data and video call data. Voice calls are voice-only calls. Voice calls may include avatars. Avatars may be still images or motion images (i.e., animated images). Motion images may be images that mimic the user's body, and parts of the image may move or the facial expression of the image may change in response to the movement of body parts (e.g., facial or hand movements). Avatar information may be stored in the memory unit 130 of terminal 100, and may be acquired from terminal 100 as part of call data and stored in the memory unit 230 of server 200 associated with the user's ID. A video call is a call that includes camera footage and audio. The camera footage may be processed. Message data D3 includes text and images. Topic data D4 includes various topics presented to the user during a call or message exchange. The memory unit 230 may be implemented by storage such as an HDD or SSD.

[0024] The control unit 120 of terminal 100 and the control unit 220 of server 200 can function as control units of system 1. The storage unit 130 of terminal 100 and the storage unit 230 of server 200 can function as storage units of system 1. Furthermore, in the following, the processing performed by the control unit 120 of terminal 100 using the input / output unit 110, storage unit 130, and communication unit 140 will also be expressed as terminal 100 performing the processing. In addition, the processing of terminal 100 is performed by an application installed on terminal 100. The operation of the application is defined by a program stored in terminal 100.

[0025] <3. Matching Process> The matching process will be explained with reference to Figure 2. The matching process is mainly performed by the matching processing unit 221 of terminal 100 and server 200. In the matching process, two users making a call are matched. Specifically, the matching processing unit 221 matches two users from among two or more users based on information of two or more users associated with each of the multiple terminals 100 stored in the storage unit 230. The information of two or more users includes user identifiers and may also include user login information. In addition, the information of two or more users may include at least the user's age and address. Furthermore, the matching processing unit 221 also matches two users from among two or more users based on information indicating the prohibition of matching two users (hereinafter also referred to as a prohibition flag).

[0026] First, the matching processing unit 221 extracts users whose login status to System 1 is "logged in" from among all users stored in the storage unit 230, based on the users who have logged into System 1. The matching processing unit 221 then filters the extracted users based on their profile information and a prohibition flag, which will be described later. Filtering conditions based on profile information may include that the age difference between the users is within a predetermined range, and that their addresses are in adjacent prefectures, adjacent cities, or within a predetermined distance by public transport. Users with a prohibition flag set are excluded from each other's filtering. For example, as shown in Figure 2, when the System 1 application is launched on terminal 100A, the matching screen 10 is displayed. The server 200 performs the above-described filtering on the users of terminal 100A.

[0027] The matching processing unit 221 randomly selects a user as a matching candidate from among the filtered users. One user may be selected, or multiple users may be selected. If multiple users are selected, the call partner is then determined from among them. The matching processing unit 221 transmits information about the selected user and information for making a call with that user to the terminal 100A via the communication unit 210. The user information transmitted to the terminal 100A may be the user's profile information. The information for making a call with the user may be a URL (Unform Resource Locator) for voice calls. The terminal 100A displays an overview of the received user information on the matching screen. For example, as shown in Figure 2, the terminal 100A receives information about the selected user from the server 200 and displays a matching screen 11 that includes an overview of the profile information, such as age, address, and hobbies, based on the selected user information. The matching processing unit 221 may also randomly select a user as a matching candidate from among all users without filtering.

[0028] Terminal 100A initiates a call based on the information needed for the call after a predetermined time has elapsed since the call preparation screen was displayed. For example, as shown in Figure 2, terminal 100A displays the call preparation screen 20. The call preparation screen 20 may display detailed profile information of the user selected as a matching candidate. After a predetermined time has elapsed since the display of the call preparation screen 20, terminal 100A accesses the server 200 using a URL for voice calls and initiates a voice call. The relationship status at the time of matching may be empty (i.e., the first stage of the relationship step). In the first stage of the relationship step, a voice call is processed.

[0029] <4. Voice Call Processing> The voice call processing will be explained with reference to Figures 3-5. Voice call processing is mainly performed by the voice call processing unit 222 of terminal 100 and server 200. In voice call processing, the voice call and topic are provided to the two users making the call. Specifically, information about the voice call between the two users (i.e., voice call data) is sent to terminals 100A and 100B associated with the two users, and the voice call screen is displayed. Furthermore, the topic of the call between the two users is displayed on the voice call screen. In the example in Figures 3-5, the voice call processing is explained for terminal 100A, but the same processing is performed for terminal 100B.

[0030] First, when a voice call is initiated based on the information required for making a call on terminals 100A and 100B, the voice call processing unit 222 transmits voice call data and topic to terminals 100A and 100B. The topic is provided by the topic provision processing unit 226. Terminals 100A and 100B output audio based on the received voice call data and display the provided topic.

[0031] For example, when a voice call is initiated, the voice data acquired by terminals 100A and 100B is transmitted to the server 200. The voice call processing unit 222 transmits the voice data from terminal 100A to terminal 100B via the communication unit 210, and transmits the voice data from terminal 100B to terminal 100A. The voice call processing unit 222 also transmits the topic of the voice call along with the voice data to terminals 100A and 100B.

[0032] When a voice call is initiated, terminal 100A displays the voice call screen 30. The voice call screen 30 displays the topic received from server 200. A display time is set for each topic, and the remaining display time may be displayed. When the remaining display time reaches 0, the topic may be removed or switched to another topic. For example, as shown in Figure 3, the topic may be switched as shown in voice call screens 30, 31, and 32. Details of topic switching will be described later. The voice call screen 30 may also display avatars of the two users making the call. The avatars may be icon images as shown in Figure 3, or motion images. Information about the avatar of the other party may be included in the call information (i.e., voice call data). Note that voice calls may also be conducted without avatars.

[0033] Furthermore, during a voice call, a confirmation will be made regarding whether to continue the call. Specifically, in a call between two users, after a predetermined amount of time has elapsed since the start of the call, but before the predetermined call time for each relationship step has elapsed, a confirmation will be displayed on the call screen regarding whether to continue the call. If a response indicating a desire to continue the call is received from both terminals 100A and 100B, the call between the two users will continue. If a response indicating a desire to continue the call is not received from at least one of terminals 100A and 100B, the call between the two users will end. In addition, if the call between the two users is an audio-only call, a confirmation regarding whether to continue the call will be displayed. If a response indicating a desire to continue the call is received from both terminals 100A and 100B, the topic will be changed. The number of times the confirmation regarding the continuation of the call is made during the call may be one or more times.

[0034] For example, terminals 100A and 100B, after a predetermined time (e.g., 5 minutes) has elapsed since the start of the voice call, but before the set call duration (e.g., 15 minutes) has elapsed, display the options "Yes" and "No" on the voice call screen 33, as shown in Figure 4, to confirm whether to continue the call. If both users select "Yes," terminals 100A and 100B continue the voice call. If at least one of the two users selects "No," terminals 100A and 100B terminate the voice call. Alternatively, a response time (e.g., 30 seconds) may be set for the confirmation of whether to continue the call, and if at least one of the two users does not respond within the response time, the voice call may be terminated. Also, if both users select "Yes," terminals 100A and 100B restore the content displayed on the voice call screen and switch the displayed topic. The voice call may also be terminated based on user operation. For example, the voice call may be terminated by pressing the call termination button displayed in the upper right corner of each voice call screen 30-32 shown in Figure 3. A confirmation message may appear before ending a voice call asking if it is okay to end it.

[0035] Then, upon the end of the voice call between the two users due to the elapsed predetermined call time, a confirmation message is displayed on both terminals 100A and 100B asking whether they wish to proceed to the next stage of the dating steps as part of the process following the ended voice call. If a response indicating a desire to proceed to the next stage of the dating steps is received from both terminals 100A and 100B, the dating steps of the two users are advanced to the next stage. In this case, the dating steps of the two users are stored in association with the identification information of each of the two users. The confirmation message regarding the desire to proceed to the next stage of the dating steps is displayed on the voice call screen after the end of the voice call between the two users. The voice call between the two users is controlled based on the type of call and call duration predetermined for each stage of the dating steps. In addition, one or more functions or one or more constraints may be set for each stage of the dating steps. For example, the dating steps may include the first stage where the first voice call is scheduled, the second stage where the second voice call is scheduled, the third stage (a predetermined stage after the first stage) where a video call is scheduled, the fourth stage (a predetermined stage after the above predetermined stage) where messaging or scheduling a meeting is scheduled, and the fifth stage where all functions are set up. In the fifth stage, some or all functions may be restricted to users other than the dating partner. Each stage may also be called by a different name. For example, the fifth stage may be called "formal dating". In the stages where calls are scheduled, a call duration may be set. In addition, conditions for transitioning to each stage may be set. For example, the condition for transitioning to the second stage may be that one voice call has been completed and the transition to the next stage of the dating steps has been agreed upon. The condition for transitioning to the third stage may be that two voice calls have been completed and the transition to the next stage of the dating steps has been agreed upon. The condition for transitioning to the fourth stage may be that a video call has been completed and the transition to the next stage of the dating steps has been agreed upon.

[0036] For example, terminals 100A and 100B terminate the voice call after a set call time (e.g., 15 minutes) has elapsed since the start of the voice call. Then, as shown in Figure 5, terminals 100A and 100B display the options "Yes" and "No" on the voice call screen 34 to confirm whether the user wants to talk to the other party again. If both users select "Yes," the voice call processing unit 222 updates the relationship status associated with the IDs of the two users stored in the storage unit 230 to the second voice call stage (i.e., the second stage) if the status is empty (i.e., the first stage). If the stored relationship status is the second stage, the relationship status is updated to the video call stage (i.e., the third stage). In other words, updating to the second or third stage corresponds to a transition to a state where a call is possible in the next stage of the relationship step. Terminals 100A and 100B display the voice call screen 35 indicating that they have advanced to the next stage of the relationship step. If at least one of the two users selects "No," terminals 100A and 100B close the voice call screen 34. Alternatively, a response time (e.g., 30 seconds) may be set for confirming the transition to the next step in the relationship, and if at least one of the two users does not respond within that time, the voice call screen 34 may be closed.

[0037] Here, it is undesirable for two users, at least one of whom does not wish to continue the relationship, to be matched again. Therefore, a prohibition flag is set for these two users. As a result, they will be excluded from being matched candidates in subsequent matching processes. Specifically, if a response indicating a desire to not continue the call is received from at least one of terminals 100A and 100B, or if a response to the confirmation of whether they wish to continue the call is not received from at least one of terminals 100A and 100B within a predetermined time after the display of the confirmation of whether they wish to continue the call, information indicating that matching of the two users is prohibited is stored in association with the respective identification information of the two users. Also, if a response indicating a desire to move to the next stage of the relationship is received from at least one of terminals 100A and 100B, or if a response to the confirmation of whether they wish to move to the next stage of the relationship is not received from at least one of terminals 100A and 100B within a predetermined time after the display of the confirmation of whether they wish to move to the next stage of the relationship, information indicating that matching of the two users is prohibited is stored in association with the respective identification information of the two users. In this case, if the stages of the relationship steps between the two users associated with the identification information of each of the two users are stored, those associated stages of the relationship steps between the two users will be deleted.

[0038] For example, if at least one of the two users selects "No" to the option shown in Figure 4 for confirming whether to continue the call, or if at least one of the two users does not respond within the response time, a ban flag may be set for those two users. Similarly, if at least one of the two users selects "No" to the option shown in Figure 5 for confirming whether they want to talk to the other user again, or if at least one of the two users does not respond within the response time, a ban flag may be set for those two users. In addition, along with setting the ban flag, the relationship status associated with each of the two users' IDs may be deleted.

[0039] Furthermore, if two users wish to move to the next stage of the dating process (for example, the second or third stage), the scheduling process will arrange a date and time for the call at the next stage of the dating process. The date and time of the call at the next stage of the dating process will be determined through scheduling and stored in the memory unit 230.

[0040] Immediately before the scheduled date and time of the voice call, the two users scheduled to make the call will be able to initiate the voice call. Specifically, two hours before the date and time of the voice call in the next stage of the relationship, terminals 100A and 100B will be able to initiate the voice call in the next stage of the relationship. For example, terminals 100A and 100B will activate the voice call button five minutes before the date and time of the second voice call that is stored in the memory. The second time mentioned above may be the same as the first time (e.g., five minutes) when the last notification is made. The voice call button may be hidden before it is activated.

[0041] If one of the two users does not participate in the scheduled voice call when the scheduled date and time arrives, the voice call will be terminated. Specifically, in response to an operation to start a voice call in the next stage of the dating step, the voice call for the next stage of the dating step is started, and if at least one of the two users does not participate in the voice call within a predetermined time elapsed from the date and time of the voice call for the next stage of the dating step, the voice call for the next stage of the dating step is terminated. For example, when terminal 100A presses the voice call button, it accesses server 200 using the URL for the second voice call and starts the voice call. On the other hand, terminal 100B does not access server 200 because the application of system 1 is not running, and therefore the voice call is not started. If there is no access from terminal 100B within a predetermined time elapsed from the date and time of the second voice call, the voice call processing unit 222 of server 200 sends a voice call termination instruction to terminal 100A. Terminal 100A terminates the voice call upon receiving the voice call termination instruction. Furthermore, terminal 100A may terminate the voice call after a predetermined time has elapsed since the start of the second voice call, without receiving an instruction from the voice call processing unit 222 to terminate the voice call. In this way, if the call is terminated because one of the two users does not participate, scheduling may be attempted again. Alternatively, a prohibition flag may be set for the two users in question without scheduling being attempted.

[0042] <5. Scheduled Processing> Please refer to Figure 5 for an explanation of the scheduling process. The scheduling process is mainly performed by the scheduling processing unit 225 of terminal 100 and server 200. In the scheduling process, for two users who wish to move to the next stage of the dating step, scheduling is performed for activities in the next stage of the dating step. Specifically, if a response indicating a desire to move to the next stage of the dating step is received from both terminal 100A and 100B, a confirmation message is displayed asking if they wish to move to the next stage of the dating step, followed by a list of possible dates and times for the next stage of the dating step displayed to terminals 100A and 100B respectively. If the dates and times selected from the date and time candidates received from terminals 100A and 100B match, the matching date and time is stored as the date and time of the call in the next stage of the dating step, associated with the identification information of each of the two users. Before the call between the two users, the dates and times when the two users are available to talk, received from terminals 100A and 100B, are stored, and the date and time candidates are determined based on the dates and times when the two users are available to talk.

[0043] For example, as shown in Figure 5, terminals 100A and 100B display a button to transition to the scheduling screen 40 on the voice call screen 35, which indicates that they have progressed to the next stage of the dating steps. When the transition button is pressed, the scheduling screen 40 is displayed. When the "Send Schedule" button is pressed on the scheduling screen 40, the available dates and times that the user has previously entered are displayed as date and time candidates. The available dates and times that the user has previously entered may be stored in the storage unit 230 of the server 200, and may be read by the scheduling processing unit 225 in response to the pressing of the "Send Schedule" button and sent to terminals 100A and 100B. When the two users select their desired dates and times from the displayed date and time candidates, the selected desired dates and times are sent from terminals 100A and 100B to the server 200. The scheduling processing unit 225 stores in the storage unit 230 the date and time that matches the desired dates and times of the two users from the received desired dates and times as the date and time of the second voice call (or video call).

[0044] As the scheduled date and time of a call approaches, the scheduled voice call is notified. Specifically, one hour before the date and time of the call in the next stage of the relationship, terminals 100A and 100B each notify a reminder of the call in the next stage of the relationship. For example, 24 hours before the date and time of the second voice call stored in the system, the scheduling processing unit 225 sends a reminder instruction for the second voice call to terminals 100A and 100B. Upon receiving the reminder instruction, terminals 100A and 100B display a notification (i.e., a reminder notification) indicating that the second voice call is scheduled for 24 hours later. The reminder notification may be a notification sent via the OS (e.g., a push notification). The number of reminder notifications may be one or more. For example, the number of reminder notifications may be a total of three, 24 hours before, 1 hour before, and 5 minutes before the scheduled date and time of the call.

[0045] The above example illustrates scheduling for phone calls. However, the same scheduling process may be applied to scheduling in-person dates.

[0046] <6. Video Call Processing> The video call process will be explained with reference to Figures 6 and 7. The video call process is mainly performed by the video call processing unit 223 of terminal 100 and server 200. In the video call process, the video call and topic are provided to the two users making the call. Specifically, information about the video call between the two users (i.e., video call data) is sent to terminals 100A and 100B, and the video call screen is displayed. Furthermore, the topic of conversation between the two users is displayed on the video call screen. In the example in Figure 6, the video call process is explained for terminal 100A, but the same process is performed for terminal 100B.

[0047] First, when a video call is initiated based on the information required for making a call between terminals 100A and 100B, the video call processing unit 223 transmits video call data and topic to terminals 100A and 100B. The topic is provided by the topic provision processing unit 226. For example, when a video call is initiated, the audio data and camera video data (i.e., video call data) acquired by terminals 100A and 100B are transmitted to the server 200, respectively. The video call processing unit 223 transmits the video call data from terminal 100A to terminal 100B via the communication unit 210, and transmits the video call data from terminal 100B to terminal 100A. The video call processing unit 223 also transmits the topic of the video call along with the video call data to terminals 100A and 100B.

[0048] Here, if the call between two users is a video call, the camera image is turned off before a predetermined time has elapsed from the start of the call, and the camera image is turned on after the predetermined time has elapsed from the start of the call. Specifically, terminals 100A and 100B output only audio based on the received video call data and display the received topic until a predetermined time has elapsed from the start of the video call. After a predetermined time has elapsed from the start of the video call, terminals 100A and 100B start displaying the camera image based on the provided video call data. For example, when a video call is started, terminals 100A and 100B display a video call screen 50 with the camera image off, as shown in Figure 6. The video call screen 50 may display the topic received from the server 200, and may display the same content as the audio call screen (e.g., the user's avatar). Just before a predetermined time (e.g., 6 minutes) has elapsed from the start of the video call, terminals 100A and 100B display on the video call screen 50 a message indicating that the camera image will be switched on and the remaining time until the camera image is turned on. After a predetermined time has elapsed since the start of the video call, terminals 100A and 100B switch on the camera feed, as shown in Figure 7. User U2 is displayed on terminal 100A, and user U2 is displayed on terminal 100B. The topic received from server 200 is also displayed on the video call screens 51A and 51B when the camera feed is on. When the camera feed is off (hereinafter also referred to as the camera off state), some or all of the voice call processing, other than the processing related to confirming the continuation of the call, may be performed. In addition, the topic displayed may be changed when switching from the camera off state to the camera feed on state (hereinafter also referred to as the camera on state).

[0049] As mentioned above, in voice calls, a confirmation prompt is given during the call to ask whether the user wants to continue. However, in video calls, this confirmation prompt is not given. Specifically, if a call between two users is a video call, a confirmation prompt to continue the call is not displayed during the video call. For example, in a video call, the call continuation confirmation shown in Figure 4 is not displayed. Note that a video call may be terminated based on user action. For example, the video call may be terminated by pressing the end call button displayed in the upper right corner of each video call screen 51A and 51B shown in Figure 7. However, the end call button may be disabled until a predetermined time has elapsed since the camera image was turned on. This is because turning off the camera image immediately after meeting face-to-face may cause discomfort to the other party.

[0050] Then, upon the end of the video call between the two users due to the elapsed predetermined call time, a confirmation message is displayed on both terminals 100A and 100B asking whether they wish to proceed to the next stage of the dating steps as part of the process following the ended video call. In the third stage of the dating steps, if both terminals 100A and 100B respond that they wish to proceed to the next stage of the dating steps, the dating steps of the two users are advanced to the fourth stage, where message exchange or scheduling of a face-to-face meeting is set. In this case, the stage of the dating steps of the two users is stored in association with the identification information of each of the two users. The confirmation message asking whether they wish to proceed to the next stage of the dating steps is displayed on the video call screen after the video call between the two users has ended. Video calls between two users are controlled based on the type of call and call duration predetermined for each stage of the dating steps.

[0051] For example, terminals 100A and 100B end the video call after a set call time (e.g., 15 minutes) has elapsed since the start of the video call. Then, terminals 100A and 100B display the option "Yes" or "No" on the video call screen to confirm whether the user on the other end of the call wants to go on a real date. If both users select "Yes," the video call processing unit 223 updates the relationship status associated with the IDs of the two users stored in the storage unit 230 to the third stage, if that status is currently at the fourth stage. That is, updating to the fourth stage corresponds to a transition to a state where message exchange is possible or where it is possible to schedule a meeting in person. Terminals 100A and 100B display a video call screen indicating that they have progressed to the next stage of the relationship steps. If at least one of the two users selects "No," terminals 100A and 100B close the video call screen. Alternatively, a response time (e.g., 30 seconds) may be set for confirming the transition to the next step in the relationship, and if at least one of the two users does not respond within that time, the video call screen may be closed.

[0052] Here, similar to voice calls, a "prohibited" flag is set for two users where at least one of them does not wish to proceed to the next step in the relationship. The process is substantially the same as that for voice calls, so the explanation is omitted.

[0053] Furthermore, the stages of the relationship between two users may be irreversible. For example, the transition from stage 2 to stage 3 is not restricted, but the transition from stage 3 to stage 2 is restricted. However, it may be possible to repeat the same stages of the relationship.

[0054] Furthermore, if two users wish to move to the next stage of the dating process (i.e., the fourth stage), the scheduling process described above will adjust the date and time for the next stage of the dating process. The date and time for the next stage of the dating process will be determined through this adjustment and stored in the memory unit 230.

[0055] Similar to voice calls, the two users scheduled for a video call will be able to initiate the call shortly before the scheduled date and time. The process is essentially the same as for voice calls, so a detailed explanation is omitted.

[0056] Furthermore, similar to voice calls, if one of the two users does not participate in the video call when the scheduled date and time arrives, the video call will be terminated. The process is essentially the same as that for voice calls, so we will omit the explanation.

[0057] <7. Message Processing> Refer to Figure 8 to explain message processing. Message processing is mainly performed by the message processing unit 224 of terminal 100 and server 200. In message processing, messages are exchanged between two users. In the example in Figure 8, message processing is explained for terminal 100A, but the same processing is performed for terminal 100B.

[0058] For example, when the interaction steps of two users move to the fourth stage (i.e., transition to a state where message exchange is possible), terminals 100A and 100B display the message exchange screen 60 as shown in Figure 8. When a message (e.g., text) is entered, as shown in message exchange screens 61 and 62 in Figure 8, the message data is sent to the server 200. The message processing unit 224 of the server 200 sends the received message data to terminal 100B and stores it in the storage unit 230. Terminal 100B displays a message based on the received message data.

[0059] Furthermore, scheduling for in-person dates may also be handled. Specifically, an action object for scheduling (e.g., an action button) will be displayed on the message exchange screen, and when the action button is pressed, the scheduling process for the aforementioned date will be initiated. Additionally, the aforementioned reminder notifications may be issued.

[0060] Furthermore, if a real-life date is scheduled, a confirmation will be made after the real-life date whether the couple wishes to continue the relationship. Specifically, after the scheduled date and time of the real-life date have passed, a confirmation will be displayed on both terminals 100A and 100B asking whether they wish to continue the relationship. If a response indicating a desire to continue the relationship is received from both terminals 100A and 100B, the relationship stage for both users will be maintained.

[0061] For example, terminals 100A and 100B display the options "Yes" and "No" on the message exchange screen to confirm whether they want to date their partner again. If both users select "Yes," the message processing unit 224 maintains the relationship status associated with the IDs of the two users stored in the storage unit 230. Terminals 100A and 100B display a message exchange screen indicating the continuation of the relationship. Alternatively, the message processing unit 224 may update the relationship status to the fifth stage (i.e., officially dating). Furthermore, in the fifth stage, some or all functions may be restricted for users other than the partner user. For example, in the fifth stage, matching or calling with users other than the partner user may be restricted. If at least one of the two users selects "No," terminals 100A and 100B close the message exchange screen. The message processing unit 224 transitions the two users to a state where message exchange is not possible. For example, the relationship status associated with the IDs of the two users may be deleted. Alternatively, a response period (e.g., one day) may be set for confirming the continuation of the relationship, and if at least one of the two users does not respond within that period, the two users may be switched to a state where they cannot exchange messages.

[0062] Here, for two users where at least one does not wish to continue the relationship, a prohibition flag is set for those two users. Specifically, if a response indicating a desire not to continue the relationship is received from at least one of terminals 100A and 100B, or if a response regarding whether to continue the relationship is not received from at least one of terminals 100A and 100B within a predetermined period from the scheduled real-life date and time, information indicating that the matching of the two users is prohibited is stored in association with the respective identification information of those two users.

[0063] For example, if at least one of two users selects "No" in response to an option to confirm whether they want to continue the relationship, or if at least one of the two users fails to respond within the response period, a ban flag may be set for those two users.

[0064] Furthermore, assistance for dating may be provided during message exchange. Specifically, the message processing unit 224 estimates content that will contribute to the progress of dating based on user data D1, call data D2, and message data D3 stored in the storage unit 230. The message processing unit 224 transmits data regarding the estimated content to terminals 100A and 100B. Terminals 100A and 100B display suggested messages based on the data regarding the received content.

[0065] For example, images or videos with geographical information provided by terminals 100A and 100B via the message exchange screen are stored in the storage unit 230. The message processing unit 224 estimates content that the two users might be interested in from the images or videos with geographical information. For example, if the geographical information is the address of an Italian restaurant, it is estimated that the two users are interested in Italian food. Also, if the image shows a torii gate, it is estimated that the two users are interested in Shinto shrines. Furthermore, anniversaries for the two users may be estimated from the content of the message and the date and time of input. The message processing unit 224 generates data related to the estimated content and sends it to terminals 100A and 100B. For example, the data related to the content may be lunch or dinner at a restaurant that serves food that the two users are interested in, a topic that the two users are both interested in, or a reminder or gift for an anniversary for the two users. Terminals 100A and 100B display the data related to the content as a suggestion message to the two users.

[0066] Furthermore, the above assistance may also be support for dating. Specifically, the message processing unit 224 generates a date plan based on the data stored in the memory unit 230 and sends the date plan to terminals 100A and 100B. Terminals 100A and 100B display the received date plan. For example, the generated date plan may include the date and time of the next date, location, menu, budget, and restaurant. Furthermore, if the two users approve the date plan, the reservation of the restaurant in the date plan may be made on their behalf. The above assistance may also be performed by an AI (Artificial Intelligence) model, and the AI ​​model may be updated by machine learning using data stored in the memory unit 230. For example, the message processing unit 224 generates input information based on at least a portion of user data D1 (e.g., user profile information), call data D2, or message data D3 stored in the memory unit 230. This input information includes instructions (e.g., prompts) for the AI ​​model. The message processing unit 224 inputs this input information to the AI ​​model. The AI ​​model outputs content or date plans that contribute to the progress of the relationship described above. For example, the AI ​​model may be an LLM (Large Language Model). Furthermore, instructions to the AI ​​model may include instructions to control the information that the AI ​​outputs. For example, instructions to control the information that the AI ​​outputs may include instructions on information filtering, information granularity, information format or representation, or the amount of information.

[0067] <8. Topic Provision Processing> Topic provision processing is mainly performed by the topic provision processing unit 226 of terminal 100 and server 200. In topic provision processing, topics for calls and message exchanges are determined and provided based on the data stored in the memory unit 230. Specifically, topics are determined based on the profile information of the two users. For example, the topic provision processing unit 226 determines topics from topic data D4 stored in the memory unit 230 that are estimated to be easy for the two users to talk about, of interest to them, or of which they have knowledge, based on the profile information of the two users. The determined topics are provided to each processing unit during a call or message exchange and transmitted to terminals 100A and 100B. Topic provision processing may also be performed by an AI model, and the AI ​​model may be updated by machine learning using data stored in the memory unit 230. For example, the topic provision processing unit 226 generates input information based on at least a portion of user data D1 (e.g., user profile information), call data D2, or message data D3 stored in the memory unit 230. This input information includes instructions for the AI ​​model. The topic provision processing unit 226 inputs the input information to the AI ​​model. The AI ​​model outputs the topic. For example, the AI ​​model may be an LLM. Also, the instructions to the AI ​​model may include instructions to control the information that the AI ​​outputs, as described above.

[0068] Furthermore, the topics of conversation between two users may be analyzed, and the topics may be determined based on the analysis results. For example, the topic provision processing unit 226 analyzes the topics of conversation based on the conversation data D2 stored in the storage unit 230. The topic analysis may be performed based on text data converted from the voice data of the conversation. The topic analysis may also be performed after the end of the conversation or in real time. Based on the analysis results, the topic provision processing unit 226 estimates the orientations (i.e., characteristics) of the two users, such as hobbies, preferences, or interests. Then, topics corresponding to the estimated orientations of the two users are determined from the topic data D4 and provided. In addition, the orientations of each of the two users may be estimated based on the analysis results of a conversation between a user different from the user currently in the conversation or exchanging messages. In addition, the topic analysis part may be performed by an AI model. For example, input information may be generated based on the conversation data D2, this input information may be input into the AI ​​model, and the analysis results may be output from the AI ​​model.

[0069] Furthermore, the timing of the topic display may be controlled. Specifically, silence in a call between two users may be detected based on the call information between the two users, and the topic may be displayed in response to the detection of silence. For example, the topic provision processing unit 226 performs silence detection processing in a call based on the voice in the call data received from terminals 100A and 100B. When silence is detected, the topic provision processing unit 226 obtains the topic from topic data D4 and sends it to terminals 100A and 100B. The received topic is displayed on terminals 100A and 100B. Although it has been stated that the topic is obtained in response to the detection of silence, the topic to be displayed in response to the detection of silence may be obtained in advance before the detection of silence. Also, the topic to be displayed in response to the detection of silence may be sent to terminals 100A and 100B in advance. Terminals 100A and 100B may perform the above silence detection processing and display the received topic in response to the detection of silence.

[0070] Furthermore, the display order of topics may be controlled. Specifically, topics may be weighted, with topics having a heavier weight than the currently displayed topic appearing next. Topics common to two users or topics considered jointly by two users may have a heavier weight than topics related to each individual user. For example, topics managed as topic data D4 may be assigned weights, and topics may be grouped by weight. The weight groups may consist of three types of groups, such as mild, moderate, and severe, or there may be four or more types of groups based on score values. For example, a weight order may be set in the order of mild < moderate < severe, and a relationship may be set where the magnitude of the score value corresponds to the degree of weight. Also, the weight may be a numerical value set for each topic. For example, a relationship may be set where the magnitude of the numerical value corresponds to the degree of weight. Furthermore, topics with relatively light weights may be topics related to each individual user, while topics with relatively heavy weights may be topics common to two users or topics considered jointly by two users. The topic provision processing unit 226 then provides topics of lower weight first, followed by topics of higher weight. Terminals 100A and 100B, which receive topics, first display a topic of lower weight, such as deciding on nicknames for each of the two users, on the voice call screen 30, as shown in Figure 3. Next, depending on the topic change, a topic of moderate weight related to a hobby common to both users is displayed on the voice call screen 31. Furthermore, depending on the topic change, a topic of high weight, such as the two users jointly deciding how to spend 100,000 yen, is displayed. Alternatively, the display order (or display priority) of topics may be provided along with the topics, and terminal 100 may switch the topics displayed according to the display order.

[0071] The topics offered may be managed by theme. For example, themes could include hobbies, date plans (e.g., first date), favorite foods, favorite drinks (e.g., alcohol), favorite restaurants, places frequently visited, how one spends holidays, views on marriage, and views on children. The topics offered may also be derived from the above themes. For example, if the hobby of watching movies is the theme of the topic, the topics could include movie genres, favorite movies, or memorable scenes. The aforementioned weights may also be assigned to the themes of the topic.

[0072] <9. Processing Flow> The processing flow of System 1 will be explained with reference to Figures 9-14. Figure 9 is a sequence diagram showing an example of the overall processing flow performed by System 1. Figures 10-14 are sequence diagrams showing an example of the flow of each processing step.

[0073] As shown in Figure 9, in System 1, which includes terminals 100A and 100 and server 200, a matching process is performed for the logged-in user (S301). An initial voice call is performed for the two matched users (S303). After the initial voice call, confirmation of the transition to the next stage of the dating process and scheduling are performed (S305). If the transition to the next stage of the dating process is successful, a second voice call is performed as scheduled (S307). After the second voice call, confirmation of the transition to the next stage of the dating process and scheduling are performed (S309). If the transition to the next stage of the dating process is successful, a video call is performed as scheduled (S311). Confirmation of the transition to the next stage of the dating process and scheduling are performed (S313). If the transition to the next stage of the dating process is successful, message processing is performed (S315).

[0074] Figure 10 is a sequence diagram showing an example of the user matching process flow. As shown in Figure 10, terminal 100 performs system login processing (S401). For example, when the application of system 1 is started, terminals 100A and 100B send the login information for system 1 to server 200.

[0075] When the system login process is performed, the server 200 acquires user data (S403). For example, when the control unit 220 receives login information from terminal 100A, it updates the login status of the user associated with terminal 100A stored in the storage unit 230 from logoff to logged in. The control unit 220 also extracts a group of users whose login status is logged in.

[0076] Server 200 performs user matching (S405). For example, control unit 220 selects matching candidates from the extracted user group by filtering based on the profile information of each user in that group. The selected matching candidates are transmitted to terminals 100A and 100B.

[0077] Terminal 100 displays matching candidates (S407). For example, terminals 100A and 100B display the received matching candidates on the matching screen.

[0078] After a predetermined time has elapsed, voice call processing will begin (S409, S411). Details of the processing will be described later with reference to Figure 11.

[0079] Figure 11 is a sequence diagram showing an example of the processing flow in the first voice call. As shown in Figure 11, terminal 100 starts the first voice call and displays topic 1 (S501). Server 200 provides the voice call data and topic 1 (S503). For example, terminals 100A and 100B access server 200 using a URL for voice calls and start transmitting voice call data. Control unit 220 transmits the voice call data received from one terminal 100 to the other terminal 100. Control unit 220 transmits topic 1 along with the voice call data. Terminals 100A and 100B output audio based on the voice call data and display topic 1.

[0080] After a predetermined time has elapsed since the start of the voice call, terminal 100 will perform a confirmation to continue the voice call in the middle of the call (S505). Server 200 will make a decision on whether to continue the voice call (S507). For example, terminals 100A and 100B will display a confirmation to continue the voice call on the voice call screen in the middle of the voice call and send a response to the confirmation to server 200. Based on the received response, control unit 220 will decide whether to continue transmitting the voice call data.

[0081] If the user wishes to continue the voice call, terminal 100 continues the voice call and displays topic 2 (S509). Server 200 provides the voice call data and topic 2 (S511). For example, if the response to the confirmation of continuing the voice call is "yes," the transmission of voice call data continues and the displayed topic is switched to topic 2. If the response to the confirmation of continuing the voice call is "no," the voice call ends.

[0082] Subsequently, after a predetermined time has elapsed, a confirmation of whether to continue the voice call is performed during the voice call (S513), and a decision is made on whether to continue the voice call (S515). If the user wishes to continue the voice call, the voice call continues and topic 3 is displayed (S517), and the voice call data and topic 3 are provided (S519).

[0083] Terminal 100 confirms the transition to the second voice call (i.e., the second stage) upon the end of the first voice call due to the elapsed predetermined call time (S521). Server 200 determines the transition to the second voice call (S523). For example, terminals 100A and 100B end the voice call after the set call time has elapsed since the start of the voice call and display a confirmation on the voice call screen asking whether to transition to the second voice call. The response to this confirmation is then sent to server 200. Based on the received response, control unit 220 determines whether to transition to the second voice call.

[0084] If the user wishes to proceed to a second voice call, the server 200 provides candidate dates and times for the second voice call (S525). Terminal 100 displays the candidate dates and times for the user to select (S527). For example, if the user responds "yes" to the confirmation of proceeding to a second voice call, the candidate dates and times stored in the storage unit 230 are displayed to terminals 100A and 100B. Then, based on the user's selection of the candidate dates and times, the date and time for the second voice call is stored in the storage unit 230.

[0085] Then, the user data is updated (S529). For example, if a second voice call is desired, the relationship status associated with each user's identification information is updated to stage 2. Otherwise, the relationship status associated with each user's identification information is deleted, and a prohibition flag is set for those two users.

[0086] Figure 12 is a sequence diagram showing an example of the processing flow in the second voice call. Note that the processing similar to that in the first voice call shown in Figure 11 will not be explained.

[0087] As shown in Figure 12, terminal 100 starts a second voice call and displays topic 4 (S601). Server 200 provides the voice call data and topic 4 (S603). However, if the other party is unavailable, terminal 100 cancels the voice call and displays a list of date and time options for the user to select (S605). Server 200 provides the date and time options (S607). For example, if one of the users scheduled to make the call has not logged in after a predetermined amount of time has elapsed since the start of the second voice call, the voice call ends. Then, the date and time options are displayed, and the modified date and time of the second voice call is stored in the storage unit 230 based on the desired date and time selected by the user from the options.

[0088] If the other party is participating in a voice call, the processes S505 to S519 shown in Figure 11 are performed. Then, terminal 100 confirms the transition to a video call (i.e., the third stage) upon the end of the second voice call due to the elapsed predetermined call time (S609). Server 200 determines whether to transition to a video call (S611). If a transition to a video call is desired, server 200 provides candidate dates and times for the video call (S613). Terminal 100 displays the candidate dates and times and allows the user to select one (S615).

[0089] Then, the user data is updated (S617). For example, if a transition to a video call is desired, the relationship status associated with each of the two users' identifications is updated to stage 3. Otherwise, the relationship status associated with each of the two users' identifications is deleted, and a prohibited flag is set for those two users.

[0090] Figure 13 is a sequence diagram showing an example of the processing flow in a video call. Note that the processing similar to that in voice calls, as shown in Figures 11 and 12, will not be explained.

[0091] As shown in Figure 13, terminal 100 starts a video call with the camera off and displays topic 5 (S701). Server 200 provides the video call data and topic 5 (S703). For example, terminals 100A and 100B access server 200 using a URL for video calls and start transmitting video call data with the cameras off. Control unit 220 transmits the video call data received from one terminal 100 to the other terminal 100. Control unit 220 transmits topic 5 along with the video call data. Terminals 100A and 100B output only audio based on the video call data and display topic 5.

[0092] If the person being called is unavailable, terminal 100 cancels the video call and displays a list of possible dates and times for the user to select (S705). Server 200 provides the date and time options (S707). If the person being called is participating in the video call, terminal 100 switches the video call to the camera-on state with a countdown (S709). For example, terminals 100A and 100B switch from the camera-off state to the camera-on state after a predetermined amount of time has elapsed since the start of the video call, following a countdown.

[0093] Terminal 100 continues the video call with the camera on and displays topic 6 (S711). Server 200 provides the video call data and topic 6 (S713). For example, with the camera on, the transmission of video call data continues, and the topic switches to topic 6 and is displayed.

[0094] Then, terminal 100 confirms the transition to a real date (i.e., the fourth stage) when the video call ends due to the elapsed time of a predetermined call duration (S715). Server 200 determines whether to proceed to a real date (S717). If the user wishes to proceed to a real date, server 200 provides candidate dates and times for the real date (S719). Terminal 100 displays the candidate dates and times and allows the user to select one (S721).

[0095] Then, the user data is updated (S723). For example, if a transition to real dating is desired, the relationship status associated with each of the two users' identifications is updated to stage 4. Otherwise, the relationship status associated with each of the two users' identifications is deleted, and a prohibited flag is set for those two users.

[0096] Figure 14 is a sequence diagram showing an example of the processing flow in RealDate. As shown in Figure 14, terminal 100 accepts messages and associated data input (S801). Server 200 stores the accepted data (S803). For example, terminals 100A and 100B acquire messages and associated data such as images entered on the message exchange screen and send them to server 200. Control unit 220 sends the message and associated data from one terminal 100 to the other terminal 100. The message and associated data are also stored in storage unit 230.

[0097] Server 200 analyzes the data stored in memory unit 230 to assist in the relationship (S805). Terminal 100 displays information related to the assistance provided by Server 200 (S807). For example, control unit 220 analyzes various data stored in memory unit 230 to estimate content that will contribute to the progress of the relationship. Then, suggestion messages regarding the estimated content are displayed on terminals 100A and 100B.

[0098] If a real-life date is scheduled, terminal 100 confirms the continuation of the relationship after the real-life date (S809). Server 200 determines the relationship status (S811) and updates the user data (S813). For example, terminals 100A and 100B display a confirmation of the continuation of the relationship on the message exchange screen after a predetermined time has elapsed since the date and time of the real-life date. Then, a response to this confirmation is sent to server 200. Control unit 220 determines whether to maintain the relationship status based on the received response. If the continuation of the relationship is desired, the relationship status associated with the identification information of each of the two users is maintained. Otherwise, the relationship status associated with the identification information of each of the two users is deleted, and a prohibition flag is set for those two users.

[0099] <10. Effects> According to the embodiment described above, the system 1, which includes two or more terminals 100 and a server 200 that communicates with the two or more terminals 100, comprises a storage unit and a control unit. The storage unit stores information on two or more users associated with each of the two or more terminals 100. The control unit matches two users from among the two or more users based on the information on the two or more users, and performs processing at each stage of the dating step, which includes at least two stages, including: (a) displaying a call screen between the two users on each of the two terminals 100 associated with the two users; (b) displaying a confirmation on each of the two terminals 100 whether they wish to proceed to the next stage of the dating step in response to the end of the call between the two users; and (c) if a response indicating a desire to proceed to the next stage of the dating step is entered on both terminals 100, the system 1 moves the two users to the next stage of the dating step. In the first stage of the dating step, the above processing is performed for voice-only calls. In this way, by displaying a confirmation prompt for the transition to the next stage of the relationship process at the end of the call and requesting the user's response, the decision of whether or not to continue the relationship is not postponed. Therefore, it is possible to prevent situations where the decision of whether or not to continue the relationship becomes ambiguous. Furthermore, by providing voice-only calls in the first stage of the relationship process, users can make decisions based on the inner characteristics of the person, contributing to a wider range of encounters.

[0100] Furthermore, the control unit of System 1 performs the aforementioned processing on calls including camera images and audio at predetermined stages after the first step of the interaction process. By providing a call including camera images after an audio-only call, it is possible to mitigate the influence that external characteristics (i.e., visual characteristics) of people have on the relationship building between users.

[0101] Furthermore, if responses indicating a desire to move to the next stage of the dating steps are entered from both terminals, the control unit of System 1 stores the dating steps of the two users in the memory unit, associating them with the identification information of each of the two users. This allows the dating steps of the two users to be managed as dating statuses, and System 1 can provide assistance appropriate to the dating status.

[0102] Furthermore, a confirmation prompt asking whether the user wishes to proceed to the next stage of the relationship will appear on the call screen after the call between the two users has ended. This allows the user to be asked to respond about moving to the next stage of the relationship without having to switch screens after the call ends. Therefore, it is possible to get the user to respond before their thoughts shift to something else, making it more reliable to prevent them from postponing their response.

[0103] Furthermore, if both terminals 100 indicate a desire to proceed to the next stage of the dating process, the control unit of System 1 displays a confirmation message asking if the users wish to proceed to the next stage of the dating process, followed by a list of possible dates and times for the next stage of the dating process on each of the two terminals 100. If the dates and times selected by the two terminals 100 match, the storage unit of System 1 stores the matching dates and times as the date and time for the call in the next stage of the dating process, associating them with the identification information of each of the two users. This reduces the effort required of the users to schedule the call in the next stage of the dating process.

[0104] Furthermore, the memory unit of System 1 stores the available dates and times for calls between the two users, which are entered in advance before the call between the two users. The control unit of System 1 then determines candidate dates and times based on the available dates and times for calls between the two users. This allows users to schedule calls without having to check their own schedules each time they need to schedule a call.

[0105] Furthermore, the control unit of System 1 notifies each of the two terminals 100 of a reminder about the call in the next stage of the relationship, a first time before the scheduled date and time of the call. This helps to prevent the user from forgetting about the call in the next stage of the relationship.

[0106] Furthermore, the control unit of System 1 enables each of the two terminals 100 to initiate the call for the next stage of the dating step two hours before the scheduled date and time of the call. This prevents the user from accidentally initiating the call before the scheduled date and time.

[0107] Furthermore, the control unit of System 1 initiates a call in the next stage of the dating step in response to an operation to start the call in the next stage of the dating step. If at least one of the two users is not participating in the call within a predetermined time elapsed from the date and time of the call in the next stage of the dating step, the control unit terminates the call in the next stage of the dating step. This helps to reduce the wasted time of the users participating in the call.

[0108] Furthermore, the control unit of System 1 processes messages or schedules for in-person meetings at predetermined stages of the dating steps. This allows the user to confirm the inner characteristics of the person they are talking to through voice and video calls before moving on to dating steps that involve closer communication. This contributes to the user building a stronger and more lasting relationship.

[0109] Furthermore, information on two or more users must include at least the user's age and address. This allows for matching users of similar ages and those living nearby, increasing the success rate of relationships.

[0110] Furthermore, the control unit of System 1 controls calls between the two users based on predetermined call types and call durations for each stage of the dating process. This ensures that calls at each stage of the dating process are completed within an appropriate timeframe for the interaction. Additionally, by making the user aware of the time limit for the call, it helps them concentrate on the conversation.

[0111] Furthermore, if a response indicating that the user does not wish to proceed to the next stage of the dating step is entered by at least one of the two terminals 100, or if a response to the confirmation of whether the user wishes to proceed to the next stage of the dating step is not entered by at least one of the two terminals 100 within a predetermined time after the display of the confirmation of whether the user wishes to proceed to the next stage of the dating step, the control unit of System 1 stores information indicating that matching for the two users is prohibited in the storage unit, associated with the identification information of each of the two users. As a result, the person with whom the user does not wish to continue dating is excluded from the matching candidates in subsequent matching processes, allowing the user to concentrate on new encounters.

[0112] Furthermore, when the control unit of System 1 stores information indicating that matching between two users is prohibited, if the stages of the two users' relationship steps associated with each user's identification information are stored in the memory unit, it deletes those associated stages of the two users' relationship steps from the memory unit. This frees up the memory area used for the relationship status of two users whose relationship has ended and who will never be matched again, thereby improving memory utilization efficiency.

[0113] Furthermore, the control unit of System 1 displays the topic of conversation on the call screen during a call between two users. This enables smooth conversations even for users who are not comfortable speaking.

[0114] Furthermore, the control unit of System 1 generates input information based on at least one of the two users' profile information or the information from the call between the two users, inputs the input information into an artificial intelligence model that generates topics, and displays the topics output by the artificial intelligence model on the call screen. This makes it possible to display topics that are easy for the users to talk about. It is also possible to display topics that are common to both users or that both users are interested in. Moreover, by using an artificial intelligence model that can learn user information, the appropriateness of the topics displayed on the call screen to the users can be improved.

[0115] Furthermore, the control unit of System 1 detects silences in a call between two users based on the call information, and the topic is displayed in response to the detection of silence. This helps to avoid awkward situations caused by interrupted calls.

[0116] Furthermore, topics are weighted, and the next topic displayed will have a heavier weight than the currently displayed topic. This allows you to gradually build a relationship with the person you're talking to during the call.

[0117] Furthermore, topics common to both users or topics they consider together carry more weight than topics related to each individual user. This means that when you don't know the other person very well, topics that are relatively easy to talk about are displayed, and once you've become somewhat closer, topics that deepen the relationship are displayed. Therefore, it becomes easier to build relationships and to deepen the relationships that have been built.

[0118] Furthermore, the dating steps include, in addition to the initial stage and the predetermined stages described above, at least one stage involving only voice calls and at least one stage involving calls including camera video and audio. This ensures that users experience at least two voice calls and one video call, allowing them to more deeply assess the inner characteristics of their conversation partner before a real date.

[0119] Furthermore, the stages of the relationship between two users are irreversible. This allows the progress of the relationship to be understood based on which stage of the relationship it is in (i.e., the relationship status).

[0120] Furthermore, in a call between two users, the control unit of System 1 displays a confirmation message on the call screen asking whether to continue the call after a predetermined time has elapsed from the start of the call but before the predetermined call time for each relationship step has elapsed. If a response indicating a desire to continue the call is entered on both terminals 100, the call between the two users is continued. If a response indicating a desire to continue the call is not entered on at least one of the two terminals 100, the call between the two users is terminated. This allows users to consider their compatibility with the other party during the call and facilitates confirmation of the continuation of the relationship after the call ends. It also prevents the continuation of a call with someone with whom there is no prospect of continuing the relationship.

[0121] Furthermore, the control unit of System 1 displays a confirmation message to continue the call if the call between two users is an audio-only call, but does not display a confirmation message to continue the call if the call between two users includes both camera video and audio. This prevents calls from being unilaterally terminated mid-conversation after the parties have met face-to-face during a video call.

[0122] Furthermore, in a call between two users, the control unit of System 1 displays the topic on the call screen, and if both terminals input a response indicating a desire to continue the call, it changes the topic. This allows for assistance with an additional topic to continue the call. Also, by presenting a different topic, it becomes easier to resume the call after it has been interrupted due to confirmation of continuation.

[0123] Furthermore, if a response indicating a desire not to continue the call is entered by at least one of the two terminals 100, or if a response to the confirmation of whether to continue the call is not entered by at least one of the two terminals 100 within a predetermined time after the confirmation of whether to continue the call is displayed, the control unit of System 1 stores information indicating that matching for the two users is prohibited in the storage unit, associated with the identification information of each of the two users. As a result, the person with whom the user does not wish to continue the call is excluded from the matching candidates in subsequent matching processes, allowing the user to concentrate on new encounters.

[0124] Furthermore, if a call between two users includes both camera video and audio, the control unit of System 1 turns off the camera video before a predetermined time has elapsed from the start of the call, and turns on the camera video after that predetermined time has elapsed. This allows for a preliminary video call with only audio, similar to the previous audio call, to be conducted before the start of a video call with the camera on, thereby reducing the user's anxiety about meeting face-to-face. This facilitates smoother video calls with the camera on.

[0125] <11. Variant> The embodiments described above may be modified as follows.

[0126] (1) In the matching process of the above embodiment, the call partner is automatically determined from the selected matching candidates, and the first voice call is initiated. However, the call partner may be selected by the user from the matching candidates. Also, the first voice call with the call partner may be initiated in response to user operation.

[0127] (2) In the matching process of the above embodiment, the first voice call is automatically started after matching is completed. However, scheduling of the first voice call may be performed after matching is completed. Alternatively, the matching process may be performed in advance, and matching candidates may be presented to the user. The frequency of the advance matching process may be one person per day.

[0128] (3) In the matching process of the above embodiment, the matching process is started automatically when the application is launched. However, a matching request may be sent from the terminal 100 to the server 200 in response to user operations after the application is launched, and the matching process may be started in response to the receipt of the matching request.

[0129] (4) In the matching process of the above embodiment, other users who are logged in at the time the user logs in will be the target of matching. However, if the user participates in a matching that takes place at a specific time, other users participating in that matching may also be the target of matching. For example, a confirmation message asking whether the user wants to participate in a matching that starts at 9 p.m. will be displayed on terminal 100 10 minutes before the matching. If the user responds that they will participate, a call partner will be randomly selected from among the other users who responded that they will participate in the matching. Then, at 9 p.m., the voice call will start automatically.

[0130] (5) In the above embodiment, if at least one of the two users does not respond that they wish to continue the relationship, a prohibition flag is set for those two users. However, a prohibition flag does not have to be set if neither responds that they wish to continue the relationship.

[0131] (6) In the above embodiment, a confirmation of transition to the next stage of the dating steps is displayed when the call ends. Here, the above may also include the case where the confirmation of transition to the next stage of the dating steps is displayed on another screen that automatically switches from the call screen when the call ends. Furthermore, the above may also include the case where, when the call ends, the display temporarily switches to another screen, then returns to the call screen, and the confirmation of transition to the next stage of the dating steps is displayed.

[0132] (7) In the scheduling of the above embodiment, date and time candidates are determined based on the dates and times that the two users are available to talk, which are entered in advance. However, if a response indicating a desire to move to the next stage of the dating step is entered on both terminals 100, the control unit of System 1 may display a date and time candidate input screen on each of the two terminals 100 and determine the date and time candidates based on the input on the input screen. This makes it possible to schedule based on the latest schedule at the time the call ends.

[0133] (8) In the above embodiment, if the person to be called is unavailable, the call is terminated. However, an AI agent (in other words, a digital twin of the user) equipped with an artificial intelligence (i.e., AI) model of the absent user may take over the call. The AI ​​model may be generated using an expert system, or it may be generated using machine learning such as deep learning. The AI ​​model generated using machine learning may be a generative AI model (e.g., LLM). Specifically, if at least one of the two matched users is unavailable for a call, the control unit of system 1 has an artificial intelligence model (i.e., an AI agent) generated using machine learning based on the information of the user who is unavailable to make a call, and displays the call record of the AI ​​agent on the terminal 100 of the user who was unable to make a call. This allows the two users to indirectly learn about each other's characteristics even if they are unable to make a call directly. Furthermore, a confirmation message is displayed on the terminal 100 of the user who was unable to make a call, and if a response indicating a desire to make a call is entered, scheduling is performed. If no response indicating a desire to make a call is entered, a prohibition flag is set.

[0134] For example, if user U1 is absent from the two users U1 and U2 who are to make a call, the control unit 220 of the server 200 has user U1's AI agent make a call with user U2. The call data with this AI agent is stored in the storage unit 230. When user U1 logs in, the stored call data with the AI ​​agent is sent to user U1's terminal 100, and the contents of the call data are output. For example, the audio of the call data may be output, or text converted from the audio of the call data (e.g., the full conversation or a summary) may be displayed. Furthermore, user U1's terminal 100 is shown a confirmation asking if they wish to make a call with user U2, and if user U1 responds that they wish to make a call, scheduling of a call with user U2 is performed. Otherwise, a prohibition flag is set for both user U1 and user U2.

[0135] Furthermore, the control unit 220 of the server 200 may initiate a call between the AI ​​agent of user U1 and the AI ​​agent of user U2 before the call between user U1 and user U2. The call data between these AI agents is stored in the storage unit 230. Subsequently, the contents of the stored call data between the AI ​​agents are output to the terminals 100 of user U1 and user U2. In addition, a confirmation message is displayed to the terminals 100 of user U1 and user U2 asking if they wish to make a call with the other party. If both user U1 and user U2 respond that they wish to make a call, scheduling of the call is performed. Otherwise, a prohibition flag is set for both user U1 and user U2.

[0136] The AI ​​agent for the user may be generated by machine learning using various data about the user stored in the memory unit 230 (e.g., user data D1 and call data D2). In this way, the AI ​​agent learns the user's likes and dislikes, preferences, and speaking style, and as the learning progresses, it will become more similar to the user themselves.

[0137] Furthermore, while the above states that the AI ​​agent will take over the call if the intended recipient is unavailable, the AI ​​agent's call may also be used in the matching process to determine the call recipient from the matching candidates. For example, once a matching candidate is selected, a call with that candidate's AI agent begins. After the call ends, the call data is presented to the matching candidate, and a matching confirmation is performed. If the matching candidate responds that they wish to proceed with the match, that candidate is determined to be the call recipient.

[0138] (9) The AI ​​agent described in (8) above may be used for user conversation training. For example, a call between user U1 and user U2's AI agent may be scheduled before a scheduled call between user U1 and user U2. In response to user U1's operation of terminal 100, server 200 provides terminal 100 with a call between user U2's AI agent.

[0139] (10) The assistance for dating in the above embodiment may be provided at any stage of the dating steps, not limited to the stage in the dating steps where message exchange is set up. Furthermore, the assistance may include relationship advice. For example, the assistance may be provided at the stage in which a voice call is set up (e.g., the first or second stage) or at the stage in which a video call is set up (e.g., the third stage). Furthermore, the assistance may be relationship advice by an AI model. When the user inputs the content of the relationship advice into the terminal 100 using voice input or text input (e.g., in chat format or non-chat format), the server 200 responds to the content of the relationship advice using an AI model. In addition, relationship advice may be provided through a conversation by an AI agent that mimics a relationship expert. Furthermore, the AI ​​model may be updated by machine learning using advice information from a relationship expert. The AI ​​model may also be an LLM.

[0140] (11) In the above embodiment, System 1 may monitor calls retrospectively or in real time. Specifically, the control unit 220 of Server 200 may perform inappropriate remark detection processing on call data stored in Storage Unit 230 and freeze or ban the account of the user who made the detected inappropriate remark. For example, the control unit 220 converts the call data into text data and inputs the text data into an AI model along with predetermined rules. The AI ​​model outputs the inappropriate remark detection result. The rules may be a description that defines an inappropriate remark. The inappropriate remark detection result may indicate the location of the inappropriate remark or the user who made the inappropriate remark. The AI ​​model may be, for example, an LLM. Alternatively, the control unit 220 may perform inappropriate remark detection processing on call data received from Terminal 100 during a call. In this case, the control unit 220 may forcibly terminate a call in which an inappropriate remark has been detected. Furthermore, instead of being performed by the control unit 220 of Server 200, the terminal 100 may perform the inappropriate remark detection processing. In this case, terminal 100 sends information to server 200 indicating the user who made the detected inappropriate remark, and server 200 freezes or bans the account.

[0141] (12) In the above embodiment, terminal 100 confirms the transition to the next stage of the dating step. However, server 200 may send an instruction to terminal 100 to confirm the transition to the next stage of the dating step, and terminal 100 may display a confirmation of the transition to the next stage of the dating step based on said instruction. Alternatively, drawing instructions for each of the above-mentioned screens may be sent from server 200 to terminal 100, and terminal 100 may display a screen based on said drawing instructions. The said drawing instructions may include information indicating the content of the screen.

[0142] (13) In the above embodiment, the operation of terminal 100 is realized by an application of system 1 installed on terminal 100. However, the operation of terminal 100 may also be realized by a browser installed on terminal 100. In this case, some or all of the processing of terminal 100 in the above embodiment may be performed by server 200 via the browser. Also, some or all of the information stored by terminal 100 in the above embodiment may be stored in server 200. For example, user avatar information may be stored in the storage unit 230 of server 200 in association with the user ID.

[0143] (14) In the above embodiment, the dating steps progress from two voice call stages (i.e., the first and second stages) and a video call stage (i.e., the third stage) to the real date stage (i.e., the fourth stage). However, the conditions for progressing to the real date stage may be the completion of at least one (e.g., three) voice call stage and at least one (e.g., three) video call stage. Also, the same dating steps may be repeated. Specifically, certain dating steps may be repeated based on the user's request. For example, in the confirmation of progress to the next stage of the dating steps displayed after the end of a video call, a confirmation may be displayed asking if the user wishes to have another video call. If the user answers that they wish to have another video call, the next stage of the dating steps is set to the second video call stage. Also, certain dating steps may be repeated based on the profile information of the two users making the call. For example, if the addresses of the two users are more than a predetermined distance apart, a second video call stage may be set in addition. Furthermore, charges may be applied for repetition of certain steps in a relationship. For example, if a user responds that they would like to have another video call, a charge may be applied to the user who responded.

[0144] (15) In the matching process of the above embodiment, an appeal requesting matching with a displayed matching candidate may be made. For example, if the profile information of a matching candidate is displayed, a confirmation will be displayed asking whether to send a gift to the matching candidate. If the user answers yes, the gift will be provided to the matching candidate. A charge may be made for providing the gift. The gift may be, for example, an image of a bouquet of flowers.

[0145] (16) In the above embodiment, notification may be sent to the administrator of System 1. For example, terminal 100 displays a notification button on the call screen, and when the notification button is pressed, it terminates the call and sends notification information to server 200. The control unit 220 of server 200 stores the notification information in the storage unit 230 and sends the notification information to the administrator terminal of System 1 via the communication unit 210. When the notification button is pressed, a confirmation message is displayed asking whether it is OK to make a notification.

[0146] (17) In the above embodiment, if a call between two users is terminated midway, information regarding the termination of the call is stored, and matching of the two users may be performed based on the information regarding the termination of the call. This makes it possible to match two users who have similar characteristics or preferences regarding calls. Specifically, the information regarding the termination of a call may be whether or not a call has been terminated midway, the number of times, or the length of time from the start to the end of the call. For example, two users who have terminated a call midway, or two users who have never terminated a call midway, may be matched. Two users who have terminated a call midway about the same number of times may be matched. Alternatively, a user who has terminated a call midway and a user who has never terminated a call midway may be matched. Furthermore, based on the above information regarding the termination of a call midway, the user's account may be frozen or banned. Note that the termination of a call midway may be due to user action, or it may be due to a response to a confirmation of the continuation of the call.

[0147] (18) In the voice call of the above embodiment, both confirmation of the transition to the next stage of the dating steps and confirmation of the continuation of the call are performed. However, only one of the two, confirmation of the transition to the next stage of the dating steps or confirmation of the continuation of the call, may be performed. Furthermore, confirmation of the continuation of the call may also be performed in the case of a video call.

[0148] (19) In the above embodiment, the topics displayed during a call are the same on the terminals 100 of the two users making the call. However, additional topics may be displayed on only one of the two users' terminals 100. For example, the terminal 100 of one of the two users (e.g., a male user) may display topics that the other user (e.g., a female user) might be interested in.

[0149] (20) In the above embodiment, user profile information may be generated by an AI model. The AI ​​model may also be updated by machine learning using data stored in the memory unit 230. For example, the control unit 220 generates input information based on at least a portion of the text data or message data D3 based on the call data D2 stored in the memory unit 230. The input information includes instructions for the AI ​​model. The control unit 220 inputs the input information to the AI ​​model. The AI ​​model outputs profile information including the user's personality, hobbies, and values. For example, the AI ​​model may be an LLM. The instructions for the AI ​​model may also include instructions to control the information that the AI ​​model outputs, as described above. For example, based on the frequency of a specific word in a conversation between two users, an item or service related to that specific word may be included in the profile information as a preference of the user. In this way, since the profile information is generated based on the actual conversation between two users, the profile information can be made more detailed. Also, features that the user is not aware of can be extracted as profile information. Furthermore, the profile information generated by the AI ​​model may be managed separately from the profile information entered by the user, or it may be integrated with it.

[0150] (21) In the above embodiment, the user matching process may be performed by an AI model. The AI ​​model may also be updated by machine learning using data stored in the memory unit 230. For example, the matching processing unit 221 generates input information based on the user profile information stored in the memory unit 230. This input information includes instructions for the AI ​​model. The matching processing unit 221 inputs this input information to the AI ​​model. The AI ​​model outputs at least one pair of users that are matching candidates. As described above, the instructions for the AI ​​model may include instructions to control the information that the AI ​​model outputs. For example, the instructions for the AI ​​model may be a prompt instructing it to output a pair of two compatible users. The input information may also be generated based on the profile information output by the AI ​​model in (20) above.

[0151] (22) In the above embodiment, sentiment analysis may be performed based on call data. Specifically, changes in the speaker's emotions (e.g., whether or not they are interested, concerned, or empathetic) may be analyzed based on the volume, change in volume, pitch (i.e., pitch), change in pitch, speed, or change in speed in the call data. For example, the control unit 220 may estimate that words (e.g., topics) corresponding to sections in the call data where the volume is relatively high, where the volume has changed, where the pitch is relatively high, where the pitch has changed, where the speed is relatively high, or where the speed has changed are words of interest to the user. Alternatively, for example, the control unit 220 may estimate that words corresponding to sections of voice patterns that appear relatively frequently in the call data are words of interest to the user. The call data used for sentiment analysis may be call data between two matched users, or call data between an AI agent and a user. For example, sentiment analysis may be performed based on the call data between the AI ​​agent and the user as described in (8) to (10) above. Alternatively, call data may be obtained by having the user talk to an AI agent for a predetermined period of time (e.g., 3 minutes).

[0152] The results of the sentiment analysis based on the aforementioned call data may be used in each process. Specifically, the results of the sentiment analysis may be used to generate user profile information. For example, the results of the sentiment analysis may be included in the input information for the AI ​​model that generates the profile information in (20) above. Furthermore, the generated profile information may be managed and stored separately from the profile information entered by the user.

[0153] Furthermore, the results of the sentiment analysis may be used in the matching process. For example, the results of the sentiment analysis may be included in the input information for the AI ​​model that performs the matching process described in (21) above. The AI ​​model may output two users whose sentiment analysis results are similar (for example, those with similar levels of sensitivity to a particular topic) as a pair of matching candidate users. Alternatively, the results of the sentiment analysis may be used in the filtering of the matching process.

[0154] Furthermore, the results of the sentiment analysis may be used in topic provision processing. For example, the results of the sentiment analysis may be included in the input information for an AI model that performs topic provision processing. The AI ​​model may output topics common to the two users (for example, topics with similar levels of sensitivity) based on similar sentiment analysis results between the two users (for example, sensitivity to topics).

[0155] Furthermore, the results of the sentiment analysis may be used to display the status of the call. Specifically, the results of the sentiment analysis themselves may be displayed as the status of the call. Alternatively, the status of the call generated based on the results of the sentiment analysis (e.g., highlights or exciting moments in the call) may be displayed. For example, the status of the call using the results of the sentiment analysis may be displayed in real time during the call or after the call has ended.

[0156] (23) In the above embodiment, a summary of the call may be provided to the user based on the call data. Specifically, the control unit 220 generates a summary of the call based on the call data for each user and each matched user (i.e., the other party to the call). The generated summary of the call data is provided to each user. For example, the control unit 220 may generate a summary of the call content for user U1 based on the call data with the matched user U2. The generated summary of the call content may be transmitted to and displayed on user U1's terminal 100.

[0157] (24) In the above embodiment, an AI agent that mimics a user (i.e., a digital twin) may be used for the matching process. Specifically, the control unit 220 has the AI ​​agent of a specific user communicate (i.e., converse) with multiple AI agents of other users, and selects one other user from among the multiple other users based on the results of the communication. The AI ​​agent of a specific user may communicate with multiple AI agents of other users in parallel. For example, multiple instances may be generated for the AI ​​agent of a specific user, and each of the multiple instances may communicate with each of the multiple other users.

[0158] The matching process using the above AI agent may be based on static and dynamic evaluations of the two users. The static evaluation may be based on non-interactive information about the two users (e.g., user information stored in advance). The dynamic evaluation may be based on interactive information about the two users (e.g., the results of a call simulation between the two users obtained through a call between the AI ​​agents). Furthermore, the matching process using the above AI agent may be performed in stages according to each phase. Specific examples of the processing in each phase are described below.

[0159] In Phase 1, initial selection is performed based on static evaluation and trial dynamic evaluation. For example, the number of matching candidates may be narrowed down from 100 to 30. In Phase 1, firstly, as a static evaluation, selection is performed based on the user's psychological characteristics. For example, the user's MBTI (Myers-Briggs Type Indicator) or values ​​may be compared with each of several other matching candidates, and a score may be calculated based on the comparison results. Based on this score, some users may be selected from among the several other users. The AI ​​agent may obtain the above user's psychological characteristics through machine learning. Furthermore, the above psychological characteristics may be stored in the memory unit 230 in advance, or they may be obtained by giving the AI ​​agent a test to determine the above psychological characteristics.

[0160] In Phase 1, secondly, a static evaluation is performed, which involves selection based on the user's behavioral characteristics. For example, the number of items such as the user's hobbies, how they spend their holidays, or their food preferences, which are stored in the memory unit 230, that are common to each of a specific user and several other users who are matching candidates may be calculated. Based on the number of items common to each of the several other users, some users may be selected from among those several other users.

[0161] In Phase 1, thirdly, a static evaluation is performed, which involves filtering based on basic conditions. For example, the basic conditions may be the user's residential area, age, or language used, which are stored in the memory unit 230.

[0162] In Phase 1, fourthly, a selection process is conducted based on trial calls between AI agents as a trial dynamic evaluation. The selection criteria based on trial calls may be the naturalness of the calls. For example, a particular user's AI agent may be made to make trial calls with each of several other users' AI agents. The data from these trial calls may be analyzed, and a score may be calculated based on the characteristics of the responses of the other AI agents in the trial calls (e.g., frequency of responses, depth of response content, or degree of interest shown in the responses). Based on this score, some users may be selected from among the several other users. The criteria for the score used to select these users may be more lenient than the criteria for the score in subsequent phases. The length or content of the calls between the AI ​​agents may be the same as or different from the calls in subsequent phases. The first to fourth processes in Phase 1 may be performed in any order.

[0163] In Phase 2, selection is performed based on local dynamic and static evaluations. For example, the number of matching candidates may be narrowed down from 30 to 10. In Phase 2, firstly, as a dynamic evaluation, selection is performed based on conversations between AI agents. For example, a particular user's AI agent may be made to have a conversation with each of several other users' AI agents. The data from the conversation may be analyzed to calculate a score based on the AI ​​agent's positivity towards the conversation, the balance between questions and answers in the conversation, or the degree of empathy in the conversation. Based on this score, some users may be selected from among the several other users. The analysis methods described in (22) above may be used for the analysis of positivity and empathy. Furthermore, the analysis of the balance between questions and answers may be based on the balance between the length of the interval corresponding to the question and the length of the interval corresponding to the answer in the data of the conversation, or the balance between the number of occurrences of the interval corresponding to the question and the number of occurrences of the interval corresponding to the answer in the data of the conversation.

[0164] In Phase 2, secondly, as a static evaluation, selection is made based on the activities of each of the multiple other users who are matching candidates in System 1. For example, for each of the multiple other users, their activities in System 1 (e.g., login or updating of profile information) are captured, and the activity data (e.g., login frequency or profile information update history) is stored in the storage unit 230. A score may be calculated based on this activity data. Based on this score, some users may be selected from among the multiple other users.

[0165] In Phase 2, thirdly, a selection process is performed based on a simulation of a virtual date as a local dynamic evaluation. For example, a date may be simulated in a virtual space between a specific user's AI agent and the AI ​​agents of several other users. The data from this simulation may be analyzed to calculate a score corresponding to the compatibility with the AI ​​agent of the date partner or the naturalness of the conversation during the date. Based on this score, some users may be selected from among the several other users. Note that the above processes 1 to 3 in Phase 2 may be performed in any order.

[0166] In Phase 3, selection is carried out based on broad dynamic and static evaluations. For example, the number of matching candidates may be narrowed down from 10 to 3. In Phase 3, firstly, as a broad dynamic evaluation, selection is carried out based on conversations between AI agents on long-term themes. For example, a particular user's AI agent may be made to have conversations with the AI ​​agents of several other users on the theme of future visions. Future visions may include views on marriage, career, or lifestyle. The data from these conversations may be analyzed and a score may be calculated. Based on this score, some users may be selected from among the several other users.

[0167] In Phase 3, secondly, as a static evaluation, selection is made based on stress tests for each of the multiple other users who are potential matching candidates. For example, each of the AI ​​agents of the multiple other users is tested on complex situations or arguments. A score may be calculated according to the problem-solving ability or tendency to deal with opposing viewpoints of each of the multiple other users estimated from the results of the test. Based on this score, some users may be selected from among the multiple other users. Note that the first and second processes in Phase 3 described above may be performed in any order.

[0168] In Phase 4, a final selection is made based on an overall evaluation. For example, the number of matching candidates may be narrowed down from three to one. In Phase 4, firstly, a selection is made based on an integrated score spanning all phases. Specifically, the scores calculated in each phase may be integrated according to predetermined weights. For example, the predetermined weights may be 40% for the score of the first process in Phase 1, 30% for the scores of the fourth process in Phase 1, the first process in Phase 2, and the third process in Phase 2, 20% for the score of the first process in Phase 3, and 10% for the scores of the second process in Phase 2 and the second process in Phase 4. Based on this integrated score, some users (e.g., one user) may be selected from among the multiple other users. In Phase 4, secondly, a selection is made based on risk avoidance analysis. Specifically, the selected users may be checked from a safety or risk perspective. For example, it may be checked whether the information of the selected users is false or whether there is a possibility that the selected users will engage in dishonest behavior.

[0169] Although embodiments for carrying out the present invention have been described above using examples, the present invention is not limited in any way to these embodiments, and various modifications and substitutions can be made without departing from the spirit of the present invention. [Explanation of Symbols]

[0170] 1 System 100 devices 110 Input / output section 120 Control Unit 130 Storage section 140 Communications Department 200 servers 210 Communications Department 220 Control Unit 230 Storage section

Claims

1. A server comprising a communications unit and a control unit, The aforementioned communication unit communicates with two or more terminals, The control unit, Based on the information of two or more users associated with each of the two or more terminals stored in the memory unit, two users are matched from among the two or more users. In each stage of the relationship process, which involves at least two stages, (a) To transmit information about the call between the two users to each of the two terminals associated with the two users via the communication unit and display the call screen, (b) Upon the termination of the call between the two users, the communication unit receives a response from each of the two terminals confirming whether they wish to proceed to the next stage of the relationship step, (c) If a response indicating a desire to move to the next stage of the relationship step is received from both terminals, the relationship step for the two users will be moved to the next stage, Perform the process that includes, In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. Based on the information from the call between the two users, the system analyzes at least one of the following: the presence or absence of interest, concern, or empathy between the two users, or the highlights or exciting moments in the call between the two users. After the call between the two users ends, the analysis results are displayed on each of the two terminals. server.

2. A server comprising a communications unit and a control unit, The aforementioned communication unit communicates with two or more terminals, The control unit, Based on the information of two or more users associated with each of the two or more terminals stored in the memory unit, two users are matched from among the two or more users. In each stage of the relationship process, which involves at least two stages, (a) To transmit information about the call between the two users to each of the two terminals associated with the two users via the communication unit and display the call screen, (b) Upon the termination of the call between the two users, the communication unit receives a response from each of the two terminals confirming whether they wish to proceed to the next stage of the relationship step, (c) If a response indicating a desire to move to the next stage of the relationship step is received from both terminals, the relationship step for the two users will be moved to the next stage, Perform the process that includes, In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. Based on the call information between the two users, a summary of the call is generated and displayed on each of the two terminals. server.

3. A server comprising a communications unit and a control unit, The aforementioned communication unit communicates with two or more terminals, The control unit, Based on the information of two or more users associated with each of the two or more terminals stored in the memory unit, two users are matched from among the two or more users. In each stage of the relationship process, which involves at least two stages, (a) To transmit information about the call between the two users to each of the two terminals associated with the two users via the communication unit and display the call screen, (b) Upon the termination of the call between the two users, the communication unit receives a response from each of the two terminals confirming whether they wish to proceed to the next stage of the relationship step, (c) If a response indicating a desire to move to the next stage of the relationship step is received from both terminals, the relationship step for the two users will be moved to the next stage, Perform the process that includes, In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. In a call between the two users, the topic is displayed on the call screen via the communication unit. The topics mentioned above are weighted, The next topic to be displayed will have a heavier weight than the previously displayed topic. server.

4. A server comprising a communications unit and a control unit, The aforementioned communication unit communicates with two or more terminals, The control unit, Based on the information of two or more users associated with each of the two or more terminals stored in the memory unit, two users are matched from among the two or more users. In each stage of the relationship process, which involves at least two stages, (a) To transmit information about the call between the two users to each of the two terminals associated with the two users via the communication unit and display the call screen, (b) Upon the termination of the call between the two users, the communication unit receives a response from each of the two terminals confirming whether they wish to proceed to the next stage of the relationship step, (c) If a response indicating a desire to move to the next stage of the relationship step is received from both terminals, the relationship step for the two users will be moved to the next stage, Perform the process that includes, In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. In a call between the two users, after a predetermined time has elapsed from the start of the call, but before the predetermined call time for each interaction step has elapsed, a confirmation message will be displayed on the call screen via the communication unit asking whether to continue the call. If a response indicating a desire to continue the call is received from both of the aforementioned terminals, the call between the two users will be continued. If no response indicating a desire to continue the call is received from at least one of the two terminals, the call between the two users will be terminated. server.

5. A server comprising a communications unit and a control unit, The aforementioned communication unit communicates with two or more terminals, The control unit, Based on the information of two or more users associated with each of the two or more terminals stored in the memory unit, two users are matched from among the two or more users. In each stage of the relationship process, which involves at least two stages, (a) To transmit information about the call between the two users to each of the two terminals associated with the two users via the communication unit and display the call screen, (b) Upon the termination of the call between the two users, the communication unit receives a response from each of the two terminals confirming whether they wish to proceed to the next stage of the relationship step, (c) If a response indicating a desire to move to the next stage of the relationship step is received from both terminals, the relationship step for the two users will be moved to the next stage, Perform the process that includes, In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. If the call between the two users includes both camera video and audio, the camera video will be turned off before a predetermined time has elapsed from the start of the call, and the camera video will be turned on after the predetermined time has elapsed from the start of the call. server.

6. The control unit, Based on the results of the analysis of the call information of the two users, matching of the two users is performed based on at least one of the static evaluation or dynamic evaluation of the two users. The profile information of the user selected in the matching process between the two users is displayed on each of the two terminals. The server according to any one of claims 1 to 5.

7. The control unit performs matching between the two users by inputting the results of an analysis based on the call information of the two users into an AI (Artificial Intelligence) model. The server according to any one of claims 1 to 5.

8. The control unit, Based on the information from the two users' calls, the analysis will determine whether the two users have any interests, concerns, or empathy, or at least one of the highlights or exciting moments in the two users' calls. The results of the analysis are used to match the two users mentioned above. The server according to any one of claims 1 to 5.

9. The control unit updates the user's profile information by inputting the results of an analysis based on the call information between the two users into the AI ​​(Artificial Intelligence) model. The server according to any one of claims 1 to 5.

10. The control unit performs the above processing on a call including camera images and audio at a predetermined stage after the first stage of the interaction step. The server according to any one of claims 1 to 5.

11. If the control unit receives a response from both terminals indicating a desire to proceed to the next stage of the dating step, it stores the stage of the dating step for each of the two users in the storage unit, associating it with the identification information of each of the two users. The server according to any one of claims 1 to 5.

12. Confirmation of whether the user wishes to proceed to the next stage of the aforementioned relationship steps will be displayed on the call screen after the call between the two users has ended. The server according to any one of claims 1 to 5.

13. The control unit, If a response indicating a desire to proceed to the next stage of the relationship step is received from both terminals, a confirmation message will be displayed asking whether the user wishes to proceed to the next stage of the relationship step, followed by a display of possible dates and times for the next stage of the relationship step on each of the two terminals via the communication unit. If the date and time selected from the date and time candidates received from the two terminals match, the matching date and time is stored in the storage unit as the date and time of the call in the next stage of the interaction step, associated with the identification information of each of the two users. The server according to any one of claims 1 to 5.

14. The control unit causes each of the two terminals to be notified of a reminder of the call in the next stage of the dating step, a first time before the date and time of the call in the next stage of the dating step. The server according to claim 13.

15. The control unit performs processing related to message exchange or scheduling a meeting at a predetermined stage of the dating step. The server according to any one of claims 1 to 5.

16. The control unit controls the call between the two users based on the type of call and call duration predetermined for each stage of the interaction step. The server according to any one of claims 1 to 5.

17. The control unit, If a response indicating that the user does not wish to proceed to the next stage of the dating step is received from at least one of the two terminals, or if a response to the question of whether the user wishes to proceed to the next stage of the dating step is not received from at least one of the two terminals within a predetermined time from the display of the question of whether the user wishes to proceed to the next stage of the dating step, then information indicating that matching of the two users is prohibited is stored in the storage unit in association with the identification information of each of the two users. The server according to any one of claims 1 to 5.

18. When the control unit stores information indicating that matching of the two users is prohibited, if the stages of the dating steps of the two users associated with the identification information of each of the two users are stored in the storage unit, the control unit deletes the associated stages of the dating steps of the two users from the storage unit. The server according to claim 17.

19. The control unit generates input information based on at least one of the profile information of the two users or the information of the call between the two users, inputs the input information to the artificial intelligence model that generates the topic, and displays the topic output by the artificial intelligence model on the call screen. The server according to claim 3.

20. The control unit detects silence in the call between the two users based on the call information, The aforementioned topic will be displayed in response to the detection of silence. The server according to claim 3.

21. The control unit, In a call between the two users, the topic is displayed on the call screen via the communication unit. If a response indicating a desire to continue the call is received from both of the aforementioned devices, the topic will be changed. The server according to claim 4.

22. The control unit, If a response indicating that the user does not wish to continue the call is received from at least one of the two terminals, or if a response to a question about whether the user wishes to continue the call is not received from at least one of the two terminals within a predetermined time after the display of the question about whether the user wishes to continue the call, then information indicating that matching of the two users is prohibited is stored in the storage unit in association with the identification information of each of the two users. The server according to claim 4.

23. Computers Communicating with two or more devices, Based on the information of two or more users associated with two or more terminals, two users are matched from among the two or more users. In each stage of the relationship process, which involves at least two stages, (a) Sending call information between the two users to each of the two terminals associated with the two users to display the call screen, (b) A confirmation displayed on the two terminals in response to the end of a call between the two users, in which the user receives a response from each of the two terminals to the confirmation of whether they wish to proceed to the next stage of the relationship step, (c) If a response indicating a desire to move to the next stage of the relationship step is received from both terminals, the relationship step for the two users will be moved to the next stage, Perform the process that includes, In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. Based on the information from the call between the two users, the system analyzes at least one of the following: the presence or absence of interest, concern, or empathy between the two users, or the highlights or exciting moments in the call between the two users. After the call between the two users ends, the analysis results are displayed on each of the two terminals. Information processing methods.

24. A system including two or more terminals and a server that communicates with the two or more terminals, The system comprises a storage unit and a control unit, The storage unit stores information of two or more users associated with each of the two or more terminals. The control unit, Based on the information of the two or more users mentioned above, two users are matched from among the two or more users. In each stage of the relationship process, which involves at least two stages, (a) Display the call screen between the two users on each of the two terminals associated with the two users, (b) In response to the end of the call between the two users, a confirmation message will be displayed on each of the two terminals asking whether they wish to proceed to the next stage of the relationship step, (c) If a response indicating a desire to move to the next stage of the dating step is entered on both terminals, the dating step for both users will be moved to the next stage. Perform the process that includes, In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. Based on the information from the call between the two users, the system analyzes at least one of the following: the presence or absence of interest, concern, or empathy between the two users, or the highlights or exciting moments in the call between the two users. After the call between the two users ends, the analysis results are displayed on each of the two terminals. system.

25. In the processor, In each stage of the relationship process, which involves at least two stages, (a) Receiving information from the server about a call between two users who are matched from among two or more users, (b) Display a call screen based on the information of the incoming call, (c) In response to the termination of the call between the two users, a confirmation will be displayed as a series of processes following the terminated call, asking whether the user wishes to proceed to the next stage of the relationship steps. (d) Sending the response entered to the server to confirm whether the person wishes to proceed to the next stage of the relationship step, A program for performing a process that includes the following: In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. Based on the information from the call between the two users, at least one of the following is analyzed: the presence or absence of interest, concern, or empathy between the two users, or the excitement or highlights of the call between the two users. The processor is instructed to display the analysis results after the call between the two users has ended. program.

26. Computers Communicating with two or more devices, Based on the information of two or more users associated with two or more terminals, two users are matched from among the two or more users. In each stage of the relationship process, which involves at least two stages, (a) Sending call information between the two users to each of the two terminals associated with the two users to display the call screen, (b) A confirmation displayed on the two terminals in response to the end of a call between the two users, in which the user receives a response from each of the two terminals to the confirmation of whether they wish to proceed to the next stage of the relationship step, (c) If a response indicating a desire to move to the next stage of the relationship step is received from both terminals, the relationship step for the two users will be moved to the next stage, Perform the process that includes, In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. Based on the call information between the two users, a summary of the call is generated and displayed on each of the two terminals. Information processing methods.

27. A system including two or more terminals and a server that communicates with the two or more terminals, The system comprises a storage unit and a control unit, The storage unit stores information of two or more users associated with each of the two or more terminals. The control unit, Based on the information of the two or more users mentioned above, two users are matched from among the two or more users. In each stage of the relationship process, which involves at least two stages, (a) Display the call screen between the two users on each of the two terminals associated with the two users, (b) In response to the end of the call between the two users, a confirmation message will be displayed on each of the two terminals asking whether they wish to proceed to the next stage of the relationship step, (c) If a response indicating a desire to move to the next stage of the dating step is entered on both terminals, the dating step for both users will be moved to the next stage. Perform the process that includes, In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. Based on the call information between the two users, a summary of the call is generated and displayed on each of the two terminals. system.

28. In the processor, In each stage of the relationship process, which involves at least two stages, (a) Receiving information from the server about a call between two users who are matched from among two or more users, (b) Display a call screen based on the information of the incoming call, (c) In response to the termination of the call between the two users, a confirmation will be displayed as a series of processes following the terminated call, asking whether the user wishes to proceed to the next stage of the relationship steps. (d) Sending the response entered to the server to confirm whether the person wishes to proceed to the next stage of the relationship step, A program for performing a process that includes the following: In the first stage of the aforementioned dating steps, the above processing is performed for voice-only calls. Based on the call information between the two users, a summary of the call is generated and displayed on the processor. program.

Images