System, information processing method, server, and program

Abstract

This prevents the occurrence of an ambiguous situation as to whether or not to continue the relationship. [Solution] The server matches two users based on information about two or more users each associated with two or more terminals, and at each stage of a relationship step including two or more stages, performs processing including: (a) sending information about the call between the two users to the two terminals associated with the two users and displaying the call screen; (b) receiving responses from the two terminals to a confirmation displayed on the two terminals upon completion of the call between the two users as to whether they wish to move to the next relationship step; and (c) if responses indicating a desire to move to the next relationship step are received from both of the two terminals, moving the relationship step of the two users to the next stage; and at the first stage of the relationship step, the server performs the above processing for voice-only calls.

Description

[Technical Field]

[0001] The present invention relates to a system, an information processing method, a server, and a program. [Background technology]

[0002] Conventionally, there have been provided matching services for meeting people using the Internet. In particular, there are services that support not only temporary matching but also the building of lasting relationships.

[0003] For example, Patent Document 1 describes an email sending and receiving system including a management computer equipped with a web server for user registration, a database for storing user information, and a mail server that provides mailboxes with folder structures for each relationship stage, and a user terminal. In this email sending and receiving system, the relationship stages are exemplified as application, email dating, telephone dating, photo exchange, and matchmaking date. Users advance their relationship by exchanging emails with their partner using folders corresponding to the relationship stage. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-48365 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology described in Patent Document 1 may result in an ambiguous state as to whether or not to continue the relationship. For example, at the stage of email or phone dating, if the dating partner does not reply to the user's email, the user falls into an ambiguous state as to whether or not to continue the relationship. And, as long as there is no reply, this ambiguous state continues.

[0006] An object of the present invention is to provide a system, an information processing method, a server, and a program that can prevent an ambiguous situation from occurring in which it is unclear whether or not to continue a relationship. [Means for solving the problem]

[0007] A server according to one embodiment of the present invention includes a communication unit and a control unit, wherein the communication unit communicates with two or more terminals, and the control unit matches two users from among the two or more users based on information about the two or more users associated with the two or more terminals, which is stored in a memory unit, and performs processing including, at each stage of a relationship step, which includes at least two or more stages, (a) transmitting information about the call between the two users to each of the two terminals associated with the two users via the communication unit to display a call screen, (b) receiving a confirmation displayed on the two terminals upon completion of the call between the two users, in which a response to a confirmation as to whether the user wishes to move to the next stage of the relationship step is received from each of the two terminals via the communication unit, and (c) if a response indicating a desire to move to the next stage of the relationship step is received from both of the two terminals, moving the relationship step of the two users to the next stage, and in the first stage of the relationship step, the processing is performed for a voice-only call.

[0008] An information processing method according to one embodiment of the present invention involves a computer communicating with two or more terminals, matching two users from among the two or more users based on information about two or more users associated with the two or more terminals, and performing processing at each stage of a relationship step, which includes at least two or more stages, including (a) sending information about the call between the two users to each of the two terminals associated with the two users and displaying a call screen; (b) receiving, from each of the two terminals, a response to a confirmation of whether the user wishes to move to the next stage of the relationship step, which is displayed on the two terminals upon completion of the call between the two users; and (c) if a response indicating a desire to move to the next stage of the relationship step is received from both of the two terminals, moving the relationship step of the two users to the next stage, and in the first stage of the relationship step, performing the processing for a voice-only call.

[0009] A system according to another embodiment of the present invention includes two or more terminals and a server that communicates with the two or more terminals, and is equipped with a memory unit and a control unit. The memory unit stores information on two or more users that are respectively associated with the two or more terminals. The control unit matches two users from the two or more users based on the information on the two or more users, and at each stage of a relationship step that includes at least two or more stages, performs processing including: (a) displaying a call screen between the two users on each of the two terminals associated with the two users; (b) displaying a confirmation on each of the two terminals as to whether the user wishes to move to the next stage of the relationship step upon completion of the call between the two users; and (c) if a response indicating a desire to move to the next stage of the relationship step is entered on both of the two terminals, moving the relationship step of the two users to the next stage. In the first stage of the relationship step, the processing is performed for a voice-only call.

[0010] A program according to another embodiment of the present invention is a program for causing a processor to execute processing including, at each stage of a dating step including at least two or more stages, (a) receiving from a server information about a call between two users matched from two or more users, (b) displaying a call screen based on the received call information, (c) upon completion of the call between the two users, displaying a confirmation as to whether the user wishes to move on to the next dating step as a series of processes following the completed call, and (d) sending to the server a response entered in response to the confirmation as to whether the user wishes to move on to the next dating step, wherein the processing is performed for an audio-only call at the first stage of the dating step. [Effects of the Invention]

[0011] According to one aspect of the present invention, it is possible to prevent a situation in which it is unclear whether or not to continue a relationship. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a diagram illustrating an example of a configuration of a system according to an embodiment of the present invention. [Figure 2] FIG. 10 is a diagram illustrating an example of a user matching screen. [Figure 3] FIG. 10 is a diagram illustrating an example of a voice call screen. [Figure 4] FIG. 10 is a diagram illustrating an example of confirmation of continuation of a call. [Figure 5] FIG. 10 is a diagram showing an example of confirmation of continued dating. [Figure 6] FIG. 10 is a diagram showing an example of a video call screen (without showing face); [Figure 7] FIG. 10 is a diagram showing an example of a video call screen (with face shown). [Figure 8] FIG. 10 is a diagram illustrating an example of a message exchange screen. [Figure 9] FIG. 2 is a sequence diagram showing an example of the overall flow of processing executed by the system. [Figure 10] FIG. 10 is a sequence diagram showing an example of the flow of a user matching process. [Figure 11] FIG. 10 is a sequence diagram showing an example of a processing flow in a first voice call. [Figure 12] FIG. 10 is a sequence diagram showing an example of a processing flow in a second voice call. [Figure 13] FIG. 10 is a sequence diagram illustrating an example of a processing flow in a video call. [Figure 14] FIG. 10 is a sequence diagram showing an example of a processing flow in a real date. DETAILED DESCRIPTION OF THE INVENTION

[0013] <1. Overview> Conventional matching services (so-called matching apps) primarily provide users with external information, such as the appearance of potential matchmakers. Users make relationship building decisions based on this external information. However, little information other than external information is provided. As a result, users have difficulty making decisions based on the potential matchmaker's internal characteristics, such as their personality or communication skills. This can make it difficult to encounter diverse people. Furthermore, because conventional matching services focus on a single encounter, they are unable to support the building of deep relationships (i.e., the building of a lasting relationship). Therefore, a system according to one embodiment of the present invention provides an audio-only call for the first call, and a call including camera footage for subsequent calls, and confirms the transition to the next relationship step at the end of each call. The calls include audio-only calls (i.e., voice calls) and calls including camera footage and audio (i.e., video calls).

[0014] <2. Configuration> A system according to one embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of a system 1 according to this embodiment. The system 1 includes terminals 100A and 100B (hereinafter also collectively referred to as terminals 100) and a server 200.

[0015] The terminal 100 includes an input / output unit 110, a control unit 120, a storage unit 130, and a communication unit 140. For example, the terminal 100 may be a smartphone or a PC (Personal Computer).

[0016] The input / output unit 110 performs input and output in cooperation with the control unit 120. Specifically, the input / output unit 110 outputs images and audio provided by the control unit 120. The input / output unit 110 also accepts various inputs and provides the input information to the control unit 120. The input content may be, for example, an operation on a screen displayed as an image by the input / output unit 110, an image around the terminal 100 (e.g., an image from a camera), and audio around the terminal 100. The input / output unit 110 may be realized by a touch panel display, a speaker, a camera, and a microphone. A display and a keyboard or a mouse may be used instead of or in addition to the touch panel display.

[0017] The control unit 120 controls the processing of the terminal 100. Specifically, the control unit 120 causes the input / output unit 110 to output images and audio based on information received by the communication unit 140 from the server 200. The control unit 120 also generates information based on input received by the input / output unit 110 and causes the communication unit 140 to transmit the generated information to the server 200. The control unit 120 also reads and writes information from and to the storage unit 130. The control unit 120 may be implemented by a processor and a memory. The processor implements the functions of the control unit 120 by reading and executing a program for the control unit 120 from the memory. For example, the processor may include a central processing unit (CPU) and may also include a graphics processing unit (GPU). The memory may include read-only memory (ROM), random access memory (RAM), and flash memory. The control unit 120 may be an application running on an operating system (OS) and may perform various controls by utilizing functions of the OS.

[0018] The storage unit 130 stores information used in processing by the terminal 100. Specifically, the storage unit 130 stores information received by the communication unit 140 from the server 200, information generated by the control unit 120, and input information from the input / output unit 110. The storage unit 130 may be realized by a storage such as a flash memory, an HDD (Hard Disk Drive), or an SSD (Solid State Drive). Note that the storage may be external.

[0019] The communication unit 140 communicates with the server 200. Specifically, the communication unit 140 receives information to be provided to the control unit 120 from the server 200, and transmits information provided from the control unit 120 to the server 200. For example, the communication unit 140 may be realized by a communication module capable of wireless communication, such as cellular communication using a system such as LTE (Long Term Evolution) (registered trademark) or 5G, or communication using a system such as WiFi (registered trademark) or Bluetooth (registered trademark). Alternatively, a communication module capable of wired communication may be used instead of or in addition to a communication module capable of wireless communication.

[0020] The server 200 includes a communication unit 210, a control unit 220, and a storage unit 230. For example, the server 200 may be realized by a single device, or may be realized by multiple devices using a technology such as cloud computing. The storage unit 230 may not be included in the server 200, but may be a separate component communicatively connected to the server 200. For example, the storage unit 230 may be a NAS (Network Attached Storage).

[0021] The communication unit 210 communicates with a plurality of terminals 100. Specifically, the communication unit 210 receives information to be provided to the control unit 220 from the plurality of terminals 100, and transmits information provided from the control unit 220 to the plurality of terminals 100. For example, the communication unit 210 may have a function of a web server. Like the communication unit 140, the communication unit 210 may be realized by a communication module capable of wireless or wired communication.

[0022] The control unit 220 controls the processing of the server 200. Specifically, the control unit 220 performs processing based on information from the communication unit 210 and causes the multiple terminals 100 to transmit information to the communication unit 210. The control unit 220 also reads and writes information from and to the storage unit 230. For example, the control unit 220 may include a matching processing unit 221, a voice call processing unit 222, a video call processing unit 223, a message processing unit 224, a schedule processing unit 225, and a topic provision processing unit 226 as application server functions. The operation of each processing unit will be described later. The control unit 220 may be realized by one or more processors and one or more memories. The processor realizes the function of the control unit 220 by reading and executing the program of the control unit 220 from the memory. For example, the processor may include a CPU, and a GPU may be used in combination. The memory may include a ROM, a RAM, and a flash memory.

[0023] The storage unit 230 stores information used in the processing of the server 200. Specifically, the storage unit 230 stores user data D1, call data D2, message data D3, and topic data D4. The user data D1 includes, for example, a user's ID (identifier), profile information such as the user's age, address, hobbies, interests, likes and dislikes, income, educational background, occupation, and introduction, a login status to the system 1, a relationship status indicating a relationship step including at least two stages, and schedule information such as the date and time of a call. The user data D1 may also include account information of the user in the system 1. The call data D2 includes, for example, voice call data and video call data. A voice call is a call consisting only of voice. Note that the voice call may be a call involving an avatar. The avatar may be a still image or a motion image (i.e., an animated image). The motion image may be an image that resembles the user's body, and parts of the image may move or the facial expression may change in response to movements of body parts (for example, facial movements or hand movements). Avatar information may be stored in the storage unit 130 of the terminal 100, or may be acquired from the terminal 100 as part of call data and stored in the storage unit 230 of the server 200 in association with the user's ID. A video call is a call that includes camera footage and audio. The camera footage may be processed. The message data D3 includes text and images. The topic data D4 includes various topics presented to the user during a call or message exchange. The storage unit 230 may be implemented by a storage device such as an HDD or SSD.

[0024] The control unit 120 of the terminal 100 and the control unit 220 of the server 200 can function as a control unit of the system 1. The memory unit 130 of the terminal 100 and the memory unit 230 of the server 200 can function as a memory unit of the system 1. In the following, the processing performed by the control unit 120 of the terminal 100 using the input / output unit 110, the memory unit 130, and the communication unit 140 is also expressed as the terminal 100 performing the processing. The processing of the terminal 100 is performed by an application installed on the terminal 100. The operation of the application is defined by a program stored in the terminal 100.

[0025] <3. Matching process> The matching process will be described with reference to FIG. 2. The matching process is mainly performed by the terminal 100 and the matching processing unit 221 of the server 200. In the matching process, two users who will be making a call are matched. Specifically, the matching processing unit 221 matches two users from two or more users based on information of two or more users associated with each of the multiple terminals 100 stored in the storage unit 230. The information of the two or more users includes user identifiers and may also include user login information. The information of the two or more users may also include at least the ages and addresses of the users. Furthermore, the matching processing unit 221 matches two users from two or more users based also on information indicating prohibition of matching two users (hereinafter also referred to as a prohibition flag).

[0026] First, the matching processing unit 221 extracts users who have logged in to the system 1 and whose login status to the system 1 is "Logged in" from all users stored in the storage unit 230. The matching processing unit 221 filters the extracted users based on the user's profile information and a prohibition flag, which will be described later. Filtering conditions based on the profile information may include that the age difference between the users is within a predetermined range, and that the users' addresses are in neighboring prefectures, neighboring cities, wards, towns, and villages, or that the distance by public transportation is within a predetermined time, etc. Users for which the prohibition flag is set are mutually excluded by filtering. For example, as shown in FIG. 2, when an application of the system 1 is launched on the terminal 100A, a matching screen 10 is displayed. The server 200 performs the above-mentioned filtering on the users of the terminal 100A.

[0027] The matching processing unit 221 randomly selects users as match candidates from the filtered users. One user or multiple users may be selected. When multiple users are selected, a call partner is further determined from among them. The matching processing unit 221 transmits information about the selected user and information for calling the user to the terminal 100A via the communication unit 210. The user information transmitted to the terminal 100A may be the user's profile information. Furthermore, the information for calling the user may be a URL (Unform Resource Locator) for voice calls. The terminal 100A displays an overview of the received user information on a match screen. For example, as shown in FIG. 2, the terminal 100A receives information about the selected user from the server 200 and displays a match screen 11 including profile information such as age, address, and a summary of hobbies based on the information about the selected user. Note that the matching processing unit 221 may randomly select users as match candidates from all users without filtering.

[0028] After a predetermined time has elapsed since the call preparation screen was displayed, the terminal 100A starts a call based on information for making a call. For example, as shown in FIG. 2, the terminal 100A displays a call preparation screen 20. The call preparation screen 20 may display detailed profile information of a user selected as a matching candidate. After a predetermined time has elapsed since the call preparation screen 20 was displayed, the terminal 100A accesses the server 200 using a URL for voice calls and starts a voice call. Note that the relationship status at the time of matching may be empty (i.e., the first stage of the relationship step). At the first stage of the relationship step, voice call processing is performed.

[0029] <4. Voice call processing> The voice call processing will be described with reference to Figs. 3 to 5. The voice call processing is mainly performed by the terminal 100 and the voice call processing unit 222 of the server 200. In the voice call processing, a voice call and a topic are provided to two users who are communicating. Specifically, information about the voice call between the two users (i.e., voice call data) is transmitted to each of the terminals 100A and 100B associated with the two users, and a voice call screen is displayed. Furthermore, in the call between the two users, the topic is displayed on the voice call screen. Note that in the examples of Figs. 3 to 5, the voice call processing will be described for the terminal 100A, but similar processing is also performed for the terminal 100B.

[0030] First, when a voice call is started between terminals 100A and 100B based on information for making a call, voice call processing unit 222 transmits voice call data and a topic to terminals 100A and 100B. The topic is provided by topic provision processing unit 226. Terminals 100A and 100B output voice based on the received voice call data and display the provided topic.

[0031] For example, when a voice call is started, the voice data acquired by the terminals 100A and 100B are each transmitted to the server 200. The voice call processing unit 222 transmits the voice data from the terminal 100A to the terminal 100B, and transmits the voice data from the terminal 100B to the terminal 100A, via the communication unit 210. The voice call processing unit 222 also transmits the topic of the voice call to the terminals 100A and 100B together with the voice data.

[0032] When a voice call is initiated, the terminal 100A displays a voice call screen 30. A topic received from the server 200 is displayed on the voice call screen 30. A display time for the topic may be set, and the remaining display time may be displayed. When the remaining display time reaches 0, the topic may be deleted or switched to another topic. For example, as shown in FIG. 3, the topic may be switched as shown in voice call screens 30, 31, and 32. Details of topic switching will be described later. The voice call screen 30 may also display avatars of the two users who are talking. The avatars may be icon images as shown in FIG. 3, or motion images. Information about the avatar of the call partner may be included in the call information (i.e., voice call data). Note that the voice call may not have an avatar.

[0033] Furthermore, confirmation as to whether to continue the call is made during a voice call. Specifically, in a call between two users, a confirmation as to whether to continue the call is displayed on the call screen after a predetermined time has elapsed since the start of the call and before the elapse of a call time predetermined for each communication step. If a response indicating a desire to continue the call is received from both terminals 100A and 100B, the call between the two users continues. If a response indicating a desire to continue the call is not received from at least one of terminals 100A and 100B, the call between the two users is terminated. Furthermore, if the call between the two users is a voice-only call, a confirmation as to whether to continue the call is displayed. If a response indicating a desire to continue the call is received from both terminals 100A and 100B, the topic is changed. Note that the number of times confirmation as to whether to continue the call during the call may be one or more times.

[0034] For example, the terminals 100A and 100B display options "Yes" and "No" on the voice call screen 33 to confirm whether to continue the call after a predetermined time (e.g., 5 minutes) has elapsed since the start of the voice call and before the set call time (e.g., 15 minutes) has elapsed, as shown in FIG. 4. If both of the two users select "Yes," the terminals 100A and 100B continue the voice call. If at least one of the two users selects "No," the terminals 100A and 100B terminate the voice call. Alternatively, a response time (e.g., 30 seconds) may be set for the confirmation of whether to continue the call, and if at least one of the two users does not respond within the response time, the voice call may be terminated. Furthermore, if both of the two users select "Yes," the terminals 100A and 100B restore the display content of the voice call screen to its original state and switch the displayed topic. The voice call may also be terminated based on a user operation. For example, the voice call may be terminated in response to pressing a call end button displayed in the upper right corner of each of the voice call screens 30 to 32 shown in FIG. 3. Before ending the voice call, a confirmation message may be displayed asking whether it is OK to end the call.

[0035] Then, in response to the end of the voice call between the two users due to the lapse of a predetermined call time, a confirmation as to whether or not the user wishes to move to the next relationship step is displayed on each of terminals 100A and 100B as a series of processes following the ended voice call. If a response indicating a desire to move to the next relationship step is received from both terminals 100A and 100B, the relationship step of the two users is moved to the next step. In this case, the relationship step of the two users is stored in association with the identification information of each of the two users. The confirmation as to whether or not the user wishes to move to the next relationship step is displayed on the voice call screen after the voice call between the two users ends. The voice call between the two users is controlled based on the type of call and the call time predetermined for each relationship step. Furthermore, one or more functions or one or more constraints may be set for each relationship step. For example, the relationship steps may include a first stage in which a first voice call is set, a second stage in which a second voice call is set, a third stage (a predetermined stage after the first stage) in which a video call is set, a fourth stage (a predetermined stage after the above predetermined stage) in which message exchange or arrangement of a date to meet in person is set, and a fifth stage in which all functions are set. In addition, in the fifth stage, some or all functions may be restricted to users other than the user being dated. Each stage may also be referred to by another name. For example, the fifth stage may be referred to as "official dating." For the stage in which a call is set, a call duration may be set. Furthermore, a transition condition for each stage may be set. For example, a transition condition for the second stage may be that one voice call has been completed and an agreement has been reached to transition to the next relationship step. A transition condition for the third stage may be that two voice calls have been completed and an agreement has been reached to transition to the next relationship step. A transition condition for the fourth stage may be that a video call has been completed and an agreement has been reached to transition to the next relationship step.

[0036] For example, the terminals 100A and 100B end the voice call when a set call time (e.g., 15 minutes) has elapsed since the start of the voice call. Then, as shown in FIG. 5, the terminals 100A and 100B display options "Yes" and "No" on the voice call screen 34 to confirm whether the user wants to talk to the other user again. If both of the two users select "Yes," the voice call processing unit 222 updates the relationship status to the second voice call stage (i.e., the second stage) if the relationship status associated with the IDs of the two users stored in the storage unit 230 is empty (i.e., the first stage). If the stored relationship status is the second stage, the relationship status is updated to the video call stage (i.e., the third stage). In other words, updating to the second or third stage corresponds to a transition to a state in which a call is possible at the next stage of the relationship steps. The terminals 100A and 100B display a voice call screen 35 indicating that the relationship has progressed to the next stage of the relationship steps. If at least one of the two users selects "No," the terminals 100A and 100B close the voice call screen 34. Alternatively, a response time (e.g., 30 seconds) may be set for the confirmation of transition to the relationship step, and if at least one of the two users does not respond within the response time, the voice call screen 34 may be closed.

[0037] Here, it is undesirable to rematch two users, at least one of whom does not wish to continue the relationship. Therefore, a prohibition flag is set for the two users. As a result, the two users are excluded from matching candidates in the next and subsequent matching processes. Specifically, if a response indicating that the user does not wish to continue the call is received from at least one of the terminals 100A and 100B, or if a response to a confirmation as to whether the user wishes to continue the call is not received from at least one of the terminals 100A and 100B within a predetermined time from the display of the confirmation as to whether the user wishes to continue the call, information indicating prohibition of matching between the two users is stored in association with the identification information of each of the two users. Also, if a response indicating that the user does not wish to move to the next relationship step is received from at least one of the terminals 100A and 100B, or if a response to a confirmation as to whether the user wishes to move to the next relationship step is not received from at least one of the terminals 100A and 100B within a predetermined time from the display of the confirmation as to whether the user wishes to move to the next relationship step, information indicating prohibition of matching between the two users is stored in association with the identification information of each of the two users. In this case, if the stages of the relationship steps of the two users associated with the identification information of each of the two users are stored, the stages of the relationship steps of the two associated users are deleted.

[0038] For example, if at least one of the two users selects "No" in response to a question about whether to continue the call shown in FIG. 4, or if at least one of the two users does not respond within the response time, a prohibition flag may be set for the two users. Also, if at least one of the two users selects "No" in response to a question about whether they want to call the other user again shown in FIG. 5, or if at least one of the two users does not respond within the response time, a prohibition flag may be set for the two users. Furthermore, along with the setting of the prohibition flag, the relationship status associated with the IDs of the two users may be deleted.

[0039] If the two users wish to move to the next relationship stage (for example, the second or third stage), the schedule process adjusts the date and time for the call at the next relationship stage. The date and time for the call at the next relationship stage is determined by the schedule adjustment and stored in the storage unit 230.

[0040] Just before the date and time of the scheduled voice call, the two users scheduled to make a call are enabled to perform an operation to start the voice call. Specifically, a second time before the date and time of the voice call in the next stage of the relationship step, an operation to start the voice call in the next stage of the relationship step is enabled on each of terminals 100A and 100B. For example, terminals 100A and 100B enable a voice call button five minutes before the stored date and time of the second voice call. The second time may be the same as the first time (e.g., five minutes) at which the final notification is made. Note that the voice call button may be hidden before it is enabled.

[0041] When the scheduled date and time of the voice call arrives, if one of the two users has not participated in the voice call, the voice call is terminated. Specifically, in response to an operation to start a voice call in the next stage of the relationship step, the voice call in the next stage of the relationship step is started. If at least one of the two users has not participated in the voice call until a predetermined time has elapsed since the date and time of the voice call in the next stage of the relationship step, the voice call in the next stage of the relationship step is terminated. For example, when the voice call button is pressed, terminal 100A accesses server 200 using a URL for the second voice call and starts the voice call. On the other hand, since the application of system 1 is not running on terminal 100B, access to server 200 is not performed and the voice call is not started. If there is no access from terminal 100B until a predetermined time has elapsed since the date and time of the second voice call, voice call processing unit 222 of server 200 sends a voice call termination instruction to terminal 100A. Terminal 100A terminates the voice call in response to receiving the voice call termination instruction. The terminal 100A may terminate the voice call when a predetermined time has elapsed since the date and time of the second voice call without receiving an instruction to terminate the voice call from the voice call processing unit 222. In this way, if the call ends because one of the two users does not participate in the call, rescheduling may be performed. Alternatively, prohibition flags may be set for the two users without rescheduling the call.

[0042] <5. Schedule Processing> Schedule processing will be described with reference to FIG. 5. Schedule processing is mainly performed by the terminal 100 and the schedule processing unit 225 of the server 200. In the schedule processing, for two users who wish to move to the next relationship step, a schedule for the activities in the next relationship step is adjusted. Specifically, when responses wishing to move to the next relationship step are received from both terminals 100A and 100B, a confirmation message asking whether the user wishes to move to the next relationship step is displayed, followed by date and time candidates for the next relationship step displayed on terminals 100A and 100B. Then, when a date and time selected from the date and time candidates received from terminals 100A and 100B matches, the matching date and time is stored as the date and time of the call in the next relationship step, associated with the identification information of each of the two users. Before the call between the two users, the dates and times when the two users are available to call received from terminals 100A and 100B are stored, and date and time candidates are determined based on the dates and times when the two users are available to call.

[0043] For example, as shown in FIG. 5, the terminals 100A and 100B display a transition button to a schedule adjustment screen 40 on the voice call screen 35 indicating that the relationship has progressed to the next stage. When the transition button is pressed, the schedule adjustment screen 40 is displayed. When the "Send schedule" button is pressed on the schedule adjustment screen 40, available dates and times for the call that the user has previously input are displayed as date and time candidates. The available dates and times for the call that the user has previously input may be stored in the storage unit 230 of the server 200, and may be read out by the schedule processing unit 225 in response to pressing of the "Send schedule" button and transmitted to the terminals 100A and 100B. When the two users select their desired dates and times from the displayed date and time candidates, the selected desired dates and times are transmitted from the terminals 100A and 100B to the server 200, respectively. The schedule processing unit 225 stores, among the received desired dates and times, a date and time that matches the desired dates and times of the two users as the date and time for the second voice call (or video call) in the storage unit 230.

[0044] As the date and time of the scheduled call approaches, a notification of the scheduled voice call is sent. Specifically, a reminder of the call in the next stage of the relationship step is sent by each of the terminals 100A and 100B a first hour before the date and time of the call in the next stage of the relationship step. For example, the schedule processing unit 225 sends a reminder instruction for the second voice call to the terminals 100A and 100B 24 hours before the stored date and time of the second voice call. In response to receiving the reminder instruction, the terminals 100A and 100B display a notification (i.e., a reminder notification) indicating that the second voice call is scheduled in 24 hours. The reminder notification may be a notification (e.g., a push notification) sent via the OS. The number of reminder notifications may be one or more. For example, the number of reminder notifications may be three, namely, 24 hours, one hour, and five minutes before the scheduled date and time of the call.

[0045] Although the above description has been given with reference to an example of scheduling processing for adjusting a date for a phone call, the above scheduling processing may also be performed for adjusting a date for a real date.

[0046] <6. Video call processing> The video call processing will be described with reference to Fig. 6 and Fig. 7. The video call processing is mainly performed by the terminal 100 and the video call processing unit 223 of the server 200. In the video call processing, a video call and a topic are provided to two users who are calling. Specifically, information about the video call between the two users (i.e., video call data) is transmitted to each of the terminals 100A and 100B, and a video call screen is displayed. Furthermore, in the call between the two users, the topic is displayed on the video call screen. Note that in the example of Fig. 6, the video call processing will be described for the terminal 100A, but similar processing is also performed for the terminal 100B.

[0047] First, when a video call is started based on information for making a call between terminals 100A and 100B, video call processing unit 223 transmits video call data and a topic to terminals 100A and 100B. The topic is provided by topic provision processing unit 226. For example, when a video call is started, audio data and camera image data (i.e., video call data) acquired by terminals 100A and 100B are each transmitted to server 200. Video call processing unit 223 transmits video call data from terminal 100A to terminal 100B, and transmits video call data from terminal 100B to terminal 100A, via communication unit 210. Furthermore, video call processing unit 223 transmits the topic of the video call together with the video call data to terminals 100A and 100B.

[0048] Here, if the call between two users is a video call, the camera image is turned off before a predetermined time has elapsed since the start of the call, and the camera image is turned on after the predetermined time has elapsed since the start of the call. Specifically, the terminals 100A and 100B output only audio based on the received video call data and display the received topic until the predetermined time has elapsed since the start of the video call. After the predetermined time has elapsed since the start of the video call, the terminals 100A and 100B start displaying the camera image based on the provided video call data. For example, when the video call starts, the terminals 100A and 100B display a video call screen 50 with the camera image turned off, as shown in FIG. 6. The video call screen 50 may display a topic received from the server 200, and may display the same content as the voice call screen (e.g., the user's avatar). Just before a predetermined time (e.g., 6 minutes) has elapsed since the start of the video call, the terminals 100A and 100B display on the video call screen 50 a message indicating that the camera image will be switched on and the remaining time until the camera image will be turned on. When a predetermined time has elapsed since the start of the video call, the terminals 100A and 100B switch the camera images on as shown in FIG. 7. User U2 is displayed on the terminal 100A, and user U2 is displayed on the terminal 100B. The topic received from the server 200 is also displayed on the video call screens 51A and 51B when the camera images are on. Note that when the camera images are off (hereinafter also referred to as the camera-off state), substantially the same processing as part or all of the voice call processing other than the processing related to the call continuation confirmation may be performed. Furthermore, when switching from the camera-off state to the camera-on state (hereinafter also referred to as the camera-on state), the displayed topic may be switched.

[0049] As described above, in a voice call, confirmation as to whether to continue the call is displayed during the voice call. However, in a video call, confirmation as to whether to continue the call is not displayed. Specifically, when a call between two users is a video call, a confirmation as to whether to continue the call is not displayed during the video call. For example, in a video call, a confirmation as to whether to continue the call as shown in FIG. 4 is not displayed. Note that a video call may be terminated based on a user operation. For example, a video call may be terminated in response to pressing an end call button displayed in the upper right corner of each video call screen 51A and 51B shown in FIG. 7. However, the end call button may be disabled until a predetermined time has elapsed since the camera image was switched on. This is because turning off the camera image immediately after meeting may cause discomfort to the call partner.

[0050] Then, in response to the end of the video call between the two users after the lapse of a predetermined call time, a confirmation as to whether the user wishes to move on to the next relationship step is displayed on each of terminals 100A and 100B as a series of processes following the ended video call. If, at the third relationship step, responses indicating a desire to move on to the next relationship step are received from both terminals 100A and 100B, the relationship step of the two users is transitioned to the fourth relationship step, in which message exchange or arrangement of a date to meet in person is set. In this case, the relationship step of the two users is stored in association with the identification information of each of the two users. The confirmation as to whether the user wishes to move on to the next relationship step is displayed on the video call screen after the video call between the two users ends. The video call between the two users is controlled based on the type of call and call duration predetermined for each relationship step.

[0051] For example, the terminals 100A and 100B end the video call when a set call time (e.g., 15 minutes) has elapsed since the start of the video call. Then, the terminals 100A and 100B display options "Yes" and "No" on the video call screen to confirm whether the user wants to go on a real date with the other user. If both of the two users select "Yes," the video call processing unit 223 updates the relationship status to the fourth stage if the relationship status associated with the IDs of the two users stored in the storage unit 230 is the third stage. In other words, the update to the fourth stage corresponds to a transition to a state where messages can be exchanged or a date to meet in person can be arranged. The terminals 100A and 100B display a video call screen indicating that the relationship has progressed to the next stage. If at least one of the two users selects "No," the terminals 100A and 100B close the video call screen. Alternatively, a response time (for example, 30 seconds) may be set for the confirmation of transition to the relationship step, and if at least one of the two users does not respond within the response time, the video call screen may be closed.

[0052] Here, as with voice calls, if at least one of the two users does not wish to move on to the next relationship step, a prohibition flag is set for the two users. The content of the process is substantially the same as the process for voice calls, so a description thereof will be omitted.

[0053] The relationship step between two users may be irreversible. For example, the transition from the second to the third stage is not restricted, but the transition from the third to the second stage is restricted. However, the same relationship step may be repeated.

[0054] Furthermore, if the two users wish to move to the next stage (i.e., the fourth stage) of the relationship steps, the schedule for the next stage of the relationship steps is adjusted in the schedule processing described above. By adjusting the schedule, the date and time of the next stage of the relationship steps is determined and stored in the storage unit 230.

[0055] As with voice calls, just before the scheduled video call date and time, the two users who are scheduled to talk can start the video call. The process is essentially the same as the process for voice calls, so a detailed explanation is omitted.

[0056] Similarly to voice calls, if the scheduled time for a video call arrives but one of the two users is not participating in the video call, the video call is terminated. The processing is essentially the same as that for voice calls, so a detailed description is omitted.

[0057] <7. Message Processing> Message processing will be described with reference to Fig. 8. Message processing is mainly performed by the terminal 100 and the message processor 224 of the server 200. In message processing, messages are exchanged between two users. Note that in the example of Fig. 8, message processing will be described for the terminal 100A, but similar processing is also performed for the terminal 100B.

[0058] For example, when the relationship step between two users transitions to the fourth stage (i.e., transitions to a state in which messages can be exchanged), terminals 100A and 100B display a message exchange screen 60 as shown in Fig. 8. When a message (e.g., text) is input to terminals 100A and 100B, as shown in message exchange screens 61 and 62 in Fig. 8, the message data is transmitted to server 200. Message processing unit 224 of server 200 transmits the received message data to terminal 100B and stores it in memory unit 230. Terminal 100B displays the message based on the received message data.

[0059] Schedule adjustments may also be made for real dates. Specifically, an operation object (e.g., an operation button) for schedule adjustment is displayed on the message exchange screen, and when the operation button is pressed, the schedule processing for the schedule adjustment described above is performed. Also, the above-mentioned reminder notification may be sent.

[0060] Furthermore, when a schedule is adjusted for a real date, after the real date ends, a confirmation as to whether to continue the relationship is made. Specifically, after the scheduled date and time of the real date has passed, a confirmation as to whether to continue the relationship is displayed on each of terminals 100A and 100B. If responses indicating a desire to continue the relationship are received from both terminals 100A and 100B, the relationship step stage of the two users is maintained.

[0061] For example, the terminals 100A and 100B display options "Yes" and "No" on a message exchange screen to confirm whether the two users want to date the dating partner again. If both of the two users select "Yes," the message processor 224 maintains the relationship status associated with the IDs of the two users stored in the storage unit 230. The terminals 100A and 100B display a message exchange screen indicating that the relationship continues. Alternatively, the message processor 224 may update the relationship status to a fifth stage (i.e., officially dating). Furthermore, in the fifth stage, some or all functions may be restricted for users other than the dating partner user. For example, in the fifth stage, matching or calls with users other than the dating partner user may be restricted. If at least one of the two users selects "No," the terminals 100A and 100B close the message exchange screen. The message processor 224 transitions the two users to a state in which message exchange is not possible. For example, the relationship status associated with the IDs of the two users may be deleted. Alternatively, a response period (for example, one day) may be set for the confirmation of continued association, and if at least one of the two users does not respond within the response period, the two users may be transitioned to a state in which they are unable to exchange messages.

[0062] Here, for two users where at least one does not wish to continue the relationship, a prohibition flag is set for the two users. Specifically, when a response indicating that the relationship is not desired is received from at least one of the terminals 100A and 100B, or when a response to the confirmation of whether to continue the relationship is not received from at least one of the terminals 100A and 100B within a predetermined period from the date and time of the scheduled real date, information indicating prohibition of matching between the two users is stored in association with the identification information of each of the two users.

[0063] For example, if at least one of the two users selects "No" in response to a question about whether to continue the relationship, or if at least one of the two users does not respond within the response period, a prohibition flag may be set for those two users.

[0064] Additionally, assistance for socializing may be provided in message exchange. Specifically, the message processor 224 estimates content that will contribute to the development of socializing, based on the user data D1, call data D2, and message data D3 stored in the storage unit 230. The message processor 224 transmits data related to the estimated content to the terminals 100A and 100B. The terminals 100A and 100B display suggested messages based on the received data related to the content.

[0065] For example, images or videos with geographic information provided from the terminals 100A and 100B via a message exchange screen are stored in the storage unit 230. The message processing unit 224 estimates content in which the two users are interested from the images or videos with geographic information. For example, if the geographic information is the address of an Italian restaurant, it is estimated that the two users are interested in Italian food. If a torii gate is shown in the image, it is estimated that the two users are interested in shrines. Anniversaries for the two users may also be estimated from the content of the message and the input date and time. The message processing unit 224 generates data related to the estimated content and transmits it to the terminals 100A and 100B. For example, the data related to the content may be lunch or dinner at a restaurant that serves food that the two users are interested in, a topic that the two users are both interested in, a reminder or gift for an anniversary for the two users, etc. The terminals 100A and 100B display the data related to the content as a suggested message to the two users.

[0066] The assistance may also be support for dating. Specifically, the message processor 224 generates a date plan based on each data stored in the storage unit 230 and transmits the date plan to the terminals 100A and 100B. The terminals 100A and 100B display the received date plan. For example, the generated date plan may include the date, time, location, meal contents, budget, and restaurant of the next date. Furthermore, if the two users approve the date plan, a reservation for the restaurant included in the date plan may be made on their behalf. The assistance may be performed by an AI (Artificial Intelligence) model, and the AI ​​model may be updated by machine learning using data stored in the storage unit 230. For example, the message processor 224 generates input information based on at least a portion of the user data D1 (e.g., user profile information), call data D2, or message data D3 stored in the storage unit 230. The input information includes instructions (e.g., prompts) for the AI ​​model. The message processor 224 inputs the input information to the AI ​​model. The AI ​​model outputs content or date plans that contribute to the development of the relationship. For example, the AI ​​model may be a large language model (LLM). The instructions to the AI ​​model may include instructions for controlling the information to be output by the AI. For example, the instructions for controlling the information to be output by the AI ​​may include instructions for narrowing down the information, the granularity of the information, the format or expression of the information, or the amount of information.

[0067] <8. Topic provision processing> The topic provision process is mainly performed by the topic provision processing unit 226 of the terminal 100 and the server 200. In the topic provision process, topics for calls and message exchanges are determined and provided based on each data stored in the storage unit 230. Specifically, the topic is determined based on the profile information of two users. For example, the topic provision processing unit 226 determines, from the topic data D4 stored in the storage unit 230, topics that are estimated to be easy for the two users to talk about, that the two users are interested in, or that the users have knowledge about, based on the profile information of the two users. The determined topic is provided to each processing unit during the call or message exchange and transmitted to the terminals 100A and 100B. Note that the topic provision process may be performed by an AI model, and the AI ​​model may be updated by machine learning using data stored in the storage unit 230, etc. For example, the topic provision processing unit 226 generates input information based on at least a portion of the user data D1 (e.g., user profile information), the call data D2, or the message data D3 stored in the storage unit 230. The input information includes instructions to the AI ​​model. The topic provision processing unit 226 inputs the input information to the AI ​​model. The AI ​​model outputs the topic. For example, the AI ​​model may be an LLM. Furthermore, as described above, the instructions to the AI ​​model may include instructions for controlling the information to be output by the AI.

[0068] Furthermore, the topic of a call between two users may be analyzed, and the topic may be determined based on the analysis results. For example, the topic provision processing unit 226 analyzes the topic of the call based on the call data D2 stored in the storage unit 230. The topic analysis may be performed based on text data converted from the audio data of the call. The topic analysis may be performed after the call ends or in real time. The topic provision processing unit 226 estimates the orientations (i.e., characteristics) of the hobbies, preferences, interests, etc. of the two users based on the analysis results. Then, a topic corresponding to the estimated orientations of the two users is determined and provided from the topic data D4. Note that the orientations of each of the two users may be estimated based on the analysis results of a call with a user different from the user currently calling or exchanging messages. Note that the topic analysis may be performed by an AI model. For example, input information may be generated based on the call data D2, the input information may be input to the AI ​​model, and the analysis results may be output from the AI ​​model.

[0069] Furthermore, the timing at which the topic is displayed may be controlled. Specifically, silence in a call between two users may be detected based on information about the call between the two users, and the topic may be displayed in response to the detection of silence. For example, the topic provision processing unit 226 performs a process of detecting silence in a call based on audio in the call data received from the terminals 100A and 100B. When silence is detected, the topic provision processing unit 226 acquires a topic from the topic data D4 and transmits it to the terminals 100A and 100B. The received topic is displayed on the terminals 100A and 100B. Note that although the topic is acquired in response to the detection of silence, the topic displayed in response to the detection of silence may be acquired in advance before the detection of silence. Furthermore, the topic displayed in response to the detection of silence may be transmitted to the terminals 100A and 100B in advance. The terminals 100A and 100B may perform the above-described process of detecting silence and display the received topic in response to the detection of silence.

[0070] The display order of topics may also be controlled. Specifically, topics may be weighted, and a topic with a higher weight than the currently displayed topic may be displayed next. A topic common to two users or a topic jointly considered by two users may be weighted higher than a topic related to each of the two users. For example, weights may be assigned to topics managed as topic data D4, and topics may be grouped by weight. The weight groups may be three types of groups, such as light, medium, and heavy, or four or more types of groups based on score values. For example, a weight order may be set in the order of light < medium < heavy, and a relationship may be set in which the magnitude of the score value corresponds to the magnitude of the weight. Furthermore, weights may be numerical values ​​assigned to each topic. For example, a relationship may be set in which the magnitude of the numerical value corresponds to the magnitude of the weight. Furthermore, topics with relatively low weights may be topics related to each of the two users, and topics with relatively high weights may be topics common to two users or topics jointly considered by two users. Then, the topic provision processing unit 226 provides topics with low weight first, and then provides topics with high weight later. For example, as shown in FIG. 3, the terminals 100A and 100B to which the topics are provided first display a topic with low weight, such as deciding on names for each of the two users, on the voice call screen 30. Next, in response to the topic change, a topic with medium weight related to a hobby common to the two users is displayed on the voice call screen 31. Furthermore, in response to the topic change, a topic with high weight, such as the two users jointly considering how to spend 100,000 yen, is displayed. Alternatively, the display order (or display priority) of the topics may be provided together with the topics, and the terminal 100 may switch the topics to be displayed according to the display order.

[0071] The topics provided may be managed by theme. For example, topic themes may include hobbies, plans for a date (e.g., a first date), favorite food, favorite drink (e.g., alcohol), favorite restaurant, frequently visited places, how to spend holidays, attitudes toward marriage, and attitudes toward children. The topics provided may be derived from the above themes. For example, if the hobby of watching movies is the topic theme, the topic may be movie genres, favorite movies, memorable scenes, or the like. Note that the above-mentioned weights may be set for the topic themes.

[0072] <9. Processing flow> The processing flow of the system 1 will be described with reference to Figures 9 to 14. Figure 9 is a sequence diagram showing an example of the overall processing flow executed by the system 1. Figures 10 to 14 are sequence diagrams showing an example of the flow of each processing.

[0073] As shown in FIG. 9, in system 1 including terminals 100A and 100 and server 200, matching processing is performed for logged-in users (S301). An initial voice call processing is performed between two matched users (S303). After the initial voice call processing, confirmation of transition to the next relationship stage and schedule adjustment are performed (S305). If transition to the next relationship stage is to occur, a scheduled second voice call processing is performed (S307). After the second voice call processing, confirmation of transition to the next relationship stage and schedule adjustment are performed (S309). If transition to the next relationship stage is to occur, a scheduled video call processing is performed (S311). Confirmation of transition to the next relationship stage and schedule adjustment are performed (S313). If transition to the next relationship stage is to occur, message processing is performed (S315).

[0074] 10 is a sequence diagram showing an example of the flow of a user matching process. As shown in FIG. 10, the terminal 100 performs a system login process (S401). For example, when an application of the system 1 is launched, the terminals 100A and 100B transmit login information of the system 1 to the server 200.

[0075] When the system login process is performed, the server 200 acquires user data (S403). For example, when the control unit 220 receives login information from the terminal 100A, the control unit 220 updates the login status of the user associated with the terminal 100A stored in the storage unit 230 from logged off to logged in. The control unit 220 also extracts a group of users whose login status is logged in.

[0076] The server 200 performs user matching (S405). For example, the control unit 220 selects match candidates from the extracted user group by filtering based on the profile information of each of the users. The selected match candidates are transmitted to the terminals 100A and 100B.

[0077] The terminal 100 displays the match candidates (S407). For example, the terminals 100A and 100B display the received match candidates on a match screen.

[0078] After the predetermined time has elapsed, the voice call process starts (S409, S411). Details of the process will be described later with reference to FIG.

[0079] FIG. 11 is a sequence diagram showing an example of the processing flow for a first voice call. As shown in FIG. 11, terminal 100 starts the first voice call and displays topic 1 (S501). Server 200 provides voice call data and topic 1 (S503). For example, terminals 100A and 100B access server 200 using a URL for voice calls and start transmitting voice call data. Control unit 220 transmits voice call data received from one terminal 100 to the other terminal 100. Control unit 220 transmits topic 1 together with the voice call data. Terminals 100A and 100B output voice based on the voice call data and display topic 1.

[0080] When a predetermined time has elapsed since the start of the voice call, the terminal 100 confirms whether to continue the voice call during the voice call (S505). The server 200 determines whether to continue the voice call (S507). For example, the terminals 100A and 100B display a confirmation for continuing the voice call on the voice call screen during the voice call, and transmit a response to the confirmation for continuing the voice call to the server 200. The control unit 220 determines whether to continue transmitting voice call data based on the received response.

[0081] If the user desires to continue the voice call, the terminal 100 continues the voice call and displays topic 2 (S509). The server 200 provides the voice call data and topic 2 (S511). For example, if the answer to the question about whether to continue the voice call is "Yes," the transmission of the voice call data continues and the displayed topic is switched to topic 2. If the answer to the question about whether to continue the voice call is "No," the voice call ends.

[0082] After that, when a predetermined time has elapsed again, confirmation of continuation of the voice call is made during the voice call (S513), and a determination is made as to whether to continue the voice call (S515). If continuation of the voice call is desired, the voice call continues, topic 3 is displayed (S517), and the voice call data and topic 3 are provided (S519).

[0083] The terminal 100 checks whether to transition to a second voice call (i.e., the second stage) in response to the end of the first voice call due to the lapse of a predetermined call time (S521). The server 200 determines whether to transition to the second voice call (S523). For example, the terminals 100A and 100B end the voice call when a set call time has elapsed since the start of the voice call, and display a confirmation on the voice call screen as to whether to transition to the second voice call. Then, a response to the confirmation is transmitted to the server 200. The control unit 220 determines whether to transition to the second voice call based on the received response.

[0084] If the user desires to transition to the second voice call, the server 200 provides candidate dates and times for the second voice call (S525). The terminal 100 displays the candidate dates and times to allow the user to select one (S527). For example, if the answer to the question about transitioning to the second voice call is "yes," the candidate dates and times stored in the storage unit 230 are displayed on the terminals 100A and 100B. Then, the date and time of the second voice call is stored in the storage unit 230 based on the desired date and time selected by the user from the candidate dates and times.

[0085] Then, the user data is updated (S529). For example, if a transition to a second voice call is desired, the relationship status associated with the identification information of each of the two users is updated to the second stage. If not, the relationship status associated with the identification information of each of the two users is deleted, and a prohibition flag is set for the two users.

[0086] 12 is a sequence diagram showing an example of the flow of processing in the second voice call. Note that a description of processing similar to that in the first voice call shown in FIG.

[0087] As shown in FIG. 12, the terminal 100 starts the second voice call and displays topic 4 (S601). The server 200 provides the voice call data and topic 4 (S603). However, if the call recipient is not available, the terminal 100 stops the voice call and displays date and time candidates to allow the user to select one (S605). The server 200 provides date and time candidates (S607). For example, if one of the users scheduled to call has not logged in even after a predetermined time has elapsed since the start of the second voice call, the voice call ends. Then, date and time candidates are displayed, and the changed date and time for the second voice call is stored in the storage unit 230 based on the desired date and time selected by the user from the date and time candidates.

[0088] If the call partner is participating in a voice call, the processes of S505 to S519 shown in Fig. 11 are performed. Then, the terminal 100 checks whether to transition to a video call (i.e., the third stage) when the second voice call ends after a predetermined call time has elapsed (S609). The server 200 determines whether to transition to a video call (S611). If transition to a video call is desired, the server 200 provides date and time candidates for the video call (S613). The terminal 100 displays the date and time candidates and allows the user to select one (S615).

[0089] Then, the user data is updated (S617). For example, if a transition to a video call is desired, the relationship status associated with the identification information of each of the two users is updated to the third stage. If not, the relationship status associated with the identification information of each of the two users is deleted, and a prohibition flag is set for the two users.

[0090] 13 is a sequence diagram showing an example of the flow of processing in a video call. Note that a description of processing similar to that in a voice call shown in FIGS.

[0091] As shown in FIG. 13, the terminal 100 starts a video call with the camera off and displays topic 5 (S701). The server 200 provides the video call data and topic 5 (S703). For example, the terminals 100A and 100B access the server 200 using a URL for a video call and start transmitting the video call data with the camera off. The control unit 220 transmits the video call data received from one terminal 100 to the other terminal 100. The control unit 220 transmits topic 5 together with the video call data. The terminals 100A and 100B output only audio based on the video call data and display topic 5.

[0092] If the caller is not available, the terminal 100 stops the video call and displays date and time candidates to allow the user to select one (S705). The server 200 provides date and time candidates (S707). If the caller is participating in the video call, the terminal 100 switches the video call to a camera-on state with a countdown (S709). For example, when a predetermined time has elapsed since the start of the video call, the terminals 100A and 100B switch from a camera-off state to a camera-on state with a countdown.

[0093] The terminal 100 continues the video call with the camera on and displays topic 6 (S711). The server 200 provides the video call data and topic 6 (S713). For example, the transmission of the video call data continues with the camera on, and the topic is switched to topic 6 and displayed.

[0094] Then, the terminal 100 checks whether to transition to a real date (i.e., the fourth stage) when the video call ends after a predetermined call time has elapsed (S715). The server 200 determines whether to transition to a real date (S717). If a transition to a real date is desired, the server 200 provides date and time candidates for the real date (S719). The terminal 100 displays the date and time candidates and allows the user to select one (S721).

[0095] Then, the user data is updated (S723). For example, if a transition to real dating is desired, the relationship status associated with the identification information of each of the two users is updated to the fourth stage. If not, the relationship status associated with the identification information of each of the two users is deleted, and a prohibition flag is set for the two users.

[0096] FIG. 14 is a sequence diagram showing an example of the processing flow in a real date. As shown in FIG. 14, the terminal 100 accepts input of a message and accompanying data (S801). The server 200 stores the accepted data (S803). For example, the terminals 100A and 100B acquire messages and accompanying data such as images input on a message exchange screen and transmit them to the server 200. The control unit 220 transmits the message and accompanying data from one terminal 100 to the other terminal 100. The message and accompanying data are stored in the storage unit 230.

[0097] The server 200 analyzes the data stored in the storage unit 230 and provides assistance in the relationship (S805). The terminal 100 displays details related to the assistance from the server 200 (S807). For example, the control unit 220 analyzes various data stored in the storage unit 230 and estimates content that will contribute to the development of the relationship. Then, a suggestion message related to the estimated content is displayed on the terminals 100A and 100B.

[0098] If a real date is scheduled, the terminal 100 confirms whether the relationship will continue after the real date (S809). The server 200 determines the relationship status (S811) and updates the user data (S813). For example, when a predetermined time has passed since the date and time of the real date, the terminals 100A and 100B display a confirmation of the relationship to continue on the message exchange screen. Then, a response to the confirmation is sent to the server 200. The control unit 220 determines whether to maintain the relationship status based on the received response. If the relationship is desired to continue, the relationship status associated with the identification information of each of the two users is maintained. If not, the relationship status associated with the identification information of each of the two users is deleted, and a prohibition flag is set for the two users.

[0099] <10. Effects> According to the embodiment described above, the system 1 including two or more terminals 100 and a server 200 that communicates with the two or more terminals 100 includes a memory unit and a control unit, the memory unit stores information of two or more users associated with the two or more terminals 100, and the control unit matches two users from the two or more users based on the information of the two or more users, and at each stage of a relationship step including at least two or more stages, performs processing including: (a) displaying a call screen between the two users on each of the two terminals 100 associated with the two users; (b) displaying a confirmation of whether the user wishes to move to the next relationship step on each of the two terminals 100 in response to the end of the call between the two users; and (c) if a response indicating a desire to move to the next relationship step is entered on both of the two terminals 100, moving the relationship step of the two users to the next stage. In the first stage of the relationship step, the above processing is performed for voice-only calls. In this way, by displaying a confirmation of whether to move to the next stage of the relationship upon the end of the call and requesting the user's response, the decision on whether to continue the relationship is not postponed. Therefore, it is possible to prevent the occurrence of an ambiguous situation as to whether to continue the relationship. Furthermore, by providing a voice-only call in the first stage of the relationship, the user can make a decision based on the person's internal characteristics, which contributes to a variety of encounters.

[0100] Furthermore, the control unit of the system 1 performs the above-described process for calls including camera footage and audio at a predetermined stage after the first stage of the relationship step. This allows for the provision of a call including camera footage after an audio-only call, thereby mitigating the impact of a person's external characteristics (i.e., visual characteristics) on building relationships between users.

[0101] Furthermore, when a response indicating a desire to move to the next relationship step is input from both of the two terminals, the control unit of the system 1 associates the relationship step stages of the two users with the identification information of each of the two users and stores them in the storage unit. This allows the relationship step stages of the two users to be managed as relationship status, and the system 1 to provide assistance that matches the relationship status.

[0102] Furthermore, the confirmation of whether the user wishes to move on to the next relationship stage is displayed on the call screen after the call between the two users ends. This allows the user to be prompted for an answer regarding moving on to the next relationship stage without switching screens after the call ends. This allows the user to respond before their thoughts shift to something else, more reliably preventing them from postponing their response.

[0103] Furthermore, when a response indicating a desire to move to the next stage of the relationship is input at both of the two terminals 100, the control unit of the system 1 displays candidate dates and times for the next stage of the relationship on each of the two terminals 100, following a display confirming whether the user desires to move to the next stage of the relationship, and when the dates and times selected from the candidate dates and times on the two terminals 100 match, the storage unit of the system 1 stores the matching date and time as the date and time of the call at the next stage of the relationship in association with the identification information of each of the two users. This reduces the user's effort in arranging the schedule for the call at the next stage of the relationship.

[0104] Furthermore, the storage unit of the system 1 stores the available dates and times for the two users to talk, which are input beforehand before the two users make a call, and the control unit of the system 1 determines the candidate dates and times based on the available dates and times for the two users to talk. This allows users to adjust schedules without having to check their own schedules each time they adjust a schedule.

[0105] Furthermore, the control unit of the system 1 causes each of the two terminals 100 to notify a reminder of the call in the next stage of the relationship step a first time before the date and time of the call in the next stage of the relationship step. This can prevent the user from forgetting to make the call in the next stage of the relationship step.

[0106] Furthermore, the control unit of the system 1 enables an operation to start a call in the next stage of the relationship step at a second time before the date and time of the call in the next stage of the relationship step, on each of the two terminals 100. This prevents the user from accidentally starting a call before the scheduled date and time.

[0107] Furthermore, the control unit of the system 1 starts the call at the next stage of the relationship step in response to an operation for starting the call at the next stage of the relationship step, and ends the call at the next stage of the relationship step if at least one of the two users has not participated in the call until a predetermined time has elapsed from the date and time of the call at the next stage of the relationship step, thereby reducing the waste of time of the users participating in the call.

[0108] Furthermore, at a predetermined stage of the relationship step, the control unit of the system 1 performs processing for exchanging messages or arranging dates to meet in person. This allows the user to confirm the inner characteristics of the person they are talking to through audio and video calls, and then move on to the relationship step of engaging in more intimate communication. This contributes to the user building a stronger, lasting relationship.

[0109] The information about the two or more users includes at least the age and address of the users, which allows matching between users of the same generation or in the same neighborhood, thereby increasing the success rate of relationships.

[0110] The control unit of the system 1 also controls calls between two users based on the type and duration of calls that are predetermined for each stage of the relationship. This allows the call to be completed within a time that is appropriate for the relationship at each stage of the relationship. Furthermore, the user can be made aware that there is a time limit on the call, allowing the user to concentrate on the call.

[0111] Furthermore, if a response indicating that the user does not wish to move to the next relationship step is input in at least one of the two terminals 100, or if a response to the confirmation as to whether the user wishes to move to the next relationship step is not input in at least one of the two terminals 100 within a predetermined time from the display of the confirmation as to whether the user wishes to move to the next relationship step, the control unit of the system 1 stores information indicating that the two users are prohibited from matching in the storage unit in association with the identification information of each of the two users. This allows users to exclude partners with whom the user does not wish to continue the relationship from matching candidates in the next and subsequent matching processes, allowing the users to concentrate on new encounters.

[0112] Furthermore, when storing information indicating prohibition of matching between two users, if the relationship step stages of the two users associated with the identification information of each of the two users are stored in the storage unit, the control unit of the system 1 deletes the relationship step stages of the two associated users from the storage unit. This frees up memory space used for the relationship status of two users whose relationship has ended and who will never be matched again, thereby improving memory utilization efficiency.

[0113] Furthermore, the control unit of the system 1 displays the topic of conversation on the call screen during a call between two users, thereby enabling smooth conversation even for users who are not good at talking.

[0114] Furthermore, the control unit of the system 1 generates input information based on at least one of the profile information of the two users or information about the call between the two users, inputs the input information to an artificial intelligence model that generates topics, and displays the topics output by the artificial intelligence model on the call screen. This makes it possible to display topics that are easy for the user to talk about. It is also possible to display topics that are common to the two users or that interest the two users. Furthermore, by using an artificial intelligence model that can learn user information, it is possible to increase the appropriateness of the topics displayed on the call screen for the user.

[0115] The control unit of the system 1 also detects silences in a conversation between two users based on the conversation information, and displays the topic of conversation when silences are detected, thereby avoiding awkward conversations caused by interruptions.

[0116] In addition, topics are weighted, and topics with a higher weight than the currently displayed topic are displayed next. This allows you to gradually build a relationship with the person you are talking to during the call.

[0117] Furthermore, topics that two users have in common or that they jointly consider are weighted higher than topics related to each of the two users individually. This allows relatively easy topics about the user to talk about when they are still not familiar with the other person, and topics that will deepen the relationship once they have become somewhat familiar. This makes it easier to build relationships and deepen the relationships that have already been built.

[0118] In addition to the initial stage and the predetermined stages, the dating step also includes at least one stage of voice-only calls and at least one stage of calls including camera footage and voice. This allows the user to experience at least two voice calls and one video call, allowing them to more deeply understand the inner characteristics of the person they are talking to before going on a real date.

[0119] Furthermore, the relationship stages between two users are irreversible, which allows users to understand the progress of their relationship based on the relationship stage (i.e., relationship status).

[0120] Furthermore, in a call between two users, the control unit of the system 1 displays a confirmation on the call screen as to whether to continue the call after a predetermined time has elapsed since the start of the call but before the elapse of a call time predetermined for each relationship step. If a response indicating a desire to continue the call is input on both of the two terminals 100, the control unit continues the call between the two users. If a response indicating a desire to continue the call is not input on at least one of the two terminals 100, the control unit ends the call between the two users. This allows the user to consider compatibility with the other party during the call and facilitates confirmation of whether to continue the relationship after the call ends. It also prevents a call from being continued with a party with whom there is no prospect of continuing the relationship.

[0121] Furthermore, the control unit of the system 1 displays a prompt to confirm whether to continue the call if the call between two users is an audio-only call, but does not display a prompt to confirm whether to continue the call if the call between two users includes camera footage and audio. This prevents the call from being unilaterally ended midway through a video call after the users meet face-to-face.

[0122] Furthermore, the control unit of the system 1 displays the topic on the call screen during a call between two users, and changes the topic when a response indicating a desire to continue the call is entered on both terminals. This allows assistance with the continued call with an additional topic. Furthermore, by presenting a different topic, it becomes easier to resume a call that has been interrupted by confirmation of the continuation of the call.

[0123] Furthermore, when a response indicating that the user does not wish to continue the call is input in at least one of the two terminals 100, or when a response to the confirmation as to whether the user wishes to continue the call is not input in at least one of the two terminals 100 within a predetermined time from the display of the confirmation as to whether the user wishes to continue the call, the control unit of the system 1 stores information indicating that the two users are prohibited from being matched in the storage unit in association with the identification information of each of the two users. As a result, the user who does not wish to continue the call is excluded from the matching candidates in the next and subsequent matching processes, allowing the user to concentrate on finding new encounters.

[0124] Furthermore, when a call between two users includes both camera video and audio, the control unit of system 1 turns off the camera video before a predetermined time has elapsed since the start of the call, and turns on the camera video after the predetermined time has elapsed since the start of the call. This allows a video call with only audio, the same as the previous audio call, to be conducted as a preparation before the start of a camera-on video call, thereby easing the users' nervousness about meeting face-to-face. This allows for a smooth camera-on call.

[0125] <11. Variations> The above-described embodiment may be modified as follows.

[0126] (1) In the matching process of the above embodiment, a call partner is automatically selected from the selected match candidates, and the first voice call is initiated. However, the call partner may be selected by the user from the match candidates. Furthermore, the first voice call with the call partner may be initiated in response to a user operation.

[0127] (2) In the matching process of the above embodiment, the first voice call is automatically initiated after the matching is completed. However, the schedule for the first voice call may be adjusted after the matching is completed. Alternatively, the matching process may be performed in advance, and candidate matches may be presented to the user. The frequency of the advance matching process may be one person per day.

[0128] (3) In the matching process of the above embodiment, the matching process is automatically started when the application is launched. However, a matching request may be sent from the terminal 100 to the server 200 in response to a user operation after the application is launched, and the matching process may be started in response to the reception of the matching request.

[0129] (4) In the matching process of the above embodiment, other users who are logged in at the time the user logs in are the target of matching. However, when a user participates in a matching that takes place at a specific time, other users who participate in the matching may also be the target of matching. For example, a confirmation message asking whether the user wants to participate in a matching that starts at 9:00 PM is displayed on the terminal 100 10 minutes before the matching. If the user responds that they will participate, a call partner is randomly selected from the other users who responded that they will participate in the matching. Then, at 9:00 PM, a voice call is automatically initiated.

[0130] (5) In the above embodiment, if at least one of the two users does not respond that they wish to continue the relationship, a prohibition flag is set for the two users. However, if neither responds that they wish to continue the relationship, the prohibition flag does not have to be set.

[0131] (6) In the above embodiment, a confirmation of transition to the next relationship stage is displayed upon the end of the call. Here, the above may also include a case where a confirmation of transition to the next relationship stage is displayed on a different screen that automatically switches from the call screen upon the end of the call. Furthermore, the above may also include a case where, upon the end of the call, the display temporarily switches to a different screen, then returns to the call screen, and a confirmation of transition to the next relationship stage is displayed.

[0132] (7) In the schedule adjustment of the above embodiment, a candidate date and time is determined based on a date and time when the two users are available to talk and that is input in advance. However, when a response indicating a desire to move to the next relationship stage is input on both terminals 100, the control unit of system 1 may display an input screen for candidate dates and times on each of the two terminals 100 and determine candidate dates and times based on the input on the input screen. This allows the schedule adjustment to be based on the latest schedule at the time the call ends.

[0133] (8) In the above embodiment, if the call recipient is unavailable, the call is terminated. However, an AI agent (i.e., the user's digital twin) equipped with an artificial intelligence (i.e., AI) model of the unavailable user may take over the call. The AI ​​model may be generated using an expert system or machine learning such as deep learning. The AI ​​model generated using machine learning may be a generative AI model (e.g., LLM). Specifically, when at least one of two matched users is unavailable for a call, the control unit of the system 1 causes an artificial intelligence model (i.e., AI agent) generated using machine learning based on information about the unavailable user to make the call, and displays the call record of the AI ​​agent on the terminal 100 of the user who was unable to make the call. This allows the two users to indirectly learn each other's characteristics even if they are unable to make a direct call. Furthermore, a confirmation message is displayed on the terminal 100 of the unavailable user to confirm whether to make the call. If a response indicating a desire to make the call is entered, a schedule is arranged. If a response indicating a desire to make the call is not entered, a prohibition flag is set.

[0134] For example, when user U1, of users U1 and U2 who are making a call, is absent, the control unit 220 of the server 200 causes user U1's AI agent to make a call with user U2. The call data with this AI agent is stored in the storage unit 230. When user U1 subsequently logs in, the stored call data with the AI ​​agent is sent to user U1's terminal 100, and the contents of the call data are output. For example, the audio of the call data may be output, or text converted from the audio of the call data (e.g., the full text or a summary of the conversation) may be displayed. Furthermore, a message is displayed on user U1's terminal 100 asking whether user U1 wishes to make a call with user U2. If user U1 replies that he or she wishes to make a call, a schedule is arranged for the call with user U2. Otherwise, a prohibition flag is set for user U1 and user U2.

[0135] Furthermore, the control unit 220 of the server 200 may have the AI ​​agent of user U1 and the AI ​​agent of user U2 make a call before the call between user U1 and user U2. The call data between these AI agents is stored in the storage unit 230. The stored call data between the AI ​​agents is then output to the terminals 100 of user U1 and user U2. Furthermore, a message is displayed on the terminals 100 of user U1 and user U2 asking whether the user wishes to make a call with the other party. If both user U1 and user U2 respond that they wish to make a call, a schedule for the call is arranged. If not, a prohibition flag is set for user U1 and user U2.

[0136] The user's AI agent may be generated by machine learning using various data about the user (e.g., user data D1 and call data D2) stored in the storage unit 230. In this way, the AI ​​agent learns the user's likes and dislikes, preferences, speaking style, etc., and the more it learns, the more similar it becomes to the user.

[0137] In the above description, an AI agent takes over the call when the call recipient is unavailable. However, the call made by the AI ​​agent may be used to determine the call recipient from the match candidates in the matching process. For example, when a match candidate is selected, a call with the AI ​​agent of the match candidate is initiated. When the call ends, the call data is presented to the match candidate, and a match is confirmed. If the match candidate replies that they wish to be matched, the match candidate is determined as the call recipient.

[0138] (9) The AI ​​agent described in (8) above may be used for user conversation training. For example, for user U1, a call with user U2's AI agent may be set up before a scheduled call with user U2. In response to user U1's operation of terminal 100, server 200 provides terminal 100 with an opportunity to call user U2's AI agent.

[0139] (10) The assistance for dating in the above embodiment may be provided at any stage of the dating steps, not limited to the stage at which message exchange is set up. Furthermore, the assistance may include love advice. For example, the assistance may be provided at the stage at which a voice call is set up (e.g., the first or second stage) or the stage at which a video call is set up (e.g., the third stage). Furthermore, the assistance may be love advice provided by an AI model. When the user inputs the content of the love advice into the terminal 100 using voice input or text input (e.g., chat format or non-chat format), the server 200 responds to the content of the love advice using an AI model. Note that the love advice may be provided through a conversation by an AI agent that mimics a love expert. Furthermore, the AI ​​model may be updated by machine learning using advice information from the love expert. The AI ​​model may also be an LLM.

[0140] (11) In the above embodiment, the system 1 may monitor calls after the fact or in real time. Specifically, the control unit 220 of the server 200 may perform an inappropriate remark detection process on the call data stored in the storage unit 230 and freeze or ban the account of a user who made the detected inappropriate remark. For example, the control unit 220 converts the call data into text data and inputs the text data to an AI model along with predetermined rules. The AI ​​model outputs the inappropriate remark detection result. The rules may be a description defining the inappropriate remark. The inappropriate remark detection result may indicate the location of the inappropriate remark or the user who made the inappropriate remark. The AI ​​model may be, for example, an LLM. Alternatively, the control unit 220 may perform an inappropriate remark detection process on call data received from the terminal 100 during a call. In this case, the control unit 220 may forcibly terminate a call in which an inappropriate remark is detected. The inappropriate remark detection process may be performed by the terminal 100 instead of the control unit 220 of the server 200. In this case, the terminal 100 transmits information indicating the user who made the detected inappropriate comment to the server 200, and the server 200 freezes or prohibits the account.

[0141] (12) In the above embodiment, terminal 100 confirms the transition to the next relationship step. However, server 200 may send an instruction to terminal 100 to confirm the transition to the next relationship step, and terminal 100 may display the confirmation of the transition to the next relationship step based on the instruction. Alternatively, drawing instructions for each of the above-mentioned screens may be sent from server 200 to terminal 100, and terminal 100 may display the screen based on the drawing instructions. The drawing instructions may include information indicating the content of the screen.

[0142] (13) In the above embodiment, the operation of the terminal 100 is realized by an application of the system 1 installed on the terminal 100. However, the operation of the terminal 100 may also be realized by a browser installed on the terminal 100. In this case, some or all of the processing of the terminal 100 in the above embodiment may be performed by the server 200 via the browser. Also, some or all of the information stored in the terminal 100 in the above embodiment may be stored in the server 200. For example, information on a user's avatar may be associated with the user's ID and stored in the storage unit 230 of the server 200.

[0143] (14) In the above embodiment, the relationship step transitions to the real date stage (i.e., the fourth stage) after two voice call stages (i.e., the first and second stages) and a video call stage (i.e., the third stage). However, the condition for transitioning to the real date stage may be the completion of at least one (e.g., three) voice call stage and at least one (e.g., three) video call stage. The same relationship step may also be repeated. Specifically, a specific relationship step may be repeated based on the user's request. For example, in a confirmation of transition to the next relationship step displayed upon the end of a video call, a confirmation of whether the user wishes to have another video call may be displayed. If the user replies that they wish to have another video call, the next relationship step is set to the second video call stage. Furthermore, a specific relationship step may be repeated based on the profile information of the two users who are calling. For example, if the addresses of the two users are apart by a predetermined distance or more, a second video call stage may be additionally set. Furthermore, a charge may be made for the repetition of a particular relationship step. For example, if a user responds that they would like to have another video call, a charge may be made to the responding user.

[0144] (15) In the matching process of the above embodiment, an appeal for a match may be made to a displayed match candidate. For example, when the profile information of a match candidate is displayed, a confirmation of whether to send a gift to the match candidate is displayed. If the user responds that they will send a gift, the gift is provided to the match candidate. Note that a fee may be charged for providing the gift. The gift may be, for example, an image of a bouquet of flowers.

[0145] (16) In the above embodiment, a report may be sent to the administrator of the system 1. For example, the terminal 100 displays a report button on the call screen, and when the report button is pressed, the terminal 100 ends the call and transmits report information to the server 200. The control unit 220 of the server 200 stores the report information in the storage unit 230 and transmits the report information to the administrator terminal of the system 1 via the communication unit 210. When the report button is pressed, a confirmation message is displayed asking whether it is okay to send a report.

[0146] (17) In the above embodiment, if a call between two users ends midway, information regarding the end of the call during the call may be stored, and the two users may be matched based on the information regarding the end of the call during the call. This allows two users with similar characteristics or preferences regarding calls to be matched. Specifically, the information regarding the end of the call during the call may be whether or not the call ended during the call, the number of times the call ended during the call, or the length of time from the start to the end of the call. For example, two users who have ended a call during the call, or two users who have never ended a call during the call, may be matched. Two users who have ended a call during the call approximately the same number of times may be matched. Alternatively, a user who has ended a call during the call may be matched with a user who has never ended a call during the call. Furthermore, a user's account may be frozen or banned based on the information regarding the end of the call during the call. Note that the end of the call during the call may be due to a user's operation, or may be due to a response to a confirmation to continue the call.

[0147] (18) In the voice call of the above embodiment, both confirmation of transition to the next relationship step and confirmation of continuation of the current call are performed. However, only one of confirmation of transition to the next relationship step and confirmation of continuation of the current call may be performed. Also, confirmation of continuation of the current call may be performed in the video call.

[0148] (19) In the above embodiment, the topics displayed during a call are the same on each of the terminals 100 of the two users. However, an additional topic may be displayed on only one of the terminals 100 of the two users. For example, the terminal 100 of one of the two users (e.g., a male user) may display a topic that the other user (e.g., a female user) may be interested in.

[0149] (20) In the above embodiment, the user's profile information may be generated by an AI model. The AI ​​model may be updated by machine learning using data stored in the storage unit 230. For example, the control unit 220 generates input information based on at least a portion of text data or message data D3 based on the call data D2 stored in the storage unit 230. The input information includes instructions for the AI ​​model. The control unit 220 inputs the input information to the AI ​​model. The AI ​​model outputs profile information including the user's personality, hobbies, values, and the like. For example, the AI ​​model may be an LLM. Furthermore, as described above, the instructions for the AI ​​model may include instructions for controlling the information output by the AI ​​model. For example, based on the frequency of a specific word in a conversation between two users, an item or service related to the specific word may be included in the profile information as the user's preference. In this way, since the profile information is generated based on the actual conversation between two users, the profile information can be more detailed. Furthermore, characteristics that the user is not aware of can be extracted as profile information. The profile information generated by the AI ​​model may be managed separately from the profile information entered by the user, or may be integrated with the profile information.

[0150] (21) In the above embodiment, the user matching process may be performed by an AI model. The AI ​​model may be updated by machine learning using data stored in the storage unit 230, etc. For example, the matching processing unit 221 generates input information based on user profile information stored in the storage unit 230. The input information includes instructions to the AI ​​model. The matching processing unit 221 inputs the input information to the AI ​​model. The AI ​​model outputs at least one pair of users who are matching candidates. As described above, the instructions to the AI ​​model may include instructions for controlling the information to be output by the AI ​​model. For example, the instructions to the AI ​​model may be a prompt instructing the AI ​​model to output two users who have good compatibility as a pair. The input information may be generated based on the profile information output by the AI ​​model in (20) above.

[0151] (22) In the above embodiment, sentiment analysis may be performed based on call data. Specifically, changes in a speaker's sentiment (e.g., the presence or absence of interest, concern, or empathy) may be analyzed based on the voice volume, the amount of change in voice volume, the voice pitch (i.e., pitch), the amount of change in pitch, the voice speed, or the amount of change in speed in the call data. For example, the control unit 220 may infer that words (e.g., topics) corresponding to sections in the call data where the voice volume is relatively loud, sections where the voice volume has changed, sections where the pitch is relatively high, sections where the pitch has changed, sections where the speed is relatively high, or sections where the speed has changed are words of interest to the user. Furthermore, for example, the control unit 220 may infer that words corresponding to sections of voice patterns that appear relatively frequently in the call data are words of interest to the user. The call data used for sentiment analysis may be data of calls between two matched users or data of calls between an AI agent and a user. For example, sentiment analysis may be performed based on data of calls between the AI ​​agent and a user in (8) to (10) above. Alternatively, the call data may be acquired by having the user talk to the AI ​​agent for a predetermined period of time (for example, three minutes).

[0152] The results of the sentiment analysis based on the call data described above may be used in various processes. Specifically, the results of the sentiment analysis may be used to generate user profile information. For example, the results of the sentiment analysis may be included in the input information to the AI ​​model that generates the profile information in (20) above. Furthermore, the generated profile information may be managed and stored separately from the profile information input by the user.

[0153] The result of the sentiment analysis may also be used in the matching process. For example, the result of the sentiment analysis may be included in the input information to the AI ​​model that performs the matching process in (21) above. The AI ​​model may output two users with similar sentiment analysis results (e.g., users with similar sensitivity to a particular topic) as a pair of users that are candidates for matching. Alternatively, the result of the sentiment analysis may be used in filtering in the matching process.

[0154] The results of the sentiment analysis may also be used in a topic provision process. For example, the results of the sentiment analysis may be included in input information to an AI model that performs the topic provision process. The AI ​​model may output topics common to two users (e.g., topics with similar sensitivity) based on similar sentiment analysis results (e.g., sensitivity to a topic) between the two users.

[0155] The result of the sentiment analysis may also be used to display the status of the call. Specifically, the result of the sentiment analysis itself may be displayed as the status of the call. Alternatively, a status of the call (e.g., highlights or highlights of the call) generated based on the result of the sentiment analysis may be displayed. For example, the status of the call using the result of the sentiment analysis may be displayed in real time during the call or after the call ends.

[0156] (23) In the above embodiment, a summary of the call may be provided to the user based on the call data. Specifically, the control unit 220 generates a summary (i.e., a summary) of the call for each matched user (i.e., the call partner) based on the call data for each user. The generated summary of the call data is provided to each user. For example, the control unit 220 may generate a summary of the call content for user U1 based on the call data between user U1 and matched user U2. The generated summary of the call content may be transmitted to the terminal 100 of user U1 and displayed.

[0157] (24) In the above embodiment, an AI agent (i.e., a digital twin) that mimics the user may be used in the matching process. Specifically, the control unit 220 causes the AI ​​agent of a specific user to communicate (i.e., converse) with the AI ​​agents of multiple other users, and selects one other user from the multiple other users based on the results of the conversation. Note that the AI ​​agent of a specific user may communicate with the AI ​​agents of multiple other users in parallel. For example, multiple instances may be generated for the AI ​​agent of a specific user, and each of the multiple instances may communicate with each of the multiple other users.

[0158] The matching process using the AI ​​agent may be performed based on static evaluation and dynamic evaluation of two users. The static evaluation may be based on non-interactive information about the two users (e.g., pre-stored user information). The dynamic evaluation may be based on interactive information about the two users (e.g., results of a call simulation between two users obtained by a call between the AI ​​agents). Furthermore, the matching process using the AI ​​agent may be performed in stages according to each phase. Specific examples of processing in each phase are described below.

[0159] In Phase 1, initial selection is performed based on static evaluation and trial dynamic evaluation. For example, the number of match candidates may be narrowed down from 100 to 30. In Phase 1, first, as static evaluation, selection is performed based on the user's psychological characteristics. For example, the user's MBTI (Myers-Briggs Type Indicator) or values ​​may be compared between a specific user and each of multiple other users who are match candidates, and a score may be calculated based on the comparison result. Based on the score, some users may be selected from the multiple other users. Note that the AI ​​agent may obtain the user's psychological characteristics through machine learning. Furthermore, the psychological characteristics may be stored in the storage unit 230 in advance, or may be obtained by administering a test to the AI ​​agent to determine the psychological characteristics.

[0160] Secondly, in Phase 1, static evaluation involves selection based on user behavioral characteristics. For example, the number of items such as the user's hobbies, how they spend their holidays, or food preferences stored in the storage unit 230 that are common between a specific user and each of multiple other users who are matching candidates may be calculated. Based on the number of items common between the specific user and each of the multiple other users, some users may be selected from the multiple other users.

[0161] Third, in Phase 1, static evaluation is performed by filtering based on basic conditions. For example, the basic conditions may be the user's residential area, age, or language used, which are stored in the storage unit 230.

[0162] Fourth, in Phase 1, as a trial dynamic evaluation, selection is performed based on trial calls between AI agents. The indicator for selection based on trial calls may be the naturalness of the calls. For example, an AI agent of a specific user may be made to have trial calls with each of the AI ​​agents of multiple other users. Data from the trial calls may be analyzed, and a score may be calculated based on the manner of the response of the AI ​​agent at the other end of the trial call (e.g., the frequency of the response, the depth of the response, or the degree of interest expressed in the response). Based on the score, some users may be selected from the multiple other users. The score criteria used to select the users may be more lenient than the score criteria in subsequent phases. Furthermore, the length or content of the calls between the AI ​​agents may be the same as or different from those in subsequent phases. Note that the first to fourth processes in Phase 1 may be performed in any order.

[0163] In Phase 2, selection is performed based on local dynamic evaluation and static evaluation. For example, the number of matching candidates may be narrowed down from 30 to 10. In Phase 2, first, as dynamic evaluation, selection is performed based on calls between AI agents. For example, an AI agent of a specific user may be made to call each of the AI ​​agents of multiple other users. Data from the calls may be analyzed to calculate a score based on the positivity of the AI ​​agent of the other party toward the call, whether or not there is a balance between questions and responses in the call, or the degree of empathy in the call. Based on the score, some users may be selected from the multiple other users. The positivity and empathy may be analyzed using the analysis method described above in (22). Furthermore, the analysis of whether or not there is a balance between questions and responses may be performed based on the balance between the length of the section corresponding to the question and the length of the section corresponding to the response in the call data, or the balance between the number of occurrences of the section corresponding to the question and the section corresponding to the response in the call data.

[0164] Secondly, in Phase 2, as a static evaluation, selection is performed based on the activity of each of the multiple other users who are matching candidates in the system 1. For example, for each of the multiple other users, activity in the system 1 (e.g., login or profile information update) is captured, and activity data (e.g., login frequency or profile information update history) is stored in the storage unit 230. A score may be calculated based on the activity data. Based on the score, some users may be selected from the multiple other users.

[0165] Third, in Phase 2, as a local dynamic evaluation, a selection is performed based on a virtual date simulation. For example, a date between a specific user's AI agent and each of multiple other users' AI agents may be simulated in a virtual space. Data from the simulation may be analyzed, and a score may be calculated based on the compatibility with the AI ​​agent of the date partner or the naturalness of the conversation during the date. Based on the score, a portion of the users may be selected from the multiple other users. Note that the above first to third processes in Phase 2 may be performed in any order.

[0166] In Phase 3, selection is performed based on global dynamic evaluation and static evaluation. For example, the number of matching candidates may be narrowed down from 10 to 3. In Phase 3, first, as global dynamic evaluation, selection is performed based on conversations between AI agents about long-term themes. For example, the AI ​​agent of a specific user may be made to talk with each of the AI ​​agents of multiple other users about the theme of their vision for the future. The vision for the future may include views on marriage, career, or lifestyle. Data from the conversations may be analyzed to calculate a score. Based on the score, some users may be selected from the multiple other users.

[0167] Second, in Phase 3, as a static evaluation, a selection based on a stress test is performed on each of the multiple other users who are match candidates. For example, a test is performed on the AI ​​agent of each of the multiple other users regarding a complex situation or argument. A score may be calculated based on each of the multiple other users' problem-solving ability or tendency to deal with people with opposing opinions, which is estimated from the test results. Based on the score, some users may be selected from the multiple other users. Note that the above first and second processes of Phase 3 may be performed in any order.

[0168] In Phase 4, a final selection is made based on a comprehensive evaluation. For example, the number of match candidates may be narrowed down from three to one. In Phase 4, first, selection is made based on an integrated score across all phases. Specifically, the scores calculated in each phase may be integrated according to a predetermined weight. For example, the predetermined weight may be 40% for the score of the first process in Phase 1, 30% for the scores of the fourth process in Phase 1, the first process in Phase 2, and the third process in Phase 2, 20% for the score of the first process in Phase 3, and 10% for the scores of the second process in Phase 2 and the second process in Phase 4. Based on the integrated score, a portion of users (e.g., one user) may be selected from the multiple other users. Second, in Phase 4, selection is made based on a risk aversion analysis. Specifically, the selected user may be checked from the perspective of safety or risk. For example, it may be checked whether the information of the selected user is false or whether the selected user is likely to behave dishonestly.

[0169] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0170] 1 System 100 devices 110 Input / output section 120 control section 130 Storage section 140 Communications Department 200 servers 210 Communications Department 220 Control Unit 230 Storage section

Claims

1. A server including a communication unit and a control unit, the communication unit communicates with two or more terminals, The control unit matching two users from among the two or more users based on information of the two or more users associated with the two or more terminals, respectively, stored in a storage unit; At each stage of the relationship, which includes at least two stages, (a) transmitting information about the call between the two users to two terminals associated with the two users via the communication unit and displaying a call screen; (b) receiving, from each of the two terminals via the communication unit, a response to a confirmation as to whether the two users wish to move to the next stage of the relationship step in response to the end of the call between the two users; (c) when responses indicating a desire to move to the next stage of the relationship step are received from both of the two terminals, moving the relationship step of the two users to the next stage; Perform processing including In the first stage of the association step, the processing is performed for a voice-only call; Based on the information of the call between the two users, analyze at least one of the interests, concerns, or sympathies of the two users, or the excitement or highlights of the call between the two users; After the call between the two users is completed, the analysis results are displayed on each of the two terminals. server.

2. A server comprising a communication unit and a control unit, the communication unit communicates with two or more terminals, The control unit matching two users from among the two or more users based on information of the two or more users associated with the two or more terminals, respectively, stored in a storage unit; At each stage of the relationship, which includes at least two stages, (a) transmitting information about the call between the two users to two terminals associated with the two users via the communication unit and displaying a call screen; (b) receiving, from each of the two terminals via the communication unit, a response to a confirmation as to whether the two users wish to move to the next stage of the relationship step in response to the end of the call between the two users; (c) when responses indicating a desire to move to the next stage of the relationship step are received from both of the two terminals, moving the relationship step of the two users to the next stage; Perform processing including In the first stage of the association step, the processing is performed for a voice-only call; Based on the information of the call between the two users, a summary of the call is generated and displayed on each of the two terminals. server.

3. A server comprising a communication unit and a control unit, the communication unit communicates with two or more terminals, The control unit matching two users from among the two or more users based on information of the two or more users associated with the two or more terminals, respectively, stored in a storage unit; At each stage of the relationship, which includes at least two stages, (a) transmitting information about the call between the two users to two terminals associated with the two users via the communication unit and displaying a call screen; (b) receiving, from each of the two terminals via the communication unit, a response to a confirmation as to whether the two users wish to move to the next stage of the relationship step in response to the end of the call between the two users; (c) when responses indicating a desire to move to the next stage of the relationship step are received from both of the two terminals, moving the relationship step of the two users to the next stage; Perform processing including In the first stage of the association step, the processing is performed for a voice-only call; During a call between the two users, a topic is displayed on the call screen via the communication unit; The topics are weighted; A topic with a weight greater than the weight of the currently displayed topic is displayed next. server.

4. A server comprising a communication unit and a control unit, the communication unit communicates with two or more terminals, The control unit matching two users from among the two or more users based on information of the two or more users associated with the two or more terminals, respectively, stored in a storage unit; At each stage of the relationship, which includes at least two stages, (a) transmitting information about the call between the two users to two terminals associated with the two users via the communication unit and displaying a call screen; (b) receiving, from each of the two terminals via the communication unit, a response to a confirmation as to whether the two users wish to move to the next stage of the relationship step in response to the end of the call between the two users; (c) when responses indicating a desire to move to the next stage of the relationship step are received from both of the two terminals, moving the relationship step of the two users to the next stage; Perform processing including In the first stage of the association step, the processing is performed for a voice-only call; In a call between the two users, after a predetermined time has elapsed since the start of the call and before a call time predetermined for each of the communication steps has elapsed, a prompt to confirm whether to continue the call is displayed on the call screen via the communication unit; If responses wishing to continue the call are received from both of the two terminals, the call between the two users is continued; If a response indicating a desire to continue the call is not received from at least one of the two terminals, the call between the two users is terminated. server.

5. A server comprising a communication unit and a control unit, the communication unit communicates with two or more terminals, The control unit matching two users from among the two or more users based on information of the two or more users associated with the two or more terminals, respectively, stored in a storage unit; At each stage of the relationship, which includes at least two stages, (a) transmitting information about the call between the two users to two terminals associated with the two users via the communication unit and displaying a call screen; (b) receiving, from each of the two terminals via the communication unit, a response to a confirmation as to whether the two users wish to move to the next stage of the relationship step in response to the end of the call between the two users; (c) when responses indicating a desire to move to the next stage of the relationship step are received from both of the two terminals, moving the relationship step of the two users to the next stage; Perform processing including In the first stage of the association step, the processing is performed for a voice-only call; If the call between the two users includes camera images and audio, the camera images are turned off before a predetermined time has elapsed since the start of the call, and the camera images are turned on after the predetermined time has elapsed since the start of the call. server.

6. The control unit Matching the two users based on at least one of a static evaluation of the two users and a dynamic evaluation of the two users as a result of an analysis based on information about the calls of the two users; Displaying profile information of a user selected in the matching of the two users on each of the two terminals The server according to any one of claims 1 to 5.

7. The control unit inputs the results of analysis based on the call information of the two users into an AI (Artificial Intelligence) model, thereby matching the two users. The server according to any one of claims 1 to 5.

8. The control unit Based on the information about the call between the two users, analyze at least one of the interests, concerns, or empathy between the two users, or the excitement or highlights of the call between the two users; The results of the analysis are used to match the two users. The server according to any one of claims 1 to 5.

9. The control unit updates the user profile information by inputting the analysis result based on the information of the call between the two users into an AI (Artificial Intelligence) model. The server according to any one of claims 1 to 5.

10. The control unit performs the processing on a call including a camera image and a voice at a predetermined stage after the first stage of the association step. The server according to any one of claims 1 to 5.

11. When responses indicating a desire to move to the next stage of the relationship step are received from both of the two terminals, the control unit associates the stages of the relationship step of the two users with identification information of each of the two users and stores them in the storage unit. The server according to any one of claims 1 to 5.

12. The confirmation of whether the user wishes to move to the next stage of the relationship is displayed on the call screen after the call between the two users ends. The server according to any one of claims 1 to 5.

13. The control unit When responses indicating a desire to move to the next stage of the relationship step are received from both of the two terminals, a confirmation of whether the user desires to move to the next stage of the relationship step is displayed, followed by displaying date and time candidates for the next stage of the relationship step on each of the two terminals via the communication unit; If the dates and times selected from the date and time candidates received from the two terminals match, the matching date and time is stored in the storage unit as a date and time of the call in the next stage of the relationship step in association with the identification information of each of the two users. The server according to any one of claims 1 to 5.

14. the control unit notifies each of the two terminals of a reminder of the call in the next stage of the relationship step a first time before the date and time of the call in the next stage of the relationship step; The server of claim 13.

15. The control unit, at a predetermined stage of the association step, performs processing for message exchange or arranging a date to meet in person. The server according to any one of claims 1 to 5.

16. The control unit controls the call between the two users based on a type of call and a call duration that are predetermined for each stage of the relationship step. The server according to any one of claims 1 to 5.

17. The control unit When a response indicating that the user does not wish to proceed to the next stage of the relationship is received from at least one of the two terminals, or when a response to the confirmation as to whether the user wishes to proceed to the next stage of the relationship is not received from at least one of the two terminals within a predetermined time from the display of the confirmation as to whether the user wishes to proceed to the next stage of the relationship, information indicating that matching between the two users is prohibited is stored in the storage unit in association with the identification information of each of the two users. The server according to any one of claims 1 to 5.

18. When the control unit stores information indicating prohibition of matching of the two users, if the stages of the relationship steps of the two users associated with the identification information of each of the two users are stored in the storage unit, the control unit deletes the stages of the relationship steps of the associated two users from the storage unit.

18. The server of claim 17.

19. the control unit generates input information based on at least one of profile information of the two users or information about a call between the two users, inputs the input information to an artificial intelligence model that generates the topic, and displays the topic output by the artificial intelligence model on the call screen. The server of claim 3.

20. the control unit detects silence in the call between the two users based on the call information; the topic is displayed in response to silence being detected. The server of claim 3.

21. The control unit During a call between the two users, a topic is displayed on the call screen via the communication unit; changing the topic if responses wishing to continue the call are received from both of the two terminals; The server of claim 4.

22. The control unit When a response indicating that the user does not wish to continue the call is received from at least one of the two terminals, or when a response to the confirmation as to whether the user wishes to continue the call is not received from at least one of the two terminals within a predetermined time from the display of the confirmation as to whether the user wishes to continue the call, information indicating that matching between the two users is prohibited is stored in the storage unit in association with the identification information of each of the two users. The server of claim 4.

23. The computer Communicating with two or more terminals, matching two users from among the two or more users based on information of the two or more users associated with the two or more terminals, respectively; At each stage of the relationship, which includes at least two stages, (a) transmitting information about a call between the two users to two terminals associated with the two users and displaying a call screen; (b) receiving, from each of the two terminals, a response to a confirmation displayed on the two terminals in response to the end of the call between the two users, the response indicating whether the user wishes to move to the next stage of the relationship; (c) when responses indicating a desire to move to the next stage of the relationship step are received from both of the two terminals, moving the relationship step of the two users to the next stage; Perform processing including In the first stage of the association step, the processing is performed for a voice-only call; Based on the information of the call between the two users, analyze at least one of the interests, concerns, or sympathies of the two users, or the excitement or highlights of the call between the two users; After the call between the two users is completed, the analysis results are displayed on each of the two terminals. Information processing methods.

24. A system including two or more terminals and a server communicating with the two or more terminals, The system includes a storage unit and a control unit, the storage unit stores information of two or more users associated with the two or more terminals, respectively; The control unit matching two users from among the two or more users based on information of the two or more users; At each stage of the relationship, which includes at least two stages, (a) displaying a call screen between the two users on two terminals associated with the two users, respectively; (b) upon completion of the call between the two users, displaying on each of the two terminals a message for confirming whether the user wishes to move to the next stage of the relationship; (c) when a response indicating a desire to move to the next stage of the relationship step is input at both of the two terminals, moving the relationship step of the two users to the next stage; Perform processing including In the first stage of the association step, the processing is performed for a voice-only call; Based on the information of the call between the two users, analyze at least one of the interests, concerns, or sympathies of the two users, or the excitement or highlights of the call between the two users; After the call between the two users is completed, the analysis results are displayed on each of the two terminals. system.

25. The processor At each stage of the relationship, which includes at least two stages, (a) receiving, from a server, information about a call between two users that are matched from two or more users; (b) displaying a call screen based on information of the received call; (c) upon completion of the call between the two users, displaying a confirmation message as to whether the user wishes to move to the next stage of the relationship as a series of processes following the end of the call; (d) sending to the server an answer entered in response to a confirmation as to whether the user wishes to move to the next stage of the relationship; A program for executing a process including: In the first stage of the association step, the processing is performed for a voice-only call; Based on the information of the call between the two users, at least one of the interests, concerns, or sympathies of the two users, or the excitement or highlights of the call between the two users is analyzed; causing the processor to display the results of the analysis after the call between the two users is terminated. program.

26. A computer comprising: Communicating with two or more terminals, matching two users from among the two or more users based on information of the two or more users associated with the two or more terminals, respectively; At each stage of the relationship, which includes at least two stages, (a) transmitting information about a call between the two users to two terminals associated with the two users and displaying a call screen; (b) receiving, from each of the two terminals, a response to a confirmation displayed on the two terminals in response to the end of the call between the two users, the response indicating whether the user wishes to move to the next stage of the relationship; (c) when responses indicating a desire to move to the next stage of the relationship step are received from both of the two terminals, moving the relationship step of the two users to the next stage; Perform processing including In the first stage of the association step, the processing is performed for a voice-only call; Based on the information of the call between the two users, a summary of the call is generated and displayed on each of the two terminals. Information processing methods.

27. ​​A system including two or more terminals and a server communicating with the two or more terminals, The system includes a storage unit and a control unit, the storage unit stores information of two or more users associated with the two or more terminals, respectively; The control unit matching two users from among the two or more users based on information of the two or more users; At each stage of the relationship, which includes at least two stages, (a) displaying a call screen between the two users on two terminals associated with the two users, respectively; (b) upon completion of the call between the two users, displaying on each of the two terminals a message for confirming whether the user wishes to move to the next stage of the relationship; (c) when a response indicating a desire to move to the next stage of the relationship step is input at both of the two terminals, moving the relationship step of the two users to the next stage; Perform processing including In the first stage of the association step, the processing is performed for a voice-only call; Based on the information of the call between the two users, a summary of the call is generated and displayed on each of the two terminals. system.

28. A processor comprising: At each stage of the relationship, which includes at least two stages, (a) receiving, from a server, information about a call between two users that are matched from two or more users; (b) displaying a call screen based on information of the received call; (c) upon completion of the call between the two users, displaying a confirmation message as to whether the user wishes to move to the next stage of the relationship as a series of processes following the end of the call; (d) sending to the server an answer entered in response to a confirmation as to whether the user wishes to move to the next stage of the relationship; A program for executing a process including: In the first stage of the association step, the processing is performed for a voice-only call; A call summary is generated based on information of the call between the two users, and the processor is caused to display the call summary. program.

Images