Multimedia communication processing method and related products

Abstract

The application provides a multimedia communication processing method and related products; the method comprises the following steps: displaying a man-machine interaction interface; wherein the man-machine interaction interface comprises a multimedia communication invitation entrance; in response to a triggering operation on the multimedia communication invitation entrance, displaying at least one candidate account and communication reference information of each candidate account; wherein the communication reference information comprises time zone time information of the candidate account and an online state corresponding to the time zone time information; in response to a multimedia communication invitation operation on at least one target account in the at least one candidate account, sending a multimedia communication invitation message to the at least one target account. Through the application, the information of the account participating in the multimedia communication can be intelligently reminded, so that the success rate of the account initiating the multimedia communication is improved.

Description

Technical Field

[0001] This application relates to multimedia communication technology, and more particularly to a multimedia communication processing method, apparatus, electronic device, computer-readable storage medium, and computer program product. Background Technology

[0002] With the development of internet technology, multimedia communication technology can be used to connect users in multiple different regions for communication. For example, audio calls or video calls can be established between multiple users, thereby speeding up the communication efficiency of users.

[0003] When multimedia communication methods are applied to people in different time zones, the success rate of establishing multimedia communication is low because users in different time zones are in different local times and have different behavioral states, resulting in low efficiency of human-computer interaction. Summary of the Invention

[0004] This application provides a multimedia communication processing method, apparatus, electronic device, computer-readable storage medium, and computer program product, which can intelligently remind users of account information participating in multimedia communication, thereby improving the success rate of initiating multimedia communication.

[0005] The technical solution of this application embodiment is implemented as follows:

[0006] This application provides a multimedia communication processing method, including:

[0007] Display a human-computer interaction interface; wherein, the human-computer interaction interface includes a multimedia communication invitation entry;

[0008] In response to a trigger operation on the multimedia communication invitation entry, at least one candidate account is displayed, and communication reference information for each candidate account is displayed; wherein, the communication reference information includes the time zone information of the candidate account and the online status corresponding to the time zone information;

[0009] In response to a multimedia communication invitation operation for at least one target account among the at least one candidate account, a multimedia communication invitation message is sent to the at least one target account.

[0010] This application provides a multimedia communication processing apparatus, comprising:

[0011] The first display module is used to display the human-computer interaction interface; wherein, the human-computer interaction interface includes a multimedia communication invitation entry;

[0012] The second display module is configured to respond to a trigger operation on the multimedia communication invitation entry, display at least one candidate account, and display communication reference information for each candidate account; wherein, the communication reference information includes the time zone information of the candidate account and the online status corresponding to the time zone information;

[0013] The invitation module is used to send a multimedia communication invitation message to the at least one target account in response to a multimedia communication invitation operation for at least one target account among the at least one candidate account.

[0014] In the above scheme, the second display module is further configured to: when the number of the at least one candidate account is multiple, display multiple candidate accounts in sequence; wherein the order is one of the following: ascending order of social distance between the multiple candidate accounts and the initiating account of the multimedia communication, descending order of activity of the multiple candidate accounts, or descending order of the most recent interaction time between the multiple candidate accounts and the initiating account.

[0015] In the above scheme, before displaying the at least one candidate account, the second display module is further configured to: obtain the candidate account that satisfies at least one of the following conditions: the candidate account is online; the social distance between the candidate account and the initiating account of the multimedia communication is less than a social distance threshold; the activity level of the candidate account is greater than an activity threshold; the most recent interaction time between the candidate account and the initiating account is greater than an interaction time threshold; the candidate account and the initiating account are in the same communication connection.

[0016] In the above scheme, when the candidate account and the initiating account are in the same communication connection, the second display module is further configured to: select at least one communication account in the target group corresponding to the communication connection other than the initiating account as at least one candidate account and display the at least one candidate account, wherein the initiating account belongs to the target group; or select the target communication account in the communication connection as the candidate account and display the candidate account.

[0017] In the above scheme, the second display module is further configured to: when the multimedia communication is real-time multimedia communication, display communication reference information for each candidate account, wherein the communication reference information includes the real-time time zone of the candidate account and the real-time online status of the candidate account corresponding to the real-time time zone.

[0018] In the above scheme, when displaying the communication reference information of each candidate account, the second display module is further configured to: when the number of the at least one candidate account is multiple, apply differentiated display styles to the communication reference information corresponding to the multiple candidate accounts respectively; wherein, the significance of the display style of the real-time time zone of the candidate account is positively correlated with the time zone difference, and the time zone difference is used to characterize the time difference between the candidate account and the initiating account of the multimedia communication; the significance of the display style of the real-time online status is positively correlated with the status difference, and the status difference is the difference between the online status of the candidate account and the online status of the initiating account.

[0019] In the above scheme, before displaying the communication reference information of each candidate account, the second display module is further configured to: obtain the real-time online status of each candidate account; wherein the real-time online status of each candidate account is determined in response to the setting operation of the candidate account.

[0020] In the above scheme, before displaying the communication reference information of each candidate account, the second display module is further configured to: determine the real-time online status of each candidate account by: obtaining historical schedule information corresponding to multiple sample communication accounts respectively; performing the following processing for each sample communication account: extracting the historical online status of each historical time period from the historical schedule information of the sample communication account; performing statistical processing on the historical online status of the multiple communication accounts in each historical time period to obtain the statistical status corresponding to each historical time period; and determining the statistical status corresponding to the historical time period in which the real-time time zone is located as the real-time online status of the candidate account.

[0021] In the above scheme, before displaying the communication reference information of each candidate account, the second display module is further configured to: determine the real-time online status of each candidate account by: acquiring the historical schedule information of the candidate account and the historical schedule information of multiple sample communication accounts; extracting the historical status features of the candidate account from the historical schedule information of the candidate account, and extracting the historical status features of the multiple sample communication accounts from the historical schedule information of the multiple sample communication accounts; performing a fusion processing on the historical status features of the candidate account and the historical status features of the multiple sample communication accounts to obtain a fused status feature; and performing a mapping processing on the fused status feature to obtain the real-time online status of the candidate account.

[0022] In the above scheme, before responding to the multimedia communication invitation operation for at least one target account among the at least one candidate account, the invitation module is further configured to: when the real-time time zone of the candidate account is in a communicable period and the real-time online status of the candidate account is a communicable state, determine the candidate account as the at least one target account and display the target account in the selected state.

[0023] In the above scheme, the second display module is further configured to: when the multimedia communication is a scheduled multimedia communication, display the time zone and online status of each candidate account at the scheduled time, wherein the scheduled time includes at least one of the following: a scheduled time point; a scheduled time period.

[0024] In the above scheme, when displaying the communication reference information of each candidate account, the second display module is further configured to: when the number of the at least one candidate account is multiple, apply differentiated display styles to the communication reference information corresponding to the multiple candidate accounts respectively; wherein, the significance of the display style of the candidate account's time zone corresponding to the appointment time is positively correlated with the time zone difference, and the time zone difference is used to characterize the time difference between the candidate account and the initiating account of the multimedia communication; the significance of the display style of the candidate account's online status corresponding to the appointment time is positively correlated with the status difference, and the status difference is the difference between the online status of the candidate account corresponding to the appointment time and the online status of the initiating account.

[0025] In the above scheme, before displaying the communication reference information of each candidate account, the second display module is further configured to: obtain the online status of each candidate account corresponding to the appointment time; wherein, the online status of each candidate account corresponding to the appointment time is determined in response to the setting operation of the candidate account.

[0026] In the above scheme, before displaying the communication reference information of each candidate account, the second display module is further configured to: determine the online status of each candidate account corresponding to the appointment time by: obtaining historical schedule information corresponding to multiple sample communication accounts respectively; performing the following processing for each sample communication account: extracting the historical online status of each historical time period from the historical schedule information of the sample communication account; performing statistical processing on the historical online status of the multiple communication accounts in each historical time period to obtain the statistical status corresponding to each historical time period; and determining the statistical status corresponding to the historical time period in which the candidate account is located at the appointment time as the online status of the candidate account corresponding to the appointment time.

[0027] In the above scheme, before displaying the communication reference information of each candidate account, the second display module is further configured to: determine the online status of each candidate account corresponding to the appointment time by: obtaining the historical schedule information of the candidate account and the historical schedule information of multiple sample communication accounts; extracting the historical status features of the candidate account from the historical schedule information of the candidate account, and extracting the historical status features of the multiple sample communication accounts from the historical schedule information of the multiple sample communication accounts; performing a fusion processing on the historical status features of the candidate account and the historical status features of the multiple sample communication accounts to obtain a fused status feature; and performing a mapping processing on the fused status feature to obtain the online status of the candidate account corresponding to the appointment time.

[0028] In the above scheme, before displaying the communication reference information of each candidate account, the second display module is further configured to: in response to the setting operation for the appointment time of the multimedia communication, obtain the time zone time and online status of the candidate account corresponding to the appointment time; after displaying the communication reference information of each candidate account, the method further includes: in response to the modification operation of the appointment time of the multimedia communication initiated by the multimedia communication, updating the communication reference information of each candidate account according to the modified appointment time, wherein the updated communication reference information is the communication reference information of each candidate account at the modified appointment time.

[0029] In the above scheme, before responding to the multimedia communication invitation operation for at least one target account among the at least one candidate account, the invitation module is further configured to: when the candidate account is in a communicable period in the time zone corresponding to the appointment time, and the candidate account is in a communicable online state corresponding to the appointment time, determine the candidate account as the at least one target account, and display the target account in the selected state.

[0030] In the above scheme, the communication reference information further includes at least one of the following: location information of the candidate account, weather information of the candidate account's location, and schedule information of the candidate account; when the communication reference information includes the location information of the candidate account, the salience of the display style of the communication reference information is positively correlated with distance, where the distance is the distance between the geographical location corresponding to the candidate account and the geographical location corresponding to the initiating account; when the communication reference information includes weather information of the candidate account's location, the salience of the display style of the communication reference information is positively correlated with the severity of weather represented by the weather information; when the communication reference information includes the schedule information of the candidate account, the salience of the display style of the communication reference information is positively correlated with the number of schedules represented by the schedule information.

[0031] In the above scheme, before responding to the multimedia communication invitation operation for at least one target account, the invitation module is further configured to: in response to the selection operation for the at least one candidate account, determine the candidate account selected by the selection operation as the at least one target account, and display the target account in the selected state; or determine the candidate account that meets the automatic selection conditions as the at least one target account, and display the target account in the selected state.

[0032] In the above scheme, the automatic selection conditions include at least one of the following: the social distance between the candidate account and the initiating account is less than a social distance threshold; the activity level of the candidate account is greater than an activity threshold; the most recent interaction time between the candidate account and the initiating account is greater than an interaction time threshold.

[0033] In the above scheme, the invitation module is further configured to: perform the following processing for each candidate account: obtain decision reference data, wherein the decision reference data includes at least one of the following: historical schedule information of the candidate account, setting information of the multimedia communication, historical communication information of the candidate account, and communication reference information of the candidate account; extract decision reference features from the decision reference data, and predict the probability that the candidate account can respond to the multimedia communication based on the decision reference features; when the probability is greater than a probability threshold, determine that the candidate account meets the automatic selection condition.

[0034] In the above scheme, before sending the multimedia communication invitation message to the at least one target account, the invitation module is further configured to: when there is a target account among the at least one target account that meets the prompting conditions, display a first prompt message, wherein the first prompt message indicates that the communication start time of the multimedia communication conflicts with the communication reference information of the target account; and in response to the confirmation operation of the first prompt message, determine to proceed to the process of sending the multimedia communication invitation message to the at least one target account.

[0035] In the above scheme, the prompting conditions include at least one of the following: at the communication start time, the time zone of the target account is in the non-communication period of the target account; at the communication start time, the time zone of the target account is in the communication period of the target account, and the time interval between the time zone of the target account and the non-communication period of the target account is less than a time interval threshold; at the communication start time, the online status of the target account is non-communication status.

[0036] In the above scheme, the invitation module is further configured to: display the account identifier of each target account and the real-time communication reference information of each target account during the multimedia communication process, wherein the real-time communication reference information of the target account includes at least one of the following: the real-time time zone of the target account and the real-time online status of the target account corresponding to the real-time time zone; when the real-time online status is a non-communication status, display a second prompt message, wherein the second prompt message is used to prompt the initiating account of the multimedia communication to end the multimedia communication.

[0037] This application provides an electronic device, including:

[0038] Memory, used to store executable instructions;

[0039] The processor, when executing executable instructions stored in the memory, implements the multimedia communication processing method provided in the embodiments of this application.

[0040] This application provides a computer-readable storage medium storing executable instructions, which, when executed by a processor, implement the multimedia communication processing method provided in this application.

[0041] This application provides a computer program product, including a computer program or instructions, which, when executed by a processor, implement the multimedia communication processing method provided in this application.

[0042] The embodiments of this application have the following beneficial effects:

[0043] Before inviting an account to conduct multimedia communication, the initiating account is shown the time zone and online status of each candidate account. This allows the initiating account to select the appropriate candidate account for multimedia communication by referring to the time zone and online status of each candidate account, thus improving the success rate of the invitation operation. Attached Figure Description

[0044] Figure 1 This is a schematic diagram of the structure of the multimedia communication processing system provided in the embodiments of this application;

[0045] Figure 2 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0046] Figures 3A-3D This is a flowchart illustrating the multimedia communication processing method provided in an embodiment of this application;

[0047] Figure 4A-4J This is a schematic diagram of the display interface of the multimedia communication processing method provided in the embodiments of this application;

[0048] Figure 5 This is a schematic diagram of the interactive flow of the multimedia communication processing method provided in the embodiments of this application. Detailed Implementation

[0049] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0050] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0051] In the following description, the terms "first, second, third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0052] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0053] In the implementation of this application, the collection and processing of relevant data should strictly comply with the requirements of relevant laws and regulations, obtain the informed consent or separate consent of the personal information subject, and carry out subsequent data use and processing within the scope of laws and regulations and the authorization of the personal information subject.

[0054] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.

[0055] 1) In response to, used to indicate the conditions or states on which the operation performed depends. When the conditions or states on which it depends are met, one or more operations performed may be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.

[0056] 2) Time zones: Due to the different longitudes of various countries and regions around the world, time zones also differ, thus forming different time zones. The official time zone division includes 24 time zones, each represented by an English letter.

[0057] 3) Multimedia communication, which includes at least one of audio and video online communication. Multimedia communication includes two types: real-time and scheduled. Among them, the typical application of scheduled multimedia communication is online conferencing.

[0058] With globalization, people from different countries have a need to communicate with each other. Various instant messaging software has become a bridge for communication between people in different countries. In implementing the embodiments of this application, the applicant discovered that time and space become obstacles to instant messaging. Being in different regions makes it impossible to know the current time zone of social friends in a timely manner, thus preventing successful communication. For example, communication account A sends an audio / video call to communication account B, but communication account B may currently be in its time zone at 3 AM, and the user corresponding to communication account B may be in a resting state. Or, communication account A wants to schedule an audio / video call with communication account B, but because it does not know the time zone of communication account B (especially in countries with daylight saving time), nor does it know the current status of the user corresponding to communication account B, it is impossible to schedule a suitable time for the audio / video call.

[0059] The existing audio and video call technology lacks a function to display the other party's time zone. Users must manually check the other party's time zone, especially since some countries have daylight saving time, requiring manual adjustment of the dial time by one hour during these times. This process has two drawbacks: 1. User error is common when manually checking the time zone. Knowing the other party's country and city is crucial, as some countries have multiple time zones with different times, and manual adjustment is necessary for daylight saving time. 2. The process is complex and lacks automation: Users must manually check and calculate the other party's time zone. This is especially problematic when dealing with contacts in multiple countries, consuming time and effort. 3. Time information is limited. A user's ability to respond to an audio or video call depends not only on the time zone but also on their current status. Relying solely on time information for invitations still doesn't guarantee a high success rate.

[0060] To address the technical problem of low invitation success rate leading to low human-computer interaction efficiency in related technologies, embodiments of this application provide a multimedia communication processing method, apparatus, electronic device, computer program product, and computer-readable storage medium, which can improve the generation and transmission of dynamic human-computer interaction diversity.

[0061] The following describes exemplary applications of the electronic devices provided in the embodiments of this application. The electronic devices for implementing the processing method for multimedia communication provided in the embodiments of this application can be implemented as various types of user terminals such as laptops, tablets, desktop computers, set-top boxes, and mobile devices (e.g., mobile phones, portable music players, personal digital assistants, dedicated messaging devices, portable gaming devices).

[0062] See Figure 1 , Figure 1 This is a schematic diagram of the architecture of the multimedia communication processing system provided in the embodiments of this application. In order to support a social application, terminal 400-1 and terminal 400-2 are connected to server 200 through network 300. Network 300 can be a wide area network or a local area network, or a combination of the two.

[0063] Terminal 400-2 receives the local status set by the candidate account and sends the local status and local time to server 200. Server 200 sends the time zone information of the candidate account and the online status corresponding to the time zone information to terminal 400-1 of the corresponding initiating account. It is understood that in this embodiment, user-related data such as the time zone information of the candidate account and the online status corresponding to the time zone information are required to obtain user permission or consent when this embodiment is applied to specific products or technologies. The collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions. Terminal 400-1 receives the trigger operation of the initiating account for the multimedia communication invitation entry and displays at least one candidate account in the human-computer interaction interface of terminal 400-1, and displays the communication reference information of each candidate account. Terminal 400-1 receives the multimedia communication invitation operation for at least one candidate account and sends the multimedia communication invitation message to terminal 400-2 of the corresponding candidate account through server 200.

[0064] In some embodiments, the terminal or server can implement the multimedia communication processing method provided in this application by running a computer program. For example, the computer program can be a native program or software module in an operating system; it can be a native application (APP), that is, a program that needs to be installed in the operating system to run, such as an instant messaging client, video conferencing client, or social networking client; it can also be a mini-program, that is, a program that only needs to be downloaded into a browser environment to run; or it can be a mini-program that can be embedded in any APP. In short, the above-mentioned computer program can be any form of application, module, or plugin.

[0065] The embodiments of this application can be implemented with the help of cloud technology, which refers to a hosting technology that unifies a series of resources such as hardware, software, and network within a wide area network or local area network to realize the computation, storage, processing, and sharing of data.

[0066] Cloud technology is a general term encompassing network technology, information technology, integration technology, management platform technology, and application technology based on the cloud computing business model. It can form resource pools, allowing for on-demand use with flexibility and convenience. Cloud computing technology will become a crucial support. The backend services of cloud computing systems require substantial computing and storage resources.

[0067] As an example, server 200 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Terminal 400-1 can be a smartphone, tablet, laptop, desktop computer, smart speaker, smartwatch, in-vehicle terminal, etc., but is not limited to these. Terminal 400-1 and server 200 can be directly or indirectly connected via wired or wireless communication, which is not limited in this embodiment.

[0068] See Figure 2 , Figure 2 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Figure 2 The terminal 400-1 shown includes at least one processor 410, a memory 450, at least one network interface 420, and a user interface 430. The various components in terminal 400-1 are coupled together via a bus system 440. It is understood that the bus system 440 is used to implement communication between these components. In addition to a data bus, the bus system 440 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 2 The general labeled all buses as Bus System 440.

[0069] Processor 410 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0070] User interface 430 includes one or more output devices 431 that enable the presentation of media content, including one or more speakers and / or one or more visual displays. User interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0071] The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state storage, hard disk drives, optical disk drives, etc. The memory 450 may optionally include one or more storage devices physically located away from the processor 410.

[0072] The memory 450 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 450 described in this application embodiment is intended to include any suitable type of memory.

[0073] In some embodiments, memory 450 is capable of storing data to support various operations, examples of which include programs, modules, and data structures or subsets or supersets thereof, as illustrated below.

[0074] Operating system 451 includes system programs for handling various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic business functions and handling hardware-based tasks;

[0075] The network communication module 452 is used to reach other computing devices via one or more (wired or wireless) network interfaces 420, exemplary network interfaces 420 including: Bluetooth, WiFi, and Universal Serial Bus (USB), etc.

[0076] Presentation module 453 is configured to enable the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 431 associated with user interface 430 (e.g., a display screen, a speaker, etc.).

[0077] The input processing module 454 is used to detect and translate one or more user inputs or interactions from one or more input devices 432.

[0078] In some embodiments, the multimedia communication processing apparatus provided in this application can be implemented in software. Figure 2 A multimedia communication processing device 455 stored in memory 450 is shown. This device can be software in the form of programs and plug-ins, and includes the following software modules: a first display module 4551, a second display module 4552, and an invitation module 4553. These modules are logically connected and can therefore be arbitrarily combined or further separated according to the functions they implement. The functions of each module will be described below.

[0079] The multimedia communication processing method provided in this application will be described in conjunction with exemplary applications and implementations of the terminals provided in the embodiments of this application.

[0080] See Figure 3A, Figure 3A This is a flowchart illustrating the multimedia communication processing method provided in the embodiments of this application, which will be combined with... Figure 3A Steps 101-103 are shown and explained.

[0081] In step 101, the human-computer interaction interface is displayed.

[0082] As an example, the human-computer interaction interface includes a multimedia communication invitation entry; see [link to relevant documentation]. Figure 4A , Figure 4A This is a schematic diagram of the display interface of the multimedia communication processing method provided in the embodiment of this application. The human-computer interaction interface 401A is the instant messaging interface of the group. The multimedia communication invitation entry 402A is displayed in the human-computer interaction interface 401A. In addition to being embedded in the instant messaging interface of the group, the multimedia communication invitation entry can also be embedded in at least one of the following: office application, private chat instant messaging interface, and the function interface of instant messaging application.

[0083] In step 102, in response to the triggering operation for the multimedia communication invitation entry, at least one candidate account is displayed, and communication reference information for each candidate account is displayed.

[0084] As an example, communication reference information includes the candidate account's time zone information and its corresponding online status. The online status can be displayed graphically or as text. It represents the candidate account's schedule within its time zone, and includes statuses such as working, away, offline, resting, lunching, entertainment, meetings, team building, etc. See also... Figure 4B , Figure 4B This is a schematic diagram of the display interface of the multimedia communication processing method provided in the embodiments of this application. The human-computer interaction interface 401B is the instant messaging interface of the group. The human-computer interaction interface 401B displays the multimedia communication invitation entry 402B. In response to the trigger operation of the multimedia communication invitation entry 401B, at least one candidate account 405B, the time zone information 403B of the candidate account, and the online status 404B of the candidate account corresponding to the time zone information are displayed in the human-computer interaction interface 401B.

[0085] In step 103, in response to a multimedia communication invitation operation for at least one target account among at least one candidate account, a multimedia communication invitation message is sent to at least one target account.

[0086] As an example, the target account is selected from at least one candidate account. See also Figure 4C , Figure 4CThis is a schematic diagram of the display interface of the multimedia communication processing method provided in the embodiments of this application. The human-computer interaction interface 401C displays at least one candidate account 402C, the local time of the candidate account 403C, and the online status 404C of the candidate account corresponding to the time zone information. The target account is a candidate account with a selection mark 405C. In response to the trigger operation of the invitation control 406C, a multimedia communication invitation message is sent to the target account (that is, to the terminal of the target account). The invitation message can be sent to the instant messaging interface of the target account.

[0087] Before inviting a target account to participate in multimedia communication, the time zone and online status of each candidate account are displayed to the initiating account. This allows the initiating account to refer to the time zone and online status of each candidate account when inviting a target account from the candidate accounts, thereby increasing the success rate of the invitation operation and improving the efficiency of human-computer interaction.

[0088] In some embodiments, displaying at least one candidate account in step 102 can be achieved through the following technical solution: when there are multiple candidate accounts, the multiple candidate accounts are displayed in sequence; wherein the order is one of the following: ascending order of social distance between the multiple candidate accounts and the initiating account of the multimedia communication, descending order of activity of the multiple candidate accounts, or descending order of the most recent interaction time between the multiple candidate accounts and the initiating account. By displaying multiple candidate accounts in the above ascending or descending order, the initiating account can be prompted with the preferred call recipient among the multiple candidate accounts, thereby improving the efficiency of human-computer interaction.

[0089] It is understood that, in the embodiments of this application, data related to social distance, activity level, and recent interaction time are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0090] As an example, see Figure 4C, at least one candidate account 402C, the time zone time information 403C of the candidate account, and the online status 404C of the candidate account corresponding to the time zone time information are displayed in the human-computer interaction interface 401C. The sorting order of the candidate accounts can be in ascending order of the social distance between multiple candidate accounts and the initiating account of the multimedia communication. For example, the social distance between the candidate account with the username "A Wen" and the initiating account is 1, and the social distance between the candidate account with the username "dcnche" and the initiating account is 2 (indicating that they have common friends). The sorting order of the candidate accounts can be in descending order of the activity of multiple candidate accounts. For example, the activity of the candidate account with the username "A Wen" is higher than that of the candidate account with the username "dcnche". The activity can be calculated based on the behavior data of the candidate account. For example, the behaviors include like behavior, comment behavior, message sending behavior, etc. The sorting order of the candidate accounts can be in descending order of the most recent interaction time between multiple candidate accounts and the initiating account. For example, the most recent interaction time between the candidate account with the username "A Wen" and the initiating account is December 12, 2021, and the most recent interaction time between the candidate account with the username "dcnche" and the initiating account is December 11, 2021. When sorting and displaying, the ascending order can also be switched to the descending order, and the descending order can be switched to the ascending order. Sorting preference options can be provided in the human-computer interaction interface for the user to select.

[0091] In some embodiments, when the candidate account and the initiating account are in the same communication connection, the step of displaying at least one candidate account in step 102 can be implemented by the following technical solutions: perform any one of the following processes: when the communication connection is the communication connection of the target group, use at least one communication account other than the initiating account in the target group corresponding to the communication connection as at least one candidate account, and display at least one candidate account, where the initiating account of the multimedia communication belongs to the target group; when the communication connection is the communication connection between the target communication account and the initiating account, use the target communication account in the communication connection as the candidate account, and display the candidate account. Directly use the communication accounts in the target group as the displayed candidate accounts or use the communication accounts of friends as candidate accounts. The communication accounts of friends have a social relationship with the initiating account, such as a friendship relationship, or a following relationship, a subscription relationship. Since the communication accounts of friends have a social relationship with the initiating account, the communication accounts of friends can establish a communication connection with the initiating account, so the communication accounts of friends are the target communication accounts in the communication connection. Through the embodiments of the present application, a reliable call object selection range can be provided to the user holding the initiating account, thereby reducing the human-computer interaction caused by the user searching for candidate objects and improving the human-computer interaction efficiency.

[0092] It is understood that, in the embodiments of this application, data related to social relationships is involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0093] As an example, see Figure 4B The human-computer interaction interface 401B is the instant messaging interface of the target group. The human-computer interaction interface 401B displays a multimedia communication invitation entry 402B. The multimedia communication invitation entry 402B can be set in the interface of the communication connection, such as in the chat interface of the target group or in the one-on-one chat interface with the target communication account. In response to the trigger operation of the multimedia communication invitation entry 401B, at least one candidate account 402B, the time zone information 403B of the candidate account, and the online status 404B of the candidate account corresponding to the time zone information are displayed in the human-computer interaction interface 401B. The candidate account can be any communication account in the target group other than the initiating account. In addition, the candidate account can also be a target communication account that has a social relationship with the initiating account and is in a certain communication connection.

[0094] In some embodiments, displaying at least one candidate account in step 102 can also be achieved through the following technical solutions: performing any of the following processes: selecting at least one communication account in the target group other than the initiating account as at least one candidate account and displaying at least one candidate account, wherein the initiating account of the multimedia communication belongs to the target group; selecting at least one communication account with a social relationship (e.g., friend relationship, or follow relationship, subscription relationship) with the initiating account as at least one candidate account and displaying at least one candidate account. Directly selecting communication accounts in the target group as displayed candidate accounts or selecting communication accounts of friends as candidate accounts can provide users holding the initiating account with a reliable range of call recipients, thereby reducing human-computer interaction caused by users searching for candidate recipients and improving human-computer interaction efficiency.

[0095] As an example, see Figure 4BThe human-computer interaction interface 401B is the instant messaging interface of the target group. The human-computer interaction interface 401B displays a multimedia communication invitation entry 402B. The multimedia communication invitation entry 402B can be set outside of a specific chat interface. For example, the multimedia communication invitation entry can be set directly in the function bar of a social app, so that it is not limited to selecting the target account to send the invitation from a specific target group or a specific target communication account. In response to the trigger operation of the multimedia communication invitation entry 401B, at least one candidate account 402B, the local time of the candidate account 403B, and the local status 404B of the candidate account at the local time are displayed in the human-computer interaction interface 401B. The candidate account can be any communication account in the target group other than the initiating account. In addition, the candidate account can also be any account that has a social relationship with the initiating account.

[0096] In some embodiments, before displaying at least one candidate account in step 102, candidate accounts that meet at least one of the following conditions are obtained: the candidate account is online; the social distance between the candidate account and the initiating account is less than a social distance threshold; the activity level of the candidate account is greater than an activity threshold; the most recent interaction time between the candidate account and the initiating account is greater than an interaction time threshold; or the candidate account and the initiating account are in the same communication connection. By filtering candidate accounts based on social distance, activity level, and most recent interaction time, candidate accounts that meet at least one of the above conditions are obtained, thereby providing users with a valuable range of call options, reducing the human-computer interaction required for searching for candidate accounts, and improving the efficiency of human-computer interaction.

[0097] As an example, the candidate account being in an online state indicates that the candidate account can receive invitation messages in a timely manner. The social distance between the candidate account and the initiating account represents the social relationship between the two. For example, a social distance of 1 between the candidate account with the username "A Wen" and the initiating account indicates that they are friends with each other. A social distance of 2 between the candidate account with the username "dcnche" and the initiating account (indicating that they do not have a direct friendship but have mutual friends) means that the activity level of the candidate account being greater than the activity threshold indicates that the activity level of the candidate account within a unit of time (e.g., the number of actions within a unit of time) is greater than the activity threshold (e.g., the threshold of the number of actions within a unit of time). The most recent interaction time between the candidate account and the initiating account is greater than the interaction time threshold. For example, the most recent interaction time between the candidate account with the username "A Wen" and the initiating account is December 12, 2021, and the interaction time threshold is December 11, 2021, that is, the most recent interaction time is greater than the interaction time threshold. The candidate account and the initiating account are in the same communication connection, and the multimedia communication invitation entry can be set on the interface of the communication connection. For example, within the chat interface of the target group or within the one-on-one chat interface with the target communication account. For example, triggering the multimedia communication invitation entry from the chat interface of the target group (where a communication connection has been established) to display the candidate accounts, and the communication accounts in the target group other than the initiating account can be displayed as candidate accounts. For example, triggering the multimedia communication invitation entry from the one-on-one chat (where a communication connection has been established) interface to display the candidate accounts, and the communication account that is the chat object in the one-on-one chat can be displayed as a candidate account.

[0098] In some embodiments, when there are multiple candidate accounts, differentiated display styles are applied to the communication reference information corresponding to each candidate account. The significance of the display style for the time zone information of the candidate account is positively correlated with the time zone difference, which characterizes the time difference between the candidate account and the initiating account of the multimedia communication. When the multimedia communication is real-time, the time zone information is the real-time time zone; when the multimedia communication is scheduled, the time zone information is the time zone corresponding to the scheduled time. The significance of the display style for the online status is positively correlated with the status difference, which is the difference between the online status of the candidate account and the initiating account. The difference in online status between accounts can be represented by status similarity. When multimedia communication is real-time, the online status corresponds to the real-time time zone. When multimedia communication is scheduled, the online status corresponds to the scheduled time. The difference can be represented by status similarity, which is the similarity between the online status of the candidate account and the online status of the initiating account at the same time. Different display styles are applied to different communication reference information. By distinguishing the display styles, users are prompted to pay extra attention to candidate accounts that differ significantly from the initiating account in terms of time zone and online status, thereby improving the efficiency of human-computer interaction.

[0099] As an example, see Figure 4D , Figure 4DThis is a schematic diagram of the display interface of the multimedia communication processing method provided in this application embodiment. The human-computer interaction interface 401D displays multiple candidate accounts 402D and 405D, the time zone information 403D of candidate account 402D, the time zone information 406D of candidate account 405D, the online status 404D of candidate account 402D corresponding to the time zone information 403D, and the online status 407D of candidate account 405D corresponding to the time zone information 406D. Different display styles are applied to the communication reference information corresponding to each of the multiple candidate accounts. The display style of the time zone information of the candidate accounts is significantly different. The degree of salience is positively correlated with time zone differences. Salience describes the attractiveness of an object's display style to the human eye. Salience can be positively correlated with the color depth of the font, the font size, and the thickness of the strokes. For example, the time zone difference between candidate account 402D and the initiating account is two time zones, while the time zone difference between candidate account 405D and the initiating account is one time zone. This means that the salience of the display style of time zone information 403D for candidate account 402D is higher than that of the display style of time zone information 406D for candidate account 405D. For instance, the font of time zone information 403D is more salience than that of time zone information 406D. The 6D font has a darker color and thicker strokes. The salience of the online status display style is negatively correlated with status similarity. Status similarity is the similarity between the online status of a candidate account and the online status of the initiating account at the same time. For example, for candidate account 402D located in New York, candidate account 405D located in Tokyo, and the initiating account located in Beijing, at the same time A, the time zone information of candidate account 402D at time A is 10 PM, and the online status of candidate account 402D is "resting." The time zone information of candidate account 405D at time A is 10 AM, and the online status of candidate account 405D is "resting." The online status of the initiating account at 9:00 AM is "working". It can be seen that the similarity between the online status of candidate account 402D and the online status of the initiating account is lower than that between the online status of candidate account 405D and the online status of the initiating account. Therefore, the significance of the display style of online status 404D of candidate account 402D is greater than that of online status 407D of candidate account 405D. For example, the font of online status 404D is darker and has thicker strokes than the font of online status 407D.

[0100] In some embodiments, the communication reference information further includes at least one of the following: location information of the candidate account, weather information of the candidate account's location, and schedule information of the candidate account; when the communication reference information includes the location information of the candidate account, the salience of the display style of the communication reference information is positively correlated with distance, where distance is the distance between the geographical location corresponding to the candidate account and the geographical location corresponding to the initiating account of the multimedia communication; when the communication reference information includes weather information of the candidate account's location, the salience of the display style of the communication reference information is positively correlated with the severity of weather represented by the weather information; when the communication reference information includes schedule information of the candidate account, the salience of the display style of the communication reference information is positively correlated with the number of schedules represented by the schedule information. In addition to time zone information and online status, weather information, schedule information, and location information of the candidate account's location can also be displayed, thereby overcoming the time and space limitations caused by different regions, providing diversified communication reference information to the initiating account, improving the display efficiency of communication reference information, and thus improving human-computer interaction efficiency.

[0101] It is understood that in the embodiments of this application, data related to user location information, weather information, schedule information, etc. are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0102] As an example, the human-computer interaction interface can also display at least one of the following: the location information of the candidate account, the weather information of the candidate account's location, and the candidate account's schedule information. For example, if the candidate account's login location is in New York, then the location information is New York; the location information of candidate account A is New York; the location information of candidate account B is Tokyo; and the geographical location of the initiating account is Beijing. The salience of the display style of the communication reference information is positively correlated with distance, and the salience of the display style of the communication reference information of candidate account A is greater than that of candidate account B. The weather information of the candidate account includes at least one of the following: blizzard, sunny, cloudy, heavy rain, etc., and the weather information of candidate account A is blizzard. The weather information for candidate account B is cloudy. The salience of the display style of the communication reference information is positively correlated with the severity of the weather represented by the weather information. The salience of the display style of the communication reference information for candidate account A is greater than that for candidate account B. The schedule information of the candidate accounts includes at least one schedule or the schedule information represents no schedule. The schedule information for candidate account A represents no schedule, while the schedule information for candidate account B represents one schedule. The salience of the display style of the communication reference information is positively correlated with the number of schedules represented by the schedule information. The salience of the display style of the communication reference information for candidate account A is less than that for candidate account B.

[0103] In some embodiments, see Figure 3B , Figure 3B This is a flowchart illustrating the multimedia communication processing method provided in this application embodiment. Step 102 displays the communication reference information for each candidate account. Figure 3B The steps 1021 or 1022 shown are implemented.

[0104] In step 1021, when the multimedia communication is real-time multimedia communication, the real-time time zone of each candidate account and the real-time online status of the candidate account corresponding to the real-time time zone are displayed.

[0105] In step 1022, when the multimedia communication is scheduled multimedia communication, the time zone and online status of each candidate account at the scheduled time are displayed.

[0106] As an example, the appointment time includes at least one of the following: appointment time point; appointment time period. When the appointment time is an appointment time period, the time zone and online status corresponding to the communication start time of each candidate account in the appointment time period are displayed.

[0107] As an example, see Figure 4E , Figure 4EThis is a schematic diagram of the display interface of the multimedia communication processing method provided in this application embodiment. The human-computer interaction interface 401E displays the candidate account 402E, the real-time time zone of the candidate account 402E 403E, and the real-time online status of the candidate account 404E. The human-computer interaction interface 401E also displays that the type of multimedia communication is real-time multimedia communication. The human-computer interaction interface 401E will display the current time 405E of the time zone where the initiating account is located. For example, if the current time is 8:00 AM Beijing time and the login region of the candidate account is New York, then the real-time time zone 403E is the New York local time converted from 8:00 AM Beijing time, and the conversion result is 9:00 PM. The real-time online status is the status corresponding to 9:00 PM. See also Figure 4F , Figure 4F This is a schematic diagram of the display interface of the multimedia communication processing method provided in this application embodiment. The human-computer interaction interface 401F displays the candidate account 402F, the time zone time corresponding to the appointment time of the candidate account 402F 403F, and the online status of the candidate account corresponding to the appointment time 404F. The human-computer interaction interface 401F also displays the type of multimedia communication as scheduled multimedia communication and the appointment time of scheduled multimedia communication 405F. The appointment time 405F is the time zone time of the location of the initiating account. For example, if the current time is 9:00 AM Beijing time, the scheduled communication time is 10:00 AM Beijing time, and the login region of the candidate account is New York, then the time zone time 403F corresponding to the appointment time of the candidate account 402F is the New York time zone time converted from 10:00 AM Beijing time, and the conversion result is 11:00 PM. The online status of the candidate account 402F corresponding to the appointment time is the status at 11:00 PM.

[0108] In some embodiments, before displaying the communication reference information for each candidate account, in response to a setting operation for the appointment time of the multimedia communication, the time zone and online status of the candidate account at the appointment time are obtained. After displaying the communication reference information for each candidate account, in response to a modification operation of the appointment time for the multimedia communication by the initiating account, the communication reference information for each candidate account is updated according to the modified appointment time. The updated communication reference information is the communication reference information for each candidate account at the modified appointment time. Different types of communication reference information are provided for different types of multimedia communication, thereby adapting the communication reference information to the multimedia communication and improving the invitation success rate of multimedia communication.

[0109] As an example, see Figure 4G , Figure 4GThis is a schematic diagram of the display interface of the multimedia communication processing method provided in this application embodiment. The human-computer interaction interface 401G displays the candidate account 402G, the time zone time corresponding to the appointment time of the candidate account 402G 403G, and the online status of the candidate account corresponding to the appointment time 404G. The human-computer interaction interface 401G also displays the type of multimedia communication as scheduled multimedia communication and the appointment time of scheduled multimedia communication 405G. The appointment communication time 405G is the time zone time of the location of the initiating account. For example, if the current time is 9:00 AM Beijing time, the appointment communication time is 10:00 AM Beijing time, and the login region of the candidate account is New York, then the time zone time 403G corresponding to the appointment time of the candidate account 402G is the New York local time converted from 10:00 AM Beijing time, and the conversion result is 11:00 PM. At this point, the online status of the candidate account at the scheduled time is "Entertainment" at 11 PM New York time. In response to the modification operation of the multimedia communication initiating account for the scheduled time 405G, the modified scheduled time 406G is 11 AM Beijing time. Based on the modified scheduled time, the communication reference information of each candidate account is updated. The updated communication reference information is the communication reference information of each candidate account at the modified scheduled time. Specifically, the time zone time corresponding to the scheduled time of candidate account 402G is updated from 11 PM New York time to 12 AM New York time corresponding to the modified scheduled time (11 AM Beijing time), and the displayed online status of the candidate account at the scheduled time, "Entertainment", is updated to "Sleeping" corresponding to the modified scheduled time.

[0110] In some embodiments, before displaying communication reference information for each candidate account, the online status of each candidate account is obtained; wherein, the online status of each candidate account is determined in response to a setting operation of the candidate account. When the multimedia communication is real-time multimedia communication, the online status of the candidate account is the real-time online status; when the multimedia communication is scheduled multimedia communication, the online status of the candidate account is the online status corresponding to the scheduled time. Determining the online status of candidate accounts through manual setting can improve the accuracy of the status, thereby increasing the invitation success rate.

[0111] As an example, the system receives the online status of each candidate account from the server, along with their time zone information. In the complete process, the system first performs function configuration. After user A's (candidate account) instant messaging client starts, during the configuration update phase, it obtains a global configuration indicating whether the display function for communication reference information is supported. If the global configuration indicates support for displaying communication reference information, user A's terminal requests the server to obtain the set or initial user configuration status. Next, configuration and time reporting updates are performed. If both global and personal status are supported, user A's terminal will trigger the acquisition of the latest Greenwich Mean Time (GMT) information and online status, and then report the latest GMT information and online status to the server. Alternatively, user A's terminal receives a setting operation to enable or disable its own time zone status display, and then reports the new switch information and the latest current GMT to the server. After receiving the information, the server converts the reported Greenwich Mean Time into time zone information through the interface and stores the time zone information in the database. During the process of creating multimedia communication on user B's terminal, when the candidate account list is displayed, it requests the server to retrieve communication reference information. The server determines whether the candidate accounts in the candidate account list support displaying their respective communication reference information. If the candidate accounts in the candidate account list support displaying their respective communication reference information, the server returns the communication reference information of the candidate accounts in the candidate account list to user B's terminal.

[0112] In some embodiments, before displaying the communication reference information for each candidate account, the online status of each candidate account is automatically determined in the following manner: when the multimedia communication is real-time multimedia communication, the time zone information of the candidate account is the real-time time zone of the candidate account, and the online status of the candidate account is the real-time online status corresponding to the real-time time zone; when the multimedia communication is scheduled multimedia communication, the time zone information of the candidate account is the time zone time corresponding to the scheduled time, and the online status of the candidate account is the online status corresponding to the scheduled time. The process involves: obtaining historical schedule information corresponding to multiple sample communication accounts; and performing the following processing for each sample communication account: from... The historical online status of each historical time period is extracted from the historical schedule information of the sample communication accounts. Statistical processing is performed on the historical online status of multiple communication accounts for each historical time period to obtain the statistical status corresponding to each historical time period. The statistical status corresponding to the historical time period that matches the time zone information is determined as the online status of the candidate account. For example, the historical time period corresponding to the time zone time of the candidate account at the scheduled time is determined as the target time period, and the statistical status corresponding to the target time period is determined as the online status of the candidate account at the scheduled time. Alternatively, the statistical status corresponding to the historical time period corresponding to the real-time time zone is determined as the real-time online status of the candidate account. Automating the determination of the online status of candidate accounts eliminates the need for user settings, improves the level of intelligence, and thus enhances the efficiency of human-computer interaction.

[0113] It is understood that in the embodiments of this application, data such as historical schedule information of sample communication accounts are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of relevant countries and regions.

[0114] As an example, the historical schedule information of sample communication account AC is obtained. The historical schedule information of sample communication account A includes the historical online status of each historical time period. The historical time period can be described in hours, that is, 9:00 to 10:00 is a historical time period. The historical online status of 3 sample communication accounts in the historical time period of 9:00 to 10:00 is statistically analyzed to obtain the statistical status of the historical time period of 9:00 to 10:00. The statistical processing here can be to take the historical online status that appears most often as the statistical status, which represents the status of most people in the historical time period of 9:00 to 10:00. When the time zone information of the candidate account is 9:30, the statistical status corresponding to the historical time period of 9:00 to 10:00 is determined as the online status of the candidate account.

[0115] In some embodiments, before displaying the communication reference information for each candidate account, the online status of each candidate account is automatically determined in the following manner: when the multimedia communication is real-time multimedia communication, the time zone information of the candidate account is the real-time time zone of the candidate account, and the online status of the candidate account is the real-time online status corresponding to the real-time time zone; when the multimedia communication is scheduled multimedia communication, the time zone information of the candidate account is the time zone time corresponding to the scheduled time, and the online status of the candidate account is the online status corresponding to the scheduled time. The process involves: obtaining the historical schedule information of the candidate account and the historical schedule information of multiple sample communication accounts; calling a first neural network model to perform the following processing: extracting the historical status features of the candidate account from the historical schedule information of the candidate account, and extracting the historical status features of multiple communication accounts from the historical schedule information of multiple sample communication accounts; fusing the historical status features of the candidate account and the historical status features of multiple communication accounts to obtain fused status features; and mapping the fused status features to obtain the online status of the candidate account. Automatically determining the online status of candidate accounts through artificial intelligence can eliminate the need for user settings, improve the level of intelligence, and thus improve the efficiency of human-computer interaction.

[0116] As an example, the first neural network model includes a first convolutional layer, a first pooling layer, and a first fully connected layer. The first convolutional layer extracts keywords from the historical schedule information of candidate accounts, performs convolution processing on the word vectors corresponding to the keywords to obtain the historical state features of the candidate accounts, and extracts the historical state features of multiple communication accounts from the historical schedule information of multiple sample communication accounts. The first pooling layer applies activation processing to the historical state features of the candidate accounts and the historical state features of the multiple communication accounts, and performs pooling processing on the activation processing results to obtain fused state features. The first fully connected layer maps the fused state features to probabilities corresponding to different historical online states, and the historical online state with the highest probability is taken as the online state corresponding to the time zone information. The training samples of the first neural network model include sample historical schedule information, and the labeled data of the first neural network model are the online state labels of the sample candidate accounts corresponding to different time zone time information. The training samples are used as input to the first neural network to obtain the predicted probability of a sample candidate account being in a certain online state (corresponding to a certain time zone time information). The predicted probability and the online state label of the sample candidate account are substituted into the loss function to obtain the first neural network model with the minimum loss.

[0117] In some embodiments, in step 103, before responding to a multimedia communication invitation operation for at least one target account, when the real-time time zone of the candidate account is in a communicable period and the real-time online status of the candidate account is communicable, the candidate account is identified as at least one target account and the target account in the selected state is displayed.

[0118] It is understood that in the embodiments of this application, data related to communication time periods and communication status are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0119] In some embodiments, in step 103, before responding to a multimedia communication invitation operation for at least one target account among at least one candidate account, when the candidate account is in a communicable period in the time zone corresponding to the appointment time and the candidate account is in a communicable online state corresponding to the appointment time, the candidate account is identified as at least one target account and the target account in the selected state is displayed.

[0120] In some embodiments, see Figure 3C , Figure 3C This is a flowchart illustrating the multimedia communication processing method provided in this application embodiment. In step 103, prior to the multimedia communication invitation operation for at least one target account, the following steps can be implemented: Figure 3C Either of steps 104 and 105 shown.

[0121] In step 104, in response to the selection operation for at least one candidate account, the candidate account selected by the selection operation is determined as at least one target account, and the target account in the selected state is displayed.

[0122] In step 105, candidate accounts that meet the automatic selection criteria are identified as at least one target account, and the target account in the selected state is displayed.

[0123] In some embodiments, the automatic selection criteria include at least one of the following: the social distance between the candidate account and the initiating account is less than a social distance threshold; the activity level of the candidate account is greater than an activity threshold; the most recent interaction time between the candidate account and the initiating account is greater than an interaction time threshold. By automatically selecting target accounts, the efficiency of acquiring target accounts can be improved, thereby enhancing the efficiency of human-computer interaction.

[0124] As an example, the communicable time period includes all time periods during which candidate account A can respond to multimedia communications, excluding non-communication time periods. Non-communication time periods include at least one of the following: rest periods, entertainment periods, sleep periods, scheduled periods, etc. The communicable status includes all statuses of candidate account A that can respond to multimedia communications, excluding non-communication statuses. Non-communication statuses include at least one of the following: rest status, entertainment status, sleep status, scheduled status, etc. Taking candidate account A and real-time multimedia communication as an example, candidate account A's real-time timezone is 10:00 AM New York time, and the communicable time periods are 9:00 AM to 11:00 AM and 3:00 PM to 5:00 PM New York time. Therefore, the candidate account's real-time timezone falls within the communicable time period. Candidate account A's real-time online status is working and has no scheduled events, so candidate account A's real-time online status is a communicable status. Based on the timezone information and online status, it can be determined that candidate account A meets the automatic selection criteria. Continuing with the example of candidate account A and scheduled multimedia communication, the time zone for the scheduled time of candidate account A is 10:00 AM New York time, and the available communication periods are 9:00 AM to 11:00 AM and 3:00 PM to 5:00 PM New York time. Therefore, the scheduled time of candidate account is within the available communication period. The online status of candidate account A at the scheduled time is working and has no scheduled activities. Thus, the online status of candidate account A at the scheduled time is available for communication. Based on the two dimensions of time zone information and online status, it can be determined that candidate account A meets the automatic selection criteria.

[0125] In some embodiments, before executing step 105, the following technical solution can be performed to obtain candidate accounts that meet the automatic selection criteria. For each candidate account, the following processing is performed: obtaining decision reference data, wherein the decision reference data includes at least one of the following: historical schedule information of the candidate account, multimedia communication setting information, historical communication information of the candidate account, and communication reference information of the candidate account; calling a second neural network model to perform the following processing: extracting decision reference features from the decision reference data, and predicting the probability that the candidate account can respond to multimedia communication based on the decision reference features; when the probability is greater than a probability threshold, determining that the candidate account meets the automatic selection criteria. Automatically determining the target account through artificial intelligence can save the user the operation of selecting the target account, improve the level of intelligence, and thus improve the efficiency of human-computer interaction.

[0126] As an example, the second neural network model includes a second convolutional layer, a second pooling layer, and a second fully connected layer. The second convolutional layer extracts keywords from the candidate account's historical schedule information, multimedia communication settings, and historical communication information. The word vectors corresponding to these keywords are then convolved to obtain the decision reference features of the candidate account. The second pooling layer applies incentive processing to these decision reference features and pools the results to obtain fused decision features. The second fully connected layer maps these fused decision features to the probability that the candidate account can respond to multimedia communication. When the probability is greater than a probability threshold, the candidate account is determined to meet the automatic selection condition. The training samples for the second neural network model include sample historical schedule information, sample multimedia communication settings, and historical communication information of the sample candidate accounts. The labeled data for the second neural network model consists of the label indicating whether each sample candidate account meets the automatic satisfaction condition. The training samples are used as input to the second neural network to obtain the predicted probability of the sample candidate account. Substituting the predicted probability and the label of the sample candidate account into the loss function yields the second neural network model with the minimum loss.

[0127] In some embodiments, see Figure 3D , Figure 3D This is a flowchart illustrating the multimedia communication processing method provided in this application embodiment. Before sending a multimedia communication invitation message to at least one target account in step 103, the following steps can be implemented: Figure 3D Steps 106 and 107 are shown.

[0128] In step 106, when at least one target account meets the prompting conditions, a first prompt message is displayed. The first prompt message indicates that the communication start time of the multimedia communication conflicts with the communication reference information of the target account.

[0129] In step 107, in response to the confirmation operation for the first prompt information, it is determined to proceed to the process of sending a multimedia communication invitation message to at least one target account.

[0130] In some embodiments, the time zone information includes the target account's time zone at the communication start time. The prompting conditions include at least one of the following: at the communication start time, the target account's time zone is within the target account's non-communication period; at the communication start time, the target account's time zone is within the target account's communicable period, and the time interval between the target account's time zone and the target account's non-communication period is less than a time interval threshold; at the communication start time, the target account's online status is non-communication. By defining the prompting conditions, scenarios requiring prompts can be effectively characterized. For example, scenarios where initiating multimedia communication is inappropriate, such as when the time zone calculated based on the communication start time is during lunchtime (a non-communication period), or when multimedia communication is currently possible, but after a period of time (e.g., a period corresponding to the time interval threshold), it becomes inappropriate to initiate multimedia communication, thereby improving the invitation success rate and the ability to maintain a call during multimedia communication.

[0131] It is understood that in the embodiments of this application, data related to non-communication periods and non-communication states are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0132] As an example, let's take target account A as an illustration. Target account A's login location is New York, and the communication start time corresponds to 12:00 PM in its time zone. 12:00 PM falls within target account A's non-communication period, thus meeting the prompting condition and requiring the display of the first prompt message. Continuing with the example of target account A, target account A's login location is New York, and the communication start time corresponds to 11:45 AM in its time zone. 11:45 AM falls within target account A's available communication period, but the minimum time interval between its time zone and the non-communication period is 15 minutes, which is less than the 30-minute interval threshold. Therefore, the prompting condition is met, and the first prompt message needs to be displayed. Non-communication periods include at least one of the following: rest periods, mealtimes, entertainment periods, scheduled time slots, etc.

[0133] As an example, see Figure 4H , Figure 4HThis is a schematic diagram of the display interface of the multimedia communication processing method provided in this application embodiment. The human-computer interaction interface 401H displays at least one candidate account 402H, the time zone of the candidate account 403H, and the online status of the candidate account corresponding to the time zone 404H. The target account is the candidate account with a selection mark 405H. In response to the trigger operation of the invitation control 406H, when there is a target account that meets the prompt conditions among the at least one target account, the first prompt information 407H is displayed. The first prompt information indicates that the communication start time of the multimedia communication invitation conflicts with the communication reference information of the target account, that is, the time zone time converted based on the communication start time is in a non-communication period or the online status corresponding to the time zone time converted based on the communication start time is a non-communication state. For example, the time zone time converted based on the communication start time is in the lunch period (non-communication period). In response to the confirmation operation of the first prompt information 407H, a multimedia communication invitation message 408H is sent to the target account. The invitation message 408H can be sent to the instant messaging interface of the target account.

[0134] In some embodiments, during multimedia communication, the account identifier of each target account and real-time communication reference information for each target account are displayed. The real-time communication reference information for each target account includes at least one of the following: the real-time time zone of the target account and the real-time online status of the target account corresponding to the real-time time zone. When the real-time online status is non-communication status, a second prompt is displayed, which prompts the initiating account to terminate the multimedia communication. By displaying at least one of the communication reference information during the communication process, the initiating account can be effectively prompted to flexibly control the communication time to avoid inconveniencing the communication recipient and reducing the user experience.

[0135] As an example, see Figure 4I , Figure 4I This is a schematic diagram of the display interface of the multimedia communication processing method provided in the embodiments of this application. The human-computer interaction interface 401I displays the account identifier 402I of each target account during the multimedia communication process, and the real-time online status 403I of each target account.

[0136] As an example, see Figure 4J , Figure 4JThis is a schematic diagram of the display interface of the multimedia communication processing method provided in this application embodiment. The human-computer interaction interface 401J displays the account identifier 402J of each target account during the multimedia communication process, and the real-time online status 403J of each target account. When the real-time online status indicates that the target account is in a non-communication state, it indicates that the user corresponding to the candidate account plans to exit the multimedia communication. The non-communication state includes all states that are not suitable to continue communication, such as rest state, meal state, and schedule occupied state. For example, if the real-time online status 403J is a meal state, the second prompt information 404J is displayed to prompt the initiating account of the multimedia communication to end the multimedia communication.

[0137] The following will describe an exemplary application of the embodiments of this application in a real-world application scenario.

[0138] In some embodiments, user A's terminal A receives the online status set by candidate account A, and terminal A sends the online status and time zone information to the server. The server sends user A's online status and time zone information to the terminal B of the corresponding initiating account B. Terminal B receives the trigger operation of the initiating account B for the multimedia communication invitation entry, and displays at least one candidate account (including candidate account A) in the human-computer interaction interface of terminal B, and displays the time zone information and online status of each candidate account. Terminal B receives the multimedia communication invitation operation for candidate account A, and sends a multimedia communication invitation message to the terminal A of the corresponding candidate account A through the server.

[0139] The multimedia communication processing method provided in this application combines communication reference information with multimedia communication invitations. When the initiating account is preparing to initiate or schedule a cross-time zone (e.g., cross-border) audio / video call, it can determine whether the other party is available for communication by checking the time zone information and online status of multiple candidate accounts, thus avoiding disturbing colleagues in other countries who are resting late at night. Furthermore, displaying real-time time zone information during multimedia communication can prevent delays from causing colleagues participating in the multimedia communication to miss their rest time. The multimedia communication processing method provided in this application can provide accurate time zone information and online status, thereby improving the success rate of multimedia communication invitations.

[0140] In some embodiments, a time zone information of the communication target is displayed before the multimedia communication invitation begins. When a user authorizes the client to obtain their current location through their communication account, the client obtains the user's geographic location to calculate the time zone information. See also Figure 4BThe human-computer interaction interface 401B is the instant messaging interface for the target group. The human-computer interaction interface 401B displays a multimedia communication invitation entry 402B. When an account makes a reservation or initiates a multimedia communication, the time zone information of all candidate participants is retrieved and displayed. In response to the trigger operation on the multimedia communication invitation entry 401B, at least one candidate account 402B, the candidate account's time zone information 403B, and the candidate account's online status 404B corresponding to the time zone information are displayed in the human-computer interaction interface 401B. Simultaneously, if a participant's corresponding multimedia communication time zone information is during rest or meal times, a warning prompt is displayed to the initiating account. See [link to relevant documentation]. Figure 4H The human-computer interaction interface 401H displays at least one candidate account 402H, the time zone information of the candidate account 403H, and the online status of the candidate account corresponding to the time zone information 404H. The target account is the candidate account with a selection mark 405H. In response to the trigger operation of the invitation control 406H, when there is a target account that meets the prompt conditions among the at least one target account, the first prompt information 407H is displayed. The first prompt information indicates that the communication start time of the multimedia communication invitation conflicts with the communication reference information of the target account. In response to the confirmation operation of the first prompt information 407H, a multimedia communication invitation message 408H is sent to the target account. The invitation message 408H can be sent to the terminal of the target account.

[0141] In some embodiments, the online status of the communication object's time zone is displayed in real time during multimedia communication. See [link to documentation]. Figure 4J , Figure 4J This is a schematic diagram of the display interface of the multimedia communication processing method provided in this application embodiment. The human-computer interaction interface 401J displays the account identifier 402J of each target account during the multimedia communication process, and the local real-time status 403J of each target account. When the local real-time status indicates that the target account is scheduled to be in a non-communication state, the non-communication state includes all states that are not suitable for continuing communication, such as rest state, meal state, and schedule occupied state. The communicable state can be a working state or a working state without a schedule. When the multimedia communication time reaches the meal or rest time of other participants, a second prompt message is given. For example, if the local real-time status 403J is a meal state, the second prompt message 404J is displayed to prompt the initiating account of the multimedia communication to end the multimedia, which can avoid unintentionally prolonging the multimedia communication and causing the participating colleagues to miss the lunch or rest time.

[0142] In some embodiments, see Figure 5 , Figure 5This is a schematic diagram of the interactive flow of the multimedia communication processing method provided in this application embodiment. In step 201, user A's terminal performs client login processing. In step 202, user A's terminal sends a global configuration request to the server to inquire whether it supports displaying the time zone. The global configuration request is used to query the server whether it supports the function of displaying the time zone. In step 203, the server returns the global configuration result. In step 204, user A's terminal updates the local global configuration in the cache. In step 205, user A's terminal sends a privacy configuration request to the server to inquire whether it supports other user terminals displaying user A's communication reference information. In step 206, the server returns the private configuration result. In step 207, user A's terminal updates the local private configuration in the cache. After obtaining the set or initial user configuration status, it then performs configuration and time zone reporting update processing. Time zone reporting is triggered in both cases. In step 208, when both global and private configurations are supported, user A's terminal obtains the latest Greenwich Mean Time information and then reports the corresponding time zone communication reference information to the server. In step 209, user A's terminal receives user A's setting operation through the privacy settings entry and sets the switch to turn on its own time zone status display. In step 210, user A's... The terminal reports the new switch information and the latest Greenwich Mean Time to the server. After receiving the information, the server converts the reported Greenwich Mean Time into time zone information through an interface and stores it in the database. In step 211, the server returns the setting result to user A's terminal. In step 212, user A's terminal updates its own setting cache, and finally obtains and displays the online status of the time zone. In step 213, when user B's terminal selects a target account, it requests the server to retrieve the new message status. In step 214, the server determines whether the candidate account supports displaying communication reference information. In step 215, if the candidate account supports displaying communication reference information... When displaying communication reference information, the server returns the communication reference information of supported candidate accounts to user B's terminal. In step 216, user B's terminal caches the communication reference information of the candidate accounts and determines whether the current time node is within the built-in meal / rest period. If the current time node is within the meal / rest period, a pop-up prompt is displayed. In step 217, after user A's terminal reports the new switch information and the latest Greenwich Mean Time to the server, the server pushes the latest communication reference information to the logged-in initiating account. In step 218, user B's terminal updates the status icon information on the interface according to the new online status.

[0143] The multimedia communication processing method provided in this application takes into account the necessity of protecting user privacy, and provides a configuration switch to allow users to decide whether to enable the function. Only after enabling the function can the user's location, time zone, and online status be displayed to friends. In addition, considering the accuracy and timeliness of the displayed time zone information, and minimizing the impact on the user's mobile phone performance, the method adopts a multi-caching approach on the server and client, as well as update push.

[0144] This application primarily addresses audio and video call scenarios highly dependent on time. It proposes supporting the display of the other party's local time zone and online status during audio and video calls, allowing users to initiate calls at appropriate times and accurately control call duration. This application enriches the auxiliary information for initiating audio and video calls by accurately synchronizing the other party's time zone information to the audio and video call invitation page. This allows users to understand whether the other party's local time zone is suitable for participation in the call at the start time. Furthermore, for time-sensitive activities, it facilitates communication and consensus-building based on the time zone information of all parties involved. This application also displays the local real-time time of all parties involved in the communication, enabling the call initiator to accurately manage call duration and prevent extended calls that could cause the other party to miss lunch or rest time.

[0145] This application proposes a technical concept that combines participant communication reference information with multimedia communication time. In related technologies, it is impossible to fully and timely understand the time zone information of all participants during the process of initiating a multimedia communication invitation and conducting multimedia communication. It relies on the initiating account to confirm the country and city of other people, and then perform manual query and calculation, which has low accuracy and consumes user time. With the auxiliary information of participant communication reference information, users can quickly understand the time zone information and online status of all participants, so as to make a quick decision on the multimedia communication time. When initiating an invitation, it is necessary to know whether the time zone information of the participants conflicts with the multimedia communication time, and the local real-time status of the participants is displayed in real time during the communication process, which greatly facilitates the alignment of communication time between the two parties.

[0146] It is understood that in the embodiments of this application, data related to user information and operational behavior are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0147] The following description continues to illustrate the exemplary structure of the multimedia communication processing apparatus 455 provided in the embodiments of this application as a software module. In some embodiments, such as Figure 2As shown, the software modules stored in the multimedia communication processing device 455 in the memory 450 may include: This application embodiment provides a multimedia communication processing device, including: a first display module 4551, used to display a human-computer interaction interface; wherein the human-computer interaction interface includes a multimedia communication invitation entry; a second display module 4552, used to display at least one candidate account and display communication reference information for each candidate account in response to a trigger operation on the multimedia communication invitation entry; wherein the communication reference information includes the time zone information of the candidate account and the online status corresponding to the time zone information; and an invitation module 4553, used to send a multimedia communication invitation message to at least one target account in response to a multimedia communication invitation operation on at least one target account among the at least one candidate account; wherein the target account is selected from at least one candidate account.

[0148] In some embodiments, the second display module 4552 is further configured to: display multiple candidate accounts in sequence when the number of at least one candidate account is multiple; wherein the order is one of the following: ascending order of social distance between the multiple candidate accounts and the initiating account of the multimedia communication, descending order of activity of the multiple candidate accounts, or descending order of the most recent interaction time between the multiple candidate accounts and the initiating account.

[0149] In some embodiments, before displaying at least one candidate account, the second display module 4552 is further configured to: obtain candidate accounts that meet at least one of the following conditions: the candidate account is online; the social distance between the candidate account and the initiating account of the multimedia communication is less than a social distance threshold; the activity level of the candidate account is greater than an activity threshold; the most recent interaction time between the candidate account and the initiating account is greater than an interaction time threshold; the candidate account and the initiating account are in the same communication connection.

[0150] In some embodiments, when the candidate account and the initiating account are in the same communication connection, the second display module 4552 is further configured to: use at least one communication account other than the initiating account in the target group of the corresponding communication connection as at least one candidate account and display at least one candidate account, wherein the initiating account belongs to the target group; or use the target communication account in the communication connection as a candidate account and display the candidate account.

[0151] In some embodiments, the second display module 4552 is further configured to: when the multimedia communication is real-time multimedia communication, display communication reference information for each candidate account, the communication reference information including the real-time time zone of the candidate account and the real-time online status of the candidate account corresponding to the real-time time zone.

[0152] In some embodiments, when displaying communication reference information for each candidate account, the second display module 4552 is further configured to: when there are multiple candidate accounts, apply differentiated display styles to the communication reference information corresponding to the multiple candidate accounts respectively; wherein, the significance of the display style of the real-time time zone of the candidate account is positively correlated with the time zone difference, and the time zone difference is used to characterize the time difference between the candidate account and the initiating account of the multimedia communication; the significance of the display style of the real-time online status is positively correlated with the status difference, and the status difference is the difference between the online status of the candidate account and the online status of the initiating account.

[0153] In some embodiments, before displaying the communication reference information for each candidate account, the second display module 4552 is further configured to: obtain the real-time online status of each candidate account; wherein the real-time online status of each candidate account is determined in response to the setting operation of the candidate account.

[0154] In some embodiments, before displaying the communication reference information for each candidate account, the second display module 4552 is further configured to: determine the real-time online status of each candidate account by: obtaining historical schedule information corresponding to multiple sample communication accounts respectively; performing the following processing for each sample communication account: extracting the historical online status of each historical time period from the historical schedule information of the sample communication account; performing statistical processing on the historical online status of multiple communication accounts in each historical time period to obtain the statistical status corresponding to each historical time period; and determining the statistical status corresponding to the historical time period in which the real-time time zone is located as the real-time online status of the candidate account.

[0155] In some embodiments, before displaying the communication reference information of each candidate account, the second display module 4552 is further configured to: determine the real-time online status of each candidate account by: acquiring the historical schedule information of the candidate account and the historical schedule information of multiple sample communication accounts; extracting the historical status features of the candidate account from the historical schedule information of the candidate account, and extracting the historical status features of multiple sample communication accounts from the historical schedule information of multiple sample communication accounts; performing a fusion process on the historical status features of the candidate account and the historical status features of multiple sample communication accounts to obtain fused status features; and performing a mapping process on the fused status features to obtain the real-time online status of the candidate account.

[0156] In some embodiments, before responding to a multimedia communication invitation operation for at least one target account among at least one candidate account, the invitation module 4553 is further configured to: determine the candidate account as at least one target account and display the target account in the selected state when the real-time time zone of the candidate account is in a communicable period and the real-time online status of the candidate account is a communicable state.

[0157] In some embodiments, the second display module 4552 is further configured to: when the multimedia communication is a scheduled multimedia communication, display the time zone and online status of each candidate account at the scheduled time, wherein the scheduled time includes at least one of the following: a scheduled time point; a scheduled time period.

[0158] In some embodiments, when displaying communication reference information for each candidate account, the second display module 4552 is further configured to: when there are multiple candidate accounts, apply differentiated display styles to the communication reference information corresponding to the multiple candidate accounts respectively; wherein, the significance of the display style of the candidate account's time zone corresponding to the appointment time is positively correlated with the time zone difference, and the time zone difference is used to characterize the time difference between the candidate account and the initiating account of the multimedia communication; the significance of the display style of the candidate account's online status corresponding to the appointment time is positively correlated with the status difference, and the status difference is the difference between the online status of the candidate account corresponding to the appointment time and the online status of the initiating account.

[0159] In some embodiments, before displaying the communication reference information for each candidate account, the second display module 4552 is further configured to: obtain the online status of each candidate account at the scheduled time; wherein the online status of each candidate account at the scheduled time is determined in response to the setting operation of the candidate account.

[0160] In some embodiments, before displaying the communication reference information for each candidate account, the second display module 4552 is further configured to: determine the online status of each candidate account at the scheduled time by: obtaining historical schedule information corresponding to multiple sample communication accounts respectively; performing the following processing for each sample communication account: extracting the historical online status of each historical time period from the historical schedule information of the sample communication account; performing statistical processing on the historical online status of multiple communication accounts in each historical time period to obtain the statistical status corresponding to each historical time period; and determining the statistical status corresponding to the historical time period in which the time zone time corresponding to the candidate account at the scheduled time is located as the online status of the candidate account at the scheduled time.

[0161] In some embodiments, before displaying the communication reference information for each candidate account, the second display module 4552 is further configured to: determine the online status of each candidate account at the scheduled time by: obtaining the historical schedule information of the candidate account and the historical schedule information of multiple sample communication accounts; extracting the historical status features of the candidate account from the historical schedule information of the candidate account, and extracting the historical status features of multiple sample communication accounts from the historical schedule information of multiple sample communication accounts; performing a fusion process on the historical status features of the candidate account and the historical status features of multiple sample communication accounts to obtain a fused status feature; and performing a mapping process on the fused status feature to obtain the online status of the candidate account at the scheduled time.

[0162] In some embodiments, before displaying the communication reference information for each candidate account, the second display module 4552 is further configured to: in response to a setting operation for the appointment time of multimedia communication, obtain the time zone time and online status of the candidate account at the appointment time; after displaying the communication reference information for each candidate account, the method further includes: in response to a modification operation of the appointment time of multimedia communication by the initiating account, updating the communication reference information for each candidate account according to the modified appointment time, wherein the updated communication reference information is the communication reference information for each candidate account at the modified appointment time.

[0163] In some embodiments, before responding to a multimedia communication invitation operation for at least one target account among at least one candidate account, the invitation module 4553 is further configured to: determine the candidate account as at least one target account and display the target account in the selected state when the candidate account is in a communicable period in the time zone corresponding to the appointment time and the candidate account is in a communicable online state corresponding to the appointment time.

[0164] In some embodiments, the communication reference information further includes at least one of the following: location information of the candidate account, weather information of the candidate account's location, and schedule information of the candidate account; when the communication reference information includes the location information of the candidate account, the salience of the display style of the communication reference information is positively correlated with distance, where distance is the distance between the geographical location corresponding to the candidate account and the geographical location corresponding to the initiating account; when the communication reference information includes weather information of the candidate account's location, the salience of the display style of the communication reference information is positively correlated with the severity of weather represented by the weather information; when the communication reference information includes the schedule information of the candidate account, the salience of the display style of the communication reference information is positively correlated with the number of schedules represented by the schedule information.

[0165] In some embodiments, before responding to a multimedia communication invitation operation for at least one target account, the invitation module 4553 is further configured to: in response to a selection operation for at least one candidate account, determine the candidate account selected by the selection operation as at least one target account and display the target account in the selected state; or determine the candidate account that meets the automatic selection conditions as at least one target account and display the target account in the selected state.

[0166] In some embodiments, the automatic selection criteria include at least one of the following: the social distance between the candidate account and the initiating account is less than a social distance threshold; the activity level of the candidate account is greater than an activity threshold; and the most recent interaction time between the candidate account and the initiating account is greater than an interaction time threshold.

[0167] In some embodiments, the invitation module 4553 is further configured to: perform the following processing for each candidate account: obtain decision reference data, wherein the decision reference data includes at least one of the following: historical schedule information of the candidate account, multimedia communication setting information, historical communication information of the candidate account, and communication reference information of the candidate account; extract decision reference features from the decision reference data, and predict the probability that the candidate account can respond to multimedia communication based on the decision reference features; when the probability is greater than a probability threshold, determine that the candidate account meets the automatic selection conditions.

[0168] In some embodiments, before sending a multimedia communication invitation message to at least one target account, the invitation module 4553 is further configured to: display a first prompt message when there is a target account that meets the prompt conditions among the at least one target account, the first prompt message indicating that the communication start time of the multimedia communication conflicts with the communication reference information of the target account; and determine to proceed to the process of sending a multimedia communication invitation message to at least one target account in response to a confirmation operation of the first prompt message.

[0169] In some embodiments, the prompting conditions include at least one of the following: at the communication start time, the target account's time zone is in the target account's non-communication period; at the communication start time, the target account's time zone is in the target account's communication period, and the time interval between the target account's time zone and the target account's non-communication period is less than a time interval threshold; at the communication start time, the target account's online status is non-communication status.

[0170] In some embodiments, the invitation module 4553 is further configured to: display the account identifier of each target account and the real-time communication reference information of each target account during multimedia communication, wherein the real-time communication reference information of the target account includes at least one of the following: the real-time time zone of the target account and the real-time online status of the target account corresponding to the real-time time zone; when the real-time online status is a non-communication status, display a second prompt message, wherein the second prompt message is used to prompt the initiating account of the multimedia communication to end the multimedia communication.

[0171] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the multimedia communication processing method described above in this application.

[0172] This application provides a computer-readable storage medium storing executable instructions. When these executable instructions are executed by a processor, they cause the processor to perform the multimedia communication processing method provided in this application. For example, ... Figures 3A-3D The multimedia communication processing method is shown.

[0173] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or it may be a variety of devices including one or any combination of the above-mentioned memories.

[0174] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0175] As an example, executable instructions can be deployed to execute on a single computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed across multiple locations and interconnected via a communication network.

[0176] In summary, by displaying the time zone and online status of each candidate account to the initiating account before inviting a target account from among the candidate accounts for multimedia communication, the initiating account can refer to the time zone and online status of each candidate account when inviting the target account from among the candidate accounts for multimedia communication, thereby improving the success rate of the invitation operation and thus improving the efficiency of human-computer interaction.

[0177] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.

Claims

1. A multimedia communication processing method, characterized in that, The method includes: Display a human-computer interaction interface; wherein, the human-computer interaction interface includes a multimedia communication invitation entry; In response to a trigger operation on the multimedia communication invitation entry, at least one candidate account is displayed; Extract the historical online status of each historical period from the historical schedule information corresponding to multiple sample communication accounts; perform statistical processing on the historical online status of the multiple sample communication accounts in each historical period to obtain the statistical status corresponding to each historical period; The statistical status corresponding to the historical time period of the time zone information is determined as the online status of the candidate account, and the communication reference information of each candidate account is displayed; wherein, the communication reference information includes the time zone information of the candidate account and the online status corresponding to the time zone information; differentiated display styles are applied to the communication reference information corresponding to multiple candidate accounts respectively; when the multimedia communication is scheduled multimedia communication, the time zone time and online status corresponding to the scheduled time of each candidate account are displayed; In response to a multimedia communication invitation operation for at least one target account among the at least one candidate accounts, when there is a target account among the at least one target account that meets the prompting conditions, a first prompt message is displayed, wherein the first prompt message indicates that the communication start time of the multimedia communication conflicts with the communication reference information of the target account; In response to the confirmation operation for the first prompt information, a multimedia communication invitation message is sent to the at least one target account.

2. The method according to claim 1, characterized in that, The display of at least one candidate account includes: When there are multiple candidate accounts, the multiple candidate accounts are displayed in sequence. The order is one of the following: ascending order of social distance between the candidate accounts and the initiating account of the multimedia communication; descending order of activity level of the candidate accounts; or descending order of most recent interaction time between the candidate accounts and the initiating account.

3. The method according to claim 1, characterized in that, Before displaying at least one candidate account, the method further includes: Obtain the candidate accounts that meet at least one of the following conditions: The candidate account is online; The social distance between the candidate account and the initiating account of the multimedia communication is less than the social distance threshold. The activity level of the candidate accounts is greater than the activity threshold; The most recent interaction time between the candidate account and the initiating account is greater than the interaction time threshold. The candidate account and the initiating account are in the same communication connection.

4. The method according to claim 3, characterized in that, When the candidate account and the initiating account are in the same communication connection, displaying at least one candidate account includes: When the communication connection is a communication connection of a target group, at least one communication account in the target group corresponding to the communication connection, excluding the initiating account, is selected as at least one candidate account, and the at least one candidate account is displayed, wherein the initiating account belongs to the target group; or When the communication connection is a communication connection between the target communication account and the initiating account, the target communication account in the communication connection is selected as the candidate account and the candidate account is displayed.

5. The method according to claim 1, characterized in that, The display of communication reference information for each candidate account includes: When the multimedia communication is real-time multimedia communication, communication reference information for each candidate account is displayed. The communication reference information includes the real-time time zone of the candidate account and the real-time online status of the candidate account corresponding to the real-time time zone.

6. The method according to claim 5, characterized in that, The significance of the display style of the real-time time zone of the candidate account is positively correlated with the time zone difference, which is used to characterize the time difference between the candidate account and the initiating account of the multimedia communication. The significance of the display style of the real-time online status is positively correlated with the status difference, which is the difference between the online status of the candidate account and the online status of the initiating account.

7. The method according to claim 5, characterized in that, Before displaying the communication reference information for each of the candidate accounts, the method further includes: Obtain the real-time online status of each candidate account; The real-time online status of each candidate account is determined in response to the setting operation of the candidate account.

8. The method according to claim 5, characterized in that, Before displaying the communication reference information for each of the candidate accounts, the method further includes: The real-time online status of each candidate account is determined by the following method: Obtain the historical schedule information of the candidate accounts and the historical schedule information of multiple sample communication accounts; Extract the historical status features of the candidate accounts from the historical schedule information of the candidate accounts, and extract the historical status features of the multiple sample communication accounts from the historical schedule information of the multiple sample communication accounts; The historical status features of the candidate accounts and the historical status features of the multiple sample communication accounts are fused to obtain fused status features. The fusion status features are mapped to obtain the real-time online status of the candidate account.

9. The method according to claim 5, characterized in that, Prior to responding to a multimedia communication invitation operation for at least one target account among the at least one candidate account, the method further includes: When the real-time time zone of the candidate account is within a communicable period and the real-time online status of the candidate account is communicable, the candidate account is identified as the at least one target account, and the target account in the selected state is displayed.

10. The method according to claim 1, characterized in that, The appointment time includes at least one of the following: appointment time point, appointment time period.

11. The method according to claim 10, characterized in that, The significance of the display style of the candidate account at the time corresponding to the appointment time is positively correlated with the time zone difference, which is used to characterize the time difference between the candidate account and the initiating account of the multimedia communication; the significance of the display style of the online status of the candidate account at the appointment time is positively correlated with the status difference, which is the difference between the online status of the candidate account at the appointment time and the online status of the initiating account.

12. The method according to claim 10, characterized in that, Before displaying the communication reference information for each of the candidate accounts, the method further includes: Obtain the online status of each candidate account at the scheduled appointment time; The online status of each candidate account at the scheduled time is determined in response to the setting operation of the candidate account.

13. The method according to claim 10, characterized in that, Before displaying the communication reference information for each of the candidate accounts, the method further includes: The online status of each candidate account at the scheduled time is determined by the following method: Obtain the historical schedule information of the candidate accounts and the historical schedule information of multiple sample communication accounts; Extract the historical status features of the candidate accounts from the historical schedule information of the candidate accounts, and extract the historical status features of the multiple sample communication accounts from the historical schedule information of the multiple sample communication accounts; The historical status features of the candidate accounts and the historical status features of the multiple sample communication accounts are fused to obtain fused status features. The fusion status features are mapped to obtain the online status of the candidate account at the scheduled time.

14. The method according to claim 10, characterized in that, Before displaying the communication reference information for each of the candidate accounts, the method further includes: In response to the setting operation for the reservation time of the multimedia communication, the time zone time and online status of the candidate account corresponding to the reservation time are obtained; After displaying communication reference information for each of the candidate accounts, the method further includes: In response to the modification operation of the reservation time of the multimedia communication initiated by the account, the communication reference information of each candidate account is updated according to the modified reservation time. The updated communication reference information is the communication reference information of each candidate account at the modified reservation time.

15. The method according to claim 10, characterized in that, Prior to responding to a multimedia communication invitation operation for at least one target account among the at least one candidate account, the method further includes: When the candidate account is in a communicable period in the time zone corresponding to the appointment time, and the candidate account is in a communicable online state corresponding to the appointment time, the candidate account is identified as the at least one target account, and the target account in the selected state is displayed.

16. The method according to any one of claims 5-15, characterized in that, The communication reference information also includes at least one of the following: the location information of the candidate account, the weather information of the location of the candidate account, and the schedule information of the candidate account; When the communication reference information includes the location information of the candidate account, the salience of the display style of the communication reference information is positively correlated with the distance, where the distance is the distance between the geographical location corresponding to the candidate account and the geographical location corresponding to the initiating account; When the communication reference information includes meteorological information about the location of the candidate account, the prominence of the display style of the communication reference information is positively correlated with the severity of the weather represented by the meteorological information; When the communication reference information includes the schedule information of the candidate account, the prominence of the display style of the communication reference information is positively correlated with the number of schedules represented by the schedule information.

17. The method according to claim 1, characterized in that, Prior to responding to a multimedia communication invitation operation for at least one target account among the at least one candidate account, the method further includes: In response to a selection operation for the at least one candidate account, the candidate account selected by the selection operation is determined as the at least one target account, and the target account in the selected state is displayed; or Candidate accounts that meet the automatic selection criteria are identified as at least one target account, and the target accounts in the selected state are displayed.

18. The method according to claim 17, characterized in that, The automatic selection criteria include at least one of the following: The social distance between the candidate account and the initiating account is less than the social distance threshold; The activity level of the candidate accounts is greater than the activity threshold; The most recent interaction time between the candidate account and the initiating account is greater than the interaction time threshold.

19. The method according to claim 17, characterized in that, The method further includes: For each of the candidate accounts, perform the following processing: Obtain decision reference data, wherein the decision reference data includes at least one of the following: historical schedule information of the candidate account, setting information of the multimedia communication, historical communication information of the candidate account, and communication reference information of the candidate account; Decision reference features are extracted from the decision reference data, and the probability that the candidate account can respond to the multimedia communication is predicted based on the decision reference features. When the probability is greater than the probability threshold, the candidate account is determined to meet the automatic selection condition.

20. The method according to claim 1, characterized in that, Before sending the multimedia communication invitation message to the at least one target account, the method further includes: When there is a target account that meets the prompting conditions among the at least one target account, a first prompt message is displayed, the first prompt message indicating that the communication start time of the multimedia communication conflicts with the communication reference information of the target account; In response to the confirmation operation of the first prompt information, the process is determined to proceed to sending a multimedia communication invitation message to the at least one target account.

21. The method according to claim 20, characterized in that, The prompting conditions include at least one of the following: At the start time of the communication, the time zone of the target account is within the non-communication period of the target account; At the communication start time, the time zone of the target account is within the communication period of the target account, and the time interval between the time zone of the target account and the non-communication period of the target account is less than the time interval threshold. At the start time of the communication, the target account is in a non-communication state.

22. The method according to claim 1, characterized in that, The method further includes: During the multimedia communication process, the account identifier of each target account and the real-time communication reference information of each target account are displayed. The real-time communication reference information of the target account includes at least one of the following: the real-time time zone of the target account and the real-time online status of the target account corresponding to the real-time time zone. When the real-time online status is a non-communication status, a second prompt message is displayed. The second prompt message is used to prompt the account that initiated the multimedia communication to end the multimedia communication.

23. A multimedia communication processing device, characterized in that, The device includes: The first display module is used to display the human-computer interaction interface; wherein, the human-computer interaction interface includes a multimedia communication invitation entry; The second display module is configured to respond to a trigger operation on the multimedia communication invitation entry by displaying at least one candidate account; extracting the historical online status of each historical time period from the historical schedule information corresponding to multiple sample communication accounts; performing statistical processing on the historical online status of the multiple sample communication accounts in each historical time period to obtain the statistical status corresponding to each historical time period; determining the statistical status corresponding to the historical time period in which the time zone information is located as the online status of the candidate account, and displaying the communication reference information of each candidate account; wherein, the communication reference information includes the time zone information of the candidate account and the online status corresponding to the time zone information; applying differentiated display styles to the communication reference information corresponding to the multiple candidate accounts respectively; when the multimedia communication is scheduled multimedia communication, displaying the time zone time and online status corresponding to the scheduled time for each candidate account; The invitation module is used to respond to a multimedia communication invitation operation for at least one target account among the at least one candidate accounts. When there is a target account among the at least one target account that meets the prompt conditions, a first prompt message is displayed, the first prompt message indicating that the communication start time of the multimedia communication conflicts with the communication reference information of the target account; in response to a confirmation operation for the first prompt message, a multimedia communication invitation message is sent to the at least one target account.

24. The apparatus according to claim 23, characterized in that, The second display module is further configured to display multiple candidate accounts in sequence when the number of the at least one candidate account is multiple; The order is one of the following: ascending order of social distance between the candidate accounts and the initiating account of the multimedia communication; descending order of activity level of the candidate accounts; or descending order of most recent interaction time between the candidate accounts and the initiating account.

25. The apparatus according to claim 23, characterized in that, The second display module is further configured to obtain candidate accounts that satisfy at least one of the following conditions: The candidate account is online; The social distance between the candidate account and the initiating account of the multimedia communication is less than the social distance threshold. The activity level of the candidate accounts is greater than the activity threshold; The most recent interaction time between the candidate account and the initiating account is greater than the interaction time threshold. The candidate account and the initiating account are in the same communication connection.

26. An electronic device, characterized in that, include: Memory, used to store executable instructions; A processor, when executing executable instructions stored in the memory, implements the multimedia communication processing method according to any one of claims 1 to 22.

27. A computer-readable storage medium, characterized in that, It stores executable instructions for use by a processor to implement the multimedia communication processing method according to any one of claims 1 to 22.

28. A computer program product comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by the processor, they implement the multimedia communication processing method according to any one of claims 1 to 22.

Images