Information transmission and reception processing method, device, and equipment, and program product
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- TENCENT TECHNOLOGY (SHENZHEN) CO LTD
- Filing Date
- 2022-04-27
- Publication Date
- 2026-08-07
AI Technical Summary
[0003]相关技术中会选中多个信息后,针对每个信息单独形成一个消息发送给对方,虽然针对发送方而言并不存在较多的交互负担,但是会造成多个消息的刷屏效果,浪费了发送与接收双方的显示资源,并且导致消息发送与接收的效率较低,
[0045]针对发送多条目标信息场景,支持发送对象根据实际需求选择依次发送或合并发送的模式,能够适用多样化的信息发送场景,且无需进行复杂的编辑,从而提高人机交互效率,当合并发送时通过信息位能够直观地在合并消息中展示多条目标信息,有效提高信息感知的效率。
Smart Images

Figure CN117032533B_ABST
Abstract
Description
Technical Field
[0001] This application relates to message sending and receiving technology, and more particularly to an information sending and processing method, an information receiving and processing method, an apparatus, an electronic device, a computer-readable storage medium, and a computer program product. Background Technology
[0002] With the development of internet technology, more and more people are chatting and communicating through social networks. During the chat, they share various types of information, such as text messages, image messages, emoticons, video messages, audio messages, etc., and at some point in the communication process, they may want to share multiple pieces of information with the other party.
[0003] In related technologies, multiple pieces of information are selected, and each piece of information is sent as a separate message to the other party. Although this does not impose a significant interactive burden on the sender, it results in multiple messages flooding the screen, wasting display resources for both the sender and receiver, and leading to low efficiency in message sending and receiving. Summary of the Invention
[0004] This application provides an information sending and processing method, an information receiving and processing method, an apparatus, an electronic device, a computer-readable storage medium, and a computer program product, which can be applied to diverse information sending scenarios and do not require complex editing, thereby improving human-computer interaction efficiency. At the same time, by merging messages to display multiple target information, the efficiency of information perception is effectively improved.
[0005] The technical solution of this application embodiment is implemented as follows:
[0006] This application provides an information sending processing method, including:
[0007] Display multiple candidate messages, and select N target messages from the multiple candidate messages, where N is an integer greater than or equal to 2;
[0008] In response to the sending operation of the N target messages one by one, N messages are displayed in the social interface, wherein each of the N messages carries one target message, and each of the N messages carries different target messages;
[0009] In response to the merged sending operation for the N target messages, a merged message obtained by merging the N target messages is displayed in the social interface, wherein the merged message includes the N target messages and at least one information bit, and one target message is displayed in each of the information bits.
[0010] This application provides an information transmission processing apparatus, including:
[0011] The first display module is used to display multiple candidate information and select N target information from the multiple candidate information, wherein N is an integer greater than or equal to 2;
[0012] The sending module is used to respond to the sending operation of the N target messages one by one, and to display the N messages in the social interface. Each of the N messages carries one target message, and each of the N messages carries different target messages.
[0013] The sending module is further configured to respond to the merging and sending operation of the N target information by displaying a merged message obtained by merging the N target information in the social interface, wherein the merged message includes the N target information and at least one information bit, and one target information is displayed on each information bit.
[0014] In the above scheme, the first display module is further configured to: perform at least one of the following: in response to the selection operation for the plurality of candidate information, display the selected N target information among the plurality of candidate information as the selected state; determine the N candidate information operated on in the most recent set time period as target information and display it as the selected state; obtain the correlation degree between each candidate information and the receiving object of the N target information, sort the plurality of candidate information in descending order based on the correlation degree, take the N candidate information with the highest sort order as the selected N target information, and display the N target information as the selected state.
[0015] In the above scheme, the first display module is further configured to: acquire historical information data of historically sent information, object data of the sending account, and candidate information data for each candidate piece of information; perform the following processing on each candidate piece of information: perform convolution processing based on convolutional layer parameters on the historical information data, the object data, and the candidate information data through the convolutional layer of the first neural network to obtain historical information features, object features, and candidate information features; perform fusion processing based on pooling layer parameters on the historical information features, the object features, and the candidate information features through the pooling layer of the first neural network to obtain fused features; perform mapping processing based on fully connected layer parameters on the fused features through the fully connected layer of the first neural network to obtain the selection probability of the candidate information, wherein the selection probability represents the probability that the candidate information is selected by the sending account; perform descending sorting processing on the multiple candidate pieces of information based on the selection probability, take the top N candidate pieces of information as the N target pieces of information to be automatically selected, and display the N target pieces of information as selected.
[0016] In the above scheme, the first display module is further configured to: sort all the information stored in the sending account based on a specific dimension, and display the top-ranked information as candidate information; wherein, all the information is stored in at least one of the following: the terminal device associated with the sending account, the network storage device associated with the sending account, and the specific dimension includes: recent usage time, usage frequency, creation time, and file size.
[0017] In the above scheme, the sending module is further configured to: display a merge sending mode control, wherein the merge sending mode control is used to switch between an on state and a off state when triggered, the on state indicating that the merge sending mode is enabled, and the off state indicating that the merge sending mode is disabled; display a sending control; in response to the merge sending mode control being in the on state and receiving a trigger operation for the sending control, identify the trigger operation as a merge sending operation for the N target messages, and display a merged message obtained by merging the N target messages in the social interface.
[0018] In the above scheme, the sending module is further configured to: display a merged sending mode control, wherein the merged sending mode control is used to switch between an on state and a off state when triggered, the on state indicating that the merged sending mode is enabled, and the off state indicating that the merged sending mode is disabled; display a sending control; in response to the merged sending mode control being in the off state and receiving a trigger operation for the sending control, identify the trigger operation as a sequential sending operation for the N target messages, and display the N messages in the social interface.
[0019] In the above scheme, when the merged message includes multiple information bits, the sending module is further configured to: display one piece of target information in each of the information bits, wherein the target information displayed in different information bits is different; when the number of the multiple information bits is less than N, display the number of undisplayed target information in any one of the information bits, wherein the undisplayed target information refers to the target information that is not displayed in the information bit.
[0020] In the above scheme, the filling priority of the information bits is positively correlated with the first feature parameter of the target information. The first feature parameter includes at least one of the following: the usage frequency of the target information, the storage time of the target information, the most recent transmission time of the target information, and the correlation between the target information and the recipient of the target information.
[0021] In the above scheme, when the merged message includes multiple information bits, the sending module is further configured to: display the target information of different information types in the multiple information bits respectively; when the number of information bits is less than the number of information types, append the number of undisplayed target information to any information bit; when the number of information bits is equal to the number of information types, append the number to the information bit with multiple target information, wherein the number refers to the count of undisplayed target information belonging to the information type, and the undisplayed target information refers to the target information not displayed in the information bit.
[0022] In the above scheme, when the merged message includes multiple information bits, and the number of the multiple information bits is greater than the number of information types, the sending module is further configured to: when the number of information types is one, display one target information belonging to the information type in the multiple information bits, wherein the target information displayed in different information bits is different; when the number of information types is multiple, display one target information in each information bit, wherein the type of the displayed target information covers all information types to which the N target information belong, and the displayed target information is the target information displayed in the information bit; when there is undisplayed target information, additionally display the number of undisplayed target information belonging to the same information type on the information bit of the displayed target information belonging to the same information type as the undisplayed target information, wherein the undisplayed target information refers to the target information not displayed in the information bit.
[0023] In the above scheme, when the merged message includes multiple information bits, the sending module is further configured to: display one piece of target information in each information bit, and the target information displayed in different information bits is different, wherein the information bits of target information belonging to the same information type are adjacent; when there is undisplayed target information belonging to the displayed information type, the number of undisplayed target information belonging to the displayed information type is additionally displayed in any information bit corresponding to the displayed information type; when there is undisplayed target information not belonging to the displayed information type, the number of undisplayed target information not belonging to the displayed information type is additionally displayed in any information bit; wherein the undisplayed target information refers to the target information not displayed in the information bit, the displayed target information is the target information displayed in the information bit, and the displayed information type is the information type to which the displayed target information belongs.
[0024] In the above scheme, when the number of information bits is one, the sending module is further configured to: display the target information with the highest correlation to the receiving object among the N target information in the information bit; and append the number of undisplayed target information to the information bit, wherein the undisplayed target information refers to the target information that is not displayed in the information bit.
[0025] In the above scheme, before displaying the sent merged message, the sending module is further configured to: obtain the information features of each of the target information; obtain the object features of the receiving objects of the N target information; determine the correlation between the information features of each target information and the object features; fill the target information with the highest correlation into the merged message template including the information bit; bind the target information among the N target information that has not been filled into the merged message template to the merged message template; and use the merged message template that has been filled and bound as the merged message.
[0026] In the above scheme, after displaying a merged message obtained by merging the N target information in the social interface, the sending module is further configured to: in response to a pressing operation on any one of the information bits, enlarge the target information in the information bit during the continuous pressing operation; and in response to releasing the pressing operation, restore the enlarged target information to a size matching the information bit.
[0027] In the above scheme, after displaying a merged message obtained by merging the N target information in the social interface, the sending module is further configured to: in response to a click operation on any information position, display the target information corresponding to the arbitrary information position in the information viewing interface; in response to a swipe operation on the target information corresponding to the information position, display the previous or next target information according to the direction of the swipe operation.
[0028] In the above scheme, when the merged message includes multiple information bits, and different types of target information are displayed in the multiple information bits respectively, after the merged message obtained by merging the N target information is displayed in the social interface, the sending module is further configured to: in response to a click operation on any information bit, display the target information corresponding to the arbitrary information bit in the information viewing interface; when there are other target information with the same information type as the target information corresponding to the arbitrary information bit among the N target information, in response to a swipe operation on the target information corresponding to the arbitrary information bit, display the other target information in the information viewing interface.
[0029] In the above scheme, the sending module is further configured to: when the target information displayed in any information bit is video, in response to a click operation on the any information bit, play the video in the any information bit or play the video in the information viewing interface; when the target information displayed in any information bit is image, in response to a click operation on the any information bit, display the image in the information viewing interface; when the target information displayed in any information bit is audio, in response to a click operation on the any information bit, play the audio in the any information bit or play the audio in the information viewing interface.
[0030] In the above scheme, after displaying the target information corresponding to the information position in the social interface, the sending module is further configured to: in response to a character input operation for any target information, display comment information for commenting on the any target information in the character input interface; in response to a sending operation for the comment information in the character input interface, perform any of the following processes: display a comment message independent of the merged message in the social interface, wherein the comment message includes the any target information and the comment information; display a comment message independent of the merged message in the social interface, wherein the comment message includes the N target information and the at least one information position, with one target information displayed in each information position, and the comment information appended to the any target information.
[0031] This application provides an information receiving and processing method, including:
[0032] A preview image of the merged message is displayed in the social interface, and a download control corresponding to the merged message is also displayed in the social interface;
[0033] The merged message includes N target information items and at least one information bit, and one target information item is displayed on each information bit, where N is an integer greater than or equal to 2;
[0034] In response to a trigger operation on the download control, at least a portion of the target information from the N target information items is downloaded.
[0035] The download progress of at least a portion of the target information is displayed in the social interface.
[0036] This application provides an information receiving and processing apparatus, including:
[0037] The second display module is used to display a preview image of the merged message in the social interface, and to display a download control corresponding to the merged message in the social interface;
[0038] The merged message includes N target information items and at least one information bit, and one target information item is displayed on each information bit;
[0039] The download module is configured to, in response to a trigger operation on the download control, download at least a portion of the target information from the N target information items, and display the download progress of the at least a portion of the target information in the social interface.
[0040] This application provides an electronic device, including:
[0041] Memory, used to store executable instructions;
[0042] A processor, when executing executable instructions stored in the memory, implements the method provided in the embodiments of this application.
[0043] This application provides a computer-readable storage medium storing executable instructions for inducing a processor to execute and implement the method provided in this application.
[0044] The embodiments of this application have the following beneficial effects:
[0045] For scenarios involving sending multiple target messages, the system supports sending the message sequentially or in a merged manner based on actual needs. This makes it suitable for diverse information sending scenarios without requiring complex editing, thereby improving human-computer interaction efficiency. When sending messages in a merged manner, multiple target messages can be intuitively displayed in the merged message through information bits, effectively improving the efficiency of information perception. Attached Figure Description
[0046] Figure 1 This is a schematic diagram of the structure of the information processing system provided in the embodiments of this application;
[0047] Figure 2 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;
[0048] Figures 3A-3B This is a flowchart illustrating the information sending and processing method provided in an embodiment of this application;
[0049] Figure 3C This is a flowchart illustrating the information receiving and processing method provided in an embodiment of this application;
[0050] Figures 4A-4E This is a schematic diagram of the interface provided in an embodiment of this application;
[0051] Figures 5A-5D This is a schematic diagram of the interface provided in an embodiment of this application;
[0052] Figure 6 This is a schematic diagram of the sending process of the information sending and processing method provided in the embodiments of this application;
[0053] Figure 7 This is a schematic diagram of the message structure of the merged message provided in an embodiment of this application;
[0054] Figure 8 This is a schematic diagram of the interaction process provided in the embodiments of this application;
[0055] Figure 9 This is a schematic diagram of the interface provided in an embodiment of this application;
[0056] Figure 10 This is a schematic diagram of the interaction process provided in the embodiments of this application;
[0057] Figure 11 This is a logic diagram provided in an embodiment of this application;
[0058] Figure 12 This is a schematic diagram of the interface provided in an embodiment of this application;
[0059] Figure 13 This is a schematic diagram of the interface provided in an embodiment of this application;
[0060] Figure 14 This is a schematic diagram of the interface provided in the embodiments of this application;
[0061] Figures 15A-15C This is a schematic diagram of the merged message template provided in an embodiment of this application;
[0062] Figure 16 This is a flowchart provided in an embodiment of this application. Detailed Implementation
[0063] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0064] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0065] In the following description, the terms "first, second, third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.
[0066] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.
[0067] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.
[0068] 1) Rich Media: Translated from the English word "Rich Media", it includes interactive information dissemination media such as animation, sound, video, and images. Rich media can be applied to various online services.
[0069] 2) In response, used to indicate the conditions or states on which the operation performed depends. When the conditions or states on which it depends are met, one or more operations performed may be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.
[0070] In related technologies, multiple pieces of information are selected, and each piece of information is sent as a separate message to the other party. See [link to relevant documentation]. Figure 4B , Figure 4B This is a schematic diagram of the interface provided in the embodiment of this application. The album interface 401B displays multiple images 402B, and the selected image 402B is marked with a selection mark 403B. The album interface 401B also displays a sending control 404B. In response to the trigger operation of the sending control 404B, multiple image messages 405B sent to the receiving object are displayed in the album interface 401B. When multiple images need to be sent, multiple images will be sent in sequence, and multiple image messages will be displayed in the social interface. Although there is not much interactive burden for the sender, it will cause multiple messages to flood the screen, wasting the display resources of both the sender and the receiver, and resulting in low efficiency of message sending and receiving, inconvenient downloading, and slow information transmission speed.
[0071] To address the aforementioned technical problems, embodiments of this application provide an information sending and receiving processing method, an information receiving and receiving processing method, an apparatus, an electronic device, a computer-readable storage medium, and a computer program product, which can improve the efficiency of message sending and receiving.
[0072] The following describes exemplary applications of the electronic devices provided in the embodiments of this application. The electronic devices provided in the embodiments of this application can be implemented as various types of user terminals such as laptops, tablets, desktop computers, set-top boxes, mobile devices (e.g., mobile phones, portable music players, personal digital assistants, dedicated information devices, portable gaming devices), intelligent voice interaction devices, smart home appliances, vehicle terminals, aircraft, etc.
[0073] See Figure 1 , Figure 1 This is a schematic diagram of the structure of the information processing system provided in the embodiment of this application. In order to support a social application, the terminal (terminal 400-1 and terminal 400-2 are shown as examples) connects to the server 200 through the network 300. The network 300 can be a wide area network or a local area network, or a combination of the two.
[0074] In some embodiments, terminal 400-1, which sends an account, receives a message sending operation for multiple target messages one by one, and sends multiple target messages sequentially to terminal 400-2, which receives an account, through server 200. The sent target messages are displayed sequentially on the social interface of terminal 400-1, and the received target messages (or preview images of the target messages) are displayed sequentially on the social interface of terminal 400-2. Terminal 400-1, which sends an account, receives a message sending multiple target messages in a merged manner, and sends multiple target messages to terminal 400-2, which receives an account, through server 200. The merged message containing multiple target messages is displayed on terminal 400-1, and a preview image of the merged message is displayed on terminal 400-2. Terminal 400-2 receives a batch download operation and displays the download progress of the multiple target messages in the merged message on terminal 400-2.
[0075] In some embodiments, the terminal or server can implement the information processing method provided in this application by running a computer program. For example, the computer program can be a native program or software module in an operating system; it can be a native application (APP), that is, a program that needs to be installed in the operating system to run, such as an instant messaging client, video conferencing client, or social networking client; it can also be a mini-program, that is, a program that only needs to be downloaded to a browser environment to run; or it can be a mini-program that can be embedded in any APP. In short, the above-mentioned computer program can be any form of application, module, or plugin.
[0076] The embodiments of this application can be implemented with the help of cloud technology, which refers to a hosting technology that unifies a series of resources such as hardware, software, and networks within a wide area network or local area network to realize the computation, storage, processing, and sharing of data.
[0077] Cloud technology is a general term encompassing network technology, information technology, integration technology, management platform technology, and application technology based on the cloud computing business model. It can form resource pools, allowing for on-demand use with flexibility and convenience. Cloud computing technology will become a crucial support. The backend services of cloud computing systems require substantial computing and storage resources.
[0078] As an example, server 200 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Terminal 400-1 can be a smartphone, tablet, laptop, desktop computer, smart speaker, smartwatch, in-vehicle terminal, etc., but is not limited to these. Terminal 400-1 and server 200 can be directly or indirectly connected via wired or wireless communication, which is not limited in this embodiment.
[0079] See Figure 2 , Figure 2 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Figure 2 The terminal shown includes at least one processor 410, a memory 450, at least one network interface 420, and a user interface 430. The various components in terminal 400-1 are coupled together via a bus system 440. It is understood that the bus system 440 is used to implement communication between these components. In addition to a data bus, the bus system 440 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in… Figure 2 The general labeled all buses as Bus System 440.
[0080] The processor 410 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc.
[0081] User interface 430 includes one or more output devices 431 that enable the presentation of media content, including one or more speakers and / or one or more visual displays. User interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.
[0082] The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state storage, hard disk drives, optical disk drives, etc. The memory 450 may optionally include one or more storage devices physically located away from the processor 410.
[0083] The memory 450 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 450 described in this application embodiment is intended to include any suitable type of memory.
[0084] In some embodiments, memory 450 is capable of storing data to support various operations, examples of which include programs, modules, and data structures or subsets or supersets thereof, as illustrated below.
[0085] Operating system 451 includes system programs for handling various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic business functions and handling hardware-based tasks;
[0086] The network communication module 452 is used to reach other computing devices via one or more (wired or wireless) network interfaces 420, exemplary network interfaces 420 including: Bluetooth, WiFi, and Universal Serial Bus (USB), etc.
[0087] Presentation module 453 is configured to enable the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 431 (e.g., a display screen, a speaker, etc.) associated with user interface 430;
[0088] The input processing module 454 is used to detect and translate one or more user inputs or interactions from one or more input devices 432.
[0089] In some embodiments, the information transmission and processing apparatus provided in this application can be implemented in software. Figure 2 An information transmission and processing device 455-1 stored in memory 450 is shown. This device can be software in the form of programs and plug-ins, and includes the following software modules: a first display module 4551 and a transmission module 4553. Figure 2 Also shown is an information receiving and processing device 455-2 stored in memory 450, which can be software in the form of programs and plug-ins, including the following software modules: a second display module 4554 and a download module 4555. These modules are logically linked and can therefore be arbitrarily combined or further separated according to the functions they implement. The functions of each module will be described below.
[0090] The information sending and processing method provided in this application will be described in conjunction with exemplary applications and implementations of the terminals provided in the embodiments of this application.
[0091] See Figure 3A , Figure 3A This is a flowchart illustrating the information sending and processing method provided in the embodiments of this application, which will be combined with... Figure 3A Steps 101 to 104 are described below.
[0092] In step 101, multiple candidate messages are displayed.
[0093] As an example, candidate information can originate from the device's local storage or a cloud server. For instance, candidate information can come from the device's local photo album, notes, calendar, etc. See [link to relevant documentation]. Figure 4A The album interface 401A displays multiple images 402A, which are candidate information sourced from the local album on the terminal.
[0094] In step 102, N target information items from the multiple candidate information items are displayed as selected.
[0095] As an example, N is an integer greater than or equal to 2, and N is not greater than the number of candidate messages. See [link to relevant documentation]. Figure 4A The selected image 402A is marked with a selection mark 403A. The selection process can be manual or automatic, and the selected image 402A is used as the target information.
[0096] In step 103, in response to the message sending operation for each of the N target messages, N messages are displayed in the social interface.
[0097] As an example, each of the N messages carries a different target information. After selecting N target information in batches, N messages corresponding one-to-one with the N target information are generated, and the N messages are sent one by one to the receiving object. See [link to example]. Figure 4A The album interface 401A also displays a send control 404A. In response to the trigger operation of the send control 404A, multiple image messages 405A sent to the receiving object are displayed in the album interface 401A. The image message 405A includes an image 402A as the target information.
[0098] In step 104, in response to the merge sending operation for N target messages, a merged message obtained by merging the N target messages is displayed in the social interface.
[0099] As an example, the merged message includes N target messages and at least one information bit, with one target message displayed in each information bit. See also Figure 4E The album interface 401E displays a merge control 402E. In response to a trigger operation on the merge control 402E, a selection mark is displayed on the merge control 402E, indicating that the merge mode is enabled. In response to a trigger operation on the send control 404E, a merged message 405E sent to the recipient is displayed in the social interface 401E. The merged message carries N target information items and includes at least one information bit. Since the number of information bits is limited, when the number of target information items is greater than the number of information bits, some target information items will not be displayed in the merged message.
[0100] As an example, the number of merged messages can be multiple or one. When the number of N target information items is greater than the threshold, the number of merged messages and the target information included in each merged message are determined based on the number of N target information items. That is, the N target information items are divided into multiple merged messages, and the target information carried by each merged message is different. For example, if 100 target information items are selected in batches, and the threshold for the number of target information items carried by each merged message is 20, then 5 merged messages need to be generated, and each merged message carries 20 target information items. Alternatively, regardless of the number of target information items selected in batches, one merged message is used to carry the target information selected in batches.
[0101] In some embodiments, displaying N target information items from multiple candidate information items as selected in step 102 can be achieved through the following technical solution: In response to a selection operation on multiple candidate information items, displaying the N selected target information items from the multiple candidate information items as selected. Manual selection ensures that the target information perfectly matches the user's expectations, improving the efficiency of human-computer interaction.
[0102] As an example, see Figure 4A The album interface 401A displays multiple images 402A. Images 402A are candidate information, which come from the local album of the terminal. In response to the selection operation of image 402A, a selection mark 403A is added to the selected image 402A, and the selected image 402A is used as the target information.
[0103] In some embodiments, displaying the corresponding selection markers for the N selected target information items among multiple candidate information items in step 102 can be achieved through the following technical solutions: performing any one of the following processes: determining the N candidate information items that have been operated on in the most recent set time period as target information items and displaying them as selected items, wherein the operation type includes: storage, editing, and sending; obtaining the correlation degree between each candidate information item and the receiving object of the N target information items, sorting the multiple candidate information items in descending order based on the correlation degree, and selecting the top N candidate information items as the N selected target information items, and displaying the N target information items as selected items. Automating the selection process can improve user operation efficiency, thereby improving human-computer interaction efficiency.
[0104] As an example, it is understood that in the embodiments of this application, data related to operation data, correlation, etc., when the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0105] As an example, the most recently set time period is a pre-configured time period, such as a time period of 1 day prior to the current time, or a time period of 5 hours prior to the current time. The candidate information of the sending account operation of the target object within the most recently set time period stored on the terminal or in the cloud is used as the target information, and the corresponding selection mark is displayed. For example, the candidate information stored, edited, and sent within the time period of 5 hours prior to the current time. The types of candidate information include at least one of the following: video information, image information, text information, audio information, emoticon information, etc.
[0106] As an example, determine the relevance between each candidate message and the receiving object. For example, if the receiving object is A, candidate message 1 is a photo of a person in receiving object A, and candidate message 2 is a landscape photo, it can be seen that the relevance between candidate message 1 and receiving object A is higher than that between candidate message 2 and receiving object B. Based on the relevance, sort the multiple candidate messages in descending order, and select the top-ranked candidate messages as the selected target messages. For example, select candidate message 1 as the selected target message and display the corresponding selection mark.
[0107] In some embodiments, displaying N target messages from multiple candidate messages as selected in step 102 can be achieved through the following technical solution: Acquiring historical information data of previously sent messages, object data of the sending account, and candidate information data for each candidate message. Historical information refers to messages previously sent by the sending account, and includes information type, sending time, sending scenario, information source, etc. The sending account is the account of the sending object, and the candidate information data includes information type, information source, etc. For each candidate message, the following processing is performed: Convolution processing based on convolutional layer parameters is applied to the historical information data, object data, and candidate information data through the convolutional layer of the first neural network to obtain historical information features, object features, and candidate information features. The convolutional layer parameters are obtained by training the first neural network. The convolutional layer parameters can be used to map discrete data into dense vector data. The pooling layer of the first neural network fuses historical information features, object features, and candidate information features based on the pooling layer parameters, resulting in fused features. These pooling layer parameters, obtained during training of the first neural network, represent the fusion weights of each feature. The fully connected layer of the first neural network then maps the fused features based on its parameters, yielding the selection probability of candidate information. This selection probability represents the probability that a candidate will be selected by the sending account. The fully connected layer parameters, also obtained during training of the first neural network, are then used to sort the candidate information in descending order based on their selection probabilities. The top N candidate information are then automatically selected as the N target information pieces, and these N target information pieces are displayed as selected. This first neural network model improves the accuracy and speed of target information selection, enhancing the efficiency of human-computer interaction.
[0108] As an example, it is understood that in the embodiments of this application, which involve historical information data, object data, and other related data, when the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions.
[0109] As an example, sample historical information data (from sample historical sending information), sample object data (from sample sending account), and sample candidate information data (from sample candidate information) are used as sample data. Sample historical sending information is information sent before sending sample candidate information. The first neural network model is trained based on the sample data. The sample data is forward propagated in the first neural network model. Forward propagation refers to the process of calculating sequentially according to the calculation order of each structure of the first neural network model. Specifically, the forward propagation process includes the sequential processing of the above-mentioned convolutional layer, pooling layer, and fully connected layer. Forward propagation obtains the predicted selection probability of sample candidate information. When sample candidate information is selected for sending, the label value of sample candidate information is 1. When sample candidate information is not selected for sending, the label value of sample candidate information is 0. The error between the predicted selection probability and the label value is determined. The error is backpropagated in the first neural network model to update the parameters of the first neural network model, that is, to update the parameters of the convolutional layer, pooling layer, and fully connected layer. When the error converges, backpropagation and parameter update stop, and the parameters obtained from the last update are used as the parameters of the trained first neural network model.
[0110] In some embodiments, displaying multiple candidate information items in step 101 can be achieved through the following technical solution: sorting all information stored by the sending account based on a specific dimension, and displaying the top-ranked information items as candidate information; wherein all information is stored in at least one of the following: the terminal device associated with the sending account, or the network storage device associated with the sending account; the specific dimensions include: recent usage time, usage frequency, creation time, and file size. Intelligent display of candidate information can reduce the difficulty for users to select target information and narrow the selection range, thereby improving human-computer interaction efficiency.
[0111] As an example, it is understood that in the embodiments of this application, data related to recent usage time, usage frequency, creation time, file size, etc. are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0112] As an example, multiple candidate pieces of information that need to be displayed can be determined intelligently, and all information can be sorted according to specific dimensions. Different sorting methods can be adopted for different specific dimensions. For example, when the specific dimensions include recent usage time, usage frequency, and creation time, the sorting method is descending order. When the specific dimension is file size, the sorting method is ascending order. The top-ranked information is then used as candidate information for display.
[0113] In some embodiments, see Figure 3B , Figure 3B This is a flowchart illustrating the information receiving and processing method provided in this application embodiment. In step 104, in response to the merging and sending operation for N target messages, a merged message obtained by merging the N target messages is displayed in the social interface. Figure 3B Steps 1041 to 1043 are implemented.
[0114] In step 1041, the merged transmission mode control is displayed.
[0115] As an example, the merged sending mode control is used to switch between an on and off state when triggered. The on state indicates that the merged sending mode is enabled, and the off state indicates that the merged sending mode is disabled.
[0116] In step 1042, the send control is displayed.
[0117] In step 1043, in response to the merge sending mode control being in the open state and a trigger operation for the sending control being received, the trigger operation is identified as a merge sending operation for N target messages, and a merged message obtained by merging N target messages is displayed in the social interface.
[0118] The sending object can freely trigger sequential or merged sending, providing the sending object with the ability to freely choose the sending method, thus improving the efficiency of human-computer interaction.
[0119] As an example, see Figure 4E The album interface 401E displays a merge control 402E. In response to a trigger operation on the merge control 402E, a selection mark is displayed on the merge control 402E, indicating that the merge mode is enabled. In response to a trigger operation on the send control 404E, a merged message 405E sent to the recipient is displayed in the social interface 401E.
[0120] In some embodiments, the display of N messages in the social interface in step 103 in response to the sequential sending operation for N target messages can be achieved through the following technical solution: displaying a merge sending mode control, wherein the merge sending mode control is used to switch between an on state and a off state when triggered, the on state indicating that the merge sending mode is enabled, and the off state indicating that the merge sending mode is disabled; displaying a sending control; in response to the merge sending mode control being in the off state and receiving a trigger operation for the sending control, the trigger operation is identified as a sequential sending operation for N target messages, and N messages are displayed in the social interface. The sending object can freely trigger sequential sending and merge sending, providing the sending object with the function of freely choosing the sending method, improving the efficiency of human-computer interaction.
[0121] As an example, see Figure 4A The album interface 401A displays a merge control 406A. The merge control 406A does not display a selection mark, indicating that the merge sending mode is in the off state. In response to the trigger operation of the sending control 404A, multiple image messages 405A sent to the receiving object are displayed in the social interface. Each image message 405A includes an image 402A as the target information.
[0122] In some embodiments, when the merged message includes multiple information bits, the step 104 of displaying a merged message obtained by merging N target information in the social interface can be achieved by the following technical solution: displaying one target information in each information bit, wherein the target information displayed in different information bits is different; when the number of multiple information bits is less than N, displaying the number of undisplayed target information in any information bit, wherein the undisplayed target information refers to the target information that is not displayed in the information bit.
[0123] As an example, there are two relationships between the number of information bits and the number of target information: first, the number of information bits is insufficient to fully display N target information; second, multiple information bits are sufficient to fully display N target information, that is, the number of information bits is greater than or equal to the number of target information.
[0124] As an example, to obtain the merge message template, see [link / reference]. Figures 15A-15CThere are multiple candidate merged message templates. Typically, the number of information bits obtained is the same as the number of target information bits. The merged message template includes information bits to be filled, the first feature parameters of N target information bits, and the filling priority of each information bit. For example, if the merged message template includes 4 information bits, the filling priority of each information bit is positively correlated with its ability to attract user attention. For instance, if information bit A is in the center and information bit B is in the lower left corner, then the filling priority of information bit A is higher than that of information bit B. The first feature parameters include at least one of the following: the usage frequency of the target information, the storage time of the target information (storage time refers to the time the target information was stored), the most recent sending time of the target information (the most recent sending time refers to the time with the smallest distance from the current time), and the correlation between the target information and its recipient (correlation refers to the degree of association between the content of the target information and the recipient). The N target information bits are sorted in descending order of their first feature parameters. For each target information bit, the following processing is performed: for example, if the usage frequency of target information 1 is higher than that of target information 2, then target information 1 is filled first, followed by target information 2. When information bit A... When neither information bit B nor the target information 1 is filled, the target information 1 is filled into the highest priority information bit A among the unfilled information bits. Then, the target information 2 is filled into the highest priority information bit B among the unfilled information bits. In addition to filling according to priority, random filling is also possible. When all information bits in the merged message template are filled, and there are still some target information bits that have not been filled into the merged message template, the number of information bits is insufficient to fully display N target information bits. Therefore, it is necessary to fill the blank spaces on the merged message template with the number of undisplayed target information bits, so that the merged message can be displayed in the social interface based on the filled merged message template.
[0125] In some embodiments, when the merged message includes multiple information bits, the step 104 of displaying a merged message obtained by merging N target information in the social interface can be achieved through the following technical solutions: Displaying target information of different information types in multiple information bits, where the priority of the information bits is negatively correlated with the download traffic of the information type; when the number of information bits is less than the number of information types, appending the number of undisplayed target information to any information bit, for example, if the number of information bits is 2, the number of information types is 3, and the number of target information is 3, displaying video information 1 in information bit A, image information 1 in information bit B, and displaying the number of undisplayed target information 1 in information bit A or information bit B; when the number of information bits is equal to the number of information types, displaying the number of undisplayed target information in the information bit containing multiple target information... The number of displayed information bits refers to the count of undisplayed target information belonging to the information type. An information bit with multiple target information bits indicates that the information type corresponding to that information bit includes multiple target information bits. For example, if the target information type displayed in information bit A is video information, and the merged message includes multiple video messages, then information bit A has multiple target information bits. Undisplayed target information refers to target information not displayed in the information bit. For example, if the number of information bits is 2, the number of information types is 2, and the number of target information bits is 4, and video information 1 is displayed in information bit A, image information 1 is displayed in information bit B, and video information 2 and image information 2 are not displayed in the merged message, then the number of undisplayed video information bits displayed in information bit A is 1, and the number of undisplayed image information bits displayed in information bit B is 1. This display method can display as much of all types of target information as possible, thereby improving information diversity.
[0126] As an example, when the number of information types and information bits are the same, each information bit displays one target information of an information type (equivalent to representative information of at least one target information of that information type). For each information type, the following processing is performed: determine representative information from at least one target information belonging to the information type. The representative information can be the target information with the highest relevance to the receiving object. Fill the corresponding information bit in the merged message template with the representative information. When there are multiple target information belonging to the information type, fill the merged message template with the number of target information belonging to the information type that has not been filled into the information bit, and display the merged message based on the merged message template.
[0127] As an example, obtain the merged message template, which includes the information bits to be filled. Obtain the download traffic of the information types of the N target information items and the filling priority of each information bit. For example, if the merged message template includes 4 information bits, the filling priority of the information bits is positively correlated with the default download priority of the receiving object. For instance, if information bit A is the first in the first row and information bit B is the second in the first row, then the filling priority of information bit A is higher than that of information bit B. The download traffic of video information type is higher than that of image information type, so the filling priority of video information type is higher than that of image information type. First, fill the target information 2 of video information type, then fill the target information 1 of image information type. When neither information bit A nor information bit B has been filled, fill the target information 2 into information bit A, and then fill the target information 1 into information bit B.
[0128] In some embodiments, when the merged message includes multiple information bits, and the number of multiple information bits is greater than the number of information types, for example, the number of information bits is 4, the step 104 of displaying a merged message obtained by merging N target information in the social interface can be implemented through the following technical solutions: When the number of information types is one, for example, the number of information types is one, namely video type, one target information belonging to the information type is displayed in multiple information bits, wherein the target information displayed in different information bits is different, that is, one video information is displayed in each of the 4 information bits, and the displayed video information is different; when the number of information types is multiple, for example, the number of information types is two, video type and image type, one target information is displayed in each information bit, wherein the type of the displayed target information covers all information types to which the N target information belong, and the displayed target information This refers to the target information displayed in the information bits, specifically one target information item displayed in each of the four information bits. The displayed target information is different for each of the four information bits, and includes at least one video item and at least one image item. When there is undisplayed target information, the number of undisplayed target information items of the same type as the undisplayed target information is appended to the information bit of the already displayed target information that belongs to the same information type. Undisplayed target information refers to target information that is not displayed in the information bit. For example, if N is 5, video information 1 is displayed in information bit A, video information 2 in information bit B, video information 3 in information bit C, and image information 1 in information bit D. There is also one undisplayed target information item, image information 2, which is not displayed in the merged message's information bit; therefore, the number 1 of undisplayed target information is appended to information bit D. This display method allows for the display of as many types of target information as possible, thereby improving information diversity.
[0129] As an example, obtain the merged message template, which includes the information bits to be filled. Obtain the download traffic of the information types of the N target information items and the filling priority of each information bit. For example, if the merged message template includes 4 information bits, the filling priority of the information bits is positively correlated with the default download priority of the receiving object. For instance, if information bit A is the first in the first row and information bit B is the second in the first row, then the filling priority of information bit A is higher than that of information bit B. The download traffic of video information type is higher than that of image information type, so the filling priority of video information type is higher than that of image information type. First, fill the target information 2 of video information type, then fill the target information 1 of image information type. When neither information bit A nor information bit B has been filled, fill the target information 2 into information bit A, and then fill the target information 1 into information bit B.
[0130] As an example, when the number of information bits is 3, the number of information types is 2, and the number of target information is 4, text information 1 is displayed in information bit A, image information 1 is displayed in information bit B, and image information 2 is displayed in information bit C. The target information not displayed is either text information or image information. When the target information not displayed is text information, the number 1 is displayed in information bit A. When the target information not displayed is image information, the number 1 is displayed in information bit B or information bit C.
[0131] In some embodiments, when the merged message includes multiple information positions, the step 104 of displaying a merged message obtained by merging N target information in the social interface can be achieved through the following technical solution: Display one target information in each information position, and the target information displayed in different information positions is different, wherein target information belonging to the same information type is located in adjacent information positions; when there is undisplayed target information belonging to the displayed information type, the number of undisplayed target information belonging to the displayed information type is additionally displayed in any information position corresponding to the displayed information type; when there is undisplayed target information not belonging to the displayed information type, the number of undisplayed target information not belonging to the displayed information type is additionally displayed in any information position; wherein, undisplayed target information refers to target information not displayed in an information position, displayed target information is target information displayed in an information position, and the displayed information type is the information type to which the displayed target information belongs. This method of displaying information by region based on information type allows for targeted display of N target information to the receiving object, avoiding accidental clicks caused by displaying them together, and effectively improving human-computer interaction efficiency.
[0132] As an example, suppose there are 11 target messages (N), including 3 video messages, 4 image messages, 3 emoticon messages, and 1 text message. The merged message includes 9 information bits, where the video information bits are adjacent to each other, the image information bits are adjacent to each other, and the emoticon information bits are adjacent to each other. For example, the 9 information bits display 3 video messages, 4 image messages, and 2 emoticon messages respectively. The displayed information types are video, image, and emoticon. Among the 11 target messages, emoticon message A and text message A are not displayed. Since the merged message displays emoticon messages, the number 1 of emoticon message A is appended to the information bit displaying emoticon messages in the merged message. Since the merged message does not display text messages, the number 1 of text message A is appended to any information bit.
[0133] In some embodiments, when the number of information bits is one, displaying a merged message obtained by merging N target information in the social interface in step 104 can be achieved through the following technical solution: displaying the target information with the highest relevance to the receiving object among the N target information in the information bit; and appending the number of undisplayed target information to the information bit, wherein the undisplayed target information refers to target information not displayed in the information bit. By displaying the information bit in a single information bit manner, the most relevant target information can be displayed to the receiving object, thereby improving the information acquisition efficiency of the receiving object.
[0134] As an example, see Figure 14 , Figure 14 This is a schematic diagram of the interface provided in an embodiment of this application. The merged message 1401A displays one target information 1402A, and the number of target information not displayed 1403A is displayed on the target information 1402A. In addition to displaying the target information with the highest relevance, the target information with the lowest download traffic can also be displayed, thereby reducing loading time and improving viewing efficiency during subsequent viewing.
[0135] In some embodiments, before displaying a merged message obtained by combining N target messages in a social interface, the information features of each target message are acquired; the object features of the recipients of the N target messages are acquired; the correlation between the information features and object features of each target message is determined. For example, if the recipient is A, candidate information 1 is a photo of the recipient A, candidate information 2 is a landscape photo, the information features are the image features of the photo and the landscape photo, and the object features are the account data features of the recipient, including the account avatar, etc. Based on the correlation between features (the correlation can be represented by the vector distance between the object features and the information features), the N target messages are processed... The target information is sorted in descending order, and the first target information in the sorted list is displayed in the merged message. The target information with the highest relevance is filled into the merged message template, including the information field. The target information among the N target information that is not filled into the merged message template is bound to the merged message template. The binding process assigns the same message identifier to the merged message template and the unfilled target information. The merged message template that has been filled and bound is used as the merged message. The target information among the N target information that is not filled into the merged message template will not be displayed in the merged message. However, due to the binding process, the target information among the N target information that is not filled into the merged message template will also be sent to the receiving object.
[0136] As an example, it is understood that in the embodiments of this application, data related to the information characteristics of the target information and the object characteristics of the receiving object, etc., need to obtain user permission or consent when the embodiments of this application are applied to specific products or technologies, and the collection, use and processing of related data need to comply with the relevant laws, regulations and standards of relevant countries and regions.
[0137] In some embodiments, after displaying a merged message obtained by combining N target information items in the social interface, in response to a press operation on any one of the information slots, the target information in the information slot is enlarged during the press operation; in response to releasing the press operation, i.e., the sender releases the press operation, the enlarged target information is restored to the size matching the information slot. The size change of the target information can be controlled by long-pressing, thereby improving the diversity of human-computer interaction.
[0138] As an example, let's take an image as the target information. See [link / reference]. Figure 4C , Figure 4CThis is a schematic diagram of the interface provided in the embodiment of this application. The social interface 402C (conversation interface) displays the sent merged message 403C. In response to a long press operation on a certain image 404C in the merged message 403C, the image 404C is enlarged and displayed on the social interface 402C. In response to the release of the long press operation, the image 404C is restored to its size before enlargement on the social interface 402C, that is, the size that matches the information bits.
[0139] In some embodiments, after displaying a merged message consisting of N target messages in the social interface, in response to a click operation on any information slot, the target information corresponding to that information slot is displayed in the information viewing interface. The information viewing interface is a full-screen interface switched from the social interface, or it is a floating layer interface of the social interface. The target information can be displayed in full-screen mode in the information viewing interface, or the size of the information viewing interface can be smaller than the full-screen size, displaying the target information in an information viewing interface of a set size. Typically, the size of the information viewing interface is larger than the size of the information slot. In response to a swipe operation on the target information corresponding to that information slot, the previous or next target information is displayed according to the direction of the swipe operation. The previous and next target information can be in the same merged message as the currently displayed target information, or in different merged messages, but both the previous and next target information are information carried by messages within the social interface. Clicking and swiping operations allow for immediate viewing of the currently operated target information and adjacent target information, thereby improving viewing convenience.
[0140] In some embodiments, after displaying a merged message obtained by combining N target information in the social interface, when the target information displayed in any information position is a video, in response to a click operation on any information position, the video can be played in any information position or in the information viewing interface. For example, in response to a click operation on information position A, since information position A displays video information, the video can be played directly in the information position, or the video can be played directly in the information viewing interface, or only the video cover frame can be displayed in the information viewing interface, and the video can be played in response to a trigger operation on the cover frame; when any information When the target information displayed in any information position is an image, the image is displayed in the information viewing interface in response to a click operation on any information position. When the target information displayed in any information position is audio, the audio is played in any information position or in the information viewing interface in response to a click operation on any information position. For example, in response to a click operation on information position A, since information position A displays audio information, the audio can be played directly in the information position, or directly in the information viewing interface, or only the audio cover frame can be displayed in the information viewing interface, and the audio can be played in the information viewing interface in response to a trigger operation on the cover frame. When displaying images or playing videos in the social interface, they can be displayed and played in the full-screen information viewing interface. The function of viewing target information does not need to be continuously triggered, and the display of information in different dimensions helps to improve the diversity of information display.
[0141] As an example, let's take images and videos as examples. See [link to documentation]. Figure 4D , Figure 4D This is a schematic diagram of the interface provided in the embodiment of this application. The social interface 402D (social interface) displays the merged message 403D. In response to a click operation on a certain image 404D in the merged message 403D, the image 404D is displayed in full screen on the full-screen information viewing interface. In response to a click operation on the video 405D, the video is played in full screen on the full-screen information viewing interface.
[0142] In some embodiments, after displaying a merged message obtained by merging N target messages in the social interface, in response to a click operation on any information position, the target message corresponding to that information position is displayed in the information viewing interface. The information viewing interface is a full-screen interface switched from the social interface, or it is a floating layer interface of the social interface. The target message can be displayed in full-screen mode in the information viewing interface, or the size of the information viewing interface can be smaller than the full-screen size, displaying the target message in an information viewing interface of a set size. Typically, the size of the information viewing interface is larger than the size of the information position. When there are other target messages among the N target messages with the same information type as the target message corresponding to any information position, in response to a click operation on any information position... The sliding operation of the target information corresponding to the information position displays other target information in the information viewing interface. When the information type of the target information corresponding to the information position is video, and there are multiple video target information among the N target information, other video target information is displayed in the information viewing interface. When the information type of the target information corresponding to the information position is audio, and there are multiple audio target information among the N target information, other audio target information is displayed in the information viewing interface. When the information type of the target information corresponding to the information position is image, and there are multiple image target information among the N target information, other image target information is displayed in the information viewing interface.
[0143] As an example, the previous target information and the next target information can be of the same information type or different information type as the currently viewed target information. Furthermore, the previous target information and the currently displayed target information can belong to the same merged message or not. Similarly, the next target information and the currently displayed target information can belong to the same merged message or not.
[0144] In some embodiments, after displaying the target information for the corresponding information position in the social interface, at least one functional control is displayed in the social interface. The functional controls include a forwarding control, an editing control, and a viewing control. The forwarding control, when triggered, forwards the target information in the full-screen information viewing interface to the forwarding object. The editing control, when triggered, allows editing of the target information in the full-screen information viewing interface. The viewing control, when triggered, displays N pieces of target information. In response to a trigger operation on any one of the functional controls, the processing corresponding to that functional control is performed on the target information. These functional controls allow for specific processing of a single target piece of information in the merged message set, thereby achieving a fine-grained information processing method and improving human-computer interaction efficiency.
[0145] As an example, let's take images and videos as examples. See [link to documentation]. Figure 4D The social interface 402D displays the merged message 403D. In response to a click on an image 404D within the merged message 403D, the image 404D is displayed in full-screen mode on the full-screen information viewing interface. The full-screen image 404D displays a forwarding control 407D, an editing control 408D, a viewing control 409D, and a more function entry control 410D. Taking the forwarding control 407D as an example, when triggered, it can forward the currently displayed image 404D. For example, it can be automatically forwarded to the social interface 402D, or it can be manually forwarded to other target accounts after selection. Continuing with the viewing control 409D as an example, when triggered, it displays a target information table. This table displays all target information from the social interface 402D (including target information within the merged message and target information within other independent messages).
[0146] In some embodiments, after displaying a merged message obtained by merging the N target information in the social interface, in response to a click operation on any target information in the social interface, any target information is displayed in the information viewing interface. In response to a character input operation on any target information, comment information for commenting on any target information is displayed in the character input interface. For example, target information A is displayed in the information viewing interface. In response to a long press operation on target information A in the information viewing interface, the character input interface is displayed. The character input operation is the operation of entering characters in the character input interface.
[0147] In some embodiments, after displaying a merged message obtained by merging N target information in the social interface, in response to a long press operation on any target information (e.g., target information A) in the merged message in the social interface, a character input interface pops up in the floating layer of the social interface while displaying the merged message. In response to a character input operation on any target information, where any target information is the information of the long press operation (i.e., target information A), and the character input operation is the operation of entering characters in the character input interface, comment information for commenting on any target information is displayed in the character input interface, that is, characters for commenting on target information A are displayed.
[0148] In some embodiments, in response to a sending operation for comment information in a character input interface, a comment message independent of the merged message is displayed in a social interface. The comment message includes any target information and comment information. For example, the social interface originally only displays the merged message. After sending, the social interface displays the comment message in addition to the merged message. The comment message displays the target information that has been commented on and the comment information obtained from the character input operation. The comment information can be displayed on the target information, or the comment information can be displayed in an area outside the target information in the comment message.
[0149] In some embodiments, in response to a sending operation for comment information in a character input interface, a comment message independent of the merged message is displayed in a social interface. For example, the social interface originally only displays the merged message, but after sending, the social interface displays a comment message in addition to the merged message. The comment message is similar to the merged message, and also includes N target information and at least one information bit. One target information is displayed in each information bit. The layout of the information bits in the comment message and the target information displayed in the information bits are the same as those in the merged message. Comment information is appended to any target information. Since the comment information is generated for target information A, the comment information is displayed on target information A.
[0150] Comment messages allow users to comment on and send comments on specific pieces of information, thereby expanding human-computer interaction methods and improving the efficiency of information dissemination.
[0151] As an example, let's consider an image as the target information. See [link to relevant documentation]. Figure 5D , Figure 5D This is a schematic diagram of the interface provided in this application embodiment. A full-screen image is displayed on the full-screen information viewing interface 501D. In response to a long-press operation on the image or a trigger operation on the forwarding control 502D, a character input interface 504D is displayed. The character input interface includes a sending control 506D. In response to an input operation on the character input interface 504D, comment information 505D is displayed. In response to a trigger operation on the sending control 506D, comment messages 503D are displayed on the social interface 507D. The social interface 507D is the social interface for sending merged messages, thus realizing a reply to the image. Therefore, the comment message can be considered a reply message. The social interface 507D can also be a conversation interface of other object accounts, so the comment message can be considered a forwarding message.
[0152] See Figure 3C , Figure 3C This is a flowchart illustrating the information receiving and processing method provided in the embodiments of this application, which will be combined with... Figure 3C Steps 201 to 202 shown will be explained.
[0153] In step 201, a preview image of the merged message is displayed in the social interface, and a download control for the corresponding merged message is also displayed in the social interface.
[0154] As an example, the merged message includes N target messages and at least one information bit, with one target message displayed in each information bit. N is an integer greater than or equal to 2. The download control can be displayed within the merged message in the social interface or in a nearby location within the merged message in the social interface. A nearby location is a position less than a distance threshold from the merged message. When the download control is displayed in the merged message, it can be displayed in any information bit of the merged message or in a form that covers multiple information bits. When the download control is displayed outside the merged message, it can be displayed in a fixed position, such as a fixed upper right corner, or the download control can be attached to the edge of the merged message and the distance from the merged message is less than the distance threshold.
[0155] In step 202, in response to a trigger operation on the download control, at least a portion of the target information from the N target information items is downloaded, and the download progress of at least a portion of the target information is displayed on the social interface.
[0156] See Figure 5A , Figure 5A This is a schematic diagram of the interface provided in the embodiment of this application. The social interface 501A displays a preview image 502A of the merged message and a download control 503A. In response to the trigger operation (batch download operation) of the download control 503A, a download progress bar 504A is displayed in the social interface 501A. In response to the completion of downloading all target information in the preview image, a download completion prompt message 505A is displayed.
[0157] In some embodiments, after displaying a preview image of the merged message in the social interface, in response to a press operation on any information segment, the target information in the information segment is enlarged during the duration of the press operation; in response to releasing the press operation, i.e., the sender releases their hand to stop the press operation, the enlarged target information is restored to the size matching the information segment. The size change of the target information can be controlled by long-pressing, thereby improving the diversity of human-computer interaction.
[0158] As an example, let's take an image as the target information. See [link / reference]. Figure 5B The social interface 502B displays a preview image 503B of the merged message. In response to a long press operation on an image 504B in the preview image, the image 504B is enlarged on the social interface 502B. In response to the release of the long press operation, the image 504B is restored to its original size on the social interface 502B, that is, restored to the size that matches the information bits.
[0159] In some embodiments, after displaying a preview image of the merged message in the social interface, in response to a click operation on any information slot, the target information corresponding to that information slot is displayed in the information viewing interface; in response to a swipe operation on the target information corresponding to that information slot, the previous or next target information is displayed according to the direction of the swipe operation. Clicking and swiping operations allow for immediate viewing of the currently active target information and adjacent target information, thereby improving viewing convenience.
[0160] As an example, let's take an image or video as the target information. See [link / reference]. Figure 5C , Figure 5C This is a schematic diagram of the interface provided in the embodiment of this application. The social interface 502C displays a preview image 503C of the merged message. In response to a click operation on an image 504C in the preview image, the image 504C is displayed in full screen on the full-screen information viewing interface. In response to a swipe operation on the image 504C, another image 505C is displayed in full screen or another video is played in full screen. The other image and the other video may come from the merged message or may not belong to the merged message but come from the social interface 502C.
[0161] In some embodiments, after displaying a preview image of the merged message in the social interface, when the target information displayed in any information slot is a video, in response to a click operation on any information slot, the video is played in any information slot or in the information viewing interface. For example, in response to a click operation on information slot A, since information slot A displays video information, the video can be played directly in the information slot, or the video can be played directly in the information viewing interface, or only the video cover frame can be displayed in the information viewing interface, and in response to a trigger operation on the cover frame, the video is played in the information viewing interface; when the target information displayed in any information slot is a video, the video can be played in the information viewing interface. When the target information is an image, the image is displayed in the information viewing interface in response to a click on any information slot. When the target information displayed in any information slot is audio, the audio is played either in any information slot or in the information viewing interface in response to a click on any information slot. For example, in response to a click on information slot A, since information slot A displays audio information, the audio can be played directly in the information slot, or directly in the information viewing interface, or only the audio cover frame can be displayed in the information viewing interface, and the audio can be played in response to a trigger action on the cover frame. When displaying images or playing videos in the social interface, they can be displayed and played in a full-screen information viewing interface. The function of viewing target information does not need to be continuously triggered, and the display of information in different dimensions helps to improve the diversity of information display.
[0162] As an example, let's take an image or video as the target information. See [link / reference]. Figure 5C , Figure 5C This is a schematic diagram of the interface provided in the embodiment of this application. The social interface 502C displays a preview image 503C of the merged message. In response to a click operation on a certain image 504C in the preview image, the image 504C is displayed in full screen on the full-screen information viewing interface. In response to a click operation on the video, the video is played in full screen on the full-screen information viewing interface.
[0163] In some embodiments, after displaying a preview image of the merged message in the social interface, in response to a click operation on any information position, the target information corresponding to that information position is displayed in the information viewing interface. The information viewing interface is a full-screen interface switched from the social interface, or it is a floating layer interface of the social interface. The target information can be displayed in full-screen mode in the information viewing interface, or the size of the information viewing interface can be smaller than the full-screen size, displaying the target information in an information viewing interface of a set size. Typically, the size of the information viewing interface is larger than the size of the information position. When there are other target information of the same type as the target information corresponding to any information position among the N target information, in response to a click operation on any information position... The sliding operation of the target information displays other target information in the information viewing interface. When the information type of the target information corresponding to the information position is video, and there are multiple video target information among the N target information, other video target information is displayed in the information viewing interface. When the information type of the target information corresponding to the information position is audio, and there are multiple audio target information among the N target information, other audio target information is displayed in the information viewing interface. When the information type of the target information corresponding to the information position is image, and there are multiple image target information among the N target information, other image target information is displayed in the information viewing interface.
[0164] As an example, the previous target information and the next target information can be of the same information type or different information type as the currently viewed target information. Furthermore, the previous target information and the currently displayed target information can belong to the same merged message or not. Similarly, the next target information and the currently displayed target information can belong to the same merged message or not.
[0165] In some embodiments, after displaying a preview image of the merged message in the social interface, at least one functional control is displayed in the social interface. This functional control includes a forwarding control, an editing control, and a viewing control. The forwarding control, when triggered, forwards the target information from the full-screen information viewing interface to the forwarding object. The editing control, when triggered, allows editing of the target information in the full-screen information viewing interface. The viewing control, when triggered, displays N target messages. In response to a trigger operation on any one of the functional controls, the corresponding processing of the target information is performed using that functional control. These functional controls allow for specific processing of a single target message in the merged message set, thereby achieving fine-grained information processing and improving human-computer interaction efficiency.
[0166] As an example, let's take images and videos as examples. See [link to documentation]. Figure 4D The social interface 402D displays the merged message 403D. In response to a click on an image 404D within the merged message 403D, the image 404D is displayed in full-screen mode on the full-screen information viewing interface. The full-screen image 404D displays a forwarding control 407D, an editing control 408D, a viewing control 409D, and a more function entry control 410D. Taking the forwarding control 407D as an example, when triggered, it can forward the currently displayed image 404D. For example, it can automatically forward it to the social interface 402D, or it can be manually forwarded to other target accounts after selection. Continuing with the viewing control 409D as an example, when triggered, it displays a target information table. This table displays all target information from the social interface 402D (including target information within the merged message and target information within other independent messages).
[0167] In some embodiments, after displaying a preview image of the merged message in the social interface, in response to a click operation on any target message in the social interface, any target message is displayed in the message viewing interface. In response to a character input operation on any target message, comment information for commenting on any target message is displayed in the character input interface. For example, target message A is displayed in the message viewing interface. In response to a long press operation on target message A in the message viewing interface, the character input interface is displayed. The character input operation is the operation of entering characters in the character input interface.
[0168] In some embodiments, after displaying a preview image of the merged message in the social interface, in response to a long press operation on any target information (e.g., target information A) in the merged message in the social interface, a character input interface pops up in the floating layer of the social interface while the merged message is displayed. In response to a character input operation on any target information, where any target information is the information of the long press operation (i.e., target information A), and the character input operation is the operation of entering characters in the character input interface, comment information for commenting on any target information is displayed in the character input interface, that is, characters for commenting on target information A are displayed.
[0169] In some embodiments, in response to a sending operation for comment information in a character input interface, a comment message independent of the merged message is displayed in a social interface. The comment message includes any target information and comment information. For example, the social interface originally only displays the merged message. After sending, the social interface displays the comment message in addition to the merged message. The comment message displays the target information that has been commented on and the comment information obtained from the character input operation. The comment information can be displayed on the target information, or the comment information can be displayed in an area outside the target information in the comment message.
[0170] In some embodiments, in response to a sending operation for comment information in a character input interface, a comment message independent of the merged message is displayed in a social interface. For example, the social interface originally only displays the merged message, but after sending, the social interface displays a comment message in addition to the merged message. The comment message is similar to the merged message, and also includes N target information and at least one information bit. One target information is displayed in each information bit. The layout of the information bits in the comment message and the target information displayed in the information bits are the same as those in the merged message. Comment information is appended to any target information. Since the comment information is generated for target information A, the comment information is displayed on target information A.
[0171] Comment messages allow users to comment on and send comments on specific pieces of information, thus expanding human-computer interaction methods and improving information dissemination efficiency.
[0172] As an example, let's consider an image as the target information. See [link to relevant documentation]. Figure 5D , Figure 5DThis is a schematic diagram of the interface provided in this application embodiment. The image is displayed in full screen on the information viewing interface 501D. In response to a long press operation on the image or a trigger operation on the forwarding control 502D, the character input interface 504D is displayed. The character input interface includes a sending control 506D. In response to an input operation on the character input interface 504D, the comment information 505D is displayed. In response to a trigger operation on the sending control 506D, the comment message 503D is displayed on the social interface 507D. The social interface 507D is the social interface for sending merged messages, thereby realizing a reply to the image 503D. Therefore, the comment message can be regarded as a reply message. The social interface 507D can also be the social interface of other object accounts. Therefore, the comment message can be regarded as a forwarding message.
[0173] The following will describe an exemplary application of the embodiments of this application in a real-world application scenario.
[0174] In some embodiments, the social network includes a sending account for sending objects and a receiving account for receiving objects. The sending account's terminal receives a sending operation for N target messages one by one, and sends the N target messages sequentially to the receiving account's terminal through a server. The sending account's terminal's human-computer interaction interface sequentially displays N messages corresponding one-to-one with the N target messages, and the receiving account's terminal's human-computer interaction interface sequentially displays the N received messages. Each message carries one target message (or a preview of the target message). The sending account's terminal receives a merging sending operation for the N target messages, and sends a merged message including the N target messages to the receiving account's terminal through a server. The merged message is displayed on the receiving account's terminal, and a preview of the merged message is also displayed. The receiving account's terminal receives a batch download operation, and the download progress for the N target messages in the merged message is displayed on the receiving account's terminal.
[0175] This application provides an information sending and receiving method, which supports the option of merging N target messages when sending them. The client of the receiving object will only display one merged message, which can achieve the purpose of sending and viewing multiple target messages, avoid screen refresh, trace at any time, and support one-click download.
[0176] In some embodiments, during a chat, multiple images can be selected from the photo album, and in response to a triggering action on the send control, the multiple images will be sent sequentially. See also Figure 4A , Figure 4AThis is a schematic diagram of the interface provided in the embodiment of this application. The album interface 401A displays multiple images 402A. The selected image 402A is marked with a selection mark 403A. The album interface 401A also displays a sending control 404A. In response to the trigger operation of the sending control 404A, multiple image messages 405A sent to the receiving object are displayed in the album interface 401A. When multiple images need to be sent, multiple images are sent in sequence, and multiple image messages are displayed in the social interface.
[0177] In some embodiments, during a chat, multiple images can be selected from the album. In response to triggering actions on the merge control and the send control, these images are merged into a single merged message and sent. Images and videos can be sent together, meaning they are combined into a single merged message. The display rules for each image and video in the merged message differ depending on the number of images and videos sent. See also Figure 4A The album interface 401A displays multiple images 402A. The selected image 402A is marked with a selection mark 403A. The album interface 401A also displays a send control 404A and a merge control 406A. In response to a trigger operation on the merge control 406A, it is shown that the merge control 406A is selected, indicating that the merge mode is on. In response to a trigger operation on the send control 404A, a merged message sent to the recipient is displayed in the social interface.
[0178] In some embodiments, the recipient's social interface may display a preview image of the merged message sent by the sender, and in response to a batch download operation for the merged message, all images and videos in the merged message may be downloaded. See also Figure 5A The social interface 501A displays a preview image 502A of the merged message and a download control 503A. In response to a trigger operation on the download control 503A, a download progress bar 504A is displayed in the social interface 501A. In response to the completion of downloading all target information in the preview image, a download completion message 505A is displayed.
[0179] In some embodiments, the recipient can long-press on an image or video in the merged message. The long-pressed image or video will then be enlarged and displayed directly in the social interface for easy previewing. After the recipient releases the long press, the enlarged image and video cover frame will return to their original size. See also Figure 5B The social interface 502B displays a preview image 503B of the merged message. In response to a long press operation on an image 504B in the preview image, the image 504B is enlarged and displayed on the social interface 502B. In response to the release of the long press operation, the image 504B is restored to its original size on the social interface 502B.
[0180] In some embodiments, the recipient can click on an image or video in the merged message to enter a full-screen viewing page. Different images can be displayed in response to the recipient's left or right swipe gestures on that image. When the user has swiped through all the images in the merged message and continues to swipe, other images and videos in this social interface will be displayed. See also Figure 5C In the social interface 502C, a preview image 503C of the merged message is displayed. In response to a click on an image 504C in the preview image, the image 504C is displayed in full screen on the full-screen information viewing interface. In response to a swipe on the image 504C, another image 505C is displayed in full screen or another video is played in full screen. The other image and the other video can come from within the merged message or from the social interface 502C but not from the merged message.
[0181] In some embodiments, the receiving object can click on an image in the merged message to enter a full-screen viewing page. The receiving object can then edit the reply information for a single image, combine the reply information and the original image to form a reply message, and send the reply message to the sending object. See also Figure 5D , Figure 5D This is a schematic diagram of the interface provided in the embodiment of this application. An image 503D is displayed in full screen on the full-screen information viewing interface 502D of the social interface 501D. In response to a long press operation on the image 503D or a trigger operation on the forwarding control 509D, a character input interface 504D is displayed. The character input interface includes a sending control 506D. In response to an input operation on the character input interface 504D, comment information 505D is displayed. In response to a trigger operation on the sending control 506D, comment messages 508D are displayed on the social interface 507D.
[0182] In some embodiments, when selecting a file (image or video), there is an entry point for the sending object to trigger the merge sending capability. When multiple images are selected to be sent, only one merge message will be sent, that is, multiple images or videos are combined into one merge message and sent to the receiving object. The receiving object's social interface will only display this merge message, instead of multiple independent messages. The merge message can contain all the images or videos sent by the sending object, making it convenient for the receiving object to download and view the images or videos. The sending logic of the merge message is different from the previous logic of sending each image or video separately. The previous logic only needed to ensure that a single image or video was sent successfully before sending the corresponding individual message. For the sending of the merge message, it is necessary to ensure that all images or videos are uploaded successfully before sending the merge message.
[0183] In some embodiments, see Figure 6 , Figure 6This is a schematic diagram of the sending process of the information sending processing method provided in this application embodiment. In step 601, an operation to select an image or video is received. In step 602, a selection operation for the merge control is received. In step 603, a click operation for the send control is received. In step 604, the selected images or videos are combined into a merge send list. In step 605, each image or video in the merge send list is traversed and uploaded. When an image is successfully uploaded and all images and videos in the merge send list are successfully uploaded, step 606 is executed. In step 606, a merge message including all images or videos in the merge send list is sent. When an image is successfully uploaded but not all images and videos in the merge send list are successfully uploaded, step 605 is executed. When an image is not successfully uploaded, step 607 is executed. In step 607, merge message sending failure processing is performed.
[0184] In some embodiments, all images or videos are uploaded to the cloud object storage service of the file storage platform. Upon successful upload, a corresponding file identifier is generated to uniquely identify the file. The file status can be viewed using this file identifier, and the corresponding file can also be downloaded based on this identifier. When a merge message is sent, this file identifier is essentially sent, and the receiving object downloads the file from the cloud object storage service based on this identifier. Furthermore, for images and videos, the file storage platform will match a corresponding merge message template after multiple files are successfully uploaded. This template is filled with thumbnails of the uploaded images and cover thumbnails of the uploaded videos, ensuring that the content of the images or videos can be displayed immediately in social interfaces. This prevents excessive download traffic from the original images, which could lead to a prolonged download time before displaying the merge message.
[0185] In some embodiments, because the message format of the merged message differs from that of a separately sent message, the message structure of the separate message cannot be directly reused. See [link to relevant documentation]. Figure 7 , Figure 7This is a schematic diagram of the message structure of a merged message provided in this application embodiment. When uploading to the cloud object storage service platform, a request needs to be sent. The `msg_type` in the `MsgBody` of the request body indicates the message type. The `MultiMediaMsgInfo` information data in the body is a list storing basic information about images or videos. After the request, an `RspBody` is returned, where `result` indicates the result of the request. If the request result is a failure, the reason for the failure is indicated by `content`. Images or videos are represented by file identifiers, which are returned to the sending object by the cloud object storage service platform after uploading. When sending the message, only the file identifier needs to be sent. The receiving object's client can request a thumbnail of the file based on the file identifier, thus quickly displaying the general content. Upon receiving the merged message, the receiving object only needs to parse the content of the merged message according to the protocol to obtain multiple images or videos in the merged message, thereby forming different display formats. For display rules, the client can obtain the corresponding number of images or videos based on the information in `MultiMediaMsgInfo` for layout. See also... Figure 13 , Figure 13 This is a schematic diagram of the interface provided in the embodiment of this application. The image thumbnails or video covers displayed in the user interface are individual image objects 1301. The outer layer of the user interface carries the image objects through a container view 1302. The image objects are arranged in the container according to the number of image objects. Each merge message includes an operation entry 1303 for easy user operation and clicking. At the same time, the merge message also contains message status information 1304, which is convenient for displaying the number of files in the merge message, whether the files are being downloaded, and whether the download was successful.
[0186] In some embodiments, see Figure 8 , Figure 8This is a schematic diagram of the interaction process provided in the embodiments of this application. In step 801, a batch download operation is received. In step 802, the file list is traversed. In step 803, the identifier and information type of the traversed files are obtained and sent to the cloud object service platform. In step 804, the received data is verified. If the verification passes, step 805 is executed, in which a file download link is generated and sent to the client for link request result processing. Otherwise, step 806 is executed, in which a link request failure result is sent to the client for link request processing. In the result processing, when the link request result indicates success, step 807 is executed. In step 807, the client requests a download from the resource download management center. In step 808, the resource download management center downloads the file according to the file download link. When the download is successful and the file list is completely downloaded, in step 809, the client performs the display processing indicating that the one-click download was successful. When the download is successful but the file list is not completely downloaded, step 802 is executed. When the download is unsuccessful or the link request result indicates failure, step 810 is executed. In step 810, the client performs the display processing indicating that the one-click download failed.
[0187] In some embodiments, for merged messages including images or videos, a fast download capability for all images or videos can be provided. According to the protocol, the client can obtain the file identifier for each file. The client can then download the corresponding file from the resource download management center based on this file identifier. For images, different types of images can be downloaded; for example, the original file can be downloaded. For videos, the video cover or the video content can be downloaded. Logically, the client needs to iterate through the file identifiers of images or videos in MultiMediaMsgInfo and download all file identifiers. During download, the file type is determined based on uint32_media_type in SigleMediaInfo. Different download interfaces are called based on different types. When iterating through the file list, the file identifier of each file is obtained one by one. Based on the file identifier and media_type, the file connection is obtained from the file download management center server. Then, the client inserts a download task in the resource download resource center. The download result will call back to the client's one-click download logic, facilitating the download of the next file. Each downloaded file can be named directly using its file identifier, which represents the uniqueness of the file.
[0188] In some embodiments, see Figure 9 , Figure 9This is an interface diagram provided in the embodiments of this application. Each image thumbnail or video cover in the merged message is an independent view 901 of an image object. In each system, the event of attaching a long press gesture to the individual view can be detected, and then the preview image of the corresponding image can be displayed. If the original file is not yet ready, the thumbnail is displayed. After the original file is downloaded, the original file is displayed, such as displaying the original image or playing the video. The preview is an independent view 902 overlaid on the social interface to carry the preview information.
[0189] In some embodiments, different operating systems support long-press events. When the user interface detects a long-press event on an image object view, it can obtain basic information such as the file identifier and information type of the image object view. Based on this information, it can download and display resources. See [link to documentation]. Figure 10 , Figure 10 This is a schematic diagram of the interaction process provided in the embodiment of this application. In step 1001, a long press operation is received on the image object view. In step 1002, the file identifier and information type of the image object view are obtained. If the original file corresponding to the image object exists, the original file is displayed in step 1003; otherwise, step 1004 is executed. In step 1004, a thumbnail is displayed and downloaded. In step 1005, a signaling request for a file download link is sent to the resource download management center according to the file identifier and information type. In step 1006, the received signaling data is verified. If the signaling data is valid, in step 1007... A file download link is generated and sent to the client for link request result processing. Otherwise, step 1008 is executed. In step 1008, a link request failure result is sent to the client for link request result processing. When the link request result indicates success, step 1009 is executed. In step 1009, the client requests a download from the resource download management center. In step 1010, the resource download management center downloads the file according to the file download link. When the download fails, or the link request result indicates failure, in step 1011, the client prompts that the original file download failed. When the download is successful, step 1003 is executed.
[0190] In some embodiments, the existence of the original file is detected mainly by judging based on the fixed path prefix and file identifier. When the original file exists locally, it indicates that the original file corresponding to the image object view exists, and the original file can be displayed directly. For different information types, the corresponding original file will be downloaded according to the information type in the signaling data of requesting the file download link. When displaying, it is determined whether to preview the image or the video according to the information type.
[0191] In some embodiments, the user interface supports long-press preview and also provides each image object's view with the ability to click for full-screen viewing, i.e., opening an independent page to display image or video information. The principle is similar to the long-press preview function, which creates an independent view to display information within the current page, while the full-screen view creates an independent page for display. When displaying information on an independent page, left and right swipe functionality is supported. The client's user interface detects gestures on the view; different operating systems will detect corresponding gesture events. For the full-screen view, where the outer container is full-screen and also embeds an independent view, additional left and right swipe gesture detection logic is added to the independent view. Swiping switches the data in the independent view. Swiping left and right refreshes the current data in the full-screen view and refreshes the user interface based on the new file identifier and information type. See [link to relevant documentation]. Figure 11 , Figure 11 This is a logical schematic diagram provided in the embodiments of this application. In step 1101, a left and right swipe operation is received. When the merge message is a merge message of images and videos, and the current file is located at the beginning or end of the resource list of the merge message, or when the merge message is not a merge message of images and videos, step 1102 is executed. In step 1102, the previous or next message of the current file is obtained. When the merge message is a merge message of images and videos, and the current file is not located at the beginning or end of the resource list of the merge message, step 1103 is executed. In step 1103, the previous or next file in the merge message is obtained. When the previous or next message is not obtained in step 1102, step 1104 is executed. In step 1104, a message indicating no more messages is displayed; otherwise, step 1105 is executed. In step 1105, the file identifier and information type of the previous or next message are obtained. In step 1106, the user interface of the full-screen viewing page is refreshed based on the new data.
[0192] In some embodiments, the difference between the full-screen view function and the long-press preview function is that the long-press preview function can only preview the file corresponding to the currently long-pressed view, while the full-screen view function will initially display the image or video of the currently clicked view, and supports left and right swiping. It will detect whether the current preview is in a merged message. If it is in a merged message, it will display the files above / below the merged message. It also supports cross-message preview. If the left and right swiping exceeds the file list of the current merged message, it will detect the files in the messages before and after the merged message, making it easy for users to quickly preview all images or videos in the social interface and providing a convenient operation path.
[0193] In some embodiments, the full-screen viewing page also provides a user forwarding function. Forwarding to the original social interface is equivalent to implementing a reply function, serving as a convenient entry point for quickly sending rich media messages. Forwarded messages only allow sending text, images, or videos individually. The message editing area allows editing of the sent content, permitting mixed text and images. This quick entry point in the full-screen viewing page facilitates users sending specific messages. See also Figure 12 , Figure 12 This is a schematic diagram of the interface provided in the embodiment of this application. The social interface displays a forwarding control 1201. In response to the triggering operation of the forwarding control 1201, a character input interface 1202 is displayed. In response to the input operation in the character input interface, comment information is displayed. In response to the sending operation of the comment information, a comment message 1203 including the comment information is displayed in the social interface. The social interface can be a social interface that receives merged messages or other social interfaces.
[0194] In some embodiments, a quick reply button is available on the full-screen viewing page. After the user clicks the reply button, a text editor is opened. Once the user finishes editing and presses enter, the program assembles the image and text mixed message and quickly sends it. See also... Figure 16 , Figure 16 This is a flowchart provided in an embodiment of this application. In step 1601, a click operation on the forwarding control is received. In step 1602, a text editing box is displayed. In step 1603, text is entered. If the text is empty, in step 1604, a prompt message indicating that forwarding is not possible is displayed; otherwise, step 1605 is executed. In step 1605, a thumbnail of the full-screen viewing page is obtained. In step 1606, the thumbnail and text are assembled. In step 1607, the assembled comment message is sent. If the user does not enter text, the forwarding logic will not be triggered. The system can detect whether the user has entered empty text or can detect the text information entered by the user in real time. As long as the text length is greater than 0, the user is allowed to trigger the sending control for quick forwarding; otherwise, the sending control is grayed out.
[0195] This application proposes a message type that integrates multiple information. When a sender sends multiple images in a chat window, they can choose to send them in a package. In this case, the sent message is no longer a single image, but a merged message. The receiver can see previews of each image in the merged message. The receiver can download all images with one click, or click to view or comment on a single image, which can effectively improve the utilization of display resources and enhance human-computer interaction efficiency.
[0196] It is understood that in the embodiments of this application, data such as user information are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0197] The following description further illustrates the exemplary structure of the information sending processing device 455-1 and information receiving processing device 455-2 provided in the embodiments of this application as software modules.
[0198] In some embodiments, such as Figure 2 As shown, the software modules stored in the information sending and processing device 455-1 in the memory 450 may include: a first display module 4551, used to display multiple candidate messages and display N target messages among the multiple candidate messages as selected, where N is an integer greater than or equal to 2; a sending module 4553, used to display N messages in the social interface in response to a message-by-message sending operation for the N target messages, where each of the N messages carries one target message and each of the N messages carries different target messages; the sending module 4553 is also used to display a merged message obtained by merging the N target messages in the social interface in response to a message-merging operation for merging the N target messages, where the merged message includes the N target messages and at least one information bit, and displays one target message in each information bit.
[0199] In some embodiments, the first display module 4551 is further configured to: perform at least one of the following: in response to a selection operation on multiple candidate information, display the N selected target information among the multiple candidate information as selected; determine the N candidate information operated on in the most recent set time period as target information and display it as selected; obtain the correlation degree between each candidate information and the receiving object of the N target information, sort the multiple candidate information in descending order based on the correlation degree, take the N candidate information with the highest ranking as the N selected target information, and display the N target information as selected.
[0200] In some embodiments, the first display module 4551 is further configured to: acquire historical information data of historically sent information, object data of the sending account, and candidate information data of each candidate message; perform the following processing for each candidate message: perform convolution processing based on convolutional layer parameters on the historical information data, object data, and candidate information data through the convolutional layer of the first neural network to obtain historical information features, object features, and candidate information features; perform fusion processing based on pooling layer parameters on the historical information features, object features, and candidate information features through the pooling layer of the first neural network to obtain fused features; perform mapping processing based on fully connected layer parameters on the fused features through the fully connected layer of the first neural network to obtain the selection probability of the candidate message, wherein the selection probability represents the probability that the candidate message is selected by the sending account; perform descending sorting processing based on the selection probability on multiple candidate messages, take the top N candidate messages as the N target messages automatically selected, and display the N target messages as selected.
[0201] In some embodiments, the first display module 4551 is further configured to: perform sorting processing on all information stored in the sending account based on a specific dimension, and display the top-ranked information as candidate information; wherein all information is stored in at least one of the following: the terminal device associated with the sending account, the network storage device associated with the sending account, and the specific dimension includes: recent usage time, usage frequency, creation time, and file size.
[0202] In some embodiments, the sending module 4553 is further configured to: display a merge sending mode control, wherein the merge sending mode control is used to switch between an on state and a off state when triggered, the on state indicating that the merge sending mode is enabled, and the off state indicating that the merge sending mode is disabled; display a sending control; in response to the merge sending mode control being in the on state and receiving a trigger operation for the sending control, identify the trigger operation as a merge sending operation for N target messages, and display a merged message obtained by merging N target messages in the social interface.
[0203] In some embodiments, the sending module 4553 is further configured to: display a merged sending mode control, wherein the merged sending mode control is used to switch between an on state and a off state when triggered, the on state indicating that the merged sending mode is enabled, and the off state indicating that the merged sending mode is disabled; display a sending control; in response to the merged sending mode control being in the off state and receiving a trigger operation for the sending control, identify the trigger operation as a sending operation for N target messages one by one, and display N messages in the social interface.
[0204] In some embodiments, when the merged message includes multiple information bits, the sending module 4553 is further configured to: display one target information in each information bit, and the target information displayed in different information bits is different; wherein, when the number of multiple information bits is less than N, the number of undisplayed target information is displayed in any information bit, wherein the undisplayed target information refers to the target information that is not displayed in the information bit.
[0205] In some embodiments, the filling priority of the information bits is positively correlated with a first characteristic parameter of the target information. The first characteristic parameter includes at least one of the following: the frequency of use of the target information, the storage time of the target information, the most recent transmission time of the target information, and the degree of correlation between the target information and the recipient of the target information.
[0206] In some embodiments, when the merged message includes multiple information bits, the sending module 4553 is further configured to: display target information of different information types in the multiple information bits respectively; when the number of information bits is less than the number of information types, append the number of undisplayed target information to any information bit; when the number of information bits is equal to the number of information types, append the number to the information bit with multiple target information, where the number refers to the count of undisplayed target information belonging to the information type, and the undisplayed target information refers to target information that is not displayed in the information bit.
[0207] In some embodiments, when the merged message includes multiple information bits, and the number of multiple information bits is greater than the number of information types, the sending module 4553 is further configured to: when the number of information types is one, display one target information belonging to the information type in the multiple information bits, wherein the target information displayed in different information bits is different; when the number of information types is multiple, display one target information in each information bit, wherein the type of the displayed target information covers all information types to which the N target information belong, and the displayed target information is the target information displayed in the information bit; when there is undisplayed target information, additionally display the number of undisplayed target information belonging to the same information type on the information bit of the displayed target information belonging to the same information type as the undisplayed target information, wherein the undisplayed target information refers to the target information not displayed in the information bit.
[0208] In some embodiments, when the merged message includes multiple information bits, the sending module 4553 is further configured to: display one target information in each information bit, and the target information displayed in different information bits is different, wherein the information bits of target information belonging to the same information type are adjacent; when there is undisplayed target information belonging to the displayed information type, the number of undisplayed target information belonging to the displayed information type is additionally displayed in any information bit corresponding to the displayed information type; when there is undisplayed target information not belonging to the displayed information type, the number of undisplayed target information not belonging to the displayed information type is additionally displayed in any information bit; wherein, undisplayed target information refers to target information not displayed in the information bit, displayed target information is target information displayed in the information bit, and displayed information type is the information type to which the displayed target information belongs.
[0209] In some embodiments, when the number of information bits is one, the sending module 4553 is further configured to: display the target information with the highest correlation to the receiving object among the N target information in the information bits; and append the number of undisplayed target information to the information bits, wherein the undisplayed target information refers to the target information that is not displayed in the information bits.
[0210] In some embodiments, before displaying the sent merged message, the sending module 4553 is further configured to: obtain the information features of each target information; obtain the object features of the receiving objects of the N target information; determine the correlation between the information features and object features of each target information; fill the target information with the highest correlation into the merged message template including information bits; bind the target information among the N target information that has not been filled into the merged message template to the merged message template; and use the filled and bound merged message template as the merged message.
[0211] In some embodiments, after displaying a merged message obtained by merging N target information in the social interface, the sending module 4553 is further configured to: in response to a pressing operation on any information bit, enlarge the target information in the information bit during the continuous pressing operation; and in response to releasing the pressing operation, restore the enlarged target information to a size matching the information bit.
[0212] In some embodiments, after displaying a merged message obtained by merging N target information in the social interface, the sending module 4553 is further configured to: in response to a click operation on any information position, display the target information corresponding to any information position in the information viewing interface; and in response to a swipe operation on the target information corresponding to the information position, display the previous target information or the next target information according to the direction of the swipe operation.
[0213] In some embodiments, when the merged message includes multiple information bits, and target information of different information types is displayed in the multiple information bits respectively, after displaying a merged message obtained by merging N target information in the social interface, the sending module 4553 is further configured to: in response to a click operation on any information bit, display the target information corresponding to any information bit in the information viewing interface; when there are other target information of the same information type as the target information corresponding to any information bit among the N target information, in response to a swipe operation on the target information corresponding to any information bit, display the other target information in the information viewing interface.
[0214] In some embodiments, the sending module 4553 is further configured to: when the target information displayed in any information bit is video, in response to a click operation on any information bit, play the video in any information bit or play the video in the information viewing interface; when the target information displayed in any information bit is image, in response to a click operation on any information bit, display the image in the information viewing interface; when the target information displayed in any information bit is audio, in response to a click operation on any information bit, play the audio in any information bit or play the audio in the information viewing interface.
[0215] In some embodiments, after displaying the target information of the corresponding information position in the social interface, the sending module 4553 is further configured to: in response to a character input operation for any target information, display comment information for commenting on any target information in the character input interface; in response to a sending operation for the comment information in the character input interface, perform any of the following processes: display a comment message independent of the merged message in the social interface, wherein the comment message includes any target information and comment information; display a comment message independent of the merged message in the social interface, wherein the comment message includes N target information and at least one information position, with one target information displayed in each information position, and comment information appended to any target information.
[0216] In some embodiments, such as Figure 2 As shown, the software modules stored in the information receiving and processing device 455-2 in the memory 450 may include: a second display module 4554, used to display a preview image of the merged message in the social interface, and to display a download control corresponding to the merged message in the social interface; wherein the merged message includes N target information items and at least one information bit, and one target information item is displayed in each information bit; and a download module 4555, used to download at least a portion of the target information items in response to a trigger operation on the download control, and to display the download progress of at least a portion of the target information items in the social interface.
[0217] In some embodiments, after displaying a preview image of the merged message in the social interface, the download module 4555 is further configured to: in response to a press operation on any one of the information bits, enlarge the target information in the information bit during the duration of the press operation; and in response to releasing the press operation, restore the enlarged target information to a size matching the information bit.
[0218] In some embodiments, after displaying a preview image of the merged message in the social interface, the download module 4555 is further configured to: in response to a click operation on any information position, display the target information corresponding to any information position in the information viewing interface; and in response to a swipe operation on the target information corresponding to the information position, display the previous or next target information according to the direction of the swipe operation.
[0219] In some embodiments, when the merged message includes multiple information bits, and target information of different information types is displayed in the multiple information bits respectively, after displaying a preview image of the merged message in the social interface, the download module 4555 is further configured to: in response to a click operation on any information bit, display the target information corresponding to any information bit in the information viewing interface; when there are other target information of the same information type as the target information corresponding to any information bit among the N target information, in response to a swipe operation on the target information corresponding to any information bit, display the other target information in the information viewing interface.
[0220] In some embodiments, after displaying a preview image of the merged message in the social interface, the download module 4555 is further configured to: when the target information displayed in any information position is a video, in response to a click operation on any information position, play the video in any information position or play the video in the information viewing interface; when the target information displayed in any information position is an image, in response to a click operation on any information position, display the image in the information viewing interface; when the target information displayed in any information position is audio, in response to a click operation on any information position, play the audio in any information position or play the audio in the information viewing interface.
[0221] In some embodiments, after displaying a preview image of the merged message in the social interface, the download module 4555 is further configured to: in response to a character input operation for any target information, display comment information for commenting on any target information in the character input interface; in response to a sending operation for the comment information in the character input interface, perform any of the following processes: display a comment message independent of the merged message in the social interface, wherein the comment message includes any target information and comment information; display a comment message independent of the merged message in the social interface, wherein the comment message includes N target information and at least one information bit, with one target information displayed in each information bit, and comment information appended to any target information.
[0222] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the information transmission processing method and information reception processing method described in this application.
[0223] This application provides a computer-readable storage medium storing executable instructions. When these executable instructions are executed by a processor, they cause the processor to execute the information sending and receiving methods provided in this application. For example, ... Figures 3A-3B The information transmission processing method shown and Figure 3C The information receiving and processing method is shown.
[0224] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or it may be a variety of devices including one or any combination of the above-mentioned memories.
[0225] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
[0226] As an example, executable instructions may, but do not necessarily, correspond to files in a file system. They may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a Hyper Text Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple collaborating files (e.g., a file that stores one or more modules, subroutines, or code sections).
[0227] As an example, executable instructions can be deployed to execute on a single computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed across multiple locations and interconnected via a communication network.
[0228] In summary, in this embodiment, in response to a sequential sending trigger operation for multiple target messages, the sent target messages are displayed sequentially; in response to a merge sending trigger operation for multiple target messages, a merged message is displayed. Each information bit of the merged message displays one target message. The sending object can freely trigger sequential sending and merged sending, providing the sending object with the function of freely selecting the sending method, improving the efficiency of human-computer interaction. Furthermore, by merging sending, multiple target messages can be integrated into a merged message, which can effectively improve the efficiency of message sending and receiving.
[0229] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.
Claims
1. An information transmission and processing method, characterized in that, Applied to a first terminal, the method includes: Display multiple candidate messages, and select N target messages from the multiple candidate messages, where N is an integer greater than or equal to 2; In response to the sending operation of the N target messages one by one, N messages are displayed in the social interface, wherein each of the N messages carries one target message, and each of the N messages carries different target messages; The display merged transmission mode control is used to switch between an on state and a off state when triggered. The on state indicates that the merged transmission mode is on, and the off state indicates that the merged transmission mode is off. Display the send control; In response to the merge sending mode control being in the open state and receiving a trigger operation for the sending control, the trigger operation is identified as a merge sending operation for the N target messages, and a merged message obtained by merging the N target messages is displayed in the social interface, wherein the merged message includes the N target messages and at least one information bit, and one target message is displayed on each information bit.
2. The method according to claim 1, characterized in that, Displaying N target information items from the plurality of candidate information items as selected includes at least one of the following: In response to the selection operation for the multiple candidate information, the N selected target information from the multiple candidate information are displayed as the selected state; The N candidate messages that have been processed in the most recent set time period are identified as target messages and displayed as selected messages; Obtain the correlation degree between each candidate information and the receiving object of the N target information, sort the candidate information in descending order based on the correlation degree, select the top N candidate information as the selected N target information, and display the N target information as selected.
3. The method according to claim 1, characterized in that, The step of displaying N target information items from the multiple candidate information items as selected includes: Acquire historical information data of historically sent information, object data of the sending account, and candidate information data for each of the aforementioned candidate messages; For each of the aforementioned candidate pieces of information, the following processing is performed: The historical information data, the object data, and the candidate information data are processed by convolutional layers of the first neural network based on the parameters of the convolutional layers to obtain historical information features, object features, and candidate information features. The historical information features, object features, and candidate information features are fused based on the pooling layer parameters through the pooling layer of the first neural network to obtain fused features; The fused features are mapped based on the parameters of the fully connected layer of the first neural network to obtain the selection probability of the candidate information, wherein the selection probability represents the probability that the candidate information is selected by the sending account. The candidate information is sorted in descending order based on the selection probability. The top N candidate information are selected as the N target information and displayed as selected.
4. The method according to any one of claims 1-3, characterized in that, The display of multiple candidate information includes: For all the information stored in the sending account, sort it according to a specific dimension, and display the top-ranked information as candidate information; The information is stored in at least one of the following: the terminal device associated with the sending account, or the network storage device associated with the sending account. The specific dimensions include: recent usage time, usage frequency, creation time, and file size.
5. The method according to claim 1, characterized in that, The response to the message sending operation for each of the N target messages, displaying N messages in the social interface, includes: Display merged transmission mode control, wherein the merged transmission mode control is used to switch between an on state and a off state when triggered, the on state indicates that the merged transmission mode is on, and the off state indicates that the merged transmission mode is off; Display the send control; In response to the merged sending mode control being in the closed state and receiving a trigger operation for the sending control, the trigger operation is identified as a sending operation for each of the N target messages, and the N messages are displayed in the social interface.
6. The method according to claim 1, characterized in that, When the merged message includes multiple information bits, displaying a merged message obtained by merging the N target information bits in the social interface includes: One piece of target information is displayed in each of the information bits, wherein the target information displayed in different information bits is different; When the number of the plurality of information bits is less than N, the number of undisplayed target information is displayed on any one of the information bits, wherein the undisplayed target information refers to the target information that is not displayed in the information bit.
7. The method according to claim 6, characterized in that, The filling priority of the information bits is positively correlated with the first feature parameter of the target information, and the first feature parameter includes at least one of the following: the usage frequency of the target information, the storage time of the target information, the most recent transmission time of the target information, and the correlation between the target information and the recipient of the target information.
8. The method according to claim 1, characterized in that, When the merged message includes multiple information bits, displaying a merged message obtained by merging the N target information bits in the social interface includes: Different types of target information are displayed in the plurality of information bits respectively; When the number of information bits is less than the number of information types, the number of undisplayed target information bits is appended to any of the information bits. When the number of information bits is equal to the number of information types, an additional display number is added to the information bits containing multiple target information items. The number refers to the count of undisplayed target information belonging to the information type, wherein the undisplayed target information refers to the target information that is not displayed in the information bits.
9. The method according to claim 1, characterized in that, When the merged message includes multiple information bits, and the number of the multiple information bits is greater than the number of information types, displaying a merged message obtained by merging the N target messages in the social interface includes: When the number of information types is one, one piece of target information belonging to the information type is displayed in the plurality of information positions, wherein the target information displayed in different information positions is different; When there are multiple information types, one target information is displayed in each information position, wherein the type of the displayed target information covers all information types to which the N target information belong, and the displayed target information is the target information displayed in the information position; When there is undisplayed target information, the number of undisplayed target information belonging to the same information type as the undisplayed target information is additionally displayed in the information position of the displayed target information that belongs to the same information type. The undisplayed target information refers to the target information that is not displayed in the information position.
10. The method according to claim 1, characterized in that, When the merged message includes multiple information bits, displaying a merged message obtained by merging the N target information bits in the social interface includes: One piece of target information is displayed in each of the information bits, and the target information displayed in different information bits is different, wherein the information bits of target information belonging to the same information type are adjacent; When there is undisplayed target information belonging to the displayed information type, the number of undisplayed target information belonging to the displayed information type is additionally displayed on any of the information bits corresponding to the displayed information type; When there is undisplayed target information that does not belong to the type of already displayed information, the number of undisplayed target information that does not belong to the type of already displayed information is additionally displayed on any of the information bits; Wherein, the undisplayed target information refers to the target information that is not displayed in the information position, the displayed target information refers to the target information displayed in the information position, and the displayed information type is the information type to which the displayed target information belongs.
11. The method according to claim 1, characterized in that, When the number of information bits is one, displaying a merged message obtained by merging the N target information bits in the social interface includes: The information bit displays the target information with the highest correlation to the receiving object among the N target information items; The number of undisplayed target information is appended to the information position, wherein the undisplayed target information refers to the target information that is not displayed in the information position.
12. The method according to claim 11, characterized in that, Before displaying a merged message obtained by merging the N target messages in the social interface, the method further includes: Obtain the information features of each piece of target information; Obtain the object characteristics of the receiving object of the N target information; Determine the correlation between the information features of each piece of target information and the object features; Fill the merged message template, which includes the information bits, with the target information that has the highest relevance. The target information in the N target information that has not been filled into the merged message template is bound to the merged message template; The merged message template, after being filled and bound, is used as the merged message.
13. The method according to claim 1, characterized in that, After displaying a merged message obtained by merging the N target messages in the social interface, the method further includes: In response to a press operation on any of the information bits, the target information in the information bit is magnified and displayed during the duration of the press operation; In response to releasing the press operation, the magnified target information is restored to a size that matches the information bit.
14. The method according to claim 1, characterized in that, After displaying a merged message obtained by merging the N target messages in the social interface, the method further includes: In response to a click operation on any information position, the target information corresponding to that information position is displayed in the information viewing interface; In response to a sliding operation on the target information corresponding to the information bit, the previous or next piece of target information is displayed according to the direction of the sliding operation.
15. The method according to claim 1, characterized in that, When the merged message includes multiple information bits, and target information of different information types is displayed in the multiple information bits respectively, After displaying a merged message obtained by merging the N target messages in the social interface, the method further includes: In response to a click operation on any information position, the target information corresponding to that information position is displayed in the information viewing interface; When there are other target information with the same information type as the target information corresponding to any one of the information bits among the N target information, in response to the sliding operation of the target information corresponding to any one of the information bits, the other target information is displayed in the information viewing interface.
16. The method according to claim 1, characterized in that, After displaying a merged message obtained by merging the N target messages in the social interface, the method further includes: When the target information displayed in any information position is a video, in response to the click operation on the information position, the video is played in the information position or in the information viewing interface; When the target information displayed in any information position is an image, in response to a click operation on any of the information positions, the image is displayed in the information viewing interface; When the target information displayed in any information position is audio, in response to a click operation on the information position, the audio is played in the information position or in the information viewing interface.
17. The method according to claim 1, characterized in that, After displaying a merged message obtained by merging the N target messages in the social interface, the method further includes: In response to a character input operation for any target information, comment information for commenting on the target information is displayed in the character input interface; In response to the sending operation of the comment information in the character input interface, perform any of the following processes: The social interface displays comment messages independent of the merged message, wherein the comment messages include any one of the target messages and the comment information; The social interface displays comment messages independent of the merged message, wherein the comment message includes the N target information items and the at least one information bit, one target information item is displayed on each information bit, and the comment information is appended to any target information item.
18. An information receiving and processing method, characterized in that, Applied to a second terminal, the method includes: A preview image of the merged message is displayed in the social interface, and a download control corresponding to the merged message is also displayed in the social interface; The merge message is sent by the first terminal and is obtained by merging N target information items in response to the first terminal being in the enabled state of the merge sending mode control and receiving a trigger operation for the sending control. The merge message includes N target information items and at least one information bit, and one target information item is displayed on each information bit. N is an integer greater than or equal to 2. The trigger operation is identified as a merge sending operation for the N target information items. The merge sending mode control is used to switch between the enabled state and the disabled state when triggered. The enabled state indicates that the merge sending mode is enabled, and the disabled state indicates that the merge sending mode is disabled. In response to a trigger operation on the download control, at least a portion of the target information from the N target information items is downloaded, and the download progress of the at least a portion of the target information items is displayed in the social interface.
19. An information transmission and processing apparatus, characterized in that, Applied to a first terminal, the device includes: The first display module is used to display multiple candidate information and select N target information from the multiple candidate information, wherein N is an integer greater than or equal to 2; The sending module is used to respond to the sending operation of the N target messages one by one and display the N messages in the social interface, wherein each of the N messages carries one target message and each of the N messages carries different target messages; The sending module is further configured to display a merge sending mode control, wherein the merge sending mode control is used to switch between an on state and a off state when triggered, the on state indicating that the merge sending mode is enabled, and the off state indicating that the merge sending mode is disabled; display a sending control; in response to the merge sending mode control being in the on state and receiving a trigger operation for the sending control, the trigger operation is identified as a merge sending operation for the N target information, and a merged message obtained by merging the N target information is displayed in the social interface, wherein the merged message includes the N target information and at least one information bit, and one target information is displayed in each information bit.
20. The apparatus according to claim 19, characterized in that, The first display module is further configured to perform at least one of the following: in response to a selection operation on the plurality of candidate information, display the selected N target information among the plurality of candidate information as the selected state; The N candidate messages that have been processed in the most recent set time period are identified as target messages and displayed as selected messages; Obtain the correlation degree between each candidate information and the receiving object of the N target information, sort the candidate information in descending order based on the correlation degree, select the top N candidate information as the selected N target information, and display the N target information as selected.
21. The apparatus according to claim 19, characterized in that, The first display module is further configured to acquire historical information data of historically sent information, object data of the sending account, and candidate information data for each candidate piece of information; and to perform the following processing on each candidate piece of information: performing convolution processing based on convolutional layer parameters on the historical information data, the object data, and the candidate information data through the convolutional layer of the first neural network to obtain historical information features, object features, and candidate information features; performing fusion processing based on pooling layer parameters on the historical information features, the object features, and the candidate information features through the pooling layer of the first neural network to obtain fused features; performing mapping processing based on fully connected layer parameters on the fused features through the fully connected layer of the first neural network to obtain the selection probability of the candidate information, wherein the selection probability represents the probability that the candidate information is selected by the sending account; and performing descending sorting processing on the multiple candidate pieces of information based on the selection probability, selecting the top N candidate pieces of information as the N automatically selected target pieces of information, and displaying the N target pieces of information as selected.
22. The apparatus according to any one of claims 19-21, characterized in that, The first display module is further configured to perform sorting processing on all information stored in the sending account based on a specific dimension, and display the top-ranked information as candidate information; wherein, all information is stored in at least one of the following: the terminal device associated with the sending account, the network storage device associated with the sending account, and the specific dimension includes: recent usage time, usage frequency, creation time, and file size.
23. The apparatus according to claim 19, characterized in that, The sending module is further configured to display a merged sending mode control, wherein the merged sending mode control is used to switch between an on state and a off state when triggered, the on state indicating that the merged sending mode is enabled, and the off state indicating that the merged sending mode is disabled; display a sending control; in response to the merged sending mode control being in the off state and receiving a trigger operation for the sending control, the trigger operation is identified as a sending operation for the N target messages one by one, and the N messages are displayed in the social interface.
24. The apparatus according to claim 19, characterized in that, When the merged message includes multiple information bits The sending module is further configured to display one piece of target information in each of the information bits, wherein the target information displayed in different information bits is different; when the number of the plurality of information bits is less than N, the number of undisplayed target information is displayed in any one of the information bits, wherein the undisplayed target information refers to the target information that is not displayed in the information bit.
25. The apparatus according to claim 24, characterized in that, The filling priority of the information bits is positively correlated with the first feature parameter of the target information, and the first feature parameter includes at least one of the following: the usage frequency of the target information, the storage time of the target information, the most recent transmission time of the target information, and the correlation between the target information and the recipient of the target information.
26. The apparatus according to claim 19, characterized in that, When the merged message includes multiple information bits The sending module is further configured to display target information of different information types in the plurality of information bits respectively; when the number of information bits is less than the number of information types, the number of undisplayed target information is appended to any of the information bits; when the number of information bits is equal to the number of information types, the number is appended to the information bits having multiple target information, wherein the number refers to the count of undisplayed target information belonging to the information type, and the undisplayed target information refers to the target information not displayed in the information bits.
27. The apparatus according to claim 19, characterized in that, When the merged message includes multiple information bits, and the number of the multiple information bits is greater than the number of information types, The sending module is further configured to: when the number of information types is one, display one target information belonging to the information type in the plurality of information bits, wherein the target information displayed in different information bits is different; when the number of information types is multiple, display one target information in each information bit, wherein the type of the displayed target information covers all information types to which the N target information belong, and the displayed target information is the target information displayed in the information bit; when there is undisplayed target information, additionally display the number of undisplayed target information belonging to the same information type as the undisplayed target information in the information bit of the displayed target information belonging to the same information type, wherein the undisplayed target information refers to the target information not displayed in the information bit.
28. The apparatus according to claim 19, characterized in that, When the merged message includes multiple information bits The sending module is further configured to display one piece of target information in each of the information bits, and the target information displayed in different information bits is different, wherein the information bits of target information belonging to the same information type are adjacent; when there is undisplayed target information belonging to the displayed information type, the number of undisplayed target information belonging to the displayed information type is additionally displayed in any of the information bits corresponding to the displayed information type; when there is undisplayed target information not belonging to the displayed information type, the number of undisplayed target information not belonging to the displayed information type is additionally displayed in any of the information bits; wherein, the undisplayed target information refers to the target information not displayed in the information bit, the displayed target information refers to the target information displayed in the information bit, and the displayed information type is the information type to which the displayed target information belongs.
29. The apparatus according to claim 19, characterized in that, When the number of information bits is one, The sending module is further configured to display, in the information bit, the target information with the highest correlation to the receiving object among the N target information; and to additionally display, in the information bit, the number of target information not displayed, wherein the target information not displayed refers to the target information not displayed in the information bit.
30. The apparatus according to claim 29, characterized in that, Before displaying a merged message obtained by merging the N target messages in the social interface. The sending module is further configured to acquire information features of each of the target information messages; acquire object features of the receiving objects of the N target information messages; and determine the correlation between the information features of each target information message and the object features. Fill the merged message template, which includes the information bits, with the target information that has the highest relevance. The target information that is not filled into the merged message template from the N target information is bound to the merged message template; the merged message template that has been filled and bound is used as the merged message.
31. The apparatus according to claim 19, characterized in that, After displaying a merged message in the social interface, which is the result of merging the N target messages, The sending module is further configured to, in response to a pressing operation on any one of the information bits, enlarge and display the target information in the information bit during the duration of the pressing operation; and, in response to releasing the pressing operation, restore the enlarged target information to a size matching the information bit.
32. The apparatus according to claim 19, characterized in that, After displaying a merged message in the social interface, which is the result of merging the N target messages, The sending module is further configured to, in response to a click operation on any information position, display the target information corresponding to the any information position in the information viewing interface; and, in response to a swipe operation on the target information corresponding to the information position, display the previous or next piece of target information according to the direction of the swipe operation.
33. The apparatus according to claim 19, characterized in that, When the merged message includes multiple information bits, and different types of target information are displayed in the multiple information bits, after the merged message obtained by merging the N target information is displayed in the social interface, The sending module is further configured to, in response to a click operation on any information position, display the target information corresponding to the arbitrary information position in the information viewing interface; when there are other target information of the same information type as the target information corresponding to the arbitrary information position among the N target information, in response to a swipe operation on the target information corresponding to the arbitrary information position, display the other target information in the information viewing interface.
34. The apparatus according to claim 19, characterized in that, The sending module is also configured to, in response to a click operation on any one of the information bits, play the video in the any one of the information bits or play the video in the information viewing interface when the target information displayed in any one of the information bits is a video; When the target information displayed in any information position is an image, in response to a click operation on any of the information positions, the image is displayed in the information viewing interface; when the target information displayed in any information position is audio, in response to a click operation on any of the information positions, the audio is played in the information position or played in the information viewing interface.
35. The apparatus according to claim 19, characterized in that, After displaying a merged message in the social interface, which is the result of merging the N target messages, The sending module is further configured to, in response to a character input operation for any target information, display comment information for commenting on the target information in the character input interface; and, in response to a sending operation for the comment information in the character input interface, perform any of the following processes: display a comment message independent of the merged message in the social interface, wherein the comment message includes the target information and the comment information; or display a comment message independent of the merged message in the social interface, wherein the comment message includes the N target information and the at least one information bit, with one target information displayed in each information bit, and the comment information appended to the target information.
36. An information receiving and processing device, characterized in that, Applied to a second terminal, the device includes: The second display module is used to display a preview image of the merged message in the social interface, and to display a download control corresponding to the merged message in the social interface; The merge message is sent by the first terminal and is obtained by merging N target information items in response to the first terminal being in the enabled state of the merge sending mode control and receiving a trigger operation for the sending control. The merge message includes N target information items and at least one information bit, and one target information item is displayed on each information bit. N is an integer greater than or equal to 2. The trigger operation is identified as a merge sending operation for the N target information items. The merge sending mode control is used to switch between the enabled state and the disabled state when triggered. The enabled state indicates that the merge sending mode is enabled, and the disabled state indicates that the merge sending mode is disabled. The download module is configured to respond to a trigger operation on the download control, download at least a portion of the target information from the N target information items, and display the download progress of the at least a portion of the target information in the social interface.
37. An electronic device, characterized in that, The electronic device includes: Memory, used to store executable instructions; The processor, when executing executable instructions stored in the memory, implements the information transmission processing method according to any one of claims 1 to 17 or the information reception processing method according to claim 18.
38. A computer-readable storage medium storing executable instructions, characterized in that, When the executable instructions are executed by the processor, they implement the information transmission processing method according to any one of claims 1 to 17 or the information reception processing method according to claim 18.
39. A computer program product comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by the processor, they implement the information transmission processing method according to any one of claims 1 to 17 or the information reception processing method according to claim 18.
Citation Information
Patent Citations
Message forwarding method and apparatus
CN105049317A