Video call processing method

Abstract

Disclosed in the present application is a video call processing method. The video call processing method is applied to a cloud album server, and comprises: acquiring scene characteristic information of a first client that is sent by the first client; searching a cloud album for a target scene image, which matches the scene characteristic information and a possible call duration of a video call; generating an image video stream on the basis of the target scene image; and sending the image video stream to a video stream receiving end, such that the video stream receiving end replaces the video stream, which is sent to a second client, with the image video stream, and the video stream receiving end comprises at least one of an instant messaging server and the first client.

Description

Video call handling methods

[0001] Cross-reference to related applications

[0002] This application is based on and claims priority to Chinese Patent Application No. 202411179598.5, filed on August 26, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application belongs to the field of cloud computing and cloud storage technology, and in particular relates to a method for processing video calls. Background Technology

[0004] Smart cloud photo albums on mobile cloud phones or mobile cloud storage can achieve functions such as facial recognition and automatic categorization for quick image searching. Users often need to share images of local scenery when video calling loved ones while traveling.

[0005] In existing methods, if a user wants to share an image with the person on the call, they can choose to minimize the video call window or adjust the window to a floating window, and then select the image to share based on the chat interface.

[0006] However, this method requires switching to a chat interface when sharing images, which is cumbersome and affects the user experience. Summary of the Invention

[0007] One aspect of this application provides a video call processing method applied to a cloud photo album server, comprising:

[0008] Obtain the scene feature information of the first client, which is sent by the first client.

[0009] Search the cloud photo album for target scene images that match the scene feature information and the possible duration of the video call;

[0010] Generate an image and video stream based on the target scene image;

[0011] The image video stream is sent to the video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with the image video stream. The video stream receiving end includes at least one of an instant messaging server and a first client.

[0012] One aspect of this application provides a video call processing method applied to a first client, comprising:

[0013] Displays a video call interface, which includes a first control.

[0014] In response to input to the first control, obtain the actual scene image of the actual scene where the first client is located;

[0015] Identify scene feature information in the actual scene image of the first client;

[0016] Scene feature information is sent to the cloud photo album server so that the cloud photo album server can obtain image and video streams using the scene feature information.

[0017] One aspect of this application provides a video call processing apparatus applied to a cloud photo album server, comprising:

[0018] The information acquisition module is configured to acquire scene feature information of the first client, which is sent by the first client.

[0019] The image search module is configured to search for target scene images from the cloud photo album that match scene feature information and the possible duration of the video call.

[0020] The video stream generation module is configured to generate an image-video stream based on the target scene image;

[0021] The first video stream sending module is configured to send an image video stream to a video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with an image video stream. The video stream receiving end includes at least one of an instant messaging server and a first client.

[0022] In one aspect of this application, a video call processing apparatus is provided, applied to a first client, comprising:

[0023] The interface display module is configured to display a video call interface, which includes a first control.

[0024] The image acquisition module is configured to acquire an actual scene image of the actual scene where the first client is located in response to input to the first control;

[0025] The information recognition module is configured to recognize scene feature information in the actual scene image of the first client;

[0026] The information sending module is configured to send scene feature information to the cloud album server so that the cloud album server can obtain image and video streams using the scene feature information.

[0027] In one aspect of this application, an electronic device is provided, the device including: a memory and a program or instructions stored in the memory and executable on a processor, wherein when the program or instructions are executed by the processor, they implement the video call processing method provided in any aspect of the above-described embodiments of this application.

[0028] One aspect of this application provides a readable storage medium storing a program or instructions, which, when executed by a processor, implements the video call processing method provided in any aspect of the above-described embodiments of this application.

[0029] In one aspect of the embodiments of this application, a computer program product is provided, wherein when the instructions in the computer program product are executed by the processor of an electronic device, the electronic device performs a video call processing method as provided in any aspect of the embodiments of this application described above.

[0030] In the video call processing method provided in this application embodiment, when a video call connection is established between a first client and a second client, the cloud album server receives scene feature information sent by the first client, then retrieves a scene image from the cloud album that matches the scene feature information and the possible duration of the video call, generating an image video stream. Finally, the image video stream is sent to the video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with the image video stream. Thus, this application embodiment generates an image video stream based on the scene feature information of the first client, retrieving the corresponding scene image from the cloud album. By replacing the video screen sent to the second client with the image video stream, the first and second clients can share multiple images without switching to the chat interface, reducing the cumbersome steps for users sharing images during video calls and improving the user experience. Attached Figure Description

[0031] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1 is a flowchart illustrating a video call processing method according to an embodiment of this application;

[0033] Figure 2 is a flowchart illustrating a video call processing method provided in another embodiment of this application;

[0034] Figure 3 is a schematic diagram of a video call interface provided in one embodiment of this application;

[0035] Figure 4 is a schematic diagram of a video call mode candidate control provided in an embodiment of this application;

[0036] Figure 5 is a schematic diagram of the structure of a video call processing system provided in an embodiment of this application;

[0037] Figure 6 is a schematic diagram of the structure of a video call processing device provided in an embodiment of this application;

[0038] Figure 7 is a schematic diagram of the structure of a video call processing device provided in another embodiment of this application;

[0039] Figure 8 is a schematic diagram of the structure of a video call processing device provided in one embodiment of this application. Detailed Implementation

[0040] The features and exemplary embodiments of various aspects of this application will be described in detail below. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain this application and not to limit it. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples.

[0041] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes said element.

[0042] It should be noted that the acquisition, storage, use, and processing of data in the technical solution of this application all comply with the relevant provisions of national laws and regulations.

[0043] It should be noted that in the embodiments of this application, certain software, components, models and other existing solutions in the industry may be mentioned. These should be regarded as exemplary and are only intended to illustrate the feasibility of implementing the technical solution of this application. However, it does not mean that the applicant has used or necessarily used the solution.

[0044] In related technologies, if a user wants to share an image with a caller, they can minimize the video call window or make it a floating window, and then select the image to share from the chat interface. However, this method requires switching the chat interface when sharing an image, which is cumbersome and affects the user experience.

[0045] The purpose of this application is to provide a video call processing method, apparatus, device, storage medium, and program product. In the video call processing method provided by this application, when a video call connection is established between a first client and a second client, a cloud photo album server receives scene feature information sent by the first client. Then, it retrieves a scene image from the cloud photo album that matches the scene feature information and the possible duration of the video call, generating an image-video stream. Finally, the image-video stream is sent to a video stream receiving end, so that the video stream sent to the second client is replaced with the image-video stream. Thus, this application embodiment generates an image-video stream based on the scene feature information of the first client, retrieving the corresponding scene image from the cloud photo album. By replacing the video screen sent to the second client with the image-video stream, the first and second clients can share multiple images without switching to a chat interface, reducing the cumbersome steps for users sharing images during video calls and improving the user experience.

[0046] The following describes specific embodiments of the video call processing method, apparatus, device, storage medium, and program product provided in this application. The video call processing method will be described first.

[0047] Figure 1 is a flowchart illustrating a video call processing method applied to a cloud photo album server. The video call processing method may include the following steps S101 to S104.

[0048] S101, Obtain the scene feature information of the first client sent by the first client.

[0049] In this embodiment, the first client is the party sharing scene images in the established video call.

[0050] Scene feature information refers to feature information that characterizes the scene in which the first client is located. For example, scene feature information may be at least one of scene location information and scene type information.

[0051] As an example, in response to an image sharing request triggered by a user on the first client, the first client captures scene feature information of the current scene through its camera and sends the scene feature information to the cloud album server, so that the cloud album server receives the scene feature information captured by the first client.

[0052] S102, search for target scene images in the cloud photo album that match the scene feature information and the possible duration of the video call.

[0053] In this embodiment, at least one scene image uploaded by the first client is stored in the cloud album.

[0054] The possible duration of the video call is estimated based on the historical call duration of the first client.

[0055] As an example, the cloud photo album server can obtain the maximum number of scene images to select by dividing the possible duration of a video call by the preset playback frame rate of each scene image.

[0056] Then, search the cloud album for at least one target scene image that matches the scene feature information and is less than or equal to the maximum number of scene images to select.

[0057] S103, Generate an image and video stream based on the target scene image.

[0058] In this embodiment, the cloud photo album server sorts the images of each target scene according to a preset order, thereby generating an image and video stream. The preset order can be either the order of scene types or the order of shooting time.

[0059] S104, the image video stream is sent to the video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with the image video stream. The video stream receiving end includes at least one of an instant messaging server and a first client.

[0060] In this embodiment, the second client is the party that receives the shared scene image during the established video call.

[0061] An instant messaging server is the server corresponding to an instant messaging program that establishes a video call connection.

[0062] As an example, after generating the image and video stream, the cloud photo album server sends the image and video stream to the first client. The first client then forwards the image and video stream to the instant messaging server, which replaces the video stream that would have been transmitted to the second client with the image and video stream, thus allowing the image and video stream to be displayed in the second client's video call interface.

[0063] As another example, after generating the image and video stream, the cloud photo album server sends the image and video stream directly to the instant messaging server. The instant messaging server then replaces the video stream that should have been transmitted to the second client with the image and video stream, so that the image and video stream can be displayed in the video call interface of the second client.

[0064] In this embodiment, when a video call connection is established between the first client and the second client, the cloud photo album server receives scene feature information sent by the first client. Then, it retrieves a scene image from the cloud photo album that matches the scene feature information and the possible duration of the video call, generating an image-video stream. Finally, the image-video stream is sent to the video stream receiving end, so that the receiving end replaces the video stream sent to the second client with the image-video stream. Thus, this embodiment generates an image-video stream based on the scene feature information of the first client, retrieving the corresponding scene image from the cloud photo album. By replacing the video screen sent to the second client with the image-video stream, the first and second clients can share multiple images without switching to the chat interface, reducing the cumbersome steps required for sharing images during video calls and improving the user experience.

[0065] As an optional embodiment, S104 may specifically include:

[0066] Upon obtaining the server identification information of the instant messaging server, the image and video stream is sent to the instant messaging server so that the instant messaging server replaces the video stream sent to the second client with the image and video stream.

[0067] Without obtaining the server identification information of the instant messaging server, the image and video stream is sent to the first client, so that the first client sends the image and video stream to the instant messaging server, and then the instant messaging server replaces the video stream sent to the second client with the image and video stream.

[0068] In this embodiment, as an example, the server identification information of the instant messaging server can be sent to the cloud photo album server by the first client.

[0069] If the cloud photo album server receives the server identification information sent by the first client, it directly sends the image and video stream to the instant messaging server based on the server identification information. If the cloud photo album server does not receive the server identification information sent by the first client, it sends the image and video stream to the first client, and the first client forwards the image and video stream to the instant messaging server.

[0070] This embodiment provides two methods for sending image and video streams based on whether the cloud photo album server obtains the server identification information of the instant messaging server. This ensures that the cloud photo album server successfully sends the image and video streams to the instant messaging server, allowing the instant messaging server to replace the video stream sent to the second client with the image and video stream, thereby improving the user's experience during video calls.

[0071] As an optional embodiment, S102 may specifically include:

[0072] The maximum playback duration of the image and video stream is obtained based on the possible duration of the video call and the preset duration ratio of the image and video stream.

[0073] The number of images is determined based on the maximum playback duration of the image and video stream and preset playback parameters;

[0074] Find the target scene image in the cloud album that corresponds to the number of images and scene feature information.

[0075] In this embodiment, the preset duration percentage is used to characterize the proportion of the image / video stream to the possible duration of the video call. For example, the expected playback duration of the generated image / video stream can be set to be at most one-tenth of the possible duration of the video call.

[0076] Preset playback parameters are used to characterize factors that affect the playback speed of a video stream. For example, preset playback parameters may be at least one of a preset playback frame rate for scene images and a preset playback speed for scene images.

[0077] As an example, assuming the preset duration of the image and video stream accounts for one-tenth, and the possible duration of the video call is 10 minutes, the cloud photo album server can determine that the maximum playback duration of the image and video stream is one minute based on the possible duration of the video call and the preset duration of the image and video stream.

[0078] Then, the maximum playback duration of the image video stream is divided by the preset playback frame rate of each scene image to obtain the number of scene images. Finally, based on the matching degree between each scene image in the cloud album and the scene feature information, the target scene image corresponding to the number of images is searched from the cloud album.

[0079] This embodiment determines the number of images in the target scene based on the potential duration of the video call and the preset duration ratio of the image / video stream. This ensures that the final generated image / video stream has an appropriate length, allowing for normal playback without interruption and minimizing impact on the user's video call experience.

[0080] As an optional embodiment, the possible duration of a video call can be determined in any of the following ways:

[0081] The first average value corresponding to the first historical video call duration of the first client is determined as the possible continuous video call duration;

[0082] The second average value corresponding to the second historical video call duration between the first client and the second client is determined as the possible continuous call duration of the video call.

[0083] In this embodiment, as an example, the duration of each first historical video call of the first client within a preset historical time period can be obtained, and then a first average can be calculated based on each first historical video call duration. Finally, the first average can be determined as the possible continuous call duration of the video call.

[0084] As another example, the second historical video call duration between the first client and the second client within a preset historical time period can be obtained, and then a second average can be calculated based on the second historical video call duration. Finally, the second average can be determined as the possible continuous call duration of the video call.

[0085] In this embodiment, the possible duration of a video call is obtained by utilizing the first historical video call duration of the first client, or the second historical video call duration between the first client and the second client. This ensures that the final generated image / video stream has an appropriate length, avoiding situations where the image / video stream cannot be played properly due to its excessive length.

[0086] As an optional embodiment, the preset playback parameter is the preset playback frame rate;

[0087] The number of images is determined based on the maximum playback duration of the image / video stream and preset playback parameters, which may specifically include:

[0088] The actual playback duration of the image and video stream is determined based on the maximum playback duration of the image and video stream. The actual playback duration is less than or equal to the maximum playback duration.

[0089] Divide the actual playback duration of the image video stream by the preset playback frame rate to obtain the number of images in the target scene.

[0090] In this embodiment, the actual playback duration of the image and video stream can be less than or equal to the maximum playback duration.

[0091] As an example, if the maximum playback duration of the image / video stream is 1 minute, you can choose an actual playback duration of 5 seconds for the image / video stream.

[0092] Then, obtain the preset playback frame rate of the target scene image. If the preset playback frame rate is 10 frames per second (FPS), then the number of images in the target scene image can be determined to be 50.

[0093] This embodiment utilizes the maximum playback duration of the image / video stream and preset playback parameters to determine the number of images in the target scene. This ensures that the final generated image / video stream has an appropriate duration, allowing for uninterrupted playback and minimizing disruption to the user's video call experience.

[0094] As an optional embodiment, searching for scene images corresponding to the number of images and scene feature information from the cloud photo album may specifically include:

[0095] Obtain the matching degree between scene images and scene feature information in the cloud photo album;

[0096] The scene images are sorted in descending order of matching degree to obtain an image sequence;

[0097] Select the scene image that ranks in the top N positions from the image sequence as the target scene image; N equals the number of images.

[0098] In this embodiment, the matching degree is used to characterize the matching relationship between the scene image and the scene feature information.

[0099] The image sequence includes multiple scene images, which are sorted in descending order of matching degree.

[0100] As an example, after obtaining the scene feature information from the first client, the cloud photo album server determines the matching degree between each scene image in the cloud photo album and the scene feature information. Then, the scene images are sorted in descending order of matching degree to obtain an image sequence. Finally, the scene image ranking in the top N positions from the image sequence is selected as the target scene image, where N equals the number of images.

[0101] As another example, if the number of scene images matching the scene feature information is less than N, a portion of the scene images can be copied to meet the quantity requirement. This copying can be done by selecting scene images with higher matching degrees in descending order of matching degree, or by arbitrarily selecting scene images from among those matching the scene feature information.

[0102] In this embodiment, target scene images are selected from the cloud album in descending order of matching degree, corresponding to the number of images. This ensures that the final shared scene image matches the scene image the user wants to share to the highest degree, thus avoiding significant discrepancies between the actual shared scene image and the user's intended scene image, and improving the user's video call experience.

[0103] As an optional embodiment, Figure 2 provides a flowchart of a video call processing method, which is applied to a first client and may include the following steps S201 to S204.

[0104] S201, Display the video call interface, which includes a first control.

[0105] In this embodiment, when the first client and the second client establish a video call connection, the video call interface will be displayed.

[0106] The first client and the second client are the clients that establish a video call. The first client is the one sharing the scene image, and the second client is the one receiving the shared scene image.

[0107] Figure 3 shows a schematic diagram of a video call interface. The video call interface includes a first control, which is used to control whether to perform scene image replacement.

[0108] If scene image replacement is not selected, the second client will display a normal video stream captured by the camera of the first client; if scene image replacement is selected, the normal video stream displayed on the second client will eventually be replaced with an image-video stream generated based on the scene image.

[0109] S202, in response to input to the first control, obtain the actual scene image of the actual scene of the first client.

[0110] In this embodiment, as an example, when the user triggers the first control on the video call interface, the first client will capture an image of the actual scene using its camera. The camera can be either the front-facing camera or the rear-facing camera of the first client.

[0111] As another example, when a user triggers the first control on the video call interface, the first client will periodically capture images of the actual scene using its camera at a preset capture frequency. Whenever the scene feature information of the actual scene image changes, a new image video stream will be generated and sent to the instant messaging server.

[0112] S203, identify scene feature information in the actual scene image of the first client.

[0113] In this embodiment, the scene feature information is feature information characterizing the scene in which the first client is located. For example, the scene feature information may be at least one of scene location information and scene type information.

[0114] As an example, after the first client captures an image of the actual scene through the camera, it obtains the location and scene type corresponding to the actual scene image, thereby obtaining the scene feature information corresponding to the actual scene image.

[0115] S204, send the scene feature information to the cloud album server so that the cloud album server can use the scene feature information to obtain the image and video stream.

[0116] In this embodiment, after the first client sends scene feature information to the cloud album server, the cloud album server finds target scene images matching the scene feature information from the cloud album. These target scene images are then sorted in a preset order to generate an image-video stream. In this embodiment, when the first client and the second client establish a video call connection, the cloud album server receives the scene feature information sent by the first client, then retrieves scene images from the cloud album that match the scene feature information and the possible duration of the video call, generating an image-video stream. Finally, the image-video stream is sent to the video stream receiving end, so that the video stream sent to the second client is replaced with the image-video stream. Thus, this embodiment generates an image-video stream based on the scene feature information of the first client, retrieving corresponding scene images from the cloud album. By replacing the video screen sent to the second client with the image-video stream, the first and second clients can share multiple images without switching to the chat interface, reducing the cumbersome steps for users sharing images during video calls and improving the user experience.

[0117] As an optional embodiment, after S204, the video call processing method may further include:

[0118] Receive image and video streams sent by the cloud photo album server;

[0119] The image / video stream is sent to the instant messaging server so that the instant messaging server replaces the video stream sent to the second client with the image / video stream.

[0120] In this embodiment, the instant messaging server is the server corresponding to the instant messaging program that establishes the video call connection.

[0121] As an example, when the cloud photo album server sends an image and video stream to the first client, the first client receives the image and video stream sent by the cloud photo album server, and then the first client sends the image and video stream and the estimated playback duration of the image and video stream to the instant messaging server.

[0122] After receiving the image and video stream, the instant messaging server will pause sending the ordinary camera footage captured by the first client to the second client, and instead send the image and video stream to the second client for playback.

[0123] Specifically, the first client has first identification information and the second client has second identification information, so that the instant messaging server can interact with the first client and the second client based on the corresponding identification information.

[0124] In this embodiment, when the cloud photo album server sends the image and video stream to the first client, the first client will forward the image and video stream to the instant messaging server to ensure that the image and video stream is successfully sent to the instant messaging server. This allows the instant messaging server to replace the video stream sent to the second client with the image and video stream, improving the user's experience during video calls.

[0125] As an optional embodiment, prior to S201, the video call processing method may further include:

[0126] Displays a candidate control for video call modes;

[0127] In response to input from the video call mode candidate control to select the scene image sharing mode control, a video call connection is established between the first client and the second client, and the video call interface is displayed.

[0128] In this embodiment, the video call mode candidate control is a control used to select a video call mode. The video call mode candidate control includes a scene image sharing mode control and a normal mode control. Specifically, the scene image sharing mode control is used to control whether to enter the scene image sharing video call mode, and the normal mode control is used to control whether to enter the normal video call mode.

[0129] As an example, Figure 4 illustrates a schematic diagram of a video call mode candidate control. When the user selects the scene image sharing mode control from the scene image sharing mode control and the normal mode control, the first client establishes a video call connection with the second client and displays the video call interface, allowing the user to select and share a scene image within the video call interface.

[0130] This embodiment provides two video call modes for users to choose from. Users can select the scene image sharing mode if they wish to share scene images, and the normal mode if they do not wish to share scene images. Providing two video call modes enhances the user experience.

[0131] As an optional embodiment, scene feature information includes scene type and / or scene location;

[0132] S203 may specifically include at least one of the following:

[0133] Perform scene recognition on real-world scene images to obtain the scene type corresponding to the real-world scene images;

[0134] Position recognition is performed on real-world scene images to obtain the scene location corresponding to the real-world scene image.

[0135] In this embodiment, as an example, when the scene feature information includes the scene type, the first client performs scene recognition on the actual scene image captured by the camera. If the scene type corresponding to the actual scene image is identified as a beach, the scene feature information will then mark the scene type as a beach.

[0136] As another example, when the scene feature information includes the scene location, the first client performs location recognition on the actual scene image captured by the camera. If the scene location information corresponding to the actual scene image is recognized, the scene feature information will include the scene location information.

[0137] This embodiment identifies the scene type and location of the actual scene image from the first client, obtaining scene feature information. This helps to identify the scene image that the user is most likely to share using the scene feature information, avoiding significant differences between the actual shared scene image and the scene image the user wants to share, thus improving the user's video call experience.

[0138] A method for processing video calls. Accordingly, this application also provides specific embodiments of a video call processing system.

[0139] Figure 5 shows a schematic diagram of a video call processing system. The system includes a first client, an instant messaging server, a second client, a cloud photo album server, and a cloud photo album.

[0140] Specifically, the first client is electrically connected to the cloud photo album server and the instant messaging server, the cloud photo album server is electrically connected to the first client, the instant messaging server, and the cloud photo album, the cloud photo album is electrically connected to the cloud photo album server, the instant messaging server is electrically connected to the first client, the second client, and the cloud photo album server, and the second client is electrically connected to the instant messaging server.

[0141] A method for processing video calls. Accordingly, this application also provides specific embodiments of a video call processing apparatus.

[0142] As shown in Figure 6, this application embodiment provides a video call processing device applied to a cloud photo album server, including:

[0143] The information acquisition module 610 is configured to acquire scene feature information of the first client, which is sent by the first client.

[0144] The image search module 620 is configured to search for target scene images from the cloud photo album that match scene feature information and the possible duration of the video call.

[0145] The video stream generation module 630 is configured to generate an image video stream based on the target scene image;

[0146] The first video stream sending module 640 is configured to send an image video stream to a video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with an image video stream. The video stream receiving end includes at least one of an instant messaging server and a first client.

[0147] As an optional embodiment, the first video stream sending module 640 specifically includes the following units:

[0148] The video stream sending unit is configured to send an image video stream to the instant messaging server upon obtaining the server identification information of the instant messaging server, so that the instant messaging server replaces the video stream sent to the second client with the image video stream.

[0149] The video stream sending unit is configured to send an image video stream to a first client without obtaining the server identification information of the instant messaging server, so that the first client sends the image video stream to the instant messaging server, thereby causing the instant messaging server to replace the video stream sent to the second client with the image video stream.

[0150] As an optional embodiment, the image search module 620 specifically includes the following units:

[0151] The duration determination unit is configured to determine the maximum playback duration of the image and video stream based on the possible duration of the video call and the preset duration ratio of the image and video stream.

[0152] The quantity determination unit is configured to determine the number of images based on the maximum playback duration of the image video stream and preset playback parameters;

[0153] The image search unit is configured to search for target scene images from the cloud photo album that correspond to the number of images and scene feature information.

[0154] As an optional embodiment, the duration determination unit specifically includes the following sub-units:

[0155] The first duration determination subunit is configured to determine the first average value corresponding to the first historical video call duration of the first client as the possible continuous call duration of the video call;

[0156] The second duration determination subunit is configured to determine the second average value corresponding to the second historical video call duration between the first client and the second client as the possible continuous call duration of the video call.

[0157] As an optional embodiment, the preset playback parameter is the preset playback frame rate;

[0158] The quantity determination unit specifically includes the following sub-units:

[0159] The third duration determination subunit is configured to determine the actual playback duration of the image and video stream based on the maximum playback duration of the image and video stream, wherein the actual playback duration is less than or equal to the maximum playback duration.

[0160] The quantity determination subunit is configured to divide the actual playback duration of the image video stream by the preset playback frame rate to obtain the number of images in the target scene.

[0161] As an optional embodiment, the image search unit specifically includes the following sub-units:

[0162] The matching degree acquisition subunit is configured to acquire the matching degree between each scene image and scene feature information in the cloud album;

[0163] The image sorting subunit is configured to sort the scene images in descending order of matching degree to obtain an image sequence;

[0164] The image selection subunit is configured to select the scene image that ranks in the top N positions from the image sequence as the target scene image; N equals the number of images.

[0165] As an optional embodiment, as shown in FIG7, this application embodiment also provides a video call processing apparatus applied to a first client, including:

[0166] The interface display module 710 is configured to display a video call interface, which includes a first control.

[0167] The image acquisition module 720 is configured to acquire an actual scene image of the actual scene where the first client is located in response to input to the first control;

[0168] The information recognition module 730 is configured to recognize scene feature information in the actual scene image of the first client;

[0169] The information sending module 740 is configured to send scene feature information to the cloud photo album server so that the cloud photo album server can obtain image and video streams using the scene feature information.

[0170] As an optional embodiment, the video call processing apparatus may further include:

[0171] The video stream receiving module is configured to receive image and video streams sent by the cloud photo album server.

[0172] The second video stream sending module is configured to send an image video stream to an instant messaging server, so that the instant messaging server replaces the video stream sent to the second client with an image video stream.

[0173] As an optional embodiment, the video call processing device further includes the following modules:

[0174] The control display module is configured to display candidate controls for video call modes;

[0175] The call connection module is configured to establish a video call connection between the first client and the second client and display the video call interface in response to input from the video call mode candidate control to select the scene image sharing mode control.

[0176] As an optional embodiment, scene feature information includes scene type and / or scene location;

[0177] The information recognition module 730 specifically includes the following units:

[0178] The scene recognition unit is configured to perform scene recognition on the actual scene image to obtain the scene type corresponding to the actual scene image;

[0179] The location recognition unit is configured to perform location recognition on the actual scene image to obtain the scene location corresponding to the actual scene image.

[0180] A method for processing video calls. Accordingly, this application also provides specific embodiments of a video call processing device.

[0181] Figure 8 shows a schematic diagram of the hardware structure of the video call processing device provided in an embodiment of this application.

[0182] The processing device for video calls may include a processor 801 and a memory 802 storing computer program instructions.

[0183] Specifically, the processor 801 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.

[0184] Memory 802 may include mass storage for data or instructions. For example, and not limitingly, memory 802 may include a hard disk drive (HDD), floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 802 may include removable or non-removable (or fixed) media. Where appropriate, memory 802 may be internal or external to the integrated gateway disaster recovery device. In a particular embodiment, memory 802 is non-volatile solid-state memory.

[0185] Memory may include read-only memory (ROM), random access memory (RAM), disk storage media devices, optical storage media devices, flash memory devices, and electrical, optical, or other physical / tangible memory storage devices. Therefore, typically, memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to one aspect of this application.

[0186] The processor 801 reads and executes computer program instructions stored in the memory 802 to implement any of the video call processing methods in the above embodiments.

[0187] In one example, the video call processing device may further include a communication interface 803 and a bus 810. As shown in Figure 8, the processor 801, memory 802, and communication interface 803 are connected via the bus 810 and communicate with each other.

[0188] The communication interface 803 is mainly configured to enable communication between various modules, devices, units and / or equipment in the embodiments of this application.

[0189] Bus 810 includes hardware, software, or both, that couples components of a video call processing device together. For example, and not limitingly, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, bus 810 may include one or more buses. Although specific buses are described and illustrated in embodiments of this application, any suitable bus or interconnect is contemplated herein.

[0190] Furthermore, in conjunction with the video call processing methods in the above embodiments, this application embodiment can provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when these computer program instructions are executed by a processor, they implement any of the video call processing methods in the above embodiments.

[0191] Furthermore, in conjunction with the video call processing methods in the above embodiments, this application embodiment can provide a computer program product for implementation. When the instructions in this computer program product are executed by the processor of an electronic device, any one of the video call processing methods in the above embodiments is implemented.

[0192] It should be clarified that this application is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of this application is not limited to the specific steps described and shown. Those skilled in the art can make various changes, modifications, and additions, or change the order of steps, after understanding the spirit of this application.

[0193] The functional blocks shown in the above-described structural diagram can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of this application are programs or code segments used to perform the required tasks. Programs or code segments can be stored on a machine-readable medium or transmitted over a transmission medium or communication link via data signals carried on a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.

[0194] It should also be noted that the exemplary embodiments mentioned in this application describe methods or systems based on a series of steps or apparatus. However, this application is not limited to the order of the above steps; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0195] The aspects of this application have been described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments disclosed in this application. It should be understood that each block in the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that these instructions, executable via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions / actions specified in one or more blocks of the flowchart illustrations and / or block diagrams. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field-programmable logic circuit. It is also understood that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can also be implemented by dedicated hardware performing the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

[0196] The above description is merely a specific implementation of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.

Claims

1. A video call processing method, applied to a cloud photo album server, the method comprising: Obtain scene feature information of the first client sent by the first client; Search the cloud photo album for a target scene image that matches the scene feature information and the possible duration of the video call; Generate an image and video stream based on the target scene image; The image video stream is sent to a video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with the image video stream. The video stream receiving end includes at least one of an instant messaging server and the first client.

2. The method according to claim 1, wherein, The step of sending the image / video stream to a video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with the image / video stream, includes: Upon obtaining the server identification information of the instant messaging server, the image and video stream is sent to the instant messaging server, so that the instant messaging server replaces the video stream sent to the second client with the image and video stream; Without obtaining the server identification information of the instant messaging server, the image and video stream is sent to the first client, so that the first client sends the image and video stream to the instant messaging server, thereby causing the instant messaging server to replace the video stream sent to the second client with the image and video stream.

3. The method according to claim 1, wherein, The step of searching for a target scene image from the cloud photo album that matches the scene feature information and the possible duration of the video call includes: The maximum playback duration of the image and video stream is obtained based on the possible duration of the video call and the preset duration ratio of the image and video stream. The number of images is determined based on the maximum playback duration of the image video stream and preset playback parameters; Search the cloud album for the target scene image that corresponds to the number of images and the scene feature information.

4. The method according to claim 3, wherein, The possible duration of the video call shall be determined by any of the following methods: The first average value corresponding to the first historical video call duration of the first client is determined as the possible continuous call duration of the video call; The second average value corresponding to the second historical video call duration between the first client and the second client is determined as the possible continuous call duration of the video call.

5. The method according to claim 3, wherein, The preset playback parameters are the preset playback frame rate; The step of determining the number of images based on the maximum playback duration of the image video stream and preset playback parameters includes: The actual playback duration of the image and video stream is determined based on the maximum playback duration of the image and video stream, wherein the actual playback duration is less than or equal to the maximum playback duration; The number of images in the target scene image is obtained by dividing the actual playback duration of the image video stream by the preset playback frame rate.

6. The method according to claim 3, wherein, The step of searching for the scene image corresponding to the number of images and the scene feature information from the cloud album includes: Obtain the matching degree between each scene image in the cloud album and the scene feature information; The scene images are sorted in descending order of matching degree to obtain an image sequence; Select the scene image that ranks in the top N positions from the image sequence as the target scene image; N is equal to the number of images.

7. A video call processing method, applied to a first client, the method comprising: Display a video call interface, the video call interface including a first control; In response to input to the first control, obtain an actual scene image of the actual scene where the first client is located; Identify scene feature information in the actual scene image of the first client; The scene feature information is sent to the cloud photo album server so that the cloud photo album server can use the scene feature information to obtain image and video streams.

8. The method according to claim 7, wherein, After sending the scene feature information to the cloud photo album server so that the cloud photo album server can obtain the image and video stream using the scene feature information, the method further includes: Receive image and video streams sent by the cloud photo album server; The image / video stream is sent to an instant messaging server, so that the instant messaging server replaces the video stream sent to the second client with the image / video stream.

9. The method according to claim 7, wherein, Before displaying the video call interface, the method further includes: Displays a candidate control for video call modes; In response to inputting a selection of a scene image sharing mode control from the video call mode candidate control, a video call connection is established between the first client and the second client, and the video call interface is displayed.

10. The method according to claim 7, wherein, The scene feature information includes scene type and / or scene location; The identification of scene feature information in the actual scene image of the first client includes at least one of the following: Perform scene recognition on the actual scene image to obtain the scene type corresponding to the actual scene image; The actual scene image is subjected to location recognition to obtain the scene location corresponding to the actual scene image.

Images