Video call processing method and device, equipment, storage medium and program product

Abstract

The invention discloses a video call processing method and device, equipment, a storage medium and a program product, and relates to the technical field of cloud computing and cloud storage. The video call processing method is applied to a cloud album server, and comprises the following steps: acquiring scene feature information of a first client sent by the first client; searching a target scene image matched with the scene feature information and the possible continuous call duration of the video call from a cloud photo album; generating an image video stream according to the target scene image; the image video stream is sent to a video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with the image video stream, and the video stream receiving end comprises at least one of the instant messaging server and the first client. According to the video call processing method provided by the invention, the tedious operation steps when the user shares the image in the video call process can be reduced, and the experience feeling of the user during the video call is improved.

Description

Technical Field

[0001] The present application belongs to the field of cloud computing and cloud storage technology, and in particular, relates to a method, device, equipment, storage medium and program product for processing a video call. Background Art

[0002] The smart cloud album of a mobile cloud phone or mobile cloud disk can realize functions such as face recognition and automatic classification to facilitate quick image search. When users make video calls with close friends during travel, they often need to share images of local beautiful scenery.

[0003] In the existing method, if the user wants to share an image with the call partner, the user can choose to minimize the video call window or adjust the window to a floating window, and then select the image to share based on the chat interface.

[0004] However, this method requires switching the chat interface when sharing images, which is cumbersome and affects the user experience. Summary of the invention

[0005] The present application provides a method, device, equipment, storage medium and program product for processing a video call, which can reduce the cumbersome operation steps for users to share images during a video call and improve the user's experience during the video call.

[0006] In one aspect of an embodiment of the present application, a method for processing a video call is provided, which is applied to a cloud album server, and includes:

[0007] Acquire scene feature information of the first client sent by the first client;

[0008] Searching for a target scene image that matches the scene feature information and the possible duration of the video call from a cloud photo album;

[0009] Generate an image video stream according to the target scene image;

[0010] The image video stream is sent to a video stream receiving end so that the video stream receiving end replaces the video stream sent to the second client with the image video stream, and the video stream receiving end includes at least one of an instant messaging server and a first client. In one aspect of an embodiment of the present application, a method for processing a video call is provided, which is applied to a first client, and includes:

[0011] Displaying a video call interface, where the video call interface includes a first control;

[0012] In response to an input to the first control, acquiring an actual scene image of an actual scene where the first client is located;

[0013] Identifying scene feature information in an actual scene image of the first client;

[0014] The scene feature information is sent to the cloud album server, so that the cloud album server obtains the image video stream using the scene feature information.

[0015] In one aspect of an embodiment of the present application, a video call processing device is provided, which is applied to a cloud album server, including:

[0016] An information acquisition module, used to acquire scene feature information of the first client sent by the first client;

[0017] An image search module, used to search for a target scene image that matches the scene feature information and the possible duration of the video call from a cloud photo album;

[0018] A video stream generation module, used for generating an image video stream according to a target scene image;

[0019] The first video stream sending module is used to send the image video stream to the video stream receiving end so that the video stream receiving end replaces the video stream sent to the second client with the image video stream. The video stream receiving end includes at least one of the instant communication server and the first client.

[0020] In one aspect of an embodiment of the present application, a video call processing device is provided, which is applied to a first client and includes:

[0021] An interface display module, used to display a video call interface, where the video call interface includes a first control;

[0022] An image acquisition module, configured to acquire an actual scene image of an actual scene where the first client is located in response to an input to the first control;

[0023] An information recognition module, used to recognize scene feature information in an actual scene image of the first client;

[0024] The information sending module is used to send the scene feature information to the cloud album server so that the cloud album server can obtain the image video stream using the scene feature information.

[0025] In one aspect of an embodiment of the present application, an electronic device is provided, which includes: a memory and a program or instruction stored in the memory and executable on a processor, wherein when the program or instruction is executed by the processor, a method for processing a video call as provided in any aspect of the above-mentioned embodiment of the present application is implemented.

[0026] In one aspect of an embodiment of the present application, a readable storage medium is provided, on which a program or instruction is stored. When the program or instruction is executed by a processor, a method for processing a video call provided in any aspect of the above-mentioned embodiment of the present application is implemented.

[0027] According to one aspect of an embodiment of the present application, a computer program product is provided. When instructions in the computer program product are executed by a processor of an electronic device, the electronic device executes a method for processing a video call as provided in any aspect of the above-mentioned embodiment of the present application.

[0028] In the video call processing method provided in the embodiment of the present application, when the first client and the second client establish a video call connection, the cloud album server receives the scene feature information sent by the first client, and then obtains the scene image that matches the scene feature information and the possible duration of the video call from the cloud album to generate an image video stream. Finally, the image video stream is sent to the video stream receiving end so that the video stream receiving end replaces the video stream sent to the second client with the image video stream. In this way, the embodiment of the present application obtains the corresponding scene image from the cloud album based on the scene feature information of the first client to generate an image video stream. By replacing the video screen sent to the second client with the image video stream, the first client and the second client can share multiple images without switching to the chat interface, which can reduce the cumbersome operation steps of users when sharing images during video calls and improve the user experience during video calls. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0030] Figure 1 It is a flowchart of a method for processing a video call provided by an embodiment of the present application;

[0031] Figure 2 is a flowchart of a method for processing a video call provided by another embodiment of the present application;

[0032] Figure 3 is a schematic diagram of a video call interface provided by an embodiment of the present application;

[0033] Figure 4 is a schematic diagram of a candidate control for a video call mode provided by an embodiment of the present application;

[0034] Figure 5 It is a structural diagram of a video call processing system provided by an embodiment of the present application;

[0035] Figure 6 It is a structural diagram of a video call processing device provided by an embodiment of the present application;

[0036] Figure 7is a structural diagram of a video call processing device provided by another embodiment of the present application;

[0037] Figure 8 It is a structural diagram of a video call processing device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0038] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0039] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0040] It should be noted that the acquisition, storage, use, and processing of data in the technical solution of this application are in compliance with the relevant provisions of national laws and regulations.

[0041] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0042] In the related art, if a user wants to share an image with a call partner, he can choose to minimize the video call window or adjust the window to a floating window, and then select an image to share based on the chat interface. However, this method requires switching the chat interface when sharing an image, which is cumbersome and affects the user experience.

[0043] The purpose of the present application is to provide a method, device, equipment, storage medium and program product for processing video calls. In the method for processing video calls provided in the embodiment of the present application, when the first client and the second client establish a video call connection, the cloud album server receives the scene feature information sent by the first client, and then obtains the scene image that matches the scene feature information and the possible duration of the video call from the cloud album to generate an image video stream. Finally, the image video stream is sent to the video stream receiving end so that the video stream receiving end replaces the video stream sent to the second client with the image video stream. In this way, the embodiment of the present application obtains the corresponding scene image from the cloud album based on the scene feature information of the first client to generate an image video stream. By replacing the video screen sent to the second client with the image video stream, multiple images can be shared between the first client and the second client without switching to the chat interface, which can reduce the cumbersome operation steps of users when sharing images during video calls and improve the user's experience during video calls.

[0044] The following describes specific embodiments of the video call processing method, device, equipment, storage medium and program product provided by the embodiments of the present application. The following first introduces the video call processing method.

[0045] Figure 1 A flow chart of a method for processing a video call is provided. The method for processing a video call is applied to a cloud album server. The method for processing a video call may include the following S101 to S104.

[0046] S101, obtaining scene feature information of the first client sent by the first client.

[0047] In this embodiment, the first client is the party that shares the scene image in the established video call.

[0048] The scene characteristic information is characteristic information characterizing the scene that the first client is in. For example, the scene characteristic information may be at least one of scene location information and scene type information.

[0049] As an example, in response to an image sharing request triggered by a user on a first client, the first client collects scene feature information of the current scene through a camera and sends the scene feature information to a cloud album server. The cloud album server receives the scene feature information collected by the first client.

[0050] S102, searching the cloud photo album for a target scene image that matches the scene feature information and the possible duration of the video call.

[0051] In this embodiment, at least one scene image uploaded from the first client is stored in the cloud album.

[0052] The possible duration of the video call is the possible duration of the current video call estimated based on the historical call durations of the first client.

[0053] As an example, the cloud album server divides the possible duration of the video call by the preset playback frame rate of each scene image, thereby obtaining the maximum number of selected scene images.

[0054] Then, at least one target scene image that matches the scene feature information and is less than or equal to the maximum selection number of scene images is searched from the cloud photo album.

[0055] S103, generating an image video stream according to the target scene image.

[0056] In this embodiment, the cloud album server sorts the target scene images in a preset order to generate an image video stream, wherein the preset order may be the order of scene types or the order of shooting time.

[0057] S104, sending the image video stream to the video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with the image video stream, and the video stream receiving end includes at least one of the instant communication server and the first client.

[0058] In this embodiment, the second client is the party that receives the shared scene image in the established video call.

[0059] The instant messaging server is a server corresponding to the instant messaging program that establishes a video call connection.

[0060] As an example, after generating an image video stream, the cloud album server sends the image video stream to the first client. The first client then forwards the image video stream to the instant messaging server, and the instant messaging server replaces the video stream that should have been transmitted to the second client with the image video stream, so that the image video stream can be displayed on the video call interface of the second client.

[0061] As another example, after generating the image video stream, the cloud album server sends the image video stream directly to the instant messaging server. The instant messaging server replaces the video stream that should have been transmitted to the second client with the image video stream, so that the image video stream can be displayed on the video call interface of the second client.

[0062] Through this embodiment, when the first client and the second client establish a video call connection, the cloud album server receives the scene feature information sent by the first client, and then obtains the scene image that matches the scene feature information and the possible duration of the video call from the cloud album to generate an image video stream. Finally, the image video stream is sent to the video stream receiving end so that the video stream receiving end replaces the video stream sent to the second client with the image video stream. In this way, the embodiment of the present application obtains the corresponding scene image from the cloud album based on the scene feature information of the first client to generate an image video stream. By replacing the video screen sent to the second client with the image video stream, the first client and the second client can share multiple images without switching to the chat interface, which can reduce the cumbersome operation steps of users when sharing images during video calls and improve the user experience during video calls.

[0063] As an optional embodiment, S104 may specifically include:

[0064] When the server identification information of the instant communication server is obtained, the image video stream is sent to the instant communication server, so that the instant communication server replaces the video stream sent to the second client with the image video stream;

[0065] When the server identification information of the instant communication server is not obtained, the image video stream is sent to the first client, so that the first client sends the image video stream to the instant communication server, and then the instant communication server replaces the video stream sent to the second client with the image video stream.

[0066] In this embodiment, as an example, the server identification information of the instant messaging server may be sent by the first client to the cloud album server.

[0067] When the cloud album server receives the server identification information sent by the first client, it directly sends the image video stream to the instant messaging server based on the server identification information; when the cloud album server does not receive the server identification information sent by the first client, it sends the image video stream to the first client, and the first client forwards the image video stream to the instant messaging server.

[0068] Through this embodiment, two ways of sending image and video streams are provided according to whether the cloud album server obtains the server identification information of the instant communication server. This ensures that the cloud album server can smoothly send the image and video stream to the instant communication server, so as to ensure that the video stream sent to the second client is replaced with the image and video stream, thereby improving the user's experience during the video call.

[0069] As an optional embodiment, S102 may specifically include:

[0070] According to the possible duration of the video call and the preset duration ratio of the image and video stream, the maximum playback duration of the image and video stream is obtained;

[0071] Determine the number of images according to the maximum playback time of the image video stream and preset playback parameters;

[0072] Find the target scene image corresponding to the number of images and scene feature information from the cloud album.

[0073] In this embodiment, the preset duration ratio is used to represent the ratio of the image video stream to the possible duration of the video call. For example, the estimated playback duration of the generated image video stream can be set to account for at most one tenth of the possible duration of the video call.

[0074] The preset playback parameter is used to characterize the factors that affect the playback speed of the video stream. For example, the preset playback parameter can be at least one of a preset playback frame rate of the scene image and a preset playback speed of the scene image.

[0075] As an example, the preset duration of the image video stream accounts for one tenth, and the possible duration of the video call is 10 minutes. The cloud album server can obtain the maximum playback duration of the image video stream as one minute based on the possible duration of the video call and the preset duration of the image video stream.

[0076] Then, the maximum playback duration of the image video stream is divided by the preset playback frame rate of each scene image to obtain the number of scene images. Finally, according to the matching degree between each scene image and the scene feature information in the cloud album, the target scene image corresponding to the number of images is searched from the cloud album.

[0077] Through this embodiment, the number of images of the target scene image is obtained according to the possible duration of the video call and the preset duration ratio of the image video stream. Therefore, it can be ensured that the duration of the image video stream finally generated is appropriate, and the image video stream can be played normally without interrupting the playback of the image video stream, avoiding affecting the user's video call experience.

[0078] As an optional embodiment, the possible duration of the video call is determined by any of the following methods:

[0079] Determine a first average value corresponding to the first historical video call duration of the first client as a possible continuous call duration of the video call;

[0080] A second average value corresponding to the second historical video call duration between the first client and the second client is determined as the possible continuous call duration of the video call.

[0081] In this embodiment, as an example, the first historical video call durations of the first client within a preset historical time period can be obtained, and then a first average is calculated based on the first historical video call durations, and finally the first average is determined as the possible duration of the video call.

[0082] As another example, the second historical video call duration between the first client and the second client within a preset historical time period can also be obtained, and then the second mean is calculated based on the second historical video call duration, and finally the second mean is determined as the possible duration of the video call.

[0083] Through this embodiment, the possible duration of the video call is obtained by using the first historical video call duration of the first client or the second historical video call duration between the first client and the second client, so that the duration of the image video stream finally generated is appropriate, avoiding the inability to normally complete the playback of the image video stream due to the excessive duration of the image video stream.

[0084] As an optional embodiment, the preset playback parameter is a preset playback frame rate;

[0085] Determine the number of images according to the maximum playback duration of the image video stream and preset playback parameters, which may include:

[0086] Determine the actual playback time of the image video stream according to the maximum playback time of the image video stream, and the actual playback time is less than or equal to the maximum playback time;

[0087] The actual playback duration of the image video stream is divided by the preset playback frame rate to obtain the number of images of the target scene.

[0088] In this embodiment, the actual playback duration of the image video stream may be less than the maximum playback duration, or may be equal to the maximum playback duration.

[0089] As an example, when the maximum playback duration of the image video stream is 1 minute, the actual playback duration of the image video stream may be selected to be 5 seconds.

[0090] Then, a preset playback frame rate of the target scene image is obtained. When the preset playback frame rate is 10 frames (Frames Per Second, FPS), it can be determined that the number of images of the target scene image is 50.

[0091] Through this embodiment, the maximum playback duration of the image video stream and the preset playback parameters can be used to obtain the number of images of the target scene image, thereby ensuring that the duration of the image video stream finally generated is appropriate, and the playback of the image video stream can be completed normally without interrupting the playback of the image video stream, thereby avoiding affecting the user's video call experience.

[0092] As an optional embodiment, searching the cloud photo album for scene images corresponding to the number of images and scene feature information may specifically include:

[0093] Obtain the matching degree between each scene image and scene feature information in the cloud photo album;

[0094] Sort the scene images in descending order of matching degree to obtain an image sequence;

[0095] The scene images ranked in the top N positions in the image sequence are selected as the target scene images; N is equal to the number of images.

[0096] In this embodiment, the matching degree is used to characterize the matching relationship between the scene image and the scene feature information.

[0097] The image sequence includes multiple scene images, and the multiple scene images are sorted in descending order of matching degree.

[0098] As an example, after obtaining the scene feature information of the first client, the cloud album server determines the matching degree between each scene image in the cloud album and the scene feature information. Then, the scene images are sorted in descending order of matching degree to obtain an image sequence. Finally, the scene images ranked in the top N positions in the image sequence are selected as the target scene images, where N is equal to the number of images.

[0099] As another example, when the number of scene images matching the scene feature information is less than N, a portion of the scene images may be copied to meet the quantity requirement. The copying of the scene images may be to select scene images with higher matching degrees in descending order of matching degrees for copying, or to select any scene image from the scene images matching the scene feature information for copying.

[0100] Through this embodiment, target scene images corresponding to the number of images are selected from the cloud album in the order of the matching degree from large to small. Thus, the matching degree between the scene image actually shared and the scene image the user wants to share can be achieved to the highest degree, thereby avoiding the problem of a large difference between the scene image actually shared and the scene image the user wants to share, and improving the user's video call experience.

[0101] As an optional embodiment, Figure 2A flowchart of a method for processing a video call is provided. The method for processing a video call is applied to a first client and may include the following S201 to S204.

[0102] S201, displaying a video call interface, where the video call interface includes a first control.

[0103] In this embodiment, when a video call connection is established between the first client and the second client, a video call interface will be displayed.

[0104] The first client and the second client are clients for establishing a video call, wherein the first client is the party that shares the scene image, and the second client is the party that receives the shared scene image.

[0105] like Figure 3 As shown, a schematic diagram of a video call interface is provided. The video call interface includes a first control, and the first control is used to control whether to replace the scene image.

[0106] If scene image replacement is not selected, the ordinary video stream captured by the camera of the first client will be displayed on the second client; if scene image replacement is selected, the ordinary video stream displayed on the second client will eventually be replaced with an image video stream generated based on the scene image.

[0107] S202: In response to an input to a first control, an actual scene image of an actual scene of a first client is acquired.

[0108] In this embodiment, as an example, when the user triggers the first control of the video call interface, the first client will collect an actual scene image of the actual scene of the first client through a camera. The camera can be a front camera of the first client or a rear camera of the first client.

[0109] As another example, when the user triggers the first control of the video call interface, the first client will periodically collect the actual scene image of the actual scene of the first client through the camera according to the preset collection frequency. As long as the scene feature information of the actual scene image changes, it will trigger the regeneration of a new image video stream and send it to the instant messaging server.

[0110] S203: Identify scene feature information in the actual scene image of the first client.

[0111] In this embodiment, the scene characteristic information is characteristic information representing the scene that the first client is in. For example, the scene characteristic information may be at least one of scene location information and scene type information.

[0112] As an example, after capturing the actual scene image through the camera, the first client obtains the position corresponding to the actual scene image and the scene type corresponding to the actual scene image, thereby obtaining scene feature information corresponding to the actual scene image.

[0113] S204, sending the scene feature information to the cloud album server, so that the cloud album server obtains the image video stream using the scene feature information.

[0114] In this embodiment, after the first client sends the scene feature information to the cloud album server, the cloud album server searches for the target scene image that matches the scene feature information from the cloud album. Thus, each target scene image is sorted in a preset order to generate an image video stream. Through this embodiment, when the first client and the second client establish a video call connection, the cloud album server receives the scene feature information sent by the first client, and then obtains the scene image that matches the scene feature information and the possible duration of the video call from the cloud album to generate an image video stream. Finally, the image video stream is sent to the video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with the image video stream. In this way, the embodiment of the present application obtains the corresponding scene image from the cloud album based on the scene feature information of the first client to generate an image video stream. By replacing the video screen sent to the second client with the image video stream, the first client and the second client can share multiple images without switching to the chat interface, which can reduce the cumbersome operation steps of users when sharing images during video calls and improve the user's experience during video calls.

[0115] As an optional embodiment, after S204, the method for processing the video call may further include:

[0116] Receive image and video streams sent by the cloud photo album server;

[0117] The image video stream is sent to the instant communication server, so that the instant communication server replaces the video stream sent to the second client with the image video stream.

[0118] In this embodiment, the instant messaging server is a server corresponding to the instant messaging program that establishes the video call connection.

[0119] As an example, when the cloud album server sends an image video stream to the first client, the first client will receive the image video stream sent by the cloud album server, and then the first client will send the image video stream and the estimated playback time of the image video stream to the instant messaging server.

[0120] After receiving the image video stream, the instant messaging server will stop sending the ordinary camera captured by the camera of the first client to the second client, and instead send the image video stream to the second client for playback.

[0121] Specifically, the first client has first identification information, and the second client has second identification information, so that the instant communication server can exchange information with the first client and the second client according to the corresponding identification information.

[0122] Through this embodiment, when the cloud album server sends the image video stream to the first client, the first client will forward the image video stream to the communication server. This ensures that the image video stream is smoothly sent to the instant messaging server, so that the video stream sent to the second client is replaced with the image video stream, thereby improving the user's experience during the video call. As an optional embodiment, before S101, the video call processing method may also include:

[0123] Display video call mode candidate controls;

[0124] In response to an input of selecting a scene image sharing mode control from the video call mode candidate controls, a video call connection is established between the first client and the second client, and a video call interface is displayed.

[0125] In this embodiment, the video call mode candidate control is a control for selecting a video call mode, and the video call mode candidate controls include a scene image sharing mode control and a common mode control. The scene image sharing mode control is used to control the entry into the scene image sharing video call mode, and the common mode control is used to control the entry into the common video call mode.

[0126] As an example, Figure 4 As shown, a schematic diagram of a video call mode candidate control is provided. When a user selects to trigger a scene image sharing mode control from a scene image sharing mode control and a normal mode control, the first client will establish a video call connection with the second client and display a video call interface, so that the user can select to share a scene image in the video call interface.

[0127] Through this embodiment, two video call modes are provided for the user to choose. If the user wants to share the scene image, the scene image sharing mode is selected; if the user does not want to share the scene image, the normal mode is selected. In this way, providing two video call modes can improve the user experience.

[0128] As an optional embodiment, the scene feature information includes scene type and / or scene location;

[0129] S203 may specifically include at least one of the following:

[0130] Performing scene recognition on the actual scene image to obtain the scene type corresponding to the actual scene image;

[0131] Perform position recognition on the actual scene image to obtain the scene position corresponding to the actual scene image.

[0132] In this embodiment, as an example, when the scene feature information includes the scene type, the first client performs scene recognition on the actual scene image captured by the camera. When it is recognized that the scene type corresponding to the actual scene image belongs to the beach, the scene feature information marks the scene type as beach.

[0133] As another example, when the scene feature information includes the scene location, the first client performs location recognition on the actual scene image captured by the camera, and when the scene location information corresponding to the actual scene image is recognized, the scene feature information includes the scene location information.

[0134] Through this embodiment, the scene type and scene location of the actual scene image of the first client are identified to obtain scene feature information. This helps to subsequently use the scene feature information to identify the scene image that the user is most likely to share, avoid the problem of a large difference between the scene image actually shared and the scene image that the user wants to share, and improve the user's video call experience.

[0135] Processing method based on video call. Accordingly, the present application also provides a specific embodiment of a processing system for video call.

[0136] like Figure 5 As shown, a schematic diagram of the structure of a video call processing system is provided. The video call processing system includes a first client, an instant messaging server, a second client, a cloud album server and a cloud album.

[0137] Specifically, the first client is electrically connected to the cloud album server and the instant messaging server respectively, the cloud album server is electrically connected to the first client, the instant messaging server and the cloud album respectively, the cloud album is electrically connected to the cloud album server, the instant messaging server is electrically connected to the first client, the second client and the cloud album server respectively, and the second client is electrically connected to the instant messaging server.

[0138] A processing method based on a video call. Accordingly, the present application also provides a specific embodiment of a processing device for a video call.

[0139] like Figure 6 As shown, an embodiment of the present application provides a video call processing device, which is applied to a cloud album server, including:

[0140] The information acquisition module 610 is used to acquire the scene feature information of the first client sent by the first client;

[0141] An image search module 620 is used to search for a target scene image that matches the scene feature information and the possible duration of the video call from the cloud photo album;

[0142] The video stream generation module 630 is used to generate an image video stream according to the target scene image;

[0143] The first video stream sending module 640 is used to send the image video stream to the video stream receiving end, so that the video stream receiving end replaces the video stream sent to the second client with the image video stream, and the video stream receiving end includes at least one of the instant messaging server and the first client. As an optional embodiment, the first video stream sending module 640 specifically includes the following units:

[0144] A video stream sending unit, configured to send the image video stream to the instant communication server when the server identification information of the instant communication server is acquired, so that the instant communication server replaces the video stream sent to the second client with the image video stream;

[0145] The video stream sending unit is used to send the image video stream to the first client without obtaining the server identification information of the instant communication server, so that the first client sends the image video stream to the instant communication server, and then the instant communication server replaces the video stream sent to the second client with the image video stream.

[0146] As an optional embodiment, the image search module 620 specifically includes the following units:

[0147] A duration determination unit, configured to obtain a maximum playback duration of the image and video stream according to a possible duration of the video call and a preset duration ratio of the image and video stream;

[0148] A quantity determination unit, used to determine the number of images according to the maximum playback time of the image video stream and preset playback parameters;

[0149] The image search unit is used to search the target scene image corresponding to the image quantity and scene feature information from the cloud album.

[0150] As an optional embodiment, the duration determination unit specifically includes the following subunits:

[0151] A first duration determination subunit, configured to determine a first average value corresponding to a first historical video call duration of the first client as a possible continuous call duration of the video call;

[0152] The second duration determination subunit is used to determine a second average value corresponding to the second historical video call duration between the first client and the second client as a possible continuous call duration of the video call.

[0153] As an optional embodiment, the preset playback parameter is a preset playback frame rate;

[0154] The quantity determination unit specifically includes the following subunits:

[0155] A third duration determination subunit is used to determine the actual playback duration of the image video stream according to the maximum playback duration of the image video stream, and the actual playback duration is less than or equal to the maximum playback duration;

[0156] The quantity determination subunit is used to divide the actual playback time of the image video stream by the preset playback frame rate to obtain the number of images of the target scene.

[0157] As an optional embodiment, the image search unit specifically includes the following subunits:

[0158] A matching degree acquisition subunit is used to obtain the matching degree between each scene image and scene feature information in the cloud photo album;

[0159] An image sorting subunit is used to sort the scene images in descending order of matching degree to obtain an image sequence;

[0160] The image selection subunit is used to select scene images ranked in the top N positions from the image sequence as target scene images; N is equal to the number of images.

[0161] As an optional embodiment, Figure 7 As shown, the embodiment of the present application also provides a video call processing device, which is applied to a first client and includes:

[0162] An interface display module 710, configured to display a video call interface, wherein the video call interface includes a first control;

[0163] The image acquisition module 720 is used to acquire an actual scene image of an actual scene where the first client is located in response to an input to the first control;

[0164] An information identification module 730, configured to identify scene feature information in an actual scene image of the first client;

[0165] The information sending module 740 is used to send the scene feature information to the cloud album server so that the cloud album server can obtain the image video stream using the scene feature information.

[0166] As an optional embodiment, the video call processing device may further include:

[0167] The video stream receiving module is used to receive the image video stream sent by the cloud album server;

[0168] The second video stream sending module is used to send the image video stream to the instant communication server, so that the instant communication server replaces the video stream sent to the second client with the image video stream.

[0169] As an optional embodiment, the video call processing device further includes the following modules:

[0170] A control display module, used for displaying candidate controls for video call mode;

[0171] The call connection module is used to establish a video call connection between the first client and the second client in response to an input of selecting a scene image sharing mode control from the video call mode candidate controls, and display a video call interface.

[0172] As an optional embodiment, the scene feature information includes scene type and / or scene location;

[0173] The information identification module 730 specifically includes the following units:

[0174] A scene recognition unit, used to perform scene recognition on the actual scene image to obtain the scene type corresponding to the actual scene image;

[0175] The position recognition unit is used to perform position recognition on the actual scene image to obtain the scene position corresponding to the actual scene image.

[0176] Based on the processing method of the video call. Accordingly, the present application also provides a specific embodiment of the processing device of the video call.

[0177] Figure 8 A schematic diagram of the hardware structure of a video call processing device provided in an embodiment of the present application is shown.

[0178] The video call processing device may include a processor 801 and a memory 802 storing computer program instructions.

[0179] Specifically, the processor 801 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0180] The memory 802 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 802 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 802 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 802 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 802 is a non-volatile solid-state memory.

[0181] The memory may include read-only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical / tangible memory storage devices. Thus, typically, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.

[0182] The processor 801 implements any one of the video call processing methods in the above embodiments by reading and executing the computer program instructions stored in the memory 802 .

[0183] In one example, the video call processing device may further include a communication interface 803 and a bus 810. Figure 8 As shown, the processor 801, the memory 802, and the communication interface 803 are connected via a bus 810 and communicate with each other.

[0184] The communication interface 803 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0185] Bus 810 includes hardware, software or both, and couples the components of the processing equipment of the video call to each other. For example, but not limitation, the bus may include an accelerated graphics port (AGP) or other graphics bus, an enhanced industrial standard architecture (EISA) bus, a front-end bus (FSB), a hypertransport (HT) interconnection, an industrial standard architecture (ISA) bus, an infinite bandwidth interconnection, a low pin count (LPC) bus, a memory bus, a microchannel architecture (MCA) bus, a peripheral component interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a serial advanced technology attachment (SATA) bus, a video electronics standard association local (VLB) bus or other suitable bus or a combination of two or more of these. In appropriate cases, bus 810 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the present application considers any suitable bus or interconnection.

[0186] In addition, in combination with the video call processing method in the above embodiment, the embodiment of the present application can provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when the computer program instructions are executed by the processor, any one of the video call processing methods in the above embodiment is implemented.

[0187] In addition, in combination with the video call processing method in the above embodiment, the embodiment of the present application can provide a computer program product for implementation. When the instructions in the computer program product are executed by the processor of the electronic device, any video call processing method in the above embodiment is implemented.

[0188] It should be clear that the present application is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present application.

[0189] The functional blocks shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0190] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.

[0191] Aspects of the present disclosure are described above with reference to the flowchart and / or block diagram of the method, device (system) and computer program product according to the embodiment of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field programmable logic circuit. It can also be understood that each box in the block diagram and / or flowchart and the combination of boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs a specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0192] The above is only a specific implementation of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.

Claims

1. A method for processing a video call, characterized in that: Applied to a cloud photo album server, the method comprises: Acquire scene feature information of the first client sent by the first client; Searching for a target scene image that matches the scene feature information and the possible duration of the video call from a cloud photo album; Generate an image video stream according to the target scene image; The image video stream is sent to a video stream receiving end so that the video stream receiving end replaces the video stream sent to the second client with the image video stream. The video stream receiving end includes at least one of an instant communication server and the first client.

2. The method according to claim 1, characterized in that The step of sending the image video stream to a video stream receiving end so that the video stream receiving end replaces the video stream sent to the second client with the image video stream includes: In case of acquiring the server identification information of the instant communication server, sending the image video stream to the instant communication server, so that the instant communication server replaces the video stream sent to the second client with the image video stream; When the server identification information of the instant communication server is not obtained, the image video stream is sent to the first client, so that the first client sends the image video stream to the instant communication server, and then the instant communication server replaces the video stream sent to the second client with the image video stream.

3. The method according to claim 1, characterized in that The searching the cloud album for a target scene image that matches the scene feature information and the possible duration of the video call includes: Obtaining a maximum playback duration of the image and video stream according to a possible duration of the video call and a preset duration ratio of the image and video stream; Determining the number of images according to the maximum playback duration of the image video stream and preset playback parameters; Search the cloud photo album for a target scene image corresponding to the number of images and the scene feature information.

4. The method according to claim 3, characterized in that The possible duration of the video call is determined by any of the following methods: Determine a first average value corresponding to the first historical video call duration of the first client as the possible continuous call duration of the video call; A second average value corresponding to the second historical video call duration between the first client and the second client is determined as the possible continuous call duration of the video call.

5. The method according to claim 3, characterized in that: The preset playback parameter is a preset playback frame rate; The step of determining the number of images according to the maximum playback duration of the image video stream and preset playback parameters includes: Determine the actual playback duration of the image video stream according to the maximum playback duration of the image video stream, wherein the actual playback duration is less than or equal to the maximum playback duration; The actual playback duration of the image video stream is divided by the preset playback frame rate to obtain the number of images of the target scene image.

6. The method according to claim 3, characterized in that The searching the cloud photo album for scene images corresponding to the number of images and the scene feature information includes: Obtaining the matching degree between each scene image in the cloud photo album and the scene feature information; Sorting the scene images in descending order of the matching degree to obtain an image sequence; The scene images ranked in the first N positions are selected from the image sequence as the target scene images; N is equal to the number of the images.

7. A method for processing a video call, characterized in that: Applied to a first client, the method includes: Displaying a video call interface, wherein the video call interface includes a first control; In response to an input to the first control, acquiring an actual scene image of an actual scene where the first client is located; Identifying scene feature information in an actual scene image of the first client; The scene feature information is sent to a cloud album server, so that the cloud album server obtains an image video stream using the scene feature information.

8. The method according to claim 7, characterized in that After sending the scene feature information to the cloud album server so that the cloud album server obtains the image video stream using the scene feature information, the method further includes: Receiving the image and video stream sent by the cloud album server; The image video stream is sent to the instant communication server, so that the instant communication server replaces the video stream sent to the second client with the image video stream.

9. The method according to claim 7, characterized in that: Before displaying the video call interface, the method further includes: Display video call mode candidate controls; In response to an input of selecting a scene image sharing mode control from the video call mode candidate controls, a video call connection is established between the first client and the second client, and the video call interface is displayed.

10. The method according to claim 7, characterized in that The scene feature information includes scene type and / or scene location; The identifying scene feature information in the actual scene image of the first client includes at least one of the following: Performing scene recognition on the actual scene image to obtain a scene type corresponding to the actual scene image; Performing position recognition on the actual scene image to obtain a scene position corresponding to the actual scene image.

Images