Call processing method and device

Abstract

The present application discloses a call processing method and device thereof, belonging to the field of communication technology. The call processing method includes: receiving a first input from a user when a video screen of a first video is displayed and a first call request is received or a first call is connected; in response to the first input, establishing an association relationship between a first video object and a first call object; according to the association relationship, sending first target information corresponding to the first video object to the first call object; wherein the first video object is an object in the first video, the first call object is an object corresponding to the first call request or an object corresponding to the first call; the first target information includes at least one of the following: voice information, image information, the first call request is a voice call request or a video call request, and the first call is a voice call or a video call.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to a call processing method and device thereof. Background Art

[0002] With the development of communication technology, in addition to traditional telephone communication, various software capable of communication has also emerged, which makes the communication methods between people more selective. However, among the many communication methods, the two parties can communicate only after establishing a communication connection. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a call processing method and device thereof, which can solve the problem in the related art that the communicating parties need to establish a communication connection before they can communicate.

[0004] In a first aspect, an embodiment of the present application provides a call processing method, the method comprising:

[0005] When the video screen of the first video is displayed and a first call request is received or the first call is connected, receiving a first input from the user;

[0006] In response to the first input, establishing an association relationship between the first video object and the first call object;

[0007] According to the association relationship, sending first target information corresponding to the first video object to the first call object;

[0008] Among them, the first video object is the object in the first video, the first call object is the object corresponding to the first call request or the object corresponding to the first call; the first target information includes at least one of the following: voice information, image information, the first call request is a voice call request or a video call request, and the first call is a voice call or a video call.

[0009] In a second aspect, an embodiment of the present application provides a call processing device, the device comprising:

[0010] A first input module is used to receive a first input from a user when a video screen of a first video is displayed and a first call request is received or the first call is connected;

[0011] A first relationship establishing module, configured to establish an association relationship between a first video object and a first call object in response to the first input;

[0012] A first sending module, configured to send first target information corresponding to the first video object to the first call object according to the association relationship;

[0013] Among them, the first video object is the object in the first video, the first call object is the object corresponding to the first call request or the object corresponding to the first call; the first target information includes at least one of the following: voice information, image information, the first call request is a voice call request or a video call request, and the first call is a voice call or a video call.

[0014] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps in the call processing method described in the first aspect are implemented.

[0015] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps in the call processing method described in the first aspect are implemented.

[0016] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the call processing method as described in the first aspect.

[0017] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the call processing method as described in the first aspect.

[0018] In an embodiment of the present application, by establishing an association relationship between the first video object and the first call object, directional transmission of at least one of the image and voice corresponding to the first video object is achieved, so that at least one of the image and voice corresponding to the first video object can be transmitted to the designated call link. In this way, even if a communication connection is not established between the first video object and the first call object, information associated with the first video object can be transmitted to the first call object, thereby enriching the communication method. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a flowchart of a call processing method provided in an embodiment of the present application;

[0020] Figure 2 This is one of the interface diagrams of the call processing method provided in the embodiment of the present application;

[0021] Figure 3 It is a schematic diagram of the bottom channel multiplexing of the camera provided in an embodiment of the present application;

[0022] Figure 4This is one of the schematic diagrams of file transmission in the call processing method provided in the embodiment of the present application;

[0023] Figure 5 This is the second schematic diagram of file transmission in the call processing method provided in the embodiment of the present application;

[0024] Figure 6 This is the second interface diagram of the call processing method provided in the embodiment of the present application;

[0025] Figure 7 This is the third interface diagram of the call processing method provided in the embodiment of the present application;

[0026] Figure 8 is a schematic block diagram of a call processing device provided in an embodiment of the present application;

[0027] Fig. 9 is a schematic block diagram of an electronic device provided in an embodiment of the present application;

[0028] Fig.10 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0030] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0031] The call processing method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0032] Figure 1It is a flow chart of a call processing method provided in an embodiment of the present application. The call processing method is applied to an electronic device, that is, the steps in the call processing method are executed by the electronic device, and the electronic device may include but is not limited to: a mobile phone, a tablet computer, a laptop computer or a desktop computer, etc.

[0033] The call processing method may include:

[0034] Step 101: When a video screen of a first video is displayed and a first call request is received or the first call is connected, a first input from a user is received.

[0035] Step 102: In response to a first input, an association relationship between a first video object and a first call object is established.

[0036] In an embodiment of the present application, when the electronic device displays the video screen of the first video, if it also receives the first call request or has connected the first call, the user can perform a first input operation on the electronic device. After receiving the first input, the electronic device can respond to the first input and establish an association relationship between the first video object and the first call object, which can also be understood as establishing an association relationship between the first video object and the first call request. Among them, the first video object is an object in the first video, that is, a character in the first video. The video screen of the first video may include M objects, and the first video object is at least one of the M objects, that is, the number of the first video objects is at least one, that is, M is a positive integer greater than or equal to 1. The first call object is the object corresponding to the first call request or the object corresponding to the first call, that is, the opposite end user of the call. The first call request is a voice call request or a video call request. The first call can be a voice call or a video call.

[0037] It should be noted that the first video object does not establish an association relationship with one or more specific users of the first call counterpart, and the first call object generally refers to the user of the counterpart of the call.

[0038] Step 103: According to the association relationship between the first video object and the first call object, first target information corresponding to the first video object is sent to the first call object.

[0039] In the embodiment of the present application, the electronic device can send the first target information corresponding to the first video object in the first video to the first call object according to the previously established association relationship, wherein the first target information includes at least one of the following: voice information and image information.

[0040] If the user performs the first input operation when receiving the first call request, the first target information is sent to the first call object after the call corresponding to the first call request is connected.

[0041] In an embodiment of the present application, by establishing an association relationship between a video object and a call object, directional transmission of at least one of the image and voice corresponding to the video object is achieved, so that at least one of the image and voice corresponding to the video object can be transmitted to a designated call link. In this way, even when a communication connection is not established between the video object and the call object, information corresponding to the video object can be transmitted to the call object, thereby enriching the communication method.

[0042] Optionally, in the case where a video includes multiple video objects, only the images and voices of some of the video objects can be sent to a designated call link, which can protect the user's privacy to a certain extent. For example, user A is currently making a video call with other users, hereinafter referred to as video call 1. The opposite users of video call 1 include user B, user C, and user D. During the video call, user E sent a phone call request to user A. Among them, among the opposite users of video call 1, only user B and user E are acquainted, and the other users are not acquainted with user E. Therefore, user A only wants to transmit the voice of user B to user E, and does not want to transmit the voices of other opposite users of video call 1 to user E. At this time, the technical solution provided in the embodiment of the present application can be used to first establish an association relationship between user B and user E. In this way, after the phone call request is connected and the phone call is established, only the voice of user B can be sent to the opposite user of the phone call, that is, user E.

[0043] It should be noted that, when the first call request is a voice call request or the first call is a voice call, the first target information may include voice information of the first video object. When the first call request is a video call request or the first call is a video call, the target information may include at least one of image information and voice information of the first video object.

[0044] Optionally, in an embodiment of the present application, the local user may also perform the first input after answering the first call request to establish an association relationship between the first video object and the first call object, corresponding to the situation where the first input operation is performed when the first call is answered.

[0045] As an optional embodiment, “receiving a first input from a user” in step 101 may include: receiving a first input from a user to a first target object.

[0046] The first target object may include at least one of the following: a first identifier corresponding to the first call request or the first call, and a first video object image. The first video object image is an image of the first video object.

[0047] Among them, the first input can be: a click input of the user on the first target object, or a voice command input by the user, or a specific gesture input by the user, which can be determined according to actual usage requirements, and the embodiment of the present application does not limit this. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture. The click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.

[0048] For example, when the first target object is the first identifier, the first input may be a drag operation on the first identifier, and when the first identifier is dragged to the position of the first video object image, the first call object is associated with the first video object.

[0049] For another example, when the first target object is the first video object image, the first input may include a long press operation and a drag operation on the first video object image, such as: the first video object image may be long pressed first, and after receiving the long press operation, the electronic device extracts the first video object image and displays the draggable first video object image, and then drags the draggable first video object image, and when the draggable first video object image is dragged to the position of the first identifier, the first call object is associated with the first video object.

[0050] For another example, when the first target object is the first identifier and the first video object image, the first input may be a multi-touch operation, such as: the user long presses the first identifier and the first video object image with two fingers at the same time, and when the electronic device receives the multi-touch operation, the first call object is associated with the first video object; or the user presses the first identifier and the first video object image with two fingers at the same time and performs a pinch operation, and when the electronic device receives the multi-touch operation, the first call object is associated with the first video object.

[0051] The first identifier here may be the identifier of the first call request or the application corresponding to the first call.

[0052] As an optional embodiment, the first video is a video corresponding to the second call, that is, the second call is a video call; or the first video is a real-time recorded video.

[0053] In an embodiment of the present application, video call object information or video shooting object information can be sent in a targeted manner to enable a call between two parties who have not established a communication connection.

[0054] In the case where the first video is the video corresponding to the second call, the first video may be a peer user video of the second call, that is, a video image captured by a peer user device.

[0055] Optionally, when the first video is a video corresponding to the second call and is a video of the opposite user, after step 102: establishing an association relationship between the first video object and the first call object, the call processing method may further include:

[0056] The second target information corresponding to the first call object is sent to the first video object.

[0057] The second target information includes at least one of the following: voice information and image information.

[0058] In the case where the first video is the video of the opposite user of the second call, when the first call object and the opposite user of the second call have not established a communication connection, at least one of the voice and image of the first call object can be transmitted to the opposite user of the second call, enriching the call mode under multi-link communication. By sending the received call information of the first call object to the opposite user of the second call, the electronic device can realize mutual communication between the first call object and the opposite user of the second call, further improving the call mode under the multi-link communication.

[0059] If the user performs the first input operation when receiving the first call request, the second target information is sent to the first call object after the call corresponding to the first call request is connected.

[0060] In order to better understand the above solution, two examples are given below to illustrate.

[0061] For example, user A is making a video call 1 with user B, and then user C initiates a phone call request to user A. If user A wants user B to participate in the phone call with user C, the first input can be made to the image of user B in the video of the other end user of video call 1 and the first identifier corresponding to the phone call request, so that an association relationship is established between user B and user C. After the phone call request is connected, the electronic device can send the voice information of user B in video call 1 to the other end user of the phone call, that is, user C, so that user B participates in the phone call. When the electronic device receives the voice information of user C, it can also send the voice information of user C to the other end user of video call 1, that is, user B, so that user B can know the content of user C's call.

[0062] For another example, while user A is having a video call 1 with user B, he is also having a phone call with user C. If user A wants user B to participate in the phone call with user C, he can first input the image of user B in the video of the other end user of video call 1 and the first identifier corresponding to the phone call, so that an association relationship is established between user B and user C. After that, the electronic device can send the voice information of user B in video call 1 to the other end user of the phone call, that is, user C, so that user B participates in the phone call. When the electronic device receives the voice information of user C, it can also send the voice information of user C to the other end user of video call 1, that is, user B, so that user B knows the content of user C's call.

[0063] As an optional embodiment, when the first target information includes voice information and the video screen of the first video includes at least two video objects, step 103: sending the first target information corresponding to the first video object to the first call object according to the association relationship between the first video object and the first call object may include:

[0064] Step A1: when the first voice information of the first video is obtained, based on the voiceprint features of the first video object, a voice segment in the first voice information that matches the voiceprint features of the first video object is intercepted to obtain the first target voice information.

[0065] Step A3: Send the first target voice information to the first call partner.

[0066] In an embodiment of the present application, after the first video object is associated with the first call object, if the electronic device receives the voice information of the first video (i.e., the first voice information), the voice information of the first video can be identified and matched according to the voiceprint features of the first video object obtained in advance. If the voice information of the first video includes a voice segment that matches the voiceprint features of the first video object, the matched voice segment can be determined as the voice information of the first video object (i.e., the first target voice information), and then extracted separately and sent to the opposite end user of the first call, so that users outside the first call can participate in the communication of the first call.

[0067] Optionally, it is mentioned above that the video screen of the first video may include M objects, and the first video object is at least one of the M objects. Assuming that the number of the first video objects is N, when N is less than M, in order to obtain the voice information of the first video object in the voice information of the M objects, it is necessary to first determine the voiceprint feature of the first video object, and then obtain the voice information of the first video object in the voice information of the M objects based on the voiceprint feature of the first video object. Therefore, in step 103: before sending the first target information corresponding to the first video object to the first call object according to the association relationship between the first video object and the first call object, the call processing method may further include:

[0068] Determine the target position of the first video object in the video image; determine the sound direction corresponding to different voice segments of the first video; determine the second target voice information corresponding to the sound direction and the target position; and obtain the voiceprint feature of the first video object based on the second target voice information.

[0069] After receiving the voice information of the first video, the electronic device can analyze the sound direction of different voice segments. When the sound direction of a voice segment corresponds to the position of the first video object, the voice segment can be determined as the voice information of the first video object. Then, based on the voice information of the first video object, the voiceprint feature of the first video object can be determined.

[0070] It is understandable that the first target voice information can also be determined based on the position of the first video object in the video image and the vocalization direction corresponding to different voice segments of the first video, but voice positioning based on voiceprint features is more accurate.

[0071] As an optional embodiment, when the first target information includes image information, the video screen of the first video includes at least two video objects, and the first call request is a video call request or the first call is a video call, step 103: sending the first target information corresponding to the first video object to the first call object according to the association relationship between the first video object and the first call object may include:

[0072] Step B1: Acquire at least one first video image including a first video object in a first video.

[0073] Step B2: performing image segmentation processing on the at least one first video image to obtain at least one first target video image.

[0074] Step B3: Send the at least one first target video image to the first call partner.

[0075] The first target image is an image corresponding to the area where the first video object is located in the first video image, that is, the first target image is an image of the first video object in the first video image.

[0076] In the embodiment of the present application, after associating the first video object with the first call object, it is possible to determine whether the first video contains a video image including the first video object, and obtain at least one first video image including the first video object. Then, the first video image is segmented, the first video object image is extracted from the first video image, and the extracted first video object image (i.e., the first target video image) is sent to the first call object, providing visual call information to the first call object.

[0077] As an optional embodiment, when the first video is the video corresponding to the second call, the first call and the second call may be calls conducted through the same application, such as both are video calls conducted through social software A; or the first call and the second call may be calls conducted through different applications, such as the first call is a voice call conducted through telephone software, and the second call is a video call conducted through social software B.

[0078] As an optional embodiment, after step 102: establishing an association relationship between the first video object and the first call object, the call processing method may further include:

[0079] Step C1: When the third call request is received or the third call is connected, a second input from the user is received.

[0080] Step C2: In response to the second input, establishing an association relationship between the second video object and the third call object.

[0081] Step C3: According to the association relationship between the second video object and the third call object, the third target information corresponding to the second video object is sent to the third call object.

[0082] The second video object is an object in the first video, and may be the same as or different from the first video object. The third call object is an object corresponding to a third call request or a third call, and the third call object and the first call object are call objects corresponding to different applications.

[0083] The third target information includes at least one of the following: voice information and image information.

[0084] The function of the second input described here is similar to that of the first input, which is to establish an association relationship between the second video object and the third call object. For details, please refer to the explanation of the first input, which will not be repeated here.

[0085] For detailed explanations of steps C1 to C3, please refer to the explanations of steps 101 to 103, which will not be repeated here.

[0086] In the embodiment of the present application, an association relationship may be established between the object in the first video and different calls, and this may be referred to the following example.

[0087] like Figure 2 As shown, a video image 201 of video call A is displayed on the mobile phone screen, and the video image 201 includes person A 2011, person B 2012, and person C 2013. During video call A, the mobile phone receives call requests for video call B and video call C, and displays a first mark 202 corresponding to video call B and a second mark 203 corresponding to video call C. The user can press the first mark 202 with one finger, and then drag the first mark 202 toward person B 2012, as shown in FIG. Figure 2 As shown by the arrow 204 in the figure, the person B 2012 is associated with the video call B. The user can also press the second mark 203 with one finger, and then drag the second mark 203 toward the direction of the person C 2013, as shown in FIG. Figure 2 As shown by arrow 205 in , character C 2013 is associated with video call C.

[0088] Optionally, when the first video is the video corresponding to the second call and the other calls are all video calls, if the local user video of the third call and the local user video of the first call are both captured by the same camera on the local device, the local user video can be sent to the first call object and the third call object respectively by multiplexing the camera image transmission channel.

[0089] The application calls the camera generally through a separate process interface, sending information such as the required size and resolution and whether to open the front camera or the rear camera to the underlying camera system so that the underlying camera system is informed. The system bottom layer will maintain a separate memory space to save the camera image data, and directly maintain a dedicated channel between the system storage and the application, which can also be called a pipe. If the system detects that different applications have called the same camera, such as the front camera or the rear wide-angle camera, etc., it is considered that the two programs share a camera. At this time, in the embodiment of the present application, the system can add a transmission channel to transmit the underlying camera memory data to another program, such as Figure 3 As shown, by multiplexing the underlying channels of the camera system, the images captured by the same camera are sent to the first call object and the third call object respectively.

[0090] It is understandable that if the local user video of the third call and the local user video of the first call are captured by different cameras on the local device, there is no need to send the video image by multiplexing the camera image transmission channel.

[0091] As an optional embodiment, when the first video is a video corresponding to the second call, after step 102: establishing an association relationship between the first video object and the first call object, the call processing method may further include:

[0092] Step D1: Receive a third input from the user regarding a file to be sent.

[0093] Step D2: In response to the third input, the file to be sent is sent to the first call partner and the second call partner at the same time.

[0094] The second call object is the object corresponding to the second call, that is, the opposite end user of the second call.

[0095] In the embodiment of the present application, the file to be sent can be sent to the first call counterpart and the second call counterpart at the same time through the third input, which facilitates the file sending operation.

[0096] If the user performs the first input operation when receiving the first call request, the user may perform the third input operation on the file to be sent after the call corresponding to the first call request is connected.

[0097] Optionally, the third input may be a drag operation. For example, when the file to be sent is dragged to a target position by a drag operation, the file to be sent is sent to the first call object and the second call object respectively. The target position is an adjacent position between the first window of the first call and the second window of the second call. At the target position, the icon of the file to be sent overlaps the first window and the second window.

[0098] Optionally, in the embodiment of the present application, when the same file needs to be sent to the first call object and the second call object, the file transfer control on the call interface can be triggered, and then the file management interface is displayed, and the locally stored files are displayed in the file management interface. After the user selects the target file 403 (i.e., the file to be sent), the target file 403 can be dragged from the file management interface to the adjacent position of the first window 401 of the first call and the second window 402 of the second call through the third input, such as Figure 4 After releasing the gesture, the target file can be sent to the first caller and the second caller at the same time, which is simple and convenient to operate.

[0099] It is understandable that when only the file to be sent needs to be sent to one of the call peers, the file can be directly dragged to the call window of the call. Figure 5 As shown, the target file 403 is dragged to the second window 402 of the second call, and after the drag is released, the target file 403 can be sent to the second call object.

[0100] As an optional embodiment, step 102: establishing an association relationship between the first video object and the first call object may include:

[0101] In response to the first input, an association relationship is established between the first video object and the first call object, and an association identifier is displayed at a corresponding position of the first video object.

[0102] In an embodiment of the present application, after receiving the first input, the electronic device can also display the association identifier of the first video object and the first call object at the corresponding position of the first video object, so as to facilitate the user to distinguish between the objects in the first video that are associated with the first call object and the objects that are not associated with the first call.

[0103] like Figure 6 As shown, the mobile phone screen displays a video screen 601 of video call A, and the video screen 601 includes person A 6011, person B 6012, and person C 6013. During the video call A, the mobile phone receives a call request of video call B, and displays a first mark 602 corresponding to the call request of video call B. The user can press the first mark 602 with one finger, and then drag the first mark 602 toward the direction of person B 6012, as shown in FIG. Figure 6 When the first mark 602 is dragged to the image range 603 of person B 6012, person B 6012 is associated with video call B, and an associated mark 604 is displayed in the image range 603 of person B 6012, as shown in FIG. Figure 7 shown.

[0104] Optionally, if you need to cancel the association between the first video object and the first call object, you can move the association mark outside the image range of the first video object to cancel the association; or long press the association mark so that a delete control is displayed in the upper right corner of the association mark. After the delete control is triggered, the association is canceled.

[0105] In an embodiment of the present application, by establishing an association relationship between the first video object and the first call object, directional transmission of at least one of the image and voice corresponding to the first video object is achieved, so that at least one of the image and voice corresponding to the first video object can be transmitted to a designated call link. In this way, even if a communication connection is not established between the first video object and the first call object, information associated with the first video object can be transmitted to the first call object, thereby enriching the communication method.

[0106] The call processing method provided in the embodiment of the present application can be executed by a call processing device. In the embodiment of the present application, the call processing device provided in the embodiment of the present application is described by taking the call processing method executed by the call processing device as an example.

[0107] Figure 8 It is a schematic block diagram of a call processing device provided in an embodiment of the present application, and the call processing device is applied to an electronic device.

[0108] like Figure 8 As shown, the call processing device may include:

[0109] The first receiving module 801 is used to receive a first input from a user when the video screen of the first video is displayed and a first call request is received or the first call is connected.

[0110] The first relationship establishing module 802 is used to establish an association relationship between the first video object and the first call object in response to the first input.

[0111] The first sending module 803 is used to send the first target information corresponding to the first video object to the first call object according to the association relationship.

[0112] Among them, the first video object is the object in the first video, the first call object is the object corresponding to the first call request or the object corresponding to the first call; the first target information includes at least one of the following: voice information, image information, the first call request is a voice call request or a video call request, and the first call is a voice call or a video call.

[0113] Optionally, the first video is a video corresponding to the second call or a video recorded in real time.

[0114] Optionally, when the first video is a video corresponding to the second call, the device may further include:

[0115] The second sending module is used to send the second target information corresponding to the first call object to the first video object.

[0116] Optionally, when the first target information includes voice information and the video screen of the first video includes at least two video objects, the first sending module 803 may include:

[0117] The first acquisition unit is used to intercept a voice segment in the first voice information that matches the voiceprint feature of the first video object according to the voiceprint feature of the first video object when the first voice information of the first video is acquired, so as to obtain the first target voice information.

[0118] The first sending unit is used to send the first target voice information to the first call object.

[0119] Optionally, when the first target information includes image information, the video screen of the first video includes at least two video objects, and the first call request is a video call request or the first call is a video call, the first sending module 803 may include:

[0120] The second acquisition unit is configured to acquire at least one first video image including the first video object in the first video.

[0121] The image segmentation unit is used to perform image segmentation processing on the at least one first video image to obtain at least one first target image.

[0122] The first target image is an image corresponding to the area where the first video object is located in the first video image.

[0123] The second sending unit is configured to send the at least one first target image to the first communication object.

[0124] Optionally, the device may further include:

[0125] The second receiving module is used to receive a second input from the user when a third call request is received or the third call is connected.

[0126] The second relationship establishing module is used to establish an association relationship between the second video object and the third call object in response to the second input.

[0127] The second video object is an object in the first video, the third call object is an object corresponding to the third call request or the third call, and the third call object and the first call object are call objects corresponding to different applications.

[0128] Optionally, the device may further include:

[0129] A third receiving module, used to receive a third input from a user of a file to be sent;

[0130] The third sending module is used to send the to-be-sent file to the first call object and the object corresponding to the second call at the same time in response to the third input.

[0131] To summarize, in the embodiments of the present application, by establishing an association relationship between the first video object and the first call object, directional transmission of at least one of the image and voice corresponding to the first video object is achieved, so that at least one of the image and voice corresponding to the first video object can be transmitted to the designated call link. In this way, even if a communication connection is not established between the first video object and the first call object, information associated with the first video object can be transmitted to the first call object, thereby enriching the communication method.

[0132] The call processing device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or a device other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0133] The call processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0134] The call processing device provided in the embodiment of the present application can achieve Figure 1 The various processes implemented in the call processing method embodiment shown achieve the same technical effect, and will not be described again here to avoid repetition.

[0135] Alternatively, if Fig. 9As shown, an embodiment of the present application further provides an electronic device 900, including: a processor 901 and a memory 902, wherein the memory 902 stores a program or instruction that can be run on the processor 901, and when the program or instruction is executed by the processor 901, the various steps of the above-mentioned call processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0136] It should be noted that the electronic device 900 in the embodiment of the present application includes the above-mentioned mobile electronic device and non-mobile electronic device.

[0137] Fig.10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0138] The electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009 and a processor 1010 and other components.

[0139] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.10 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0140] The user input unit 1007 is used to receive a first input from a user when the video screen of the first video is displayed and a first call request is received or the first call is connected. The processor 1010 is used to establish an association relationship between the first video object and the first call object in response to the first input; and send the first target information corresponding to the first video object to the first call object according to the association relationship. The first video object is an object in the first video, the first call object is an object corresponding to the first call request or an object corresponding to the first call; the first target information includes at least one of the following: voice information, image information, the first call request is a voice call request or a video call request, and the first call is a voice call or a video call.

[0141] Optionally, when the first video is a video corresponding to the second call, the processor 1010 is further configured to: send second target information corresponding to the first call object to the first video object. The second target information includes at least one of the following: voice information and image information.

[0142] Optionally, when the first target information includes voice information and the video screen of the first video includes at least two video objects, the processor 1010 is also used to: when the first voice information of the first video is obtained, based on the voiceprint features of the first video object, intercept a voice segment in the first voice information that matches the voiceprint features of the first video object to obtain the first target voice information; and send the first target voice information to the first call object.

[0143] Optionally, when the first target information includes image information, the video screen of the first video includes at least two video objects, and the first call request is a video call request or the first call is a video call, the processor 1010 is further configured to: obtain at least one first video image including the first video object in the first video; perform image segmentation processing on the at least one first video image to obtain at least one first target image; and send the at least one first target image to the first call object. The first target image is an image corresponding to the area where the first video object is located in the first video image.

[0144] Optionally, the user input unit 1007 is further configured to: receive a second input from the user when a third call request is received or the third call is connected; and the processor 1010 is further configured to: establish an association relationship between the second video object and the third call object in response to the second input. The second video object is an object in the first video, the third call object is an object corresponding to the third call request or the third call, and the third call object and the first call object are call objects corresponding to different applications.

[0145] Optionally, the user input unit 1007 is further used to: receive a third input from the user regarding a file to be sent; the processor 1010 is further used to: in response to the third input, send the file to be sent to the first call object and the object corresponding to the second call at the same time.

[0146] In an embodiment of the present application, by establishing an association relationship between the first video object and the first call object, directional transmission of at least one of the image and voice corresponding to the first video object is achieved, so that at least one of the image and voice corresponding to the first video object can be transmitted to a designated call link. In this way, even if a communication connection is not established between the first video object and the first call object, information associated with the first video object can be transmitted to the first call object, thereby enriching the communication method.

[0147] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0148] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0149] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.

[0150] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned call processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0151] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0152] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned call processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0153] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned call processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0154] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0155] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises one..." does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the method and device in the embodiment of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0156] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM, RAM, disk, CD), and includes a number of instructions for a terminal (which can be a mobile phone, computer, server or network device, etc.) to execute the methods described in each embodiment of the present application.

[0157] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A call processing method, applied to an electronic device, characterized in that: The method comprises: When the video screen of the first video is displayed and a first call request is received or the first call is connected, receiving a first input from the user; In response to the first input, establishing an association relationship between the first video object and the first call object; wherein the association relationship does not include a communication connection relationship; The electronic device sends the first target information corresponding to the first video object to the first call object according to the association relationship; Among them, the first video object is the object in the first video, the first call object is the object corresponding to the first call request or the object corresponding to the first call; the first target information includes at least one of the following: voice information, image information, the first call request is a voice call request or a video call request, and the first call is a voice call or a video call.

2. The call processing method according to claim 1, characterized in that: The first video is a video corresponding to the second call or a video recorded in real time.

3. The call processing method according to claim 2, characterized in that: In a case where the first video is a video corresponding to the second call, after establishing the association relationship between the first video object and the first call object, the method further includes: Sending second target information corresponding to the first call object to the first video object; The second target information includes at least one of the following: voice information and image information.

4. The call processing method according to claim 1 or 2, characterized in that: In a case where the first target information includes voice information and the video screen of the first video includes at least two video objects, sending the first target information corresponding to the first video object to the first call object according to the association relationship includes: When the first voice information of the first video is obtained, based on the voiceprint feature of the first video object, a voice segment matching the voiceprint feature of the first video object in the first voice information is intercepted to obtain the first target voice information; The first target voice information is sent to the first call partner.

5. The call processing method according to claim 1 or 2, characterized in that: In a case where the first target information includes image information, the video screen of the first video includes at least two video objects, and the first call request is a video call request or the first call is a video call, sending the first target information corresponding to the first video object to the first call object according to the association relationship includes: Acquire at least one first video image including the first video object in the first video; Performing image segmentation processing on the at least one first video image to obtain at least one first target image, wherein the first target image is an image corresponding to an area where the first video object is located in the first video image; The at least one first target image is sent to the first call object.

6. The call processing method according to claim 1, characterized in that: After establishing the association relationship between the first video object and the first call object, the method further includes: When the third call request is received or the third call is connected, receiving a second input from the user; In response to the second input, establishing an association relationship between the second video object and the third call object; The second video object is an object in the first video, the third call object is an object corresponding to the third call request or the third call, and the third call object and the first call object are call objects corresponding to different applications.

7. The call processing method according to claim 2, characterized in that: In the case where the first video is a video corresponding to the second call, after establishing the association relationship between the first video object and the first call object, the method further includes: receiving a third input from a user regarding a file to be sent; In response to the third input, the to-be-sent file is simultaneously sent to the first call object and the object corresponding to the second call.

8. A call processing device, applied to an electronic device, characterized in that: The device comprises: A first input module is used to receive a first input from a user when a video screen of a first video is displayed and a first call request is received or the first call is connected; A first relationship establishing module, configured to establish an association relationship between the first video object and the first call object in response to the first input; wherein the association relationship does not include a communication connection relationship; A first sending module, configured to send, by the electronic device, first target information corresponding to the first video object to the first call object according to the association relationship; Among them, the first video object is the object in the first video, the first call object is the object corresponding to the first call request or the object corresponding to the first call; the first target information includes at least one of the following: voice information, image information, the first call request is a voice call request or a video call request, and the first call is a voice call or a video call.

9. The call processing device according to claim 8, characterized in that: The first video is a video corresponding to the second call or a video recorded in real time.

10. The call processing device according to claim 9, characterized in that: The device also includes: A second sending module, configured to send second target information corresponding to the first call object to the first video object when the first video is a video corresponding to the second call; The second target information includes at least one of the following: voice information and image information.

11. The call processing device according to claim 8 or 9, characterized in that: The first sending module includes: a first acquisition unit, configured to, when the first target information includes voice information, the video screen of the first video includes at least two video objects, and the first voice information of the first video is acquired, intercept a voice segment in the first voice information that matches the voiceprint feature of the first video object according to the voiceprint feature of the first video object, so as to obtain the first target voice information; The first sending unit is used to send the first target voice information to the first call object.

12. The call processing device according to claim 8 or 9, characterized in that: The first sending module includes: a second acquisition unit, configured to acquire at least one first video image including the first video object in the first video, when the first target information includes image information, the video screen of the first video includes at least two video objects, and the first call request is a video call request or the first call is a video call; an image segmentation unit, configured to perform image segmentation processing on the at least one first video image to obtain at least one first target image, wherein the first target image is an image corresponding to an area where the first video object is located in the first video image; The second sending unit is configured to send the at least one first target image to the first communication object.

13. The call processing device according to claim 8, characterized in that: The device also includes: A second receiving module is used to receive a second input from the user when a third call request is received or the third call is connected; A second relationship establishing module, configured to establish an association relationship between the second video object and the third call object in response to the second input; The second video object is an object in the first video, the third call object is an object corresponding to the third call request or the third call, and the third call object and the first call object are call objects corresponding to different applications.

14. The call processing device according to claim 9, characterized in that: The device also includes: A third receiving module is used to receive a third input of a file to be sent by a user when the first video is a video corresponding to the second call; The third sending module is used to send the to-be-sent file to the first call object and the object corresponding to the second call at the same time in response to the third input.

15. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the call processing method according to any one of claims 1 to 7 are implemented.

Images