Call control method and electronic device

Abstract

The present application provides a call control method and an electronic device, which can be applied to an electronic device, wherein the electronic device includes a first display screen and a second display screen, and the method includes: displaying a first call interface on the first display screen; wherein the first call interface includes a first user and a remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to a remote device; in response to a received first operation, the first display screen does not display the first call interface, and displays a second call interface on the second display screen; wherein the first operation is used to instruct the first call interface to be transferred to the second display screen, the second call interface includes a second user and the remote user, and the second user corresponds to the second display screen. The solution provided by the present application can improve the convenience of call control and call efficiency.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the priority of the Chinese patent application filed with the Patent Office of the People's Republic of China on August 30, 2022, with application number 202211049708.7 and application name "A method for transferring calls from one person to multiple people", the entire contents of which are incorporated by reference in this application. Technical Field

[0003] The present application relates to the technical field of electronic equipment, and in particular to a call control method and electronic equipment. Background Art

[0004] In the current car-machine scenario, when different users in the cockpit make video calls on different screens, all parties making the call need to have independent user accounts. Each user needs to log in to the corresponding user account in the application that provides the call service before they can control the initiation of the call, access the call, or transfer the call (referring to transferring the call on one screen to another screen so that the user corresponding to the other screen can participate in the call). Therefore, the operation process is more cumbersome and the call process is more complicated, resulting in lower convenience and efficiency of calls based on this method. Summary of the invention

[0005] The present application provides a call control method and electronic device to improve the convenience and efficiency of call control.

[0006] In a first aspect, the present application provides a call control method, which is applied to an electronic device, wherein the electronic device includes a first display screen and a second display screen; the method includes: displaying a first call interface on the first display screen; wherein the first call interface includes a first user and a remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to a remote device; in response to a received first operation, the first display screen does not display the first call interface, and displays a second call interface on the second display screen; wherein the first operation is used to instruct the first call interface to be transferred to the second display screen, the second call interface includes the second user and the remote user, and the second user corresponds to the second display screen.

[0007] In this method, when the electronic device displays the call interface corresponding to the call between the first user and the remote user on the first display screen, the call interface can be transferred to the second display screen in response to the user's operation, and after the call interface is transferred to the second display screen, the user in the call interface becomes the second user and the remote user corresponding to the second display screen, and the users participating in the call also become the second user and the remote user. Based on this method, the electronic device can easily and quickly transfer calls between its multiple display screens without the need for the user corresponding to each display screen to log in to the user account on the corresponding display screen. Therefore, the execution process of the call transfer method is relatively simple and fast, which can improve the convenience of call control and call efficiency.

[0008] In one possible design, before displaying the first call interface on the first display screen, the method further includes: using the first camera to shoot the first user, and sending the video shot by the first camera to the remote device; after displaying the first call interface on the first display screen, the method further includes: in response to the first operation, using the first camera to shoot the second user, and sending the video shot by the first camera to the remote device; or, in response to the first operation, turning off the first camera, starting the second camera, using the second camera to shoot the second user, and sending the video shot by the second camera to the remote device; wherein the first camera is associated with the first display screen, and the second camera is associated with the second display screen.

[0009] In this method, after the call is transferred, the electronic device can switch the camera used to shoot the first user to shoot the second user or use the camera associated with the second display screen to shoot the second user, thereby obtaining the video content of the second user, so as to display the second user participating in the call in the call interface after the call is transferred, thereby achieving the effect of call transfer.

[0010] In one possible design, displaying the second call interface on the second display screen includes: receiving a video from the remote device, and displaying the remote user in the second call interface based on the video from the remote device; and displaying the second user in the second call interface based on the video captured by the first camera or the second camera.

[0011] In this method, the electronic device can display the remote user and the second user participating in the call in the call interface after the transfer based on the video from the remote device and the video captured by the camera, thereby achieving the effect of call transfer.

[0012] In one possible design, the method also includes: in response to the first operation, using the Bluetooth headset connected to the second display screen to play the audio from the remote device; or, in response to the first operation, using a set audio output device in the spatial area where the second display screen is located to play the audio from the remote device; or, in response to the first operation, using a target audio output device to play the audio from the remote device; wherein the target audio output device is associated with a first target sound zone, and the first target sound zone is associated with at least one audio output device in the spatial area where the second display screen is located.

[0013] In this method, the electronic device can use different methods to select the audio output device for playing audio after the call is transferred, so it is more flexible and helps to achieve the effect of call transfer in more application scenarios, thereby improving the practicality of the solution.

[0014] In one possible design, the first target sound zone is associated with the second display screen.

[0015] In this method, the sound zone is associated with the display screen, so the electronic device can manage different sound zones based on the display screen, and can automatically select the audio output device associated with the sound zone associated with the display screen to play the audio corresponding to the content on the display screen, thereby realizing automatic audio playback control without manual control by the user. Therefore, this method is highly intelligent and practical.

[0016] In a possible design, the device type and / or location type of the at least one audio output device are the same.

[0017] In this method, the audio output devices used when playing audio are of the same type, and the audio output devices of the same type are associated with the sound zones, so the electronic device can divide different types of audio output devices by the sound zones, which can improve the efficiency of managing the audio output devices. In addition, the audio output device can be selected based on the sound zones, which helps to improve the efficiency of selecting the audio output device, thereby improving the control efficiency of the audio playback process.

[0018] In one possible design, the method also includes: when the first call interface is displayed on the first display screen, using the first audio output device to play the audio from the remote device; after the first call interface is displayed on the first display screen, the method also includes: in response to the first operation, the first audio output device does not play the audio from the remote device.

[0019] In this method, after the electronic device completes the call transfer, it can control the audio output device that played audio before the call transfer to stop playing audio, thereby avoiding audio playback conflicts with the audio output device that plays audio after the call transfer and avoiding unnecessary power consumption.

[0020] In one possible design, the method also includes: in response to the first operation, receiving audio using a Bluetooth headset connected to the second display screen, and sending the audio received by the Bluetooth headset to the remote device; or, in response to the first operation, receiving audio using a target audio input device, and sending the audio received by the target audio output device to the remote device; wherein the target audio input device is associated with a second target sound zone, and the second target sound zone is associated with at least one audio input device in the spatial area where the second display screen is located.

[0021] In this method, the electronic device can use different methods to select the audio input device for receiving audio after the call is transferred, so it is more flexible and helps to achieve the effect of call transfer in more application scenarios, thereby improving the practicality of the solution.

[0022] In one possible design, the second target sound zone is associated with the second display screen.

[0023] In this method, the sound zone is associated with the display screen, so the electronic device can manage different sound zones based on the display screen, and can automatically select the audio input device associated with the sound zone associated with the display screen to receive audio, thereby realizing automatic audio reception control without manual control by the user. Therefore, this method is highly intelligent and practical.

[0024] In a possible design, the device type and / or location type of the at least one audio input device are the same.

[0025] In this method, the audio input devices used when receiving audio are of the same type, and the audio input devices of the same type are associated with the sound zones, so the electronic device can divide different types of audio input devices by the sound zones, which can improve the efficiency of managing the audio input devices. In addition, the audio input device can be selected based on the sound zones, which helps to improve the efficiency of selecting the audio input device, thereby improving the control efficiency of the audio receiving process.

[0026] In one possible design, the method also includes: when the first call interface is displayed on the first display screen, using a first audio input device to receive audio, and sending the audio received by the first audio input device to the remote device; after the first call interface is displayed on the first display screen, the method also includes: in response to the first operation, closing the first audio input device.

[0027] In this method, after the call transfer is completed, the electronic device can control the audio input device that received the audio before the call transfer to stop receiving the audio, thereby avoiding repeated audio reception and unnecessary power consumption.

[0028] In one possible design, the first display screen and the second display screen are different display screens in the cabin space.

[0029] In this method, the electronic device can execute the above method in a cockpit scenario to realize call flow between different display screens in the cockpit, thereby meeting the call flow needs of users in the vehicle cabin and improving the user's call experience.

[0030] In a second aspect, the present application provides a call control method, which is applied to an electronic device, wherein the electronic device includes a first display screen and a second display screen; the method includes: displaying a first call interface on the first display screen; wherein the first call interface includes a first user and a remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to a remote device; in response to a received first operation, the first call interface on the first display screen is updated to a second call interface, and a third call interface is displayed on the second display screen; wherein the first operation is used to indicate: inviting a second user corresponding to the second display screen to participate in the call; the second call interface and the third call interface include the first user, the second user and the remote user.

[0031] In this method, when the electronic device displays a call interface corresponding to a call between a first user and a remote user on a first display screen, it can, in response to the user's operation, invite the user corresponding to the second display screen to join the call, and update the call interface on the first display screen to a three-party (i.e., remote user, first user, and second user) call interface, and display the three-party call interface on the second display screen. Based on this method, the electronic device can easily and quickly invite and join calls between its multiple display screens to realize multi-party calls, without the need for the user corresponding to each display screen to log in to the user account on the corresponding display screen. Therefore, the execution process of this method is relatively simple and fast, and can improve the convenience of call control and call efficiency.

[0032] In one possible design, the method also includes: in response to the first operation, using a first camera to shoot the first user, using a second camera to shoot the second user, and sending the first video shot by the first camera and the second video shot by the second camera to the remote device; wherein the first camera is associated with the first display screen, and the second camera is associated with the second display screen; or, in response to the first operation, using a third camera to shoot the first user and the second user, and sending the third video shot by the third camera and the fourth video shot by the third camera to the remote device; wherein the third video includes the first user, and the fourth video includes the second user.

[0033] In this method, after inviting the second user to join the call, the electronic device can use different cameras to shoot the first user and the second user respectively, or use the same camera to shoot the first user and the second user, so that the video content of the first user and the second user can be obtained, so as to display the first user and the second user participating in the call in the call interface, thereby achieving the effect of inviting the new user, namely the second user, to join the call.

[0034] In a possible design, the method of shooting the first user and the second user with a third camera and sending the third video shot by the third camera and the fourth video shot by the third camera to the remote device includes: shooting the first user and the second user with the third camera to obtain a fifth video; wherein the fifth video includes the first user and the second user; determining the third video including the first user based on the fifth video, and determining the fourth video including the second user based on the fifth video; and sending the third video and the fourth video to the remote device respectively.

[0035] In this method, the electronic device can obtain videos containing different users from the video taken by the same camera, so there is no need to shoot different users through multiple cameras. On the one hand, it can reduce the hardware cost of configuring the camera. On the other hand, even in the scenario where multiple cameras cannot be configured, it is possible to invite new users to join the call and display the corresponding call interface. Therefore, this method is highly practical.

[0036] In one possible design, the fifth video includes at least one frame of image; determining the third video including the first user based on the fifth video includes: performing a target processing process on each frame of image in the fifth video to obtain the third video; wherein the target processing process includes: cutting out content outside a first framing frame at a set position in the image; wherein the first framing frame is used to indicate the position of the first user.

[0037] In this method, the electronic device can obtain a video containing one of the users by cropping image frames in a video containing multiple users. Therefore, this method can support obtaining videos containing different users from videos taken by the same camera.

[0038] In one possible design, displaying the third call interface on the second display screen includes: receiving a video from the remote device, and displaying the remote user in the third call interface based on the video from the remote device; and, displaying the first user in the third call interface based on the video captured by the first camera or the third camera; and, displaying the second user in the third call interface based on the video captured by the second camera or the third camera.

[0039] In this method, the electronic device can display the remote user, the first user and the second user participating in the call in the call interface after inviting the second user to join the call based on the video from the remote device and the video captured by the camera, thereby achieving the effect of a three-party call.

[0040] In one possible design, the positions of the first user and the second user are adjacent to each other on the left and right; displaying the third call interface on the second display screen includes: receiving a video from the remote device, and displaying the remote user in the third call interface based on the video from the remote device; determining a sixth video including the first user and the second user based on a first target video and a second target video; wherein the first target video is a video shot by the first camera or the third camera, and the second target video is a video shot by the second camera or the third camera; according to the sixth video, displaying the first user and the second user in the third call interface; wherein the first user and the second user are displayed in the same display area.

[0041] In this method, the electronic device fuses the videos corresponding to different users and displays them in the same interface. When different cameras are used to shoot different users, the viewing user can simultaneously view the different users being shot in the same display area, thereby improving the viewing experience of the user. For example, a user watching a call interface can view two adjacent users in the same area of ​​the interface, which makes it easier for the viewing user to understand information such as the relative positions of the two users in the interface, thereby improving the viewing experience of the user.

[0042] In one possible design, the method further includes: in response to the first operation, receiving audio from the remote device, and / or receiving audio using a second audio input device; wherein the second audio input device is associated with the second display screen; and using a first audio output device to play audio from the remote device and / or audio received by the second audio input device; wherein the first audio output device is associated with the first display screen.

[0043] In this method, the electronic device can use the audio output device associated with the display screen to receive audio from users participating in the call, and can use the audio output device associated with the display screen to play audio from other call participants, thereby realizing audio reception and audio playback during the call and ensuring the smooth progress of the call.

[0044] In one possible design, the first audio output device is: a Bluetooth headset connected to the first display screen; or a set audio output device in the spatial area where the first display screen is located; or an audio output device associated with the first sound zone; wherein the first sound zone is associated with at least one audio output device in the spatial area where the first display screen is located.

[0045] In this method, the electronic device can select the audio output device for playing audio in different ways, so it is highly flexible and helps to improve the practicality of the solution.

[0046] In one possible design, the first sound zone is associated with the first display screen.

[0047] In this method, the sound zone is associated with the display screen, so the electronic device can manage different sound zones based on the display screen, and can automatically select the audio output device associated with the sound zone associated with the display screen to play the audio corresponding to the content on the display screen, thereby realizing automatic audio playback control without manual control by the user. Therefore, this method is highly intelligent and practical.

[0048] In a possible design, the second audio input device is a Bluetooth headset connected to the second display screen or an audio input device associated with the second sound zone; wherein the second sound zone is associated with at least one audio input device in the spatial area where the second display screen is located.

[0049] In this method, the electronic device can select the audio input device for receiving audio in different ways, so it is highly flexible and helps to improve the practicality of the solution.

[0050] In one possible design, the second sound zone is associated with the second display screen.

[0051] In this method, the sound zone is associated with the display screen, so the electronic device can manage different sound zones based on the display screen, and can automatically select the audio input device associated with the sound zone associated with the display screen to receive audio, thereby realizing automatic audio reception control without manual control by the user. Therefore, this method is highly intelligent and practical.

[0052] In one possible design, the method further includes: in response to the first operation, sending the audio received by the second audio input device to the remote device.

[0053] In this method, the electronic device sends the audio corresponding to the second user who has newly joined the call, which is received through the second audio output device, to the remote device, thereby ensuring that the remote device can obtain and play the audio corresponding to the second user who has newly joined the call, thereby achieving a three-party call effect.

[0054] In one possible design, the method further includes: in response to the first operation, receiving audio from the remote device, and / or receiving audio using a first audio input device; wherein the first audio input device is associated with the first display screen; and using a second audio output device to play audio from the remote device and / or audio received by the first audio input device; wherein the second audio output device is associated with the second display screen.

[0055] In this method, the electronic device can use the audio output device associated with the display screen to receive audio from users participating in the call, and can use the audio output device associated with the display screen to play audio from other call participants, thereby realizing audio reception and audio playback during the call and ensuring the smooth progress of the call.

[0056] In one possible design, the second audio output device is: a Bluetooth headset connected to the second display screen; or a set audio output device in the spatial area where the second display screen is located; or an audio output device associated with a third sound zone; wherein the third sound zone is associated with at least one audio output device in the spatial area where the second display screen is located.

[0057] In this method, the electronic device can select the audio output device for playing audio in different ways, so it is highly flexible and helps to improve the practicality of the solution.

[0058] In one possible design, the third sound zone is associated with the second display screen.

[0059] In this method, the sound zone is associated with the display screen, so the electronic device can manage different sound zones based on the display screen, and can automatically select the audio output device associated with the sound zone associated with the display screen to play the audio corresponding to the content on the display screen, thereby realizing automatic audio playback control without manual control by the user. Therefore, this method is highly intelligent and practical.

[0060] In a possible design, the first audio input device is a Bluetooth headset connected to the first display screen or an audio input device associated with a fourth sound zone; wherein the fourth sound zone is associated with at least one audio input device in the spatial area where the first display screen is located.

[0061] In this method, the electronic device can select the audio input device for receiving audio in different ways, so it is highly flexible and helps to improve the practicality of the solution.

[0062] In one possible design, the fourth sound zone is associated with the first display screen.

[0063] In this method, the sound zone is associated with the display screen, so the electronic device can manage different sound zones based on the display screen, and can automatically select the audio input device associated with the sound zone associated with the display screen to receive audio, thereby realizing automatic audio reception control without manual control by the user. Therefore, this method is highly intelligent and practical.

[0064] In one possible design, the method further includes: in response to the first operation, sending the audio received by the first audio input device to the remote device.

[0065] In this method, the electronic device sends the audio corresponding to the first user received by the first audio output device to the remote device, which can ensure that the remote device can obtain and play the audio corresponding to the first user, thereby ensuring the smooth execution of the call process.

[0066] In a possible design, the device type and / or location type of the at least one audio output device are the same.

[0067] In this method, the audio output devices used when playing audio are of the same type, and the audio output devices of the same type are associated with the sound zones, so the electronic device can divide different types of audio output devices by the sound zones, which can improve the efficiency of managing the audio output devices. In addition, the audio output device can be selected based on the sound zones, which helps to improve the efficiency of selecting the audio output device, thereby improving the control efficiency of the audio playback process.

[0068] In a possible design, the device type and / or location type of the at least one audio input device are the same.

[0069] In this method, the audio input devices used when receiving audio are of the same type, and the audio input devices of the same type are associated with the sound zones, so the electronic device can divide different types of audio input devices by the sound zones, which can improve the efficiency of managing the audio input devices. In addition, the audio input device can be selected based on the sound zones, which helps to improve the efficiency of selecting the audio input device, thereby improving the control efficiency of the audio receiving process.

[0070] In one possible design, the first display screen and the second display screen are different display screens in the cabin space.

[0071] In this method, the electronic device can execute the above method in a cockpit scenario to achieve the effect of inviting different display screens in the cockpit to join the call, thereby meeting the multi-party call needs of users in the vehicle cabin and improving the user's call experience.

[0072] In a third aspect, the present application provides a call control method, which is applied to a second electronic device including a second display screen, the method comprising: receiving a first request from a first electronic device forwarded by a server, and receiving first account information from the server; wherein the server is used to store the association relationship between the first display screen of the first electronic device and the second display screen and the first user account logged in on the first display screen, the first user account is associated with a first call interface displayed on the first display screen, the first call interface includes a first user and a remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to the remote device; the first request is used to request that the first call interface be transferred to the second display screen; the first account information is used to indicate the first user account; in response to the first request, the first user account is determined according to the first account information, and the first user account is logged in on the second display screen; the second call interface is displayed on the second display screen; wherein the second call interface is associated with the first user account, the second call interface includes the second user and the remote user, and the second user is associated with the second display screen.

[0073] In this method, the second electronic device can automatically log in to the user account logged in on the first display screen of the first electronic device on the display screen, and then control the flow of calls associated with the user account. During this process, the user only needs to log in to the user account on the first display screen, and there is no need to log in to the user account on each display screen. Therefore, this call flow method can appropriately simplify user operations, thereby improving the simplicity and speed of the call flow process. Therefore, this method can improve the convenience of call control and call efficiency.

[0074] In one possible design, after logging into the first user account on the second display screen, the method further includes: using a first camera to shoot the second user, and sending the video shot by the first camera to the remote device, wherein the first camera is associated with the first display screen and the second display screen; or, using a second camera associated with the second display screen to shoot the second user, and sending the video shot by the second camera to the remote device.

[0075] In one possible design, displaying the second call interface on the second display screen includes: receiving a video from the remote device, and displaying the remote user in the second call interface based on the video from the remote device; and displaying the second user in the second call interface based on the video captured by the first camera or the second camera.

[0076] In one possible design, after logging in to the first user account on the second display screen, the method also includes: using a Bluetooth headset connected to the second display screen to play audio from the remote device; or, using a set audio output device in the spatial area where the second display screen is located to play audio from the remote device; or, using a target audio output device to play audio from the remote device; wherein the target audio output device is associated with a first target sound zone, and the first target sound zone is associated with at least one audio output device in the spatial area where the second display screen is located.

[0077] In one possible design, the first target sound zone is associated with the second display screen.

[0078] In a possible design, the device type and / or location type of the at least one audio output device are the same.

[0079] In one possible design, the method also includes: receiving audio using a Bluetooth headset connected to the second display screen, and sending the audio received by the Bluetooth headset to the remote device; or, receiving audio using a target audio input device, and sending the audio received by the target audio output device to the remote device; wherein the target audio input device is associated with a second target sound zone, and the second target sound zone is associated with at least one audio input device in the spatial area where the second display screen is located.

[0080] In one possible design, the second target sound zone is associated with the second display screen.

[0081] In a possible design, the device type and / or location type of the at least one audio input device are the same.

[0082] In one possible design, the first display screen and the second display screen are different display screens in the cabin space.

[0083] In a fourth aspect, the present application provides a call control method, which is applied to a second electronic device including a second display screen, the method comprising: receiving a first request from a first electronic device forwarded by a server, and receiving first account information from the server; wherein the server is used to store the association relationship between the first display screen of the first electronic device and the second display screen and the first user account logged in on the first display screen, the first user account is associated with a first call interface displayed on the first display screen, the first call interface includes a first user and a remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to the remote device; the first request is used to request the second user corresponding to the second display screen to participate in the call; the first account information is used to indicate the first user account; in response to the first request, the first user account is determined according to the first account information, and the first user account is logged in on the second display screen; the second call interface is displayed on the second display screen; wherein the second call interface is associated with the first user account, and the second call interface includes the first user, the second user and the remote user.

[0084] In this method, the second electronic device can automatically log in to the user account logged in on the first display screen of the first electronic device on the second display screen, and then control the second user corresponding to the second display screen to join the call associated with the user account. In this process, the user only needs to log in to the user account on the first display screen, and there is no need to log in to the user account on each display screen. Therefore, this method can appropriately simplify user operations, thereby improving the simplicity and speed of the process of inviting users to join existing calls. Therefore, this method can improve the convenience of call control and call efficiency.

[0085] In one possible design, after logging in to the first user account on the second display screen, the method also includes: using the first camera to shoot the second user, and sending the first video shot by the first camera to the first electronic device and the remote device; wherein the first camera is associated with the second display screen; or, using the second camera to shoot the first user and the second user, and determining a third video including the second user based on the second video shot by the second camera, and sending the third video to the first electronic device and the remote device; wherein the second camera is associated with the first display screen and the second display screen.

[0086] In one possible design, sending the first video captured by the first camera to the first electronic device and the remote device includes: sending the first video to the first electronic device; and forwarding the first video to the remote device via the first electronic device.

[0087] In this method, the second electronic device can transmit the captured video stream to the remote device by forwarding it through the first electronic device. Then, the second electronic device does not need to establish data communication with the remote device, but can transmit the video data by means of the communication link established between the second electronic device and the first electronic device and the data communication link established between the first electronic device and the remote device, thereby improving the processing efficiency on the second electronic device side.

[0088] In one possible design, the second video includes at least one frame of image; determining the third video including the second user based on the second video shot by the second camera includes: performing a target processing process on each frame of image in the second video to obtain the third video; wherein the target processing process includes: cutting out content outside a first viewfinder at a set position in the image; wherein the first viewfinder is used to indicate the position of the second user.

[0089] In one possible design, displaying the second call interface on the second display screen includes: receiving a video from the remote device, and displaying the remote user in the second call interface based on the video from the remote device; and, receiving a video from the first electronic device, and displaying the first user in the second call interface based on the video from the first electronic device; and, displaying the second user in the second call interface based on the first video or the third video.

[0090] In one possible design, the positions of the first user and the second user are adjacent to each other on the left and right; displaying the second call interface on the second display screen includes: receiving a video from the remote device, and displaying the remote user in the second call interface based on the video from the remote device; receiving a video from the first electronic device; determining a fourth video including the first user and the second user based on a first target video and a second target video; wherein the first target video is a video from the first electronic device, and the second target video is the first video or the third video; displaying the first user and the second user in the second call interface based on the fourth video; wherein the first user and the second user are displayed in the same display area.

[0091] In one possible design, after logging in to the first user account on the second display screen, the method also includes: using a first audio output device to play audio from the first electronic device and / or the remote device; wherein the first audio output device is: a Bluetooth headset connected to the second display screen; or, a set audio output device within the spatial area where the second display screen is located; or, an audio output device associated with the first sound zone; wherein the first sound zone is associated with at least one audio output device within the spatial area where the second display screen is located.

[0092] In one possible design, the first sound zone is associated with the second display screen.

[0093] In a possible design, the device type and / or location type of the at least one audio output device are the same.

[0094] In one possible design, after logging into the first user account on the second display screen, the method further includes: using a first audio input device to receive audio, and sending the audio received by the first audio input device to the first electronic device and the remote device; wherein, the first audio input device is a Bluetooth headset connected to the second display screen or an audio input device associated with a second sound zone; wherein, the second sound zone is associated with at least one audio input device in the spatial area where the second display screen is located.

[0095] In one possible design, the second sound zone is associated with the second display screen.

[0096] In a possible design, the device type and / or location type of the at least one audio input device are the same.

[0097] In one possible design, the first display screen and the second display screen are different display screens in the cabin space.

[0098] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising a display screen, a memory and one or more processors; wherein the memory is used to store computer program code, and the computer program code comprises computer instructions; when the computer instructions are executed by the one or more processors, the electronic device executes the method described in the first aspect or any possible design of the first aspect, or executes the method described in the second aspect or any possible design of the second aspect, or executes the method described in the third aspect or any possible design of the third aspect, or executes the method described in the fourth aspect or any possible design of the fourth aspect.

[0099] In a sixth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the computer executes the method described in the first aspect or any possible design of the first aspect, or executes the method described in the second aspect or any possible design of the second aspect, or executes the method described in the third aspect or any possible design of the third aspect, or executes the method described in the fourth aspect or any possible design of the fourth aspect.

[0100] In the seventh aspect, the present application provides a computer program product, comprising a computer program or instructions, which, when executed on a computer, causes the computer to execute the method described in the first aspect or any possible design of the first aspect, or execute the method described in the second aspect or any possible design of the second aspect, or execute the method described in the third aspect or any possible design of the third aspect, or execute the method described in the fourth aspect or any possible design of the fourth aspect.

[0101] In an eighth aspect, the present application provides a chip system, the chip system includes a processor and a memory, and the memory stores instructions; when the instructions are executed by the processor, the method described in the first aspect or any possible design of the first aspect is implemented, or the method described in the second aspect or any possible design of the second aspect is implemented, or the method described in the third aspect or any possible design of the third aspect is implemented, or the method described in the fourth aspect or any possible design of the fourth aspect is implemented. The chip system can be composed of chips, or it can include chips and other discrete devices.

[0102] For the beneficial effects not mentioned in the third to eighth aspects above, please refer to the description of the beneficial effects of the corresponding contents in the first or second aspect above, and no further repetition will be given here. BRIEF DESCRIPTION OF THE DRAWINGS

[0103] Figure 1 A schematic diagram of the hardware architecture of an electronic device provided in an embodiment of the present application;

[0104] Figure 2 A schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;

[0105] Figure 3 A schematic diagram of the division of sound zones in a vehicle cabin provided in an embodiment of the present application;

[0106] Figure 4 A schematic diagram of the functional hierarchy architecture of a control device provided in an embodiment of the present application;

[0107] Figure 5 A flowchart of an audio control method provided in an embodiment of the present application;

[0108] Figure 6 A schematic diagram of an application scenario of a call control method provided in an embodiment of the present application;

[0109] Figure 7a A schematic diagram of a call interface in a cockpit provided in an embodiment of the present application;

[0110] Figure 7b A schematic diagram of a call control control in a cockpit provided by an embodiment of the present application;

[0111] Figure 7c A schematic diagram of a display screen selection interface in a cockpit provided in an embodiment of the present application;

[0112] Figure 7d A schematic diagram of a call interface in a cockpit provided in an embodiment of the present application;

[0113] Figure 8 A schematic diagram of a call control method provided in an embodiment of the present application;

[0114] Fig. 9 A schematic diagram of a call control method provided in an embodiment of the present application;

[0115] Fig.10 A schematic diagram of a video stream processing method provided in an embodiment of the present application;

[0116] Fig.11 A schematic diagram of a shooting range of a central control camera in a cockpit provided in an embodiment of the present application;

[0117] Fig.12a A schematic diagram of a display screen selection interface in a cockpit provided in an embodiment of the present application;

[0118] Figure 12b A schematic diagram of a call interface in a cockpit provided in an embodiment of the present application;

[0119] Fig.13 A schematic diagram of a call control method provided in an embodiment of the present application;

[0120] Fig.14 A schematic diagram of a call control method provided in an embodiment of the present application;

[0121] Fig.15 A schematic diagram of a call interface in a cockpit provided in an embodiment of the present application;

[0122] Fig.16 A schematic diagram of an image fusion processing method provided in an embodiment of the present application;

[0123] Fig.17 A schematic diagram of an image fusion processing interface provided in an embodiment of the present application;

[0124] Fig.18 A schematic diagram of a call interface in a cockpit provided in an embodiment of the present application;

[0125] Fig.19 A schematic diagram of a call control method provided in an embodiment of the present application;

[0126] Fig. 20 A schematic diagram of a call control method provided in an embodiment of the present application;

[0127] Fig.21 A schematic diagram of a call control method provided in an embodiment of the present application;

[0128] Fig. 22 A schematic diagram of a call control method provided in an embodiment of the present application;

[0129] Fig.23 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0130] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. Among them, in the description of the embodiments of the present application, the terms "first" and "second" are used only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.

[0131] To facilitate understanding, exemplary descriptions of concepts related to the present application are provided for reference.

[0132] The electronic device may be a device having a display function and a wireless connection function. In some embodiments of the present application, the electronic device may be a device having one or more display screens.

[0133] In some embodiments of the present application, the electronic device may be a portable device, such as a mobile phone, a tablet computer, a wearable device with a wireless communication function (e.g., a watch, a bracelet, a helmet, a headset, etc.), a vehicle-mounted terminal device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. The electronic device may also be a smart home device (e.g., a smart TV, a smart speaker, etc.), a smart car, a smart robot, a workshop device, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, or a wireless terminal in smart home, a flying device (e.g., a smart robot, a hot air balloon, a drone, an airplane), etc.

[0134] In some embodiments of the present application, the electronic device may also be a portable terminal device that also includes other functions such as a personal digital assistant and / or a music player. Exemplary embodiments of the portable terminal device include but are not limited to: Or a portable terminal device with other operating systems. The portable terminal device may also be other portable terminal devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of the present application, the electronic device may not be a portable terminal device, but a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0135] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

[0136] The embodiments of the present application provide a call control method and an electronic device for easily and quickly implementing multi-party calls or call transfers among multiple people, thereby improving the convenience and practicality of call control and thereby improving the user's call experience.

[0137] First see Figure 1 , the structure of the electronic device to which the method provided in the embodiments of the present application is applicable is introduced.

[0138] like Figure 1 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a SIM card interface 195, etc.

[0139] The sensor module 180 may include a gyroscope sensor, an acceleration sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, an air pressure sensor, a bone conduction sensor, and the like.

[0140] Understandably, Figure 1 The electronic device 100 shown is merely an example and does not constitute a limitation on the electronic device, and the electronic device may have more or fewer components than those shown in the figure, may combine two or more components, or may have a different component configuration. Figure 1 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0141] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural network processor (Neural-network Processing Unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. Among them, the controller can be the nerve center and command center of the electronic device 100. The controller can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

[0142] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0143] The execution of the call control method provided in the embodiment of the present application can be controlled by the processor 110 or completed by calling other components, such as calling the processing program of the embodiment of the present application stored in the internal memory 121, or calling the processing program of the embodiment of the present application stored in a third-party device through the external memory interface 120, to control the wireless communication module 160 to communicate data with other devices, improve the intelligence and convenience of the electronic device 100, and enhance the user experience. The processor 110 can include different devices. For example, when the CPU and GPU are integrated, the CPU and GPU can cooperate to execute the call control method provided in the embodiment of the present application, such as part of the algorithm in the call control method is executed by the CPU, and the other part of the algorithm is executed by the GPU, so as to obtain faster processing efficiency.

[0144] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. The display screen 194 can be used to display information input by a user or information provided to a user and various graphical user interfaces (GUIs). For example, the display screen 194 can display photos, videos, web pages, or files, etc.

[0145] In the embodiment of the present application, the display screen 194 may be an integrated flexible display screen, or a spliced ​​display screen consisting of two rigid screens and a flexible screen located between the two rigid screens.

[0146] The camera 193 (a front camera or a rear camera, or one camera can be used as both a front camera and a rear camera) is used to capture still images or videos. Generally, the camera 193 may include a photosensitive element such as a lens group and an image sensor, wherein the lens group includes a plurality of lenses (convex lenses or concave lenses) for collecting light signals reflected by the object to be photographed and transmitting the collected light signals to the image sensor. The image sensor generates an original image of the object to be photographed based on the light signal.

[0147] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store codes of an operating system, an application program (such as an audio control function, etc.), etc. The data storage area may store data created during the use of the electronic device 100, etc.

[0148] The internal memory 121 may also store one or more computer programs corresponding to the audio control algorithm provided in the embodiment of the present application. The one or more computer programs are stored in the internal memory 121 and configured to be executed by one or more processors 110, and the one or more computer programs include instructions, which may be used to execute the various steps in the following embodiments.

[0149] In addition, the internal memory 121 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0150] Of course, the code of the audio control algorithm provided in the embodiment of the present application may also be stored in an external memory. In this case, the processor 110 may run the code of the audio control algorithm stored in the external memory through the external memory interface 120 .

[0151] The sensor module 180 may include a gyro sensor, an acceleration sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, and the like.

[0152] The touch sensor is also called a "touch panel". The touch sensor can be arranged on the display screen 194, and the touch sensor and the display screen 194 form a touch display screen, also called a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor can also be arranged on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0153] Exemplarily, the display screen 194 of the electronic device 100 displays a main interface, which includes icons of multiple applications (such as a camera application, a WeChat application, etc.). The user clicks the icon of the camera application in the main interface through the touch sensor, triggering the processor 110 to start the camera application and turn on the camera 193. The display screen 194 displays the interface of the camera application, such as a viewfinder interface.

[0154] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0155] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0156] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110. In an embodiment of the present application, the mobile communication module 150 can also be used to interact with other devices for information.

[0157] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0158] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) and the like applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering processing, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2. In the embodiment of the present application, the wireless communication module 160 is used to establish a connection with other electronic devices and exchange data. Or the wireless communication module 160 can be used to access the access point device, send control instructions to other electronic devices, or receive data sent from other electronic devices.

[0159] In addition, the electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. For example, music playback, recording, etc. The electronic device 100 can receive input from the key 190 and generate key signal input related to the user settings and function control of the electronic device 100. The electronic device 100 can use the motor 191 to generate a vibration prompt (such as an incoming call vibration prompt). The indicator 192 in the electronic device 100 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 in the electronic device 100 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195, or pulled out from the SIM card interface 195, to achieve contact and separation with the electronic device 100.

[0160] It should be understood that in practical applications, the electronic device 100 may include Figure 1The embodiments of the present application are not limited to the more or fewer components shown. The illustrated electronic device 100 is only an example, and the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.

[0161] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. Figure 2 As shown, the software architecture can be divided into four layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime and system library, and the Linux kernel layer.

[0162] The application layer is the top layer of the operating system, including native applications of the operating system, such as camera, gallery, calendar, Bluetooth, music, video, information, etc. The application involved in the embodiments of the present application is referred to as application, which is a software program that can realize one or more specific functions. Usually, multiple applications can be installed in an electronic device. For example, camera application, email application, smart home control application, etc. The application mentioned below can be a system application installed when the electronic device leaves the factory, or it can be a third-party application downloaded from the Internet or obtained from other electronic devices by the user during the use of the electronic device.

[0163] Of course, for developers, developers can write applications and install them in this layer. In a possible implementation, applications can be developed using the Java language by calling the Application Programming Interface (API) provided by the application framework layer. Developers can interact with the bottom layer of the operating system (such as the kernel layer) through the application framework to develop their own applications.

[0164] The application framework layer provides application programming interfaces and programming frameworks for applications in the application layer. The application framework layer may include some predefined functions. The application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0165] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0166] Content providers are used to store and retrieve data and make these data accessible to applications. The data may include files (such as documents, videos, images, audio), text and other information.

[0167] The view system includes visual controls, such as controls for displaying text, images, documents, etc. The view system can be used to build applications. The interface in the display window can be composed of one or more views. For example, the display interface including the SMS notification icon can include a view for displaying text and a view for displaying images.

[0168] The phone manager is used to provide communication functions for electronic devices. The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction.

[0169] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the system.

[0170] The core library of the system consists of two parts: one is the function that the Java language needs to call, and the other is the core library of the system. The application layer and the application framework layer run in the virtual machine. Taking Java as an example, the virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0171] The system library can include multiple functional modules. For example: surface manager, media library, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), image processing library, etc. The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications. The media library supports a variety of commonly used audio and video format playback and recording, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.564, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.

[0172] The kernel layer provides the core system services of the operating system, such as security, memory management, process management, network protocol stack and driver model, which are all implemented based on the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer has many drivers related to electronic devices, the main drivers are: display driver; keyboard driver as input device; Flash driver based on memory technology device; camera driver; audio driver; Bluetooth driver; WiFi driver, etc.

[0173] It should be understood that the functional services described above are only examples, and in actual applications, electronic devices may also be divided into more or fewer functional services according to other factors, or the functions of each service may be divided in other ways, or the functional services may not be divided but work as a whole.

[0174] The solution provided in the embodiments of the present application is described in detail below.

[0175] The solution provided in the embodiment of the present application can be applied to a call control system including at least one electronic device, multiple display screens, and multiple audio devices. Among them, at least one electronic device is used to control multiple display screens and multiple audio devices. In one scenario, the call control system may include an electronic device, and the multiple display screens may be display screens belonging to the electronic device. In this scenario, the electronic device can use a one-core multi-screen mechanism to control multiple display screens. Among them, the one-core multi-screen mechanism can be understood as a chip driving multiple display screens to interact. In another scenario, the call control system may include multiple electronic devices, and the multiple display screens may belong to different electronic devices among the multiple electronic devices, and the multi-core multi-screen mechanism can be used to control multiple display screens in this scenario. The audio device has the functions of audio input and audio output, or the audio device may include an audio input device and an audio output device. The audio device may belong to the same electronic device or a different electronic device as the display screen. Among them, the multi-core multi-screen mechanism can be understood as multiple chips driving multiple display screens to interact, and each chip can drive one of the multiple display screens.

[0176] In some embodiments of the present application, the call control system may further include at least one camera, which can be used to photograph users participating in the call, thereby supporting video calls.

[0177] The solution provided in the embodiment of the present application can realize call transfer between different display screens or realize multi-party calls corresponding to multiple display screens. Among them, in the call transfer scenario, the call service on one display screen can be transferred to another display screen, so that the user corresponding to the other display screen can participate in the call without logging into the user call account. In the multi-party call scenario, it can support the user corresponding to one display screen to join the ongoing call on another display screen without logging into the user account. Based on the solution provided in the embodiment of the present application, multi-party call processing can be performed without relying on the call account system, and the user joining the call does not need to manually log in to the relevant user call account before joining the call. Therefore, the call process is relatively simple and quick, which can improve the user's call experience. Therefore, the convenience, flexibility and practicality of call control are relatively high.

[0178] Optional, above Figure 1 or Figure 2 The structure of the electronic device shown can be used as a possible implementation of the electronic device provided in the embodiment of the present application. In practical applications, the composition structure of the electronic device can also adopt other implementations, such as including more or fewer modules, etc., which is not specifically limited in the embodiment of the present application.

[0179] In some embodiments of the present application, the above-mentioned call control system may be a system composed of at least one electronic device, multiple display screens, and multiple audio devices in the same spatial environment, and the spatial environment may be, for example, the interior of a cabin, an indoor environment, etc. Based on the solution provided in the embodiments of the present application, multiple display screens in the same spatial environment may perform call transfer or multi-party calls under the control of at least one electronic device, and multiple audio devices in the same spatial environment may perform call transfer or multi-party call-related audio reception or audio output processing under the control of at least one electronic device, thereby providing audio services for users. When the call control system includes at least one camera, at least one camera is located in the same spatial environment, and at least one camera may perform call transfer or multi-party call-related video acquisition and other processing under the control of at least one electronic device.

[0180] The following uses a one-chip, multi-screen scenario as an example to illustrate the audio input and output method used in the embodiment of the present application.

[0181] In the one-chip multi-screen scenario, multiple display screens in the call control system belong to the same electronic device, and the electronic device can adopt a partition management mechanism when controlling audio input and output. The partition management mechanism means that the electronic device can divide the spatial environment corresponding to the call control system into audio zones. Among them, the audio zone defines the area range where the audio device is located in the spatial environment corresponding to the call control system, and different audio zones are different area ranges in the spatial environment. The area defined by each audio zone can include at least one display screen and at least one audio device. Each display screen can be associated with the audio zone to which it is located, and each display screen can play audio and receive audio when the corresponding user of the display screen speaks through the audio device in the audio associated with the display screen. When the electronic device displays the call interface on the display screen, it can select the associated audio zone according to the display screen, and use the audio device in the associated audio zone to play and receive audio.

[0182] It should be noted that the audio device described in the embodiments of the present application may be a device with audio output and audio input functions, that is, the audio device may be used as both an audio output device and an audio input device. Alternatively, the audio device described in the embodiments of the present application includes an audio output device and an audio input device.

[0183] When the audio device described in the embodiment of the present application includes an audio output device and an audio input device, the area defined by each of the above-mentioned audio zones includes at least one display screen, at least one audio output device, and at least one audio input device. Each display screen can play audio through the audio output device in the associated audio zone, and can receive audio of the user corresponding to the display screen through the audio input device in the associated audio zone. When the electronic device displays a call interface on the display screen, it can select the associated audio zone according to the display screen, and use the audio output device in the associated audio zone to play the call audio, and use the audio output device in the associated audio zone to collect the call audio.

[0184] In some embodiments of the present application, the sound zone can be divided into a main available sound zone and a secondary available sound zone. Among them, the main available sound zone can be used as a default sound zone. In the case where multiple sound zone division is not performed, each display screen can be associated with the main available sound zone, and can be associated with the newly divided sound zone after multiple sound zone division is performed. For the spatial environment corresponding to the call control system, the main available sound zone can be the entire spatial environment, and the audio devices corresponding to the main available sound zone are all the audio devices in the entire spatial environment, that is, if the main available sound zone is selected when playing audio, all audio devices in the spatial environment can be used to play or receive audio. The secondary available sound zone is a partial area in the spatial environment, and the audio device corresponding to the secondary available sound zone is an audio device in the partial area corresponding to the secondary available sound zone. There can be multiple secondary available sound zones.

[0185] In the embodiment of the present application, a sound zone can be associated with multiple display screens. Among them, for a sound zone, multiple display screens associated with a sound zone can use the audio device in the sound zone to play / receive audio. For a display screen, a display screen can only use the audio device in a sound zone associated with it to play / receive audio. The division of the sound zone can be automatically divided by the electronic device according to the set rules, or it can be manually divided by the user.

[0186] For example, the call control system may be a system composed of electronic devices, multiple display screens, and multiple audio devices deployed in the vehicle cabin, and the space environment corresponding to the call control system may be the space in the vehicle cabin. Figure 3 As shown in , taking a five-seater car as an example, taking the audio device for outputting audio as an example, the display screen deployed in the vehicle cockpit may include a central control screen (or driving screen), a co-pilot screen, a rear screen (including at least one of a rear left screen, a rear right screen, or an auxiliary screen), etc., and the audio device deployed in the vehicle cockpit may include a driver's seat speaker (i.e., a loudspeaker), a co-pilot's seat speaker, a rear speaker (including a rear left speaker, a rear right speaker), a headrest speaker for each seat (including a driver's seat headrest speaker, a co-pilot's seat headrest speaker, a rear left headrest speaker, and a rear right headrest speaker), a Bluetooth headset connected to each seat or each display screen (e.g. Figure 3The co-pilot Bluetooth headset, auxiliary screen Bluetooth headset, etc. shown in the figure, wherein the driver's seat speaker, the co-pilot's seat speaker, and the rear speaker can together constitute the whole vehicle speaker in the vehicle cabin. For example, Figure 3 As shown in , the sound zones in the vehicle cabin may include sound zones 1 to 3, wherein sound zone 1 may be a primary available sound zone, sound zones 2 and 3 may be secondary available sound zones, and each sound zone includes a display screen and an audio device such as Figure 3 As shown in , the main available audio zone, i.e., audio zone 1, corresponds to the space in the entire cockpit, and the audio devices in audio zone 1 may include all audio devices in the cockpit. The central control screen is associated with audio zone 1, so when the electronic device plays / receives the audio corresponding to the central control screen, it can select at least one audio device to be used from all audio devices in the cockpit. Audio zone 2 corresponds to the space near the co-pilot seat, and the audio devices in audio zone 2 include co-pilot speakers, co-pilot headrest speakers, and co-pilot Bluetooth headsets. The co-pilot screen is associated with audio zone 2, so when the electronic device plays / receives the audio corresponding to the co-pilot screen, it can select the audio device to be used from the audio devices in audio zone 2. Audio zone 3 corresponds to the space near the rear seats, and the audio devices in audio zone 3 include rear speakers, rear headrest speakers, and rear screen Bluetooth headsets. The rear screen is associated with audio zone 3, so when the electronic device plays / receives the audio corresponding to the rear screen, it can select the audio device to be used from the audio devices in audio zone 3.

[0187] It should be noted that the above Figure 3 The number of sound zones, the way of dividing sound zones, the association between the display screen and the sound zones shown in are only examples provided in the embodiments of the present application, and do not limit the method of dividing sound zones and the method of associating the display screen and the sound zones provided in the embodiments of the present application. Figure 3 In the scenario shown, the division of sound zones in the cockpit space and the association between the display screen and the sound zones are not limited to the implementation methods described above. In actual applications, electronic devices can flexibly divide sound zones and flexibly control the association between the display screen and the sound zones according to actual scenarios, user needs and other factors. For example, the cockpit can be divided into more sound zones. For another example, the sound zone associated with the co-pilot screen may also include the vehicle speakers, etc. Based on the above sound zone division method, when the electronic device displays content on different display screens, for each display screen, the electronic device can choose to use the audio device in the sound zone associated with the display screen to play / receive the audio corresponding to the display screen. That is, on which display screen the call service (or application) is displayed (running), when playing / receiving audio, the audio device in the sound zone of which display screen is preferentially selected.

[0188] Reference Figure 4In some embodiments of the present application, the functional layers in the electronic device used to implement the audio control method provided in the embodiments of the present application may include a system layer, an application layer, a media framework layer, a hardware abstract layer (HAL), etc.

[0189] The system layer includes multiple display screens (e.g. Figure 4 The application layer includes various types of applications installed in electronic devices, such as system-level applications (vehicle control settings, comfort settings, etc.), media applications (including video applications, music applications, radio applications and other main listening applications), voice call applications, navigation applications, etc. These applications can run or display content on the display screen of the system layer, and can play / receive various types of audio (such as playing) through the audio device in the call control system. Figure 4 , such as media audio, navigation audio, etc., and receiving user audio, etc.). Optionally, the application layer can be implemented as Figure 2 The application layer shown in the figure, the media framework layer can be deployed in Figure 2 In the application framework layer shown in .

[0190] The media framework layer may include an audio control module (e.g. Figure 4 , mixers (mix / mixer) 1 to 11 shown in the figure, Bluetooth audio transmission model protocol (advanced audio distribution profile, A2DP) thread, etc.) and a sound zone management module (e.g. Figure 4, etc.). The audio control module and the audio zone management module can collaborate to complete the control of the audio playback / reception process. Specifically, the audio zone management module is used to manage the audio zones divided in the call control system. The audio zone management module can be connected to at least one bus, wherein each bus can be connected to at least one audio device, and different buses are connected to different audio devices. The audio zone management module can store the association between the display screen and the audio zone, the information of the audio devices existing in the audio zone, the connection relationship between the bus and the audio device, etc. The audio control module can obtain this information from the audio zone management module. On the one hand, the audio control module can select the audio device used to play the corresponding audio and the bus used to transmit the audio data according to this information when displaying the application content, and then transmit the audio data to the selected audio device through the selected bus for playback. Specifically, the audio control module is used to receive audio data from the application in the application layer, and select the corresponding audio device for the audio data according to the above method. After selecting the audio device, the audio control module can determine the bus corresponding to the selected audio device. After determining the bus, the audio control module can transmit the audio data through the audio zone management module and the bus, so as to transmit the audio data to the selected audio device for playback. On the other hand, the audio control module can determine the bus to which the audio device is connected based on this information, and receive the audio data from the audio device through the corresponding bus, thereby processing the received audio. Specifically, the audio control module can configure the connection relationship between the audio zone module, the bus and the audio device. After receiving the user audio, the audio device transmits the corresponding audio data to the connected bus, and transmits the audio data to the audio module corresponding to the audio device through the bus. The audio zone module then sends the received audio data to the audio control module, and the audio control module can perform subsequent processing on the received audio data, such as distributing it to other audio processing modules for processing.

[0191] The HAL layer is located in the kernel layer (which can be Figure 2 The kernel layer shown in Figure 2 The HAL layer may include a bus (e.g. Figure 4 1 to 10, A2DP transmission line, universal serial bus (USB), etc.) and the corresponding interfaces of each audio device (e.g. Figure 4 The bus can transmit audio data from the software layer to the corresponding interface, and the interface can transmit the audio data to the corresponding audio device for playback; or, the interface can transmit audio data from the audio device to the corresponding bus, and the bus can transmit the audio data to the software layer for processing.

[0192] It should be noted that Figure 4 The connection mode between the display screen, audio control module, audio zone module, bus, interface corresponding to the audio device, and the data routing mode shown in the figure is only an exemplary description provided in the embodiment of the present application, and the connection mode between the modules or devices inside the electronic device and the data routing mode are not limited to Figure 4 The method shown in , in specific implementation, can be deployed according to the method executed.

[0193] As an optional implementation, different buses can be connected to interfaces corresponding to different audio devices, and each bus can only be connected to an interface corresponding to one audio device. Then the audio control module can only determine one corresponding audio device through one bus. Taking the audio playback scenario as an example, after selecting an audio device, the audio control module can send audio data to the bus corresponding to the selected audio device, and transmit the audio data to the selected audio device through the bus and the interface connected to the bus. For example, Figure 4 As shown in , buses 1 to 5 are connected to the vehicle speakers, driver's speakers, driver's headrest speakers, co-driver's speakers, and co-driver's headrest speakers respectively. When the audio control module chooses to use the front speakers and front headrest speakers to play audio, the audio can be sent to buses 2 to 5 respectively; when the audio control module chooses to use the driver's headrest speakers to play audio, the audio can be sent to bus 3.

[0194] It should be noted that for ease of viewing, the connection method between the zone module and the bus is as follows: Figure 4 The figure only shows some of the possible connection methods, and does not cover all possible connection methods, nor does it limit the connection method between the audio zone module and the bus inside the electronic device. In actual scenarios, the electronic device can control the connection relationship between the audio zone module corresponding to the divided audio zone and the bus according to the actual situation of dividing the audio zone. Figure 3 From the audio zone division method shown in , it can be seen that the audio zone 1 associated with the central control screen can include all the audio devices in the cockpit, then correspondingly, Figure 4 The audio zone module 1 corresponding to the central control screen shown in the figure can be connected to buses 1 to 3 as well as other buses such as buses 4 to 10, A2DP transmission line, USB, etc.

[0195] As another optional implementation, each bus can be connected to interfaces corresponding to multiple audio devices, and the audio control module can select multiple audio devices through one bus. At the same time, each audio device can also be connected to multiple buses. For example, Figure 4The driver's headrest audio, driver's speaker, passenger speaker, and passenger headrest audio shown in the figure are all connected to a bus. When the audio control module chooses to use the front speakers and front headrest audio to play audio, the audio can be directly sent to the bus. Figure 4 The rear left speaker and the rear right speaker shown in the figure are connected to a bus. When the audio control module chooses to use the rear speakers to play audio, the audio can be directly sent to the bus.

[0196] It should be noted that Figure 4 The hardware and software hierarchical structure shown is only one implementation of the relevant layers of the electronic device in the embodiment of the present application. In practical applications, the electronic device and the composition of each layer can also adopt other implementations, such as including more or fewer modules, etc., which are not specifically limited in the embodiment of the present application.

[0197] Exemplarily, when the electronic device runs a voice call application and displays a call interface on the first display screen, the audio control module can select the sound zone associated with the first display screen according to the association between the display screen and the sound zone, and can further select an audio device for playing / receiving audio from the sound zone according to the audio type. After selecting the audio device, on the one hand, the audio to be played can be transmitted to the interface of the HAL layer through the bus corresponding to the selected audio device, and the audio output mode of the audio device can be configured, and the audio to be played can be transmitted to the corresponding audio device for playback. On the other hand, the user audio can be received through the selected audio device, and the audio data collected by the audio device can be transmitted to the corresponding audio processing module for processing through the bus corresponding to the selected audio device.

[0198] Among them, Figure 5 As shown in , the process corresponding to the above audio playback method may include:

[0199] S501: The electronic device obtains and stores the association relationship between the display screen identifier and the audio zone identifier.

[0200] Among them, the electronic equipment can be Figure 4 The electronic device shown in .

[0201] In some implementations, the association between the display screen identifier and the sound zone identifier can be obtained and saved by the sound zone management module of the electronic device. The association between the display screen identifier and the sound zone identifier can be set by the user; or the sound zone management module can automatically divide the environment space corresponding to the call control system into sound zones according to the set rules, and after obtaining the position of the display screen in the environment space, associate the display screen identifier of the display screen with the sound zone identifier of the sound zone where it is located, thereby obtaining the association between the display screen identifier and the sound zone identifier.

[0202] For example, based on the above Figure 3 In the audio zone division method shown in the figure, the association relationship between the display screen and the audio zone obtained and saved by the audio zone management module may include: the central control screen associated audio zone 1, the co-pilot screen associated audio zone 2, and the rear screen associated audio zone 3. Figure 4 As shown in the figure, the audio played on the central control screen will be transmitted to the audio device in audio zone 1 for playback, the audio played on the co-pilot screen will be transmitted to the audio device in audio zone 2 for playback, and the audio played on the rear screen will be transmitted to the audio device in audio zone 3 for playback.

[0203] S502: When the electronic device displays the first content on the first display screen through the first application, the electronic device sends the identifier of the first display screen, the first audio corresponding to the first content, and the audio type of the first audio to the audio control module.

[0204] The first application can obtain the display screen identifier of the first display screen where the first application is located from the display screen management module. The display screen management module can be used to manage multiple display screens. The display screen management module can be deployed in Figure 2 In the application framework layer shown in .

[0205] For example, when the first display screen is the central control screen, that is, the first application is running and displayed on the central control screen and the first audio played by the first application is a media audio, the first application can obtain the display screen identifier of the central control screen from the display screen management module. The first application can send the display screen identifier of the central control screen, the first audio, and the audio type of the first audio (for example, a media audio type) to the audio control module.

[0206] S503: The electronic device obtains the target sound zone associated with the first display screen from the sound zone management module according to the identifier of the first display screen.

[0207] Exemplarily, the target sound zone associated with the first display screen can be obtained from the sound zone management module by the audio control module of the electronic device according to the identifier of the first display screen. The audio control module can obtain the identifier of the target sound zone associated with the identifier of the first display screen from the sound zone management module, and the sound zone management module determines the identifier of the target sound zone associated with the received identifier of the first display screen according to the received identifier of the first display screen and the association relationship between the saved identifier of the display screen and the sound zone identifier, and provides the identifier of the target sound zone to the audio control module, so that the audio control module determines the corresponding target sound zone.

[0208] For example, based on the above example, the audio control module can send the display screen identifier of the central control screen to the sound zone management module. Since the central control screen is associated with sound zone 1, the sound zone management module can determine that sound zone 1 is the target sound zone and return the sound zone identifier of sound zone 1 to the audio control module.

[0209] S504: The electronic device selects a target audio device in a target audio zone according to the audio type of the first audio.

[0210] Exemplarily, a target audio device can be selected in a target audio zone by an audio control module of the electronic device. After the audio control module selects the target audio zone, the audio of the first application can be played through the audio device in the target audio zone, that is, the target audio zone is used as the audio sound zone of the first application. The audio control module can obtain the audio device included in the target audio zone from the audio zone management module.

[0211] In some embodiments of the present application, the audio control module can select the audio device corresponding to the audio type of the first audio according to the correspondence between the preset audio type and the audio device and the priority of the audio device, and use the selected audio device to play the first audio. Among them, the audio devices corresponding to different audio types can be the same or different. The priorities of the audio devices corresponding to the same audio type in different sound zones can be the same or different. The priorities of the audio devices corresponding to different audio types in the same sound zone can be the same or different. The priority of the audio device can be determined according to the position (e.g., driving seat, co-pilot seat, etc.), the audio type of the played audio (e.g., media sound, etc.), the audio playback mode (e.g., private mode, etc.), the display mode (e.g., copy display, splicing display, etc.), etc., or according to user instructions (e.g., voice instructions or operation instructions). For example, when the central control screen and the co-pilot screen are spliced ​​to display video content, the priority of the entire vehicle speaker can be set to be the highest. When the co-pilot screen displays the video in private mode, the priority of the co-pilot Bluetooth headset can be set higher than the priority of the co-pilot speaker. For another example, the priority of the audio device manually selected by the user can be the highest. Optionally, the audio control module may obtain the priority of the audio device from a configuration file of the system.

[0212] In some embodiments of the present application, the audio control module may give priority to the audio device corresponding to the audio type to play the audio of the corresponding type. Among the multiple audio devices corresponding to the audio type, the audio control module may give priority to one or more audio devices with higher priority to play the audio of the corresponding type. Exemplarily, based on the above example 1, the correspondence between the preset audio types and the audio devices may be: media audio corresponds to Bluetooth headsets, vehicle speakers, speakers for each seat, headrest speakers for each seat, etc.; navigation audio corresponds to driver's seat Bluetooth headsets, vehicle speakers, driver's seat speakers, driver's seat headrest speakers, etc. Among them, when the same type of audio corresponds to multiple audio devices, different audio devices have different priorities. For example, it may be the case described in the following examples:

[0213] Case 1: Media audio case, Figure 4The priorities of the audio devices corresponding to the audio zone module 1 associated with the central control screen can be: vehicle speakers, driver's seat speakers, and driver's seat headrest speakers from high to low.

[0214] Case 2: Navigation audio Figure 4 The priorities of the audio devices corresponding to the audio zone module 1 associated with the central control screen in the image may be, from high to low, the driver's seat speaker, the vehicle speaker, and the driver's seat headrest speaker.

[0215] Case 3: In the case of media audio, Figure 4 The priorities of the audio devices corresponding to the audio zone module 2 associated with the co-pilot screen can be, from high to low,: co-pilot Bluetooth headset, co-pilot headrest audio, and co-pilot speaker.

[0216] For example, Figure 4 As shown in , the audio zone module 1 corresponds to the audio zone 1 associated with the central control screen. When the first application displays content on the central control screen and plays media audio, the audio to be played, the corresponding audio type, and the display screen identifier of the central control screen can be sent to the audio control module, such as mixer 1. The audio control module (such as mixer 1) can determine the audio zone module 1 corresponding to the audio zone associated with the central control screen according to the display screen identifier of the central control screen, and determine that the audio device used is the vehicle speaker according to the audio type and its corresponding audio device priority (such as the priority described in the above case 1). The audio control module can control the transmission route of the audio to be played from the audio zone module 1 to the bus 1, and from the bus 1 to the interface corresponding to the vehicle speaker, and then transmit the audio to be played to the vehicle speaker for playback. Figure 4 The playback methods of other audios shown in are similar and will not be described in detail here.

[0217] Of course, the priority of the audio devices in each audio zone in the above example may also be other rankings, such as a ranking set by a user, etc., and is not limited to the above ranking method.

[0218] S505: The electronic device sends the first audio to the audio zone management module, and instructs the audio zone management module to transmit the first audio to the target audio device.

[0219] Exemplarily, the first audio may be sent to the audio zone management module through the audio control module of the electronic device, and the audio zone management module may be instructed to transmit the first audio to the target audio device.

[0220] S506: The electronic device sends the first audio to the target audio device through the bus between the audio zone management module and the target audio device.

[0221] Exemplarily, the audio zone management module in the electronic device may send the first audio to the target audio device via a bus between the audio zone management module and the target audio device.

[0222] S507: After receiving the first audio, the target audio device plays the first audio.

[0223] In the above-mentioned audio receiving method, the electronic device may obtain the association relationship between the display screen identifier and the sound zone identifier in advance, and save the association relationship through the sound zone management module. When the first display screen has an audio reception requirement, the electronic device may obtain the identifier of the first display screen through the audio control module, and obtain the target sound zone associated with the first display screen from the sound zone management module according to the identifier of the first display screen. For details, please refer to the description of the above-mentioned step S503, which will not be repeated here. After determining the target sound zone, the electronic device may select a target audio device from the target sound zone for receiving the audio of the user corresponding to the first display screen. In some embodiments of the present application, the electronic device may select a target audio device in the target sound zone according to the audio type of the audio to be received. Among them, the audio type of the audio to be received may be determined according to the current application scenario. For example, in a voice or video call scenario, it can be determined that the audio type to be received is a call audio, and the electronic device may select the audio device corresponding to the call audio in the target audio as the target audio device to receive the user audio corresponding to the first display screen. The specific implementation method may refer to the relevant description of the method for selecting an audio device according to the audio type described in step S504, which will not be described in detail here. After determining the target audio device, the electronic device may start the target audio device and receive audio through the target audio device.

[0224] The audio division method provided in the above embodiment divides the audio zones according to the spatial area range, but the audio division rules applicable to the present application are not limited to this. In some embodiments of the present application, the audio zones can also be divided according to other characteristics of the audio device. For example, the audio device on the vehicle can be divided into audio zones according to the state type (e.g., static type, dynamic type, etc.) of the audio output device, the position range (e.g., the in-car area, the outside car area, the front row area, the rear row area, etc.), the device type (e.g., speakers, Bluetooth headsets, etc.), and other characteristics. Among them, the specific division rules may include at least one of the following:

[0225] 1) For static audio output devices, they can be divided according to the device location. The static audio output device described in the embodiments of the present application may be an audio output device with a fixed location, for example, a fixed audio output device configured on a vehicle.

[0226] In this way, audio output devices located in the same position area can be divided into the same sound zone, and audio output devices located in different position areas can be divided into different sound zones. The sound zones divided based on this way are static sound zones.

[0227] For example, an external audio output device configured outside the vehicle's cabin may be classified into an external audio zone, and an audio output device configured inside the vehicle's cabin may be classified into an internal audio zone.

[0228] 2) For static audio output devices, they can be divided according to device type.

[0229] In this way, audio output devices of the same device type can be divided into the same audio zone, and audio output devices of different device types can be divided into different audio zones. The audio zones divided based on this way are static audio zones.

[0230] For example, the speakers configured in the cabin may be divided into speaker zones.

[0231] 3) For static audio output devices, they can be divided based on device location and device type.

[0232] In this method, audio output devices located in different position areas can be directly divided into different sound zones; audio output devices located in the same position area can be divided into the same sound zone for audio output devices of the same device type, and audio output devices of different device types can be divided into different sound zones. In other words, audio output devices in different position areas belong to different sound zones, audio output devices of different device types in the same position area belong to different sound zones, and audio output devices of the same device type in the same position area belong to the same sound zone. The sound zones divided based on this method are static sound zones.

[0233] 4) For dynamic audio output devices, each audio output device can be divided into a sound zone. The dynamic audio output device described in the embodiment of the present application can be an audio output device with a non-fixed position, for example, it can include a mobile playback device such as a Bluetooth headset that the user brings into the vehicle cabin.

[0234] The sound zone divided in this way is a dynamic sound zone.

[0235] For example, the Bluetooth headset carried by the co-pilot user in the vehicle cabin and connected to the co-pilot screen can be divided into Bluetooth sound zone 1, and the Bluetooth headset carried by the user in the left rear seat in the vehicle cabin and connected to the left rear screen can be divided into Bluetooth sound zone 2.

[0236] In some embodiments of the present application, the above-mentioned sound zone division rules (i.e., the above-mentioned rules 1) to 3)) for dividing the sound zones for the static audio output device can be used as a vehicle audio configuration file and pre-configured in the vehicle system. The electronic device to which the display screen in the cockpit belongs can perform sound zone division according to the above-mentioned sound zone division rules after obtaining the above-mentioned sound zone division rules.

[0237] In some embodiments of the present application, for a static audio output device on a vehicle, a user can pre-divide the static audio zone, and store the audio zone information of each static audio zone as an audio configuration file of the vehicle system. Then, the electronic device to which the display screen in the cockpit belongs can directly determine the audio zone information of the divided static audio zone according to the audio configuration file stored in the vehicle system.

[0238] In some embodiments of the present application, for a dynamic audio output device, the electronic device can divide the dynamic sound zone according to a preset sound zone division rule (i.e., Rule 4 above) after establishing a communication connection with the dynamic audio output device, so that the dynamic sound zone can be updated according to changes in the dynamic audio output device in the cabin, thereby ensuring the accuracy of the divided dynamic sound zone.

[0239] The sound zone information described in the embodiments of the present application includes at least a sound zone identifier and an identifier of an audio output device included in the sound zone, and may also include type information such as a status type, a position range, and a device type of the audio output device included in the sound zone. It may also include an audio output channel corresponding to the sound zone, and audio transmission-related configuration information such as an audio format, sampling rate, and volume range supported by the audio output channel.

[0240] In some embodiments of the present application, when the audio profile of the vehicle computer contains the audio zone information of multiple static audio zones, the electronic device can also prioritize the multiple static audio zones according to the user's instructions or the rules set by the user, and select the audio zone to be used according to the priority ranking. Among them, the audio output devices contained in the same audio zone belong to the same type. Therefore, prioritizing multiple static audio zones can also be understood as prioritizing the types of multiple different types of audio output devices, and the priority ranking indicates the priority of selecting the audio zone or audio output device for playing audio. For example, for the audio output device on the vehicle, one possible priority ranking can be that the priority of the Bluetooth headset is higher than the in-car speaker, and the priority of the in-car speaker is higher than the out-car speaker. Correspondingly, the priority of the Bluetooth audio zone is higher than the in-car speaker audio zone, and the priority of the in-car speaker audio zone is higher than the out-car speaker audio zone. Optionally, when the same display screen is associated with different Bluetooth audio zones, the priority of different Bluetooth audio zones can be determined according to the time when the Bluetooth headset in the Bluetooth audio zone is connected to the display screen, wherein the priority of the Bluetooth audio zone to which the Bluetooth headset connected to the display screen earlier belongs is higher than the priority of the Bluetooth audio zone to which the Bluetooth headset connected to the display screen later belongs.

[0241] In some embodiments of the present application, the priority rankings corresponding to different types of display screens may be different, and the electronic device may sort the audio output devices available for different display screens according to the priority rankings corresponding to the different display screens, and further select the audio output device with the highest priority from the audio output devices available for the display screens to play the audio corresponding to the content of the display screens. For example, when the cockpit includes a speaker and a Bluetooth headset, the priority ranking corresponding to the central control screen and the instrument screen in the cockpit may be that the priority of the speaker is higher than that of the Bluetooth headset, and the priority ranking corresponding to the co-pilot screen and the rear screen in the cockpit may be that the priority of the Bluetooth headset is higher than that of the speaker.

[0242] It should be understood that the priority sorting provided above is only an example, and the actually available priority sorting is not limited to this. It can be determined according to the user's settings, and no specific limitations are made in the embodiments of the present application.

[0243] In the above embodiment, the audio input and output method provided in the embodiment of the present application is introduced by taking the one-chip multi-screen mechanism controlling the display screen as an example. However, the method provided in the embodiment of the present application is not limited to the scenario where the one-chip multi-screen mechanism controls the display screen, but can also be applied to the scenario where a multi-chip multi-screen mechanism or multiple devices control the display screen.

[0244] Among them, when the solution provided in the embodiment of the present application is applied to the scenario of a multi-core multi-screen mechanism or a multi-device control display screen, the multiple display screens in the audio control system described in the above embodiment may belong to multiple control devices. In one embodiment, the control device (such as a vehicle) may be a vehicle using a multi-core multi-screen mechanism. In another embodiment, a communication connection may be established between multiple devices. For example, a vehicle may establish a communication connection with external devices such as a tablet and a large screen, and the various display screens of the vehicle and the tablet and the large screen together constitute multiple display screens in the audio control system. In this scenario, for an audio device, each audio device is connected (or associated) with only one control device among multiple control devices and is controlled by the control device. For each control device, there may be an audio device connected to the control device in the audio control system, or there may be no audio device connected to the control device. Among them, if there is an audio device connected to a certain control device in the audio control system, the audio device can be used as an independent audio device of the control device, and the control device can display content through its own display screen, and play / receive audio through the connected audio device; if there is no audio device connected to a certain control device in the audio control system, the control device can only display content through its own display screen. If audio needs to be played / received, it is necessary to use the audio devices corresponding to other control devices. For example, the audio to be played can be sent to other control devices and played by other control devices through the connected audio devices, or audio forwarded by other control devices and received by the other control devices through the connected audio devices can be received.

[0245] In the above multi-core multi-screen or multi-device control scenario, the audio control system may include multiple control devices, each control device includes at least one display screen, and the display screens of multiple control devices constitute multiple display screens in the audio control system. Each control device may not be connected to an audio device or may be connected to at least one audio device. The audio control method used by multiple control devices is the same.

[0246] For example, in the scenario of Example 1 above, if the control mechanism of multiple display screens adopts a multi-core multi-screen mechanism, in one example, the central control screen and the co-pilot screen can belong to the first control device, and the rear screen can belong to the second control device. The hierarchical structure of the first control device and the second control device can refer to Figure 4 The structure shown in , wherein the software processing modules of the first control device and the second control device (such as the structure of the media framework layer (audio control module, audio zone management module, etc.)) and the corresponding processing logic are all the same Figure 4 The corresponding modules and processing logic shown in are the same. The hardware structure of the first control device and the second control device is the same as Figure 4There is a difference in the hardware structure shown in the figure. The difference is that the display screen included in the first control device system layer and the display screen included in the second control device system layer together constitute Figure 4 The multiple display screens in the system layer shown in FIG. 1 are composed of an interface for connecting an audio device included in the first control device HAL layer and an interface for connecting an audio device included in the second control device HAL layer. Figure 4 The interface for connecting audio devices in the HAL layer shown in (the same applies to the bus). In one example, the audio devices connected to the first control device may include a driver's headrest audio, a driver's speaker, a passenger's speaker, a passenger's headrest audio, a passenger's Bluetooth headset, etc., and the audio devices connected to the second control device may include a rear speaker, a rear headrest audio, etc.

[0247] In an example scenario, when the audio device connected to the second control device includes rear speakers, when the call on the central control screen of the first control device is transferred to the rear screen of the second control device, the first control device can stop playing audio through the connected audio device, and the second control device can play audio through the connected audio device, i.e., the rear speakers.

[0248] In another example scenario, when the audio device connected to the second control device includes a Bluetooth headset, when the call on the central control screen of the first control device is transferred to the rear screen of the second control device, the first control device can stop playing / receiving audio through the connected audio device, and the second control device can play / receive audio through the connected audio device, i.e., the Bluetooth headset.

[0249] In another example scenario, when the audio devices connected to the first control device include driver's speakers and passenger's speakers, and the audio devices connected to the second control device include rear speakers, the second control device can display content on the rear screen and play the corresponding audio through the rear speakers. When the second control device needs to play the audio through the entire vehicle's speakers, the second control device can send the audio to the first control device after establishing a communication connection with the first control device (for example, the second control device can establish a communication connection with the first control device via Bluetooth connection or frequency modulation (FM) broadcasting, etc.). The first control device can play the audio through the driver's speakers and passenger's speakers. At the same time, the second control device can continue to play the audio through the rear speakers, thereby achieving the effect of playing audio using the entire vehicle's speakers under a multi-core and multi-screen control mechanism.

[0250] The audio input and output methods and effects of the method provided in the embodiments of the present application when applied to a multi-core multi-screen mechanism or a scenario where multiple devices control a display screen can refer to the audio input and output methods and effects in the scenario where a single-core multi-screen mechanism controls a display screen described in the above embodiments, and will not be described in detail one by one in the embodiments of the present application.

[0251] The following describes the solution provided in the embodiment of the present application by taking the application of the solution provided in the embodiment of the present application to a vehicle-mounted system as an example. The implementation methods of the solution provided in the embodiment of the present application applied to other scenarios can refer to the implementation methods applied in the vehicle-mounted system and will not be described in detail in this application.

[0252] When the solution provided in the embodiment of the present application is applied to a vehicle system, the call control system may include multiple display screens and audio devices configured in the vehicle cabin, and may also include at least one camera configured in the vehicle cabin (such as a central control camera, a rear camera, etc.). The multiple display screens include at least a first display screen and a second display screen, and may of course include more display screens.

[0253] Reference Figure 6 When the solution provided in the embodiment of the present application is applied to the vehicle system, based on the display screen control mode of the vehicle system, it can be divided into implementation schemes using two control mechanisms: one-chip multi-screen mechanism and multi-chip multi-screen mechanism; based on the user call experience, it can be divided into call flow (i.e., the call on one display screen flows to another display screen) or multi-party call (adding the user corresponding to another display screen to the call on one display screen). Combined with the display screen control mode of the vehicle system and the user call experience, the method provided in the embodiment of the present application can include the following four scenarios:

[0254] The first scenario: call transfer under the one-chip multi-screen mechanism, specifically: under the one-chip multi-screen control mechanism, the first display screen and the second display screen belong to the same control device, and the call interface after the first user answers the call on the first display screen is transferred to the second display screen for display, and the first user participating in the call is changed to the second user corresponding to the second display screen. After the transfer, the first display screen no longer displays the call interface, the first user no longer participates in the call through the first display screen, the second display screen displays the call interface, and the second user corresponding to the second display screen can participate in and control the call.

[0255] The second scenario: call transfer under the multi-core multi-screen mechanism, specifically: under the multi-core multi-screen control mechanism, the first display screen and the second display screen belong to different control devices, and the call interface after the first user answers the call on the first display screen is transferred to the second display screen for display, and the first user participating in the call is changed to the second user corresponding to the second display screen. After the transfer, the first display screen no longer displays the call interface, the first user no longer participates in the call through the first display screen, the second display screen displays the call interface, and the second user corresponding to the second display screen can participate in and control the call.

[0256] The third scenario: multi-party calls under the one-chip multi-screen mechanism, specifically: under the one-chip multi-screen control mechanism, the first display screen and the second display screen belong to the same control device, and after the first user answers the call on the first display screen, the second user corresponding to the second display screen is connected to the call. After the connection, the first display screen and the second display screen both display the call interface, and the first user corresponding to the first display screen and the second user corresponding to the second display screen can both participate in and control the call.

[0257] The fourth scenario: multi-party calls under the multi-core multi-screen mechanism, specifically: under the multi-core multi-screen control mechanism, the first display screen and the second display screen belong to different control devices. After the first user answers the call on the first display screen, the second user corresponding to the second display screen is connected to the call. After the connection, the first display screen and the second display screen both display the call interface, and the first user corresponding to the first display screen and the second user corresponding to the second display screen can both participate in and control the call.

[0258] Among them, the call described in the embodiment of the present application can be a voice call or a video call.

[0259] It can be understood that the multi-core multi-screen mechanism is similar to the mechanism of multi-device control of the display screen. Therefore, this application combines the two control mechanisms of one-core multi-screen mechanism and multi-core multi-screen mechanism, and takes the above four scenarios as examples for explanation. The solution in the scenario of multi-device control of the display screen can refer to the solution in the scenario of multi-core multi-screen mechanism control of the display screen. The specific implementation plans adopted in each of the above scenarios are described below.

[0260] 1. Call Transfer

[0261] In a call transfer scenario (including the first and second scenarios described above), before the call on the first display screen is transferred to the second display screen, the first user corresponding to the first display screen is participating in the call, and the first electronic device can call the corresponding audio device to play the call audio or receive the user audio. Optionally, in a video call scenario, the first electronic device can also use a camera to shoot the first user so as to display the first user in the call interface on the first display screen. Optionally, the method for the first electronic device to determine the corresponding audio device and use the corresponding audio device to play / receive audio can refer to the method provided in the above embodiments. Of course, other methods can also be used, and there is no specific limitation in the embodiments of the present application.

[0262] In a call transfer scenario (including the first and second scenarios described above), after the call on the first display screen is transferred to the second display screen, on the one hand, the first electronic device to which the first display screen belongs can control the audio device corresponding to the first display screen to stop playing / receiving audio. Optionally, in a video call scenario, the first electronic device to which the first display screen belongs can also control the camera used to shoot the first user to stop shooting the first user. On the other hand, after selecting an audio device for playing call audio and an audio device for receiving user audio, the second electronic device to which the second display screen belongs can use the selected audio device to play call audio and receive user audio, respectively. Optionally, in a video call scenario, the second electronic device to which the second display screen belongs can also use a camera to shoot the second user.

[0263] Among them, under the one-chip multi-screen mechanism, the first electronic device and the second electronic device are the same electronic device, and under the multi-chip multi-screen mechanism, the first electronic device and the second electronic device are different electronic devices.

[0264] The following describes the audio control method in the call transfer scenario.

[0265] In some embodiments of the present application, the first electronic device can call the audio device in the sound zone where the first display screen is located to play the call audio or receive the user audio, wherein the method for the first electronic device to determine the sound zone where the first display screen is located and to select the audio device for playing the call audio or receiving the user audio in the sound zone where the first display screen is located can refer to the relevant introduction of some contents of the audio input and output methods in the aforementioned embodiments, which will not be described in detail here. Of course, the method for the first electronic device to select the audio device is not limited to this, and the first electronic device can also use other methods to select the audio device for playing the call audio or receiving the user audio, which is not specifically limited in the embodiments of the present application.

[0266] In some embodiments of the present application, the second electronic device may select an audio device for playing the call audio in the following manner:

[0267] 1) If the second display screen is connected to a Bluetooth headset, the Bluetooth headset connected to the second display screen is selected as the audio device for playing the call audio.

[0268] Optionally, in the vehicle cockpit, while selecting the Bluetooth headset connected to the second display screen as the audio device for playing the call audio, a set audio device configured in the cockpit, such as the vehicle speaker, can also be selected as the audio device for playing the call audio. In other words, the Bluetooth headset connected to the display screen can be used first to play the call audio, or the Bluetooth headset and the set audio device in the cockpit can be used to play the call audio at the same time.

[0269] 2) If the second display screen is not connected to a Bluetooth headset, the set audio device is selected as the audio device for playing the call audio, or the audio output device in the audio zone where the second display screen is located is selected as the audio device for playing the call audio.

[0270] In some embodiments of the present application, in the vehicle cabin, the set audio device may be the vehicle speaker. Of course, the set audio device may also be other devices, such as the headrest speakers of the seat corresponding to the display screen, etc., which may be determined according to the actual application scenario or user instructions, and is not specifically limited in the embodiments of the present application.

[0271] Optionally, when the second display screen is not connected to a Bluetooth headset, the set audio device can be preferentially selected as the audio device for playing the call audio. When the set audio playback device cannot be used to play the call audio (for example, the set audio playback device is playing other audio, etc.), the audio output device in the sound zone where the second display screen is located can be selected as the audio device for playing the call audio. For example, in the case where the set audio device is the vehicle speaker, when the main driver's speaker is playing the navigation audio, if the vehicle speaker is used to play the call audio corresponding to the second display screen, it will affect the playback of the navigation audio. In this case, the audio device in the sound zone associated with the second display screen can be used to play the call audio corresponding to the second display screen.

[0272] In this manner, the method of determining the audio zone where the second display screen is located and selecting an audio device for playing call audio in the audio zone where the second display screen is located can refer to the relevant introduction of some contents of the audio input and output method in the aforementioned embodiment, which will not be described in detail here.

[0273] In some embodiments of the present application, the second electronic device may select an audio device for receiving user audio in the following manner:

[0274] 1) If the second display screen is connected to a Bluetooth headset, the Bluetooth headset connected to the second display screen is selected as the audio device for receiving the user audio.

[0275] Optionally, while selecting the Bluetooth headset connected to the second display screen as the audio device for receiving the call audio, the audio device in the sound zone where the display screen is located can also be selected as the audio device for receiving the call audio. In other words, the Bluetooth headset connected to the display screen can be used to receive the call audio first, or the Bluetooth headset and the audio device in the sound zone where the display screen is located can be used to receive the call audio at the same time.

[0276] 2) If the second display screen is not connected to a Bluetooth headset, the audio input device in the audio zone where the second display screen is located is selected as the audio device for receiving the user audio.

[0277] In this manner, the method of determining the sound zone where the second display screen is located and selecting an audio device for receiving user audio in the sound zone where the second display screen is located can refer to the relevant introduction of some contents of the audio input and output method in the aforementioned embodiment, which will not be described in detail here.

[0278] The audio device selected by the second electronic device for playing the call audio and the audio device selected for receiving the user audio may be the same or different.

[0279] Based on the above method, when the call on the first display screen is transferred to the second display screen, the call interface on the first display screen is transferred to the second display screen, and the call-related audio input / output is also transferred to the audio device corresponding to the second display screen. Therefore, it is possible to support the user corresponding to the second display screen to participate in the call, thereby achieving the effect of transferring the call function between display screens.

[0280] The following describes the camera control method in the call flow scenario.

[0281] In some embodiments of the present application, the camera used to photograph the first user and the camera used to photograph the second user may be the same camera or different cameras. When the camera used to photograph the first user and the camera used to photograph the second user are the same camera, the first electronic device or the second electronic device may photograph the corresponding user by controlling the camera to focus on the position of the corresponding user.

[0282] In a call transfer scenario, while the first electronic device displays the call interface on the first display screen, the first user can be photographed through the first camera corresponding to the first display screen. After the call on the first display screen is transferred to the second display screen, the user participating in the call changes from the first user corresponding to the first display screen to the second user corresponding to the second display screen. When the call is a video call, the first user in the call interface needs to be changed to the second user. Therefore, after the call on the first display screen is transferred to the second display screen, the second electronic device can use the second camera corresponding to the second display screen to photograph the second user, and update the first user in the call interface to the second user, and then display the updated call interface. Among them, the camera corresponding to each display screen can be a camera configured on the display screen, or can be a camera configured in the vehicle cabin and connected to the display screen or the electronic device to which the display screen belongs.

[0283] Exemplarily, the second camera corresponding to the second display screen may include a camera configured on the second display screen, a central control camera, etc. As an optional implementation, when a camera is configured on the second display screen, the second electronic device may use the camera to photograph the second user. When a camera is not configured on the second display screen, the second electronic device may use the central control camera to focus on the passenger seat and photograph the second user on the passenger seat.

[0284] In the above method, after the video call is transferred, the users participating in the call change accordingly. By switching the camera to shoot the users participating in the call after the transfer, it can be ensured that the users displayed in the call interface are the users who actually participate in the call, thereby ensuring the accuracy of the call process.

[0285] In some embodiments of the present application, the first display screen may be any display screen in the vehicle cabin, and the second display screen may be any display screen in the vehicle cabin except the first display screen.

[0286] Exemplarily, take the case where the first display screen is the central control screen in the vehicle cockpit and the second display screen is the co-pilot screen in the vehicle cockpit. When the call is transferred from the central control screen to the co-pilot screen, optionally, when the co-pilot screen is equipped with a camera, the camera of the co-pilot screen can be called to shoot the co-pilot user; when the co-pilot screen is not equipped with a camera, the central control camera can be called to focus on the co-pilot seat to shoot the co-pilot user. In addition, after the call is transferred, the audio device corresponding to the co-pilot screen can be used for call-related audio input / output. For example, when the co-pilot screen is connected to a Bluetooth headset, the Bluetooth headset can be used to play the call audio first, and the Bluetooth headset can be used to receive the user audio to prevent disturbing other users; when the co-pilot screen is not connected to a Bluetooth headset, the default audio output device (such as the whole vehicle speaker) can be used to play the call audio, and the audio input device in the sound zone where the co-pilot screen is located (such as the co-pilot microphone) can be used to receive the user audio.

[0287] For example, based on the above example scenario, when the driver answers the video call, the central control screen can display the corresponding call interface, for example Figure 7a The call interface shown in , the call interface includes the main driver's seat user and another remote user participating in the call. Optionally, the call interface can be displayed in full screen mode, split screen mode or window mode. Figure 7a The example of the full-screen display of the call interface on the central control screen is used for illustration only, and does not limit the display method of the call interface in the embodiment of the present application.

[0288] As an optional implementation, after the call interface is displayed on the central control screen, the user can trigger the display of interactive controls for controlling call-related interactions between different display screens by operating on the central control screen (for example, swiping up), and the central control screen can further display interactive controls. For example, the central control screen can display interactive controls in the currently displayed call interface, or can display interactive controls in an area outside the call interface on the display screen, or can display interactive controls in a floating window, etc. Among them, the interactive controls may include call transfer controls for triggering the transfer of the current call to other display screens, and may also include multi-party call controls for triggering the addition of users corresponding to other display screens to the current call, etc. Exemplarily, after the user triggers the display of the interactive controls, the central control screen can Figure 7a The interface shown switches to Figure 7b The interface shown in .

[0289] After the interactive controls are displayed on the central control screen, the user can initiate a call transfer by operating the call transfer control in the interactive controls displayed on the central control screen (for example, by clicking the call transfer control). Figure 7c The display selection interface shown in the figure includes candidate display screens to which the call can be transferred (such as the co-pilot screen, the left rear screen, the right rear screen, etc.). The user can select the target display screen to which the call will be transferred from the candidate display screens. The central control screen can then stop displaying the call-related interface and switch back to the interface before the call interface was displayed, or switch to the setting interface (such as the desktop interface, etc.) or turn it off, etc. The target display screen can then update the main driver's seat user in the call interface to the user at the corresponding seat on the target display screen, and display the corresponding call interface. For example, when the user is in Figure 7c After selecting the rear right screen in the display selection interface shown, the central control screen can stop displaying the call interface; if the target display is the rear right screen, the rear right screen can display the following Figure 7dThe call interface shown in the figure includes the user in the rear right seat and the other remote user mentioned above. The user in the rear right seat can talk to the remote user. Based on the above method, the call between the user in the main driving seat and the remote user can be switched to the call between the user in the rear right seat and the remote user. Optionally, the above Figure 7a or Figure 7d In the interface shown, when a user's audio is received, the area where the user is located in the call interface can be highlighted, or a prompt message indicating that the user is speaking can be displayed in the area where the user is located.

[0290] As another optional implementation, after the call interface is displayed on the central control screen, the user can directly transfer the call interface to the target display screen by performing an operation on the central control screen (such as swiping with multiple fingers in the direction of the target display screen). After the user performs the operation, the central control screen directly stops displaying the call interface and switches back to the interface before displaying the call interface or switches to the setting interface; and the target display screen can update the main driver seat user in the call interface on the central control screen to the user in the corresponding seat of the target display screen, and then display the corresponding call interface. For example, when the target display screen is the rear right screen, after the user triggers the transfer of the call interface on the central control screen to the rear right screen, the central control screen stops displaying the call interface, and the rear right screen displays Figure 7d The call interface shown in the figure can complete the call flow from the central control screen to the rear right screen.

[0291] In the above method, the call transfer process is explained by taking the main driving screen as the control end for initiating the call transfer as an example. The corresponding methods when other display screens are used as the control end for initiating the call transfer can refer to the above method, and will not be described in detail one by one in the embodiments of this application.

[0292] In the above method, after the target display screen displays the call interface, the user can continue to initiate a call transfer on the target display screen, thereby transferring the call flow on the target display screen to other display screens. The specific transfer process can refer to the method of transferring the call flow on the main driving screen to the target display screen, which will not be repeated here.

[0293] The specific implementation methods of the above solution in the one-chip multi-screen scenario and the multi-chip multi-screen scenario are different, which are introduced below.

[0294] When the above solution is implemented based on the one-chip multi-screen mechanism, it corresponds to the first scenario described in the above embodiment. In this scenario, the first electronic device and the second electronic device described in the above embodiment are the same electronic device, hereinafter collectively referred to as the electronic device. Figure 8 A call control method that can be used in this scenario may include:

[0295] S801: The electronic device determines identifiers of a plurality of display screens and corresponding camera identifiers, wherein the plurality of display screens include at least a first display screen and a second display screen.

[0296] Among them, the electronic device can initialize the corresponding identification for the display screen and save it when the display screen is started for use in subsequent processes.

[0297] S802: The electronic device receives a video call request from a remote device, where the request is used to request a first user corresponding to a first user call account to make a video call; wherein the first user call account has been logged into the electronic device.

[0298] Before the electronic device receives the video call request from the remote device, the electronic device can log in to the first user's call account through the call service according to the user's instruction. The video call request received by the electronic device can be sent by the remote device to the server associated with the call service and forwarded by the server to the electronic device.

[0299] In some embodiments of the present application, the first user may be a user sitting in a seat associated with the first display screen.

[0300] Optionally, the remote device may be any other device that supports voice or video calls, such as a mobile phone, tablet or other mobile device.

[0301] S803: The electronic device sends a video call response to the remote device, where the video call response is used to confirm the video call.

[0302] Optionally, after receiving a video call request from a remote device, the electronic device may display a call reminder interface on the first display screen, which may include prompt information for prompting the user to confirm whether to accept the video call and a control for confirming acceptance or rejection of the video call. The electronic device may determine to establish a video call with the remote device in response to the user operating the control for confirming acceptance of the video call.

[0303] Optionally, the call between the electronic device and the remote device can also be established after the electronic device initiates a call request. In this case, the above steps S802 to S803 can be replaced by the following steps: the electronic device sends a video call request to the remote device in response to the user's operation of initiating a call on the first display screen, and the video call request is used to request a video call with the user corresponding to the remote device; the electronic device receives a video call response from the remote device, and the video call response is used to confirm the video call.

[0304] In the above method, the electronic device can complete the call connection with the remote device through the call service (such as an APP that supports the call function installed in the electronic device), and display the relevant user interface, etc.

[0305] S804: After the electronic device establishes a video call connection with the remote device, the first call interface is displayed on the first display screen, and the first camera corresponding to the first display screen is called to shoot the first user, and the first audio device corresponding to the first display screen is called to play the call audio or receive the user audio, wherein the first call interface includes the first user shot by the first camera and the remote user corresponding to the remote device.

[0306] For example, when the first display screen is a central control screen, the first call interface may be Figure 7a The call interface displayed on the central control screen shown in .

[0307] S805: The remote device displays a call interface including the remote user and the first user.

[0308] S806: In response to the received call transfer operation, the electronic device displays a transfer screen selection interface, where the interface includes information for indicating at least one display screen, and the at least one display screen includes a display screen among the multiple display screens except the first display screen.

[0309] In some embodiments of the present application, the call transfer operation may include an operation of triggering the display of a call transfer control and an operation performed on the displayed call transfer control, wherein the call transfer control is used to trigger the call transfer. After displaying the first call interface, the electronic device may further display the call transfer control in response to the user's operation of triggering the display of the call transfer control (such as the swipe up operation described in the above embodiment). After displaying the call transfer control, the electronic device may display information indicating at least one display screen in response to the user's operation on the call transfer control. For example, the first call interface displayed by the electronic device may be Figure 7a The call interface shown on the central control screen shown in the figure can be displayed after receiving the user's operation of triggering the display of the call flow control Figure 7b In the interface displayed on the central control screen shown in , after receiving the user's operation of clicking the call flow control in the interface, the electronic device can display Figure 7c The interface displayed on the central control screen shown in .

[0310] In some embodiments of the present application, the first call interface may further include a call transfer control, and the call transfer operation may be an operation performed by the user on the call transfer control. Figure 7b The interface displayed on the central control screen shown in , the call transfer operation may be an operation in which the user clicks the call transfer control in the interface.

[0311] In some embodiments of the present application, the information used to indicate at least one display screen may be identification information of the display screen, such as the name of the display screen.

[0312] For example, when the first display screen is the central control screen, the flow screen selection interface can be Figure 7c The interface shown in the figure includes identification information of the co-pilot screen, the rear left screen, and the rear right screen in the cockpit, from which the user can choose which display screen to transfer the call to.

[0313] S807: In response to the flow screen selection operation of selecting the second display screen in the at least one display screen, the electronic device switches from displaying the first call interface on the first display screen to displaying the second call interface on the second display screen, and at the same time, calls the second camera corresponding to the second display screen to shoot the second user, and calls the second audio device corresponding to the second display screen to play call audio or receive user audio, wherein the second call interface includes the second user and the remote user.

[0314] Among them, the second call interface can also be understood as: an interface after the first user photographed by the first camera in the first call interface is replaced by the second user photographed by the second camera.

[0315] For example, when the first display screen is the central control screen, the flow screen selection operation can be performed by the user in Figure 7c The operation of selecting the display screen in the flow screen selection interface shown in .

[0316] The electronic device switches from displaying a first call interface on a first display screen to displaying a second call interface on a second display screen, specifically including: the electronic device stops displaying the first call interface on the first display screen, and displays the second call interface on the second display screen.

[0317] For example, when the first display screen is the central control screen and the second display screen is the rear right screen, the second call interface can be Figure 7d The call interface displayed on the rear right screen as shown in the figure.

[0318] In some embodiments of the present application, when the user corresponding to the display screen is a user in the vehicle cabin, the electronic device may display a vehicle logo in the area where the user is located in the call interface when displaying the call interface, so as to mark that the user is in the vehicle cabin. Figure 7d In the call interface on the rear right screen described in the figure, the vehicle logo is displayed in the area where the passenger seat user is located.

[0319] In some embodiments of the present application, the first camera corresponding to the first display screen and the second camera corresponding to the second display screen may be the same camera, and the electronic device may use the same camera to shoot different users. In this scenario, in the above method, when the electronic device shoots the first user through the camera, the camera may be focused on the position of the first user for shooting; when the electronic device shoots the second user through the camera, the camera may be focused on the position of the second user for shooting.

[0320] In some embodiments of the present application, the first camera corresponding to the first display screen and the second camera corresponding to the second display screen may be different cameras, and the electronic device may use different cameras to shoot different users. In this scenario, in the above method, when the electronic device calls the first camera to shoot the first user, the second camera may be turned off. After the call is transferred, when the electronic device calls the second camera to shoot the second user, the first camera may be turned off. The camera corresponding to the display screen may be a camera configured on the display screen, or may be a pre-configured camera that can be used to shoot the seat area corresponding to the display screen.

[0321] In some embodiments of the present application, when the electronic device calls the first audio device to play call audio or receive user audio, the second audio device can be turned off. After the call is transferred, when the electronic device calls the second audio device to play call audio or receive user audio, the first audio device can be turned off, thereby stopping calling the first audio device to play call audio or receive user audio.

[0322] In the above method, the method for the electronic device to determine the first camera and the first audio device corresponding to the first display screen, and the method for the electronic device to determine the second camera and the second audio device corresponding to the second display screen can refer to the relevant description of the audio control method and the camera control method in the call transfer scenario in the previous embodiment, and will not be repeated here.

[0323] The above method uses the flow of a video call as an example to illustrate the control method of the call flow, and the difference between the call control method in the scenario of only a voice call and the above method is that the electronic device does not need to use a camera to capture the user corresponding to the display screen, and the call interface displayed by the electronic device does not need to include the user, but can include the user's identification information (such as the user's name, account number, etc.). In addition to this difference, the execution of the call control method in the voice call scenario can refer to the execution of the call control method in the above video call scenario, and will not be described in detail in the embodiments of this application.

[0324] Based on the above method, when an electronic device adopts a one-chip multi-screen mechanism, calls can be transferred between its multiple display screens, which is highly flexible and convenient.

[0325] It should be noted that the specific implementation process provided in the above example is only an example of the method process applicable to the embodiment of the present application. The execution order of the above steps can be adjusted accordingly according to actual needs, and other steps can be added or some steps can be reduced.

[0326] When the above solution is implemented based on the multi-core multi-screen mechanism, it corresponds to the second scenario described in the above embodiment. In this scenario, the first electronic device and the second electronic device described in the above solution are different electronic devices. Fig. 9 A call control method that can be used in this scenario may include:

[0327] S901: The first electronic device determines the identifications of multiple display screens and corresponding camera identifications and reports them to a server so that the server establishes a trust relationship between the multiple display screens; the multiple display screens include at least a first display screen of the first electronic device and a second display screen of the second electronic device.

[0328] The multiple display screens may be display screens present in a vehicle cabin. Exemplarily, the first electronic device may discover the multiple display screens in the cabin through near field communication. The server may be a server associated with the call service in the first electronic device and the second electronic device, and is used to support the call service in the electronic device to implement the call function. The server may generate a corresponding communication identifier for each display screen based on the identifiers of the multiple display screens, and use the correspondence between the communication identifiers of the multiple display screens as a trust relationship between the multiple display screens.

[0329] Optionally, the server may be a cloud server.

[0330] S902: The first electronic device receives a video call request from a remote device, where the request is used to request a first user corresponding to a first user call account to make a video call; wherein the first user call account has been logged into the first electronic device.

[0331] Before the first electronic device receives the video call request from the remote device, the first electronic device can log in to the first user's call account through the call service according to the user's instruction. The video call request received by the first electronic device can be sent by the remote device to the server and then forwarded by the server to the first electronic device.

[0332] S903: The first electronic device sends a video call response to the remote device, where the video call response is used to confirm the video call.

[0333] The call service in the first electronic device can determine to establish a video call with the remote device according to the user's operation on the first display screen, and send a video call response to the remote device. The first electronic device can send the video call response to the remote device by forwarding it through a server.

[0334] S904: The first electronic device displays a first call interface on the first display screen through the call service, and calls the first camera corresponding to the first display screen to shoot the first user, and calls the first audio device corresponding to the first display screen to play call audio or receive user audio, wherein the first call interface includes the first user shot by the first camera and the remote user corresponding to the remote device.

[0335] S905: The remote device displays a call interface including the remote user and the first user.

[0336] S906: In response to the received call transfer operation, the first electronic device displays a transfer screen selection interface, where the interface includes information for indicating at least one display screen, where the at least one display screen includes a display screen other than the first display screen among the multiple display screens.

[0337] The specific implementation of steps S902 to S906 may refer to the introduction of the relevant contents of steps S802 to S806 in the aforementioned embodiment, which will not be repeated here.

[0338] S907: In response to the transfer screen selection operation of selecting the second display screen among the at least one display screen, the first electronic device sends a call transfer request to the server, where the request is used to request that the call corresponding to the first call interface be transferred to the second display screen.

[0339] S908: The server sends the call transfer request and the first account information to the second electronic device, where the first account information is used to indicate the call account of the first user.

[0340] S909: After receiving the call transfer request, the second electronic device determines whether the call service is started; if so, execute step S910, otherwise, execute step S911.

[0341] The call service is associated with the server, and the call service is used to provide a call function. Exemplarily, the call service may be an APP installed in the second electronic device that supports the call function.

[0342] S910: The second electronic device determines whether the first user's call account has been logged in; if so, execute step S913, otherwise, execute step S912.

[0343] S911: The second electronic device starts the call service, and executes step S912.

[0344] S912: The second electronic device logs in the first user's call account in the call service, and executes step S913.

[0345] S913: The second electronic device sends a transfer acceptance notification to the first electronic device, where the notification is used to confirm acceptance of the call transferred from the first display screen.

[0346] Optionally, the first electronic device and the second electronic device may communicate with each other via near field communication, or other communication methods (such as server forwarding, etc.), which is not specifically limited in the embodiments of the present application.

[0347] S914: The first electronic device negotiates with the remote device to exit the call, and then executes step S915.

[0348] S915: The first electronic device stops displaying the first call interface on the first display screen, turns off the first camera, and turns off the first audio device.

[0349] S916: The second electronic device negotiates with the remote device to access the same call.

[0350] This step may be performed after step S913.

[0351] S917: The second electronic device activates a second camera corresponding to the second display screen, and activates a second audio device corresponding to the second display screen, wherein the second camera is used to photograph the second user, and the second audio device is used to play call audio or receive user audio.

[0352] S918: The second electronic device sends the received first media stream to the remote device, where the first media stream includes: a video stream from the second camera and an audio stream from the second audio device.

[0353] S919: The remote device updates the displayed call interface based on the received first media stream and the second media stream, wherein the second media stream includes a video stream captured by a camera corresponding to the remote device and an audio stream collected by an audio device corresponding to the remote device, and the updated call interface includes the second user and the remote user.

[0354] S920: The second electronic device receives a second media stream from a remote device.

[0355] S921: The second electronic device displays a second call interface through the call service according to the received first media stream and second media stream, wherein the second call interface includes the second user and the remote user.

[0356] The second call interface can be understood as: the interface after the first user photographed by the first camera in the first call interface is replaced with the second user photographed by the second camera. The first camera and the second camera can be the same camera or different cameras. For the determination and use of the first camera and the second camera, please refer to the above Figure 8 The relevant descriptions in the corresponding embodiments are not repeated here.

[0357] In the above method, the method for the first electronic device to determine the first camera and the first audio device corresponding to the first display screen, and the method for the second electronic device to determine the second camera and the second audio device corresponding to the second display screen can refer to the relevant description of the audio control method and the camera control method in the call transfer scenario in the previous embodiment, and will not be repeated here.

[0358] The above method takes the flow of video calls as an example to illustrate the control method of call flow, and the difference between the call control method in the scenario of only voice calls and the above method is that each electronic device does not need to use a camera to shoot the user corresponding to the display screen, and the call interface displayed by each electronic device does not need to include the user, but can include the user's identification information. In addition to this difference, the execution of the call control method in the voice call scenario can refer to the execution of the call control method in the video call scenario, and will not be described in detail in the embodiments of this application.

[0359] In the scenario of implementing call transfer based on the above scheme, the electronic devices corresponding to different display screens support running independent call services, and different electronic devices can log in to the same or different user call accounts through their respective call services. When call transfer is required between the display screens of different electronic devices, the electronic device receiving the call transfer can automatically log in to the same user call account as the electronic device initiating the call transfer, thereby supporting the call transfer, so that the display screen of the second electronic device can continue to display the call on the first display screen. In this process, the user does not need to manually log in or activate the relevant user call account, so the flexibility and convenience are relatively high.

[0360] It should be noted that the specific implementation process provided in the above example is only an example of the method process applicable to the embodiment of the present application. The execution order of the above steps can be adjusted accordingly according to actual needs, and other steps can be added or some steps can be reduced. For example, the above steps S914 to S915 can be executed earlier than step S916, or can be executed synchronously with step S916.

[0361] 2. Multi-party calls

[0362] In a multi-party call scenario (including the third and fourth scenarios described above), before the second user corresponding to the second display screen joins the ongoing call on the first display screen, the first user corresponding to the first display screen participates in the call, and the first electronic device can call the corresponding audio device to play the call audio or receive user audio. Optionally, in a video call scenario, the first electronic device can also use a camera to shoot the first user so as to display the first user in the call interface on the first display screen. Optionally, the method for the first electronic device to determine the corresponding audio device and use the corresponding audio device to play / receive audio can refer to the method provided in the above embodiments. Of course, other methods can also be used, and there is no specific limitation in the embodiments of the present application.

[0363] In a multi-party call scenario (including the third and fourth scenarios mentioned above), after the second user corresponding to the second display screen joins the ongoing call on the first display screen, on the one hand, the first electronic device to which the first display screen belongs can call the original or new audio device to play the call audio or receive the user audio, and add information related to the second user to the call interface displayed on the first display screen, such as the second user, the second user's identification information, the identification information of the second display screen, etc., which can be determined according to the actual scenario. Optionally, in a video call scenario, the first electronic device can also continue to shoot the first user with a camera and display it in the call interface. On the other hand, the second electronic device to which the second display screen belongs can, after selecting an audio device for playing call audio and an audio device for receiving user audio, use the selected audio device to play the call audio and receive the user audio, respectively. Optionally, in a video call scenario, the second electronic device to which the second display screen belongs can also use a camera to shoot the second user so that the second user is displayed in the call interface on the second display screen.

[0364] Among them, under the one-chip multi-screen mechanism, the first electronic device and the second electronic device are the same electronic device, and under the multi-chip multi-screen mechanism, the first electronic device and the second electronic device are different electronic devices.

[0365] In the embodiments of the present application, the audio control method in a multi-party call scenario can refer to the relevant introduction of the audio control method in a call transfer scenario in the previous embodiments, which will not be repeated here.

[0366] The following describes the camera control method in a multi-party call scenario.

[0367] In some embodiments of the present application, the camera used to photograph the first user and the camera used to photograph the second user may be the same camera or different cameras. When the camera used to photograph the first user and the camera used to photograph the second user are the same camera, the camera may photograph the first user and the second user at the same time, and the first electronic device or the second electronic device may respectively obtain a portion of the corresponding user's interface from the interface photographed by the camera.

[0368] In a multi-party call scenario, after the user corresponding to the second display screen joins the call on the first display screen, the second user is added to the users participating in the call. The call interface on the first display screen needs to add information indicating the second user, and the second display screen needs to display information of the first user, the second user, and the remote user who was originally talking to the first user. For example, in a video call scenario, after the user corresponding to the second display screen joins the call on the first display screen, both the first display screen and the second display screen need to display the first user, the second user, and the remote user.

[0369] As an optional implementation, the first electronic device and the second electronic device may use different cameras to photograph the first user and the second user, respectively. Specifically, the first electronic device may use the first camera corresponding to the first display screen to photograph the first user, and the second electronic device may use the second camera corresponding to the second display screen to photograph the second user. Among them, the first camera corresponding to the first display screen may be a camera configured on the first display screen or a camera configured in the vehicle cabin and associated with the first display screen (or the first electronic device); the second camera corresponding to the second display screen may be a camera configured on the second display screen or a camera configured in the vehicle cabin and associated with the second display screen (or the second electronic device), and the first camera and the second camera are different.

[0370] As another optional implementation, the first electronic device and the second electronic device can use the same camera to simultaneously shoot the first user and the second user, and the first electronic device and the second electronic device can respectively determine the first user and the second user from the image of the video stream shot by the camera, and display the first user and the second user in the call interface respectively. For example, the central control camera in the vehicle cabin can be used to simultaneously shoot the first user and the second user, and the first electronic device and the second electronic device can respectively cut out the video streams corresponding to the first user and the second user from the video stream shot by the central control camera and then display them separately, wherein the image frame in the video stream corresponding to the first user only contains the first user, and the image frame in the video stream corresponding to the second user only contains the second user.

[0371] For example, Fig.10As shown in , in a scenario where multiple display screens simultaneously use the same camera to capture video streams, a video stream processing method provided by an embodiment of the present application may include:

[0372] S1001: The electronic device obtains a video stream from a camera.

[0373] The camera is the same camera corresponding to the multiple display screens. The video stream is a video stream obtained by the camera by simultaneously photographing users corresponding to the multiple display screens, or the video stream is a video stream obtained by the camera photographing an area within its wide-angle range.

[0374] For example, the camera may be a central control camera in a vehicle cabin, and the video stream may be a video stream obtained by the central control camera collecting images within the entire wide-angle range. Fig.11 The range shown in , which includes the area occupied by all seats in the cabin (including the main driver's seat, the co-driver's seat, the back seats (including the back left seat, the back right seat, the back middle seat, etc.)), where the area occupied by each seat is as shown in Fig.11 as shown in .

[0375] S1002: The electronic device determines the number N of users included in the video stream and the position of each user, where N is a positive integer.

[0376] For example, when the camera is a central control camera in the vehicle cabin, the camera's shooting range is the entire cabin space, so the number and position of users included in the video stream are the number and position of users in the cabin. The electronic device can sense whether there are users sitting in the corresponding seats through the seat pressure in the vehicle cabin, and then obtain the number and position of users in the cabin; or the electronic device can detect the users in the cabin through infrared sensors, thereby determining the position of each user and the number of users in the cabin.

[0377] S1003: The electronic device obtains N copies of the video stream by duplication, and allocates one copy of the video stream to each of the N users.

[0378] S1004: For each user, the electronic device obtains preset viewfinder coordinates corresponding to the user according to the position of the user, and the viewfinder coordinates are used to mark the area occupied by the user's position in the image captured by the central control camera.

[0379] For example, Fig.11 As shown in , within the shooting range of the central control camera, the main driving seat is where the main driving seat user is located, and the area occupied by the main driving seat is the area covered by the viewfinder 1. The position coordinates of this area in the image taken by the central control camera are the viewfinder coordinates corresponding to the main driving seat user.

[0380] S1005: The electronic device crops each frame of the video stream assigned to the user according to the view frame coordinates corresponding to the user, deletes the image content outside the area marked by the view frame coordinates in each frame of the image, and obtains a cropped video stream.

[0381] S1006: The electronic device displays and transmits the cropped video stream corresponding to the user.

[0382] Among them, the electronic device can display the video stream corresponding to the user in the call interface on the display screen corresponding to the user, and can also transmit the video stream corresponding to the user to other devices so that the other devices can display the call interface according to the video stream.

[0383] For example, in Fig.11 In the scenario shown, after obtaining the video stream captured by the central control camera, the electronic device to which the main driving screen belongs can crop each frame of the video stream according to the view frame coordinates corresponding to the main driving seat user, so that each cropped frame only includes the area covered by the view frame 1, thereby obtaining a cropped video stream. After obtaining the cropped video stream, the electronic device to which the main driving screen belongs can display the cropped video stream on the main driving screen during a call.

[0384] The electronic device described in the above method may be an electronic device to which each of the multiple display screens belongs. The electronic devices to which each of the multiple display screens belongs may be the same electronic device or different electronic devices. Fig.10 The method shown processes the video stream captured by the camera to obtain the video stream corresponding to the user corresponding to each display screen.

[0385] In some embodiments of the present application, the first display screen may be any display screen in the vehicle cabin, and the second display screen may be any display screen in the vehicle cabin except the first display screen.

[0386] For example, based on the above example scenario, when the driver answers the video call, the central control screen can display the corresponding call interface, for example Figure 7a The call interface shown in , the call interface includes the main driver user and another remote user participating in the call. Among them, the display method of the call interface can refer to the relevant description in the above embodiment, which will not be repeated here.

[0387] As an optional implementation, after the call interface is displayed on the central control screen, the user can trigger the display of interactive controls for controlling call-related interactions between different display screens by operating on the central control screen (for example, swiping up), and the central control screen can further display interactive controls. For example, the central control screen can display interactive controls in the currently displayed call interface, or can display interactive controls in an area outside the call interface on the display screen, or can display interactive controls in a floating window, etc. Among them, the interactive controls may include multi-party call controls for triggering the addition of users corresponding to other display screens to the current call, and may also include call transfer controls for triggering the transfer of the current call to other display screens, etc. Exemplarily, after the user triggers the display of the interactive controls, the central control screen can Figure 7a The interface shown switches to Figure 7b The interface shown in .

[0388] After the interactive controls are displayed on the central control screen, the user can initiate a multi-party call by operating the multi-party call control in the interactive controls displayed on the central control screen (for example, by clicking the multi-party call control). Fig.12a The display selection interface shown in the figure includes candidate display screens (such as the co-pilot screen, the rear left screen, the rear right screen, etc.) on which the corresponding user can join the call. The user can select the target display screen corresponding to the user to join the call from the candidate display screens, and the central control screen can be switched to display a call interface including the main driver's seat user, the user corresponding to the target display screen, and the other remote user mentioned above; the target display screen also displays a call interface including the main driver's seat user, the user corresponding to the target display screen, and the other remote user mentioned above. For example, when the user is in Fig.12a When selecting the co-pilot screen and the rear right screen in the display screen selection interface shown, the target display screen is the co-pilot screen and the rear right screen, such as Figure 12b As shown in , the central control screen, the co-pilot screen and the rear right screen all display call interfaces, and the call interfaces displayed on each display screen include the main driver user, the co-pilot user, the user on the rear right seat and the other remote user mentioned above. The main driver user, the co-pilot user and the user on the rear right seat can all talk to the remote user. Based on the above method, the two-party call between the main driver user and the remote user can be switched to a four-party call between the main driver user, the co-pilot user, the user on the rear right seat and the remote user. Optionally, the above Figure 7a or Figure 12b In the interface shown, when a user's audio is received, the area where the user is located in the call interface can be highlighted, or a prompt message indicating that the user is speaking can be displayed in the area where the user is located.

[0389] As another optional implementation, after the call interface is displayed on the central control screen, the user can directly add the user corresponding to the target display screen to the current call by performing an operation on the central control screen. After the user performs the operation, both the central control screen and the target display screen directly switch to displaying the call interface including the main driver's seat user, the user corresponding to the target display screen, and the other remote user mentioned above.

[0390] In the above method, the multi-party call process is explained by taking the main driving screen as the control end for initiating a multi-party call as an example. The corresponding methods when other display screens are used as the control ends for initiating a multi-party call can refer to the above method, and will not be described in detail one by one in the embodiments of this application.

[0391] In the above method, after the target display screen displays the call interface, the user can continue to invite the users corresponding to other display screens to join the call on the target display screen. The specific implementation process can refer to the above method of inviting the users corresponding to the target display screen to join the call on the main driving screen, which will not be repeated here. In the above method, after the call interface is displayed on the central control screen or the target display screen, the user can also exit the current call.

[0392] The specific implementation methods of the above scheme in the one-chip multi-screen scenario and the multi-chip multi-screen scenario are different, which are introduced below. It should be noted that the first camera and the second camera described in the following embodiments can be the same camera or different cameras. For the processing method of the first camera and the second camera, please refer to the relevant description of the camera control method in the multi-party call scenario, which will not be repeated below.

[0393] When the above solution is implemented based on the one-chip multi-screen mechanism, it corresponds to the third scenario described in the above embodiment. In this scenario, the first electronic device and the second electronic device described in the above embodiment are the same electronic device, hereinafter collectively referred to as the electronic device. Fig.13 A call control method that can be used in this scenario may include:

[0394] S1301: The electronic device determines identifiers of a plurality of display screens and corresponding camera identifiers, wherein the plurality of display screens include at least a first display screen and a second display screen.

[0395] S1302: The electronic device receives a video call request from a remote device, where the request is used to request a first user corresponding to the first display screen to make a video call.

[0396] S1303: The electronic device sends a video call response to the remote device, where the video call response is used to confirm the video call.

[0397] S1304: After the electronic device establishes a video call connection with the remote device, the first call interface is displayed on the first display screen, and the first camera corresponding to the first display screen is called to shoot the first user, and the first audio device corresponding to the first display screen is called to play the call audio or receive the user audio, wherein the first call interface includes the first user shot by the first camera and the remote user corresponding to the remote device.

[0398] S1305: The remote device displays a call interface including the remote user and the first user.

[0399] The specific implementation process of the above steps S1301 to S1305 can refer to the relevant introduction of steps S801 to S805 in the above embodiment, which will not be repeated here.

[0400] S1306: In response to the received multi-party call operation, the electronic device displays a call screen selection interface, where the interface includes information for indicating at least one display screen, and the at least one display screen includes display screens among the multiple display screens except the first display screen.

[0401] Exemplarily, when the first display screen is the central control screen, the call screen selection interface may be Fig.12a The interface displayed on the central control screen in .

[0402] S1307: The electronic device responds to a call screen selection operation of selecting a second display screen among the at least one display screen by starting a second camera corresponding to the second display screen and starting a second audio device corresponding to the second display screen; wherein the second camera is used to photograph a second user corresponding to the second display screen, and the second audio device is used to play call audio or receive user audio of the second user.

[0403] S1308: The electronic device sends the received first media stream to the remote device, where the first media stream includes: a video stream from the first camera, an audio stream from the first audio device, a video stream from the second camera, and an audio stream from the second audio device.

[0404] S1309: The electronic device obtains two copies of the first media stream by duplicating the media stream.

[0405] S1310: The electronic device receives a second media stream from a remote device, wherein the second media stream includes a video stream captured by a camera corresponding to the remote device and an audio stream collected by an audio device corresponding to the remote device.

[0406] S1311: The electronic device obtains two second media streams by duplicating the media stream.

[0407] S1312: The electronic device distributes a first media stream and a second media stream to both the first display screen and the second display screen.

[0408] S1313: The electronic device updates the first call interface displayed on the first display screen according to the first media stream and the second media stream distributed to the first display screen, and displays the second call interface on the second display screen according to the first media stream and the second media stream distributed to the second display screen; wherein the updated first call interface and the second call interface both include the first user, the second user and the remote user.

[0409] For example, when the first display screen is the central control screen in the cockpit, and the second display screens are the co-pilot screen and the rear right screen, the first call interface can be Figure 12b The interface displayed on the central control screen shown in the figure, the second call interface can be Figure 12b The interface displayed on the co-pilot screen and the interface displayed on the rear right screen are shown in the figure. Among them, the display positions of different users in the call interface displayed on each display screen can be flexibly adjusted according to the application scenario or user instructions, not limited to Figure 12b The location distribution shown in .

[0410] In the above method, the method for the first electronic device to determine the first camera and the first audio device corresponding to the first display screen, and the method for the second electronic device to determine the second camera and the second audio device corresponding to the second display screen can refer to the relevant description of the audio control method and the camera control method in the call transfer scenario in the previous embodiment, and will not be repeated here.

[0411] The above method uses the video call scenario as an example to illustrate the control method of multi-party calls. The difference between the call control method in the scenario of only voice calls and the above method is that each electronic device does not need to use a camera to capture the user corresponding to the display screen, and the call interface displayed by each electronic device does not need to include the user, but can include the user's identification information. In addition to this difference, the execution of the call control method in the voice call scenario can refer to the execution of the call control method in the video call scenario, and will not be described in detail in the embodiments of this application.

[0412] Based on the above method, when an electronic device adopts a one-chip multi-screen mechanism, users corresponding to multiple display screens of the electronic device can directly participate in the same call without the user having to perform additional operations such as logging into the call account. Therefore, it has high flexibility and convenience, and can efficiently realize multi-party calls.

[0413] It should be noted that the specific implementation process provided in the above example is only an example of the method process applicable to the embodiment of the present application. The execution order of the above steps can be adjusted accordingly according to actual needs, and other steps can be added or some steps can be reduced. For example, the above step S1309 can be executed earlier than steps S1310 to S1311, or can be executed synchronously with steps S1310 to S1311.

[0414] When the above solution is implemented based on the multi-core multi-screen mechanism, it corresponds to the fourth scenario described in the above embodiment. In this scenario, the first electronic device and the second electronic device described in the above embodiment are different electronic devices. Fig.14 A call control method that can be used in this scenario may include:

[0415] S1401: The first electronic device determines the identifications of multiple display screens and corresponding camera identifications and reports them to a server so that the server establishes a trust relationship between the multiple display screens; wherein the multiple display screens include at least a first display screen of the first electronic device and a second display screen of the second electronic device.

[0416] S1402: The first electronic device receives a video call request from a remote device, where the request is used to request a first user corresponding to a first user call account to make a video call; wherein the first user call account has been logged into the first electronic device.

[0417] S1403: The first electronic device sends a video call response to the remote device, where the video call response is used to confirm the video call.

[0418] S1404: After the first electronic device establishes a video call connection with the remote device, the first call interface is displayed on the first display screen through the call service, and the first camera corresponding to the first display screen is called to shoot the first user, and the first audio device corresponding to the first display screen is called to play the call audio or receive the user audio, wherein the first call interface includes the first user shot by the first camera and the remote user corresponding to the remote device.

[0419] S1405: The remote device displays a call interface including the remote user and the first user.

[0420] The specific implementation process of the above steps S1401 to S1405 can refer to the relevant introduction of steps S901 to S905 in the above embodiment, which will not be repeated here.

[0421] S1406: In response to the received multi-party call operation, the first electronic device displays a call screen selection interface, where the interface includes information for indicating at least one display screen, and the at least one display screen includes a display screen among the multiple display screens except the first display screen.

[0422] The specific implementation of this step can refer to the relevant introduction of step S1106 in the above embodiment, which will not be repeated here.

[0423] S1407: In response to a call screen selection operation of selecting a second display screen from among the at least one display screen, the electronic device sends a call invitation request to the server, where the request is used to request that a user corresponding to the second display screen be connected to the call on the first display screen.

[0424] S1408: The server sends the call invitation request and the first account information to the second electronic device, where the first account information is used to indicate the call account of the first user.

[0425] S1409: After receiving the call invitation request, the second electronic device determines whether the call service is started; if so, execute step S1410, otherwise, execute step S1411.

[0426] S1410: The second electronic device determines whether the first user's call account has been logged in; if so, execute step S1413, otherwise, execute step S1412.

[0427] S1411: The second electronic device starts the call service, and executes step S1412.

[0428] S1412: The second electronic device logs in the first user's call account in the call service, and executes step S1413.

[0429] S1413: The second electronic device activates the second camera corresponding to the second display screen, and activates the second audio device corresponding to the second display screen; wherein the second camera is used to photograph the second user corresponding to the second display screen, and the second audio device is used to play call audio or receive user audio of the second user.

[0430] S1414: The second electronic device sends the received first media stream to the first electronic device, where the first media stream includes: a video stream from the second camera and an audio stream from the second audio device.

[0431] S1415: The first electronic device sends the first media stream and the second media stream to the remote device, wherein the second media stream includes a video stream from the first camera and an audio stream from the first audio device.

[0432] S1416: The remote device updates the displayed call interface based on the received first media stream, second media stream, and third media stream, wherein the third media stream includes a video stream captured by a camera corresponding to the remote device and an audio stream collected by an audio device corresponding to the remote device, and the updated call interface includes the first user, the second user, and the remote user.

[0433] S1417: The first electronic device receives a third media stream from a remote device.

[0434] S1418: The first electronic device sends the copied second media stream and third media stream to the second electronic device.

[0435] S1419: The first electronic device updates a first call interface according to the received first media stream, second media stream, and third media stream, wherein the first call interface includes the first user, the second user, and the remote user.

[0436] S1420: The second electronic device displays a second call interface according to the received first media stream, second media stream and third media stream, wherein the second call interface includes the first user, the second user and the remote user.

[0437] It should be noted that in the above method, the data transmission between the second electronic device and the remote device is achieved by forwarding by the first electronic device, but the data transmission method between the second electronic device and the remote device in the present application is not limited to this, and can also be achieved in other ways. For example, the second electronic device and the remote device can directly establish a communication connection and then exchange data. In the above method, the second electronic device can send the copied first media stream directly to the remote device, and the remote device can also send the copied third media stream directly to the second electronic device. The data transmission method between the second electronic device and the remote device can be selected as needed in actual applications, and no specific restrictions are made in the embodiments of the present application.

[0438] In the above method, the method for the first electronic device to determine the first camera and the first audio device corresponding to the first display screen, and the method for the second electronic device to determine the second camera and the second audio device corresponding to the second display screen can refer to the relevant description of the audio control method and the camera control method in the call transfer scenario in the previous embodiment, and will not be repeated here.

[0439] The above method uses the video call scenario as an example to illustrate the control method of multi-party calls. The difference between the call control method in the scenario of only voice calls and the above method is that each electronic device does not need to use a camera to capture the user corresponding to the display screen, and the call interface displayed by each electronic device does not need to include the user, but can include the user's identification information. In addition to this difference, the execution of the call control method in the voice call scenario can refer to the execution of the call control method in the video call scenario, and will not be described in detail in the embodiments of this application.

[0440] Based on the above method, when an electronic device adopts a multi-core multi-screen mechanism, users corresponding to multiple display screens of the electronic device can directly participate in the same call without the need for the user to perform additional operations such as logging in to the call account. Therefore, it has high flexibility and convenience, and can efficiently implement multi-party calls. Among them, electronic devices corresponding to different display screens support running independent call services, and different electronic devices can log in to the same or different user call accounts through their respective call services. When a user invites a user corresponding to the display screen of another electronic device to join a call on the display screen of one electronic device, the electronic device that accepts the invitation can automatically log in to the same user call account as the electronic device that initiated the invitation, thereby joining the call. In this process, the user does not need to manually log in to the relevant user call account, so it has high flexibility and convenience.

[0441] It should be noted that there may be similarities between the methods provided in different examples in the aforementioned embodiments, or the methods in some examples are also applicable in other examples. The embodiments of the present application are not described in detail in each example, and the similarities or commonalities in the methods provided in different examples can be used as references to each other.

[0442] It should be noted that the specific implementation process provided in the above example is only an example of the method process applicable to the embodiment of the present application. The execution order of the above steps can be adjusted accordingly according to actual needs, and other steps can be added or some steps can be reduced. For example, the above step S1416 can be executed synchronously with step S1417, and the above step S1419 can be executed synchronously with step S1420, etc.

[0443] In the above embodiment, when users corresponding to other display screens are invited to join a call on one display screen, a call interface including all users participating in the multi-party call is displayed on the display screen corresponding to each user participating in the multi-party call.

[0444] For example, when the users participating in the multi-party call include the remote user, the user in the left rear seat in the cabin, and the user in the right rear seat, the remote device, the electronic device to which the left rear screen belongs, and the electronic device to which the right rear screen belongs can display the following information: Fig.15 The call interface shown in the figure includes a remote user, a user on the left rear seat, and a user on the right rear seat, wherein each user is displayed in an independent area or window.

[0445] The implementation process of the above method can refer to the relevant description in the above embodiments, which will not be repeated here.

[0446] In some embodiments of the present application, when the users participating in the multi-party call include multiple users in the same row in the cabin, each electronic device (such as the electronic device, the first electronic device, the second electronic device, the remote device, etc. described in the above embodiments) can splice and fuse the images corresponding to the multiple users into one image for display when displaying the multiple users in the call interface. Taking the video call scenario as an example, each electronic device can determine the video of each user among the multiple users based on the video stream captured by the camera and / or the video stream from other electronic devices, thereby obtaining multiple channels of video corresponding to the multiple users. Then, the multiple channels of video corresponding to the multiple users are subjected to image fusion processing to obtain one channel of video, which is displayed in the call interface.

[0447] In some embodiments of the present application, the method of performing image fusion processing on multiple channels of video may be to perform image fusion processing on image frames with the same number of frames in the multiple channels of video respectively. Taking the image fusion processing on two channels of video as an example, the first frame image in one channel of video may be subjected to image fusion processing with the first frame image in another channel of video to obtain the first frame image of the fused video, and the second frame image in one channel of video may be subjected to image fusion processing with the second frame image in another channel of video to obtain the second frame image of the fused video, and so on, to obtain the fused video corresponding to the two channels of video.

[0448] In some embodiments of the present application, Fig.16 As shown in , the process of image fusion processing of two images may include: selecting a path with the lowest visual energy in the overlapping area of ​​the two images as the stitching line of the two images, and stitching the two images according to the stitching line. Fig.16 As shown in , the image on the left is image 1, the image on the right is image 2, the shaded portion is the overlapping area of ​​image 1 and image 2, and the dotted line is the stitching line of the two images.

[0449] For example, Fig.17 The schematic diagram (a) in the figure shows an image of the user on the right side of the rear seat taken by the camera corresponding to the rear right screen in the cockpit. Fig.17 The schematic diagram (b) in the figure shows an image of the rear left user captured by the camera corresponding to the rear left screen in the cockpit. The fused image obtained by performing image fusion processing on the image of the rear right user and the image of the rear left user according to the above method is as follows: Fig.17 As shown in the schematic diagram (c) in FIG. 1 , the fused image reorganizes the images captured by the two rear cameras into an overall image, which is easier for users to view when displayed, so that users can view the status of two users at the same time in one image, thereby improving the user experience.

[0450] For the fusion processing between two or more images, after sorting the images according to the position of the user in the images, refer to the above-mentioned fusion processing process between two images, first fuse two adjacent images, then fuse the obtained image with the next adjacent image, and so on, until the fusion processing of all images is completed, and the fused image corresponding to the two or more images can be obtained.

[0451] For the fusion processing between videos, the above-mentioned fusion processing process between images can be referred to, and each frame of the different videos can be fused accordingly to obtain a fused video after fusion of the different videos. By fusion of different videos and displaying them in the same window, when different cameras are used to shoot different users, the viewing user can simultaneously view the status of different users being filmed in the same window, thus providing a better viewing experience.

[0452] For example, in the above Fig.15 In the example shown, the user in the left rear seat and the user in the right rear seat are in the same row, so the user in the left rear seat and the user in the right rear seat can be displayed in the same screen for easy viewing. Then, each electronic device can perform fusion processing on the video or image screen corresponding to the user in the left rear seat and the user in the right rear seat according to the above method and then display it on the display screen. Based on this method, the call interface displayed by each electronic device can be Fig.18 In the interface shown in , the user on the left rear seat and the user on the right rear seat in the cabin are displayed on the same screen in the same area or window. Therefore, the user watching the call interface can simultaneously view users in different positions in the same row in the same area screen.

[0453] Based on the above embodiments and the same technical concept, the present application embodiment also provides a call control method, such as Fig.19 As shown in , the method may include:

[0454] S1901: The electronic device displays a first call interface on a first display screen; wherein the first call interface includes a first user and a remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to the remote device.

[0455] Exemplarily, the electronic device may be the electronic device described in the aforementioned embodiment, and the remote device may be the remote device described in the aforementioned embodiment.

[0456] Exemplarily, the first display screen may be Figure 7a The central control screen shown in FIG. 1 , the first call interface can be Figure 7aIn the call interface displayed on the central control screen shown in , the first user can be the main driving user.

[0457] S1902: In response to the first operation received, the electronic device does not display the first call interface on the first display screen, and displays the second call interface on the second display screen; wherein the first operation is used to instruct the first call interface to be transferred to the second display screen, the second call interface includes the second user and the remote user, and the second user corresponds to the second display screen.

[0458] Exemplarily, the second display screen may be the target display screen described in the aforementioned embodiment. The first operation may include the operation of the call transfer control displayed on the first display screen by the user described in the aforementioned embodiment and the operation of the user selecting the target display screen in the display screen selection interface displayed on the first display screen. Alternatively, the first operation may be the operation of the user selecting the target display screen in the display screen selection interface displayed on the first display screen described in the aforementioned embodiment.

[0459] Exemplarily, the second display screen may be Figure 7d The second call interface can be Figure 7d In the call interface displayed on the rear right screen shown in , the second user may be the user sitting in the rear right seat in the cabin.

[0460] In some embodiments of the present application, before the electronic device displays the first call interface on the first display screen, it can use the first camera to shoot the first user, and send the video shot by the first camera to the remote device, so that the remote device can display the first user in the displayed call interface based on the video shot by the first camera.

[0461] Exemplarily, the first user may be the driving seat user described in the aforementioned embodiment, and the first camera may be the central control camera described in the aforementioned embodiment.

[0462] As an optional implementation, after the electronic device displays the first call interface on the first display screen, it can respond to the first operation by using the first camera to shoot the second user, and send the video shot by the first camera to the remote device, so that the remote device can display the second user in the displayed call interface according to the video shot by the first camera. Exemplarily, the second user can be the user in the co-pilot seat in the cabin, and the first camera can be the central control camera, then the electronic device can focus the central control camera to the co-pilot seat to shoot the user in the co-pilot seat.

[0463] As another optional implementation, after the electronic device displays the first call interface on the first display screen, it can respond to the first operation by turning off the first camera, starting the second camera, using the second camera to shoot the second user, and sending the video shot by the second camera to the remote device, thereby enabling the remote device to display the second user in the displayed call interface based on the video shot by the second camera. The first camera is associated with the first display screen, and the second camera is associated with the second display screen. Exemplarily, the second user can be a user in the co-pilot seat in the cockpit, and the second camera can be a camera configured on the co-pilot screen, and the electronic device can use the camera to shoot the user in the co-pilot seat.

[0464] In some embodiments of the present application, the electronic device can receive a video from the remote device, and display the remote user in the second call interface based on the video from the remote device; and display the second user in the second call interface based on the video captured by the first camera or the second camera, thereby achieving the effect of displaying the second interface.

[0465] The above method for using a camera by an electronic device can refer to the relevant description of the camera control method in the call transfer scenario in the aforementioned embodiment, which will not be described in detail here.

[0466] In some embodiments of the present application, the electronic device may also respond to the first operation by using a Bluetooth headset connected to the second display screen to play audio from the remote device; or, the electronic device may respond to the first operation by using a set audio output device in the spatial area where the second display screen is located to play audio from the remote device; or, the electronic device may respond to the first operation by using a target audio output device to play audio from the remote device; wherein the target audio output device is associated with a first target sound zone, and the first target sound zone is associated with at least one audio output device in the spatial area where the second display screen is located.

[0467] In some embodiments of the present application, the first target sound zone is associated with the second display screen. In this scenario, the first target sound zone can be a sound zone associated with the second display screen obtained by dividing the sound zone according to the spatial area range described in the above embodiments.

[0468] In some embodiments of the present application, the device type and / or location type of the at least one audio output device are the same. In this scenario, the first target sound zone may be a sound zone divided by the method for dividing sound zones by type described in the above embodiments.

[0469] In some embodiments of the present application, when the electronic device displays the first call interface on the first display screen, it can use the first audio output device to play the audio from the remote device; when receiving the first operation, the electronic device can respond to the first operation and not use the first audio output device to play the audio from the remote device.

[0470] In some embodiments of the present application, the electronic device can also respond to the first operation, use the Bluetooth headset connected to the second display screen to receive audio, and send the audio received by the Bluetooth headset to the remote device; or, the electronic device can respond to the first operation, use the target audio input device to receive audio, and send the audio received by the target audio output device to the remote device; wherein the target audio input device is associated with a second target sound zone, and the second target sound zone is associated with at least one audio input device in the spatial area where the second display screen is located.

[0471] In some embodiments of the present application, the second target sound zone is associated with the second display screen. In this scenario, the second target sound zone can be a sound zone associated with the second display screen obtained by dividing the sound zone according to the spatial area range described in the above embodiments.

[0472] In some embodiments of the present application, the device type and / or location type of the at least one audio input device are the same. In this scenario, the second target sound zone can be a sound zone divided by the method of dividing the sound zone by type described in the above embodiments.

[0473] In some embodiments of the present application, when the electronic device displays the first call interface on the first display screen, the first audio input device can be used to receive audio, and the audio received by the first audio input device can be sent to the remote device so that the remote device plays the audio. After the electronic device displays the first call interface on the first display screen, the first audio input device can also be turned off in response to the first operation.

[0474] The above-mentioned method for controlling audio output and audio input of an electronic device can refer to the relevant description of the audio control method in the call transfer scenario in the aforementioned embodiment, and will not be described in detail here.

[0475] In some embodiments of the present application, the first display screen and the second display screen are different display screens in the cabin space.

[0476] In the above method, the specific steps executed by the electronic device can refer to the introduction of the relevant methods in the call transfer scenario in the previous embodiment (such as the method for realizing call transfer based on a one-chip multi-screen mechanism, etc.), which will not be elaborated here.

[0477] Based on the above embodiments and the same technical concept, the present application embodiment also provides a call control method, such as Fig. 20 As shown in , the method may include:

[0478] S2001: The electronic device displays a first call interface on a first display screen; wherein the first call interface includes a first user and a remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to the remote device.

[0479] For the specific implementation of this step, please refer to the relevant introduction of the above step S1901, which will not be repeated here.

[0480] S2002: In response to receiving the first operation, the electronic device updates the first call interface on the first display screen to a second call interface, and displays a third call interface on the second display screen; wherein the first operation is used to indicate: inviting the second user corresponding to the second display screen to participate in the call; the second call interface and the third call interface include the first user, the second user and the remote user.

[0481] Exemplarily, the second display screen may be the target display screen described in the aforementioned embodiment. The first operation may include the operation of the multi-party call control displayed on the first display screen by the user as described in the aforementioned embodiment and the operation of the user selecting the target display screen in the display screen selection interface displayed on the first display screen. Alternatively, the first operation may be the operation of the user selecting the target display screen in the display screen selection interface displayed on the first display screen as described in the aforementioned embodiment.

[0482] In a possible example, the second display screen may be Figure 12b The second call interface can be Figure 12b In another possible example, the second display screen may be a call interface displayed on the co-pilot screen shown in FIG. Figure 12b The second call interface can be Figure 12b In the call interface displayed on the rear right screen shown in , the second user may be the user sitting in the rear right seat in the cabin.

[0483] In some embodiments of the present application, as an optional implementation, the electronic device can also respond to the first operation by using a first camera to shoot the first user, using a second camera to shoot the second user, and sending the first video shot by the first camera and the second video shot by the second camera to the remote device; wherein the first camera is associated with the first display screen, and the second camera is associated with the second display screen.

[0484] Exemplarily, the first user may be a user in the driving seat in the cockpit, the first camera may be a central control camera, the second user may be a user in the rear right seat in the cockpit, and the second camera may be a camera configured on the rear right screen in the cockpit.

[0485] As another optional implementation, the electronic device may respond to the first operation by using a third camera to shoot the first user and the second user, and send the third video shot by the third camera and the fourth video shot by the third camera to the remote device; wherein the third video includes the first user, and the fourth video includes the second user. The electronic device may use the third camera to shoot the first user and the second user to obtain a fifth video including the first user and the second user; then determine the third video including the first user based on the fifth video, and determine the fourth video including the second user based on the fifth video; and finally send the third video and the fourth video to the remote device respectively.

[0486] In some embodiments of the present application, the fifth video includes at least one frame of image; when the electronic device determines that the third video includes the first user based on the fifth video, the electronic device may perform a target processing process on each frame of image in the fifth video to obtain the third video; wherein the target processing process includes: cutting out the content outside the first viewfinder at a set position in the image; wherein the first viewfinder is used to indicate the position of the first user. When the electronic device determines that the fourth video includes the second user based on the fifth video, the electronic device may perform a processing process similar to the above-mentioned target processing process on each frame of image in the fifth video to obtain the fourth video; wherein the processing process includes: cutting out the content outside the second viewfinder at a set position in the image; wherein the second viewfinder is used to indicate the position of the second user. The specific implementation of this process can be referred to. Fig.10 The method shown is executed and will not be described in detail here.

[0487] Exemplarily, any frame image in the fifth video may include a frame image taken by a central control camera. Fig.11The scene within the wide-angle range of the camera shown, when the first user is Fig.11 When the user in the main driving seat is shown in FIG. , the first viewfinder may be Fig.11 As shown in the framing frame 1 , the electronic device can obtain an image including only the user in the main driving seat by cutting off the image content outside the area corresponding to the framing frame 1 in the image.

[0488] In some embodiments of the present application, the electronic device can receive a video from the remote device, and display the remote user in the third call interface based on the video from the remote device; and display the first user in the third call interface based on the video captured by the first camera or the third camera; and display the second user in the third call interface based on the video captured by the second camera or the third camera.

[0489] The above method for using a camera by an electronic device can refer to the relevant description of the camera control method in a multi-party call scenario in the aforementioned embodiment, and will not be described in detail here.

[0490] In some embodiments of the present application, the positions of the first user and the second user can be adjacent to each other on the left and right; when the electronic device displays the third call interface on the second display screen, it can receive the video from the remote device, and display the remote user in the third call interface based on the video from the remote device; it can determine the sixth video including the first user and the second user based on the first target video and the second target video, and display the first user and the second user in the third call interface based on the sixth video; wherein the first target video is the video shot by the first camera or the third camera, and the second target video is the video shot by the second camera or the third camera. In this method, the first user and the second user can be displayed in the same display area.

[0491] Exemplarily, the third interface may be Fig.18 The interface shown in .

[0492] In some embodiments of the present application, when the electronic device determines the sixth video including the first user and the second user based on the first target video and the second target video, it can perform image fusion processing on the image in the first target video and the image in the second target video to obtain the image in the sixth video, and then obtain the sixth video.

[0493] In a possible example, the first user may be a user sitting in the right rear seat in the cabin, and a frame of image in the first target video may be Fig.17The second user may be a user sitting in the left rear seat in the cabin, and a frame of the second target video may be Fig.17 The image shown in the schematic diagram (b). Fig.17 The image shown in the schematic diagram (a) is similar to Fig.17 The images shown in the schematic diagram (b) in FIG. 3 are taken at the same time. Fig.17 The image shown in the schematic diagram (a) is similar to Fig.17 After the image shown in the schematic diagram (b) in FIG. 1 is subjected to image fusion processing, the corresponding frame image in the sixth video obtained can be Fig.17 The image shown in the schematic diagram (c) of FIG. Fig.17 The image shown in the schematic diagram (a) is similar to Fig.17 The process of performing image fusion processing on the image shown in the schematic diagram (b) in FIG. 1 can refer to the image fusion processing related methods described in the above embodiments (for example Fig.16 The corresponding method) is implemented and will not be described in detail here.

[0494] The process of the electronic device determining the sixth video from the first target video and the second target video can be implemented by referring to the process of performing image fusion processing on multiple videos described in the aforementioned embodiment, which will not be described in detail here.

[0495] In some embodiments of the present application, the electronic device can also receive audio from the remote device in response to the first operation, and / or receive audio using a second audio input device; and use a first audio output device to play the audio from the remote device and / or the audio received by the second audio input device; wherein the second audio input device is associated with the second display screen; and the first audio output device is associated with the first display screen.

[0496] Optionally, the first audio output device may be: a Bluetooth headset connected to the first display screen; or a set audio output device within the spatial area where the first display screen is located; or an audio output device associated with the first sound zone; wherein the first sound zone is associated with at least one audio output device within the spatial area where the first display screen is located.

[0497] In some embodiments of the present application, the first sound zone is associated with the first display screen. In this scenario, the first sound zone can be a sound zone associated with the first display screen obtained by dividing the sound zone according to the spatial area range described in the above embodiments.

[0498] Optionally, the second audio input device may be a Bluetooth headset connected to the second display screen or an audio input device associated with the second sound zone; wherein the second sound zone is associated with at least one audio input device in the spatial area where the second display screen is located.

[0499] In some embodiments of the present application, the second sound zone is associated with the second display screen. In this scenario, the second sound zone can be a sound zone associated with the second display screen obtained by dividing the sound zone according to the spatial area range described in the above embodiments.

[0500] In some embodiments of the present application, the electronic device may also send the audio received by the second audio input device to the remote device in response to the first operation, so that the remote device plays the audio.

[0501] In some embodiments of the present application, the electronic device can also receive audio from the remote device in response to the first operation, and / or receive audio using a first audio input device; and use a second audio output device to play the audio from the remote device and / or the audio received by the first audio input device; wherein the first audio input device is associated with the first display screen; and the second audio output device is associated with the second display screen.

[0502] Optionally, the second audio output device may be: a Bluetooth headset connected to the second display screen; or a set audio output device within the spatial area where the second display screen is located; or an audio output device associated with a third sound zone; wherein the third sound zone is associated with at least one audio output device within the spatial area where the second display screen is located.

[0503] In some embodiments of the present application, the third sound zone is associated with the second display screen. In this scenario, the third sound zone can be a sound zone associated with the second display screen obtained by dividing the sound zone according to the spatial area range described in the above embodiments.

[0504] Optionally, the first audio input device may be a Bluetooth headset connected to the first display screen or an audio input device associated with a fourth sound zone; wherein the fourth sound zone is associated with at least one audio input device in the spatial area where the first display screen is located.

[0505] In some embodiments of the present application, the fourth sound zone is associated with the first display screen. In this scenario, the fourth sound zone can be a sound zone associated with the first display screen obtained by dividing the sound zone according to the spatial area range described in the above embodiments.

[0506] In some embodiments of the present application, the electronic device may also send the audio received by the first audio input device to the remote device in response to the first operation.

[0507] In some embodiments of the present application, the device type and / or location type of the at least one audio output device are the same. In this scenario, the sound zone associated with the at least one audio output device can be a sound zone divided by the method of dividing the sound zone by type described in the above embodiments.

[0508] In some embodiments of the present application, the device type and / or location type of the at least one audio input device are the same. In this scenario, the sound zone associated with the at least one audio input device can be a sound zone divided by the method of dividing the sound zone by type described in the above embodiments.

[0509] The above method for controlling audio output and audio input of an electronic device can refer to the relevant description of the audio control method in a multi-party call scenario in the above embodiment, and will not be described in detail here.

[0510] In some embodiments of the present application, the first display screen and the second display screen are different display screens in the cabin space.

[0511] In the above method, the specific steps executed by the electronic device can refer to the introduction of the relevant methods in the multi-party call scenario in the previous embodiment (such as the method for realizing multi-party calls based on a one-chip multi-screen mechanism, etc.), which will not be elaborated here.

[0512] Based on the above embodiments and the same technical concept, the present application embodiment also provides a call control method, such as Fig.21 As shown in , the method may include:

[0513] S2101: The second electronic device receives a first request from the first electronic device forwarded by a server, and receives first account information from the server; wherein the server is used to store the association between the first display screen of the first electronic device and the second display screen and the first user account logged in on the first display screen, the first user account is associated with the first call interface displayed on the first display screen, the first call interface includes the first user and the remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to the remote device; the first request is used to request that the first call interface be transferred to the second display screen; the first account information is used to indicate the first user account.

[0514] S2102: The second electronic device determines the first user account according to the first account information in response to the first request, and logs in the first user account on the second display screen.

[0515] S2103: The second electronic device displays a second call interface on the second display screen; wherein the second call interface is associated with the first user account, the second call interface includes a second user and the remote user, and the second user is associated with the second display screen.

[0516] The interface display effects related to the above method can refer to the above Fig.19 The related interface display effects in the method shown will not be repeated here.

[0517] In the above method, the specific steps executed by the electronic device can refer to the introduction of the relevant methods in the call transfer scenario in the previous embodiment (such as the method for realizing call transfer based on a multi-core multi-screen mechanism, etc.), which will not be elaborated here.

[0518] Based on the above embodiments and the same technical concept, the present application embodiment also provides a call control method, such as Fig. 22 As shown in , the method may include:

[0519] S2201: The second electronic device receives a first request from the first electronic device forwarded by a server, and receives first account information from the server; wherein the server is used to store the association between the first display screen of the first electronic device and the second display screen and the first user account logged in on the first display screen, the first user account is associated with the first call interface displayed on the first display screen, the first call interface includes a first user and a remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to the remote device; the first request is used to request the second user corresponding to the second display screen to participate in the call; the first account information is used to indicate the first user account.

[0520] S2202: The second electronic device determines the first user account according to the first account information in response to the first request, and logs in the first user account on the second display screen.

[0521] S2203: The second electronic device displays a second call interface on the second display screen; wherein the second call interface is associated with the first user account, and the second call interface includes the first user, the second user and the remote user.

[0522] The interface display effects related to the above method can refer to the above Fig. 20 The related interface display effects in the method shown will not be repeated here.

[0523] In the above method, the specific steps executed by the electronic device can refer to the introduction of the relevant methods in the multi-party call scenario in the previous embodiment (for example, the method for implementing multi-party calls based on a multi-core multi-screen mechanism, etc.), and will not be elaborated here.

[0524] Based on the above embodiments and the same concept, the embodiments of the present application also provide an electronic device, which can be used to implement the method provided in the embodiments of the present application and applied to the electronic device or the first electronic device or the second electronic device. Fig.23 As shown in FIG. 2 , the electronic device 2300 may include: a display screen 2301 , a memory 2302 , one or more processors 2303 , and one or more computer programs (not shown in the figure). The above components may be coupled via one or more communication buses 2304 .

[0525] Among them, the display screen 2301 is used to display relevant user interfaces such as application interface.

[0526] One or more computer programs (codes) are stored in the memory 2302, and the one or more computer programs include computer instructions; one or more processors 2303 call the computer instructions stored in the memory 2302, so that the electronic device 2300 executes the method applied to the electronic device or the first electronic device or the second electronic device provided in the embodiment of the present application.

[0527] In a specific implementation, the memory 2302 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 2302 may store an operating system (hereinafter referred to as the system), such as an embedded operating system such as ANDROID, IOS, WINDOWS, or LINUX. The memory 2302 may be used to store an implementation program of an embodiment of the present application. The memory 2302 may also store a network communication program, which may be used to communicate with one or more additional devices, one or more user devices, or one or more network devices.

[0528] The one or more processors 2303 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

[0529] It should be noted that Fig.23 This is only one implementation of the electronic device 2300 provided in the embodiment of the present application. In actual applications, the electronic device 2300 may also include more or fewer components, which is not limited here.

[0530] It should be understood that the various schemes of the embodiments of the present application can be used in reasonable combination, and the explanations or descriptions of the various terms appearing in the embodiments can be mutually referenced or explained in the various embodiments, without limitation.

[0531] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0532] Based on the above embodiments and the same concept, an embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program runs on a computer, the computer executes the audio playback method provided in the above embodiments.

[0533] Based on the above embodiments and the same concept, the embodiments of the present application also provide a computer program product, which includes a computer program or instructions. When the computer program or instructions are executed on a computer, the computer executes the audio playback method provided in the above embodiments.

[0534] Based on the above embodiments and the same technical concept, the embodiment of the present application further provides a chip system, which includes a processor and a memory, wherein instructions are stored in the memory; when the instructions are executed by the processor, the method described in the first aspect or any possible design of the first aspect can be implemented. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0535] In the method provided in the embodiment of the present application, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center via wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a digital video disc (DVD), or a semiconductor medium (e.g., an SSD), etc.

[0536] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A call control method, applied to an electronic device, characterized in that: The electronic device comprises a first display screen and a second display screen; the method comprises: Displaying a first call interface on the first display screen, and calling an audio device corresponding to the first display screen to play the call audio; wherein the audio device corresponding to the first display screen is selected from the audio devices associated with the first display screen according to the audio type of the call audio and the priority of the audio device; the first call interface includes a first user and a remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to the remote device; In response to the received first operation, the first display screen does not display the first call interface, and displays the second call interface on the second display screen; wherein the first operation is used to indicate that the first call interface is transferred to the second display screen, and the second call interface includes the second user and the remote user, and the second user corresponds to the second display screen.

2. The method according to claim 1, characterized in that Before displaying the first call interface on the first display screen, the method further includes: Using a first camera to shoot the first user, and sending the video shot by the first camera to the remote device; After displaying the first call interface on the first display screen, the method further includes: In response to the first operation, using the first camera to shoot the second user, and sending the video shot by the first camera to the remote device; or In response to the first operation, the first camera is turned off, the second camera is turned on, the second user is photographed using the second camera, and the video photographed by the second camera is sent to the remote device; wherein the first camera is associated with the first display screen, and the second camera is associated with the second display screen.

3. The method according to claim 2, characterized in that The displaying the second call interface on the second display screen includes: Receive the video from the remote device, and display the remote user in the second call interface based on the video from the remote device; and display the second user in the second call interface based on the video captured by the first camera or the second camera.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: In response to the first operation, using a Bluetooth headset connected to the second display screen to play audio from the remote device; or In response to the first operation, using a set audio output device in the spatial area where the second display screen is located to play the audio from the remote device; or In response to the first operation, audio from the remote device is played using a target audio output device; wherein the target audio output device is associated with a first target sound zone, and the first target sound zone is associated with at least one audio output device in a spatial area where the second display screen is located.

5. The method according to claim 4, characterized in that The first target sound zone is associated with the second display screen.

6. The method according to claim 4, characterized in that The at least one audio output device has the same device type and / or location type.

7. The method according to any one of claims 1 to 3, characterized in that: After displaying the first call interface on the first display screen and calling the audio device corresponding to the first display screen to play the call audio, the method further includes: In response to the first operation, the audio device corresponding to the first display screen does not play the call audio.

8. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: In response to the first operation, receiving audio using a Bluetooth headset connected to the second display screen, and sending the audio received by the Bluetooth headset to the remote device; or In response to the first operation, audio is received using a target audio input device, and the audio received by the target audio input device is sent to the remote device; wherein the target audio input device is associated with a second target sound zone, and the second target sound zone is associated with at least one audio input device in the spatial area where the second display screen is located.

9. The method according to claim 8, characterized in that The second target sound zone is associated with the second display screen.

10. The method according to claim 8, characterized in that The at least one audio input device has the same device type and / or location type.

11. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: When the first call interface is displayed on the first display screen, the audio is received by the first audio input device, and the audio received by the first audio input device is sent to the remote device; After displaying the first call interface on the first display screen, the method further includes: In response to the first operation, the first audio input device is turned off.

12. The method according to any one of claims 1 to 3, characterized in that: The first display screen and the second display screen are different display screens in the cockpit space.

13. A call control method, applied to an electronic device, characterized in that: The electronic device comprises a first display screen and a second display screen; the method comprises: Displaying a first call interface on the first display screen, and calling an audio device corresponding to the first display screen to play the call audio; wherein the audio device corresponding to the first display screen is selected from the audio devices associated with the first display screen according to the audio type of the call audio and the priority of the audio device; the first call interface includes a first user and a remote user participating in the call, the first user corresponds to the first display screen, and the remote user corresponds to the remote device; In response to the first operation received, the first call interface on the first display screen is updated to a second call interface, and a third call interface is displayed on the second display screen; wherein the first operation is used to indicate: inviting the second user corresponding to the second display screen to participate in the call; the second call interface and the third call interface include the first user, the second user and the remote user.

14. The method according to claim 13, characterized in that The method further comprises: In response to the first operation, use a first camera to shoot the first user, use a second camera to shoot the second user, and send a first video shot by the first camera and a second video shot by the second camera to the remote device; wherein the first camera is associated with the first display screen, and the second camera is associated with the second display screen; or In response to the first operation, the first user and the second user are photographed using a third camera, and a third video photographed by the third camera and a fourth video photographed by the third camera are sent to the remote device; wherein the third video includes the first user, and the fourth video includes the second user.

15. The method according to claim 14, characterized in that The using a third camera to shoot the first user and the second user, and sending a third video shot by the third camera and a fourth video shot by the third camera to the remote device, comprises: Using the third camera to shoot the first user and the second user to obtain a fifth video; wherein the fifth video includes the first user and the second user; Determine the third video including the first user according to the fifth video, and determine the fourth video including the second user according to the fifth video; The third video and the fourth video are sent to the remote device respectively.

16. The method according to claim 15, characterized in that The fifth video includes at least one frame of image; and the determining, according to the fifth video, the third video including the first user, comprises: Performing a target processing process on each frame of the fifth video to obtain the third video; wherein the target processing process includes: The content outside the first viewfinder at a set position in the image is cut off; wherein the first viewfinder is used to indicate the position of the first user.

17. The method according to any one of claims 14 to 16, characterized in that: The displaying the third call interface on the second display screen includes: Receive the video from the remote device, and display the remote user in the third call interface based on the video from the remote device; and, display the first user in the third call interface based on the video captured by the first camera or the third camera; and, display the second user in the third call interface based on the video captured by the second camera or the third camera.

18. The method according to any one of claims 14 to 16, characterized in that: The first user and the second user are located adjacent to each other on the left and right; The displaying the third call interface on the second display screen includes: receiving a video from the remote device, and displaying the remote user in the third call interface according to the video from the remote device; Determine a sixth video including the first user and the second user according to a first target video and a second target video; wherein the first target video is a video shot by the first camera or the third camera, and the second target video is a video shot by the second camera or the third camera; According to the sixth video, the first user and the second user in the third call interface are displayed; wherein the first user and the second user are displayed in the same display area.

19. The method according to any one of claims 13 to 16, characterized in that: The method further comprises: In response to the first operation, receiving audio from the remote device, and / or receiving audio using a second audio input device; wherein the second audio input device is associated with the second display screen; The audio from the remote device and / or the audio received by the second audio input device is played by a first audio output device; wherein the first audio output device is associated with the first display screen.

20. The method of claim 19, wherein: The first audio output device is: A Bluetooth headset connected to the first display screen; or a preset audio output device within the spatial area where the first display screen is located; or An audio output device associated with a first sound zone; wherein the first sound zone is associated with at least one audio output device in a spatial area where the first display screen is located.

21. The method of claim 20, wherein: The first sound zone is associated with the first display screen.

22. The method of claim 19, wherein: The second audio input device is a Bluetooth headset connected to the second display screen or an audio input device associated with the second audio zone; Wherein, the second sound zone is associated with at least one audio input device in the spatial area where the second display screen is located.

23. The method of claim 22, wherein: The second sound zone is associated with the second display screen.

24. The method of claim 19, wherein: The method further comprises: In response to the first operation, the audio received by the second audio input device is sent to the remote device.

25. The method according to any one of claims 13 to 16, characterized in that: The method further comprises: In response to the first operation, receiving audio from the remote device, and / or receiving audio using a first audio input device; wherein the first audio input device is associated with the first display screen; The audio from the remote device and / or the audio received by the first audio input device is played by a second audio output device; wherein the second audio output device is associated with the second display screen.

26. The method of claim 25, wherein: The second audio output device is: A Bluetooth headset connected to the second display screen; or A set audio output device in the spatial area where the second display screen is located; or An audio output device associated with a third sound zone; wherein the third sound zone is associated with at least one audio output device in the spatial area where the second display screen is located.

27. The method of claim 26, wherein: The third sound zone is associated with the second display screen.

28. The method of claim 25, wherein: The first audio input device is a Bluetooth headset connected to the first display screen or an audio input device associated with the fourth audio zone; The fourth sound zone is associated with at least one audio input device in the spatial area where the first display screen is located.

29. The method of claim 28, wherein: The fourth sound zone is associated with the first display screen.

30. The method of claim 25, wherein: The method further comprises: In response to the first operation, the audio received by using the first audio input device is sent to the remote device.

31. The method according to claim 20 or 26, characterized in that The at least one audio output device has the same device type and / or location type.

32. The method of claim 22 or 28, wherein: The at least one audio input device has the same device type and / or location type.

33. The method according to any one of claims 13 to 16, characterized in that: The first display screen and the second display screen are different display screens in the cockpit space.

34. An electronic device, characterized in that: The electronic device includes a display screen, a memory and one or more processors; The memory is used to store computer program code, which includes computer instructions; when the computer instructions are executed by the one or more processors, the electronic device executes the method as claimed in any one of claims 1 to 12, or executes the method as claimed in any one of claims 13 to 33.

35. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program runs on a computer, the computer is enabled to execute the method according to any one of claims 1 to 12, or to execute the method according to any one of claims 13 to 33.

Images