Cross-device camera cooperation method and device

Abstract

The embodiment of the invention provides a cross-device camera collaboration method and device, relates to the field of terminals, and can ensure that electronic equipment can call more types of cameras in a cross-device manner, so that the cameras called by the electronic equipment better meet user requirements. The method is applied to a first electronic device, the first electronic device and a second electronic device are in a multi-screen cooperation state, and the method comprises the following steps: in response to an operation of triggering a video call by a user, collecting first video data based on a first camera of the first electronic device; acquiring camera information of second electronic equipment; wherein the camera information comprises the number of cameras of the second electronic equipment, identifiers of the cameras and camera attributes, the camera attributes comprise orientation attributes, and the orientation attributes comprise front attributes or rear attributes; determining a second camera having a mapping relationship with the first camera according to the camera information; and acquiring second video data based on a second camera of the second electronic equipment.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of terminals, and in particular, to a method and apparatus for cross-device camera collaboration. Background Art

[0002] The multi-screen collaboration technology is a distributed technology that can achieve cross-device collaboration. Resource sharing and collaborative operations can be realized between different devices. For example, after connecting two electronic devices (such as a mobile phone and a tablet computer), the tablet computer can display the desktop interface of the mobile phone, and the user can operate on the desktop interface of the mobile phone displayed on the tablet computer to make the mobile phone execute corresponding functions. For example, in response to the user's operation of triggering the video call function of the instant messaging software on the desktop interface of the mobile phone displayed on the tablet computer, the mobile phone can initiate a video call.

[0003] In the scenario of multi-screen collaboration, an electronic device can call a camera across devices, that is, start a virtual camera service (virtualized camera service). For example, when a mobile phone makes a video call, in addition to using the camera configured by itself to collect video frames, the mobile phone can also switch to collect video frames through the camera of the tablet computer.

[0004] Currently, an electronic device (such as a mobile phone) can virtualize the use of the default camera (such as the front camera of a tablet computer) across devices, which does not meet the user's needs in actual scenarios (for example, the user hopes to use the rear camera of the tablet computer, while the front camera of the tablet computer is defaultly turned on). Summary of the Invention

[0005] The embodiments of the present application provide a method and apparatus for cross-device camera collaboration, which can ensure that an electronic device can call more types of cameras across devices, making the cameras called by the electronic device more in line with user needs.

[0006] To achieve the above object, the embodiments of the present application adopt the following technical solutions:

[0007] In a first aspect, a method for camera collaboration across devices is provided, which is applied to a first electronic device. The first electronic device and a second electronic device are in a multi-screen collaboration state. The method includes: in response to a user's operation of triggering a video call, the first electronic device collects first video data based on a first camera of the first electronic device and displays a first video window according to the first video data; the first electronic device obtains camera information of the second electronic device; wherein, the camera information includes the number of cameras of the second electronic device, the identifiers of the cameras, and camera attributes, and the camera attributes include an orientation attribute, and the orientation attribute includes a front-facing attribute or a rear-facing attribute; the first electronic device determines a second camera having a mapping relationship with the first camera according to the camera information; the second camera is a camera of the second electronic device; the first electronic device sends an indication message to the second electronic device, and the indication message is used to indicate the second camera; the first electronic device receives second video data from the second electronic device, and the second video data is from the second camera; the first electronic device displays a second video window according to the second video data.

[0008] Based on the method provided in the embodiments of the present application, the first electronic device and the second electronic device are in a multi-screen collaboration state, and in a scenario where the user triggers a video call on the first electronic device, the first electronic device can first collect first video data based on the first camera of the first electronic device, then obtain the camera information of the second electronic device, and determine a second camera having a mapping relationship with the first camera according to the camera information of the second electronic device. The second camera is a camera of the second electronic device. Then, it can be instructed that the second electronic device collects a video stream (second video data) based on the second camera, and obtain the second video data from the second electronic device to display a second video window according to the second video data. That is, the first video data collected by the first camera is replaced with the second video data collected by the second camera. In this way, in a virtualized camera scenario (i.e., a scenario where the first electronic device (e.g., a mobile phone) cross-device calls the camera of the second electronic device (e.g., a tablet computer)), the mobile phone can consider information such as the number and orientation attribute of the tablet computer's camera when cross-device calling the camera, so that the mobile phone and the tablet computer can perform camera collaboration more accurately.

[0009] In a possible implementation, the first electronic device determines a second camera having a mapping relationship with the first camera according to camera information, including: when the number of cameras of the second electronic device is 2, determining that the second camera having a mapping relationship with the first camera is the camera among the 2 cameras of the second electronic device that has the same orientation attribute as the first camera. That is, when the number of cameras of the second electronic device (for example, a tablet computer) is 2, the second camera can be determined according to the orientation attribute, and the orientation attribute of the second camera is the same as that of the first camera. In this way, it can be ensured that when the first electronic device (for example, a mobile phone) calls a camera across devices, it can call a virtual camera with the same orientation attribute as the local camera (the first camera), which better meets the user's needs. For example, when a mobile phone makes a video call, if the user uses the local front camera of the mobile phone to capture video frames, when switching to capturing video frames through the camera of the tablet computer, the front camera of the tablet computer can be used to capture video frames, which can make the switching of the camera more in line with the user's needs (the user's need to use the front camera).

[0010] In a possible implementation, the first electronic device determines a second camera having a mapping relationship with the first camera according to camera information, including: when the number of cameras of the second electronic device is 1, determining that the first camera has a mapping relationship with the 1 camera of the second electronic device. That is, when the second electronic device only includes 1 camera, the local camera has a mapping relationship with the only 1 camera of the tablet computer, and the camera attributes of the tablet computer do not need to be considered. In this way, it can be ensured that the first electronic device (for example, a mobile phone) can call the only 1 camera of the second electronic device (for example, a tablet computer) across devices, avoiding camera mapping failure and resulting in the failure of calling a camera across devices.

[0011] In a possible implementation, the camera attribute further includes a label attribute, and the label attribute includes at least one of a wide-angle attribute, a main camera attribute, a telephoto attribute, or a macro attribute.

[0012] In a possible implementation, the first electronic device determines a second camera having a mapping relationship with the first camera based on camera information, including: when the number of cameras of the second electronic device is greater than 2, determining that the second camera having a mapping relationship with the first camera is the camera among the multiple cameras of the second electronic device that has the same label attribute as the first camera. In this way, it can be ensured that when the first electronic device (such as a mobile phone) calls a camera across devices, it can call a virtual camera that has the same marking attribute as the local camera (the first camera), which better meets the user's needs. For example, when a mobile phone makes a video call, if the user uses the local wide-angle camera of the mobile phone to capture video frames, when switching to capturing video frames through the camera of a tablet computer, the wide-angle camera of the tablet computer can be used to capture video frames, which can make the camera switching more in line with the user's needs (the user's need to use a wide-angle camera).

[0013] In a possible implementation, the method further includes: if there is no camera among the multiple cameras of the second electronic device that has the same label attribute as the first camera, determining that the second camera having a mapping relationship with the first camera is the camera among the multiple cameras of the second electronic device that has the same orientation attribute as the first camera. In this way, in the case where the second camera having a mapping relationship with the first camera cannot be determined based on the marking attribute, the second camera having a mapping relationship with the first camera can be determined based on the orientation attribute. Thus, it can be ensured that when the first electronic device (such as a mobile phone) calls a camera across devices, it can call a virtual camera that has the same orientation attribute as the local camera (the first camera), which better meets the user's needs.

[0014] In a possible implementation, the method further includes: the first electronic device obtains the orientation attribute and / or label attribute of the first camera; the first electronic device determines a second camera having a mapping relationship with the first camera based on camera information, including: the first electronic device determines a second camera having a mapping relationship with the first camera based on the camera information of the second electronic device and the orientation attribute and / or label attribute of the first camera. In this way, when a mobile phone calls a camera across devices, it can consider information such as the camera information of the second electronic device and the orientation attribute and / or label attribute of the first camera, enabling the mobile phone and the tablet computer to perform camera coordination more accurately.

[0015] Second aspect, a camera collaboration method across devices is provided, which is applied to a system including a first electronic device and a second electronic device. The first electronic device and the second electronic device are in a multi-screen collaboration state. The method includes: in response to an operation of the user triggering a video call, the first electronic device collects first video data based on a first camera of the first electronic device and displays a first video window according to the first video data; the first electronic device sends a request message to the second electronic device, and the request message is used to request camera information of the second electronic device; the second electronic device receives the request message and collects camera information of the second electronic device. The camera information includes the number of cameras of the second electronic device, the identifiers of the cameras, and camera attributes. The camera attributes include an orientation attribute, and the orientation attribute includes a front-facing attribute or a rear-facing attribute; the second electronic device sends the camera information of the second electronic device to the first electronic device; the first electronic device receives the camera information of the second electronic device from the second electronic device; the first electronic device determines a second camera having a mapping relationship with the first camera according to the camera information. The second camera is a camera of the second electronic device; the first electronic device sends an indication message to the second electronic device, and the indication message is used to indicate the second camera; the second electronic device receives the indication message and collects second video data based on the second camera according to the indication message; the second electronic device sends the second video data to the first electronic device; the first electronic device receives the second video data from the second electronic device; the first electronic device displays a second video window according to the second video data.

[0016] Based on the method provided in the embodiments of the present application, the first electronic device and the second electronic device are in a multi-screen collaboration state, and in the scenario where the user triggers a video call on the first electronic device, the first electronic device can first collect first video data based on the first camera of the first electronic device, then obtain the camera information of the second electronic device, and determine a second camera having a mapping relationship with the first camera according to the camera information of the second electronic device. The second camera is a camera of the second electronic device. Then, the second electronic device can be instructed to collect a video stream (second video data) based on the second camera, and the second video data is obtained from the second electronic device to display a second video window according to the second video data. That is, the first video data collected by the first camera is replaced with the second video data collected by the second camera. In this way, in the virtualized camera scenario (i.e., the scenario where the first electronic device (such as a mobile phone) calls the camera of the second electronic device (such as a tablet computer) across devices), the mobile phone can consider information such as the number and orientation attributes of the cameras of the tablet computer when calling the camera across devices, so that the mobile phone and the tablet computer can perform camera collaboration more accurately.

[0017] In a possible implementation, the first electronic device determines a second camera that has a mapping relationship with the first camera according to the camera information, including: when the number of cameras of the second electronic device is 2, determining that the second camera that has a mapping relationship with the first camera is the camera among the 2 cameras of the second electronic device that has the same orientation attribute as the first camera.

[0018] In a possible implementation, the first electronic device determines a second camera that has a mapping relationship with the first camera according to the camera information, including: when the number of cameras of the second electronic device is 1, determining that the first camera has a mapping relationship with the 1 camera of the second electronic device.

[0019] In a possible implementation, the camera attribute further includes a label attribute, and the label attribute includes at least one of a wide-angle attribute, a main camera attribute, a telephoto attribute, or a macro attribute.

[0020] In a possible implementation, the first electronic device determines a second camera that has a mapping relationship with the first camera according to the camera information, including: when the number of cameras of the second electronic device is greater than 2, determining that the second camera that has a mapping relationship with the first camera is the camera among the multiple cameras of the second electronic device that has the same label attribute as the first camera.

[0021] In a possible implementation, the method further includes: if there is no camera among the multiple cameras of the second electronic device that has the same label attribute as the first camera, determining that the second camera that has a mapping relationship with the first camera is the camera among the multiple cameras of the second electronic device that has the same orientation attribute as the first camera.

[0022] In a possible implementation, the method further includes: the first electronic device obtains the orientation attribute and / or label attribute of the first camera; the first electronic device determines a second camera that has a mapping relationship with the first camera according to the camera information, including: the first electronic device determines a second camera that has a mapping relationship with the first camera according to the camera information of the second electronic device and the orientation attribute and / or label attribute of the first camera.

[0023] In a third aspect, a system for cross-device camera collaboration is provided. The system includes a system of a first electronic device and a second electronic device. The first electronic device and the second electronic device are in a multi-screen collaboration state, where: The first electronic device is configured to, in response to a user's operation of triggering a video call, collect first video data based on a first camera of the first electronic device, and display a first video window according to the first video data; The first electronic device is further configured to send a request message to the second electronic device, where the request message is used to request the camera information of the second electronic device; The second electronic device is configured to receive the request message, collect the camera information of the second electronic device, where the camera information includes the number of cameras of the second electronic device, the identifiers of the cameras, and the camera attributes, and the camera attributes include an orientation attribute, and the orientation attribute includes a front-facing attribute or a rear-facing attribute; The second electronic device is further configured to send the camera information of the second electronic device to the first electronic device; The first electronic device is further configured to receive the camera information of the second electronic device from the second electronic device; The first electronic device is further configured to determine a second camera having a mapping relationship with the first camera according to the camera information, where the second camera is a camera of the second electronic device; The first electronic device is further configured to send an indication message to the second electronic device, where the indication message is used to indicate the second camera; The second electronic device is further configured to receive the indication message, and collect second video data based on the second camera according to the indication message; The second electronic device is further configured to send the second video data to the first electronic device; The first electronic device is further configured to receive the second video data from the second electronic device; The first electronic device is further configured to display a second video window according to the second video data.

[0024] Based on the method provided in the embodiments of the present application, when the first electronic device and the second electronic device are in a multi-screen collaboration state and the user triggers a video call on the first electronic device, the first electronic device can first collect first video data based on the first camera of the first electronic device, then obtain the camera information of the second electronic device, and determine a second camera having a mapping relationship with the first camera according to the camera information of the second electronic device, where the second camera is a camera of the second electronic device. Then, it can instruct the second electronic device to collect a video stream (second video data) based on the second camera, obtain the second video data from the second electronic device, and display a second video window according to the second video data. That is, replace the first video data collected by the first camera with the second video data collected by the second camera. In this way, in a virtualized camera scenario (i.e., a scenario where the first electronic device (e.g., a mobile phone) cross-device calls the camera of the second electronic device (e.g., a tablet computer)), the mobile phone can consider information such as the number and orientation attribute of the tablet computer's camera when cross-device calling the camera, so that the mobile phone and the tablet computer can perform camera collaboration more accurately.

[0025] Fourth aspect, the present application provides a chip system, which includes one or more interface circuits and one or more processors. The interface circuits and the processors are interconnected by lines. The above chip system can be applied to an electronic device including a communication module and a memory. The interface circuit is used to receive a signal from the memory of the electronic device and send the received signal to the processor, and the signal includes computer instructions stored in the memory. When the processor executes the computer instructions, the electronic device can execute the method described in the first aspect and any possible design manner thereof.

[0026] Fifth aspect, the present application provides a computer-readable storage medium, which includes computer instructions. When the computer instructions run on an electronic device (such as a mobile phone), the electronic device is caused to execute the method described in the first aspect and any possible design manner thereof.

[0027] Sixth aspect, an embodiment of the present application provides a cross-device camera collaboration device, including a processor, the processor is coupled to a memory, and the memory stores program instructions. When the program instructions stored in the memory are executed by the processor, the device implements the method described in the first aspect and any possible design manner thereof. The device can be an electronic device; or can be a component of an electronic device, such as a chip.

[0028] Seventh aspect, an embodiment of the present application provides a cross-device camera collaboration device. The device can be divided into different logical units or modules according to functions, and each unit or module executes different functions to cause the device to execute the method described in the first aspect and any possible design manner thereof.

[0029] Eighth aspect, the present application provides a computer program product. When the computer program product runs on a computer, the computer is caused to execute the method described in the first aspect and any possible design manner thereof.

[0030] It can be understood that the beneficial effects that can be achieved by the chip system described in the fourth aspect, the computer-readable storage medium described in the fifth aspect, the devices described in the sixth and seventh aspects, and the computer program product described in the eighth aspect can refer to the beneficial effects in the first to third aspects and any possible design manner thereof, which will not be elaborated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 is a schematic diagram of a system architecture provided by an embodiment of the present application;

[0032] Figure 2 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application;

[0033] Figure 3 Schematic diagram of a software architecture for invoking an electronic device provided by an embodiment of the present application;

[0034] Figure 4 Schematic diagram of a software architecture for an electronic device to be invoked provided by an embodiment of the present application;

[0035] Figure 5A Schematic diagram of the camera distribution of an electronic device provided by an embodiment of the present application;

[0036] Figure 5B Another schematic diagram of the camera distribution of an electronic device provided by an embodiment of the present application;

[0037] Figure 6 Schematic diagram of the display of a tablet computer provided by an embodiment of the present application;

[0038] Figure 7 Schematic diagram of the display of a mobile phone provided by an embodiment of the present application;

[0039] Figure 8 Schematic diagram of multi-screen collaboration provided by an embodiment of the present application;

[0040] Figure 9 Another schematic diagram of multi-screen collaboration provided by an embodiment of the present application;

[0041] Figure 10 Another schematic diagram of multi-screen collaboration provided by an embodiment of the present application;

[0042] Figure 11 Schematic diagram of module interaction provided by an embodiment of the present application;

[0043] Figure 12 Another schematic diagram of the display of a mobile phone provided by an embodiment of the present application;

[0044] Figure 13 Schematic diagram of the structure of a chip system provided by an embodiment of the present application. Detailed implementation manners

[0045] For the sake of clear and concise description of the following embodiments, a brief introduction to the related technologies is given first:

[0046] In the scenario of multi-screen collaboration, an electronic device can invoke a camera across devices, that is, start a virtual camera service (virtualized camera service). For example, when a mobile phone makes a video call, in addition to using the camera configured on itself to collect video frames, the mobile phone can also switch to collect video frames through the camera of a tablet computer.

[0047] However, the current virtualized camera solution has the following problems:

[0048] 1), In some solutions, an electronic device (e.g., a mobile phone) can virtualize and use a default camera across devices (e.g., the front camera of a tablet computer), which does not meet the user needs in actual scenarios well (e.g., the user hopes to use the rear camera of the tablet computer, while the front camera of the tablet computer is defaultly turned on).

[0049] 2), In other solutions, an electronic device can call a camera across devices according to the identifier of the camera. For example, assume that when a mobile phone makes a video call, it uses the camera with the identifier 0 locally to collect video frames. When the mobile phone switches the camera, it will call the camera with the identifier 0 on the peer device (e.g., a tablet computer). If there is no camera with the identifier 0 on the peer device, the call to the camera will fail.

[0050] The embodiments of the present application provide a method for camera collaboration across devices, which can avoid the failure of calling a camera across devices, and can ensure that an electronic device can call more types of cameras across devices, making the cameras called by the electronic device more in line with user needs.

[0051] Figure 1 Exemplarily, a schematic diagram of an application scenario applicable to the embodiments of the present application is shown. As Figure 1 shown, this application scenario includes: an electronic device 001 and an electronic device 002. The electronic device 001 and the electronic device 002 can be different types of electronic devices. For example, the electronic device 001 can be a mobile phone, and the electronic device 002 can be a tablet computer.

[0052] Figure 1 In this, the electronic device 001 and the electronic device 002 can be interconnected through a wireless communication network. This wireless communication network can be a local area network. When this communication network is a local area network, exemplarily, this communication network can be a Wi-Fi hotspot network, a Wi-Fi P2P network, a Bluetooth network, a zigbee network, or a NFC network, etc., which are short-range communication networks. In Figure 1 the shown scenario, different electronic devices can send data through the communication network, such as sending pictures, texts, videos, or the retrieval results of objects such as pictures, texts, or videos by the electronic device.

[0053] It should be noted that more electronic devices can also be included in the above system, such as a laptop computer, a smart TV, a smart watch, etc. The embodiments of the present application do not limit this.

[0054] Next, taking the hardware structure of an electronic device (e.g., the electronic device 001 or the electronic device 002) as the electronic device 100 as an example for description. Figure 2The schematic diagram of the hardware structure of the electronic device 100 is shown. The electronic device 100 can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device, and / or a smart city device. The specific type of the electronic device is not particularly limited in the embodiments of the present application.

[0055] Referring to Figure 2 , the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management process 140, a power management process 141, a battery 142, an antenna 1, an antenna 2, a mobile communication process 150, a wireless communication process 160, an audio process 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor process 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor process 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0056] It can be understood that the structure schematically shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0057] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0058] Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0059] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from this memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0060] In some embodiments, the processor 110 may include one or more interfaces, such as an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0061] The wireless communication function of the electronic device 100 can be implemented by antenna 1, antenna 2, mobile communication process 150, wireless communication process 160, a modulation and demodulation processor, a baseband processor, etc.

[0062] Antenna 1 and antenna 2 are used for transmitting and receiving electromagnetic wave signals.

[0063] The mobile communication process 150 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication process 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication process 150 can receive electromagnetic waves by antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication process 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through antenna 1 for radiation.

[0064] The modulation and demodulation processor can include a modulator and a demodulator. Among them, the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to speaker 170A, receiver 170B, etc.), or displays an image or video through the display screen 194.

[0065] The wireless communication process 160 can provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication process 160 can be one or more devices integrating at least one communication processing process. The wireless communication process 160 receives electromagnetic waves through antenna 2, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication process 160 can also receive the signal to be transmitted from the processor 110, frequency-modulate and amplify it, and convert it into electromagnetic waves through antenna 2 for radiation.

[0066] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication process 150, and antenna 2 is coupled to wireless communication process 160, such that electronic device 100 can communicate with the network and other devices through wireless communication technologies.

[0067] Electronic device 100 can implement a shooting function through an ISP, camera 193, video codec, GPU, display screen 194, application processor, and the like.

[0068] The ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image through algorithms. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be provided in camera 193.

[0069] Camera 193 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV, and other formats. In some embodiments, electronic device 100 may include one or N cameras 193, where N is an integer greater than 1.

[0070] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals.

[0071] The video codec is used to compress or decompress digital videos. Electronic device 100 can support one or more video codecs. In this way, electronic device 100 can play or record videos in multiple coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

[0072] The external memory interface 120 can be used to connect to an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and videos are saved in the external memory card.

[0073] The internal memory 121 can be used to store computer-executable program codes, and the computer-executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the image playback function, etc.). The data storage area can store the data created during the use of the electronic device 100 (such as audio data, etc.).

[0074] The methods in the following embodiments can all be implemented in the electronic device 100 with the above hardware structure.

[0075] The software system of the above electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of the present invention, the Android system with a layered architecture is taken as an example to exemplarily illustrate the software structure of the electronic device 100.

[0076] The software architectures of the electronic device 001 and the electronic device 002 will be described below. The software architectures of the electronic device 001 and the electronic device 002 are different. In a multi-screen collaboration scenario, the electronic device 001 can be used as a calling device (also referred to as a master device), and the electronic device 002 can be used as a called device (also referred to as a controlled device). Taking the electronic device 001 as a mobile phone and the electronic device 002 as a tablet computer as an example, after the mobile phone and the tablet computer establish a collaborative connection, the tablet computer can display the desktop interface of the mobile phone, and the user can operate on the desktop interface of the mobile phone displayed on the tablet computer to make the mobile phone execute corresponding functions.

[0077] In addition, in a scenario of sharing a camera, after the mobile phone and the tablet computer establish a collaborative connection, the tablet computer can call the camera of the mobile phone. At this time, the tablet computer is the calling device, and the mobile phone can be the called device.

[0078] Figure 3 It is the software architecture of a called device / controlled device (for example, the electronic device 001) provided by the embodiments of the present application. See Figure 3The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided from top to bottom into an application layer, an application framework layer, a system layer, an extension layer, and a kernel layer.

[0079] The application layer can include a series of application packages. Figure 3 As shown, the application package may include but is not limited to instant messaging, multi-screen collaboration, shared camera, camera, Bluetooth, gallery, call, map and other applications. Among them, the instant messaging application can be used to realize video calls; the multi-screen collaboration application can be used to enable the multi-screen collaboration function. The shared camera application can be used to realize the function of calling the camera across devices.

[0080] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 3 As shown, the application framework layer may include a service discovery process, a collaborative assistant process, and an interconnected service process.

[0081] The service discovery process is used to listen for connection instructions for collaboration after Bluetooth or NFC is turned on, and notify the collaboration assistant process after listening to the connection instruction. The collaboration assistant process is used to establish a collaborative connection by exchanging information with the collaboration assistant processes in other electronic devices after receiving the notification from the service discovery process.

[0082] As an example of the present application, during a video call, if it is in a collaborative scenario, the interconnection service process is used to enable the virtualized camera service to open up the data transmission channel between the interconnection service process and the virtual camera process. In addition, after the virtualized camera service is successfully enabled, the interconnection service process is also used to send a video stream to the calling device (master control device).

[0083] In one example, the interconnection service process includes a data processing module, a transmission channel module, a flow control module, and a capability acquisition module. The data processing module can be used to process video frames according to the needs of the underlying layer, such as format conversion, etc. The transmission channel module is used to configure the transmission channel; the flow control module is used to cache the video stream; the capability acquisition module is used to collect the camera capabilities (i.e., camera information) of the local electronic device and send the camera capabilities of the local electronic device to the calling device (master control device).

[0084] As an example of the present application, the system layer includes an audio framework, a multimedia framework, and the like.

[0085] Among them, the audio framework can support multiple common audio coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The multimedia framework can support multiple common video formats and static image files, etc. The video formats supported by the multimedia framework can include, for example: AVI, WMV, FLV, Blu-ray, etc.

[0086] As an example of this application, the extended layer can include a camera process and a virtual camera process, and the camera process and the virtual camera process are located in the hardware abstract layer (HAL). Among them, the camera process is used to turn on the local camera according to the service requirements of the application layer and collect video frames through the local camera. In one embodiment, in a collaborative scenario, the camera process is used to send the video frames collected by the local camera to the interconnected service process according to the service requirements of the virtual camera process, so that the interconnected service process can send the video frames collected by the local camera to the calling device (master device).

[0087] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, a sensor driver, etc. Among them, the camera driver is used to drive the camera hardware so that the camera starts. In this way, the electronic device can collect images through the camera.

[0088] Figure 4 This is the software architecture of a calling device / master device (for example, electronic device 002) provided by an embodiment of this application. Refer to Figure 4 , the layered architecture divides software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into an application layer, an application framework layer, a system layer, an extended layer, and a kernel layer from top to bottom.

[0089] The application layer can include a series of application packages. As Figure 4 shown, the application packages can include, but are not limited to, applications such as instant messaging, multi-screen collaboration, shared camera, camera, Bluetooth, gallery, call, map, etc. Among them, the instant messaging application can be used to implement video calls; the multi-screen collaboration application can be used to enable the multi-screen collaboration function. The shared camera application can be used to implement the function of cross-device camera call.

[0090] The application framework layer provides application programming interfaces and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions. As Figure 4 shown, the application framework layer can include a service discovery process, a collaboration assistant process, and an interconnected service process.

[0091] The service discovery process is used to listen for connection instructions for collaboration after Bluetooth or NFC is turned on, and notify the collaboration assistant process after listening to the connection instruction. The collaboration assistant process is used to establish a collaborative connection by exchanging information with the collaboration assistant processes in other electronic devices after receiving the notification from the service discovery process.

[0092] As an example of this application, during a video call, if it is in a collaborative scenario, the interconnection service process is used to enable the virtualized camera service to open up the data transmission channel between the interconnection service process, the virtual camera adaptation process, and the virtual camera process. In addition, after the virtualized camera service is successfully enabled, the interconnection service process is also used to receive and cache the video stream sent by the called device (controlled device), and provide the corresponding camera service to the bottom layer according to the request of the bottom layer.

[0093] In one example, the interconnection service process includes a data processing module, a transmission channel module, a flow control module, and a capability summary module. The data processing module can be used to process video frames according to the needs of the underlying layer, such as format conversion; the transmission channel module is used to configure the transmission channel; the flow control module is used to cache the video stream; and the capability summary module can be used to save the camera capabilities of the controlled device.

[0094] As an example of the present application, the system layer includes a virtual camera adaptation process, a multimedia framework, etc.

[0095] The video formats supported by the multimedia framework may include, for example, AVI, WMV, FLV, Blu-ray, etc.

[0096] The virtual camera adaptation process can be used to perform format conversion on data transmitted between the interconnection service process and the extension layer.

[0097] In one example, the virtual camera adaptation process includes a first service, a second service, a converter, a camera relationship mapping module, and a camera switching management module.

[0098] The first service is used to provide services to the upper layer and supports the first data format. For example, the first service is a CHANNEL service. If the interconnection service process needs to send data to the underlying virtual camera process, the data can be converted according to the first data format first, and then the converted data is sent to the virtual camera adapter process through the first service, so that the virtual camera adapter process sends the data to the virtual camera process.

[0099] The second service is used to provide services downward and supports the second data format. For example, the second service is the TRANSLATOR service. If the virtual camera process needs to send data to the upper-layer interconnection service process, it can first convert the data according to the second data format, and then send the converted data to the virtual camera adaptation process through the second service, so that the virtual camera adaptation process can send it to the interconnection service process.

[0100] The converter is used to convert the data format. For example, convert the data at the lower layer into a data format that can be recognized and processed by the upper layer, or convert the data at the upper layer into a data format that can be recognized and processed by the lower layer.

[0101] Among them, the converter may include a camera mapping management module. The camera mapping management module is used to map the camera (or camera) of the local electronic device to the camera of the controlled device. For example, when it is determined according to the collected camera capability information (camera information) that both the local electronic device and the controlled device include a front camera and a rear camera, the front camera of the local electronic device is corresponded to the front camera of the controlled device, and the rear camera of the local electronic device is corresponded to the rear camera of the controlled device.

[0102] As an example of this application, the extended layer mainly includes a camera process and a virtual camera process, and the camera process and the virtual camera process are located in the HAL layer. Among them, the camera process is used to turn on the local camera according to the service requirements of the application layer and collect video frames through the local camera. In one embodiment, in a collaborative scenario, the camera process requests to obtain the video stream collected by the controlled device through the virtual camera process. Correspondingly, the virtual camera process obtains the video frames collected by the controlled device from the interconnection service process according to the request of the camera process, and sends the video frames collected by the controlled device to the camera process to replace the local video stream, so as to realize camera switching.

[0103] The kernel layer is the layer between the hardware and the software. The kernel layer at least includes a display driver, a camera driver, an audio driver, a sensor driver, etc. Among them, the camera driver is used to drive the camera hardware so that the camera starts, so that the electronic device can collect images through the camera.

[0104] The following combines Figure 5A - Figure 5B to describe the camera distribution of various types of electronic devices (such as mobile phones, tablet computers, laptop computers, foldable mobile phones).

[0105] Such as Figure 5AAs shown in (a) of [description], the tablet computer may include two cameras, namely a front camera and a rear camera. Exemplarily, the corresponding IDs of the front camera and the rear camera of the tablet computer are 0 (which may also be Camera0) and 1 (which may also be Camera 1) respectively. As Figure 5A As shown in (b) of [description], the mobile phone may include four cameras, namely a front camera, a rear telephoto camera, a rear wide-angle camera, and a rear main camera. Exemplarily, the corresponding identifiers (identifiers, IDs) of the front camera, the rear telephoto camera, the rear wide-angle camera, and the rear main camera of the mobile phone are 1, 0, 6, and 7 respectively. As Figure 5A As shown in (c) of [description], the laptop may include one camera, for example, it may be a front camera. Exemplarily, the ID corresponding to the front camera of the laptop is 0. As Figure 5B As shown in (a) of [description], the foldable mobile phone may include a front camera on the outer screen (the third screen), a rear telephoto camera, a rear wide-angle camera, and a rear main camera. As Figure 5B As shown in (b) of [description], the foldable mobile phone may also include a front camera on the inner screen. Exemplarily, the corresponding IDs of the front camera on the inner screen, the rear main camera, the rear telephoto camera, the rear wide-angle camera, and the front camera on the outer screen of the foldable mobile phone are 1, 0, 9, 8, and 13 respectively.

[0106] Next, the technical solutions in the embodiments of the present application will be described with reference to the accompanying drawings in the embodiments of the present application. Among them, in the description of the present application, unless otherwise specified, "at least one" means one or more, and "a plurality" means two or more than two. In addition, in order to facilitate a clear description of the technical solutions in the embodiments of the present application, in the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same items or similar items with basically the same functions and roles. Those skilled in the art can understand that the terms "first" and "second" do not limit the quantity and execution order, and the terms "first" and "second" do not necessarily limit to be different.

[0107] For the sake of easy understanding, several possible connection methods for multi-screen collaboration will be introduced below by taking the collaboration between a mobile phone and a tablet computer as an example.

[0108] 1. Establish a connection via Bluetooth.

[0109] In one embodiment, when the user wants to work collaboratively with a mobile phone and a tablet computer, the Bluetooth and Wi-Fi in both the mobile phone and the tablet computer can be turned on. In addition, on the mobile phone, the user can manually turn on the multi-screen collaboration function. For example, the user can find the switch of "Multi-device Collaboration" through the path of "Settings" - "More Connections" - "Multi-device Collaboration", and set this switch to the on state, thus turning on the multi-screen collaboration function of the mobile phone. Optionally, the mobile phone and the tablet computer can be logged in with the same account (for example, a Honor account).

[0110] As shown in Figure 6 (a) of, the user slides down the notification panel from the status bar of the tablet computer, and the notification panel includes a "Multi-screen Collaboration" option 31. The user can click on the "Multi-screen Collaboration" option 31. In response to the user's trigger operation on the "Multi-screen Collaboration" option 31, the tablet computer displays a first prompt window, and the first prompt window includes first operation prompt information for instructing the user on how to operate. Exemplarily, as shown in Figure 6 (b) of, the first operation prompt information includes the prompt content of "1. Turn on the Bluetooth of your mobile phone and bring it close to this device. After finding this device, click 'Connect'. 2. After connecting, you can operate the mobile phone on the tablet computer to achieve data sharing between devices." In this way, the user can operate according to the first operation prompt information in the first prompt window. For example, bring the mobile phone close to the tablet computer.

[0111] In one example, during the process of the mobile phone approaching the tablet computer, when the mobile phone discovers the tablet computer, the mobile phone displays a second prompt window, as shown in Figure 7 (a) of, the second prompt window includes a "Connect" option 41 and a "Cancel" option 42. In response to the user's trigger operation on the "Connect" option 41, the mobile phone establishes a connection with the tablet computer via Bluetooth. In another example, during the process of the mobile phone approaching the tablet computer, when the mobile phone discovers the tablet computer, it can also not display the second prompt window, but automatically establish a connection with the tablet computer via Bluetooth.

[0112] By way of example and not limitation, during the process of the mobile phone establishing a connection with the tablet computer via Bluetooth, in order to display the progress of establishing the connection, the mobile phone can also display a third prompt window for indicating that it is connecting. For example, as shown in Figure 7 (b) of, the third prompt window can be window 43. Optionally, window 43 includes a "Cancel" option, so that the user can cancel the connection during the process of establishing the connection if needed.

[0113] 2. Establish a connection by scanning a code.

[0114] On the tablet computer side, the user can operate on the tablet computer according to the path of "My Phone" - "Connect Immediately" - "Scan the QR Code to Connect". In response to the user's operation, the tablet computer displays a QR code for establishing a connection. Optionally, the tablet computer can also display a second operation prompt message for prompting the user on how to operate. For example, the second operation prompt message is "Scan the QR code to connect using the mobile phone browser".

[0115] On the mobile phone side, the user can enter an interface including the "Scan" option in the browser (or Smart Vision). In response to the user's triggering operation on the "Scan" option, the mobile phone activates the camera, so that the user can aim the camera at the QR code displayed on the tablet computer side for scanning.

[0116] In one example, after the mobile phone successfully scans the QR code, it sends a request to establish a connection to the tablet computer. After receiving the request from the mobile phone, the tablet computer can display a prompt message. For example, the prompt message is "Device xx requests to establish a connection with this end. Do you agree to establish a connection?". In addition, the fourth prompt window can also include an "Agree" option and a "Disagree" option. In response to the user's triggering operation on the "Agree" option, the tablet computer establishes a connection with the mobile phone.

[0117] It should be noted that the above is only an example of opening the QR code through the path of "My Phone" - "Connect Immediately" - "Scan the QR Code to Connect" on the tablet computer side. In another embodiment, the QR code can also be opened through other paths. Exemplarily, please refer to Figure 6 Figure (b) therein. In addition to the first operation prompt message, the first prompt window also includes a second operation prompt message, which is "Can't find this device? You can also scan the QR code to connect", and the four words "Scan the QR code to connect" are set to be triggerable. The user can click on the "Scan the QR code to connect" content in the first prompt window. In response to the user's triggering operation on "Scan the QR code to connect", the interface of the tablet computer can display a QR code. In this way, the user can scan the QR code on the tablet computer with the mobile phone, so as to establish a connection by scanning the code.

[0118] 3. Establish a connection by tapping.

[0119] The user can turn on the NFC and multi-screen collaboration functions on the mobile phone and the tablet computer respectively. Then, the user touches the NFC area on the back of the mobile phone (around the camera on the back of the mobile phone) to the NFC area of the keyboard. In response to this operation by the user, a connection is established between the mobile phone and the tablet computer through NFC. Optionally, before establishing a connection through NFC, the user can also be prompted on the tablet computer and the mobile phone respectively whether they agree to establish a connection. After the user agrees to establish a connection, the mobile phone and the tablet computer perform the operation of establishing a connection. In one example, when the mobile phone is connected to the tablet computer, the mobile phone can also prompt the user by vibrating or ringing.

[0120] It should be noted that the above several possible connection methods are described by taking the wireless implementation as an example. In another embodiment, screen mirroring can also be performed by a wired method. For example, screen mirroring can be achieved through a connection line of Type-C to high definition multimedia interface (HDMI). The embodiments of the present application do not limit this.

[0121] After the mobile phone is successfully connected to the tablet computer, as Figure 8 shown, the window of the mobile phone can be mirror-displayed on the tablet computer. In this way, the user can operate within this window according to needs.

[0122] In one example, when the user wants to make a video call through an instant messaging software, the user can click the icon of instant messaging software A in this window of the tablet computer to open the instant messaging software, and then click the "Video Call" option in the instant messaging software. In response to the user's triggering operation on the "Video Call" option, the tablet computer sends a video call control instruction to the mobile phone. After receiving the video call control instruction, the mobile phone initiates a video call request to make a video call with other users. Please refer to Figure 9 , during this process, the screens of the window of the mobile phone and the tablet computer are synchronously displayed.

[0123] In one embodiment, please refer to Figure 10 , in response to the user's operation of pulling down the notification bar of the tablet computer, the tablet computer can display a notification interface 1201. The notification interface 1201 may include a multi-screen collaboration notification 1202, and it is displayed in the multi-screen collaboration notification 1202 that it is connected (collaborated) to the mobile phone. The multi-screen collaboration notification 1202 may further include a disconnection button and a button for switching audio and video to the mobile phone. The user can adjust the opening and closing of the corresponding buttons according to needs. It should be understood that when the tablet computer is connected (collaborated) to the mobile phone, the camera of the tablet computer can be used by default for video picture acquisition. If the user only wants to use the camera of the mobile phone itself to acquire video pictures, the user can operate the button for switching audio and video to the mobile phone (for example, click the button for switching audio and video to the mobile phone). In this way, the video picture during the video call of the mobile phone can be acquired by the camera of the mobile phone.

[0124] Next, taking the first electronic device as a mobile phone, the second electronic device as a tablet computer, and a collaborative connection being established between the mobile phone and the tablet computer (i.e., in a multi-screen collaboration state) as an example, a cross-device camera collaboration method between the mobile phone and the tablet computer will be introduced in detail. Among them, the mobile phone can be a calling end (master control end), and the tablet computer can be a called end (controlled end). As Figure 11 shown, this method includes:

[0125] 1101. The instant messaging application of the mobile phone sends a request to open the camera to the multi-screen collaboration application of the mobile phone.

[0126] The request to open the camera may carry the ID of the local camera of the mobile phone.

[0127] When multi-screen collaboration is established between the mobile phone and the tablet computer and the user triggers a video call on the mobile phone, the instant messaging application of the mobile phone sends a request to open the camera to the multi-screen collaboration application of the mobile phone.

[0128] In some embodiments, after the multi-screen collaboration is established between the mobile phone and the tablet computer, in response to the user's operation of triggering a video call on the mobile phone, the mobile phone's instant messaging application can send a request to the mobile phone's multi-screen collaboration application to open the camera. The operation of triggering a video call may include initiating a video call or answering a video call, which is not limited in this application.

[0129] In other embodiments, when the mobile phone has initiated a video call, in response to the user triggering an operation to establish multi-screen collaboration between the mobile phone and the tablet computer, the mobile phone's instant messaging application may send a request to open the camera to the mobile phone's multi-screen collaboration application.

[0130] The multi-screen collaborative application may also be a shared camera application, which can be used to implement a function of calling a camera across devices.

[0131] It should be noted that when a multi-screen collaborative connection is established between a mobile phone and a tablet computer, and the user triggers a video call on the mobile phone, on the one hand, steps 1101 to 1110 can be executed to obtain the camera information of the tablet computer. On the other hand, steps 1111 to 1114 can be executed to obtain the camera properties of the camera currently turned on the mobile phone. Finally, the local camera (the camera of the calling electronic device (e.g., mobile phone)) and the virtual camera (i.e., the camera of the called electronic device (e.g., tablet computer)) can be mapped and bound according to the camera properties of the camera currently turned on the mobile phone and the camera information of the tablet computer, that is, step 1115 can be executed. After that, steps 1116 to 1121 can be continued.

[0132] 1102. The multi-screen collaborative application of the mobile phone sends a request to enable the virtualized camera service to the Internet service process of the mobile phone.

[0133] The interconnection service process can enable the virtualized camera service to open up a data transmission channel between the interconnection service process and the virtual camera process.

[0134] 1103. The Internet service process of the mobile phone requests the camera information of the tablet computer from the capability aggregation module of the mobile phone.

[0135] 1104. The capability summary module of the mobile phone requests camera information from the capability collection module of the tablet computer.

[0136] The capability summary module of the mobile phone can send a request message to the capability collection module of the tablet computer through its own transmission channel module. The request message is used to request the camera information of the tablet computer.

[0137] 1105. The capability collection module of the tablet computer requests camera information from the multimedia framework of the tablet computer.

[0138] The capability collection module of the tablet computer can receive a request message from the mobile phone through its own transmission channel module. The request message is used to request the camera information of the tablet computer.

[0139] 1106. The multimedia framework of the tablet computer obtains the camera information of the tablet computer.

[0140] The camera information of the tablet computer includes the identifiers and camera attributes of all available cameras of the tablet computer.

[0141] Among them, the identifier of the camera can also be called the camera number, which is used to identify different cameras. The identifiers corresponding to different cameras are different. Exemplarily, the IDs corresponding to the front camera, rear telephoto camera, rear wide-angle camera, and rear main camera of the mobile phone are 1, 0, 6, and 7 respectively.

[0142] The camera attribute can include an orientation attribute, and the orientation attribute includes a front attribute (FRONT) and a rear attribute (BACK).

[0143] Exemplarily, the tablet computer can call the first interface at the system layer to read the orientation attribute of each camera. Among them, the first interface can be, for example, CameraCharacteristics.LENS_FACING. For each camera of the tablet computer, the first interface can be called according to the identifier (ID) corresponding to the camera to read the orientation attribute of the camera. If the return value of the first interface is CameraMetadata.LENS_FACING_FRONT, it means that the camera is a front camera, and the orientation attribute of the camera can be marked as the front (FRONT) attribute; if the return value of the first interface is CameraMetadata.LENS_FACING_BACK, it means that the camera is a rear camera, and the orientation attribute of the camera can be marked as the rear (BACK) attribute.

[0144] In a possible design, the camera attribute can further include a label attribute, and the label attribute includes at least one of a wide-angle attribute, a main camera attribute, a telephoto attribute, or a macro attribute.

[0145] Exemplarily, the tablet computer can call the second interface at the system layer to read the tag attributes. Among them, the second interface can be, for example, KeyGenerator.generateCharacteristicsKey. For each camera of the tablet computer, the second interface can be called according to the identifier (ID) corresponding to the camera to read the tag attributes of the camera. If the return value (key value) of the second interface is com.hihonor.device.capabilities.mainModeSupported, it is considered that the camera is the rear main camera, and the tag attributes of the camera are marked as the main camera attribute (Main); if the return value (key value) of the second interface is com.hihonor.device.capabilities.teleSupported, it is considered that the camera is a telephoto camera, and the tag attributes of the camera are marked as the telephoto attribute (Focus); if the return value (key value) of the second interface is com.hihonor.device.capabilities.wideModeSupported, it is considered that the camera is a wide-angle camera, and the tag attributes of the camera are marked as the wide-angle attribute (Wide).

[0146] Optionally, the camera attributes can also include other attributes, such as magnification attributes, exposure attributes, etc. Among them, the magnification attributes can include, for example, high magnification attributes and low magnification attributes, etc. The exposure attributes can include, for example, high exposure rate attributes and low exposure rate attributes, etc.

[0147] Optionally, the camera information of the tablet computer can also include stream capability information. Among them, the stream capability information can include the bitstreams supported by the camera (for example, H265 / H264, etc.) and the resolutions supported by the camera (for example, 480P / 720P, etc.). Among them, all available cameras of the tablet computer can include the cameras built in the tablet computer and the cameras externally connected to the tablet computer, which are not limited in this application.

[0148] Exemplarily, assume that the tablet computer can support two cameras, including camera 1 (ID is Camera 1) and camera 2 (ID is Camera 0). The camera information of the tablet computer can be shown in Table 1:

[0149] Table 1

[0150]

[0151] Among them, the orientation attribute of camera 1 is FRONT (i.e., the front-facing attribute), and the marking attribute is empty, that is, the marking attribute of camera 1 is not queried. Alternatively, the marking attribute of camera 1 can be wide-angle, telephoto, main camera, etc., which is not limited in this application. The orientation attribute of camera 2 is BACK (i.e., the rear-facing attribute), and the marking attribute is Main (i.e., the main camera attribute).

[0152] The camera information can be in json format. Json is a lightweight data interchange format. For example, the camera information of a tablet computer is as follows:

[0153] {"id":"Camera1","streamAbility":{"Supported bitstreams":{H265 / H264…},"Supported resolutions":{480P / 720P…},"Other information":{"Orientation attribute":"Front"}};

[0154] {"id":"Camera0","streamAbility":{"Supported bitstreams":{H265 / H264…},"Supported resolutions":{480P / 720P…},"Other information":{"Marking attribute":"BACK"},{"Marking attribute":"Main"}}.

[0155] In a possible design, the camera information of the tablet computer can also include the number (count) of cameras of the tablet computer. For example, the number of cameras of the tablet computer can be 2.

[0156] It should be understood that the embodiments of this application are described by taking the tablet computer as the called end (controlled end) as an example. In actual applications, the called end (controlled end) can also be other types of electronic devices, such as mobile phones, PCs, etc. When the called end (controlled end) is a mobile phone or a PC, the method for the mobile phone or the PC to obtain its own camera information can refer to the method for the tablet computer to obtain camera information, which is not elaborated in this application.

[0157] 1107. The multimedia framework of the tablet computer returns the camera information of the tablet computer to the capability acquisition module of the tablet computer.

[0158] 1108. The capability acquisition module of the tablet computer returns the camera information of the tablet computer to the capability aggregation module of the mobile phone.

[0159] The capability acquisition module of the tablet computer can send the camera information of the tablet computer to the mobile phone through its own transmission channel module. The mobile phone can receive the camera information of the tablet computer from the tablet computer through its own transmission channel module and can send the camera information of the tablet computer to the capability aggregation module of the mobile phone.

[0160] 1109. The capability summary module of the mobile phone saves the camera information of the tablet computer.

[0161] In a possible design, if the camera information from the tablet computer does not include the number of cameras of the tablet computer, the capability summary module of the mobile phone can determine the number (count) of cameras of the tablet computer. For example, the capability summary module of the mobile phone can count the number of cameras of the tablet computer according to the number of camera identifiers carried in the camera information of the tablet computer. For example, the camera identifiers carried in the camera information of the tablet computer may include "Camera1" and "Camera0", that is, the number of cameras of the tablet computer can be 2.

[0162] 1110. The capability summary module of the mobile phone returns the camera information of the tablet computer to the camera mapping management module of the mobile phone.

[0163] In some embodiments, after multi-screen collaboration is established between the mobile phone and the tablet computer, in response to the user's operation of triggering a video call on the mobile phone, the instant messaging application of the mobile phone can send a request to open the camera to the multi-screen collaboration application of the mobile phone. Among them, the operation of triggering a video call may include initiating a video call or answering a video call, which is not limited in this application.

[0164] In other embodiments, when the mobile phone has initiated a video call, in response to the user's operation of triggering the establishment of multi-screen collaboration between the mobile phone and the tablet computer, the instant messaging application of the mobile phone can send a request to open the camera to the multi-screen collaboration application of the mobile phone.

[0165] 1111. The instant messaging application of the mobile phone sends a request to open the local camera to the camera HAL of the mobile phone.

[0166] Among them, the request to open the camera may carry the identifier of the local camera (the first camera). The identifier of the local camera of the mobile phone may be, for example, "Camera 0".

[0167] 1112. The camera HAL of the mobile phone opens the local camera.

[0168] The camera HAL of the mobile phone can open the local camera through the camera driver.

[0169] 1113. The camera HAL of the mobile phone sends the video stream collected by the local camera to the instant messaging application of the mobile phone.

[0170] The camera HAL of the mobile phone can obtain the video stream collected by the local camera through the camera driver, and then send the video stream (the first video stream) collected by the local camera to the instant messaging application of the mobile phone. So that the instant messaging application of the mobile phone can display a video window (the first video window) according to the video stream (the first video stream) collected by the local camera.

[0171] 1114. The camera HAL of the mobile phone sends the orientation attribute and / or marking attribute of the local camera to the camera mapping management module.

[0172] In a possible design, the camera HAL of the mobile phone can call a third interface to obtain the orientation attribute of the currently opened local camera. Among them, the third interface can be, for example, cameraInfo.facing. The return value of cameraInfo.facing can include CAMERA_FACING_FRONT and CAMERA_FACING_BACK.

[0173] Among them, CAMERA_FACING_FRONT represents the front attribute, and CAMERA_FACING_BACK represents the rear attribute. Taking the currently opened local camera as camera 1 as an example, if the orientation attribute corresponding to camera 1 is CAMERA_FACING_FRONT, it is considered that camera 1 is a front camera, and the orientation attribute of camera 1 is marked as Front. If the orientation attribute corresponding to camera 1 is CAMERA_FACING_BACK, it is considered that camera 1 is a rear camera, and the orientation attribute of camera 1 is marked as Main.

[0174] The camera HAL of the mobile phone can call a fourth interface to determine the marking attribute of the currently opened local camera. Taking the chip used in the mobile phone as the Qualcomm chip 8650 as an example. The fourth interface can include IsMainSensor, IsWideSensor, IsteleSensor, etc. Among them, the return values of interfaces such as IsMainSensor, IsWideSensor, IsteleSensor can be true or false.

[0175] The camera HAL of the mobile phone can sequentially call interfaces such as IsMainSensor, IsWideSensor, IsteleSensor to determine the marking attribute of the currently opened local camera. The order in which the mobile phone calls interfaces such as IsMainSensor, IsWideSensor, IsteleSensor can be a preset order or an order determined according to a preset rule, which is not limited in this application.

[0176] Exemplarily, IsMainSensor can be called according to the identifier (ID) corresponding to the currently opened local camera. If the return value of IsMainSensor is true, it is considered that the camera is the main camera, and the marked attribute of the camera is marked as the main camera (Main) attribute. If the return value of IsMainSensor is false, IsWideSensor can be called continuously. If the return value of IsWideSensor is true, it is considered that the camera is a wide-angle camera, and the marked attribute of the camera is marked as the wide-angle attribute; if the return value of IsWideSensor is false, IsteleSensor can be called continuously. If the return value of IsteleSensor is true, it is considered that the camera is a telephoto camera, and the marked attribute of the camera is marked as the telephoto attribute.

[0177] 1115. The camera mapping management module of the mobile phone performs mapping binding between the local camera and the virtual camera.

[0178] The camera mapping management module of the mobile phone can perform mapping binding between the local camera and the virtual camera according to the camera information of the tablet computer. Among them, the local camera is the camera of the mobile phone. The virtual camera refers to the camera of the tablet computer.

[0179] In the embodiments of the present application, the mapping binding between the local camera and the virtual camera can at least include the following three situations.

[0180] In the first case, when there is only a single camera on the tablet computer, that is, when the number of cameras on the tablet computer is 1, the local camera has a mapping relationship with the only 1 camera on the tablet computer, and there is no need to consider the camera attributes of the tablet computer. In this way, it can be ensured that the mobile phone can call the only 1 camera on the tablet computer across devices, avoiding camera mapping failure and resulting in failure to call the camera across devices.

[0181] It should be understood that the local camera of the mobile phone can be any local camera of the mobile phone. For example, it can be a front camera, a rear camera, a wide-angle camera, etc., and the present application does not make any limitations. The 1 camera on the tablet computer can be any type of camera. For example, it can be a front camera or a rear camera, and the present application does not make any limitations.

[0182] In the second case, when there are 2 cameras on the tablet computer, the virtual camera having a mapping relationship with the local camera is the camera on the tablet computer with the same orientation attribute as the local camera among the 2 cameras on the tablet computer. That is, when the number of cameras on the tablet computer is 2, the orientation attributes of the cameras on the tablet computer and the local camera can be considered. The local camera has a mapping relationship with the camera on the tablet computer with the same orientation attribute.

[0183] It can be understood that when there are two cameras on the tablet computer, the two cameras include a front camera and a rear camera.

[0184] Exemplarily, if the orientation attribute of the local camera is the front orientation attribute, that is, the local camera is a front camera, then the camera with the front orientation attribute in the cameras of the tablet computer can be called, that is, the front camera of the tablet computer can be called. If the orientation attribute of the local camera is the rear orientation attribute, that is, the local camera is a rear camera, then the camera with the rear orientation attribute in the cameras of the tablet computer can be called, that is, the rear camera of the tablet computer can be called.

[0185] In this way, the virtual camera (i.e., the camera of the tablet) mapped by the local camera of the mobile phone can be determined according to the orientation attribute, which can ensure that when the mobile phone calls the camera across devices, the virtual camera with the same orientation attribute as the local camera can be called, which is more in line with the user's needs. For example, when the mobile phone makes a video call, if the user uses the local front camera of the mobile phone to collect video frames, when switching to collecting video frames through the camera of the tablet computer, the front camera of the tablet computer can be used to collect video frames, which can make the switching of the camera more in line with the user's needs (the user's need to use the front camera).

[0186] In the third case, when there are more than two cameras on the tablet computer, the camera that has a mapping relationship with the local camera is the camera among the multiple (more than two) cameras of the tablet computer that has the same label attribute as the local camera. That is, when the number of cameras of the tablet computer is greater than 2, the marking attribute of the cameras of the tablet computer and the marking attribute of the local camera can be considered. The local camera has a mapping relationship with the camera of the tablet computer with the same marking attribute.

[0187] Exemplarily, if the orientation attribute of the local camera is the wide-angle attribute, that is, the local camera is a wide-angle camera, then the camera with the wide-angle attribute in the cameras of the tablet computer can be called, that is, the wide-angle camera of the tablet computer can be called. If the orientation attribute of the local camera is the telephoto attribute, that is, the local camera is a telephoto camera, then the camera with the telephoto attribute in the cameras of the tablet computer can be called, that is, the telephoto camera of the tablet computer can be called.

[0188] In this way, the virtual camera mapped by the local camera of the mobile phone (i.e., the camera of the tablet) can be determined according to the marker attribute, which can ensure that when the mobile phone calls the camera across devices, it can call the virtual camera with the same marker attribute as the local camera, which better meets the user's needs. For example, when the mobile phone makes a video call, if the user uses the local wide-angle camera of the mobile phone to collect video frames, when switching to collecting video frames through the camera of the tablet computer, the wide-angle camera of the tablet computer can be used to collect video frames, which can make the switching of the camera more in line with the user's needs (the user's need to use the wide-angle camera).

[0189] In the third case, if the multiple cameras of the tablet computer do not include a camera with the same label attribute as the local camera, the camera that has a mapping relationship with the local camera is determined to be the camera with the same orientation attribute as the local camera among the multiple cameras of the tablet computer. That is, when the number of cameras of the tablet computer is greater than 2, the marker attribute of the camera of the tablet computer and the marker attribute of the local camera can be considered first. Then consider the orientation attribute of the camera of the tablet computer and the orientation attribute of the local camera. In the case where the virtual camera having a mapping relationship with the local camera cannot be determined according to the marker attribute, the virtual camera having a mapping relationship with the local camera (i.e., the camera of the tablet computer) is determined according to the orientation attribute.

[0190] 1116. The camera mapping management module of the mobile phone sends an indication message to the capability aggregation module of the mobile phone.

[0191] Among them, the indication message is used to indicate the camera (the second camera) of the tablet computer that has a mapping relationship with the local camera. For example, the indication message can carry the identifier of the second camera.

[0192] 1117. The capability aggregation module of the mobile phone sends an indication message to the capability acquisition module of the tablet computer.

[0193] 1118. The capability acquisition module of the tablet computer sends an indication message to the multimedia framework of the tablet computer.

[0194] After receiving the indication message, the multimedia framework of the tablet computer can collect video data (the second video data) based on the camera (the second camera) indicated by the indication message.

[0195] 1119. The multimedia framework of the tablet computer sends the video data collected by the camera of the tablet computer to the camera mapping management module of the mobile phone.

[0196] The multimedia framework of the tablet computer can send the video data (video frames / video stream) collected by the camera of the tablet computer to the mobile phone through the transmission channel module of the tablet computer. The camera mapping management module of the mobile phone can receive the video data sent by the tablet computer through the transmission channel module of the mobile phone.

[0197] 1120. The camera mapping management module of the mobile phone sends the video data collected by the camera of the tablet computer to the camera HAL of the mobile phone.

[0198] 1121. The camera HAL of the mobile phone sends the video data collected by the camera of the tablet computer to the instant messaging application.

[0199] The instant messaging application of the mobile phone displays a second video window according to the video data (the second video data) collected by the camera of the tablet computer.

[0200] That is, the instant messaging application of the mobile phone can replace the video data collected by the local camera with the video data collected by the camera of the tablet computer, so as to realize camera switching.

[0201] In some embodiments, when multi-screen collaboration is established between the mobile phone and the tablet computer, after the user opens the camera application on the mobile phone, the user can select the local camera or the camera of the tablet computer through the path of "More" - "Multi-camera". For the mobile phone, the camera of the tablet computer can be regarded as a virtual camera. As Figure 12 shown, in response to the user's operation of triggering the selection of the camera in the camera application of the mobile phone, the mobile phone can display a pop-up window 12, and the pop-up window 12 can include multiple camera options. The multiple camera options can include options corresponding to the local camera and options corresponding to the camera of the tablet computer. Among them, the local camera can include the local front camera (i.e., this device (front)), the local rear main camera (i.e., this device (rear)), the local wide-angle camera (i.e., this device (wide-angle)), and the camera of the tablet computer can include the front camera of the tablet computer (i.e., my tablet (front)), the rear main camera of the tablet computer (i.e., my tablet (rear)), the wide-angle camera of the tablet computer (i.e., my tablet (wide-angle)). Optionally, the local camera can also include a local telephoto camera, a macro camera, etc. The camera of the tablet computer can also include a telephoto camera, a macro camera, etc. of the tablet computer. In this way, in the virtual camera scenario (i.e., the scenario where an electronic device (such as a mobile phone) calls a camera across devices), the mobile phone can call multiple types of cameras (such as a front camera, a rear main camera, a wide-angle camera, etc.) across devices. The mobile phone can provide multiple types of cameras for the user to choose from, which can enrich the user's choices and improve the user experience.

[0202] Based on the method provided in this application, in the virtual camera scenario (i.e., the scenario where the first electronic device (such as a mobile phone) calls the camera of the second electronic device (such as a tablet computer) across devices), when the mobile phone calls the camera across devices, it can consider information such as the number, orientation attribute, and marking attribute of the camera of the tablet computer, so that the mobile phone and the tablet computer can perform camera collaboration more accurately.

[0203] For example, a mobile phone can determine a virtual camera mapped by a local camera (i.e., the camera of a tablet) according to the orientation attribute, which can ensure that when the mobile phone calls a camera across devices, it can call a virtual camera with the same orientation attribute as the local camera, better meeting the user's needs. For example, when the mobile phone makes a video call, if the user uses the front camera of the local mobile phone to capture video frames, when switching to capturing video frames through the camera of the tablet computer, the front camera of the tablet computer can be used to capture video frames, making the camera switching more in line with the user's needs (the user's need to use the front camera).

[0204] Another example is that a mobile phone can determine a virtual camera mapped by a local camera (i.e., the camera of a tablet) according to the marking attribute, which can ensure that when the mobile phone calls a camera across devices, it can call a virtual camera with the same marking attribute as the local camera, better meeting the user's needs. For example, when the mobile phone makes a video call, if the user uses the wide-angle camera of the local mobile phone to capture video frames, when switching to capturing video frames through the camera of the tablet computer, the wide-angle camera of the tablet computer can be used to capture video frames, making the camera switching more in line with the user's needs (the user's need to use the wide-angle camera).

[0205] Some embodiments of the present application provide an electronic device, which may include: a touch screen, a memory, and one or more processors. The touch screen, the memory, and the processor are coupled. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device can perform each function or step executed by the electronic device in the above method embodiments. The structure of the electronic device can refer to Figure 2 the structure of the electronic device 100 shown

[0206] Embodiments of the present application also provide a chip system (for example, a system on a chip (SoC)), as Figure 13 shown, the chip system includes at least one processor 1301 and at least one interface circuit 1302. The processor 1301 and the interface circuit 1302 can be interconnected through lines. For example, the interface circuit 1302 can be used to receive signals from other devices (such as the memory of an electronic device). Another example is that the interface circuit 1302 can be used to send signals to other devices (such as the processor 1301 or the touch screen of an electronic device). Exemplarily, the interface circuit 1302 can read instructions stored in the memory and send the instructions to the processor 1301. When the instructions are executed by the processor 1301, the electronic device can perform each step in the above embodiments. Of course, the chip system may also include other discrete devices, and the embodiments of the present application do not make specific limitations on this.

[0207] The embodiments of the present application also provide a computer-readable storage medium, which includes computer instructions. When the computer instructions run on the above-mentioned electronic device, the electronic device is enabled to execute each function or step executed by the electronic device in the above method embodiments.

[0208] Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of description, only the division of the above function modules is used for illustration. In actual applications, the above functions can be allocated to different function modules according to needs, that is, the internal structure of the device is divided into different function modules to complete all or part of the functions described above.

[0209] In several embodiments provided by the present application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in electrical, mechanical or other forms.

[0210] The unit described as a separated component may or may not be physically separated. The component displayed as a unit may be a physical unit or multiple physical units, that is, it may be located in one place, or may be distributed to multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0211] In addition, each functional unit in the various embodiments of the present application can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0212] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions for causing a device (which can be a single-chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, read only memory (ROM), random access memory (RAM), magnetic disks, or optical discs.

[0213] The above content is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method for camera collaboration across devices, characterized in that, applied to a first electronic device, the first electronic device and a second electronic device are in a multi-screen collaboration state, and the method includes: In response to a user's operation of triggering a video call, the first electronic device collects first video data based on a first camera of the first electronic device, and displays a first video window according to the first video data; The first electronic device obtains camera information of the second electronic device; wherein, the camera information includes the number of cameras of the second electronic device, the identifiers of the cameras, and camera attributes, and the camera attributes include an orientation attribute, and the orientation attribute includes a front-facing attribute or a rear-facing attribute; The first electronic device determines a second camera having a mapping relationship with the first camera according to the camera information, and the second camera is a camera of the second electronic device; The first electronic device sends an indication message to the second electronic device, and the indication message is used to indicate the second camera; The first electronic device receives second video data from the second electronic device, and the second video data comes from the second camera; The first electronic device displays a second video window according to the second video data.

2. The method according to claim 1, characterized in that, The first electronic device determines a second camera having a mapping relationship with the first camera according to the camera information, including: When the number of cameras of the second electronic device is 2, it is determined that the second camera having a mapping relationship with the first camera is the camera among the 2 cameras of the second electronic device that has the same orientation attribute as the first camera.

3. The method according to claim 1 or 2, characterized in that, The first electronic device determines a second camera having a mapping relationship with the first camera according to the camera information, including: When the number of cameras of the second electronic device is 1, it is determined that the first camera has a mapping relationship with the 1 camera of the second electronic device.

4. The method according to any one of claims 1-3, characterized in that, The camera attributes further include a label attribute, and the label attribute includes at least one of a wide-angle attribute, a main camera attribute, a telephoto attribute, or a macro attribute.

5. The method according to claim 4, characterized in that, The first electronic device determines a second camera having a mapping relationship with the first camera according to the camera information, including: When the number of cameras of the second electronic device is greater than 2, it is determined that the second camera having a mapping relationship with the first camera is the camera among the multiple cameras of the second electronic device that has the same label attribute as the first camera.

6. The method according to claim 5, characterized in that, The method further includes: If none of the multiple cameras of the second electronic device has the same tag attribute as the first camera, determine that the second camera having a mapping relationship with the first camera is the camera among the multiple cameras of the second electronic device that has the same orientation attribute as the first camera.

7. The method according to any one of claims 1-6, wherein, the method further includes: the first electronic device obtains the orientation attribute and / or tag attribute of the first camera; the first electronic device determines the second camera having a mapping relationship with the first camera according to the camera information, including: the first electronic device determines the second camera having a mapping relationship with the first camera according to the camera information of the second electronic device and the orientation attribute and / or tag attribute of the first camera.

8. A method for cross-device camera collaboration, wherein, applied to a system including a first electronic device and a second electronic device, the first electronic device and the second electronic device are in a multi-screen collaboration state, and the method includes: In response to a user's operation of triggering a video call, the first electronic device collects first video data based on a first camera of the first electronic device and displays a first video window according to the first video data; the first electronic device sends a request message to the second electronic device, and the request message is used to request the camera information of the second electronic device; the second electronic device receives the request message, collects the camera information of the second electronic device, and the camera information includes the number of cameras of the second electronic device, the identifiers of the cameras, and the camera attributes, and the camera attributes include orientation attributes, and the orientation attributes include front-facing attributes or rear-facing attributes; the second electronic device sends the camera information of the second electronic device to the first electronic device; the first electronic device receives the camera information of the second electronic device from the second electronic device; the first electronic device determines a second camera having a mapping relationship with the first camera according to the camera information, and the second camera is a camera of the second electronic device; the first electronic device sends indication information to the second electronic device, and the indication information is used to indicate the second camera; the second electronic device receives the indication information and collects second video data based on the second camera according to the indication information; the second electronic device sends the second video data to the first electronic device; the first electronic device receives the second video data from the second electronic device; the first electronic device displays a second video window according to the second video data.

9. The method according to claim 8, wherein, the first electronic device determines the second camera having a mapping relationship with the first camera according to the camera information, including: When the number of cameras of the second electronic device is 2, determine that the second camera having a mapping relationship with the first camera is the camera among the two cameras of the second electronic device that has the same orientation attribute as the first camera.

10. The method according to claim 8 or 9, wherein, the first electronic device determines the second camera having a mapping relationship with the first camera according to the camera information, including: when the number of cameras of the second electronic device is 1, determine that the first camera has a mapping relationship with the one camera of the second electronic device.

11. The method according to any one of claims 8-10, wherein, the camera attribute further includes a label attribute, and the label attribute includes at least one of a wide-angle attribute, a main camera attribute, a telephoto attribute, or a macro attribute.

12. The method according to claim 11, wherein, the first electronic device determines the second camera having a mapping relationship with the first camera according to the camera information, including: when the number of cameras of the second electronic device is greater than 2, determine that the second camera having a mapping relationship with the first camera is the camera among the multiple cameras of the second electronic device that has the same label attribute as the first camera.

13. The method according to claim 12, wherein, the method further includes: if the multiple cameras of the second electronic device do not include a camera having the same label attribute as the first camera, determine that the second camera having a mapping relationship with the first camera is the camera among the multiple cameras of the second electronic device that has the same orientation attribute as the first camera.

14. The method according to any one of claims 8-13, wherein, the method further includes: the first electronic device obtains the orientation attribute and / or label attribute of the first camera; the first electronic device determines the second camera having a mapping relationship with the first camera according to the camera information, including: the first electronic device determines the second camera having a mapping relationship with the first camera according to the camera information of the second electronic device and the orientation attribute and / or label attribute of the first camera.

15. A system for cross-device camera collaboration, wherein, the system includes a system of a first electronic device and a second electronic device, and the first electronic device and the second electronic device are in a multi-screen collaboration state, wherein: the first electronic device is configured to, in response to a user's operation of triggering a video call, collect first video data based on a first camera of the first electronic device, and display a first video window according to the first video data; the first electronic device is further configured to send a request message to the second electronic device, and the request message is used to request the camera information of the second electronic device; The second electronic device is configured to receive the request message and collect camera information of the second electronic device. The camera information includes the number of cameras of the second electronic device, the identifiers of the cameras, and camera attributes. The camera attributes include an orientation attribute, and the orientation attribute includes a front-facing attribute or a rear-facing attribute; The second electronic device is further configured to send the camera information of the second electronic device to the first electronic device; The first electronic device is further configured to receive the camera information of the second electronic device from the second electronic device; The first electronic device is further configured to determine a second camera having a mapping relationship with the first camera according to the camera information, where the second camera is a camera of the second electronic device; The first electronic device is further configured to send indication information to the second electronic device, where the indication information is used to indicate the second camera; The second electronic device is further configured to receive the indication information and collect second video data based on the second camera according to the indication information; The second electronic device is further configured to send the second video data to the first electronic device; The first electronic device is further configured to receive the second video data from the second electronic device; The first electronic device is further configured to display a second video window according to the second video data.

16. An electronic device, characterized in that, the electronic device includes: a wireless communication module, a memory, and one or more processors; the wireless communication module, the memory are coupled to the processor; wherein, the memory is used to store computer program code, and the computer program code includes computer instructions; when the computer instructions are executed by the processor, the electronic device is caused to execute the method according to any one of claims 1-7.

17. A computer-readable storage medium, characterized in that, it includes computer instructions; when the computer instructions run on an electronic device, the electronic device is caused to execute the method according to any one of claims 1-7.

Images