Electronic device and processing method thereof
By introducing image acquisition devices, interfaces, and processors into electronic devices, image data merging and combination between multiple devices can be achieved, solving the problem of limited device interaction functions and expanding the functionality and interaction range of the devices.
Patent Information
- Application Number
- CN202310194533.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-02-28
- Publication Date
- 2026-01-16
- Estimated Expiration
- 2043-02-28
AI Technical Summary
Each electronic device's image acquisition device can only interact with its own data processing device, resulting in relatively limited interactive functions.
An electronic device is provided, which has an image acquisition device, a first interface and a second interface, and is capable of connecting with other devices to merge or combine image data, and performs data processing through a processor to realize image data interaction and display between multiple devices.
This expands the functionality and interactivity of electronic devices, enabling multiple devices to share and process image data, thus meeting diverse user needs.
Smart Images

Figure CN116347007B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to an electronic device and a processing method thereof. BACKGROUND
[0002] In a scenario of multiple electronic devices, each electronic device has an image acquisition device, but the image data collected by the image acquisition device of each electronic device can only interact with a data processing device, resulting in a relatively single interactive function of the device. SUMMARY
[0003] Therefore, embodiments of the present application aim to provide an electronic device and a processing method.
[0004] To achieve the above-mentioned purpose, the technical solution of the present application is as follows:
[0005] According to an aspect of the present application, a first device is provided, comprising:
[0006] an image acquisition device, configured to collect first image data;
[0007] a first interface, configured to connect with a second device and receive at least second image data sent by the second device, wherein the second image data comprises image data collected by an image acquisition device of the second device;
[0008] a second interface, configured to connect with a third device and send at least data comprising the first image data and the second image data to the third device.
[0009] In the above-mentioned solution, the first device further comprises:
[0010] a processor, configured to merge the first image data and the second image data to obtain third image data, or to combine the first image data and the second image data to obtain third image data;
[0011] the second interface is configured to send at least the third image data to the third device.
[0012] In the above-mentioned solution, the second image data is combined data of image data collected by the image acquisition device of the second device and image data sent by a fourth device and received by the second device; the image data sent by the fourth device at least comprises image data collected by an image acquisition device of the fourth device.
[0013] the processor is specifically configured to merge the first image data, the image data collected by the image acquisition device of the second device, and the image data collected by the image acquisition device of the fourth device to obtain the third image data.
[0014] In the scheme, the image data sent by the fourth device is combined data of image data collected by an image collection device of the fourth device and image data sent by the fifth device; and the image data sent by the fifth device at least includes image data collected by an image collection device of the fifth device.
[0015] The processor is specifically configured to merge the first image data, image data collected by the image collection device of the second device, image data collected by the image collection device of the fourth device, and image data collected by the image collection device of the fifth device to obtain the third image data.
[0016] In the scheme, the first device further includes:
[0017] The selection device is configured to determine a target device in candidate devices in response to a selection instruction, the candidate devices at least including the first device, the second device, and a fourth device connected to the second device; wherein the second image data is combined data of image data collected by an image collection device of the second device and image data sent by the fourth device, and the image data sent by the fourth device at least includes image data collected by an image collection device of the fourth device.
[0018] The second interface is configured to send image data corresponding to the target device to the third device.
[0019] In the scheme, the second interface is further configured to receive the selection instruction sent by the third device, and the selection instruction at least carries a device identifier.
[0020] The first interface is further configured to send an image collection instruction to the second device based on the device identifier, so that the second device performs image collection through the image collection device of the second device based on the device identifier carried in the image collection instruction; and / or, send the image collection instruction to the fourth device, so that the fourth device performs image collection through the image collection device of the fourth device based on the device identifier carried in the image collection instruction.
[0021] In the scheme, the first device further includes:
[0022] An image output device.
[0023] The second interface is specifically configured to send data including the first image data and the second image data to the third device, and receive first display data sent by the third device, so that the first display data is displayed on the image output device.
[0024] The first interface is specifically configured to receive the second image data sent by the second device, and send second display data to the second device, so that the second display data is displayed on an image output apparatus of the second device, wherein the first display data comprises the second display data.
[0025] In the foregoing solution, the first display data comprises a plurality of sub-display data, and each sub-display data corresponds to an identifier, and the identifier is used to indicate a display order of each sub-display data on a corresponding device.
[0026] The first device further comprises:
[0027] The processor is configured to determine a first sub-display data from the plurality of sub-display data based on the identifier.
[0028] The image output apparatus is further configured to display the first sub-display data.
[0029] The first interface is specifically configured to send, to the second device, remaining sub-display data in the plurality of sub-display data except the first sub-display data, so that the second device displays a corresponding second sub-display data in the remaining sub-display data based on the identifier through an image output apparatus of the second device, or sends the remaining sub-display data to a fourth device connected to the second device, so that the fourth device displays a corresponding third sub-display data in the remaining sub-display data based on the identifier through an image output apparatus of the fourth device.
[0030] In the foregoing solution, the image output apparatus is further configured to output at least part of the first image data and the second image data.
[0031] In the foregoing solution, the first interface and the second interface are universal serial bus interfaces.
[0032] According to another aspect of the present application, a processing method is provided, comprising:
[0033] acquiring first image data by a first device;
[0034] receiving second image data sent by a second device;
[0035] sending data comprising the first image data and the second image data to a third device.
[0036] In the foregoing solution, the method further comprises:
[0037] In response to a selection instruction, determining a target device from candidate devices, wherein the target device comprises the first device, the second device, and a fourth device connected to the second device.
[0038] sending the image data corresponding to the target device to a third device. BRIEF DESCRIPTION OF DRAWINGS
[0039] Figure 1 a structural schematic diagram of a first device in the present application;
[0040] Figure 2 a scene implementation schematic of an electronic device in the present application Figure 1 ;
[0041] Figure 3 a Figure 2 structural schematic diagram corresponding thereto;
[0042] Figure 4 a scene implementation schematic of an electronic device in the present application Figure 2 ;
[0043] Figure 5 a Figure 4 structural schematic diagram corresponding thereto;
[0044] Figure 6 a scene implementation schematic of an electronic device in the present application Figure 3 ;
[0045] Figure 7 a Figure 6 structural schematic diagram corresponding thereto;
[0046] Figure 8 a flow implementation schematic of a processing method in the present application. DETAILED DESCRIPTION
[0047] In order to make the purpose, technical scheme and advantages of the present application clearer, the technical scheme in the embodiments of the present application will be described clearly and completely below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application. The embodiments in the present application and the features in the embodiments can be combined with each other arbitrarily without conflict. The steps shown in the flowchart of the drawings can be executed in a computer system such as a group of computer executable instructions. Moreover, although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that here.
[0048] The technical scheme of the present application will be further described in detail below in combination with the drawings in the specification and specific embodiments.
[0049] Figure 1 a structural schematic diagram of a first device in the present application, asFigure 1 As shown, the first device 100 comprises an image acquisition apparatus 101, a first interface 102 and a second interface 103; wherein the image acquisition apparatus 101 is configured to acquire first image data; the first interface 102 is configured to be connected with the second device 200 and receive at least second image data sent by the second device 200, wherein the second image data comprises image data acquired by an image acquisition apparatus of the second device 200; and the second interface 103 is configured to be connected with the third device 300 and send at least data comprising the first image data and the second image data to the third device 300.
[0050] Here, the first interface 102 and the second interface 103 can both be a universal serial bus (USB, Universal Serial Bus) interface, preferably a USB-C interface. Of course, it can also be a display interface (DP, DisplayPort), a thunderbolt interface (Thunderbolt), or a high-definition multimedia interface (HDMI, High Definition Multimedia Interface).
[0051] Here, the types of the first device, the second device and the third device can be the same, such as all being displays.
[0052] Here, the types of the first device, the second device and the third device can also be different, such as the first device and the second device being displays and the third device being a device for generating or processing media data.
[0053] The electronic device provided in the present application not only can interact with a device having a function of generating or processing media data, but also can interact with a display, thereby not only expanding the functionality of the electronic device but also expanding the interaction range of the electronic device.
[0054] In the present application, the first device 100 can further comprise a processor 104 configured to merge the first image data and the second image data to obtain third image data; or the processor 104 can also be configured to combine the first image data and the second image data to obtain third image data.
[0055] Here, merging means fusing multiple independent images into one image, which cannot be directly split into the original independent images. For example, merging the independent first image data and the independent second image data into one third image data, the third image data being an independent image, which cannot be split into the independent first image data and the second image data.
[0056] Here, the combination is to fuse multiple independent images into an image group, each image still has relative independence, and the image group can be dispersed to restore the original independent image. For example, combining independent first image data and independent second image data into third image data, the third image data is an image data group, which can be split into independent first image data and second image data.
[0057] It should be noted that the processor 104 is different from the central processing unit (CPU) in the device with media data processing capability, and the difference can be embodied in that the processor 104 realizes image processing and coding and decoding through hardware, that is, the processor 104 is a processor with hardware image processing capability and hardware coding and decoding capability, while the CPU realizes image processing and coding and decoding through software.
[0058] In the present application, the first device 100 can specifically send the third image data to the third device 300 through the second interface 103.
[0059] Here, when the third device 300 is of the same type as the first device 100, the third device 300 can merge or combine the third image data with the image data collected by itself and send it to the next electronic device connected to the third device 300. Or, the third image data is directly forwarded to the next electronic device connected to the third device 300.
[0060] Here, when the third device 300 is of a different type from the first device 100, the third device 300 can send the third image data to a remote device connected to the third device, so that the third image data is displayed and output on the display screen of the remote device.
[0061] In the present application, the second image data sent by the second device 200 and received by the first device 100 through the first interface 102 can also include image data received by the second device 200 and sent by the fourth device 400, and the image data sent by the fourth device 400 includes at least image data collected by the image collection device of the fourth device 400.
[0062] Here, the second image data can be combined data of the image data collected by the image collecting device of the second device 200 and the image data sent by the fourth device 400 and received by the second device 200, or can be merged data of the image data collected by the image collecting device of the second device 200 and the image data sent by the fourth device 400 and received by the second device 200. When the second image data is the combined data of the image data collected by the image collecting device of the second device 200 and the image data sent by the fourth device 400 and received by the second device 200, the processor 104 of the first device 100 can be configured to merge the first image data, the image data collected by the image collecting device of the second device 200 and the image data collected by the image collecting device of the fourth device 400 to obtain the third image data. When the second image data is the merged data of the image data collected by the image collecting device of the second device 200 and the image data sent by the fourth device 400 and received by the second device 200, the processor 104 of the first device 100 can be configured to merge the first image data and the second image data to obtain the third image data.
[0063] In the present application, the image data sent by the fourth device 400 can further include image data sent by the fifth device 500 and received by the fourth device 400, and the image data sent by the fifth device 500 at least includes image data collected by the image collecting unit of the fifth device 500.
[0064] Here, the image data sent by the fourth device 400 can be combined data of the image data collected by the image collecting device of the fourth device 400 and the image data sent by the fifth device 500 and received by the fourth device 400; or can be merged data of the image data collected by the image collecting device of the fourth device 400 and the image data sent by the fifth device 500 and received by the fourth device 400. When the image data sent by the fourth device 400 is the combined data of the image data collected by the image collecting device of the fourth device 400 and the image data sent by the fifth device 500 and received by the fourth device 400, the processor 104 can be configured to merge the first image data, the image data collected by the image collecting device of the second device 200, the image data collected by the image collecting device of the fourth device 400 and the image data collected by the image collecting device of the fifth device 500 to obtain the third image data. When the image data sent by the fourth device 400 is the merged data of the image data collected by the image collecting device of the fourth device 400 and the image data sent by the fifth device 500 and received by the fourth device 400, the processor 104 can be configured to merge the first image data and the second image data to obtain the third image data. The second image data is the merged data of the image data collected by the image collecting device of the second device 200 and the image data sent by the fourth device; the image data sent by the fourth device is the merged data of the image data collected by the image collecting device of the fourth device 400 and the image data collected by the image collecting device of the fifth device 500.
[0065] In the present application, the first device 100 can further have an image output device 105, through which the first image data and / or the second image data can be output, or at least part of the first image data and / or the second image data can be output.
[0066] Here, the image output device 105 can be a display screen, the first device 100, the second device 200, the fourth device and the fifth device 500 can all be displays, and the first device 100, the second device 200, the fourth device and the fifth device 500 can have the same composition; the third device 300 can be a computer.
[0067] The display provided in the application not only has computing capability, but also has hardware processing data capability and hardware coding and decoding capability; in addition, through the device cascade mode (i.e. serial connection), the display can not only receive image data sent by the previous device (such as the second device), but also send image data collected by itself and image data sent by the previous device (such as the second device) to the next device (such as the third device), and can also receive data sent by the next device (such as the third device) and send data from the third device to the previous device (such as the second device). In this way, the third device can obtain camera image data of any device on the cascade link as needed, meeting the user's demand for images of different angles.
[0068] In the application, the first device can also have a plurality of first interfaces 102, the second device 200, the fourth device 400 and the fifth device 500 can be directly connected to the first device 100 through one first interface 102, the first device 100 can directly receive image data collected by the image collection device of the second device 200, the fourth device 400 and the fifth device 500, and can also send the image data collected by the image collection device 101 of the first device itself to the third device 300 after merging or combining the image data collected by the image collection device of the second device 200, the fourth device 400 and the fifth device 500.
[0069] In the application, the first device 100 further includes a selection device 106 for determining a target device in the candidate device in response to a selection instruction, the candidate device at least including the first device 100, the second device 200 and the fourth device 400 connected to the second device 200, and of course can also include the fifth device 500 and more cascade devices; wherein the second image data is combined data of image data collected by the image collection device of the second device 200 and image data sent by the fourth device 400, and the image data sent by the fourth device 400 at least includes image data collected by the image collection device of the fourth device 400; the second interface 103 is used for sending image data corresponding to the target device to the third device 300.
[0070] Here, the second interface 103 is further configured to receive the selection instruction sent by the third device 300, and the selection instruction carries at least a device identifier; the selection device 106 is further configured to send an image acquisition instruction to the second device 200 through the first interface 102 based on the device identifier, so that the second device 200 acquires an image through an image acquisition device of the second device 200 based on the device identifier carried in the image acquisition instruction; and / or, the selection device 106 is further configured to send the image acquisition instruction to the fourth device 400 through the second device 200 based on the device identifier, so that the fourth device 400 acquires an image through an image acquisition device of the fourth device 400 based on the device identifier carried in the image acquisition instruction. That is, the second device 200 can be used as a relay device between the first device 100 and the fourth device 400, and only forwards data.
[0071] Here, the selection device 106 can be a touch display screen, a physical button, a microphone, or the like input device. It can also be a software module implemented by part of the code integrated in the processor 104.
[0072] When the selection device 106 is an input device, the first device 100 can further receive a menu opening instruction implemented through the selection device 106, and through the menu opening instruction, a menu interface for device selection can be displayed on the display area of the first device 100. Then, the selection device 106 can further receive a selection instruction for each candidate device in the menu interface, and based on the device identifier carried in the selection instruction, the target device can be determined from the candidate devices.
[0073] For example, a user presses a physical button on the first device 100, and a menu interface for device selection can be popped up on the display area of the first device 100. The user can select a target device from a plurality of candidate devices displayed in the menu interface by pressing the physical button again.
[0074] Here, the first device 100 can receive the menu opening instruction from the selection device, and at the same time, receive the display data sent by the third device. At this time, the priority of the menu opening instruction can be higher than that of the display data. The first device 100 can display the target menu interface in the display area according to the priority of the menu opening instruction. Of course, the first device can also display the target menu interface and the display data in the display area at the same time. At this time, since the priority of the menu opening instruction is higher than that of the display data, at least part of the content of the display data can be blocked by the target menu interface.
[0075] In the present application, when the selection device is a software module of the processor, the first device can further include an input device through which a menu opening instruction can be received, based on which a menu interface for device selection can be displayed on the display area, and then the first device can further receive a selection operation for the multiple candidate devices in the menu interface, and by the processor identifying the device identifier carried in the selection operation, the target device can be determined.
[0076] Here, the first device can display a menu interface on the display screen through a screen menu type adjustment mode (OSD, on-screen display) to realize selection of the target device.
[0077] The first device provided in the present application has not only data selection capability but also enables the third device to access the camera image data of any device on the cascaded link according to user demand, thereby meeting different use demands of the user.
[0078] In the present application, the first device 100 can further send data including the first image data and the second image data to the third device 300 through the first data channel of the second interface 103, and receive the first display data sent by the third device 300 through the second data channel of the second interface 103, so that the first display data is displayed on the image output device 105.
[0079] Here, the first display data can be derived from the image data sent by the remote device received by the third device 300. Or it can also be the image data stored by the third device 300 itself.
[0080] In the present application, the first device 100 can further receive the second image data sent by the second device 200 through the first data channel of the first interface 102, and send second display data to the second device 200 through the second data channel of the first interface 102, so that the second display data is displayed on the image output device of the second device 200. Wherein, the first display data includes the second display data.
[0081] In one implementation, the second display data sent by the first device 100 to the second device 200 through the first interface 102 is the same as the first display data. For example, the second display data is all the data of the first display data.
[0082] In another implementation, the second display data sent by the first device 100 to the second device 200 through the first interface 102 is different from the first display data. For example, the second display data is part of the data in the first display data.
[0083] In the present application, the first display data can further include a plurality of sub-display data, each of which corresponds to an identifier, which is used to indicate the display order of each sub-display data on the corresponding device.
[0084] For example, the first display data includes three sub-display data, wherein the identifier corresponding to the first sub-display data is 1, indicating the first display; the identifier corresponding to the second sub-display data is 3, indicating the third display; and the identifier corresponding to the third sub-display data is 2, indicating the second display.
[0085] In the present application, the processor 104 can further determine a first sub-display data from the plurality of sub-display data based on the identifier, and display the first sub-display data through the image output device 105.
[0086] Here, the first device can be located at a first display position, and the identifier of the first sub-display data indicates the first display corresponding to the first device.
[0087] Then, the first device 100 can send the remaining sub-display data except the first sub-display data in the plurality of sub-display data to the second device 200 through the first interface 102, so that the second device 200 displays the corresponding second sub-display data in the remaining sub-display data through the image output device of the second device 200 based on the identifier; or, the first device 100 sends the remaining sub-display data to the fourth device 400 connected to the second device 200, so that the fourth device 400 displays the corresponding third sub-display data in the remaining sub-display data through the image output device of the fourth device 400 based on the identifier.
[0088] For example, the second device 200 is located at a second display position, and the fourth device 400 is located at a third display position, and the first display data includes two sub-display data, wherein the identifier corresponding to the first sub-display data is 1, indicating the first display and being displayed through the first device 100; and the identifier corresponding to the second sub-display data is 2, indicating the second display and being displayed through the second device 200. If the identifier corresponding to the second sub-display data is 3, indicating the third display, then the second device 200 forwards the data to the fourth device 400 for display through the fourth device 400.
[0089] Here, when data forwarding is performed through the second device 200, the data sent by the first device 100 to the second device 200 can carry an identifier, and the second device 200 can determine whether to output by itself or forward data based on the identifier.
[0090] For example, the first device, the second device, and the fourth device are connected in a cascading manner. The first device can send the second sub-display data carrying the identifier 3 to the second device 200 through the first interface 102. After receiving the second sub-display data carrying the identifier 3, the second device 200 can compare the identifier 3 with the identifier allocated to the second device 200. If the comparison result is different, the second device 200 can send the second sub-display data carrying the identifier 3 to the fourth device 400, and the fourth device 400 displays the second sub-display data. That is, the second device 200 only forwards the data and does not display the data.
[0091] In the present application, the third device 300 can be a mobile phone, a computer, an information transceiver device, a tablet device, a personal digital assistant, or the like. The third device 300 can include at least one processor, a memory, at least one network interface, and an input / output device. The various components in the third device 300 are coupled together through a bus system. It can be understood that the bus system is used to realize the connection and communication between the components. In addition to the data bus, the bus system also includes a power bus, a control bus, and a status signal bus.
[0092] The input / output device can include a display, a camera, a keyboard, a mouse, a trackball, a click wheel, a key, a button, a touchpad, a touch screen, or the like.
[0093] It can be understood that the memory can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a ferromagnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM). The magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example but not limitation, many forms of RAM can be used, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), sync link dynamic random access memory (SLDRAM), and direct rambus random access memory (DRRAM).The memory described in the embodiments of the present application is intended to include, but not limited to, these and any other suitable types of memory.
[0094] The memory in the embodiments of the present application is used to store various types of data to support the operation of the third device 300. Examples of these data include: any computer programs for operating on the third device 300, such as operating systems and application programs; contact data; phonebook data; messages; pictures; audio; and the like. Among them, the operating system contains various system programs, such as framework layer, core library layer, driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application program can contain various application programs, such as media player (Media Player), browser (Browser), etc., for implementing various application services. The program for implementing the method of the embodiments of the present application can be contained in the application program.
[0095] Here, the processor can be an integrated circuit chip with processing capability.
[0096] In the exemplary embodiments, the third device 300 can be implemented by one or more application specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic elements.
[0097] The first device provided in the present application can have the functions of daisy chain and reverse daisy chain at the same time through device cascading, and can also select part of the data or all the data to transmit to the upper-level device or the lower-level device.
[0098] Figure 2 To implement the scenario of the electronic device in the present application Figure 1 As shown in Figure 2 , it includes four displays, which are display 1, display 2, display 3 and display 4, wherein the display 1, display 2, display 3 and display 4 are connected in sequence through the USB interface, and the display 4 is also connected with the computer 5 through the USB interface.
[0099] Here, each display has a camera through which image acquisition can be performed. Among them, the display 1 can send the image 1 acquired by the camera of the display 1 to the display 2; the display 2 can merge the image acquired by the camera of the display 2 with the image 1 to form the image 2 and send the image 2 to the display 3; the display 3 can merge the image acquired by the camera of the display 3 with the image 2 sent by the display 2 to form the image 3 and send the image 3 to the display 4; the display 4 can merge the image acquired by the camera of the display 4 with the image 3 sent by the display 3 to form the image 4 and send the image 4 to the computer 5. That is, each display can merge the image acquired by the camera of the display with the image sent by the previous display and send the image to the next display. In this way, the computer 5 can obtain the image data acquired by the camera of all the displays.
[0100] Here, the computer 5 can be connected with a remote device, and through the connection, the image 4 can be sent to the remote device so that the image 4 can be displayed on the remote device. For example, in the scenario of a remote meeting, the remote device can see the images of different angles acquired by the cameras of the four displays.
[0101] Figure 3 For Figure 2 The corresponding structural composition diagram is as follows: Figure 3As shown, the camera 1 of the display 1 performs image acquisition, and sends the acquired image 1 to the hub HUB 1, the HUB 1 sends the image 1 to the processor SoC 1, the SoC 1 sends the image 1 to the USB-C controller 2 of the display 2 through the USB-C controller 1; the USB-C controller 2 of the display 2 sends the image 1 to the HUB 2 of the display 2, the camera 2 of the display 2 performs image acquisition, and sends the acquired image to the HUB 2, the HUB 2 sends the image and the image 1 to the processor SoC 2, the SoC 2 merges the image acquired by the camera 2 and the image 1 to obtain the image 2, and sends the image 2 to the USB-C controller 2 of the display 3 through the USB-C controller 1 of the display 2; the USB-C controller 2 of the display 3 sends the image 2 to the HUB 3 of the display 3, the camera 3 of the display 3 performs image acquisition, and sends the acquired image to the HUB 3, the HUB 3 sends the image and the image 2 to the processor SoC 3, the SoC 3 merges the image acquired by the camera 3 and the image 2 to obtain the image 3, and sends the image 3 to the USB-C controller 2 of the display 4 through the USB-C controller 1 of the display 3; the USB-C controller 2 of the display 4 sends the image 3 to the HUB 4 of the display 4, the camera 4 of the display 4 performs image acquisition, and sends the acquired image to the HUB 4, the HUB 4 sends the image and the image 3 to the processor SoC 4, the SoC 4 merges the image acquired by the camera 4 and the image 3 to obtain the image 4, and sends the image 4 to the computer 5 through the USB-C controller 1 of the display 4.
[0102] Here, Figure 3 The thick black line represents the image data transmitted from the display to the computer, and the dashed line represents the data sent from the computer 5 to the display. The thin black line represents that if the identification carried in the camera selection instruction sent by the computer 5 to the display 4 is the camera corresponding to the display 1, the selection instruction needs to be sent to the USB-C controller 2 of the display 1 through the SoC 1 of the display 1, so as to control the HUB 1 to send the image acquired by the camera 1 to the SoC 1 through the USB-C controller 2 of the display 1.
[0103] Figure 4 Implementation of the scene of the electronic device in the present application is shown Figure 2 As shown, Figure 4 As shown, four displays are included, which are display 1, display 2, display 3 and display 4, wherein the display 1, the display 2, the display 3 and the display 4 are connected through the USB interface in sequence, and the display 4 is further connected with the computer 5 through the USB interface.
[0104] Here, each display has a camera through which image acquisition can be performed. Among them, the display 1 can send the image 1 acquired by the camera of the display 1 to the display 2; the display 2 can send the image 2 acquired by the camera of the display 2 together with the image 1 to the display 3; the display 3 can send the image 3 acquired by the camera of the display 3 together with the image 1 and the image 2 sent by the display 2 to the display 4; the display 4 can merge the image acquired by the camera of the display 4 with the image 1, the image 2 and the image 3 sent by the display 3 to form the image 4 and send the image 4 to the computer 5. In this way, the computer 5 can obtain the image data acquired by the cameras of all the displays.
[0105] Here, the computer 5 can also be connected with a remote device, and through the connection, the image 4 can be sent to the remote device so that the image 4 can be displayed on the remote device, so that the remote device can see the images of different angles acquired by the cameras of the four displays.
[0106] Figure 5 For Figure 4 The corresponding structural composition diagram is as follows: Figure 5As shown, the camera 1 of the display 1 performs image acquisition, and sends the acquired image 1 to the hub SW HUB 1 with a switch, the SW HUB 1 sends the image 1 to the USB-C controller 1 of the display 1, the USB-C controller 1 of the display 1 sends the image 1 to the USB-C controller 2 of the display 2; the USB-C controller 2 of the display 2 sends the image 1 to the SW HUB 2 of the display 2, the camera 2 of the display 2 performs image acquisition, and sends the acquired image 2 to the SW HUB 2, the SW HUB 2 sends the image 1 and the image 2 together to the USB-C controller 1 of the display 2, the USB-C controller 1 of the display 2 sends the image 1 and the image 2 together to the USB-C controller 2 of the display 3; the USB-C controller 2 of the display 3 sends the image 1 and the image 2 together to the SW HUB 3 of the display 3, the camera 3 of the display 3 performs image acquisition, and sends the acquired image 3 to the SW HUB 3, the SW HUB 3 sends the image 1, the image 2 and the image 3 together to the USB-C controller 1 of the display 3, the USB-C controller 1 of the display 3 sends the image 1, the image 2 and the image 3 together to the USB-C controller 2 of the display 4; the USB-C controller 2 of the display 4 sends the image 1, the image 2 and the image 3 together to the SW HUB 4 of the display 4, the camera 4 of the display 4 performs image acquisition, and sends the acquired image to the SW HUB 4, the SW HUB 4 sends the image 1, the image 2, the image 3 and the image acquired by the camera 4 to the processor SoC 4, the SoC 4 merges the image 1, the image 2, the image 3 and the image acquired by the camera 4 to obtain the image 4, and sends the image 4 to the computer 5 through the USB-C controller 1 of the display 4.
[0107] Here, Figure 5 The thick black line represents the merged image, that is Figure 5 Only the display 4 performs image merging, and the other displays only perform image combination or forwarding. The dashed line represents data sent from the computer 5 to the display. The dashed line between the SW HUB and the SoC represents no data transmission.
[0108] Figure 6 To realize the scene of the electronic device in the present application Figure 3 As shown, Figure 6 As shown, four displays are included, which are display 1, display 2, display 3 and display 4, wherein the display 1, the display 2, the display 3 and the display 4 are connected through the USB interface in sequence, and the display 4 is further connected with the computer 5 through the USB interface.
[0109] Here, each display has a camera through which image acquisition can be performed.Figure 6 In this system, monitor 4 can receive selection commands sent by computer 5. These commands may contain a device identifier. Based on this device identifier, monitor 4 determines that the camera on monitor 3 is the target object and sends an image acquisition command to monitor 3. This causes monitor 3 to activate its camera for image acquisition. Monitor 3 then sends the acquired image 1 to monitor 4 (shown by the solid line in the diagram). Monitor 4 then sends image 1 to computer 5. Computer 5 can then send image 1 to a remote device for display.
[0110] Here, computer 5 can also receive remote images sent by remote devices (shown by dotted lines in the figure) and send the remote images to monitor 4. Monitor 4 displays the remote images on its screen and sends them to monitor 3. Monitor 3 determines that its screen is currently in use based on the usage status information of its screen, and can then directly send the remote images to monitor 2. Monitor 2 outputs the remote images on its screen and then sends them to monitor 1. Monitor 1 then outputs the remote images on its screen.
[0111] The cascaded display provided in this application allows a computer to access the camera of any one of the cascaded displays, causing one display to show the local camera image while the other displays show the remote image. This achieves the goal of displaying different content on different screens.
[0112] Figure 7 for Figure 6 The corresponding structural composition diagram, such as Figure 7 As shown, only the camera on monitor 3 is active (represented by the solid line). Camera 3 captures images and sends the captured image 1 to the switch SW3 on monitor 3. SW3 then sends image 1 to hub 3. Hub 3 then sends image 1 to the USB-C controller 1 and display screen 3 on monitor 3 for display output. Simultaneously, the USB-C controller 1 on monitor 3 sends image 1 to the USB-C controller 2 on monitor 4. The USB-C controller 2 on monitor 4 then sends image 1 to hub 4 on monitor 4. Hub 4 then sends image 1 to the USB-C controller 1 on monitor 4, which in turn sends it to computer 5. In this way, only the camera on monitor 3 is active, and the display screen 3 can display the local image data captured by the camera 3. This enables the computer to select any camera on the cascaded link to capture images as needed.
[0113] Here, the corresponding camera in the display 1, the display 2 and the display 4 can be in an active state or in an inactive state, Figure 7 In the case that the corresponding camera in the display 1, the display 2 and the display 4 is in the active state, the image captured by the camera can be sent to the corresponding SoC through the corresponding SW, but not transmitted outward (as shown by the dotted line).
[0114] Figure 7 In the case that the corresponding camera in the display 1, the display 2 and the display 4 is in the active state, the image captured by the camera can be sent to the corresponding SoC through the corresponding SW, but not transmitted outward (as shown by the dotted line).
[0115] The electronic device provided in the present application can realize image acquisition of the device itself, and can also receive image data sent by the upper-level device and / or send image data acquired by the device itself and / or image data sent by the upper-level device to the lower-level device through the device cascade mode. In this way, the use demand of the user for the image acquired by the multiple cameras can be met. In addition, the computer connected with the cascade device can also select any camera on the cascade device link to acquire image, so that in the video conference scene, the remote device can see the image acquired by any camera, and the range of the image that can be seen is no longer limited.
[0116] Figure 8 A flowchart for implementing the method in the present application is shown in the figure, and the method can be applied to a first device, such as Figure 8 As shown in the figure, the method comprises the following steps:
[0117] Step 801: acquiring first image data through the first device;
[0118] Here, the first device can be a display, which can have an image acquisition device through which the first image data can be acquired.
[0119] Step 802, receiving second image data sent by the second device.
[0120] Here, the first device can have a first interface through which the second device can be connected to receive the second image data sent by the second device. Here, the second image data can be image data acquired by an image acquisition device of the second device, or can be image data acquired by the second device from the fourth device.
[0121] Step 803, sending data including the first image data and the second image data to the third device.
[0122] Here, the first device can have a second interface through which the data including the first image data and the second image data can be sent to the third device.
[0123] Here, the first device can merge or combine the first image data and the second image data to generate third image data, and send the third image data to the third device through the second interface.
[0124] Here, the first device, the second device, the third device, and the fourth device can be connected in series, or the second device, the third device, and the fourth device can be directly connected to the first device.
[0125] Here, the first device can also receive display data sent by the third device through the second interface, and output the display data through its own display device, and of course, at least part of the display data can be sent to the second device through the first interface, or at least part of the display data can be sent to the fourth device through the second device.
[0126] Of course, the data displayed by the first device through its own display device can also be the same as the data content output by the second device and the fourth device.
[0127] Here, the first device, the second device, and the fourth device can all be displays, and the third device can be a computer device having a CPU.
[0128] It should be noted that the processing method provided in the above embodiment and the first device embodiment provided above belong to the same concept, and the specific implementation process is described in detail in the device embodiment, which will not be described here.
[0129] In several embodiments provided in the present application, it should be understood that the disclosed device and method can be implemented in other manners. The embodiments described above are merely exemplary, for example, the division of the apparatus is only a logical function division, and there can be other division manners in actual implementation. For example, a plurality of apparatuses or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed coupling, or direct coupling or communication connection between any two components can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or in other forms.
[0130] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, can be located in one place or distributed on a plurality of network units; part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
[0131] The features disclosed in several product embodiments provided in the present application can be combined arbitrarily without conflict to obtain new product embodiments.
[0132] The features disclosed in several device embodiments provided in the present application can be combined arbitrarily without conflict to obtain new device embodiments.
[0133] The above is merely specific embodiments of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical range disclosed in the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A first device, comprising: an image acquisition apparatus configured to acquire first image data; an image output apparatus; a first interface configured to connect with a second device, receive at least second image data transmitted by the second device, and transmit second display data to the second device, so that the second display data is displayed on an image output apparatus of the second device, wherein the second image data comprises image data acquired by an image acquisition apparatus of the second device; a second interface configured to connect with a third device, transmit at least data comprising the first image data and the second image data to the third device, and receive first display data transmitted by the third device, so that the first display data is displayed on the image output apparatus, wherein the first display data comprises the second display data. 2.The first device of claim 1, further comprising: a processor configured to merge the first image data and the second image data to obtain third image data, or combine the first image data and the second image data to obtain third image data; the second interface configured to transmit at least the third image data to the third device. 3.The first device of claim 2, wherein the second image data is combined data of image data acquired by an image acquisition apparatus of the second device and image data received by the second device from a fourth device, and the image data transmitted by the fourth device comprises at least image data acquired by an image acquisition apparatus of the fourth device; the processor is specifically configured to merge the first image data, the image data acquired by the image acquisition apparatus of the second device, and the image data acquired by the image acquisition apparatus of the fourth device to obtain the third image data. 4.The first device of claim 3, wherein the image data transmitted by the fourth device is combined data of image data acquired by an image acquisition apparatus of the fourth device and image data received by the fourth device from a fifth device, and the image data transmitted by the fifth device comprises at least image data acquired by an image acquisition apparatus of the fifth device; the processor is specifically configured to merge the first image data, the image data acquired by the image acquisition apparatus of the second device, the image data acquired by the image acquisition apparatus of the fourth device, and the image data acquired by the image acquisition apparatus of the fifth device to obtain the third image data. 5.The first device of claim 1, further comprising: a selection apparatus configured to determine a target device in candidate devices in response to a selection instruction, wherein the candidate devices comprise at least the first device, the second device, and a fourth device connected with the second device, and the second image data is combined data of image data acquired by an image acquisition apparatus of the second device and image data transmitted by the fourth device, and the image data transmitted by the fourth device comprises at least image data acquired by an image acquisition apparatus of the fourth device; the second interface configured to transmit image data corresponding to the target device to the third device. 6. The first device of claim 5, wherein the second interface is further configured to receive the selection instruction sent by the third device, the selection instruction carrying at least a device identifier. The first interface is further configured to send an image capturing instruction to the second device based on the device identifier, so that the second device performs image capturing by an image capturing apparatus of the second device based on a device identifier carried in the image capturing instruction; and / or, send the image capturing instruction to the fourth device, so that the fourth device performs image capturing by an image capturing apparatus of the fourth device based on the device identifier carried in the image capturing instruction.
7. The first device of claim 1, wherein the first display data comprises a plurality of sub-display data, each of the sub-display data corresponding to an identifier, the identifier being used to indicate a display order of each of the sub-display data on a corresponding device. The first device further comprises: a processor configured to determine a first sub-display data from the plurality of sub-display data based on the identifiers; the image output apparatus is further configured to display the first sub-display data; the first interface is specifically configured to send remaining sub-display data in the plurality of sub-display data except the first sub-display data to the second device, so that the second device displays a corresponding second sub-display data from the remaining sub-display data based on the identifiers by an image output apparatus of the second device; or, send the remaining sub-display data to a fourth device connected to the second device, so that the fourth device displays a corresponding third sub-display data from the remaining sub-display data based on the identifiers by an image output apparatus of the fourth device.
8. A processing method applied to a first device, comprising: capturing first image data by the first device; receiving second image data sent by a second device; receiving first display data sent by a third device, so that the first display data is displayed on an image output apparatus of the first device; sending data comprising the first image data and the second image data to the third device, and sending second display data to the second device, so that the second display data is displayed on an image output apparatus of the second device, the first display data comprising the second display data.
9. The method of claim 8, wherein, The method further comprises: determining a target device from candidate devices in response to a selection instruction, the target device comprising the first device, the second device, and a fourth device connected to the second device; sending image data corresponding to the target device to the third device.
Citation Information
Patent Citations
Method and device for controlling camera shooting device
CN105979196A
Camera, camera system and data transmission system
CN112449148A
Data transmission method and electronic equipment
CN114554037A
Imaging apparatus, electronic device and imaging system
US20170359552A1