A multi-module camera device and its control method
By using a main control circuit and an interface aggregation module to uniformly process video data of different data formats, the hardware complexity caused by differences in video data formats in multi-module camera devices is solved, achieving improved compatibility and integration.
Patent Information
- Application Number
- CN202611278972.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-08-21
- Publication Date
- 2026-11-17
AI Technical Summary
When different types of camera modules are integrated into the same camera device, the differences in their video data formats lead to a complex system hardware structure, consume more interface resources, and reduce the integration level and scalability of multi-module camera devices.
The main control circuit and interface aggregation module are used to process video data of different data formats in a unified manner, and output to external terminal devices through a common interface. A control interface conversion module is set up to realize video data interaction and control communication between multiple camera modules and external terminal devices.
It improves the video output compatibility and system integration of multi-module camera devices, reduces the need for external terminal devices to adapt to different video data formats, and simplifies the hardware structure.
Smart Images

Figure CN123123700A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of camera equipment technology, and in particular to a multi-module camera device and its control method. Background Technology
[0002] With the development of imaging technology, different types of camera modules are being applied to different image acquisition scenarios. For example, in complex environments, it is often necessary to combine different imaging methods to acquire target image information in order to meet the acquisition needs of different scenes, different lighting conditions, or different wavelengths.
[0003] In related technologies, different types of camera modules typically employ their own independent data processing methods, and their output video data formats, interface types, and communication methods may differ. For example, the raw video data output by different camera modules may use different data formats, making it difficult for video data between different camera modules to be directly compatible.
[0004] When multiple different types of camera modules need to be integrated into the same camera device and accessed uniformly through external terminal devices, due to the differences in video data formats of each camera module, it is usually necessary to configure corresponding data processing circuits or independent data transmission interfaces for different camera modules. This makes the system hardware structure complex, consumes more interface resources, and reduces the integration level and expansion capability of multi-module camera devices.
[0005] Therefore, how to achieve unified processing of video data among multiple camera modules with different data format output capabilities is a technical problem that needs to be solved in this field. Summary of the Invention
[0006] The purpose of this invention is to provide a multi-module camera device and its control method, which can uniformly process video data output by multiple camera modules with different data formats, and realize video data interaction between multiple camera modules and external terminal devices through a common interface, thereby improving the video output compatibility and system integration of the multi-module camera device.
[0007] To solve the above-mentioned technical problems, the present invention provides a multi-module camera device, comprising: Multiple camera modules are used to output raw video data, and the raw video data output by the multiple camera modules has at least two different data formats; The main control circuit includes multiple video input channels, which are respectively connected to multiple camera modules. The main control circuit is used to receive the raw video data output by the multiple camera modules and convert the raw video data into video data streams that correspond to the multiple camera modules and conform to a unified video protocol. An interface aggregation module, which is connected to the main control circuit, is used to output multiple video data streams to external terminal devices through a common interface.
[0008] Preferably, it also includes a control interface conversion module; The control interface conversion module is connected to the external terminal device through the interface aggregation module and to multiple camera modules, and is used to establish a control communication path between the external terminal device and the multiple camera modules through the interface aggregation module.
[0009] Preferably, the control interface conversion module includes multiple control interface conversion units; the multiple control interface conversion units are respectively connected between the interface aggregation module and the corresponding camera module, and are used to establish a control communication path between the external terminal device and the corresponding camera module.
[0010] Preferably, the control interface conversion module is connected to the main control circuit, and the control interface conversion module is also used to establish a control communication path between the external terminal device and the main control circuit through the debugging interface and / or control interface of the main control circuit.
[0011] Preferably, the system further includes a format conversion module, which is connected between the interface aggregation module and at least one of the camera modules, and is used to convert the raw video data output by the corresponding camera module into a video data stream that conforms to the unified video protocol.
[0012] To address the aforementioned technical problems, this invention provides a control method for a multi-module camera device, applied to the multi-module camera device as described above, the control method comprising: Acquire device information for the main control circuit and multiple camera modules; Based on the device information, a mapping relationship is established between the external terminal device, the main control circuit, and the multiple camera modules; Based on user input information, control commands are generated corresponding to the main control circuit and each of the camera modules; The control commands are sent to the main control circuit and each of the camera modules based on the mapping relationship via the interface aggregation module and the control interface conversion module. Receive response information returned by the main control circuit and each of the camera modules.
[0013] Preferably, the control instructions include parameter configuration instructions; Based on user input information, control commands are generated corresponding to the main control circuit and each of the camera modules, including: Obtain the configuration parameters from the user input information that correspond to the main control circuit and each of the camera modules; Based on each of the configuration parameters, parameter configuration instructions corresponding to the main control circuit and each of the camera modules are generated respectively.
[0014] Preferably, the control command includes a status query command; Receive response information returned by the main control circuit and each of the camera modules, including: The system receives status data from the main control circuit and each of the camera modules, and determines the operating status of the main control circuit and each of the camera modules based on the status data.
[0015] Preferably, it further includes: Upon receiving a program upgrade instruction, the upgrade program corresponding to the main control circuit and the multiple camera modules is obtained; The upgrade program is sent to the main control circuit and each of the camera modules based on the mapping relationship via the interface aggregation module and the control interface conversion module.
[0016] Preferably, it further includes: The interface aggregation module receives video data streams output by the main control circuit, each corresponding to one of the camera modules. One or more target video channels are determined based on video display instructions; Display the video feed corresponding to the target video channel.
[0017] This application provides a multi-module camera device and its control method. The multi-module camera device includes multiple camera modules, a main control circuit, and an interface aggregation module. The raw video data output by the multiple camera modules has at least two different data formats. Multiple video input channels of the main control circuit are respectively connected to the multiple camera modules to receive the raw video data output by the multiple camera modules, and convert the multiple raw video data into video data streams corresponding to the multiple camera modules and conforming to a unified video protocol. Then, the interface aggregation module outputs the multiple video data streams from the main control circuit to an external terminal device through a common interface. Based on this, video data output by multiple camera modules with different data formats can be processed uniformly, and video data interaction between multiple camera modules and external terminal devices can be realized through a common interface, improving the video output compatibility and system integration of the multi-module camera device. Attached Figure Description
[0018] To more clearly illustrate the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1 A schematic diagram of the structure of a multi-module camera device provided in this application; Figure 2 A schematic diagram of the specific structure of a multi-module camera device provided in this application; Figure 3 A further detailed structural schematic diagram of a multi-module camera device provided in this application; Figure 4 This is a flowchart illustrating a control method for a multi-module camera device provided in this application. Detailed Implementation
[0020] The core of this invention is to provide a multi-module camera device and its control method, which can uniformly process video data output by multiple camera modules with different data formats, and realize video data interaction between multiple camera modules and external terminal devices through a common interface, thereby improving the video output compatibility and system integration of the multi-module camera device.
[0021] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0022] Because different camera modules may use different types of image sensors or different data transmission interfaces, the video data output by multiple camera modules may have inconsistent data formats. When multiple camera modules are connected to the same processing device at the same time, the video data of different formats needs to be processed separately, which makes the internal processing circuit of the device complex, and the external terminal device needs to be adapted to different types of video data interfaces.
[0023] To address the aforementioned issues, this embodiment provides a multi-module camera device. By setting up multiple camera modules, a main control circuit, and an interface aggregation module, the raw video data of different formats output by the multiple camera modules can be processed uniformly and then output to external terminal devices through a common interface, thereby reducing the adaptation requirements of external terminal devices for different video data formats.
[0024] Please refer to Figure 1 , Figure 1 A schematic diagram of a multi-module camera device provided in this application includes: Multiple camera modules 1 are used to output raw video data, and the raw video data output by the multiple camera modules 1 has at least two different data formats; The main control circuit 2 includes multiple video input channels, which are respectively connected to multiple camera modules 1. The main control circuit 2 is used to receive the raw video data output by the multiple camera modules 1 and convert the raw video data into video data streams that correspond to the multiple camera modules 1 and conform to a unified video protocol. Interface aggregation module 3 is connected to main control circuit 2 and is used to output multiple video data streams to external terminal devices through a common interface.
[0025] In this embodiment, multiple camera modules 1 are used to acquire image information from the external environment and output corresponding raw video data. The camera modules 1 can employ different types of image acquisition devices, such as different models of camera sensors or camera modules with different interface types, depending on the actual application requirements. Therefore, the raw video data output by the multiple camera modules 1 may have different data formats.
[0026] Raw video data refers to the video data output by the image sensor in camera module 1 after photoelectric conversion, before it undergoes unified processing by the main control circuit 2 in this embodiment. Since different camera modules 1 may use different image sensors, data transmission methods, or output interfaces, the raw video data output by different camera modules 1 can have different data formats. For example, the raw video data output by one camera module 1 may use a first data format, while the raw video data output by another camera module 1 may use a second data format.
[0027] By setting up multiple camera modules 1 capable of outputting raw video data in different data formats, the multi-module camera device can be made compatible with different types of video acquisition units, thereby improving the camera device's adaptability to different camera modules 1.
[0028] The video input channel of the main control circuit 2 is used to receive the raw video data output by the corresponding camera module 1. Since the data formats output by different camera modules 1 may be different, the main control circuit 2 is equipped with multiple video input channels corresponding to the camera modules 1, so that each camera module 1 can transmit raw video data to the main control circuit 2 through the corresponding video input channel.
[0029] Specifically, one video input channel can be connected to one camera module 1, or, depending on the actual application requirements, one video input channel can process one or more video data streams. Multiple video input channels can simultaneously receive video data output from multiple camera modules 1, avoiding mutual interference between data transmissions between the multiple camera modules 1.
[0030] After receiving the raw video data output by multiple camera modules 1, the main control circuit 2 processes the raw video data of different data formats respectively, and converts the multiple raw video data into a video data stream that conforms to a unified video protocol.
[0031] The unified video protocol refers to the video data transmission format that external terminal devices can recognize. Since the original video data formats output by different camera modules 1 may differ, if video data of different formats are directly transmitted to external terminal devices, the external terminal devices need to parse and process each data format separately, increasing the data processing complexity of the terminal devices.
[0032] In this embodiment, the main control circuit 2 converts raw video data of different formats, so that the video data output by different camera modules 1 are all converted into video data streams that conform to a unified video protocol. For example, the main control circuit 2 can perform data parsing, format conversion, and video encapsulation on the input video data according to the data format corresponding to different camera modules 1, so that the video data output by multiple camera modules 1 has a unified data output format.
[0033] Through the above processing method, even if multiple camera modules 1 output video data in different formats, the main control circuit 2 can still complete the corresponding video data conversion separately, so that the video data of multiple camera modules 1 can be transmitted in a unified format.
[0034] The main control circuit 2 can also independently process the video data received from multiple video input channels according to the data transmission requirements between multiple camera modules 1.
[0035] For example, when multiple camera modules 1 output video data simultaneously, the main control circuit 2 can receive the video data corresponding to each camera module 1 and perform corresponding video processing according to the data status received by each video input channel, so that the video data output by different camera modules 1 can be converted simultaneously.
[0036] By setting up multiple video input channels, the problem of additional data switching when multiple camera modules 1 share a single input channel can be avoided, allowing multiple camera modules 1 to maintain independent video data input paths.
[0037] The common interface of the interface aggregation module 3 refers to the unified interface used for data interaction between external terminal devices and multi-module camera devices. Since the main control circuit 2 has already converted the video data output by different camera modules 1 into video data streams that conform to a unified video protocol, the interface aggregation module 3 does not need to set up independent output interfaces for different camera modules 1. Instead, it can aggregate multiple video data streams and send them to external terminal devices through the common interface.
[0038] Specifically, the interface aggregation module 3 can receive multiple video data streams output by the main control circuit 2 and transmit the multiple video data streams according to the preset data transmission method, so that external terminal devices can simultaneously obtain video data corresponding to multiple camera modules 1 through a common interface.
[0039] By setting up interface aggregation module 3, the number of interfaces between the multi-module camera device and external terminal equipment can be reduced, allowing external terminal equipment to acquire video data collected by multiple camera modules 1 without having to connect to multiple camera modules 1 separately. Interface aggregation module 3 can be, but is not limited to, a USB hub chip. The USB hub chip is not simply an expansion interface, but rather aggregates the video channels corresponding to multiple camera modules 1, as well as the control communication channels corresponding to the main control circuit 2 and multiple camera modules 1, into a common interface.
[0040] Based on this, compared to the method of multiple camera modules 1 outputting video data of different formats to external terminal devices respectively, this embodiment completes the conversion between different video data formats inside the camera device, so that the external terminal device only needs to identify a unified video data protocol to obtain the video data output by multiple camera modules 1, reducing the need for the external terminal device to process different video formats separately.
[0041] Meanwhile, since multiple camera modules 1 can output raw video data in different data formats, the multi-module camera device can adapt to different types of camera modules 1, thus improving the overall compatibility of the device.
[0042] The external terminal device can be a host computer, a mobile handheld terminal, or other devices with video display and control functions; this application does not limit this. The mobile handheld terminal and the interface aggregation module 3 can be connected via a USB extension cable to extend the mobile handheld terminal's mobility. The external terminal device can also be a mobile phone, which can, but is not limited to, interacting with the main control circuit 2 via a Wi-Fi or Bluetooth module. A USB flash drive can be connected to the external terminal device to store the received video data. The main control circuit 2 can, but is not limited to, a SoC (System-on-a-Chip). The main control circuit 2 can not only receive the raw video data output by each camera module 1, but also configure the parameters of each camera module 1. The main control circuit 2 can also store the raw video data or format-converted video data output by each camera module 1 via eMMC.
[0043] In summary, the system can uniformly process video data output from multiple camera modules 1 with different data formats, and realize video data interaction between multiple camera modules 1 and external terminal devices through a common interface, thereby improving the video output compatibility and system integration of the multi-module camera device.
[0044] Based on the above embodiments: Please refer to Figure 2 , Figure 2 This is a schematic diagram of the specific structure of a multi-module camera device provided in this application.
[0045] In a preferred embodiment, the system further includes a format conversion module 4, which is connected between the interface aggregation module 3 and at least one camera module 1, and is used to convert the raw video data output by the corresponding camera module 1 into a video data stream that conforms to the unified video protocol.
[0046] In multi-module camera devices, multiple camera modules 1 typically need to be connected simultaneously. The number of video input channels within the main control circuit 2 is usually determined by chip specifications, hardware resources, and data processing capabilities, and may not be sufficient to meet the access requirements of all camera modules 1. For example, if the number of camera modules 1 requiring connection exceeds the number of video input channels in the main control circuit 2, and all camera modules 1 process data through the main control circuit 2, it is necessary to increase the number of video input channels in the main control circuit 2 or replace it with a main control device that has more input resources, thereby increasing circuit complexity.
[0047] In response to the above situation, this embodiment sets up a format conversion module 4, so that some camera modules 1 do not need to be connected to the main control circuit 2, but instead convert the original video data into a video data stream that conforms to the unified video protocol through the format conversion module 4, and send it directly to the interface aggregation module 3.
[0048] With the above settings, even with a limited number of video input channels in the main control circuit 2, a larger number of camera modules 1 can still be connected, so that the multi-module camera device is not limited by the number of input channels in the main control circuit 2.
[0049] Since different camera modules 1 may use different data output methods, their raw video data output may not directly meet the data input requirements of the interface aggregation module 3. Therefore, the format conversion module 4 converts the raw video data according to the data format output by the camera module 1 and the video data format required by the interface aggregation module 3, so that the output video data stream conforms to the unified video protocol.
[0050] For example, the raw video data output by camera module 1 can be in the first data format, while interface aggregation module 3 needs to receive video data streams that conform to a unified video protocol. In this case, format conversion module 4 can parse, convert, and repackage the video data in the first data format to convert it into a video data stream that interface aggregation module 3 can recognize.
[0051] The format conversion module 4 enables video data output by different types of camera modules 1 to meet the data input requirements of the interface aggregation module 3 without needing to be processed by the main control circuit 2.
[0052] The camera module 1 connected to the format conversion module 4 can be determined according to actual application requirements. Each camera module 1 can also correspond to one format conversion module 4, but this embodiment does not limit this.
[0053] For some camera modules 1, since the main control circuit 2 has a corresponding video input channel, these camera modules 1 can be directly connected to the main control circuit 2, and the main control circuit 2 will complete the reception of raw video data and the conversion and processing of video data.
[0054] For camera modules 1 with more video input channels than the main control circuit 2, they can be connected to the format conversion module 4, which will convert the video data and send it to the interface aggregation module 3.
[0055] The main control circuit 2 is used to process the raw video data output by the camera module 1 connected to its video input channel, and convert the corresponding video data into a video data stream that conforms to the unified video protocol; the format conversion module 4 is used to process the raw video data output by the camera module 1 that cannot be connected to the video input channel of the main control circuit 2, and convert the corresponding video data into a video data stream that conforms to the unified video protocol.
[0056] With the above settings, video data from multiple camera modules 1 can be accessed without increasing the number of input channels of the main control circuit 2, and then uniformly output to external terminal devices through the interface aggregation module 3.
[0057] Compared to connecting all camera modules 1 only through the main control circuit 2, this embodiment does not require replacing the main control circuit 2 with more video input channels, nor does it require setting up an independent output interface for each newly added camera module 1, thereby reducing the hardware adjustment requirements when expanding a multi-module camera device to include multiple camera modules 1.
[0058] In the above manner, the video data transmission path of camera module 1 can be allocated according to the input resources of main control circuit 2 and the number of camera modules 1, so that some video data is processed by main control circuit 2 and some video data is processed by format conversion module 4, thereby meeting the requirement of multiple camera modules 1 being connected at the same time.
[0059] It should be noted that if the external terminal device is a mobile phone that communicates with the main control circuit 2 via a Wi-Fi module or Bluetooth module, then the mobile phone can only control the camera module 1 connected to the main control circuit 2. Therefore, a switch channel can also be configured for each camera module. Before the mobile phone needs to control any camera module, it first connects the camera module 1 to the main control circuit 2 via the switch channel instead of the format conversion module 4. Of course, this application does not limit this.
[0060] The raw video data output by different camera modules can adopt at least two of the following formats, including but not limited to MIPI CSI-2 (MIPI Camera Serial Interface 2), DVP (Digital VideoPort), BT.656, BT.1120, RAW, YUV (Luminance Chrominance), and RGB. For example, the first camera module can output raw video data in RAW format using the MIPI CSI-2 interface, while the second camera module can output raw video data in YUV format using the DVP interface. Since the raw video data output by different camera modules has different data formats, the main control circuit 2 and the format conversion module 4 need to receive raw video data in different formats and convert them into video data streams conforming to a unified video protocol. When the raw video data is in DVP format and the interface aggregation module 3 is a USB HUB chip, the format conversion module 4 can be a DVP to USB chip; however, this application does not limit this.
[0061] As a preferred embodiment, the unified video protocol is the USB video class protocol.
[0062] In this embodiment, the video data output by multiple camera modules 1 is converted into a video data stream conforming to a unified video protocol, and the unified video protocol is further set as a USB (Universal Serial Bus) video protocol, so that the processed video data can be sent to external terminal devices through a public interface.
[0063] The USB video protocol refers to the video device communication protocol used when transmitting video data via the USB interface. It enables the camera device to interact with external terminal devices as a standard video device. Since many terminal devices already have the ability to recognize USB video protocol devices, when the video data output by a multi-module camera device conforms to the USB video protocol, the external terminal device does not need to develop corresponding data parsing programs for different camera modules to obtain the video data output by the camera device.
[0064] Specifically, in this embodiment, the main control circuit 2 is used to receive raw video data output by multiple camera modules 1 and convert the raw video data into a video data stream that conforms to the USB video class protocol.
[0065] Since the raw video data output by multiple camera modules 1 may have different formats, such as different data arrangement, data transmission formats or encoding methods, the main control circuit 2 can process the data separately after receiving the data output by different camera modules 1, so that the video data from different sources can be converted into video data streams that meet the requirements of the USB video class protocol.
[0066] The converted video data streams can have the same data transmission format and the same device identification method, enabling the subsequent interface aggregation module 3 to output data using a unified data transmission method.
[0067] By using the above processing method, the problem of external terminal devices needing to be adapted separately due to different data formats used by different camera modules 1 can be avoided.
[0068] For video data that has not passed through the main control circuit 2, it can be converted into a video data stream that conforms to the USB video class protocol by the format conversion module 4.
[0069] The format conversion module 4 receives the raw video data output by the corresponding camera module 1 and converts the raw video data into a video data stream that conforms to the USB video class protocol.
[0070] In this way, video data from different sources, whether processed by the main control circuit 2 or the format conversion module 4, can be converted into video data streams that conform to the USB video class protocol and output uniformly by the interface aggregation module 3.
[0071] Furthermore, in this embodiment, the interface aggregation module 3 is used to receive video data streams conforming to the USB video class protocol and output them to external terminal devices through a public interface.
[0072] Among them, the public interface can be an interface that can transmit USB video protocol data, used to realize video data interaction between multi-module camera devices and external terminal devices, such as the Type-C interface (Universal Serial Bus Type-C interface).
[0073] Since the video data streams received by the interface aggregation module 3 all conform to the USB video class protocol, the interface aggregation module 3 can send the video data corresponding to multiple camera modules 1 to the public interface according to the preset transmission method, so that external terminal devices can obtain the video data corresponding to multiple camera modules 1 through a public interface.
[0074] For example, when a multi-module camera device includes multiple camera modules 1, the interface aggregation module 3 can send multiple video data streams to an external terminal device through a common interface, enabling the external terminal device to identify the video sources corresponding to the multiple camera modules 1 respectively, and send them to the external terminal device through a USB interface, so that the external terminal device can identify multiple video data sources.
[0075] Specifically, after receiving video data conforming to the USB video protocol, the external terminal device can identify and process the video data in the same way as the general video device data interaction method, without having to set up a separate parsing program for the data format corresponding to each camera module 1.
[0076] Meanwhile, since the video data output by multiple camera modules 1 is converted into a unified protocol format, the interface aggregation module 3 does not need to set different types of data output interfaces for different camera modules 1, thus enabling the output of multiple video data streams through a common interface.
[0077] It should be noted that the use of the USB video protocol as the unified video protocol is only one preferred implementation. In other embodiments, multiple video data streams can be converted into other video protocols that can be recognized by the external terminal device, depending on the data receiving method of the external terminal device and the application requirements. This application does not limit this.
[0078] In a preferred embodiment, a control interface conversion module 5 is also included; The control interface conversion module 5 is connected to the external terminal device through the interface aggregation module 3 and to multiple camera modules 1. It is used to establish a control communication path between the external terminal device and multiple camera modules 1 through the interface aggregation module 3.
[0079] In a multi-module camera device, multiple camera modules 1 not only need to output the collected video data to external terminal devices, but in actual use, the external terminal devices may also need to control the multiple camera modules 1, such as controlling the camera modules 1 to start or stop collecting, adjusting camera parameters, reading the status information of the camera modules 1, or sending configuration parameters to the camera modules 1.
[0080] However, since multiple camera modules 1 typically have their own corresponding control interfaces, and external terminal devices usually only connect to the multi-module camera device through a common interface, external terminal devices cannot directly establish control communication connections with each of the multiple camera modules 1.
[0081] In response to the above situation, this embodiment sets up a control interface conversion module 5, which is connected to an external terminal device through the interface aggregation module 3 and to multiple camera modules 1, so that the external terminal device can establish a control communication path with the multiple camera modules 1 through the interface aggregation module 3.
[0082] Specifically, in this embodiment, the control interface conversion module 5 is connected to multiple camera modules 1 to receive control signals from the camera modules 1 or to send control signals to the corresponding camera modules 1.
[0083] Since different camera modules 1 may use different types of control interfaces, such as different data transmission interfaces or different communication methods, the control signal formats of multiple camera modules 1 may differ.
[0084] The control interface conversion module 5 can convert and process control signals according to the data interaction requirements between the external terminal device and the camera module 1, so that the control information output by the external terminal device can be recognized by the corresponding camera module 1, and the information fed back by the camera module 1 can be transmitted to the external terminal device.
[0085] For example, after an external terminal device sends a control command, the control interface conversion module 5 can receive the control command, convert it according to the control interface format corresponding to the target camera module 1, and then send it to the corresponding camera module 1; when the camera module 1 provides feedback status information, the control interface conversion module 5 can receive the feedback information and convert it into a data format that the external terminal device can recognize.
[0086] In addition to transmitting video data, the interface aggregation module 3 is also used to transmit control signals between the control interface conversion module 5 and external terminal devices, so that both the video data transmission path and the control communication path can be realized through the same common interface.
[0087] Compared to the method of connecting each camera module 1 to an external terminal device separately, this embodiment reduces the number of connections between the external terminal device and multiple camera modules 1, enabling multiple camera modules 1 to interact with the external terminal device through a unified interface.
[0088] In addition, external terminal devices can send control commands to the control interface conversion module 5 through the interface aggregation module 3. The control interface conversion module 5 converts the control commands according to the target camera module 1 corresponding to the control commands and sends them to the corresponding camera module 1.
[0089] Meanwhile, multiple camera modules 1 can also send status information, such as the working status, parameter information, or configuration results of camera modules 1, to external terminal devices through the control interface conversion module 5.
[0090] Since the multi-module camera device includes multiple camera modules 1, different camera modules 1 may need to receive corresponding control information separately. Therefore, the control interface conversion module 5 can set up multiple control communication paths according to the number of camera modules 1 and control requirements, so that external terminal devices can control different camera modules 1 separately.
[0091] For example, when an external terminal device sends information containing the identifier of a target camera module, the control interface conversion module 5 can determine the corresponding camera module 1 based on the identifier and send the control information to the corresponding camera module 1.
[0092] Based on this, during video data transmission, the external terminal device does not need to connect to multiple camera modules 1 separately; it can control multiple camera modules 1 through a common interface. Furthermore, the external terminal device only needs to connect to the multi-module camera device through a single common interface to simultaneously acquire video data from multiple camera modules 1 and send control commands. Moreover, through bidirectional communication, information exchange between the external terminal device and multiple camera modules 1 can be achieved, not just one-way control. Specifically, the video data output by multiple camera modules 1 can be processed by the main control circuit 2 or the format conversion module 4, and then output to the external terminal device through the interface aggregation module 3. During the control process, the control information sent by the external terminal device can be transmitted through the interface aggregation module 3 to the control interface conversion module 5, and further sent to the corresponding camera module 1.
[0093] It should be noted that the configuration of the control interface conversion module 5 is not limited to the above method, and can be adjusted according to the control interface type of the camera module 1 and the data interaction method of the external terminal device.
[0094] For example, the control interface conversion module 5 can be implemented as an independent circuit module, or it can be integrated with the interface aggregation module 3 or the main control circuit 2, as long as it can realize the transmission of control signals between the external terminal device and multiple camera modules 1.
[0095] The control interface conversion module 5 may be, but is not limited to, a serial-to-USB chip, such as a chip that converts data transmitted through a common interface into UART (Asynchronous Serial Communication Port) protocol data. This application does not limit this.
[0096] In a preferred embodiment, the control interface conversion module 5 includes multiple control interface conversion units; the multiple control interface conversion units are respectively connected between the interface aggregation module 3 and the corresponding camera module 1, and are used to establish a control communication path between the external terminal device and the corresponding camera module 1.
[0097] In order to enable external terminal devices to control multiple camera modules 1 separately, the control interface conversion module 5 may include multiple control interface conversion units.
[0098] In related technologies, when multiple camera modules 1 are integrated into the same device, each camera module 1 typically needs to establish a communication connection with the control device separately to perform operations such as parameter configuration, status acquisition, or program updates. As the number of camera modules 1 increases, external terminal devices need to be configured with multiple control interfaces, which not only increases the number of connections but also makes unified management of multiple camera modules 1 inconvenient. Therefore, this embodiment sets up multiple control interface conversion units, enabling external terminal devices to establish control communication paths with multiple camera modules 1 through the interface aggregation module 3, thereby achieving independent control of multiple camera modules 1.
[0099] Specifically, the control interface conversion module 5 includes multiple control interface conversion units, each corresponding to a camera module 1. One end of each control interface conversion unit is connected to the interface aggregation module 3, and the other end is connected to the corresponding camera module 1, for realizing data conversion between different interface forms, so that control data output by external terminal devices can be transmitted to the corresponding camera module 1.
[0100] The specific type of the control interface conversion unit can be determined according to the type of control interface used by the camera module 1. For example, when the camera module 1 uses a serial communication interface for control data transmission, the control interface conversion unit can be used to convert data between the common interface and the serial communication interface; when the camera module 1 uses other types of control interfaces, the control interface conversion unit can also use the corresponding data conversion method. This application does not impose specific limitations in this regard.
[0101] By configuring corresponding control interface conversion units for each of the multiple camera modules 1, control data between different camera modules 1 can be exchanged through their respective transmission paths. When an external terminal device sends control data, it can determine the corresponding control interface conversion unit based on the target camera module and send the control data to the target camera module through that control interface conversion unit, thereby avoiding data transmission conflicts that occur when multiple camera modules 1 share the same control interface.
[0102] Furthermore, the interface aggregation module 3 can receive control data sent by external terminal devices and, according to the connection relationship between different control interface conversion units, send the control data to the corresponding control interface conversion unit. After receiving the control data, the control interface conversion unit converts the control data into a data format that can be recognized by the corresponding camera module 1 and sends it to the corresponding camera module 1.
[0103] In one embodiment, the control interface conversion unit can also receive data returned by the camera module 1, convert the returned data into a data format that can be recognized by the external terminal device, and then transmit it to the external terminal device via the interface aggregation module 3. For example, the camera module 1 can return operating status information, parameter information, or response information, and the external terminal device can determine the working status of the corresponding camera module 1 based on the returned data.
[0104] Through the above configuration, multiple camera modules 1 establish control communication paths with external terminal devices through corresponding control interface conversion units. This allows the external terminal devices to control the multiple camera modules 1 individually based on their respective connection relationships, while avoiding the need for a separate external connection device for each camera module 1, thus improving the integration level of the multi-module camera device. If the number of camera modules needs to be increased in the future, corresponding control interface conversion units can be added for further expansion.
[0105] In a preferred embodiment, the control interface conversion module 5 is connected to the main control circuit 2. The control interface conversion module 5 is also used to establish a control communication path between the external terminal device and the main control circuit 2 through the debugging interface and / or control interface of the main control circuit 2.
[0106] During the operation of the multi-module camera device, the main control circuit 2 not only needs to receive video data output from multiple camera modules 1, but also needs to configure parameters, adjust working status, or debug programs according to actual application requirements. For example, during equipment installation, production testing, or use, external terminal devices may need to send configuration parameters to the main control circuit 2 or read the current operating status of the main control circuit 2.
[0107] However, in existing multi-module camera devices, the main control circuit 2 is usually located inside the device, and external terminal devices cannot directly access the debugging interface or control interface of the main control circuit 2. Therefore, an additional connection path needs to be set up to complete the information interaction between the main control circuit 2 and the external terminal devices.
[0108] Based on this, in this embodiment, the control interface conversion module 5 is connected to the main control circuit 2. The control interface conversion module 5 converts the debugging interface and / or control interface of the main control circuit 2 into a communication interface accessible to external terminal devices, enabling external terminal devices to communicate with the main control circuit 2 through a common connection interface. The debugging interface can be, but is not limited to, a debugging interface, and the control interface can be, but is not limited to, a UART serial port. For example... Figure 3 As shown, Figure 3 This is a further detailed structural diagram of a multi-module camera device provided in this application. The debugging interface is the debugging interface on the main control circuit 2 connected to the control interface conversion module 5. The UART1 serial port is the control interface on the main control circuit 2 connected to the control interface conversion module 5. The UART2, UART3, and UART4 serial ports are respectively... Figure 3 The control interfaces on the three camera modules are connected to the control interface conversion module 5.
[0109] The debugging interface in the main control circuit 2 is used to interact with external terminal devices during the development, production testing, or maintenance of the main control circuit 2. For example, the debugging interface can be used to send debugging commands to the main control circuit 2, read running status information, or configure program parameters in the main control circuit 2.
[0110] The control interface in the main control circuit 2 is used to realize the exchange of control information between the main control circuit 2 and external terminal devices. For example, the external terminal device can send control commands to the main control circuit 2 through the control interface, so that the main control circuit 2 can perform corresponding operations.
[0111] Since different main control circuits 2 may use different chip types, internal resources, and interface forms, the specific forms of the debugging interface and control interface can be determined according to the actual application requirements.
[0112] Furthermore, the debugging and control interfaces in the main control circuit 2 typically adopt interface forms that match the internal communication method of the chip, while the communication interface used by the external terminal device may be different from that of the main control circuit 2. Therefore, the control interface conversion module 5 can receive the interface signals output by the main control circuit 2 and convert them into a data format that the external terminal device can recognize; at the same time, it can also receive control information sent by the external terminal device and convert it into a signal form that the corresponding interface of the main control circuit 2 can recognize.
[0113] For example, when an external terminal device sends a master control configuration command, the control interface conversion module 5 can receive the configuration command, convert it according to the data format corresponding to the debugging interface or control interface of the master control circuit 2, and then send it to the master control circuit 2; when the master control circuit 2 returns status information, the control interface conversion module 5 can convert the status information and send it to the external terminal device.
[0114] Furthermore, external terminal devices can connect to the interface aggregation module 3 via a common interface and access the control interface conversion module 5 through the interface aggregation module 3. In other words, external terminal devices can establish communication connections with multiple camera modules 1 and the main control circuit 2 through the interface aggregation module 3. After receiving control information sent by the external terminal devices, the control interface conversion module 5 converts the control information into signals that the main control circuit 2 can recognize and sends them to the main control circuit 2.
[0115] Meanwhile, the debugging information or status information returned by the main control circuit 2 can also be converted by the control interface conversion module 5 and transmitted to the external terminal device via the interface aggregation module 3.
[0116] Based on this, when it is necessary to debug the program or detect the running status of the main control circuit 2, the control interface conversion module 5 can connect to the debugging interface of the main control circuit 2, so that external terminal devices can send debugging information to the main control circuit 2.
[0117] When it is necessary to configure parameters or control functions of the main control circuit 2, the control interface conversion module 5 can be connected to the control interface of the main control circuit 2, so that external terminal devices can send control information to the main control circuit 2.
[0118] In other embodiments, the control interface conversion module 5 can also be connected to both the debugging interface and the control interface of the main control circuit 2 to meet the information interaction needs of different application scenarios.
[0119] By bringing out the existing debugging / control interface inside the main control circuit 2 through the control interface conversion module 5 and reusing the common connection path provided by the interface aggregation module 3, compared to the method where external terminal devices need to connect to the debugging interface or control interface of the main control circuit 2 separately, this embodiment converts the interface of the main control circuit 2 through the control interface conversion module 5, so that the internal interface of the main control circuit 2 can be connected to the external terminal device through the interface aggregation module 3.
[0120] Therefore, while the video data of multiple camera modules 1 are output through the common interface, external terminal devices can also use the common interface to debug, configure, or acquire the status of the main control circuit 2, thereby meeting the control needs of the multi-module camera device during production, debugging, and use.
[0121] Please refer to Figure 4 , Figure 4 This application provides a flowchart illustrating a control method for a multi-module camera device. The control method is applied to the multi-module camera device described above and includes: S11: Obtain device information corresponding to the main control circuit 2 and multiple camera modules 1; S12: Establish a mapping relationship between external terminal devices, main control circuit 2, and multiple camera modules 1 based on device information; S13: Generate control commands corresponding to the main control circuit 2 and each camera module 1 based on the user input information; S14: Control commands are sent to the main control circuit 2 and each camera module 1 respectively via the interface aggregation module 3 and the control interface conversion module 5 based on the mapping relationship; S15: Receive response information returned by the main control circuit 2 and each camera module 1.
[0122] In a multi-module camera device, there are multiple camera modules 1 and a main control circuit 2. Different devices perform functions such as video acquisition, data processing, and data transmission. In actual use, external terminal devices not only need to receive video data output from the multiple camera modules 1, but also need to control the main control circuit 2 and each camera module 1 according to application requirements.
[0123] However, since multiple camera modules 1 and main control circuit 2 usually have their own corresponding device information and communication interfaces, if the external terminal device cannot distinguish the communication objects corresponding to different devices, it cannot accurately send control commands to the target device.
[0124] Therefore, this embodiment provides a control method that obtains the device information corresponding to the main control circuit 2 and multiple camera modules 1, and establishes a mapping relationship between the external terminal device and each device based on the device information, so that the external terminal device can identify different device objects and send control commands to the corresponding devices according to user input information.
[0125] The device information is used to identify different device objects in the multi-module camera device. The device objects include the main control circuit 2 and multiple camera modules 1. The device information may include device identification information, device type information, device parameter information, or other information that can distinguish different device objects. Specifically, the device identification information includes the manufacturer identification information and product identification information of the camera modules and the main control circuit, i.e., VID / PID (Vendor ID / Product ID).
[0126] For example, different camera modules 1 can each have a corresponding device number or device identifier, and the main control circuit 2 can also have a corresponding device identifier. By obtaining the above device information, the external terminal device can determine which devices are included in the currently connected multi-module camera device.
[0127] Specifically, after the multi-module camera device establishes a connection with the external terminal device, the external terminal device can send a device information acquisition request to the main control circuit 2 and the multiple camera modules 1 through the interface aggregation module 3. After receiving the request, the main control circuit 2 and the multiple camera modules 1 will return the corresponding device information to the external terminal device.
[0128] By acquiring device information corresponding to multiple device objects, external terminal devices can identify the different control objects contained in the currently connected multi-module camera device.
[0129] Furthermore, a mapping relationship is established between the external terminal device, the main control circuit 2, and multiple camera modules 1 based on the device information.
[0130] The mapping relationship is used to represent the correspondence between the controlled object in the external terminal device and the actual device in the multi-module camera device.
[0131] Since the multi-module camera device includes multiple camera modules 1, and different camera modules 1 may be used to collect image information from different directions or different areas, the external terminal device needs to distinguish the data and control objects corresponding to each camera module 1.
[0132] In this embodiment, the external terminal device establishes corresponding relationships with the main control circuit 2 and multiple camera modules 1 based on the acquired device information.
[0133] For example, the external terminal device can establish a correspondence between the first control object and the first camera module 1, and between the second control object and the second camera module 1, based on the device identifier returned by the camera module 1; at the same time, it can establish a correspondence between the corresponding control object and the main control circuit 2.
[0134] By establishing a mapping relationship, when an external terminal device generates a control command, the corresponding actual device can be determined based on the target control object, and the control command can be sent to the corresponding device.
[0135] Furthermore, control commands corresponding to the main control circuit 2 and each camera module 1 are generated based on user input information.
[0136] User input information refers to control operation information input by the user through an external terminal device.
[0137] User input information may include control information for the main control circuit 2, or control information for each camera module 1.
[0138] For example, users can input operation information to adjust the acquisition parameters of camera module 1 through external terminal devices, or input operation information to control the main control circuit 2 for data processing or parameter configuration.
[0139] After receiving user input information, the external terminal device generates control commands based on the user-selected control object and corresponding control content.
[0140] Different control objects correspond to different control commands. For example, control commands generated for the main control circuit 2 can be used to adjust the working state of the main control circuit 2 or to read the status information of the main control circuit 2; control commands generated for the camera module 1 can be used to adjust the acquisition parameters of the camera module 1 or to obtain the operating status of the camera module 1.
[0141] By generating corresponding control commands based on different device objects, external terminal devices can control different devices in a multi-module camera device.
[0142] Furthermore, via the interface aggregation module 3 and the control interface conversion module 5, control commands are sent to the main control circuit 2 and each camera module 1 based on the mapping relationship.
[0143] Specifically, after the external terminal device generates control commands, it determines the target device based on the established mapping relationship and sends the control commands through the interface aggregation module 3.
[0144] Among them, the interface aggregation module 3 is used to provide a data transmission path between external terminal devices and multi-module camera devices.
[0145] The control interface conversion module 5 is used to convert control commands so that the control commands can meet the interface communication requirements of the corresponding main control circuit 2 or camera module 1.
[0146] For example, when the control command corresponds to the main control circuit 2, the control command sent by the external terminal device is converted into control information that the main control circuit 2 can recognize after passing through the interface aggregation module 3 and the control interface conversion module 5, and then sent to the main control circuit 2.
[0147] When a control command corresponds to a certain camera module 1, the control interface conversion module 5 determines the target camera module 1 according to the mapping relationship, and sends the converted control command to the corresponding camera module 1.
[0148] In this way, external terminal devices can send control commands to the main control circuit 2 and multiple camera modules 1 through the same common interface, without having to connect to multiple devices separately.
[0149] Furthermore, it receives response information returned by the main control circuit 2 and each camera module 1.
[0150] The response information refers to the information returned by the main control circuit 2 or the camera module 1 after performing the corresponding operation according to the control command.
[0151] Response information may include execution result information, device status information, parameter information, or other feedback information.
[0152] Specifically, after receiving the control command, the main control circuit 2 or the camera module 1 performs the corresponding operation according to the control command and returns the execution result or current status information to the external terminal device.
[0153] The returned information can be formatted by the control interface conversion module 5 and sent to the external terminal device through the interface aggregation module 3.
[0154] Based on the returned response information, external terminal devices can determine whether the control command has been executed successfully or obtain the current status of the corresponding device.
[0155] In summary, in this embodiment, by acquiring the device information corresponding to the main control circuit 2 and multiple camera modules 1, and establishing a mapping relationship between the external terminal device and different device objects, the external terminal device can identify different control objects in the multi-module camera device. Based on user input information, corresponding control commands are generated and sent to the corresponding devices through the interface aggregation module 3 and the control interface conversion module 5, enabling the external terminal device to control the main control circuit 2 and multiple camera modules 1 separately through a unified connection method.
[0156] Compared to the method of connecting multiple camera modules 1 to external terminal devices separately, this embodiment does not require setting an independent external connection path for each camera module 1. Instead, it establishes corresponding control relationships through device information identification and mapping relationships, enabling external terminal devices to complete information interaction between multiple device objects through a common interface.
[0157] For a description of the control method of the multi-module camera device provided by the present invention, please refer to the above embodiments; the present invention will not be described again here.
[0158] In addition, the device information corresponding to the main control circuit 2 and the multiple camera modules 1 is obtained, specifically including: Obtain the device identification information corresponding to each USB device; The corresponding main control circuit and camera module are determined based on the device identification information.
[0159] In one preferred embodiment, the control instructions include parameter configuration instructions; Based on user input, control commands are generated corresponding to the main control circuit 2 and each camera module 1, including: Obtain the configuration parameters corresponding to the main control circuit 2 and each camera module 1 from the user input information; Based on each configuration parameter, parameter configuration instructions corresponding to the main control circuit 2 and each camera module 1 are generated respectively.
[0160] During the operation of a multi-module camera device, the main control circuit 2 and the multiple camera modules 1 typically have different functions and operating parameters. For example, the main control circuit 2 may be involved in video data processing parameters, while the camera modules 1 may be involved in image acquisition parameters. Since different devices perform different functions, the parameters they need to be configured may also differ.
[0161] In existing multi-module camera devices, when multiple camera modules 1 are connected to the same external terminal device, the external terminal device usually needs to identify different devices and send configuration parameters to the corresponding devices. If the corresponding device identification relationship is missing, the configuration parameters may be sent to the wrong target, such as sending camera module 1 parameters to the main control circuit 2, or sending the configuration parameters of one camera module 1 to another camera module 1.
[0162] Therefore, in this embodiment, configuration parameters corresponding to the main control circuit 2 and each camera module 1 are obtained according to the user input information, and corresponding parameter configuration instructions are generated according to different configuration parameters, so that the external terminal device can configure the parameters of the main control circuit 2 and multiple camera modules 1 respectively.
[0163] Specifically, the configuration parameters corresponding to the main control circuit 2 and each camera module 1 are obtained from the user input information. The user input information refers to the parameter setting operation information input by the user through an external terminal device. The user input information may include configuration parameters input for the main control circuit 2, or configuration parameters input for different camera modules 1.
[0164] For example, users can input the data processing parameters corresponding to the main control circuit 2 through an external terminal device, and at the same time input the acquisition parameters corresponding to the first camera module 1 and the acquisition parameters corresponding to the second camera module 1.
[0165] The external terminal device determines the target device corresponding to different configuration parameters based on the established device mapping relationship, and obtains the configuration parameters corresponding to the main control circuit 2 and each camera module 1 respectively.
[0166] The above method allows external terminal devices to distinguish the configuration content corresponding to different devices, avoiding confusion between configuration parameters of different devices.
[0167] In addition, the configuration parameters can be set according to the functional requirements of the main control circuit 2 and the camera module 1.
[0168] The configuration parameters corresponding to the main control circuit 2 may include parameters used to control the working state of the main control circuit 2, such as data processing parameters, video output parameters, and working mode parameters.
[0169] The configuration parameters corresponding to camera module 1 may include parameters used to control the image acquisition process, such as acquisition resolution parameters, exposure parameters, gain parameters, acquisition mode parameters, etc.
[0170] It should be noted that the specific type of configuration parameters can be determined according to the specific structure of the main control circuit 2 and the camera module 1. This embodiment does not limit the specific content of the configuration parameters.
[0171] After obtaining the configuration parameters of each device, the external terminal device converts the configuration parameters into corresponding parameter configuration commands according to the communication method and data format of different devices.
[0172] For example, when the configuration parameters correspond to the main control circuit 2, the external terminal device generates the main control circuit 2 parameter configuration instruction according to the device identifier corresponding to the main control circuit 2; when the configuration parameters correspond to a certain camera module 1, the external terminal device generates the corresponding camera module 1 parameter configuration instruction according to the device identifier corresponding to the camera module 1.
[0173] The generated parameter configuration instructions can include target device information and corresponding configuration content, enabling the subsequent control process to determine the recipient of the parameter configuration instructions based on the device information.
[0174] After generating the parameter configuration command, the sending path corresponding to the parameter configuration command can be determined according to the pre-established mapping relationship.
[0175] Specifically, the external terminal device searches for the corresponding communication path in the established mapping relationship based on the target device information in the parameter configuration command.
[0176] When the parameter configuration command corresponds to the main control circuit 2, the external terminal device can send the parameter configuration command to the main control circuit 2 through the interface aggregation module 3 and the control interface conversion module 5.
[0177] When the parameter configuration command corresponds to a certain camera module 1, the external terminal device can send the parameter configuration command to the corresponding camera module 1 through the interface aggregation module 3 and the control interface conversion module 5.
[0178] After receiving the corresponding parameter configuration instructions, the main control circuit 2 and the multiple camera modules 1 can adjust their corresponding working states according to the configuration parameters in the parameter configuration instructions.
[0179] For example, after receiving the parameter configuration command, the main control circuit 2 can adjust the video data processing method according to the configuration parameters; after receiving the parameter configuration command, the camera module 1 can adjust the image acquisition status according to the configuration parameters.
[0180] After the adjustment is completed, the main control circuit 2 and each camera module 1 can return response information to the external terminal device to provide feedback on the parameter configuration results.
[0181] Based on this, by obtaining the configuration parameters of the main control circuit 2 and each camera module 1 from the user input information, and generating corresponding parameter configuration instructions according to different configuration parameters, the external terminal device can set the parameters of the main control circuit 2 and multiple camera modules 1 respectively.
[0182] Compared to external terminal devices that can only control the entire device in a unified manner, this embodiment can generate corresponding parameter configuration instructions for different device objects and send the parameter configuration instructions to the corresponding devices through the established mapping relationship, so that multiple camera modules 1 and main control circuit 2 can complete independent parameter configuration under the same communication connection.
[0183] Meanwhile, since the parameter configuration command is sent based on the device mapping relationship, it is not necessary to set up an independent external connection interface for each camera module 1, so that parameter configuration between multiple devices can be realized.
[0184] Therefore, the entity executing the control method can be, but is not limited to, an external terminal device.
[0185] In a preferred embodiment, the control instructions include status query instructions; Receive response information from the main control circuit 2 and each camera module 1, including: It receives status data from the main control circuit 2 and each camera module 1, and determines the operating status of the main control circuit 2 and each camera module 1 based on the status data.
[0186] During the operation of the multi-module camera device, the main control circuit 2 and the multiple camera modules 1 each perform different functions. The main control circuit 2 is used to receive and process the video data output by the multiple camera modules 1, while the camera modules 1 are used to acquire image information. In actual use, external terminal devices not only need to send control information to the main control circuit 2 and the multiple camera modules 1, but also need to obtain the current operating status of each device to determine whether the device is working properly.
[0187] However, since the multi-module camera device includes multiple camera modules 1 and main control circuit 2, each device has an independent operating state. If the external terminal device cannot obtain the status information of different devices, it is impossible to determine the working status of the specific device.
[0188] Therefore, in this embodiment, a status query command is set to send a status query request to the main control circuit 2 and each camera module 1 through an external terminal device, and receive the status data returned by the corresponding device, and determine the operating status of the main control circuit 2 and each camera module 1 based on the status data.
[0189] Status query commands can be generated by external terminal devices based on user input, or they can be automatically generated by external terminal devices according to a preset cycle.
[0190] For example, after the device is started, the external terminal device can send a status query command to obtain whether the main control circuit 2 and multiple camera modules 1 are currently in normal working condition; during the operation of the device, the external terminal device can also send a status query command according to actual needs to obtain the real-time status of the corresponding device.
[0191] The status query command can include target device information to determine the specific device object whose status needs to be queried.
[0192] For example, when it is necessary to query the status of the main control circuit 2, the status query instruction may include the device identifier corresponding to the main control circuit 2; when it is necessary to query the status of a certain camera module 1, the status query instruction may include the device identifier corresponding to the camera module 1.
[0193] After receiving the status query command, the external terminal device determines the corresponding communication path in the pre-established device mapping relationship based on the target device corresponding to the status query command.
[0194] When the status query command corresponds to the main control circuit 2, the external terminal device sends the status query command to the main control circuit 2 through the interface aggregation module 3 and the control interface conversion module 5.
[0195] When a status query command corresponds to a certain camera module 1, the external terminal device sends the status query command to the corresponding camera module 1 through the interface aggregation module 3 and the control interface conversion module 5.
[0196] After receiving the status query command, the main control circuit 2 and the camera module 1 obtain their corresponding status data according to the query request and return it to the external terminal device.
[0197] Status data is used to indicate the current operating status of the main control circuit 2 or the camera module 1. Status data may include device operating status information, parameter status information, connection status information, acquisition status information, or other data that can reflect the device's operating status.
[0198] For example, the status data returned by the main control circuit 2 may include the current working mode, data processing status, or communication status of the main control circuit 2; the status data returned by the camera module 1 may include the image acquisition status, current configuration parameter status, or device connection status.
[0199] It should be noted that the specific content of the status data can be determined according to the functional requirements of the main control circuit 2 and the camera module 1. This embodiment does not limit the specific type of status data.
[0200] After receiving the status data returned by the main control circuit 2 and the camera module 1, the external terminal device identifies the status data and determines the operating status of the corresponding device based on the device identifier corresponding to the status data.
[0201] For example, when the main control circuit 2 receives status data, the external terminal device determines whether the main control circuit 2 is in normal operation based on the status data; when a certain camera module 1 receives status data, the external terminal device determines whether the corresponding camera module 1 is acquiring images normally based on the status data.
[0202] Furthermore, external terminal devices can display the corresponding operating status based on the status data returned by different devices, enabling users to understand the current working status of the main control circuit 2 and multiple camera modules 1.
[0203] When multiple devices return status data simultaneously, external terminal devices can distinguish between different status data based on the device mapping relationship.
[0204] Since the multi-module camera device includes multiple camera modules 1, the status data returned by different camera modules 1 may arrive at the external terminal device at the same time. Therefore, the external terminal device can determine the device object corresponding to the status data based on the device information carried in the status data.
[0205] For example, the first camera module 1 returns first status data, and the second camera module 1 returns second status data. The external terminal device determines the first status data to correspond to the first camera module 1 and the second status data to correspond to the second camera module 1 based on the corresponding device identifier.
[0206] In this embodiment, by generating a status query command and obtaining the status data fed back by the main control circuit 2 and each camera module 1, the external terminal device can query the operating status of multiple device objects through the public interface.
[0207] Compared to the method of connecting multiple camera modules 1 to external terminal devices for status query, this embodiment determines the status query object through device mapping relationship, and completes status data transmission through interface aggregation module 3 and control interface conversion module 5, so that external terminal devices can obtain the operating status of main control circuit 2 and multiple camera modules 1 under the same connection method.
[0208] At the same time, since the status data returned by different devices can be distinguished based on device information, external terminal devices can determine the operating status of different device objects respectively.
[0209] As a preferred embodiment, it also includes: Upon receiving a program upgrade instruction, the upgrade program corresponding to the main control circuit 2 and multiple camera modules 1 is obtained; The upgrade program is sent to the main control circuit 2 and each camera module 1 respectively via the interface aggregation module 3 and the control interface conversion module 5 based on the mapping relationship.
[0210] In a multi-module camera device, the main control circuit 2 and the multiple camera modules 1 typically each have their own corresponding control program or operating program. As equipment functions are adjusted or product maintenance requirements change, it may be necessary to update the programs in the main control circuit 2 or the camera modules 1.
[0211] In existing multi-device camera devices, since the main control circuit 2 and the multiple camera modules 1 each have independent program storage areas, when a program upgrade is required, it is usually necessary to connect to the upgrade interface of the corresponding device and send the upgrade program to each device individually. For devices that include multiple camera modules 1, this upgrade method requires connecting to different devices multiple times, making the operation process quite complex.
[0212] In response to the above situation, in this embodiment, a communication relationship is established between the main control circuit 2, multiple camera modules 1 and external terminal devices in the multi-module camera device, and the corresponding upgrade program is sent to the target device according to the device mapping relationship, so that the external terminal device can complete the program upgrade of multiple device objects through a unified interface.
[0213] Specifically, upon receiving a program upgrade instruction, the upgrade program corresponding to the main control circuit 2 and the multiple camera modules 1 is obtained.
[0214] The program upgrade command is used to trigger the multi-module camera device to perform a program update operation.
[0215] The program upgrade command can be entered by the user through an external terminal device, or it can be generated by the external terminal device according to preset conditions.
[0216] For example, when a user needs to update the main control program in a multi-module camera device or the program for camera module 1, they can send a program upgrade command through an external terminal device. After receiving the command, the external terminal device identifies the device that needs to be upgraded and obtains the corresponding upgrade program.
[0217] The upgrade program refers to the data file used to replace or update the currently running program of the target device. Since the main control circuit 2 and the camera module 1 perform different functions, their corresponding program contents may be different. Therefore, the upgrade program for the main control circuit 2 and the upgrade program for the camera module 1 can be set separately.
[0218] For example, the upgrade program corresponding to the main control circuit 2 can be used to update the video data processing related program, and the upgrade program corresponding to the camera module 1 can be used to update the image acquisition control related program.
[0219] Furthermore, external terminal devices can determine the currently connected main control circuit 2 and each camera module 1 based on the device mapping relationship, and obtain the upgrade program corresponding to different devices.
[0220] The upgrade program can be pre-stored in the external terminal device or retrieved by the external terminal device from other storage devices.
[0221] For example, the external terminal device stores upgrade programs for the main control circuit 2, the first camera module 1, and the second camera module 1. Upon receiving an upgrade command, the external terminal device determines the corresponding device based on the device information and calls the corresponding upgrade program accordingly.
[0222] In other implementations, external terminal devices may also obtain the corresponding upgrade program from external storage locations based on device model, device version information, or device identifier.
[0223] After obtaining the upgrade programs for multiple devices, the external terminal device determines the target device for each upgrade program based on the established mapping relationship.
[0224] When the upgrade program corresponds to the main control circuit 2, the external terminal device sends the upgrade program corresponding to the main control circuit 2 to the main control circuit 2 through the interface aggregation module 3 and the control interface conversion module 5.
[0225] When the upgrade program corresponds to a certain camera module 1, the external terminal device sends the upgrade program corresponding to the camera module 1 to the corresponding camera module 1 through the interface aggregation module 3 and the control interface conversion module 5.
[0226] Among them, the control interface conversion module 5 is used to convert the upgrade data so that the upgrade program can be sent according to the data transmission method corresponding to the target device.
[0227] For example, if the upgrade data format output by the external terminal device is different from the data format that the main control circuit 2 or the camera module 1 can receive, the control interface conversion module 5 can convert the upgrade data so that the target device can receive and recognize the corresponding upgrade program.
[0228] Since the multi-module camera device includes multiple camera modules 1, and different camera modules 1 may have different device identifiers and different program versions, when the external terminal device sends the upgrade program, it is necessary to determine the target object corresponding to each upgrade program.
[0229] For example, the first upgrade program corresponds to the first camera module 1, and the second upgrade program corresponds to the second camera module 1. The external terminal device sends the first upgrade program to the first camera module 1 and the second upgrade program to the second camera module 1 according to the device mapping relationship.
[0230] After receiving the upgrade program, the target device can verify the upgrade program and write it to the corresponding storage area if the upgrade conditions are met.
[0231] For example, after receiving the upgrade program, the main control circuit 2 can update the control program in the main control circuit 2; after receiving the upgrade program, the camera module 1 can update the control program in the camera module 1.
[0232] After the program upgrade is completed, the main control circuit 2 and each camera module 1 can return upgrade response information to external terminal devices.
[0233] Based on the returned response information, external terminal devices can determine whether the corresponding device has completed the program upgrade and display the upgrade response information.
[0234] Furthermore, the program upgrade process in this embodiment can be combined with the aforementioned device identification process.
[0235] Specifically, before the program upgrade is performed, the external terminal device can first obtain the device information corresponding to the main control circuit 2 and multiple camera modules 1, and establish a mapping relationship based on the device information.
[0236] After the mapping relationship is established, the external terminal device determines the target device corresponding to the upgrade program based on the device identifier, and sends the upgrade program through the interface aggregation module 3 and the control interface conversion module 5.
[0237] Based on this, when a program upgrade instruction is received, the upgrade program corresponding to the main control circuit 2 and multiple camera modules 1 is obtained, and based on the device mapping relationship, it is sent to the corresponding devices through the interface aggregation module 3 and the control interface conversion module 5, so that the external terminal device can complete the program upgrade of multiple device objects through the common interface.
[0238] Compared to the method of connecting each camera module 1 to an upgrade device for program updates, this embodiment uses the established device mapping relationship to distinguish different upgrade objects and sends the corresponding upgrade program to the target device through a unified communication path, so that the main control circuit 2 and multiple camera modules 1 in the multi-module camera device can complete the program update respectively.
[0239] Meanwhile, since the upgrade program is sent based on the device mapping relationship, it is not necessary to establish an external connection for each device to complete the program upgrade operation between multiple device objects.
[0240] In addition, before performing the program upgrade, the external terminal device can also obtain the current program version information of the main control circuit 2 and the camera module 1, and determine whether an upgrade is needed based on the current program version.
[0241] When the target device needs an upgrade, obtain the corresponding version of the upgrade program and send it to the target device.
[0242] As a preferred embodiment, it also includes: The interface aggregation module 3 receives video data streams output from the main control circuit 2, which correspond to each camera module 1. One or more target video channels are determined based on video display instructions; Display the video feed corresponding to the target video channel.
[0243] In a multi-module camera device, multiple camera modules 1 can respectively capture video images from different directions, different areas, or different scenes, and output corresponding video data. Since the video data corresponding to the multiple camera modules 1 comes from different sources, in practical applications, external terminal devices may need to view the video images captured by multiple camera modules 1 simultaneously, or select to view the video images corresponding to one or some camera modules 1 according to actual needs.
[0244] In existing multi-camera module 1 devices, multiple camera modules 1 typically correspond to different video output paths, requiring external terminal devices to connect to different video output interfaces to obtain the corresponding video data. As the number of camera modules 1 increases, the number of video inputs that external terminal devices need to process also increases, making it difficult to view multiple video feeds through a unified interface.
[0245] Therefore, in this embodiment, the interface aggregation module 3 receives multiple video data streams output by the main control circuit 2, and determines the target video channel to be displayed according to the video display instructions, so that the external terminal device can select to display the video screen corresponding to one or more camera modules 1.
[0246] Specifically, since multiple camera modules 1 correspond to different video acquisition paths, the video data streams output by the main control circuit 2 can correspond to different camera modules 1 respectively.
[0247] For example, the video data collected by the first camera module 1 is processed by the main control circuit 2 to form a first video data stream, and the video data collected by the second camera module 1 is processed by the main control circuit 2 to form a second video data stream.
[0248] After receiving multiple video data streams, the interface aggregation module 3 can distinguish between different video data streams based on the device information or channel information corresponding to each video data stream, so that subsequent external terminal devices can determine the video source corresponding to different video data streams.
[0249] There is a correspondence between the video data stream and the camera module 1. This correspondence can be determined based on the device identifier of the camera module 1, the video channel identifier, or other information that can distinguish the video source.
[0250] For example, when the interface aggregation module 3 receives the first video data stream, it can determine that the video data stream originates from the first camera module 1 based on the channel information corresponding to the first video data stream; when it receives the second video data stream, it can determine that the video data stream originates from the second camera module 1.
[0251] Furthermore, one or more target video channels are determined based on video display instructions. Video display instructions are used to indicate the video content the user wishes to view. These instructions can be input by the user through an external terminal device, or generated by the external terminal device according to a preset display method.
[0252] For example, when a user wants to view the video footage captured by the first camera module 1, they can select the first video channel through an external terminal device, which will then generate the corresponding video display command based on the user's input.
[0253] When a user wants to view video footage captured by multiple camera modules 1 simultaneously, the video display command can include multiple target video channels.
[0254] The target video channel is used to indicate the transmission channel corresponding to the video data that needs to be displayed.
[0255] For example, the first target video channel corresponds to the first camera module 1, and the second target video channel corresponds to the second camera module 1.
[0256] After determining the target video channel according to the video display instructions, the external terminal device obtains the corresponding video data from multiple video data streams, parses the video data, and generates the corresponding video frame.
[0257] For example, when the target video channel includes the first video channel, the external terminal device displays the video image corresponding to the first camera module 1; when the target video channel includes the first video channel and the second video channel, the external terminal device displays the video images corresponding to the first camera module 1 and the second camera module 1 respectively.
[0258] The display method of multiple video frames can be determined according to actual application requirements. For example, multiple windows can be used to display the video frames corresponding to different camera modules 1, or the video frames of different camera modules 1 can be switched according to a preset method.
[0259] This embodiment does not limit the specific display method, as long as the corresponding video image can be displayed according to the target video channel.
[0260] When displaying video feeds corresponding to multiple target video channels, external terminal devices can process the video data streams corresponding to each target video channel separately.
[0261] Since multiple camera modules 1 can output video data simultaneously, the interface aggregation module 3 can receive multiple video data streams at the same time, and the external terminal device can obtain the corresponding video data according to the multiple target video channels.
[0262] For example, when a user chooses to view the video feeds from multiple camera modules 1 simultaneously, the external terminal device acquires the video data corresponding to each target video channel and generates multiple corresponding video display areas.
[0263] When the target video channel changes, the external terminal device can adjust the displayed video image according to the updated video display instructions.
[0264] For example, if the video feed corresponding to the first camera module 1 is currently being displayed, and the user selects to add a video channel corresponding to the second camera module 1, the external terminal device will obtain the video data corresponding to the second video channel according to the new video display instruction and display the video feed corresponding to the second camera module 1.
[0265] When a user cancels a video channel, the external terminal device stops displaying the video feed corresponding to that video channel.
[0266] Based on this, the interface aggregation module 3 receives the video data streams corresponding to multiple camera modules 1 output by the main control circuit 2, and determines the target video channel according to the video display instructions, so that the external terminal device can select to display the video screen corresponding to one or more camera modules 1.
[0267] Compared to the method of connecting multiple camera modules 1 to external terminal devices for video display, this embodiment receives video data corresponding to multiple camera modules 1 through a unified interface, and selects target video data according to the correspondence between video channels and camera modules 1, so that external terminal devices can view video images captured by multiple camera modules 1 through a single connection.
[0268] Meanwhile, since the video display process is based on the selection of the target video channel, the external terminal device can display the video screen corresponding to one or more camera modules 1 according to actual needs.
[0269] It should also be noted that, in this specification, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
[0270] The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A multi-module camera device, characterized in that, include: Multiple camera modules are used to output raw video data, and the raw video data output by the multiple camera modules has at least two different data formats; The main control circuit includes multiple video input channels, which are respectively connected to multiple camera modules. The main control circuit is used to receive the raw video data output by the multiple camera modules and convert the raw video data into video data streams that correspond to the multiple camera modules and conform to a unified video protocol. An interface aggregation module, which is connected to the main control circuit, is used to output multiple video data streams to external terminal devices through a common interface.
2. The multi-module camera device as described in claim 1, characterized in that, It also includes a control interface conversion module; The control interface conversion module is connected to the external terminal device through the interface aggregation module and to multiple camera modules, and is used to establish a control communication path between the external terminal device and the multiple camera modules through the interface aggregation module.
3. The multi-module camera device as described in claim 2, characterized in that, The control interface conversion module includes multiple control interface conversion units; the multiple control interface conversion units are respectively connected between the interface aggregation module and the corresponding camera module, and are used to establish a control communication path between the external terminal device and the corresponding camera module.
4. The multi-module camera device as described in claim 2, characterized in that, The control interface conversion module is connected to the main control circuit. The control interface conversion module is also used to establish a control communication path between the external terminal device and the main control circuit through the debugging interface and / or control interface of the main control circuit.
5. The multi-module camera device as described in any one of claims 1-4, characterized in that, It also includes a format conversion module, which is connected between the interface aggregation module and at least one of the camera modules, and is used to convert the raw video data output by the corresponding camera module into a video data stream that conforms to the unified video protocol.
6. A control method for a multi-module camera device, characterized in that, The control method, applied to the multi-module camera device as described in any one of claims 1-5, comprises: Acquire device information for the main control circuit and multiple camera modules; Based on the device information, a mapping relationship is established between the external terminal device, the main control circuit, and the multiple camera modules; Based on user input information, control commands are generated corresponding to the main control circuit and each of the camera modules; The control commands are sent to the main control circuit and each of the camera modules based on the mapping relationship via the interface aggregation module and the control interface conversion module. Receive response information returned by the main control circuit and each of the camera modules.
7. The control method for the multi-module camera device as described in claim 6, characterized in that, The control commands include parameter configuration commands; Based on user input information, control commands are generated corresponding to the main control circuit and each of the camera modules, including: Obtain the configuration parameters from the user input information that correspond to the main control circuit and each of the camera modules; Based on each of the configuration parameters, parameter configuration instructions corresponding to the main control circuit and each of the camera modules are generated respectively.
8. The control method for the multi-module camera device as described in claim 6, characterized in that, The control commands include status query commands; Receive response information returned by the main control circuit and each of the camera modules, including: The system receives status data from the main control circuit and each of the camera modules, and determines the operating status of the main control circuit and each of the camera modules based on the status data.
9. The control method for the multi-module camera device as described in claim 6, characterized in that, Also includes: Upon receiving a program upgrade instruction, the upgrade program corresponding to the main control circuit and the multiple camera modules is obtained; The upgrade program is sent to the main control circuit and each of the camera modules based on the mapping relationship via the interface aggregation module and the control interface conversion module.
10. The control method for the multi-module camera device as described in claim 6, characterized in that, Also includes: The interface aggregation module receives video data streams output by the main control circuit, each corresponding to one of the camera modules. One or more target video channels are determined based on video display instructions; Display the video feed corresponding to one or more of the target video channels.
