Video acquisition circuit, electronic equipment and vehicle driving system
By using an N-stage deserializer and an N-1-stage serializer in the video acquisition circuit, the problem of limited chip interfaces was solved, ensuring sufficient interface resources for multi-channel camera modules and improving the user experience.
Patent Information
- Application Number
- CN202520320656.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-26
- Publication Date
- 2026-02-27
- Estimated Expiration
- 2035-02-26
AI Technical Summary
The limited number of MIPI interfaces on the chip makes it impossible to meet the requirements of scenarios with multiple interface transmissions, thus reducing the user experience.
The video acquisition circuit design employs an N-stage deserializer and an N-1-stage serializer. A serializer is connected between every two stages of the deserializer. The serializer serializes the video data of multiple camera modules, and multiple modules are connected through a single interface, making full use of interface resources.
The system provides ample interface resources for multi-camera modules, enhancing the user experience.
Smart Images
Figure CN223957591U_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The utility model relates to video monitoring technical field especially, it is a kind of video acquisition circuit, electronic equipment and vehicle driving system. BACKGROUND
[0002] Mobile industry processor interface (Mobile Industry Processor Interface, MIPI) is a kind of high-speed serial interface, is widely used in mobile device, to realize the high-speed data transmission between camera and display. Some corresponding MIPI interface quantity on chip is limited, resulting in it will limit the number of simultaneously connected camera or display number, further unable to meet the scene requirement of multiple interface transmission, reduce the experience of user.
[0003] Therefore, how to meet the requirement of interface resource sufficient of multiple interface transmission, to improve the experience of user is the technical problem that the technical personnel in the field urgently need to solve. UTILITY MODEL CONTENT
[0004] The utility model aims at providing a kind of video acquisition circuit, electronic equipment and vehicle driving system, to solve the problem that the interface of chip is limited and cannot meet the scene requirement of multiple interface transmission, to reduce the experience of user.
[0005] To solve the above technical problems, the utility model provides a kind of video acquisition circuit, including N level deserializers and N-1 level serializers;Wherein, between every two deserializers, connect one level serializer;
[0006] Processor connects first deserializer, and the first deserializer connects first serializer;The first serializer connects the next level deserializer of first level, until the connection N-1 level serializer, N-1 level serializer connects N level deserializer, and N level deserializer connects at least one camera, for gathering the video data of at least one camera by N level deserializer and N-1 level serializer transmission.
[0007] In one aspect, N is 2, and N level deserializer includes first level deserializer and second level deserializer;
[0008] The processor connects first level deserializer, and the first level deserializer connects first level serializer, and the first level serializer connects second level deserializer, and the second level deserializer connects at least one camera;Wherein, the number of first level serializer is same with the interface number of deserializer of first level deserializer.
[0009] In another aspect, the connection relationship of N level deserializer and N-1 level serializer constitutes first acquisition branch;
[0010] Correspondingly, further include:
[0011] At least one camera is connected to the first deserializer to form a second acquisition branch.
[0012] On the other hand, the target deserializer other than the first deserializer is connected to a first target camera to form a first sub-acquisition branch of the first acquisition branch.
[0013] A second target camera is connected to the remaining deserializers other than the target deserializer and the first deserializer to form a second sub-acquisition branch of the first acquisition branch.
[0014] On the other hand, the target deserializer other than the first deserializer is connected to a first target camera to form a first sub-acquisition branch of the first acquisition branch.
[0015] A second target camera is connected to the first deserializer to form a first sub-acquisition branch of the second acquisition branch.
[0016] On the other hand, the models of the deserializers of the N-level deserializers are the same, and the models of the serializers of the N-1-level serializers are the same.
[0017] On the other hand, the number of interfaces of the deserializers of the N-level deserializers is the same.
[0018] On the other hand, the utility model still includes a memory.
[0019] The memory is connected to the processor to store the acquired video data.
[0020] To solve the above technical problems, the utility model also provides an electronic device, including:
[0021] At least one camera is used for shooting video data.
[0022] At least one camera is connected to the video acquisition circuit to send the video data to the video acquisition circuit to complete acquisition.
[0023] To solve the above technical problems, the utility model also provides a vehicle driving system, including the video acquisition circuit.
[0024] The video acquisition circuit provided by the utility model, the acquisition circuit between the processor and the camera, one level serializer is connected between every two levels of deserializers, considering that the interface resources of the processor are limited, on the basis of the first level deserializer of the acquisition circuit, the addition of the serializer makes the video data of the multi-path camera module serialized, the serialized data occupies one interface of the first level deserializer in the mode of one interface, realizing that the access of the multi-path module is realized through one interface. In addition, in the utility model, through the access of the N level deserializers, when each level deserializer continues to connect the next level serializer, the multi-path camera can be connected by each level deserializer, the next level deserializer can also realize the connection of the multi-path camera, the interface resources of the deserializer are fully utilized to access the multi-path camera module, one interface is used to access when the multi-path camera module finally reaches the first level deserializer, the requirement of sufficient interface resources for multiple interface transmission is met, and the experience of the user is improved.
[0025] In addition, the utility model also provides an electronic equipment and vehicle driving system, has same beneficial effect with above-mentioned video acquisition circuit. BRIEF DESCRIPTION OF DRAWINGS
[0026] In order to more clearly illustrate the utility model embodiment, the following will be to the embodiment needed to use the drawing do simple introduction, obviously, the following description in the drawing only some embodiments of the utility model, for those skilled in the art, under the premise of not paying creative labor, other drawings can also be obtained according to these drawings.
[0027] Figure 1 The structure diagram of the video acquisition circuit provided by the utility model embodiment is shown in the figure.
[0028] Figure 2 The structure diagram of another video acquisition circuit provided by the utility model embodiment is shown in the figure.
[0029] Figure 3 The structure diagram of the video acquisition circuit provided by another embodiment of the utility model is shown in the figure.
[0030] Figure 4 The structure diagram of the video acquisition circuit corresponding to the two acquisition branches provided by the utility model embodiment is shown in the figure. DETAILED DESCRIPTION
[0031] The technical scheme in the utility model embodiment will be clearly and completely described below in combination with the drawings in the utility model embodiment, obviously, the described embodiment only is a part of the utility model, not all embodiments. Based on the embodiment in the utility model, all other embodiments obtained by those skilled in the art without making creative labor belong to the protection scope of the utility model.
[0032] The utility model discloses a video acquisition circuit, electronic equipment and vehicle driving system, to solve the interface of chip is limited and leads to the scene requirement of multiple interface transmission cannot be satisfied, to reduce the experience of user's problem.
[0033] In order to make the personnel in the technical field better understand the utility model scheme, the utility model is further explained in detail below in combination with the drawings and specific embodiments.
[0034] Vehicle camera passes through the coaxial cable, and the data packet is sent out in the series mode, and then the data after series is received through the deserializer, and the data is deserialized, so that the data is restored to the original pattern, so as to transmit the original data to the processor through the camera serial interface second edition (Camera Serial Interface 2, CSI2) protocol for subsequent video data processing. In this process, the deserializer has only four GMSL interfaces, which means that the traditional hardware connection mode can only access 4 modules, leading to the scene of multiple interface cameras cannot be satisfied. The video acquisition circuit provided by the utility model can solve the above technical problems.
[0035] Figure 1 The structure diagram of a video acquisition circuit provided by the utility model embodiment is as shown in Figure 1 The circuit includes N-stage deserializers and N-1-stage serializers, wherein one-stage serializer is connected between every two deserializers.
[0036] The processor 1 is connected with the first-stage deserializer, the first-stage deserializer is connected with the first-stage serializer, the first-stage serializer is connected with the next-stage deserializer of the first stage, until the N-1-stage serializer, the N-1-stage serializer is connected with the N-stage deserializer, and the N-stage deserializer is connected with at least one camera 2, for collecting the video data of at least one camera 2 transmitted by the N-stage deserializer and the N-1-stage serializer.
[0037] Specifically, the deserializer receives the serial data stream transmitted through the transmission medium (such as optical cable or copper wire), recovers the clock signal through the internal clock data recovery circuit, and parses the serial data into multiple parallel data bits according to the specific protocol or timing. It usually also contains data buffer, error detection and correction mechanism to ensure the accuracy and integrity of the data.
[0038] The main function of the serializer is to convert parallel data into serial data stream for transmission in high-speed transmission medium (such as optical fiber or copper cable), which is used in conjunction with the deserializer.
[0039] In this embodiment, assuming the processor fully considers interface resources, one interface corresponds to the connection of both a deserializer and a serializer. The number of deserializers and serializers can be determined based on the premise that the bandwidth meets the transmission requirements. Similar connection relationships can also be formed on other interfaces of the processor. If it is considered that the interface already meets the transmission needs of video data from multiple cameras, other interfaces can either be connected only to deserializers or remain idle.
[0040] In this embodiment, the number of deserializers corresponding to each level of deserializer is different. Since the first-level deserializer is connected to the processor, the maximum number of deserializers that the processor can allow to connect determines the number of the first-level deserializers. The number of the second-level deserializers is determined based on the number of interfaces of the first-level deserializer, and so on. The number of the next-level deserializers is based on the number of interfaces of each deserializer in the previous-level deserializer. It should be noted that the number of deserializers at each level here corresponds to the maximum number. The maximum number of serializers at each level is determined based on the number of interfaces of the connected upper-level deserializer. In the connection relationship between deserializers and serializers connected to one interface of the processor, the relationship between the number of deserializer levels and the number of serializer levels is N-level deserializers and N-1-level serializers, with one level of serializer connected between every two levels of deserializers.
[0041] The Nth-level deserializer connects to modules. In the (N-1)th-level serializer, multiple modules connected to the Nth-level deserializer are serialized, forming serial data with the same number of serializers corresponding to the (N-1)th-level serializer. This connects to the (N-1)th-level deserializer. Considering the number of interfaces connected to each deserializer in the (N-1)th-level deserializer, it continues to connect to the (N-2)th-level serializer, forming serial data with the same number of serializers corresponding to the (N-2)th-level serializer, until reaching the first-level serializer, forming serial data with the same number of serializers corresponding to the first-level serializer. In this embodiment, since it is a single interface of the processor, the number of connections to the first-level serializer is one. Therefore, the video data from multiple cameras is serialized into a single serial data, achieving full utilization of interface resources.
[0042] The video acquisition circuit provided by the embodiment of the utility model, the acquisition circuit between the processor and the camera, connect a serializer between every two deserializers, considering the interface resource of the processor is limited, on the basis of the first deserializer of the acquisition circuit, the addition of the serializer makes the video data of the multi-path camera module serializes, the serialized data occupies an interface of the first deserializer in a way of one interface, realizing the access of the multi-path module through one interface. In addition, in the utility model, through the access of N deserializers, when each deserializer continues to connect the next serializer, the multi-path camera can be connected by each deserializer, the next deserializer can also realize the connection of the multi-path camera, the interface resource of the deserializer is fully utilized to access the multi-path camera module, when the multi-path serializers finally access the first deserializer, one interface is adopted to access, the requirement of sufficient interface resource of multiple interface transmission is met, and the experience of the user is improved.
[0043] In some embodiments, N is 2, and the N deserializers include a first deserializer and a second deserializer.
[0044] The processor is connected with the first deserializer, the first deserializer is connected with a first serializer, the first serializer is connected with the second deserializer, and the second deserializer is connected with at least one camera.
[0045] Figure 2 Another structure diagram of a video acquisition circuit provided by the embodiment of the utility model is shown in FIG. 2. Figure 2 As shown in FIG. 2, taking one interface of the processor 1 as an example, the processor 1 is connected with the first deserializer, the first deserializer is connected with the first serializer, the first serializer is connected with the second deserializer, and the second deserializer is connected with at least one camera 2. In the setting process, considering the problem of full utilization of interface resources, the number of the first serializers is the same as the number of the interfaces of the deserializers of the first deserializer.
[0046] The connection relationship between the two deserializers and the one serializer provided by the embodiment improves the utilization rate of the interface resources, and in the connection of the camera module, the deserializer is connected first, then the one serializer is connected, so as to serialize the video data of the multi-path camera module, and then the serialized data is connected with the first deserializer, thereby ensuring the transmission of the data to the processor.
[0047] Figure 3 A structure diagram of a video acquisition circuit provided by another embodiment of the utility model is shown in FIG. 3. Figure 3 As shown in FIG. 3, the structure diagram of the video acquisition circuit includes three deserializers and two serializers, and taking the connection of the second deserializer corresponding to one interface of the processor 1 as an example, if the second deserializer has four interfaces, one of the interfaces is connected with the second serializer, and the remaining three interfaces are connected with the camera 2 module to transmit the corresponding video data.
[0048] In some embodiments, the connection relationship of the N-level deserializer and the N-1 level serializer constitutes a first acquisition branch;
[0049] Correspondingly, it also comprises:
[0050] At least one camera is connected to the first-level deserializer to constitute a second acquisition branch.
[0051] Specifically, in the embodiment, considering that the connection relationship of the N-level deserializer and the N-1 level serializer is realized in the case of full utilization of interface resources, in the actual application process, in addition to considering the interface resource utilization and determining the actual number of modules connected, the number of devices and the circuit area occupied are also considered in the circuit design process, and here the second acquisition branch is realized by connecting the camera module to the first-level deserializer, and the first-level deserializer is corresponding to the N-level deserializer.
[0052] Figure 4 The video acquisition circuit structure diagram corresponding to the two acquisition branches provided by the embodiment of the utility model is shown in Figure 4 The camera 2 of the 1V8M and 1V2M two modules is connected to the first-level deserializer, occupies two interfaces of the first-level deserializer, and constitutes a second acquisition branch. One of the interfaces of the first-level deserializer constitutes a first acquisition branch through the connection relationship of the N-level deserializer and the N-1 level serializer. Here, 1V8M corresponds to a camera system with 1 video input, and the resolution of the video is 8 million pixels (8 Megapixels, 8M), and 1V2M corresponds to a camera system with 1 video input, and the resolution of the video is 2 million pixels (2 Megapixels, 2M). In the first acquisition branch, 4V2M corresponds to a camera system with 4 video inputs, and the resolution of each video is 2 million pixels.
[0053] The two acquisition branches provided by the embodiment reduce the number of devices and save costs under the condition of ensuring full utilization of interface resources.
[0054] In some embodiments, considering that the video data generated by the camera is interfered or cannot be transmitted in the transmission process, resulting in reduced accuracy of the video data received by the processor or the inability to receive any video data. Therefore, in addition to the first-level deserializer, the target-level deserializer is connected to the first target camera to constitute a first sub-acquisition branch of the first acquisition branch;
[0055] The second target camera is connected to the remaining level deserializer except the target-level deserializer and the first-level deserializer to constitute a second sub-acquisition branch of the first acquisition branch; wherein the first target camera and the second target camera both acquire video data of the same angle range.
[0056] Specifically, considering that the interference degree is different in the process of video data transmission, in the process of collecting video, two cameras are used to realize the redundancy of the main and standby modes, forming two different collection branches, in the embodiment, the two different collection branches are located in the first collection branch, and the two different collection branches are located in the first collection branch. Figure 3 For example, the first target camera is located at an interface of the second level deserializer, and the second target camera is located at an interface of the third level deserializer, which corresponds to different sub-collection branches.
[0057] It should be noted that the interface of the camera has only one, so in the redundancy process, the first target camera and the second target camera collect video data of the same angle range to form multiple same video data.
[0058] The embodiment provides a transmission of multiple sub-collection branches in the first collection branch to form the same video data, so as to improve the anti-interference of video transmission.
[0059] In other embodiments, the target level deserializer except the first level deserializer is connected with the first target camera, and constitutes the first sub-collection branch of the first collection branch.
[0060] The second target camera is connected with the first level deserializer, and constitutes the first sub-collection branch of the second collection branch; wherein the first target camera and the second target camera collect video data of the same angle range.
[0061] Specifically, unlike the above-mentioned embodiment, the two sub-collection branches are located in different total collection branches, so as to realize that the two collection branches are completely different, and if all the branches are damaged in the process of receiving in the processor, the other branch is completely received.
[0062] The embodiment provides transmission of the same video data formed in different collection branches, which further improves the anti-interference of video transmission and the flexibility and diversity of the collection branch.
[0063] In some embodiments, the models of the level deserializers of the N-level deserializer are the same, and the models of the level serializers of the N-1-level serializer are the same.
[0064] Considering that the level deserializers and the level serializers have multiple models in the transmission process, the corresponding models are different, so as to support multiple video transmission standards and bandwidth requirements. The deserializers and serializers of different models provide more flexible system design.
[0065] Considering that the sampling circuit is standardized and uniformly designed in the early stage of design, such as in the same batch of equipment produced in a factory, or in a specific and closed video monitoring system, the deserializer of the same model can ensure compatibility and interoperability, and simplify system design and maintenance.
[0066] In some embodiments, the number of interfaces of each stage of the N-stage deserializer is the same.
[0067] In the process of video transmission, different types of deserializers may have different numbers of interfaces to meet different application requirements, such as a single-channel deserializer, a single-channel deserializer, and a programmable number of interfaces.
[0068] In this embodiment, at the initial design stage, the number of interfaces of each stage of the deserializer is the same to simplify the system design and avoid design errors caused by mismatched interfaces. The same number of interfaces means that each stage of the deserializer can better accommodate each other, reducing signal transmission problems caused by differences in the number of interfaces and improving the overall interoperability of the system. It can also reduce the diversity of hardware interfaces, thereby reducing hardware costs and wiring complexity, while making data management more flexible and efficient.
[0069] In some embodiments, it also includes a memory;
[0070] The memory is connected to the processor and is used to store the collected video data.
[0071] In this embodiment, the addition of the corresponding memory takes into account that the processor also has data storage capabilities, but its storage space is small. The memory uses a hierarchical structure to improve data access efficiency, storing frequently accessed data and instructions close to the processor to reduce processor waiting time. The auxiliary memory provides a larger storage space to meet long-term storage needs.
[0072] The cooperative work of the memory and the processor can ensure that the data reaches the processor quickly when needed, while allowing for flexible expansion and improving overall performance.
[0073] The processor distinguishes and identifies camera video data from different modules by decoding the corresponding video data in the process of collecting video data. This can be done through a serial number identification method or through pin marking identification, without limitation.
[0074] As for the model of the processor, it can be a system on chip (SoC), or it can be other chips, without limitation, and it can be set according to actual conditions.
[0075] Further, the utility model also provides an electronic equipment, including:
[0076] At least one camera for shooting video data;
[0077] At least one camera is connected to the video acquisition circuit as described above to send video data to the video acquisition circuit to complete the acquisition.
[0078] For the electronic equipment provided by the utility model, please refer to the above-mentioned circuit embodiment, and the utility model will not repeat here, which has the same beneficial effects as the above-mentioned video acquisition circuit.
[0079] Further, the utility model also provides a vehicle driving system, including above-mentioned video acquisition circuit.
[0080] For the vehicle driving system provided by the utility model, please refer to the above-mentioned circuit embodiment, and the utility model will not repeat here, which has the same beneficial effects as the above-mentioned video acquisition circuit.
[0081] The above-mentioned video acquisition circuit, electronic equipment and vehicle driving system provided by the utility model are introduced in detail. The embodiments in the specification are described in a progressive manner, and each embodiment mainly explains the difference from other embodiments, and the same or similar parts of each embodiment can be referred to. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the related parts can be referred to the method part. It should be pointed out that for ordinary skilled in the art, without departing from the principle of the utility model, the utility model can be improved and modified, and these improvements and modifications also fall within the protection scope of the utility model.
[0082] It should be further noted that in the specification, the relationship terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between the entities or operations. Moreover, the terms "include", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or equipment including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or equipment. Without more limitations, the element limited by the statement "including a" does not exclude the presence of other identical elements in the process, method, article or equipment including the element.
Claims
1. A video capture circuit, comprising: The N-level deserializer and the N-1 level serializer are connected; wherein, one level serializer is connected between every two levels of deserializer; The processor is connected with the first level deserializer, the first level deserializer is connected with the first level serializer, the first level serializer is connected with the next level deserializer of the first level, until the N-1 level serializer, the N-1 level serializer is connected with the N level deserializer, and the N level deserializer is connected with at least one camera for collecting video data of the at least one camera transmitted by the N level deserializer and the N-1 level serializer.
2. The video capture circuit of claim 1, wherein, N is 2, and the N level deserializer includes a first level deserializer and a second level deserializer; The processor is connected with the first level deserializer, the first level deserializer is connected with the first level serializer, the first level serializer is connected with the second level deserializer, and the second level deserializer is connected with at least one camera; wherein, the number of the first level serializer is same as the number of the interface of the deserializer of the first level deserializer.
3. The video capture circuit of claim 1 or 2, wherein, The connection relationship of the N level deserializer and the N-1 level serializer constitutes a first acquisition branch; Correspondingly, further comprising: At least one camera is connected with the first level deserializer to constitute a second acquisition branch.
4. The video capture circuit of claim 3, wherein, The target level deserializer except the first level deserializer is connected with the first target camera to constitute a first sub-acquisition branch of the first acquisition branch; The second target camera is connected with the remaining level deserializer except the target level deserializer and the first level deserializer to constitute a second sub-acquisition branch of the first acquisition branch; wherein, the first target camera and the second target camera both collect video data of the same angle range.
5. The video capture circuit of claim 3, wherein, The target level deserializer except the first level deserializer is connected with the first target camera to constitute a first sub-acquisition branch of the first acquisition branch; The second target camera is connected with the first level deserializer to constitute a first sub-acquisition branch of the second acquisition branch; wherein, the first target camera and the second target camera both collect video data of the same angle range.
6. The video capture circuit of claim 1, wherein, The models of the level deserializers of the N level deserializer are same, and the models of the level serializers of the N-1 level serializer are same.
7. The video capture circuit of claim 1, wherein, The number of the interfaces of the level deserializers of the N level deserializer is same.
8. The video capture circuit of claim 1, wherein, Further comprising a memory; The memory is connected with the processor for storing the collected video data.
9. An electronic device, comprising: Comprising: At least one camera for shooting video data; At least one camera is connected with the video acquisition circuit according to any one of claims 1 to 8 to send the video data to the video acquisition circuit to complete the collection.
10. A vehicle driving system characterized by comprising: The video acquisition circuit according to any one of claims 1 to 8.