Camera system and its driving method, vehicle

Abstract

A camera system, its driving method, and a vehicle are disclosed. The camera system includes a first camera module and a second camera module. Both the first and second camera modules include a deserializer and at least one image sensor connected to the deserializer. The driving method includes: configuring the communication addresses of each image sensor of the first camera module via a first bus, and periodically accessing the deserializer of the first camera module via the first bus after the first camera module is configured; configuring the communication addresses of each image sensor of the second camera module via a second bus, and periodically accessing the deserializer of the second camera module via the first bus after the second camera module is configured. By configuring the first and second camera modules respectively via the first and second buses, the unexpected response of the second camera module during periodic access to the first camera module can be avoided, preventing access logic anomalies.

Description

Technical Field

[0001] This application belongs to the field of shooting system technology, and in particular relates to a camera system and its driving method, and a vehicle. Background Technology

[0002] As new energy vehicles place increasingly higher demands on driver assistance functions, the requirements for the number of external cameras and the accuracy of data transmission are also increasing accordingly.

[0003] The current architecture requires the camera system's control device to periodically access the running cameras while also configuring other cameras. If the initial address of a camera that is powered on later conflicts with the communication address of the running device, it will cause abnormal access logic of the control device, affecting driving safety. Summary of the Invention

[0004] The purpose of this application is to provide a camera system and its driving method, as well as a vehicle, which aims to solve the problem of high risk of abnormal access logic of cameras in traditional camera systems.

[0005] A first aspect of this application provides a driving method for a camera system, the camera system comprising: a first camera module and a second camera module, both the first camera module and the second camera module comprising a deserializer and at least one image sensor connected to the deserializer; the driving method comprising: configuring the communication addresses of each image sensor of the first camera module via a first bus, and after the first camera module is configured, periodically accessing the deserializer of the first camera module via the first bus; configuring the communication addresses of each image sensor of the second camera module via a second bus, and after the second camera module is configured, periodically accessing the deserializer of the second camera module via the first bus.

[0006] In one embodiment, the first camera module includes a first power supply chip, a first deserialization chip, and a plurality of first image sensors, wherein the first power supply chip and the first deserialization chip are both connected to each of the first image sensors; configuring the communication addresses of each image sensor of the first camera module via the first bus includes: enabling the first power supply chip and the first deserialization chip to work via the first bus; and configuring the communication addresses of each of the first image sensors via the first bus and the first deserialization chip.

[0007] In one embodiment, periodically accessing the deserializer of the first camera module via the first bus includes periodically accessing the first deserializer chip via the first bus.

[0008] In one embodiment, the second camera module includes a second power supply chip, a second deserialization chip, and multiple second image sensors. The second power supply chip and the second deserialization chip are both connected to each of the second image sensors. Configuring the communication addresses of each image sensor of the second camera module via the second bus includes: enabling the second deserialization chip to operate via the first bus, and controlling the second deserialization chip to disconnect each of the second image sensors from the first bus via the second bus; enabling the second power supply chip to operate via the first bus; configuring the communication addresses of each of the second image sensors via the second bus and the second deserialization chip; and restoring the connection between each of the second image sensors and the first bus after the communication addresses of each of the second image sensors have been configured.

[0009] In one embodiment, the periodic access to the deserializer of the second camera module via the first bus includes: periodically accessing the second deserializer chip via the first bus.

[0010] In one embodiment, the camera system includes a first control module and a second control module, wherein the first bus is connected to the first control module and the second bus is connected to the second control module.

[0011] In one embodiment, the first camera module and the second camera module are respectively connected to the second control module via a corresponding third bus; the driving method further includes: after the first camera module and the second camera module are configured, transmitting the image data output by each image sensor to the second control module.

[0012] A second aspect of this application provides a camera system, including: a first control module, a second control module, a first camera module, and a second camera module; the first control module is connected to the first camera module and the second camera module via a first bus, and the second control module is connected to the second camera module via a second bus; the first control module is configured to configure the first camera module via the first bus, and periodically access the first camera module via the first bus after the first camera module is configured; the second control module is configured to configure the second camera module via the second bus, and the first control module is further configured to periodically access the second camera module via the first bus after the second camera module is configured.

[0013] In one embodiment, a plurality of second camera modules are included; the second control module is used to configure each of the second camera modules sequentially via a second bus, and the first control module is also used to periodically access each of the second camera modules via the first bus after each of the second camera modules has been configured.

[0014] A third aspect of this application provides a vehicle including a camera system for performing the driving method as described above.

[0015] The beneficial effects of this application embodiment compared with the prior art are: by configuring the first camera module and the second camera module through the first bus and the second bus respectively, it is possible to avoid the situation where the second camera module responds unexpectedly and causes access logic abnormalities when the first camera module is accessed periodically. Attached Figure Description

[0016] Figure 1 A flowchart of a driving method provided in an embodiment of this application;

[0017] Figure 2 This is a schematic diagram of a camera system provided in one embodiment of this application;

[0018] Figure 3 This is a schematic diagram of the specific structure of a camera system provided in one embodiment of this application;

[0019] Figure 4 Here is a flowchart of step S100;

[0020] Figure 5 Here is a flowchart of step S200;

[0021] Figure 6 Another flowchart of a driving method provided in an embodiment of this application;

[0022] Figure 7 Another schematic diagram of the camera system provided in one embodiment of this application. Detailed Implementation

[0023] To make the technical problems, technical solutions, and beneficial effects to be solved by this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and are not intended to limit the scope of this application.

[0024] It should be noted that when a component is referred to as being "fixed to" or "set on" another component, it can be directly on or indirectly on that other component. When a component is referred to as being "connected to" another component, it can be directly connected to or indirectly connected to that other component.

[0025] It should be understood that the terms "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this application.

[0026] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0027] It should be noted that a shooting system typically includes a microcontroller unit (MCU) and a system-on-chip (SoC). The MCU is mainly used for overall control of the shooting system, while the SoC is usually dedicated to processing the data output from the cameras. For shooting systems using deserializers, after the MCU configures each camera via the bus, the MCU needs to periodically access the deserializer's registers via the bus to ensure the normal operation of the shooting system.

[0028] However, if a new camera is connected to or started on the bus while the MCU is periodically accessing the deserializer, and the initial communication address of the newly powered-on camera is the same as the communication address / communication address segment in the deserializer's register, the new camera will respond to the access signal and send a feedback signal, making the level signal on the bus unrecognizable, and ultimately causing the shooting system to malfunction.

[0029] Taking the I2C bus as an example, the I2C bus includes two physical traces, and information transmission can be achieved by controlling the voltage levels on these two physical traces. If, when the MCU sends an access signal to the deserializer's register via the I2C bus, both the deserializer's register and the subsequently powered-on camera respond to the access signal and simultaneously configure the voltage levels on the physical traces, the information transmitted on the I2C bus will not be recognized by the MCU, ultimately causing the I2C bus to malfunction.

[0030] For driver assistance systems that rely on camera systems, I2C bus failure will cause the driver assistance system to malfunction.

[0031] Figure 1 A flowchart of a driving method for a camera system according to an embodiment of this application is shown. For ease of explanation, only the parts relevant to this embodiment are shown, and are described in detail below:

[0032] A driving method that can be applied to, for example Figure 2 The camera system shown includes a first camera module 100 and a second camera module 200.

[0033] like Figure 1 As shown, the driving method includes steps S100 to S200.

[0034] Step S100: Configure the communication addresses of each image sensor of the first camera module through the first bus, and periodically access the deserializer of the first camera module through the first bus after the first camera module is configured.

[0035] Step S200: Configure the communication addresses of each image sensor of the second camera module through the second bus, and after the second camera module is configured, periodically access the deserializer of the second camera module through the first bus.

[0036] By configuring the first camera module 100 and the second camera module 200 respectively via the first bus 300 and the second bus 400, the situation where the second camera module 200 unexpectedly responds and causes access logic abnormalities when the first camera module 100 is accessed periodically can be avoided.

[0037] It is understood that the first bus 300 and the second bus 400 can be connected to different control devices or to the same control device to implement steps S100 and S200. This embodiment does not limit them.

[0038] Specifically, the first bus 300 and the second bus 400 can be any one of the following: SPI bus, I2C bus, UART bus, I2S bus, GPIO bus, SDIO bus, and CAN bus.

[0039] Preferably, both the first bus 300 and the second bus 400 can be I2C buses.

[0040] In one embodiment, such as Figure 3As shown, the first camera module 100 includes a first power supply chip 110, a first deserialization chip 120, and a plurality of first image sensors 130. The first power supply chip 110 and the first deserialization chip 120 are both connected to the first bus 300, and the first power supply chip 110 and the first deserialization chip 120 are both connected to each of the first image sensors 130. The first power supply chip 110 is used to supply power to each of the first image sensors 130, and the first deserialization chip 120 is used to configure the communication address of each of the first image sensors 130 and to acquire the image data generated by each of the first image sensors 130.

[0041] like Figure 4 As shown, step S100 specifically includes steps S110 to S130.

[0042] Step S110: Enable the first power supply chip and the first deserialization chip to work via the first bus.

[0043] After the first bus 300 enables the first power supply chip 110, the first power supply chip 110 can supply power to each of the first image sensors 130 so that each of the first image sensors 130 can be powered on and started.

[0044] After the first bus 300 enables the first deserialization chip 120, the first deserialization chip 120 can control each of the first image sensors 130 to power on and start.

[0045] Step S120: Configure the communication address of each first image sensor through the first bus and the first deserialization chip.

[0046] After each first image sensor 130 is powered on, the communication address of each first image sensor 130 can be configured through the first bus 300 and the first deserialization chip 120.

[0047] Step S130: Periodically access the first deserialization chip via the first bus.

[0048] It should be noted that, in order to ensure the normal operation of each first image sensor 130, the registers of the first deserialization chip 120 need to be accessed periodically.

[0049] In some embodiments, the interval between two accesses to the first deserialization chip 120 is 50ms to 500ms, preferably 200ms.

[0050] In one embodiment, the second camera module 200 includes a second power supply chip 210, a second deserialization chip 220, and a plurality of second image sensors 230. Specifically, the second power supply chip 210 and the second deserialization chip 220 are both connected to the first bus 300, and the second deserialization chip 220 is also connected to the second bus 400. The second power supply chip 210 and the second deserialization chip 220 are both connected to each of the second image sensors 230. The second power supply chip 210 is used to supply power to each of the second image sensors 230, and the second deserialization chip 220 is used to configure the communication address of each of the second image sensors 230 and to acquire the image data output by each of the second image sensors 230.

[0051] like Figure 5 As shown, step S200 specifically includes steps S210 to S240.

[0052] Step S210: Enable the second deserialization chip to work through the first bus, and control the second deserialization chip to disconnect each second image sensor from the first bus through the second bus.

[0053] After disconnecting the connection between each second image sensor 230 and the first bus 300 via the second bus 400, the problem of the second image sensor 230 sending feedback signals and causing the level signals on the first bus 300 to become chaotic and unable to be properly identified can be avoided when the first bus 300 periodically accesses the first deserialization chip 120. This is because the communication address or communication address fragment of some registers in the first deserialization chip 120 is the same as the initial address of the second image sensor 230.

[0054] Therefore, after disconnecting the connection between each of the second image sensors 230 and the first bus 300, the signals on the first bus 300 will not affect the normal configuration of each of the second image sensors 230, and the second image sensors 230 will not affect the periodic access to the first deserialization chip 120.

[0055] Step S220: Enable the second power supply chip to work via the first bus.

[0056] After the first bus 300 enables the second power supply chip 210, the second power supply chip 210 can supply power to each of the second image sensors 230 so that each of the second image sensors 230 can be powered on and started.

[0057] Step S230: Configure the communication address of each second image sensor through the second bus and the second deserialization chip, and restore the connection between each second image sensor and the first bus after the communication address of each second image sensor is configured.

[0058] After the communication address of the second image sensor 230 is properly configured, there will be no conflict between the communication address of the second image sensor 230 and the communication address of the register of the first deserialization chip 120, and the connection between the second deserialization chip 220 and the first bus 300 can be restored.

[0059] Specifically, each second deserialization chip 220 can be configured with two communication channels, which can be connected to the first bus 300 and the second bus 400 respectively. The second deserialization chip 220 can control the two communication channels to be turned on and off, thereby connecting the second image sensor 230 to the corresponding bus or disconnecting it from the corresponding bus.

[0060] Step S240: Periodically access the second deserialization chip 220 through the first bus 300.

[0061] After configuring the communication address of the second image sensor 230, the first bus 300 can periodically access the registers of the first deserializer 120 and the second deserializer 220.

[0062] In some embodiments, the interval between two accesses to the second deserialization chip 220 is 50ms to 500ms, preferably 200ms.

[0063] In one embodiment, the camera system includes a first control module 500 and a second control module 600, with a first bus 300 connected to the first control module 500 and a second bus 400 connected to the second control module 600.

[0064] By connecting the first bus 300 and the second bus 400 to different control modules respectively, the load on a single control module can be reduced.

[0065] Specifically, the first control module 500 may include a microcontroller unit (MCU), and the second control module 600 may include a system on chip (SoC). The first control module 500 can be used to control the camera system as a whole, and the second control module 600 can be used to implement some specified functions. For example, the second control module 600 can be used to acquire and process image data output by each image sensor to obtain the corresponding image.

[0066] In some embodiments, the first bus 300 may include multiple enable signal lines, which may be connected to the first deserialization chip 120 and the second deserialization chip 220 respectively for sending enable signals.

[0067] In one embodiment, the first camera module 100 and the second camera module 200 are respectively connected to the second control module 600 through a corresponding third bus.

[0068] like Figure 6 As shown, the driving method also includes step S300: after the first camera module and the second camera module are configured, they transmit the image data output by each image sensor to the second control module.

[0069] It is understandable that the configuration of the first camera module 100 and the second camera module 200 is completed, which means that the communication addresses of each image sensor are configured. At this time, each image sensor can work normally, and the second control module 600 can collect image data from each image sensor.

[0070] The second control module 600 may have multiple data interfaces, each corresponding to a deserialization chip. Each data interface is connected to each deserialization chip via an independent data bus. The deserialization chip can transmit the image data output by each image sensor to the second control module 600.

[0071] Specifically, the data interface can be a MIPI interface, and the data bus can be a MIPI bus.

[0072] Figure 7 A schematic diagram of a camera system according to an embodiment of this application is shown. For ease of explanation, only the parts relevant to this embodiment are shown, and the details are as follows:

[0073] The camera system includes: a first control module 500, a second control module 600, a first camera module 100, and a second camera module 200.

[0074] The first control module 500 is connected to the first camera module 100 and the second camera module 200 via the first bus 300, and the second control module 600 is connected to the second camera module 200 via the second bus 400. The first control module 500 is used to configure the first camera module 100 via the first bus 300, and periodically access the first camera module 100 via the first bus 300 after the configuration is completed. The second control module 600 is used to configure the second camera module 200 via the second bus 400, and the first control module 500 is also used to periodically access the second camera module 200 via the first bus 300 after the configuration is completed.

[0075] It is understood that the camera system can be used to perform the driving method as described in any of the above embodiments.

[0076] In one embodiment, such as Figure 7As shown, the camera system includes multiple second camera modules 200; a second control module 600 is used to sequentially configure each second camera module 200 via a second bus 400, and a first control module 500 is also used to periodically access each second camera module 200 via a first bus 300 after the configuration is completed. Alternatively, the second control module 600 can be connected to each second camera module 200 via multiple second buses 400 to individually control each second camera module 200.

[0077] When there are multiple second camera modules 200, step S200 can be executed cyclically to achieve sequential configuration of each second camera module 200.

[0078] One embodiment of this application provides a vehicle that includes a camera system, which can be used to perform the driving method as described in any of the above embodiments.

[0079] The vehicle may specifically be an electric vehicle. The vehicle includes, but is not limited to, components such as the body, wheels, on-board power supply, motor, and controller.

[0080] Camera systems can be used to enable driver assistance functions in vehicles.

[0081] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0082] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0083] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0084] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A driving method of an image pickup system, characterized by, The camera system comprises a first camera module and a second camera module, and each of the first camera module and the second camera module comprises a deserializer and at least one image sensor connected with the deserializer; The driving method comprises: configuring communication addresses of each image sensor of the first camera module through a first bus, and periodically accessing the deserializer of the first camera module through the first bus after the configuration of the first camera module is completed; configuring communication addresses of each image sensor of the second camera module through a second bus, and periodically accessing the deserializer of the second camera module through the first bus after the configuration of the second camera module is completed.

2. The driving method according to claim 1, wherein The first camera module comprises a first power supply chip, a first deserializer chip and a plurality of first image sensors, and each of the first power supply chip and the first deserializer chip is connected with each first image sensor; The configuration of the communication addresses of each image sensor of the first camera module through the first bus comprises: enabling the first power supply chip and the first deserializer chip to work through the first bus; configuring the communication addresses of each first image sensor through the first bus and the first deserializer chip.

3. The driving method according to claim 2, wherein The periodic access to the deserializer of the first camera module through the first bus comprises: periodically accessing the first deserializer chip through the first bus.

4. The driving method of claim 1, wherein The second camera module comprises a second power supply chip, a second deserializer chip and a plurality of second image sensors, and each of the second power supply chip and the second deserializer chip is connected with each second image sensor; The configuration of the communication addresses of each image sensor of the second camera module through the second bus comprises: enabling the second deserializer chip to work through the first bus, and controlling the second deserializer chip to disconnect each second image sensor from the first bus through the second bus; enabling the second power supply chip to work through the first bus; configuring the communication addresses of each second image sensor through the second bus and the second deserializer chip, and restoring the connection between each second image sensor and the first bus after the configuration of the communication addresses of each second image sensor is completed.

5. The driving method of claim 4, wherein, The periodic access to the deserializer of the second camera module through the first bus comprises: periodically accessing the second deserializer chip through the first bus.

6. The driving method according to any one of claims 1 to 5, wherein The camera system comprises a first control module and a second control module, the first bus is connected with the first control module, and the second bus is connected with the second control module.

7. The driving method according to claim 6, wherein The first camera module and the second camera module are connected with the second control module through corresponding third buses respectively. The driving method further comprises: After the configuration of the first camera module and the second camera module is completed, the image data output by each image sensor is transmitted to the second control module.

8. An image pickup system characterized by comprising: It comprises: a first control module, a second control module, a first camera module and a second camera module; The first control module is connected with the first camera module and the second camera module through a first bus, and the second control module is connected with the second camera module through a second bus; The first control module is configured to configure the first camera module through the first bus, and periodically access the first camera module through the first bus after the configuration of the first camera module is completed; The second control module is configured to configure the second camera module through the second bus, and the first control module is further configured to periodically access the second camera module through the first bus after the configuration of the second camera module is completed.

9. The camera system of claim 8, wherein, The camera system comprises a plurality of second camera modules; The second control module is configured to configure each of the second camera modules through the second bus in sequence, and the first control module is further configured to periodically access each of the second camera modules through the first bus after the configuration of each of the second camera modules is completed.

10. A vehicle characterized by comprising: The camera system is configured to perform the driving method according to any one of claims 1 to 7.

Images