Construction method and apparatus

Abstract

The present disclosure relates to a configuration method and apparatus. The method is applied to an image processing device, and includes the steps of: acquiring an access configuration file from the image acquisition device when it is detected that the image acquisition device accesses the image processing device; acquiring a serializer configuration file and a deserializer configuration file based on the access configuration file; sending a first configuration instruction to the image acquisition device, the first configuration instruction including a serializer configuration file, the serializer configuration file being used to configure a serializer in the image acquisition device to enable the image acquisition device to convert the acquired parallel electrical signals into serial electrical signals for transmission; and configuring a deserializer in the image processing device by using the deserializer configuration file to process the serial electrical signals from the image acquisition device to acquire parallel electrical signals that can be displayed on an image signal processing ISP chip. The configuration method and apparatus of the present disclosure can implement plug-and-play of the image acquisition device.

Description

[Technical field]

[0001] This application claims priority to Chinese Patent Application No. 202011565909.3, entitled “CONFIGURATION METHOD AND APPARATUS,” filed with the China National Intellectual Property Office on December 25, 2020, which is incorporated by reference in its entirety.

[0002] The present disclosure relates to the field of image processing, and in particular to configuring methods and apparatus. [Background technology]

[0003] Autonomous driving relies on camera modules, which can be used for lane departure warning, traffic sign identification, panoramic parking, etc. With the development of autonomous driving technology, the computing power of autonomous driving chips is becoming higher and higher, the level of autonomous driving is gradually increasing, and the number of on-board cameras in the vehicle is also increasing. For example, there may be 15 on-board cameras.

[0004] The autonomous driving platform needs to be adapted to camera modules from different manufacturers to implement autonomous driving. Currently, when a camera module accesses the autonomous driving platform, the configuration file of the currently accessed camera module needs to be manually configured. Thus, when the camera module is replaced or a new camera module is introduced, the camera module needs to be adapted again, which is inconvenient. Summary of the Invention [Means for solving the problem]

[0005] With this in mind, a configuration method and apparatus is provided that can implement plug-and-play of an image capture device on an image processing device.

[0006] According to a first aspect, an embodiment of the present disclosure provides a configuration method, which is applied to an image processing device, and includes the steps of: acquiring an access configuration file from the image capture device when it is detected that the image capture device accesses the image processing device; acquiring a serializer configuration file and a deserializer configuration file based on the access configuration file; sending a first configuration instruction to the image capture device, the first configuration instruction including the serializer configuration file, the serializer configuration file being used to configure a serializer in the image capture device to enable the image capture device to convert captured parallel electrical signals into serial electrical signals for transmission; and configuring a deserializer in the image processing device by using the deserializer configuration file to process the serial electrical signals from the image capture device to acquire parallel electrical signals that can be displayed on an image signal processing ISP chip.

[0007] In this embodiment of the present disclosure, when a new image input device accesses the image processing device, the image processing device can read and parse the information stored in the memory medium of the new image input device to obtain the serializer configuration file and the deserializer configuration file, so that the adaptation of the image input device is automatically implemented, and the user does not need to manually modify the configuration information in the image processing device. In other words, in this embodiment of the present disclosure, when a new image input device is introduced into the image processing device, the image processing device is not affected by the image input device. The plug and play of the new image input device can be implemented, and compatibility is realized for different image input devices, so that development efficiency is improved and development costs are reduced.

[0008] According to a first aspect, in a first possible implementation of the configuration method, the step of obtaining a serializer configuration file based on an access configuration file includes a step of obtaining the serializer configuration file based on format information for image transmission, information of an address mapping register of a transmission bus, and rate information for image transmission in the access configuration file.

[0009] In this manner, configuration of the serializer can be performed by generating a serializer configuration file.

[0010] According to the first aspect, in a second possible implementation example of the configuration method, the step of obtaining a deserializer configuration file based on an access configuration file includes a step of obtaining a deserializer configuration file based on an initial configuration file of a locally preconfigured deserializer and transmission channel information, a synchronization pin number, rate information for image transmission, and format information for image transmission in the access configuration file.

[0011] In this manner, configuration of the deserializer can be performed by generating a deserializer configuration file.

[0012] According to the first aspect or any one of the aforementioned possible implementations of the first aspect, in a third possible implementation of the configuration method, the image acquisition device has a storage medium and the access configuration file is stored on the storage medium.

[0013] In this way, since the access configuration information is stored in the storage medium of the image acquisition device, when the image acquisition device accesses the image processing device, the image processing device can automatically adapt to the image acquisition device, and there is no need to manually add configuration files to the image processing device, which is advantageous for improving development efficiency and reducing development costs.

[0014] According to a third possible implementation mode of the first aspect, in a fourth possible implementation mode of the configuration method, the storage medium further stores an image sensor reset pin number. The method further includes the steps of obtaining the image sensor reset pin number from the image capture device and sending a reset command to the image capture device to enable an image sensor in the image capture device to perform a reset operation, the reset command including the image sensor reset pin number.

[0015] In this way, an automatic reset of the image sensor can be implemented.

[0016] According to a third possible implementation mode of the first aspect, in a fifth possible implementation mode of the configuration method, the storage medium further stores an image sensor configuration file, the method comprising the steps of: obtaining the image sensor configuration file from the image capture device; and sending second configuration instructions to the image capture device to configure the image sensor in the image capture device, the second configuration instructions including the image sensor configuration file.

[0017] In this way, automatic configuration of the image sensor can be performed.

[0018] According to a third possible implementation form of the first aspect, in a sixth possible implementation form of the configuration method, the storage medium further stores a display effect parameter, and the method further includes: acquiring the display effect parameter from the image capture device; and performing an image display effect adjustment on the ISP chip according to the display effect parameter.

[0019] In this way, the matching between different lenses and the image capturing devices of the image sensors can be implemented, and the image display effect can be effectively improved.

[0020] According to a second aspect, an embodiment of the present disclosure provides a configuration device, which is applied to an image processing device, the device includes: a first acquisition module configured to acquire an access configuration file from the image acquisition device when it is detected that the image acquisition device accesses the image processing device; a parsing module configured to acquire a serializer configuration file and a deserializer configuration file based on the access configuration file acquired by the first acquisition module; a first transmission module configured to send a first configuration instruction to the image acquisition device, the first configuration instruction including the serializer configuration file acquired by the parsing module, the serializer configuration file being used to configure a serializer in the image acquisition device to enable the image acquisition device to convert the acquired parallel electrical signals into serial electrical signals for transmission; and a configuration module configured to configure a deserializer in the image processing device by using the deserializer configuration file acquired by the parsing module to process the serial electrical signals from the image acquisition device to acquire parallel electrical signals that can be displayed on an image signal processing ISP chip.

[0021] According to a second aspect, in a first possible implementation example of the configuration device, the parsing module includes a first parsing unit configured to obtain a serializer configuration file based on format information for image transmission, information of an address mapping register of the transmission bus, and rate information for image transmission, which are in the access configuration file.

[0022] According to a second aspect, in a second possible implementation example of the configuration device, the parsing module further includes a second parsing unit configured to obtain a deserializer configuration file based on an initial configuration file of a locally preconfigured deserializer and transmission channel information, a synchronization pin number, rate information for image transmission, and format information for image transmission in the access configuration file.

[0023] According to the second aspect or any one of the above possible implementations of the second aspect, in a third possible implementation of the configuration apparatus, the image acquisition device has a storage medium and the access configuration file is stored on the storage medium.

[0024] According to a third possible implementation example of the second aspect, in a fourth possible implementation example of the configuration apparatus, the storage medium further stores an image sensor reset pin number. The apparatus further includes a second acquisition module configured to acquire the image sensor reset pin number from the image acquisition device, and a second transmission module configured to transmit a reset command to the image acquisition device to enable an image sensor in the image acquisition device to perform a reset operation, the reset command including the image sensor reset pin number.

[0025] According to a third possible implementation example of the second aspect, in a fifth possible implementation example of the configuration apparatus, the storage medium further stores an image sensor configuration file. The apparatus further includes a third acquisition module configured to acquire the image sensor configuration file from the image capture device, and a third transmission module configured to transmit second configuration instructions to the image capture device, the second configuration instructions including the image sensor configuration file to configure the image sensor in the image capture device.

[0026] According to a third possible implementation example of the second aspect, in a sixth possible implementation example of the configuration device, the storage medium further stores the display effect parameters, and the device further includes a fourth acquisition module configured to acquire the display effect parameters from the image acquisition device, and an adjustment module configured to perform image display effect adjustment on the ISP chip based on the display effect parameters.

[0027] According to a third aspect, an embodiment of the present disclosure provides an electronic device, the electronic device being capable of performing a configuration method according to the first aspect or one or more of a number of possible implementations of the first aspect.

[0028] According to a fourth aspect, an embodiment of the present disclosure provides a computer program product. The computer program product includes a computer readable code or a non-volatile computer readable storage medium carrying the computer readable code. When the computer readable code is executed on an electronic device, a processor of the electronic device executes a configuration method according to the first aspect or one or more of the possible implementations of the first aspect.

[0029] These and other aspects of the present disclosure will be more concise and understandable in the description of the embodiment(s) that follows.

[0030] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments, features, and aspects of the present disclosure and are intended to explain the principles of the disclosure. [Brief description of the drawings]

[0031] [Figure 1] FIG. 1 is a diagram of an implementation environment for a device connection method according to one embodiment of the present disclosure. [Diagram 2] FIG. 1 is a schematic diagram of the architecture of a device connection system in the related art. [Diagram 3] FIG. 1 is a schematic diagram of an architecture of a device connection system according to one embodiment of the present disclosure. [Figure 4] 1 is a correlation flow chart of a configuration method according to an embodiment of the present disclosure. [Figure 5A] 1 is a correlation flow chart of a configuration method according to an embodiment of the present disclosure. [Figure 5B] 1 is a correlation flow chart of a configuration method according to an embodiment of the present disclosure. [Figure 6] FIG. 2 is a schematic diagram of the structure of a computing device. [Figure 7] FIG. 2 is a schematic diagram of a configuration device according to one embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0032] Various exemplary embodiments, features, and aspects of the present disclosure will now be described in detail with reference to the accompanying drawings, in which like reference numerals indicate elements having the same or similar functions, and in which various aspects of the embodiments are illustrated in the accompanying drawings, which are not necessarily drawn to scale unless otherwise specified.

[0033] The specific term "exemplary" herein means "serving as an example, embodiment, or illustration." An embodiment described as an "exemplary" is not necessarily described as superior or better than other embodiments.

[0034] Furthermore, in order to better explain the present disclosure, numerous specific details are given in the following specific embodiments. Those skilled in the art should understand that the present disclosure may be practiced without specific details. In some embodiments, methods, means, elements and circuits well known to those skilled in the art are not described in detail, so as to emphasize the subject matter of the present disclosure.

[0035] In one embodiment of the present disclosure, the image acquisition device may represent a device configured to acquire an image, and the image processing device may represent a device configured to process an image. In one possible implementation, the image acquisition device may include a camera module, and the image processing device may include an autonomous driving platform. In this case, according to the configuration method provided in the embodiment of the present disclosure, the autonomous driving platform may automatically adapt to camera modules of different manufacturers and different models, so that the autonomous driving platform implements plug-and-play on the camera module. In one possible implementation, the image acquisition device may include a terminal device, such as a mobile phone, a netbook, a tablet computer, a notebook computer, a wearable electronic device (e.g., a smart band, a smart watch, etc.), a TV, and a virtual reality device. The image processing device may include an in-vehicle display screen, such as an in-vehicle display screen connected to an in-vehicle infotainment. In this case, according to the configuration method provided in the embodiment of the present disclosure, the in-vehicle display screen may automatically adapt to terminal devices of different manufacturers and different models, and the in-vehicle display screen may implement plug-and-play on the terminal device.

[0036] For example, a camera module is used as the image acquisition device, and an autonomous driving platform is used as the image processing device. FIG. 1 is a diagram of an implementation environment of a configuration method according to an embodiment of the present disclosure. As shown in FIG. 1, the implementation environment includes a camera module and an autonomous driving platform. The camera module may be deployed around the vehicle. The autonomous driving platform may be deployed at locations such as a driving position and a central control area of ​​the vehicle. The camera module may access the autonomous driving platform via a coaxial cable or the like. The camera module may acquire images and then transmit the acquired images to the autonomous driving platform for processing and display.

[0037] FIG. 2 is a schematic diagram of the architecture of a device connection system in the related art. As shown in FIG. 2, the system includes a camera module 11, an autonomous driving platform 12, and a coaxial cable 13 that connects the camera module and the autonomous driving platform. The camera module 11 includes a lens 111, an image sensor 112, and a serializer 113. In one example, the lens 111 may include a long focal length lens, a short focal length lens, a medium focal length lens, a fisheye lens, etc. The image sensor 112 may include an Ar0231, an Imx390, an Imx490, etc. The serializer 113 may include a max9295, a max96705, etc. The autonomous driving platform 12 includes a deserializer 121 and an image signal processing (Image Signal Processing, ISP) chip 122. In one example, the deserializer 121 may include a Max96721, etc. The ISP chip 122 may include a Hi3559, a Hi1951, etc.

[0038] To implement communication between the camera module 11 and the autonomous driving platform 12, the serializer 113 in the camera module 11 and the deserializer 121 in the autonomous driving platform 12 need to be correspondingly configured. As shown in FIG. 2, in the related art, the procedure for correspondingly configuring the serializer 113 and the deserializer 121 includes the following five steps: (1) The camera module 11 accesses the autonomous driving platform 12. (2) The user manually adds the configuration file of the camera module 11 to the autonomous driving platform 12. (3) The autonomous driving platform 12 indicates to the camera module 11 to configure the image sensor 112 based on the configuration file. (4) The autonomous driving platform 12 indicates to the camera module 11 to configure the serializer 113 based on the configuration file. (5) The autonomous driving platform 12 constitutes a deserializer 121.

[0039] After the aforementioned configuration procedures are completed, the image sensor 112 may sense an optical signal through the lens 111 and then convert the optical signal into a multi-path parallel electrical signal. The serializer 113 may perform a serialization process on the parallel electrical signal to obtain a serial electrical signal. The camera module 11 transmits the serial electrical signal to the autonomous driving platform 12 through the coaxial cable 13. The deserializer 121 of the autonomous driving platform 12 may perform a deserialization process on the received serial electrical signal to obtain a parallel electrical signal. The parallel electrical signal may be displayed after being processed by the ISP chip 122.

[0040] In the initialization process described above, the user manually adds the configuration file for the camera module. Module When the camera is replaced or a new camera Module is introduced, the user needs to manually add a configuration file of the newly added camera module, which causes the autonomous driving platform to perform adaptation on the camera module again, and the autonomous driving platform cannot implement plug-and-play on the camera module, resulting in a poor user experience.

[0041] In the related technology, a correspondence between the ID value of the camera module and the configuration file of the camera module may be further added to the autonomous driving platform. When the camera module accesses the autonomous driving platform, the autonomous driving platform may search for the corresponding configuration file based on the ID value of the camera module to implement the configuration of the camera module. However, in this way, if the camera module of the above correspondence is not pre-configured in the autonomous driving platform, the automatic adaptation cannot be performed. The user needs to manually add the corresponding configuration file on the autonomous driving platform, and the autonomous driving platform cannot implement plug and play on the camera module, which deteriorates the user experience.

[0042] In the related art, a memory may be further arranged in the camera module. The memory may store a configuration file of the camera module, and the camera module may be configured by calling the configuration file. However, in this way, the deserializer of the autonomous driving platform is not correspondingly configured. The autonomous driving platform cannot obtain a video image from the serial electrical signal sent by the camera module. The user still needs to manually add the corresponding configuration file to the autonomous driving platform, and the autonomous driving platform cannot implement plug-and-play on the camera module, which reduces the user experience.

[0043] In one embodiment of the present disclosure, a configuration method is provided that can implement plug-and-play of an image capture device on an image processing device. When the configuration method is applied to the autonomous driving implementation environment shown in FIG. 1, the autonomous driving platform can implement plug-and-play on a camera module.

[0044] In order to implement plug-and-play of the autonomous driving platform on the camera module, an embodiment of the present disclosure provides a device connection system that can automatically implement corresponding configuration of the serializer and the deserializer and implement plug-and-play of the autonomous driving platform on the camera module. In this embodiment of the present disclosure, a storage medium configured to store an access configuration file is included in the camera module, and a parsing module that can parse the access configuration file is added to the autonomous driving platform. The parsing module can obtain both the serializer configuration file and the deserializer configuration file based on the access configuration file.

[0045] 3 is a schematic diagram of the architecture of a device connection system according to an embodiment of the present disclosure. As shown in FIG. 3, compared with the device connection system shown in FIG. 2, in the device connection system provided in this embodiment of the present disclosure, a storage medium 114 is added to the camera module 11, and a parsing module 123 is added to the autonomous driving platform 12. The storage medium 114 may store some storage medium information. The parsing module 123 may parse the storage medium information stored in the storage medium 114 to obtain a file used to configure the serializer 113 and the deserializer 121.

[0046] The storage medium information stored in the storage medium 114 is shown in FIG. 3. In implementation, the function and meaning of the bytes in the storage medium 114 may be first agreed upon. For example, it is agreed that the first byte represents a Pipe channel number, the second byte represents a Frame Synchronizer (FSYNC) pin number, etc. In this way, the autonomous driving platform 12 may determine the meaning of the bytes in the storage medium information obtained from the storage medium 114 based on the agreement, and parse the storage medium information to obtain the information needed to be used.

[0047] In one possible embodiment, the storage medium 114 stores the storage medium information 1 shown in Fig. 3. After the parsing module 123 parses the acquired storage medium information, the storage medium information 1 can be acquired. Specifically, the video link model of the serializer and the access configuration file can be acquired. The video link model of the serializer includes Max9295, Max96705, Max96707, etc. The access configuration file includes transmission channel information (e.g., Pipe channel information including one of values ​​X, Y, Z, and U to indicate which channel of X, Y, Z, and U is used as the image transmission channel), synchronization pin number (e.g., FSYNC pin number representing the pin number used on the serializer to connect to the image sensor in the camera module), information of the address mapping register of the transmission bus (e.g., information of the address mapping register of the serializer i2c), link mode information for image transmission (e.g., default GMSL link mode whose value includes GMSL1 or GMSL2), rate information for image transmission (e.g., default GMSL transmission speed whose value includes 3G or 6G), format information for image transmission (e.g., raw12, raw10, yuv420, or yuv422), and a register initialization configuration list of the serializer.

[0048] The aforementioned access configuration file can be used to configure the serializer 113 and the deserializer 121. After the parsing module 123 parses the access configuration file, the autonomous driving platform 12 may obtain a serializer configuration file used to configure the serializer 113 and a deserializer configuration file used to configure the deserializer 121 based on the access configuration file.

[0049] In one possible embodiment, the autonomous driving platform 12 may obtain a serializer configuration file based on the format information for image transmission, the information of the address mapping register of the transmission bus, and the rate information for image transmission in the access configuration file. The autonomous driving platform 12 may obtain a deserializer configuration file based on the initial configuration file of the deserializer preconfigured locally and the transmission channel information, the synchronization pin number, the rate information for image transmission, and the format information for image transmission in the access configuration file. The initial configuration file may represent a general configuration serializer file.

[0050] The autonomous driving platform 12 may send a first configuration command, including a serializer configuration file, to the camera module 11. After receiving the first configuration command, the camera module 11 may configure the serializer based on the serializer configuration file. After the configuration is completed, the serializer may convert the parallel electrical signals acquired by the image sensor into serial electrical signals for transmission. The autonomous driving platform 12 may configure the deserializer 121 using the acquired deserializer configuration file. After the configuration is completed, the deserializer may perform a deserialization process on the serial electrical signals sent by the camera module 11 to obtain parallel electrical signals and restore the image using the ISP chip for display. In one example, the autonomous driving platform 12 configuring the deserializer 121 may include: configuring a register for receiving a transmission channel, configuring the transmission channel based on a synchronization pin number, configuring a format for receiving a transmission image, and configuring a mipi-related register for communication between the deserializer and the back-end ISP chip.

[0051] In one possible embodiment, the storage medium 114 further stores the storage medium information 2 shown in FIG. 3. After the parsing module 123 parses the acquired storage medium information, the storage medium information 2, specifically, the image sensor reset pin number, can be further acquired. Then, the autonomous driving platform 12 may send a reset command including the image sensor reset pin number to the camera module 11. After receiving the reset command, the camera module 11 may perform a reset operation on the image sensor 112.

[0052] In one possible embodiment, the storage medium 114 further stores storage medium information 3 shown in FIG. Parsing module 123 After parsing the acquired storage medium information, the storage medium information 3, specifically, the image sensor configuration file, can be further acquired. In one example, the image sensor configuration file may include an image sensor resolution, an image register initialization list, an image sensor operation mode (e.g., linear, HDR), an image sensor data compression curve, etc. Then, the autonomous driving platform 12 may send a second configuration command including the image sensor configuration file to the camera module 11. After receiving the second configuration command, the camera module 11 may configure the image sensor 112.

[0053] In implementation, a reset command may be sent before the second configuration command, such that the image sensor is first reset and then configured.

[0054] In one possible implementation, the storage medium 114 further stores the storage medium information 4, the storage medium information 5, and the storage medium information 6 shown in FIG. 3. After the parsing module 123 parses the acquired storage medium information, the storage medium information 4, the storage medium information 5, and the storage medium information 6, specifically, the size of the lens angle of view, the camera type (front view, rear view, binocular view, surround view, etc.), and the image effect parameters (e.g., image quality parameters, image sensor model, etc.) can be acquired. Then, the autonomous driving platform may perform image display effect adjustment for the ISP chip 122 based on the aforementioned size of the lens angle of view, the camera type, and the image effect parameters. In this embodiment of the present disclosure, the size of the lens angle of view, the camera type, and the image effect parameters may be referred to as display effect parameters.

[0055] In this embodiment of the present disclosure, when a new camera module is inserted into the autonomous driving platform, the autonomous driving platform can read and parse the information stored in the memory medium of the new camera module to obtain a serializer configuration file and a deserializer configuration file, so that the adaptation of the camera module is automatically implemented, and the user does not need to manually modify the configuration information on the autonomous driving platform. In other words, in this embodiment of the present disclosure, when a new camera module is introduced into the autonomous driving platform, the autonomous driving platform is not affected by the camera module. The plug and play of the new camera module can be implemented, and compatibility is realized for different camera modules, thereby improving development efficiency and reducing development costs.

[0056] Similarly, in this embodiment of the present disclosure, plug and play may also be implemented for a newly replaced camera module of a different type of image sensor. Plug and play may also be implemented for an upgraded camera module.

[0057] In addition, in this embodiment of the present disclosure, when a new camera module is inserted into the autonomous driving platform, the autonomous driving platform may further read the display effect parameters from the storage medium in the camera module, and the display effect parameters are then transferred to the ISP module for image optimization processing, so that the autonomous driving platform can well adapt to camera modules having different angles of view, different camera types, and different image effect parameters.

[0058] In implementation, the auto-camera module may be a Gigabit Multimedia Serial Links (GMSL) camera or a non-GMSL camera (e.g., a Roam camera), which is not limited in this disclosure.

[0059] In implementation, the storage medium may be an electrically erasable programmable read only memory (EEPROM), etc., which is not limited in this disclosure.

[0060] In implementation, the autonomous driving platform may include a Mobile Data Center (MDC) or the like, which is not limited in this disclosure.

[0061] FIG. 4 is a correlation flow chart of a configuration method according to an embodiment of the present disclosure. The method may be applied to a device connection system including an image acquisition device and an image processing device. The image acquisition device includes a storage medium, and the storage medium stores an access configuration file. The image processing device includes a parsing module, and the parsing module may parse the storage medium information obtained from the storage medium of the image acquisition device to obtain the access configuration file. In one example, the method shown in FIG. 4 may be applied to the system shown in FIG. 3. As shown in FIG. 4, the method may include steps S400 to S405.

[0062] Step S400: The image acquisition device accesses the image processing device.

[0063] Step S401: The image processing device obtains an access configuration file from the image capturing device when it is detected that the image capturing device accesses the image processing device.

[0064] In one possible embodiment, the image processing device may send a request to the image acquisition device to obtain an access configuration file when it is detected that the image acquisition device accesses the image processing device. In response to the request to obtain the access configuration file, the image acquisition device may return the access configuration file to the image processing device. For the access configuration file, please refer to the access configuration file shown in Figure 3. Details will not be repeated here.

[0065] Step S402: The image processing device obtains a serializer configuration file and a deserializer configuration file based on the access configuration file.

[0066] In one possible embodiment, the step of obtaining the serializer configuration file based on the access configuration file includes obtaining the serializer configuration file based on the format information for image transmission, the information of the address mapping register of the transmission bus, and the rate information for image transmission in the access configuration file. The step of obtaining the deserializer configuration file based on the access configuration file includes obtaining the deserializer configuration file based on the initial configuration file of the locally preconfigured deserializer and the transmission channel information, the synchronization pin number, the rate information for image transmission, and the format information for image transmission in the access configuration file.

[0067] For the format information for image transmission, the information of the address mapping register of the transmission bus, the rate information for image transmission, the initial configuration file of the deserializer, and the transmission channel information, the synchronous pin number, and the format information for image transmission in the access configuration file, please refer to Figure 3. Details are not repeated here.

[0068] Step S403: The image processing device sends a first configuration instruction including a serializer configuration file to the image capture device.

[0069] The serializer configuration file may be used to configure a serializer located within the image capture device.

[0070] Step S404: The image capture device configures the serializer based on the serializer configuration file.

[0071] Step S405: The image processing device configures the deserializer using the deserializer configuration file.

[0072] In this way, the corresponding configuration of the serializer and the deserializer is completed, and the image processing device can process the data output by the image capture device. In other words, the matching between the image processing device and the image capture device is completed, and the plug-and-play of the image processing device on the image capture device is implemented.

[0073] In an implementation, the image acquisition device may acquire parallel electrical signals via an image sensor. The image acquisition device converts the acquired parallel signals into serial electrical signals via a configured serializer. The image acquisition device transmits the serial electrical signals to an image processing device. The image processing device processes the serial electrical signals via a configured deserializer to acquire parallel electrical signals. The image processing device displays the acquired parallel electrical signals via the ISP chip.

[0074] In this embodiment of the present disclosure, when a new image input device accesses the image processing device, the image processing device can read and parse the information stored in the memory medium of the new image input device to obtain the serializer configuration file and the deserializer configuration file, so that the adaptation of the image input device is automatically implemented, and the user does not need to manually modify the configuration information in the image processing device. In other words, in this embodiment of the present disclosure, when a new image input device is introduced into the image processing device, the image processing device is not affected by the image input device. The plug and play of the new image input device can be implemented, and compatibility is realized for different image input devices, so that development efficiency is improved and development costs are reduced.

[0075] 5A and 5B are a correlation flow chart of a configuration method according to an embodiment of the present disclosure. The storage medium of the image acquisition device further includes an image sensor reset pin number, an image sensor configuration file, and a display effect parameter. The parsing module of the image processing device can obtain the aforementioned information by parsing. As shown in FIG. 5A and FIG. 5B, based on FIG. 4, the method further includes steps S406 to S413.

[0076] Step S406: The image processing device obtains the image sensor reset pin number from the image capturing device.

[0077] For image sensor reset pin numbers, see Figure 3. Details will not be repeated here.

[0078] Step S407: The image processing device sends a reset command including the image sensor reset pin number to the image capture device.

[0079] Step S408: The image capture device performs a reset operation on the image sensor based on the image sensor reset pin number.

[0080] Step S409: The image processing device obtains the image sensor configuration file from the image capture device.

[0081] Step S410: The image processing device sends a second configuration instruction including the image sensor configuration file to the image capture device.

[0082] Step S411: The image capture device configures the image sensor based on the image sensor configuration file.

[0083] Step S412: The image capture device acquires a display effect parameter from the image capture device.

[0084] Step S413: The image capture device performs image display effect adjustment on the ISP chip according to the display effect parameters.

[0085] After the above process, the image sensor is reset and configured, and the ISP chip is configured. In this way, the image acquisition device can acquire parallel electrical signals through the configured image sensor, and the image processing device displays the parallel signals acquired through the adjusted ISP chip.

[0086] It should be noted that the execution order of step S401, step S406, step S409, and step S412 is not limited in this embodiment of the present disclosure. After acquiring the storage medium information from the storage medium of the image acquisition device, the image processing device may acquire the access configuration file, the image sensor reset pin number, the image sensor configuration file, and the display effect parameters at one time by parsing. The image processing device may further parse the acquired storage medium information multiple times to separately acquire the access configuration file, the image sensor reset pin number, the image sensor configuration file, and the display effect parameters. Alternatively, the image processing device may acquire the storage medium information from the storage medium of the image acquisition device multiple times, and separately parse the acquired storage medium information each time to acquire the access configuration file, the image sensor reset pin number, the image sensor configuration file, and the display effect parameters. In this embodiment of the present disclosure, the method and sequence for acquiring the access configuration file, the image sensor reset pin number, the image sensor configuration file, and the display effect parameters are not limited.

[0087] In this embodiment of the present disclosure, plug and play may also be implemented for a newly replaced image input device of a different type of image sensor, and plug and play may also be implemented for an upgraded image input device. When a new image input device is inserted into the image processing device, the image processing device may further read the display effect parameters from the storage medium in the image input device, and then the display effect parameters are transferred to the ISP module for image optimization processing, so that the image processing device can be well adapted to the image input device with different angle of view, different camera type, and different image effect parameters.

[0088] 6 is a schematic diagram of a structure of a computing device, which may be configured to deploy a camera module or an autonomous driving platform.

[0089] As shown in Fig. 6, the computing device may include at least one processor 301, a memory 302, an input / output device 303, and a bus 304. The components of the computer device will be specifically described hereinafter with reference to Fig. 6.

[0090] Processor 301 is the control center of a computing device and may be a general term for a processor or multiple processing elements. For example, processor 301 is a CPU, an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement this embodiment of the present disclosure. For example, one or more microprocessors (Digital Signal Processors, DSPs), or one or more Field Programmable Gate Arrays (FPGAs).

[0091] The processor 301 may perform various functions of the computing device by implementing or executing software programs stored in the memory 302 and accessing data stored in the memory 302 .

[0092] In a specific implementation, in one embodiment, the processor 301 may include one or more CPUs, for example, CPU0 and CPU1 as shown in the figure.

[0093] In a specific implementation, in one embodiment, a computing device may include multiple processors, such as processor 301 and processor 305 shown in Figure 6. Each processor may be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). A processor here may be one or more devices, circuits, and / or processing cores configured to process data (e.g., computer program instructions).

[0094] The memory 302 may be, but is not limited to, a Read-Only Memory (ROM) or another type of static storage device capable of storing static information and instructions, a Random Access Memory (RAM) or another type of dynamic storage device capable of storing information and instructions, or an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc Read-Only Memory (CD-ROM) or another optical disk storage, an optical disk storage (including a compact disk, laser disk, optical disk, digital versatile disk, or Blu-ray disk, etc.), a magnetic disk storage medium or another magnetic storage device, or any other medium that can be used to hold or store appropriate program code in the form of instructions or data structures and that can be accessed by a computer. The memory 302 may exist independently or be connected to the processor 301 via the bus 304. Alternatively, the memory 302 may be integrated with the processor 301. In this embodiment of the disclosure, memory 302 may be configured to store an access configuration file, an image sensor reset pin number, an image sensor configuration file, and display effect parameters.

[0095] The input / output device 303 is configured to communicate with other devices or communication networks, such as Ethernet, Radio access network (RAN), Wireless Local Area Networks (WLAN), and other communication networks. The input / output device 303 may include all or part of a baseband processor, or may include a Radio Frequency (RF) processor. The RF processor is configured to transmit or receive RF signals. The baseband processor is configured to process baseband signals converted from RF signals or baseband signals to be converted to RF signals.

[0096] In a specific implementation, as an embodiment, the input / output device 303 may include a transmitter and a receiver. The transmitter is configured to transmit a signal to another device or a communication network, and the receiver is configured to receive a signal transmitted by another device or a communication network. The transmitter and the receiver may exist independently or may be integrated. In this embodiment of the present disclosure, the input / output device may be configured to receive an image, receive a parallel electrical signal, transmit a serial electrical signal, and receive a serial electrical signal.

[0097] The bus 304 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be classified as an address bus, a data bus, a control bus, etc. For ease of illustration, the bus is depicted in FIG. 6 by using only one bold line. However, this does not indicate that there is only one bus or only one type of bus.

[0098] The device structure shown in FIG. 6 does not constitute a limitation on the computing device, which may include more or fewer components than those shown in the figure, or may combine several or different components for deployment.

[0099] 7 is a schematic diagram of the structure of a configuration apparatus according to an embodiment of the present disclosure. The apparatus may be applied to an image processing device. As shown in FIG. 7, the apparatus 70 includes: a first acquisition module 71 configured to acquire an access configuration file from the image acquisition device when it is detected that the image acquisition device accesses the image processing device; a parsing module 72 configured to obtain a serializer configuration file and a deserializer configuration file based on the access configuration file obtained by the first obtaining module 71; a first transmitting module 73 configured to transmit first configuration instructions to the image capture device, the first configuration instructions including a serializer configuration file acquired by the parsing module 72, the serializer configuration file being used to configure a serializer within the image capture device to enable the image capture device to convert the acquired parallel electrical signals into serial electrical signals for transmission; a configuration module 74 configured to configure a deserializer in the image processing device by using the deserializer configuration file obtained by the parsing module 72 to process the serial electrical signal from the image capture device to obtain a parallel electrical signal that can be displayed on an image signal processing ISP chip; Includes.

[0100] In one possible embodiment, the parsing module comprises: a first parsing unit configured to obtain a serializer configuration file based on format information for image transmission, information of an address mapping register of a transmission bus, and rate information for image transmission in the access configuration file; Includes.

[0101] In one possible embodiment, the parsing module comprises: a second parsing unit configured to obtain a deserializer configuration file based on an initial configuration file of the locally preconfigured deserializer and the transmission channel information, the synchronization pin number, the rate information for image transmission, and the format information for image transmission in the access configuration file; Further includes:

[0102] In one possible implementation, the image acquisition device has a storage medium and the access configuration file is stored on the storage medium.

[0103] In one possible embodiment, the storage medium further stores an image sensor reset pin number, and the apparatus further comprises: a second acquisition module configured to acquire an image sensor reset pin number from the image capture device; a second transmitting module configured to transmit a reset command to the image capture device to enable an image sensor in the image capture device to perform a reset operation, the reset command including an image sensor reset pin number; Further includes:

[0104] In one possible embodiment, the storage medium further stores an image sensor configuration file, and the apparatus further comprises: a third acquisition module configured to acquire the image sensor configuration file from the image capture device; a third transmitting module configured to transmit second configuration instructions to the image capture device, the second configuration instructions including an image sensor configuration file for configuring an image sensor in the image capture device; Further includes:

[0105] In one possible embodiment, the storage medium further stores a display effect parameter, and the present device: a fourth acquisition module configured to acquire display effect parameters from the image acquisition device; an adjustment module configured to perform image display effect adjustment on the ISP chip according to the display effect parameters; Further includes:

[0106] In this embodiment of the present disclosure, when a new image input device accesses the image processing device, the image processing device can read and parse the information stored in the memory medium of the new image input device to obtain the serializer configuration file and the deserializer configuration file, so that the adaptation of the image input device is automatically implemented, and the user does not need to manually modify the configuration information in the image processing device. In other words, in this embodiment of the present disclosure, when a new image input device is introduced into the image processing device, the image processing device is not affected by the image input device. The plug and play of the new image input device can be implemented, and compatibility is realized for different image input devices, so that development efficiency is improved and development costs are reduced.

[0107] One embodiment of the present disclosure provides an electronic device including a processor and a memory configured to store executable instructions that can be executed by the processor, the processor being configured to perform the aforementioned method when executing the instructions.

[0108] One embodiment of the present disclosure provides a non-volatile computer readable storage medium, which stores computer program instructions that, when executed by a processor, perform the aforementioned method.

[0109] One embodiment of the present disclosure provides a computer program product, the computer program product including computer readable code or a non-volatile computer readable storage medium carrying the computer readable code, which when executed on a processor of an electronic device causes the processor of the electronic device to perform the aforementioned method.

[0110] A computer-readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. A computer-readable storage medium may be (but is not limited to) an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include portable computer disks, hard disks, Random Access Memory (RAM), Read Only Memory (ROM), Electrically Programmable Read-Only Memory (EPROM, or Flash Memory), Static Random-Access Memory (SRAM), portable Compact Disc Read-Only Memory (CD-ROM), Digital Video Disc (DVD), memory sticks, floppy disks, mechanical coding devices such as punched cards or slotted structures that store instructions, and any suitable combination thereof.

[0111] The computer-readable program instructions or codes described herein can be downloaded to each computing / processing device from a computer-readable storage medium or via an external computer or external storage device over a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network may include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing / processing device.

[0112] The computer program instructions used to perform the operations in this disclosure may be assembly instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, status setting data, or source or target code written in any combination of one or more programming languages. Programming languages ​​include object-oriented programming languages ​​such as Smalltalk and C++, as well as traditional procedural programming languages ​​such as "C" or similar programming languages. The computer readable program instructions may be executed entirely on the user computer, partially on the user computer, as a standalone software package, partially on the user computer, partially on a remote computer, or entirely on a remote computer or server. When a remote computer is involved, the remote computer may be connected to the user computer via any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are customized by using status information of computer-readable program instructions. The electronic circuits may execute computer-readable program instructions to implement various aspects of the present disclosure.

[0113] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure. It will be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, may be implemented by computer readable program instructions.

[0114] These computer-readable program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, or another programmable data processing device to manufacture a machine, such that the instructions, when executed by the processor of the computer or another programmable data processing device, create an apparatus for performing the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams. Alternatively, these computer-readable program instructions may be stored on a computer-readable storage medium. These instructions enable a computer, a programmable data processing device, and / or another device to operate in a particular manner. Thus, a computer-readable medium storing instructions includes an artifact including instructions for performing various aspects of the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams.

[0115] Alternatively, the computer readable program instructions may be loaded into a computer, another programmable data processing apparatus, or another device, such that a sequence of operational steps are executed by the computer, another programmable data processing apparatus, or another device to produce a computer-implemented process. Thus, the instructions executing on the computer, another programmable data processing apparatus, or another device implement the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams.

[0116] The flowcharts and block diagrams in the accompanying drawings illustrate the system architecture, functionality, and operation of possible implementations of the apparatus, system, method, and computer program product according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or part of an instruction, which includes one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may also occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks may in fact be executed substantially in parallel or may be executed in a reverse order depending on the functions involved.

[0117] It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by hardware (e.g., a circuit or ASIC (Application-Specific Integrated Circuit)) that performs the corresponding function or operation, or may be implemented by a combination of hardware and software, e.g., firmware.

[0118] Although the present invention has been described with reference to the embodiments, in the process of implementing the claimed invention, those skilled in the art may understand and implement other variations of the disclosed embodiments by referring to the attached drawings, the disclosed content, and the appended claims. In the claims, "comprising" does not exclude other components or steps, and "a" or "a" does not exclude a plurality of cases. A single processor or other unit may perform several functions recited in the claims. Although several means are recited in mutually different dependent claims, this does not mean that these means cannot be combined to produce a better effect.

[0119] The above describes the embodiments of the present disclosure. The above description is by way of example, and is not exhaustive or limited to the disclosed embodiments. Surrounded Many modifications and variations will be apparent to those skilled in the art without departing from the spirit and scope of the present invention. The choice of terminology used herein is intended to fully explain the principles of the embodiments, practical applications, or improvements to the art in the marketplace, or to enable those skilled in the art to understand the embodiments disclosed herein. [Explanation of symbols]

[0120] 11 Camera module 12 Autonomous Driving Platform 13 Coaxial Cable 70 equipment 71 First Acquisition Module 72 Syntax Analysis Module 73 First Transmitting Module 74 Configuration Module 111 Lens 112 Image Sensor 113 Serializer 114 Storage medium 121 Deserializer 122 Image Signal Processing (ISP) Chip 123 Syntax Analysis Module 301 Processor 302 Memory 303 Input / Output Devices 304 Bus 305 Processor

Claims

1. 1. A configuration method, the method being applied to an image processing device, the method comprising: obtaining an access configuration file stored in a storage medium of the image capture device when it is detected that the image capture device accesses the image processing device; obtaining a serializer configuration file and a deserializer configuration file based on the access configuration file; obtaining an image sensor reset pin number stored in the storage medium of the image capture device; sending a reset command to the image capture device to enable an image sensor in the image capture device to perform a reset operation, the reset command including the image sensor reset pin number; sending first configuration instructions to the image capture device, the first configuration instructions including the serializer configuration file, the serializer configuration file being used to configure a serializer within the image capture device to enable the image capture device to convert captured parallel electrical signals into serial electrical signals for transmission; configuring a deserializer in the image processing device by using the deserializer configuration file to process serial electrical signals from the image capture device to obtain parallel electrical signals that can be displayed on an image signal processing (ISP) chip; A method comprising:

2. obtaining a serializer configuration file based on the access configuration file, obtaining the serializer configuration file based on format information for image transmission, information of an address mapping register of a transmission bus, and rate information for image transmission in the access configuration file; 2. The method of claim 1, comprising:

3. obtaining a deserializer configuration file based on the access configuration file, Obtaining the deserializer configuration file based on an initial configuration file of the deserializer preconfigured locally and transmission channel information, a synchronization pin number, rate information for image transmission, and format information for image transmission in the access configuration file.

2. The method of claim 1, comprising:

4. The storage medium further stores an image sensor configuration file, and the method further comprises: obtaining the image sensor configuration file from the image capture device; sending second configuration instructions to the image capture device to configure an image sensor in the image capture device, the second configuration instructions including the image sensor configuration file; The method of claim 1, further comprising:

5. The storage medium further stores display effect parameters, and the method further comprises: acquiring the display effect parameters from the image capture device; performing an image display effect adjustment on the ISP chip according to the display effect parameters; The method of claim 1, further comprising:

6. A configuration apparatus, the apparatus being applied to an image processing device, the apparatus comprising: a first acquisition module configured to acquire an access configuration file stored in a storage medium of the image acquisition device when it is detected that the image acquisition device accesses the image processing device; a parsing module configured to obtain a serializer configuration file and a deserializer configuration file based on the access configuration file obtained by the first obtaining module; a second acquisition module configured to acquire an image sensor reset pin number stored in the storage medium of the image capture device; a second transmitting module configured to transmit a reset command to the image capture device to enable an image sensor in the image capture device to perform a reset operation, the reset command including the image sensor reset pin number; and a first transmission module configured to transmit first configuration instructions to the image capture device, the first configuration instructions including the serializer configuration file acquired by the parsing module, the serializer configuration file being used to configure a serializer within the image capture device to enable the image capture device to convert acquired parallel electrical signals into serial electrical signals for transmission; a configuration module configured to configure a deserializer in the image processing device by using the deserializer configuration file obtained by the parsing module to process serial electrical signals from the image capture device to obtain parallel electrical signals that can be displayed on an image signal processing (ISP) chip; An apparatus comprising:

7. The parsing module: a first parsing unit configured to obtain a serializer configuration file based on format information for image transmission, information of an address mapping register of a transmission bus, and rate information for image transmission in the access configuration file; The apparatus of claim 6, comprising:

8. The parsing module: a second parsing unit configured to obtain the deserializer configuration file based on an initial configuration file of the deserializer preconfigured locally and transmission channel information, a synchronization pin number, rate information for image transmission, and format information for image transmission in the access configuration file; The apparatus of claim 6, further comprising:

9. The storage medium further stores an image sensor configuration file, and the apparatus further comprises: a third acquisition module configured to acquire the image sensor configuration file from the image capture device; a third transmission module configured to transmit second configuration instructions to the image capture device to configure an image sensor in the image capture device, the second configuration instructions including the image sensor configuration file; The apparatus of claim 6, further comprising:

10. The storage medium further stores a display effect parameter, and the device further comprises: a fourth acquisition module configured to acquire the display effect parameters from the image capture device; an adjustment module configured to perform image display effect adjustment on the ISP chip according to the display effect parameters; The apparatus of claim 6, further comprising:

11. A vehicle comprising an image processing device and an image acquisition device, said image processing device comprising a component device according to any one of claims 6 to 10.

Images