Image processing system and image processing apparatus

By adding a fuzzy data processing module to the camera module, using a special integrated circuit ASIC to blur the image data, the high hardware requirements and high power consumption problems when external processors process sensitive data in the prior art are solved, and the more Low power consumption and lower hardware requirements data processing.

CN221961880UActive Publication Date: 2024-11-05XIAOMI EV TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202222102534.8
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2022-08-10
Publication Date
2024-11-05
Estimated Expiration
2032-08-10

AI Technical Summary

Technical Problem

When processing sensitive data, existing camera modules require external processors to perform fuzzy processing, resulting in high data processing capabilities and hardware requirements of the processor and large power consumption.

Method used

A fuzzy data processing module is added to the camera module, and the image data is blurred using the application-specific integrated circuit ASIC, so that the camera module itself outputs the blurred image data, reducing the processing capability and hardware requirements for other devices.

Benefits of technology

By implementing fuzzy processing of sensitive data in the camera module, the data processing capabilities and hardware requirements of other devices are reduced, power consumption is reduced, and the data transmission process is simplified.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN221961880U_ABST
    Figure CN221961880U_ABST
Patent Text Reader

Abstract

The utility model relates to an image processing system and an image processing apparatus. The image processing system comprises a camera module and a processor. The camera module comprises an image acquisition element; the ISP is connected with the image acquisition element and is used for processing the image acquired by the image acquisition element to obtain first image data; and the fuzzy data processing module is connected with the ISP and is used for performing fuzzy processing on sensitive data in the first image data to obtain second image data, and the fuzzy data processing module is an ASIC (Application Specific Integrated Circuit). The processor is connected with the camera module and used for obtaining the first image data and the second image data output by the camera module, and the processor is a vehicle-mounted host. The camera module further comprises a storage module which is connected with the image acquisition element, is connected with the ISP and is used for storing the image acquired by the image acquisition element. The ISP is used for reading the image acquired by the image acquisition element from the storage module; the ISP is used for performing high-definition image processing on the image acquired by the image acquisition element to obtain first image data;
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of image processing, and in particular to a camera module, an image processing system and an image processing device. Background Art

[0002] With the continuous development of autonomous driving technology, the requirements for the functions and clarity of camera modules are getting higher and higher. How to make the functions of camera modules more diversified is very important for intelligent driving. Utility Model Content

[0003] In order to overcome the problems existing in the related art, the present disclosure provides an image processing system and an image processing device.

[0004] According to a first aspect of an embodiment of the present disclosure, an image processing system is provided, comprising a camera module and a processor. The camera module comprises: an image acquisition element; an image signal processor ISP, connected to the image acquisition element, for performing image processing on an image acquired by the image acquisition element to obtain first image data; a fuzzy data processing module, connected to the ISP, for performing fuzzy processing on the first image data to obtain second image data, wherein the fuzzy data processing module is an application-specific integrated circuit ASIC.

[0005] The processor is connected to the camera module and is used to obtain the first image data and the second image data output by the camera module. The processor is a vehicle-mounted host.

[0006] Wherein, the camera module further includes: a storage module, connected to the image acquisition element and to the ISP, and used for storing the images acquired by the image acquisition element.

[0007] The ISP is used to read the image acquired by the image acquisition component from the storage module. The ISP is used to perform high-definition image processing on the image acquired by the image acquisition component to obtain first image data.

[0008] The processor is connected to the camera module and is used to obtain the first image data and the second image data output by the camera module.

[0009] According to a second aspect of an embodiment of the present disclosure, there is provided an image processing device, comprising: the image processing system according to the first aspect above.

[0010] Optionally, the image processing device further includes: a communication module, configured to communicate with a remote device and transmit the first image data and the second image data to the remote device.

[0011] Optionally, the processor is further used to perform data processing on the first image data and / or the second image data, and transmit the processed data to the remote device through the communication module.

[0012] Optionally, the image processing device is a vehicle.

[0013] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: by adding a fuzzy data processing module to the camera module, the fuzzy processing of sensitive data in the image data output by the ISP can be implemented at the camera module, so that the camera module itself can directly output the image data obtained after the fuzzy processing for use by other devices. In this way, the requirements for the data processing capabilities of other devices and the hardware requirements for related processing elements in other devices can be reduced, and it is conducive to reducing the power consumption of other devices.

[0014] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0016] Figure 1 It is a structural schematic diagram of a camera module in the related art.

[0017] Figure 2 The figure is a schematic structural diagram of a camera module according to an exemplary embodiment.

[0018] Figure 3 is a schematic structural diagram of a camera module according to another exemplary embodiment.

[0019] Figure 4 The figure is a schematic diagram showing the structure of an image processing system according to an exemplary embodiment.

[0020] Figure 5 The figure is a schematic diagram showing the structure of an image processing device according to an exemplary embodiment. DETAILED DESCRIPTION

[0021] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0022] It should be noted that all actions of acquiring signals, information or data in this application are carried out in compliance with the relevant data protection laws and policies of the country where they are located, and with the authorization given by the owner of the corresponding device.

[0023] Figure 1 Schematic diagram of the structure of a camera module in the related art. Figure 1 As shown, in the related art, the camera module 100 may include: an image acquisition element 101 and an image signal processor ISP 102, wherein the ISP 102 is connected to the image acquisition element 101, and is used to perform image processing on the image acquired by the image acquisition element 101, for example, high-definition signal processing, to obtain corresponding image data. Afterwards, the ISP 102 transmits the image data to an external processor 200, such as a vehicle-mounted host. Since the image acquired by the image acquisition element 101 may contain sensitive data, such as sensitive data that is not allowed to be disclosed according to relevant laws and regulations, such as specific place information, specific sign information, person information, etc., the processor 200 needs to perform blur processing on the image data transmitted by the ISP 102 to blur out the sensitive data contained therein. This requires additional processor computing power and memory to handle this task, and the requirements for the data processing capability and hardware requirements of the processor are relatively high.

[0024] In view of this, the present disclosure provides a camera module, an image processing system and an image processing device to solve the above technical problems.

[0025] Figure 2 FIG. 1 is a schematic diagram showing the structure of a camera module according to an exemplary embodiment. Figure 2 As shown, the camera module 300 provided by the present disclosure may include: an image acquisition component 301; an ISP 302, connected to the image acquisition component 301, for performing image processing on the image acquired by the image acquisition component 301 to obtain first image data; a fuzzy data processing module 303, connected to the ISP 302, for performing fuzzy processing on the first image data to obtain second image data.

[0026] By adding a fuzzy data processing module to the camera module, the fuzzy processing of sensitive data in the image data output by the ISP can be realized at the camera module, so that the camera module itself can directly output the image data obtained after the fuzzy processing for use by other devices. In this way, the requirements for the data processing capabilities of other devices and the hardware requirements for related processing elements in other devices can be reduced, and it is conducive to reducing the power consumption of other devices.

[0027] In at least one embodiment, the fuzzy data processing module 303 may be an application specific integrated circuit ASIC. That is, the fuzzy processing of the image data is performed using the application specific integrated circuit ASIC, which does not affect the processing efficiency of the ISP and does not increase the space occupied by the camera module too much.

[0028] Figure 3 FIG. 1 is a schematic diagram showing the structure of a camera module according to another exemplary embodiment. Figure 3 As shown, the camera module 300 may also include: a storage module 304, connected to the image acquisition component 301 and to the ISP 302, for storing images acquired by the image acquisition component 301; the ISP 302 is used to read the images acquired by the image acquisition component 301 from the storage module 304.

[0029] The storage module 304 can cache the images captured by the image acquisition component 301 to ensure the continuity of the captured real-time image data.

[0030] In at least one embodiment, the ISP 302 may be used to perform high-definition image processing on the image captured by the image acquisition element 301 to obtain first image data. That is, the first image data output by the ISP 302 is high-definition image data. For example, the high-definition image processing may include, but is not limited to, resolution adjustment, denoising, and the like.

[0031] Figure 4 FIG. 1 is a schematic diagram showing the structure of an image processing system according to an exemplary embodiment. Figure 4 As shown, the image processing system 500 may include: the above-mentioned camera module 300; a processor 400 connected to the camera module 300 and used to obtain the first image data and the second image data output by the camera module 300.

[0032] For example, the processor 400 may be connected to the ISP 302 in the camera module 300 to obtain the first image data output by the ISP 302. In addition, the processor 400 may also be connected to the fuzzy data processing module 303 in the camera module 300 to obtain the second image data output by the fuzzy data processing module 303. The connection between the processor 400 and the ISP 302 and the fuzzy data processing module 303 may be wired or wireless, which is not limited in the present disclosure.

[0033] Thus, the processor 400 can directly receive the blurred second image data from the camera module 300 without having to perform blur processing on the sensitive data itself. Therefore, the requirements on the data processing capabilities of the processor and the hardware requirements on related processing elements in the processor can be reduced, and it is also beneficial to reduce the power consumption of the processor.

[0034] Figure 5 FIG. 1 is a schematic diagram showing the structure of an image processing device according to an exemplary embodiment. Figure 5 As shown, the image processing device 600 may include the above-mentioned image processing system 500 .

[0035] The image processing device 600 may be any of a variety of intelligent devices, for example, the image processing device 600 may be a smart phone, an intelligent wearable device, a robot, a vehicle, etc. In the case of a vehicle, the processor 400 may be a vehicle-mounted host, for example, an electronic control unit (ECU) of the vehicle, a cockpit controller, a vehicle-mounted multimedia terminal, etc.

[0036] In at least one embodiment, the image processing device 600 may further include: a communication module, configured to communicate with a remote device and transmit the first image data and the second image data to the remote device.

[0037] The communication module can establish a wireless communication connection with the remote device. The processor 400 can transmit the first image data and the second image data to the remote device through the communication module so that the remote device can perform corresponding processing. For example, the remote device can include but is not limited to: a cloud server, other smart phones, other smart wearable devices, other robots, other vehicles, roadside units, etc.

[0038] In addition, the processor 400 may also be used to process the first image data and / or the second image data, and transmit the processed data to a remote device via a communication module.

[0039] The processor 400 may be configured accordingly according to actual functional requirements so that it performs corresponding data processing on the first image data and / or the second image data. The data processing may include, for example, but is not limited to: recognition and extraction of image content, target recognition, target tracking, etc. Afterwards, the processor 400 transmits the processed data to the remote device through the communication module for further processing by the remote device.

[0040] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. This application is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0041] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An image processing system, It is characterized in that include: Camera module, including: Image acquisition component; An image signal processor ISP, connected to the image acquisition element, and configured to perform image processing on the image acquired by the image acquisition element to obtain first image data; a fuzzy data processing module connected to the ISP and configured to perform fuzzy processing on sensitive data in the first image data to obtain second image data, wherein the fuzzy data processing module is an application specific integrated circuit ASIC; A processor, connected to the camera module, and configured to obtain the first image data and the second image data output by the camera module, wherein the processor is a vehicle-mounted host; Wherein, the camera module further includes: A storage module, connected to the image acquisition element and to the ISP, and used to store the image acquired by the image acquisition element; The ISP is used to read the image captured by the image acquisition element from the storage module; The ISP is used to perform high-definition image processing on the image captured by the image acquisition component to obtain first image data.

2. An image processing device, It is characterized in that The invention comprises the image processing system as claimed in claim 1.

3. The image processing device according to claim 2, It is characterized in that The image processing device further comprises: The communication module is used to communicate with a remote device and transmit the first image data and the second image data to the remote device.

4. The image processing device according to claim 3, It is characterized in that The processor is further configured to perform data processing on the first image data and / or the second image data, and transmit the processed data to the remote device via the communication module.

5. The image processing device according to any one of claims 2 to 4, It is characterized in that The image processing device is a vehicle.