Image pipeline execution method and device, chip, electronic equipment and storage medium
By adjusting the execution order of the image processing module and optimizing the image pipeline configuration, the problem of images being unreadable due to insufficient storage space was resolved, thus improving the user experience.
Patent Information
- Application Number
- CN202411480768.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-22
- Publication Date
- 2025-11-07
- Estimated Expiration
- 2044-10-22
AI Technical Summary
In the prior art, when the storage space of the image forming apparatus is insufficient, processing the target image according to the default image pipeline may result in the inability to read all images, leading to a poor user experience.
By determining whether the system memory supports the default image pipeline configuration, the execution order of the image processing modules is adjusted, and the image pipeline configuration is optimized to reduce memory usage, including image cropping, resizing, and color-to-grayscale conversion, to ensure that images can be processed in a timely manner.
This improves the user experience, ensures that images can be processed, archived, or copied in a timely manner, and avoids image reading failures due to insufficient memory.
Smart Images

Figure CN119484723B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of image forming, in particular to an image pipeline execution method and device, a chip, an electronic equipment and a storage medium. BACKGROUND
[0002] When performing a scanning task, an image forming device usually first acquires a target image by using a scanning device on the image forming device, then performs relevant digital image processing on the acquired target image by using an image pipeline, and finally archives or copies the processed target image. The image pipeline technology refers to a technology of associating image processing modules such as image cropping processing, image scaling processing and color space conversion in a certain order, so as to sequentially perform image processing on a target image.
[0003] Specifically, in the prior art, an image pipeline sequentially processes a target image in a fixed order of different image processing modules, so as to archive or copy the target image.
[0004] However, since the memory of an image processing chip configured to execute the image pipeline is limited, if the target image is still processed according to the default image pipeline when the storage space is insufficient, it may cause that all the target images cannot be read, and thus the user experience is poor.
[0005] It should be noted that the information disclosed in the background section of the present application is only intended to deepen the understanding of the general background of the present application, and should not be regarded as acknowledging or implying in any form that the information constitutes prior art known to those skilled in the art. SUMMARY
[0006] Therefore, the present application provides an image pipeline execution method and device, a chip, an electronic equipment and a storage medium, so as to solve the problem that when the storage space is insufficient, if the target image is still processed according to the default image pipeline, it may cause that all the target images cannot be read, and thus the user experience is poor.
[0007] In a first aspect, an image pipeline execution method is provided, which is executed on an image processing chip, and the method comprises:
[0008] determining whether a system memory supports execution of a default image pipeline configuration on a target image, the default image pipeline configuration comprising a plurality of image processing modules in a fixed order;
[0009] adjust an execution order of one or more of the image processing modules in the default image pipeline configuration when the system memory does not support execution of the target image using the default image pipeline configuration, to determine a target image pipeline configuration, wherein execution of the target image using the target image pipeline configuration occupies less system memory than execution of the target image using the default image pipeline configuration;
[0010] execute the target image using the target image pipeline configuration.
[0011] In the embodiments of the present application, firstly, it is judged whether the system memory supports execution of a target image using a default image pipeline configuration; when the system memory does not support execution of the target image using the default image pipeline configuration, an execution order of one or more image processing modules in the default image pipeline configuration is adjusted to determine a target image pipeline; finally, the target image is executed using the target image pipeline configuration. It can be understood that when the system memory is insufficient, the execution order of the image processing modules is adjusted to reduce the occupancy of the target image in the system memory, so that the target image can be processed in time, and the user experience is improved to a certain extent.
[0012] In a possible implementation, the judging whether the system memory supports execution of the target image using the default image pipeline configuration comprises:
[0013] According to the image parameters corresponding to the target image, it is judged whether the system memory supports execution of the target image using the default image pipeline configuration, wherein the image parameters corresponding to the target image include the size of the memory occupied by the target image and the resolution of the target image.
[0014] In the embodiments of the present application, according to the size of the memory occupied by the target image and the resolution of the target image, it can be more accurately judged whether the system memory supports execution of the target image using the default image pipeline configuration, so that the execution order of the image processing modules can be adjusted in time, the occupancy of the target image in the system memory is reduced, the target image can be processed in time, and the user experience is improved to a certain extent.
[0015] In a possible implementation, the judging whether the system memory supports execution of the target image using the default image pipeline configuration comprises:
[0016] In response to a target image format configuration requirement triggered by a user, a configuration format of the target image is determined, the configuration format of the target image being a format of the target image after image pipeline configuration;
[0017] According to the configuration format of the target image, it is judged whether the system memory supports execution of the target image using the default image pipeline configuration.
[0018] In this embodiment, in response to a user-triggered target image format configuration request, the configuration format of the target image is determined. Based on the configuration format of the target image, it is possible to more accurately determine whether the system memory supports the execution of the default image pipeline configuration for the target image, thereby enabling timely adjustment of the execution order of the image processing module, reducing the occupancy rate of the target image in the system memory, and allowing the target image to be processed in a timely manner, which improves the user experience to a certain extent.
[0019] In one possible implementation, adjusting the execution order of one or more image processing modules in the default image pipeline configuration to determine the target image pipeline includes:
[0020] Determine whether the default image pipeline configuration includes image space reduction processing, wherein the image space reduction processing is a process that reduces the storage space of the target image;
[0021] When the default image pipeline configuration includes image space reduction processing, the image processing module corresponding to the image space reduction processing in the default image pipeline configuration is moved forward, thereby determining the target image pipeline.
[0022] In this embodiment, it is first determined whether the default image pipeline configuration includes image space reduction processing. When the default image pipeline configuration includes image space reduction processing, the image processing module corresponding to the image space reduction processing in the default image pipeline configuration is moved forward, thereby reducing the memory occupancy of the target image in the system first, so that the target image can be processed in a timely manner, which improves the user experience to a certain extent.
[0023] In one possible implementation, the image space reduction process includes: image cropping, image reduction, and color-to-grayscale conversion.
[0024] In the embodiments of this application, image cropping, image reduction, and color-to-grayscale conversion can all reduce the memory footprint of the target image in the system, thereby enabling the target image to be processed in a timely manner and improving the user experience to a certain extent.
[0025] In one possible implementation, performing the target image pipeline configuration on the target image includes:
[0026] During the configuration of the target image pipeline, before each image processing module in the target image pipeline outputs the target image, compression processing is performed on the target image.
[0027] In the embodiment of the present application, the compression processing is performed on the target image before each image processing module in the target image pipeline outputs the target image, which can reduce the memory occupancy rate of the target image when passing between each image processing module, so that the target image can be processed in time, and the user experience is improved to a certain extent.
[0028] In a possible implementation, the method further includes:
[0029] When the system memory supports performing the default image pipeline configuration on the target image, performing the default image pipeline configuration on the target image.
[0030] In the embodiment of the present application, when the system memory supports performing the default image pipeline configuration on the target image, the default image pipeline configuration is performed on the target image, which can ensure that the target image is fully processed for archiving or copying, and the user experience is improved to a certain extent.
[0031] In a possible implementation, performing the default image pipeline configuration on the target image includes:
[0032] Determining whether the target image is a blank page.
[0033] When the target image is not a blank page, performing the default image pipeline configuration on the target image.
[0034] In the embodiment of the present application, it is first determined whether the target image is a blank page, and when the target image is not a blank page, the default image pipeline configuration is performed on the target image, which can avoid invalid operations of the image processing chip when the target image is a blank page, and the user experience is improved to a certain extent.
[0035] In a possible implementation, the method further includes:
[0036] When the target image is a blank page, the default image pipeline configuration function is closed.
[0037] In the embodiment of the present application, when the target image is a blank page, the default image pipeline configuration function is closed, which can avoid invalid operations of the image processing chip when the target image is a blank page, and the user experience is improved to a certain extent.
[0038] In a second aspect, the embodiment of the present application provides an image pipeline execution device, including:
[0039] A determining module is configured to determine whether a system memory supports performing a default image pipeline configuration on a target image, the default image pipeline configuration including a plurality of image processing modules in a fixed order.
[0040] a target image pipeline determination module, configured to adjust an execution order of one or more of the image processing modules in the default image pipeline configuration when the system memory does not support execution of the default image pipeline configuration on the target image, so as to determine a target image pipeline configuration, wherein a system memory occupied by execution of the target image pipeline configuration on the target image is less than a system memory occupied by execution of the default image pipeline configuration on the target image;
[0041] an execution module, configured to execute the target image pipeline configuration on the target image.
[0042] In a third aspect, an image processing chip is provided, and the image processing chip comprises:
[0043] The image processing chip is configured to execute the method in any one of the first aspect.
[0044] In a fourth aspect, an electronic device is provided, and the electronic device comprises:
[0045] a processor;
[0046] a memory;
[0047] and a computer program, wherein the computer program is stored in the memory, and the computer program comprises instructions, which, when executed by the processor, cause the electronic device to execute the method in any one of the first aspect.
[0048] In a fifth aspect, a computer readable storage medium is provided, and the computer readable storage medium comprises a stored program, wherein the program, when executed, controls a device where the computer readable storage medium is located to execute the method in any one of the first aspect.
[0049] It can be understood that the image pipeline execution apparatus provided in the second aspect, the image processing chip provided in the third aspect, the electronic device provided in the fourth aspect, and the computer readable storage medium provided in the fifth aspect are all used to execute the method provided in the present application. Therefore, the beneficial effects that can be achieved thereby can refer to the beneficial effects in the corresponding method, which will not be described here again. BRIEF DESCRIPTION OF DRAWINGS
[0050] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the embodiments will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor.
[0051] Figure 1 An application scenario diagram is provided for the embodiments of the present application.
[0052] Figure 2 A working diagram of an image pipeline is provided for the present application.
[0053] Figure 3 A flow diagram of an image pipeline execution method is provided for the embodiments of the present application.
[0054] Figure 4 A structural diagram of an image pipeline execution device is provided for the embodiments of the present application.
[0055] Figure 5 A structural diagram of an electronic device is provided for the embodiments of the present application. DETAILED DESCRIPTION
[0056] In order to better understand the technical solutions of the present application, the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0057] It should be clear that the described embodiments are only some of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative labor fall within the scope of protection of the present application.
[0058] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise.
[0059] It should be understood that the term "and / or" used herein is only to describe the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the three cases of A alone, A and B together, and B alone. In addition, the character " / " in this paper generally represents that the front and rear associated objects are a "or" relationship.
[0060] An image forming device is a device that forms an image on an imaging medium by imaging principles, such as a printer, a copier, a fax machine, a multifunction image making and copying device, an electrostatic printing device, and any other similar device. In practical applications, image forming devices are increasingly widely used in offices and daily life. In order to facilitate understanding, the specific application scenarios will be described first by way of example.
[0061] Referring to Figure 1An application scenario is provided for the embodiments of the present application. As shown in Figure 1 The application scenario includes an image forming device 101. It should be noted that the image forming device described herein is only an example and should not be considered as a limitation of the protection scope of the present application. For example, the image forming device includes, but is not limited to, a printer, a copier, a fax machine, a scanner, and a multifunctional machine integrating printing, copying, faxing, and scanning functions, etc., and its function is to print images or text on an imaging medium.
[0062] Specifically, when performing a scanning job, the image forming device usually first acquires a target image using a scanning device on the image forming device; then performs relevant digital image processing on the acquired target image using an image pipeline; and finally archives or copies the processed target image.
[0063] For ease of understanding, a color laser printer is taken as an example. The color laser printer has become the mainstream direction of the development of printers due to its printing speed and strong color reproduction. Two key technologies are crucial in color scanning, one is the ability of the scanning device to acquire images, and the other is the digital image processing technology of the scanned images. Through the target image of the scanner, some image processing operations are needed before compression and archiving or copying to make the image be archived or copied with the best quality.
[0064] It should be noted that the image pipeline technology refers to the technology of associating image processing modules such as image cropping processing, image scaling processing, and color space conversion in a certain order to sequentially perform image processing on the target image in order.
[0065] For ease of understanding, refer to Figure 2 A working diagram of an image pipeline is provided for the present application. As shown in the figure, the diagram shows an angle detection module 201, a histogram statistics module 202, an image correction module 203, an image correction / cropping and scaling module 204, an image enhancement module 205, an image printing module 206, and an encoding module 207. The angle detection module 201 is used to acquire the offset angle of the target image; the histogram statistics module 202 is used to determine the distribution of different colors in the target image; the image correction module 203 is used to correct obvious errors of the target image; the image correction / cropping and scaling module 204 is used to correct / crop and scale the target image; the image enhancement module 205 is used to enhance the quality of the target image; the image printing module 206 is used to print the target image; and the encoding module 207 is used to compress the target module for storage.
[0066] It should be noted that Figure 2The image pipeline shown in the figure is only an exemplary illustration, and those skilled in the art can adjust the types and quantities of the image processing modules included in the image pipeline or the execution order of the image processing modules according to actual needs, which is not specifically limited in the present application.
[0067] In the prior art, the image pipeline processes the target image in a fixed order of different image processing modules, so as to archive or copy the target image.
[0068] Of course, in the related art, different pipeline configurations can also be selected according to the different densities of the target image, so as to complete the image processing with the best efficiency.
[0069] However, the above-mentioned related method only considers the image processing efficiency and does not consider that a more complex image may be difficult to complete some image processing work in the case of limited memory space, so that the memory use efficiency problem is not solved. That is, when the memory is insufficient, if the target image is still processed according to the default image pipeline, it may not be able to read all the target images, thereby causing poor user experience.
[0070] To solve the above problems, in the embodiments of the present application, first, it is judged whether the system memory supports executing the default image pipeline configuration on the target image; when the system memory does not support executing the default image pipeline configuration on the target image, the execution order of one or more image processing modules in the default image pipeline configuration is adjusted, and then the target image pipeline is determined; finally, the target image is executed according to the target image pipeline configuration. It can be understood that when the system memory is insufficient, the execution order of the image processing modules is adjusted, thereby reducing the occupancy rate of the target image in the system memory, so that the target image can be processed in time, and the user experience is improved to a certain extent. In the following, the specific implementation mode is described in detail.
[0071] Referring to Figure 3 A flowchart of an image pipeline execution method provided by the embodiments of the present application is shown. The method can be applied to Figure 1 the application scenario shown in FIG. 1, as shown in FIG. 2, which mainly includes the following steps. Figure 3
[0072] Step S301: judging whether the system memory supports executing the default image pipeline configuration on the target image.
[0073] In actual application, the target image is first acquired. Specifically, the scanning device in the image forming device acquires the target image by scanning the image. It should be pointed out that the target image is used to represent one or more images.
[0074] In the embodiment of the present application, when the target image is acquired, the image processing chip first reads the target image, and then determines whether the system memory supports performing the default image pipeline configuration on the target image. The default image pipeline configuration includes a plurality of image processing modules in a fixed order. The system memory is used to represent the storage space of the target image corresponding to the image processing chip.
[0075] Specifically, in a possible implementation, whether the system memory supports performing the default image pipeline configuration on the target image is determined according to the image parameters corresponding to the target image, wherein the image parameters corresponding to the target image include the size of the memory occupied by the target image and the resolution of the target image.
[0076] It can be understood that the size of the memory occupied by the target image and the resolution of the target image both represent the space of the system memory occupied by the target image. When the size of the memory occupied by the target image is larger and the resolution of the target image is higher, the system memory occupied by the target image is larger, and at this time, the default image pipeline may not be able to process the target image.
[0077] In the embodiment of the present application, whether the system memory supports performing the default image pipeline configuration on the target image can be more accurately determined according to the size of the memory occupied by the target image and the resolution of the target image, so that the execution order of the image processing module can be adjusted in time, thereby reducing the occupancy rate of the target image in the system memory, so that the target image can be processed in time, and the user experience is improved to a certain extent.
[0078] Of course, in a possible implementation, in response to a target image format configuration requirement triggered by a user, the configuration format of the target image is determined, and whether the system memory supports performing the default image pipeline configuration on the target image is determined according to the configuration format of the target image. The configuration format of the target image is the format of the target image after the image pipeline configuration.
[0079] It can be understood that when the configuration format of the target image is an enlarged format, the system memory occupied by the target image will become larger and larger, and at this time, the default image pipeline may not be able to process the target image. Similarly, when the configuration format of the target image is a clipping format, the system memory occupied by the target image will become smaller and smaller, and at this time, the default image pipeline can process the target image.
[0080] In the embodiment of the present application, whether the system memory supports performing the default image pipeline configuration on the target image can be more accurately determined according to the configuration format of the target image, so that the execution order of the image processing module can be adjusted in time, thereby reducing the occupancy rate of the target image in the system memory, so that the target image can be processed in time, and the user experience is improved to a certain extent.
[0081] In a possible implementation, when the system memory supports performing the default image pipeline configuration on the target image, the default image pipeline configuration is performed on the target image. It can be understood that when the system memory supports performing the default image pipeline configuration on the target image, performing the default image pipeline configuration on the target image can ensure that the target image is sufficiently processed so as to be archived or copied, thereby improving the user experience to a certain extent.
[0082] In a possible implementation, when the system memory supports performing the default image pipeline configuration on the target image, it is determined whether the target image is a blank page; and when the target image is not a blank page, the default image pipeline configuration is performed on the target image.
[0083] It can be understood that when the target image is a blank page, it indicates that the content of the target image obtained by scanning is empty, and therefore the target image does not need to be processed by the image pipeline.
[0084] In the embodiment of the application, it is first determined whether the target image is a blank page; and when the target image is not a blank page, the default image pipeline configuration is performed on the target image, which can avoid the image processing chip performing invalid operations when the target image is a blank page, thereby improving the user experience to a certain extent.
[0085] In a possible implementation, when the target image is a blank page, the default image pipeline configuration function is closed, which can avoid the image processing chip performing invalid operations when the target image is a blank page, thereby improving the user experience to a certain extent.
[0086] In a possible implementation, when the system memory does not support performing the default image pipeline configuration on the target image, the execution order of one or more image processing modules in the default image pipeline configuration is adjusted, and then the target image pipeline is determined.
[0087] In the embodiment of the application, when the system memory does not support performing the default image pipeline configuration on the target image, the execution order of one or more image processing modules in the default image pipeline configuration is adjusted, and then the target image pipeline is determined.
[0088] Specifically, in a possible implementation, it is determined whether the default image pipeline configuration contains image space reduction processing; when the default image pipeline configuration contains image space reduction processing, the image processing module corresponding to the image space reduction processing in the default image pipeline configuration is moved forward, and then the target image pipeline is determined. The image space reduction processing is processing that reduces the storage space of the target image.
[0089] It can be understood that, by advancing the corresponding image processing module in the default image pipeline configuration through image space reduction processing, the determined target image pipeline can first reduce the occupancy of the target image in the system memory, so that the target image can be processed in time, and the user experience is improved to a certain extent.
[0090] Specifically, in a possible implementation, the image space reduction processing includes image cropping processing, image reduction processing, and color-to-gray processing. The image cropping processing means cropping part of the target image, which can reduce the storage space of the target image. The image reduction processing means reducing the area of the target image, which can reduce the storage space of the target image without excessively improving the image quality of the target image. The color-to-gray processing means converting the color target image into a grayscale image, which can reduce the storage space of the target image.
[0091] Exemplarily, the default image pipeline is to sequentially perform angle detection, histogram statistics, image correction, image rectification processing, image cropping processing, image scaling processing, image enhancement, and image printing. When the scanned target image is a color three-channel image and the output target image is required to be a grayscale image, the color-to-gray processing corresponding to the image enhancement is opened in the image enhancement, and the color-to-gray processing corresponding to the image enhancement is advanced, and then the target image pipeline is determined. That is, the target image pipeline is: angle detection, the color-to-gray processing corresponding to the image enhancement, histogram statistics, image correction, image rectification processing, image cropping processing, image scaling processing, other image enhancement, and image printing.
[0092] It should be noted that, since the angle detection needs to be performed on the original image obtained after scanning, when the target image pipeline processing includes angle detection, the angle detection can be taken as the first step of the target image pipeline processing, and then the angle information is obtained. Of course, the angle detection can also be adjusted according to actual needs by those skilled in the art, so that the angle detection can also be in other positions of the target image pipeline, and the present application does not make specific limitation thereto.
[0093] Similarly, when the scanned target image needs to be cropped, the corresponding target image pipeline is: angle detection, image cropping processing, histogram statistics, image correction, image rectification processing, image scaling processing, image enhancement, and image printing. Similarly, the same applies.
[0094] In the embodiments of the present application, the image cropping processing, the image reduction processing, and the color-to-gray processing can all reduce the occupancy of the target image in the system memory, and then the target image can be processed in time, and the user experience is improved to a certain extent.
[0095] Of course, in the embodiments of the present application, the image space reduction processing can also include other processing, which is not limited in the present application.
[0096] Step S303: performing target image pipeline configuration on the target image.
[0097] In the embodiments of the present application, after the target image pipeline is determined, the target image pipeline configuration is performed on the target image.
[0098] In a possible implementation, during the target image pipeline configuration on the target image, the target image is compressed before each image processing module in the target image pipeline outputs the target image.
[0099] Specifically, before the target image pipeline works, the image compression and decompression functions in the image processing modules corresponding to each stage of the pipeline are opened. Specifically, the target image is compressed first, and when the image processing module corresponding to the next stage of the pipeline receives the compressed target image, the target image is decompressed and other image processing is performed; after the processing is completed, the target image is compressed and outputted; and the above process is repeated until the processing is completed.
[0100] Of course, in a possible implementation, when the system memory does not support the default image pipeline configuration on the target image, the target image can also be compressed first, and then it is judged whether the compressed target image can be configured according to the default image pipeline. When the compressed target image can be configured according to the default image pipeline, the target image is controlled to continue to be configured according to the default image pipeline.
[0101] In the embodiments of the present application, the target image is compressed before each image processing module in the target image pipeline outputs the target image, which can reduce the memory occupancy rate of the target image during transmission between each image processing module, so that the target image can be processed in time, and the user experience is improved to a certain extent.
[0102] Corresponding to the above embodiments, the present application also provides an image pipeline execution device. Referring to Figure 4A structural schematic diagram of an image pipeline execution apparatus provided in an embodiment of the present application is shown in FIG. 4. As shown in the figure, the image pipeline execution apparatus 400 is shown in the figure. The image pipeline execution apparatus 400 includes a judging module 401, a target image pipeline determination module 402, and an execution module 403. The judging module 401 is configured to judge whether the system memory supports performing a default image pipeline configuration on a target image. The target image pipeline determination module 402 is configured to adjust the execution order of one or more image processing modules in the default image pipeline configuration when the system memory does not support performing the default image pipeline configuration on the target image, and then determine a target image pipeline configuration. The execution module 403 is configured to perform the target image pipeline configuration on the target image.
[0103] Corresponding to the above-mentioned embodiments, the present application further provides an image processing chip. The image processing chip is used to execute the corresponding method in the above-mentioned embodiments.
[0104] Corresponding to the above-mentioned embodiments, the present application further provides an electronic device. Referring to Figure 5 A structural schematic diagram of an electronic device provided in an embodiment of the present application is shown in FIG. 5. The electronic device 500 can include a processor 501, a memory 502, and a communication unit 503. These components communicate through one or more buses. Those skilled in the art can understand that the structure of the electronic device shown in the figure does not constitute a limitation on the embodiments of the present application. It can be a bus structure or a star structure. It can include more or fewer components than shown in the figure, or combine some components, or have different component arrangements.
[0105] The communication unit 503 is configured to establish a communication channel, so that the electronic device can communicate with other devices. It receives user data sent by other devices or sends user data to other devices.
[0106] The processor 501 is the control center of the electronic device. It connects various parts of the electronic device through various interfaces and lines, executes software programs, instructions, and / or modules stored in the memory 502, and calls data stored in the memory, to perform various functions of the electronic device and / or process data. The processor can be composed of integrated circuits (ICs). For example, it can be composed of a single packaged IC, or it can be composed of multiple packaged ICs connected together. For example, the processor 501 can only include a central processing unit (CPU). In the embodiments of the present application, the CPU can be a single operation core or can include multiple operation cores.
[0107] The memory 502 is configured to store execution instructions of the processor 501. The memory 502 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic storage, a flash memory, a magnetic disk, or an optical disk.
[0108] When the execution instructions in the memory 502 are executed by the processor 501, the electronic device 500 is enabled to perform Figure 1 some or all of the steps in the embodiments shown.
[0109] In specific implementations, the present disclosure further provides a computer storage medium, which can store a program. When the program is executed, the program can include some or all of the steps in the embodiments of the method for generating a simulation scene provided by the present disclosure. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM), etc.
[0110] In specific implementations, the present disclosure further provides a computer program product, which contains executable instructions. When the executable instructions are executed on a computer, the computer is enabled to perform some or all of the steps in the embodiments of the method for generating a simulation scene provided by the present disclosure.
[0111] In the embodiments of the present disclosure, “at least one” means one or more, and “multiple” means two or more. “And / or” describes the association relationship of the associated objects, which means that there can be three kinds of relationships, for example, A and / or B, which can represent the cases of A alone, A and B together, and B alone. Wherein A and B can be singular or plural. The character “ / ” generally represents that the associated objects before and after it are in an “or” relationship. “At least one of the following” and similar expressions mean any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, and c can represent a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, and c can be single or multiple.
[0112] Those skilled in the art can clearly understand that the units and algorithm steps described in the embodiments disclosed herein can be realized by electronic hardware, computer software and combination of the electronic hardware and the computer software. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solutions. Those skilled in the art can use different methods to realize the described functions for each specific application, but it should not be considered that the implementation goes beyond the scope of the present application.
[0113] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be described here.
[0114] In several embodiments provided in the present application, any function realized in the form of a software function unit and sold or used as an independent product can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the part of the technical solutions that make contributions to the prior art or the part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.
[0115] The same or similar parts among the various embodiments in the specification can be referred to each other. Especially, for the device embodiments and the terminal embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the related parts can refer to the description in the method embodiments.
Claims
1. A method of image pipeline execution, the method comprising: The method is executed on an image processing chip, and the method comprises: determining whether system memory supports execution of a default image pipeline configuration on a target image, the default image pipeline configuration comprising a plurality of image processing modules in a fixed order; when the system memory does not support execution of the default image pipeline configuration on the target image, adjusting the execution order of one or more of the image processing modules in the default image pipeline configuration, and thereby determining a target image pipeline, wherein the system memory occupied by execution of the target image pipeline configuration on the target image is less than the system memory occupied by execution of the default image pipeline configuration on the target image; executing the target image pipeline configuration on the target image.
2. The method of claim 1, wherein, The determination of whether the system memory supports execution of the default image pipeline configuration on the target image comprises: determining, according to an image parameter corresponding to the target image, whether the system memory supports execution of the default image pipeline configuration on the target image, wherein the image parameter corresponding to the target image comprises the size of the memory occupied by the target image and the resolution of the target image.
3. The method of claim 1, wherein, The determination of whether the system memory supports execution of the default image pipeline configuration on the target image comprises: in response to a target image format configuration requirement triggered by a user, determining a configuration format of the target image, the configuration format of the target image being a format of the target image after the target image has been processed by the default image pipeline configuration; determining, according to the configuration format of the target image, whether the system memory supports execution of the default image pipeline configuration on the target image.
4. The method of claim 1, wherein, The adjustment of the execution order of one or more of the image processing modules in the default image pipeline configuration, and thereby the determination of the target image pipeline, comprises: determining whether the default image pipeline configuration contains an image space reduction process, the image space reduction process being a process of reducing the storage space of the target image; when the default image pipeline configuration contains the image space reduction process, advancing the image processing module corresponding to the image space reduction process in the default image pipeline configuration, and thereby determining the target image pipeline.
5. The method of claim 4, wherein, The image space reduction process comprises image cropping, image reduction and color-to-gray processing.
6. The method of claim 1, wherein, The execution of the target image pipeline configuration on the target image comprises: during the execution of the target image pipeline configuration on the target image, performing compression processing on the target image before each of the image processing modules in the target image pipeline outputs the target image.
7. The method of claim 1, wherein, Further comprising: when the system memory supports execution of the default image pipeline configuration on the target image, executing the default image pipeline configuration on the target image.
8. The method of claim 7, wherein, The execution of the default image pipeline configuration on the target image comprises: determining whether the target image is a blank page; when the target image is not a blank page, executing the default image pipeline configuration on the target image.
9. An image pipeline execution apparatus, characterized by, Further comprising: A judging module is configured to judge whether a system memory supports a default image pipeline configuration for a target image, the default image pipeline configuration comprising a plurality of image processing modules in a fixed order; A target image pipeline determining module is configured to adjust an execution order of one or more of the image processing modules in the default image pipeline configuration when the system memory does not support the default image pipeline configuration for the target image, and to determine a target image pipeline configuration, wherein a system memory occupied by execution of the target image pipeline configuration for the target image is less than a system memory occupied by execution of the default image pipeline configuration for the target image; An executing module is configured to execute the target image pipeline configuration for the target image.
10. An image processing chip, characterized by The image processing chip is configured to execute the method in any one of claims 1 to 8. The electronic device comprises:
11. An electronic device, comprising: a processor; a memory; and a computer program, wherein the computer program is stored in the memory, and the computer program comprises instructions which, when executed by the processor, cause the electronic device to perform the method in any one of claims 1 to 8. The computer-readable storage medium comprises a stored program, wherein the program, when executed, controls a device in which the computer-readable storage medium is located to perform the method in any one of claims 1 to 8.
12. A computer-readable storage medium, characterized in that,
Citation Information
Patent Citations
Pipelined image processing engine
CN101673391A
Image procsessing apparatus, image processing method and vehicle control apparatus
CN107229451A