Information processing device and program
The information processing device optimizes image representation by dividing images into raster and vector regions based on feature differences, addressing data volume and quality issues in existing formats.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-12-02
- Publication Date
- 2026-03-17
AI Technical Summary
Existing image description formats struggle to generate images with the desired quality by combining the advantages of raster and vector formats, leading to issues with data volume and image quality when converting between formats.
An information processing device that divides images into regions suitable for raster or vector formats based on feature differences, converting between formats as needed to maintain intended image quality while reducing data volume.
The device generates images with suppressed data volume and maintained image quality by optimizing raster and vector representations, addressing the limitations of single-format approaches.
Smart Images

Figure 0007830910000001 
Figure 0007830910000002 
Figure 0007830910000003
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus ,oh and a program.
Background Art
[0002] Conventionally, there are multiple image description formats. Regarding which image description format to use for expressing an image, it has been performed in units of pages composed of photographs, figures, illustrations, text, etc., or in units of objects included in a page (for example, Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, since each image description format has advantages and disadvantages, for example, it is impossible to generate an image of an object that has both the advantages of expressing an image in a raster format and the advantages of expressing an image in a vector format, and it has been difficult to generate an image with the image quality intended by the user.
[0005] An object of the present invention is to be able to generate an image with the image quality intended by the user as compared with an image expressed in a single image description format.
Means for Solving the Problems
[0006] The invention described in claim 1 includes a processor, and the processor divides an image of a first object included in an image If the first object is represented in raster format, the image of the first object is converted to vector format, and an image of the third object is generated by converting it back to raster format, and based on the difference between the image of the first object and the image of the third object... into a first area to be expressed in a raster format and The aforementioned a second area to be expressed in a vector format, The aforementioned and divides it. ,before The image of the second region is converted to the vector format. ,before This information processing device is characterized by generating an image of a second object that includes an image of a first region and an image of the second region. Claim 2 The invention described herein is characterized in that the processor divides the image of the third object and the image of the first object into a first region and a second region based on the difference in feature quantities, as a difference between them. 1 This is the information processing device described above. Claim 3 The invention described herein relates to a computer that processes images of a first object contained in an image. If the first object is represented in raster format, the function converts the image of the first object to vector format and generates an image of the third object converted back to raster format, and based on the difference between the image of the first object and the image of the third object... Then, the image of the first object, The aforementioned The first area should be represented in raster format, The aforementioned A function to divide into a second area that should be represented in vector format. ,before Convert the image of the second region to the vector format. exchange This program implements the functions of generating an image of a second object which includes the image of the first region and the image of the second region. [Effects of the Invention]
[0007] According to claim 1 of the present invention, it is possible to provide an information processing device that can generate objects that suppress an increase in data volume compared to objects represented in raster format alone or vector format alone, while maintaining the intended image quality. Furthermore, by converting the image of the first object in raster format to vector format, and then converting it back to raster format, the image of the third object generated is compared with the image of the first object. Areas with large differences can be considered areas that should be represented in raster format, while areas with small differences can be considered areas that should be represented in vector format. Claim 2 According to the present invention, an image of a third object is generated by converting the image of a first object in raster format to vector format and then converting it back to raster format. By comparing this image with the image of the first object, regions with large differences in feature quantities can be designated as regions to be represented in raster format, while regions with small differences in feature quantities can be designated as regions to be represented in vector format. Claim 3According to the present invention, it is possible to provide a program that can generate an object in which an increase in data volume is suppressed and an intended image quality is maintained, compared to an object represented in only a raster format or only a vector format. Furthermore, by converting the image of the first object in raster format to vector format, and then converting it back to raster format, the image of the third object generated is compared with the image of the first object. Areas with large differences can be considered areas that should be represented in raster format, while areas with small differences can be considered areas that should be represented in vector format.
Brief Description of the Drawings
[0008] [Figure 1] It is a diagram showing an example of the overall configuration of an information processing system to which the present embodiment is applied. [Figure 2] It is a diagram showing the hardware configuration of the management server. [Figure 3] It is a diagram showing the functional configuration of the control unit of the management server. [Figure 4] It is a diagram showing the functional configuration of the control unit of the user terminal. [Figure 5] It is a flowchart showing the processing flow of the management server. [Figure 6] It is a flowchart showing the processing flow of the user terminal. [Figure 7] (A) is a diagram showing a specific example of an image. (B) is a diagram showing a specific example of the data structure when the image of (A) is represented in a raster format. [Figure 8] It is a diagram showing a specific example of an image of an object represented only in a raster format. [Figure 9] It is a diagram showing a specific example of an image of an object represented only in a vector format. [Figure 10] It is a diagram showing a specific example of an image of an object representing an edge region and a non-edge region other than the edge region as a detection result of the edge region. [Figure 11] Based on the detection result of the edge region shown in FIG. 10, it is a diagram showing a specific example of an image of an object including a region represented in a raster format for a portion determined to be a non-edge region and a region represented in a vector format for a portion detected as an edge region.
Embodiments for Carrying Out the Invention
[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. (Configuration of Information Processing System) FIG. 1 is a diagram showing an example of the overall configuration of an information processing system 1 to which the present embodiment is applied. The information processing system 1 is configured by connecting a management server 10 and user terminals 30 via a network 90. The network 90 is, for example, a LAN (Local Area Network), the Internet, or the like.
[0010] The management server 10 is an information processing device as a server that manages the information processing system 1. The management server 10, for example, divides the image of an object included in the image of the entire page into an area to be expressed in a raster format and an area to be expressed in a vector format according to the mode of the image of the object. Further, when the image of an object to be subjected to image processing among the images of one or more objects included in the image of the entire page is expressed in a raster format, the management server 10 converts the image of the area to be expressed in a vector format into a vector format expression. Also, when the image of an object to be subjected to image processing is expressed in a vector format, the management server 10 converts the area to be expressed in a raster format into a raster format. Then, the management server 10 generates an image of an object including an area expressed in a raster format and an area expressed in a vector format. Details of these processes by the management server 10 will be described later. In this specification, the expression "image" shall include "image data".
[0011] Here, the "raster format" is an image description format that expresses an image by pixels with different densities and pixels of various colors, and is often used when expressing complex shadows such as photographs and graphics. Raster format images are saved in file formats such as BMP, JPEG, TIFF, GIF, PNG, etc. The raster format is known for its ability to reproduce colors and tones, but it is said to have problems with the reproducibility of the edge regions indicating lines and boundaries included in the image.
[0012] Furthermore, "vector format" is an image description format that represents images using vector data. "Vector data" is data that represents points, lines, polygons, etc., using coordinate values and attribute information. Vector format images are saved in file formats such as SVG, PDF, and HTML. In this embodiment, vector format images are saved in SVG file format. When illustrations and graphic data are represented in vector format, the amount of data can be reduced compared to representation in raster format, but there are said to be issues with the reproduction of color and gradation.
[0013] The user terminal 30 is an information processing device such as a personal computer, tablet, or smartphone operated by the user. The user terminal 30 accepts input operations to specify a page containing an image of an object to be processed. The user terminal 30 also accepts input operations to specify an image of an object to be processed from the image of the entire specified page.
[0014] Furthermore, the user terminal 30 accepts input operations to specify at least one of the regions of the specified object's image that should be represented in raster format and the regions that should be represented in vector format. Based on the content of the input operations, when the management server 10 generates an image of the object that includes both the regions represented in raster format and the regions represented in vector format, the user terminal 30 retrieves and displays the image of that object. Details of these processes performed by the user terminal 30 will be described later.
[0015] The functions of the management server 10 and user terminal 30 that constitute the information processing system 1 described above are merely examples, and it is sufficient for the information processing system 1 as a whole to possess the functions described above. For this reason, some or all of the above functions may be shared or performed collaboratively within the information processing system 1. That is, some or all of the functions of the management server 10 may be assigned to the functions of the user terminal 30, or some or all of the functions of the user terminal 30 may be assigned to the functions of the management server 10. Furthermore, some or all of the functions of the management server 10 and user terminal 30 that constitute the information processing system 1 may be transferred to other servers, etc., not shown in the diagram. This will facilitate processing for the information processing system 1 as a whole, and will also allow for mutual complementarity of processing.
[0016] (Management server hardware configuration) Figure 2 shows the hardware configuration of the management server 10. The management server 10 includes a control unit 11, a memory 12, a storage unit 13, a communication unit 14, an operation unit 15, and a display unit 16. These units are connected by a data bus, an address bus, a PCI (Peripheral Component Interconnect) bus, etc.
[0017] The control unit 11 is a processor that controls the functions of the management server 10 through the execution of various software such as the OS (operating system) and application software. The control unit 11 is composed of, for example, a CPU (Central Processing Unit). The memory 12 is a storage area that stores various software and data used for its execution, and is used as a work area during calculations. The memory 12 is composed of, for example, RAM (Random Access Memory).
[0018] The storage unit 13 is a storage area that stores input data for various software and output data from various software. The storage unit 13 is composed of, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), or semiconductor memory used to store programs and various setting data. The storage unit 13 also stores a database for storing various information, such as an image DB 801 containing still images and moving images.
[0019] The communication unit 14 transmits and receives data between the user terminal 30 and the outside world via the network 90. The operation unit 15 consists of, for example, a keyboard, mouse, mechanical buttons, and switches, and accepts input operations. The operation unit 15 also includes a touch sensor that forms a touch panel integrally with the display unit 16. The display unit 16 consists of, for example, a liquid crystal display or an organic EL (=Electro Luminescence) display used for displaying information, and displays image and text data.
[0020] (User terminal hardware configuration) The hardware configuration of the user terminal 30 is the same as that of the management server 10 shown in Figure 2. Therefore, the illustration and explanation of the hardware configuration of the user terminal 30 are omitted.
[0021] (Functional configuration of the control unit of the management server) Figure 3 shows the functional configuration of the control unit 11 of the management server 10. The control unit 11 of the management server 10 functions as follows: information acquisition unit 101, object identification unit 102, edge detection unit 103, area division unit 104, format conversion unit 105, image generation unit 106, and transmission control unit 107.
[0022] The information acquisition unit 101 acquires various types of information. For example, the information acquisition unit 101 acquires information specified by the user (hereinafter referred to as "specified information") transmitted from the user terminal 30. The specified information includes, for example, information about pages designated as targets for image processing, and information about objects on the specified pages that are designated as targets for image processing.
[0023] Of this information, the information regarding the page designated for image processing includes the image data of the entire page designated for image processing, or information for accessing the image data of the entire page designated for image processing. In addition, the designation information includes information regarding the regions of the designated object that should be represented in raster format, and information regarding the regions that should be represented in vector format.
[0024] The object identification unit 102 identifies the object to be processed from among one or more objects contained in the image of the entire page designated as the target of image processing. For example, the object identification unit 102 identifies the object to be processed from among one or more objects based on the specified information obtained by the information acquisition unit 101. In this case, the object identification unit 102 identifies the object to be processed based on the information contained in the specified information regarding the page designated as the target of image processing, and the information regarding the object designated as the target of image processing from among one or more objects contained in that page.
[0025] Furthermore, if, for example, the information acquisition unit 101 does not acquire the specified information, the object identification unit 102 extracts one or more objects from the image contained in the image that are candidates for image processing, based on the results of analyzing the image of the entire page. The one or more objects extracted as candidates for image processing are displayed on the display unit of the user terminal 30 in a manner that allows selection and specification. When an object to be processed is specified, specification information, which includes at least information related to that specification, is transmitted from the management server 10 to the user terminal 30.
[0026] The edge detection unit 103 detects edges from an image of an object identified as a target for image processing by the object identification unit 102. The method used by the edge detection unit 103 to detect edges is not particularly limited; for example, edges may be detected by processes such as spatial frequency detection, dilation and deflation, or processing using a Laplacian filter.
[0027] In the case of detecting edges by detecting spatial frequencies, the edge detection unit 103 represents regions with high spatial frequencies in vector format and other non-edge regions in raster format. In the case of detecting edges by dilation and erosion, the edge detection unit 103 detects edges by increasing the white area of the binary image through dilation and decreasing the white area through erosion. For example, for each of the red, green, and blue in the RGB color model, an n×n (n is usually 3 or 5) dilation process and an n×n erosion process are performed, and the difference (absolute value) is taken. A Laplacian filter is a spatial filter that detects edges from an image of an object using the second derivative. Furthermore, the edge detection unit 103 may also perform edge detection using a machine learning model.
[0028] The region division unit 104 divides the image of an object identified as a target for image processing by the object identification unit 102 into regions to be represented in raster format and regions to be represented in vector format, according to the characteristics of the object. Specifically, the region division unit 104 divides the image into regions to be represented in raster format and regions to be represented in vector format based on the edge detection result by the edge detection unit 103. For example, the region division unit 104 divides the edge regions as regions to be represented in vector format, and the non-edge regions other than the edges as regions to be represented in raster format.
[0029] Furthermore, the region division unit 104 can also divide the image of an object identified as a target for image processing by the object identification unit 102 into regions that are candidates for editing and regions that are not candidates for editing. In this case, the region division unit 104 can, for example, designate regions that should be represented in vector format as regions that are candidates for editing, and regions that should be represented in raster format as regions that are not candidates for editing. "Editing" refers to, for example, editing for the purpose of creating a video.
[0030] Furthermore, the region division unit 104 can also divide the image of an object into areas to be represented in raster format and areas to be represented in vector format, based on the results of the conversion process performed by the format conversion unit 105, which will be described later. In this case, first, the format conversion unit 105 converts the image of the object, which was represented in raster format, into vector format, and then converts it back into raster format. Then, the region division unit 104 compares the raster images before and after the conversion, and based on the difference, divides the image of the object into areas to be represented in raster format and areas to be represented in vector format.
[0031] When using a method that compares raster images before and after conversion, regions where the difference between the raster images before and after conversion is large can be designated as regions that should be represented in raster format, while regions where the difference between the raster images before and after conversion is small can be designated as regions that should be represented in vector format. The "differences" here refer to, for example, differences in image features. In this case, for example, the region division unit 104 divides the image of the object into regions that should be represented in raster format and regions that should be represented in vector format, based on a predetermined function for evaluating the difference in features.
[0032] The format conversion unit 105 converts the description format of part or all of an image (still image, moving image). For example, if the image of an object designated as the target of image processing is represented in raster format, the format conversion unit 105 converts it to vector format, and if it is represented in vector format, it converts it back to raster format. Also, for example, the format conversion unit 105 converts the image of the region of an object represented in raster format that should be represented in vector format into a vector representation, and converts the image of the region of an object represented in vector format that should be represented in raster format into a raster representation.
[0033] The format conversion unit 105 converts an image of an object represented in raster format into a vector format using, for example, the following methods. Specifically, the format conversion unit 105 performs processes such as color reduction, color splitting, separation of color layers, extraction of contours and points for each color layer, generation of vector data for each color layer, image rendering, integration of color layers, and correction of missing parts during rendering.
[0034] Among the processes performed by the format conversion unit 105, the process of reducing the number of colors in an image of an object represented in raster format uses algorithms such as vector quantization, median cut, and K-means. Vector quantization is a method of reducing the number of colors in an image by mapping multiple pixels or their corresponding elements together to a single code. Median cut is a method of considering the pixels of an RGB color model as coordinates within a three-dimensional rectangular prism and dividing that rectangular prism at the median so that the number of pixels remains the same. K-means is a method of reducing the number of colors in an image by dividing each pixel into multiple groups based on a representative color and replacing the representative color with the average color of the pixel data for each group, repeating this process until the representative color no longer changes.
[0035] Furthermore, the format conversion unit 105 can convert an image of an object represented in raster format to vector format and then convert it back to raster format, or it can convert an image of an object represented in vector format to raster format and then convert it back to vector format. The format conversion unit 105 may or may not generate mask data when converting the image description format.
[0036] The image generation unit 106 generates an image of an object that includes regions represented in raster format and regions represented in vector format, based on the conversion process performed by the format conversion unit 105. For example, the image generation unit 106 generates an image of an object that includes regions represented in raster format and regions represented in vector format by compositing an image of a region represented in raster format with an image of a region represented in vector format. Specifically, for example, the image generation unit 106 generates an image of an object that includes regions represented in raster format and regions represented in vector format by overwriting an image of a region represented in vector format, which serves as a draft, with an image of a region represented in vector format, and compositing them. A specific example of an image generated by the image generation unit 106 will be described later with reference to Figure 10.
[0037] Furthermore, if, for example, an image of a region represented in vector format has been made into a video through editing, the image generation unit 106 generates an image of an object that includes a region represented in raster format and a region represented in vector format that has at least a portion of it made into a video, by overwriting the video of the region represented in vector format with a draft image of the region represented in raster format and compositing them.
[0038] The transmission control unit 107 controls the transmission of information about the object to be processed, identified by the object identification unit 102, to the user terminal 30. The transmission control unit 107 also controls the transmission of an image of the object, which includes both a region represented in raster format and a region represented in vector format, generated by the image generation unit 106, to the user terminal 30.
[0039] (Functional configuration of the user terminal's control unit) Figure 4 shows the functional configuration of the control unit of the user terminal 30. The control unit of the user terminal 30 functions as follows: input reception unit 301, transmission control unit 302, information acquisition unit 303, and display control unit 304.
[0040] The input receiving unit 301 accepts user input operations as a first receiving means or a second receiving means. For example, the input receiving unit 301 accepts an input operation to specify a page to be processed. Also, for example, the input receiving unit 301 accepts an input operation to specify an object to be processed that is included in the specified page. Also, for example, the input receiving unit 301 accepts an input operation to specify a region of the image of the specified object that should be represented in raster format.
[0041] Furthermore, for example, the input receiving unit 301 accepts input operations to specify the region of the image of a specified object that should be represented in vector format. Also, for example, the input receiving unit 301 accepts input operations to specify the region of the image of an object identified as the target of image processing that should be turned into a video. Specifically, the input receiving unit 301 accepts input operations to specify the region of the image of an object identified as the target of image processing that has been classified as needing to be represented in vector format as the region to be turned into a video.
[0042] Input operations to the user terminal 30 may be performed, for example, through a user interface displayed on the display unit by launching dedicated application software installed on the user terminal 30, or through a user interface displayed on the display unit by accessing a dedicated website.
[0043] The transmission control unit 302 controls the transmission of the content of the input operation received by the input reception unit 301 to the management server 10. Specifically, for example, the transmission control unit 302 controls the transmission of the specified information, which is the content of the received input operation, to the management server 10.
[0044] The information acquisition unit 303 acquires various types of information. For example, the information acquisition unit 303 acquires information about an object identified as the target of image processing, which has been transmitted from the management server 10. Also, for example, the information acquisition unit 303 acquires an image of an object, which includes both an image of a region represented in raster format and an image of a region represented in vector format, which has been transmitted from the management server 10.
[0045] The display control unit 304 controls the display of various types of information. For example, the information acquisition unit 303 controls the display of an image of an object identified as the target of image processing, which has been acquired by the information acquisition unit 303. Also, for example, the display control unit 304 controls the display of an image of an object, which has been acquired by the information acquisition unit 303, including an image of a region represented in raster format and an image of a region represented in vector format. The display of the image may also be performed via the user interface described above.
[0046] (Processing by the management server) Figure 5 shows the processing flow of the management server. When the management server 10 receives specified information from the user terminal 30 (YES in step 601), it retrieves the received specified information (step 602) and, based on the retrieved specified information, retrieves an image of the entire specified page (step 603). Conversely, if the user terminal 30 has not sent any specified information (NO in step 601), the management server 10 repeats step 601 until the user terminal 30 sends the specified information.
[0047] If the management server 10 finds that the specified information obtained in step 602 includes information regarding the object to be processed (YES in step 604), it identifies the object to be processed based on that information (step 605) and proceeds to step 610. On the other hand, if the specified information does not include information regarding the object to be processed (NO in step 604), the management server 10 extracts one or more objects that are candidates for image processing based on the results of analyzing the image of the entire specified page and sends them to the user terminal 30 (step 606).
[0048] When the management server 10 receives specification information from the user terminal 30 that includes at least information about the object to be processed for image processing (YES in step 607), it retrieves the transmitted specification information (step 608) and, based on the retrieved information, identifies the object to be processed for image processing from among one or more objects (step 609). Conversely, if no specification information has been sent from the user terminal 30 (NO in step 607), the management server 10 repeats step 607 until specification information is sent from the user terminal 30.
[0049] The management server 10 detects edges from the image of the object identified as the target of image processing (step 610), divides the image of the object into areas to be represented in raster format and areas to be represented in vector format based on the detection results (step 611), and transmits information regarding the division results to the user terminal 30 (step 612). Specifically, the management server 10 divides the edge areas as areas to be represented in vector format, and the non-edge areas other than the edges as areas to be represented in raster format, and transmits information regarding the division results to the user terminal 30.
[0050] If the image of the object to be processed is represented in raster format (YES in step 613), the management server 10 converts the image of the region of the object's image that has been separated as a region that should be represented in vector format into a vector format representation (step 614). Conversely, if the image of the object to be processed is represented in vector format (NO in step 613), the management server 10 converts the image of the region of the object's image that has been separated as a region that should be represented in raster format into a raster format representation (step 615).
[0051] If the image of the region converted to vector format has been edited (YES in step 616), the management server 10 reflects the results of the editing (step 617) and generates an image of the object that includes both the region represented in raster format and the region represented in vector format (step 618). Conversely, if the image of the region converted to vector format has not been edited (NO in step 616), step 617 is skipped and the process proceeds to step 618. The management server 10 sends the image of the object generated in step 618 to the user terminal 30 (step 619).
[0052] (Processing on the user terminal) Figure 6 is a flowchart showing the processing flow of the user terminal 30. If an input operation to specify the page to be processed is performed on the user terminal 30 (YES in step 701), the user terminal 30 accepts that input operation (step 702). Conversely, if no input operation to specify the page to be processed is performed (NO in step 701), the user terminal 30 repeats step 701 until an input operation to specify the page to be processed is performed.
[0053] When the user terminal 30 receives an input operation to specify an object to be processed from among one or more objects included in the specified page (YES in step 703), it accepts the input operation (step 704) and sends the accepted information to the management server 10 (step 705). If, however, no input operation to specify an object to be processed is performed (NO in step 703), the process proceeds to step 706.
[0054] When the user terminal 30 receives information about an object identified as the target of image processing from the management server 10 (YES in step 706), it retrieves the received information (step 707) and displays the retrieved information on the display unit (step 708). Conversely, if no information about an object identified as the target of image processing has been received (NO in step 706), the user terminal 30 repeats step 706 until information about an object identified as the target of image processing is received.
[0055] When the user terminal 30 receives an input operation to specify the areas of the designated object to be represented in raster format and the areas to be represented in vector format (YES in step 709), it accepts the input operation (step 710) and sends the accepted information to the management server 10 (step 711). If, however, no input operation to specify the areas to be represented in raster format and the areas to be represented in vector format has been performed (NO in step 709), the process proceeds to step 712.
[0056] When the user terminal 30 receives information from the management server 10 regarding the results of the division of the regions of an object identified as the target of image processing (YES in step 712), it retrieves the received information (step 713) and displays the retrieved information on the display unit (step 714). However, if no information regarding the division results has been received (NO in step 712), the user terminal 30 repeats step 712 until information regarding the division results is received.
[0057] When the user terminal 30 receives an input operation from the management server 10 to edit an area that has been divided into areas to be represented in vector format (YES in step 715), it accepts the input operation (step 716) and sends the received information to the management server 10 (step 717). Examples of input operations for editing include input operations to create a video of at least a part of the area that has been divided into areas to be represented in vector format. On the other hand, if no input operation has been performed to edit an area that has been divided into areas to be represented in vector format (NO in step 715), the process proceeds to step 718.
[0058] As a result of image processing by the management server 10, an image of an object containing both raster and vector regions is generated and transmitted from the management server 10 (YES in step 718). In this case, the user terminal 30 acquires the transmitted information (step 719) and displays the acquired information on the display unit (step 720). Conversely, if an image of an object containing both raster and vector regions has not been transmitted (NO in step 718), the user terminal 30 repeats step 718 until an image of that object is transmitted.
[0059] (Specific example) Figure 7(A) shows a specific example of an image. Figure 7(B) shows a specific example of the data structure when the still image in Figure 7(A) is represented in raster format. The still image shown in Figure 7(A) is an image in which a colored rectangle is placed in the center of a region indicated by a rectangle. Figure 7(B) shows the data structure when the image in Figure 7(A) is represented in raster format. As shown in Figure 7(B), the raster format is a format in which an image is represented by data consisting of pixels represented by the RGB color model arranged in a grid of vertical and horizontal lines. For example, "(0,0,0)" represents a white pixel, and "(99,8,5)" represents a colored pixel. When an image represented in raster format is enlarged, the image becomes rough and degraded. Therefore, in order to suppress image degradation, it is necessary to increase the number of pixels and raise the resolution, but increasing the resolution increases the amount of data.
[0060] Figure 8 shows a concrete example of an object image represented using only raster format. Figure 9 shows a concrete example of an object image represented using only vector format. The raster image shown in Figure 8 is image G1 of an object identified as the target of image processing from the entire page image (not shown). Image G1 is a graphics image that depicts a tiger's head using edges and gradations of color and brightness. As mentioned above, raster images are represented by pixels of different densities and various colors, so when image G1 is enlarged, the image quality deteriorates and jagged edges appear around the contours, as shown within the frame in Figure 8. Therefore, in order to achieve image quality that satisfies the user without producing jagged edges when enlarged, it is necessary to increase the resolution of image G1, but increasing the resolution of image G1 increases the amount of data in image G1.
[0061] The vector image shown in Figure 9 is image G2 of an object represented solely in vector format. Because image G2 is represented by vector data, the image does not degrade when enlarged, but color reduction during conversion makes it prone to color muddiness, tonal steps, and color differences. Specifically, for example, in the example in Figure 9, muddiness occurs in the area of the tiger's eyes enclosed by frames W1 and W2, tonal steps occur in the area of the tiger's nose enclosed by frame W3, and color changes occur in the area of the tiger's teeth enclosed by frame W4.
[0062] Therefore, in this embodiment, an image of an object is generated that includes areas represented in raster format and areas represented in vector format, achieving image quality that satisfies the user and reducing the amount of data compared to when the image is represented using only a single image description format. In other words, a hybrid image format is generated that takes advantage of the strengths of both raster and vector formats. Specifically, in the image of the tiger's head in Figure 8, the image of areas with a large number of colors and gradations is represented in raster format, and the image of areas with many edges is represented in vector format, with the image description format conversion performed for each area.
[0063] Figure 10 shows a concrete example of an object image represented by edge regions and non-edge regions as a result of edge region detection. Figure 10 shows an example of how edges are detected after expansion and contraction processing. In this figure, the areas represented in white are the areas detected as edge regions, and the areas represented in color are the areas that were determined to be non-edge regions.
[0064] Figure 11 is a specific example of an object image that includes a region represented in raster format where the non-edge region is represented, and a region represented in vector format where the detected edge region is represented, based on the edge region detection results shown in Figure 10. When the image of the region of the raster image G1 in Figure 8 that should be converted to vector format is converted to vector format, an image G3 of an object is generated that includes both the region represented in raster format and the region represented in vector format, as shown in Figure 11. Image G3 can achieve the same level of color reproduction as the raster image G1. Specifically, for example, the color muddiness, tonal steps, and color changes seen in the example in Figure 9, which is represented only in vector format, are not seen in the example in Figure 11.
[0065] Furthermore, since the image in the edge E region is converted to a vector format, clear image quality can be achieved without the jagged edges seen in Figure 8, even when enlarged, as shown within the frame in Figure 11. This allows for image quality that satisfies users while also reducing the amount of data compared to representing the image using only a single image description format. Because images with these advantages are web-compatible, they can be used, for example, as images for web pages or for display on digital signage.
[0066] Although this embodiment has been described above, the present invention is not limited to this embodiment. Furthermore, the effects of the present invention are not limited to those described in this embodiment. For example, the configuration of the information processing system 1 shown in Figure 1 and the hardware configuration of the management server 10 shown in Figure 2 are merely examples for achieving the objectives of the present invention and are not particularly limited. Similarly, the functional configuration of the management server 10 shown in Figure 3 and the functional configuration of the user terminal 30 shown in Figure 4 are also merely examples and are not particularly limited. It is sufficient that the information processing system 1 in Figure 1 is equipped with a function that can execute the above-described process as a whole, and the functional configuration used to realize this function is not limited to the examples in Figures 3 and 4.
[0067] Furthermore, the order of the processing steps for the management server 10 and user terminal 30 shown in Figures 5 and 6 are merely illustrative and not particularly limiting. The processing is not limited to being performed chronologically according to the illustrated step order; it may also be performed in parallel or individually. Similarly, the specific examples shown in Figures 7 to 11 are merely examples and not particularly limiting. [Explanation of symbols]
[0068] 1...Information processing system, 10...Management server, 11...Control unit, 30...User terminal, 90...Network, 101...Information acquisition unit, 102...Object identification unit, 103...Edge detection unit, 104...Area division unit, 105...Format conversion unit, 106...Image generation unit, 107...Transmission control unit, 301...Input reception unit, 302...Transmission control unit, 303...Information acquisition unit, 304...Display control unit
Claims
1. Equipped with a processor, The aforementioned processor, If the image of the first object included in the image is represented in raster format, the image of the first object is converted to vector format, and then an image of the third object is generated by converting it back to raster format. Based on the difference between the image of the first object and the image of the third object, the image of the first object is divided into a first region to be represented in raster format and a second region to be represented in vector format. The image of the second region is converted to the vector format, The method is characterized by generating an image of a second object that includes an image of the first region and an image of the second region. Information processing device.
2. The processor is characterized by dividing the image of the third object and the image of the first object into a first region and a second region based on the difference in their features. The information processing apparatus according to claim 1.
3. On the computer, If the image of a first object included in the image is represented in raster format, the function converts the image of the first object to vector format and generates an image of a third object which is converted back to raster format. A function to divide the image of the first object into a first region to be represented in raster format and a second region to be represented in vector format, based on the difference between the image of the first object and the image of the third object. A function to convert the image of the second region into the vector format, A function for generating an image of a second object that includes the image of the first region and the image of the second region, A program to achieve this.
Citation Information
Patent Citations
Kakupaipunipiasubaaringuohodokosu renzokujidokakoki no kanagatasochi
JP1976080670A
Information processing apparatus, method of operating information processing apparatus, and storage medium
JP2011165173A
System for generation of a composite raster-vector image
US5715331A