Information processing device, information processing method, and computer readable medium

Abstract

The present invention provides an information processing device, an information processing method, and a computer-readable medium. The information processing device includes a processor, the processor acquiring a plurality of contour line coordinates of an original image and a contour line of a cropping area in the original image, and performing the following control: a portion of the original image and an image of the contour line are overlapped and displayed on the image display unit in such a manner that each pixel corresponding to the plurality of contour line coordinates appears in a clockwise or counterclockwise order in the central area of ​​the image display unit.

Description

Technical Field

[0001] The present invention relates to an information processing device, an information processing method and a computer-readable medium. Background Art

[0002] Extract the desired object area of ​​the original image, insert the object area into another image, or perform different image processing on the object area and the area outside the object area of ​​the original image. For example, extract the product image part (the object area) from the original image of the product, perform different color adjustments on the product image part and the background part (the area outside the object area) around the product image part, or replace the background part with another image.

[0003] When extracting the object area from the original image, a mask image including a cropping area is used, and the cropping area is defined to be at the same position and in the same shape as the object area. The mask image includes the cropping area and areas outside the cropping area, such as an image filled with different colors, or an image with the outline of the cropping area added to the original image.

[0004] Japanese Patent Gazette No. 2-101456 relates to a method for generating cropping mask data for extracting or deleting a desired processed area of ​​an original image, which discloses the following contents: a plurality of small unit areas are set on an original image displayed in a reduced state on an image display unit, unit area images which are respective image portions within the plurality of small unit areas are displayed in a non-reduced state, contour points of the processed area are specified on each unit area image in this display state, thereby generating cropping mask data.

[0005] In a program having a function of cutting out an image of a desired area from an original image, a mask image, which is an image showing the area to be cut out, is sometimes superimposed on the original image, and the mask image is corrected to determine the cutout area, and various processes such as cutting or color correction are performed on the cutout area of ​​the original image. If the position of the contour line of the cutout area deviates from the desired position, the target area cannot be extracted from the original image with high accuracy, so the operator needs to carefully confirm whether the contour of the cutout area is located at the desired position.

[0006] Generally, the number of pixels of the cropping area of ​​the mask image is greater than the number of pixels that can be displayed by the image display device. Therefore, if the entire cropping area is displayed, it is difficult to confirm the detailed part of the cropping area. In addition, when the operator carefully confirms the position of the outline of the cropping area, if the outline part of the cropping area to be confirmed is enlarged and displayed, when confirming other outline parts that are not displayed on the display screen, the operator needs to use the vertical and horizontal scroll bars displayed on the display screen, for example, with a mouse, to perform a movement operation, which requires a lot of labor. Summary of the invention

[0007] The object of the present invention is to provide a structure that, when an operator confirms the outline of a cropping area whose number of pixels is greater than the number of pixels that can be displayed by the image display device on a display screen of an image display device, can perform the confirmation operation more simply than when the operator performs a vertical or horizontal movement operation.

[0008] According to the first scheme of the present invention, there is provided an image processing device comprising a processor, wherein the processor obtains a plurality of contour line coordinates of an original image and a contour line of a cropped area in the original image, and performs the following control: a portion of the original image and an image of the contour line are displayed overlappingly on the image display unit in such a manner that each pixel corresponding to the plurality of contour line coordinates appears in sequence in a clockwise or counterclockwise order in a central area of ​​an image display unit.

[0009] According to the second aspect of the present invention, the processor controls the display in such a manner that pixels corresponding to the contour line coordinates appearing in the central area of ​​the image display unit are sequentially changed in accordance with continuous operations by the operator.

[0010] According to a third aspect of the present invention, the processor controls the display in such a manner that, upon receiving a start instruction from an operator, pixels corresponding to the contour line coordinates appearing in a central area of ​​the image display unit are automatically changed in sequence.

[0011] According to a fourth aspect of the present invention, the processor controls the display in such a manner that pixels corresponding to the contour line coordinates appearing in the center area of ​​the image display unit are sequentially changed in accordance with an operator's operation of a mouse wheel.

[0012] According to the fifth aspect of the present invention, the processor controls the display in the following manner: in response to an operator's operation of a scroll bar displayed on a display screen of the image display device, pixels corresponding to the contour line coordinates appearing in the central area of ​​the image display unit change sequentially.

[0013] According to the sixth aspect of the present invention, the processor controls the display in the following manner: according to the change in the slope of the contour line of the cropped area, the speed at which the pixels corresponding to the contour line coordinates appearing in the central area of ​​the image display unit are sequentially changed is changed.

[0014] According to the seventh aspect of the present invention, the image displayed on the image display unit includes an image representing a portion of the original image in units of pixels or an image obtained by enlarging a portion of the original image.

[0015] According to the 8th scheme of the present invention, there is provided a computer-readable medium storing a program for causing a computer to execute processing, wherein the processing comprises the following steps: obtaining a plurality of contour line coordinates of an original image and a contour line of a cropped area in the original image; and performing the following control: displaying a portion of the original image and an image of the contour line overlappingly on the image display unit in such a manner that each pixel corresponding to the plurality of contour line coordinates appears in sequence in a clockwise or counterclockwise order in a central area of ​​an image display unit.

[0016] According to the 9th scheme of the present invention, there is provided an information processing method, which comprises the following steps: obtaining a plurality of contour line coordinates of the contour lines of an original image and a cropped area in the original image; and performing the following control: displaying a portion of the original image and an image of the contour line overlappingly on the image display unit in such a manner that each pixel corresponding to the plurality of contour line coordinates appears in sequence in a clockwise or counterclockwise order in the central area of ​​the image display unit.

[0017] According to the first, eighth or ninth aspect, the confirmation operation can be performed more simply than in a case where the operator performs a vertical or horizontal movement operation to confirm the outline of the cropping area.

[0018] According to the second aspect, the outline of the region to be trimmed at a speed desired by the operator is confirmed.

[0019] According to the third aspect, when confirming the outline of the trimming area, the operator can reduce the labor involved in the operation compared to a case where the operator performs the operation all the time.

[0020] According to the fourth aspect, the confirmation area of ​​the image is sequentially moved by the operation of one finger.

[0021] According to the fifth aspect, the confirmation area of ​​the image is sequentially moved by moving the mouse or the like in a straight line.

[0022] According to the sixth aspect, the portion having a complex shape compared to the portion having a simple shape in the cropping region can be checked at a reduced speed.

[0023] According to the seventh aspect, compared with a case where a part of the original image is thinned out and displayed, it is possible to confirm in detail whether the boundary of the cropping area is located at a desired position. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a block diagram showing an example of the structure of an information processing device.

[0025] Figure 2 This is a diagram showing an example of an original image.

[0026] Figure 3This is a diagram showing an example of a mask image without an original image.

[0027] Figure 4 A diagram showing an example of a mask image with an original image.

[0028] Figure 5 This is a diagram for explaining the generation of contour line information.

[0029] Figure 6 This is a diagram showing an example of contour line information.

[0030] Figure 7 This is a diagram for explaining how to sequentially move the confirmation area of ​​the mask image.

[0031] Figure 8 This is a diagram for explaining how to sequentially move the confirmation area of ​​the mask image.

[0032] Fig. 9 FIG. 1 is a diagram showing an example of an image of a part of a mask image.

[0033] Fig.10 FIG. 1 is a diagram showing an example of a display screen for edge confirmation based on a mouse wheel operation.

[0034] Fig.11 : is a flowchart showing the flow of image display control based on mouse wheel operation.

[0035] Fig.12 This is a diagram showing an example of a display screen for edge confirmation by the automatic preview function.

[0036] Fig.13 : is a flowchart showing the flow of image display control based on the automatic preview function.

[0037] Fig.14 It is a diagram for explaining the contour confirmation of a plurality of cropping areas.

[0038] Fig.15 This is a diagram for explaining image display control of a portion of a cropping region having a complex shape.

[0039] Fig.16 This is a diagram for explaining other image display control of a portion of a cropping region with a complex shape. DETAILED DESCRIPTION

[0040] Hereinafter, each embodiment of the present invention will be described in detail while confirming the accompanying drawings. The structure described below is an example for explanation and can be appropriately changed according to the specifications of the device. In addition, when the following includes multiple embodiments or variations, it is initially envisioned that these characteristic parts are appropriately combined and used. In all the drawings, the same reference numerals are marked on the same elements, and repeated descriptions are omitted.

[0041] Figure 1 1 is a block diagram showing an example of the structure of the information processing device 10. The information processing device 10 is a personal computer PC. The information processing device 10 is connected to a keyboard 30 and a mouse 32 as an operation unit 26 for operating the information processing device, and a display 28. In addition, as another embodiment, the information processing device 10 may also be a portable terminal such as a tablet computer or a smart phone. In this case, the information processing device 10 may be configured to include the operation unit 26 and the display 28, and the operation unit 26 and the display 28 may be configured as a touch panel.

[0042] The information processing device 10 of the present embodiment includes a processor 12 , a storage unit 14 , a communication unit 16 , an input interface 18 , and a display interface 20 , which are connected via a bus 22 .

[0043] The processor 12 includes a CPU, and the processor 12 performs information processing according to the program installed in the information processing device 10. In addition, the processor 12 can also be called a computer. The storage unit 14 is a ROM, RAM, flash memory, hard disk, etc., which stores programs and various data for execution by the processor 12. The communication unit 16 is, for example, a network card, which is connected to a network such as a LAN or the Internet (not shown) by wireless or wired connection to communicate with other devices. The input interface 18 is a device that receives signals from the operation unit 26 and transmits operation information to the processor 12. The display interface 20 is, for example, a graphics card, which outputs image signals to a display (also called an image display device 28) according to instructions from the processor 12.

[0044] The program includes a generation program 23 and a display program 24. The generation program 23 and the display program 24 installed in the information processing device 10 may be provided via a network such as the Internet, or may be stored in a computer-readable recording medium such as an optical disk or a USB memory.

[0045] The information processing device 10 receives an image (hereinafter referred to as an original image) via a network such as the Internet or a computer-readable recording medium such as an optical disk or a USB memory. The information processing device 10 generates a mask image from the original image by operating according to a generation program 23, and displays a confirmation screen of the mask image on a display 28 by operating according to a display program 24. Here, the mask image is an image showing an area from which an image is to be cropped from the original image. In many image editing programs, a mask image is superimposed on the original image, an operator enlarges or reduces an area of ​​the mask image to edit it, and uses information of the area of ​​the mask image that has been edited to generate a cropped image from the original image.

[0046] Figure 2 is an example of the original image 60. Figure 3 is with Figure 2 The mask image 62 corresponding to the original image 60 is an image generated separately from the original image. Figure 4 is with Figure 2 The mask image 64 of another form corresponding to the original image 60 is an image expressing the outline of the cropping target area by overlapping the original image.

[0047] The mask images 62 and 64 represent the desired object areas 66A, 66B, and 66C of the original image 60 (confirmation Figure 2 ) is an image representing area information, which is used to cut out the object area 66A, 66B, 66C and insert it into other images, or to divide the original image 60 into the object area 66A, 66B, 66C and the area outside the object area to perform different image processing. Figure 2 In the example of FIG. 6 , the object area 66A is a sofa, the object area 66B is a lamp stand umbrella, and the object area 66C is an object placed on a shelf.

[0048] The processor 12 of the information processing device 10 operates according to the generation program 23, thereby extracting the cropping area by analyzing the color difference between the target area and the area other than the target area of ​​the original image, and generating mask images 62 and 64 based on the coordinate information of the outline of the cropping area. The generated mask images 62 and 64 are configured to be able to identify the cropping areas 68A, 68B, and 68C as the cropping areas, wherein the cropping areas 68A, 68B, and 68C are defined to be the same positions and the same shapes as the target areas 66A, 66B, and 66C. Figure 3 The mask image 62 is an image in which the cropped areas 68A, 68B, 68C and areas outside the cropped areas are filled with different colors. Figure 4 The mask image 64 is an image in which the outlines OL of the cropping areas 68A, 68B, and 68C are added to the original image 60 .

[0049] Here, it should be noted that the object regions 66A, 66B, 66C and the crop regions 68A, 68B, 68C are not necessarily consistent. The object regions 66A, 66B, 66C are regions that the operator desires to extract, while the crop regions 68A, 68B, 68C are regions (estimated regions) obtained by analyzing the original image 60 by the information processing device 10. Therefore, the crop regions 68A, 68B, 68C and the object regions 66A, 66B, 66C may not be consistent. That is, the positions of the contour lines OL of the crop regions 68A, 68B, 68C may deviate from the positions that the operator desires.

[0050] Since the original image is cropped at the position of the contour line OL of the cropping area, if the position of the contour line OL of the cropping area deviates from the desired position, the target area cannot be cropped from the original image as desired. Therefore, the operator needs to carefully confirm whether the boundary of the cropping area is located at the desired position. Therefore, the information processing device 10 provides a confirmation screen of the mask image by executing the display program 24. The following is a detailed description of the confirmation screen of the mask image.

[0051] In the following description, when a mask image is referred to as a mask image, it means Figure 4 The mask image 64 is a mask image 64 having a contour line superimposed on the original image as shown. The mask image 64 is not limited to an image having a contour line superimposed on the original image 60 itself, but may be an image having a contour line superimposed on an image after a predetermined image processing is performed on the original image.

[0052] The storage unit 14 of the information processing device 10 stores the generated mask image 64 and the coordinates of the multiple contour line pixels of the contour line OL of the cropped areas 68A, 68B, and 68C of the mask image 64, that is, the contour line coordinates. In the above description, it is assumed that the information processing device 10 generates the mask image 64, but the mask image 64 may be generated by another device and input to the information processing device 10 and stored in the storage unit 14. In this case, the multiple contour line coordinates of the cropped areas 68A, 68B, and 68C of the mask image 64 may be input to the information processing device 10 together with the mask image 64, or may be extracted by analyzing the mask image 64 by the information processing device 10.

[0053] First, the processor 12 generates contour line information that describes information of each pixel constituting the contour line OL by operating according to the display program 24. The generation of the contour line information is described below. The processor 12 reads a plurality of contour line coordinates of the clipping areas 68A, 68B, and 68C from the storage unit 14, and generates contour line information for each clipping area 68A, 68B, and 68C. Figure 5 is a diagram for explaining the generation of contour information. Figure 6 It is a diagram showing an example of the contour line information 70 .

[0054] exist Figure 5In FIG. 1 , a plurality of contour line pixels of the cropping area 68 corresponding to any one of the cropping areas 68A, 68B, and 68C are shown on the xy plane. The processor 12 first searches for the contour line pixel that is the first element (element No. 1) of the contour line information 70. This is done by repeatedly increasing the value of x from the position (x, y) = (0, 0), increasing the value of y by 1 after the value of x reaches the maximum (right end position), and then increasing the value of x from the position (x, y) = (0, 1) in the same manner. The contour line pixel that is first searched is used as the first element of the contour line information 70. Figure 5 In the example, the contour pixel E1 is the first element (element No. 1) of the contour information 70, and the contour coordinates (x 1 ,y 1 ) is stored in the contour line information 70.

[0055] Next, the processor 12 sets the contour line pixel adjacent to the contour line pixel as the first element as the second element (element No. 2). Figure 5 In the example, there are two contour pixels E2 and En adjacent to the contour pixel E1 as the first element. Here, the contour pixel E2 is taken as the second element (element No. 2), and the contour coordinates (x 2 ,y 2 ) is stored in the contour line information 70.

[0056] Next, the processor 12 uses the contour line pixels adjacent to the contour line pixel as the second element as the third element (element No. 3) in the same manner as described above. At this time, the contour line pixels already stored in the contour line information 70 are removed and the adjacent contour line pixels are searched. Figure 5 In the example, the contour pixel E3 adjacent to the contour pixel E2 as the second element is set as the third element (element No. 3), and the contour coordinates (x 3 ,y 3 ) is stored in the contour line information 70.

[0057] By repeating the above search operation, the plurality of contour line coordinates of the clipping region 68 are arranged in the counterclockwise order of the contour line OL of the clipping region 68 ( Figure 5 The order of the dashed arrows shown in FIG. 1 is stored in the contour information 70. Figure 5 In the example, the contour pixel Em is the mth element (element No. m), and finally, the contour pixel En is the nth element (element No. n). In addition, whether it is the last contour pixel can be determined by whether the contour pixel E1 of element No. 1 is included in the adjacent contour pixels.

[0058] The method for generating the contour information 70 described above is an example, and the contour information 70 may be generated by other methods. In the above description, the plurality of contour coordinates are stored in the contour information 70 in the counterclockwise order of the contour OL of the clipping area 68, but may be stored in the contour information 70 in the clockwise order of the contour OL of the clipping area 68. The processor 12 stores the contour information 70 generated for each clipping area in the storage unit 14. Figure 6 The “chapter point” and “slope change point” of the outline information 70 shown will be described later.

[0059] Next, the processor 12 operates according to the display program 24 to display a confirmation screen of the mask image 64 using the contour information 70. In the confirmation screen of the mask image 64, there is a typical method of moving the confirmation area according to the mouse wheel operation of the operator ( Fig.10 ) and automatically move the confirmation area ( Fig.12 , automatic preview function). Here, first, the basic operation and confirmation area of ​​the processor 12 common to these modes are described.

[0060] When the confirmation screen of the mask image 64 is displayed on the display 28, the processor 12 reads (acquires) the mask image 64 and the contour information 70 (a plurality of contour coordinates of the cropping area) from the storage unit 14. Then, the processor 12 sequentially reads out the elements of the contour coordinates stored in the contour information 70 in a counterclockwise or clockwise order, and performs control as follows: a portion of the mask image 64 is displayed on the image display unit without thinning out pixels in such a manner that each contour pixel corresponding to the plurality of contour coordinates appears sequentially in a counterclockwise or clockwise order at the center of the image display unit of the display 28. This portion of the mask image 64 is the confirmation area.

[0061] Here, the number of pixels of the cropping area of ​​the mask image 64 is usually greater than the number of displayable pixels of the display 28. Therefore, if the entire cropping area is to be displayed on the display 28, the pixels of the cropping area are thinned out, and a part of the outline OL of the cropping area is omitted and displayed. Therefore, it is impossible to confirm in detail whether the boundary of the cropping area is located at the desired position. Therefore, in this embodiment, as described above, a part of the mask image 64 is displayed without thinning out the pixels. That is, the pixels existing in the confirmation area of ​​the mask image 64 are not thinned out and are directly displayed on the display 28.

[0062] Figure 7 , 8 is a diagram for explaining that the confirmation area of ​​the mask image moves sequentially. Figure 7 ,8 In the Figure 4 The processor 12 reads the contour coordinates (x ) of the contour pixels of element No. 1 from the contour information 70. 1 ,y 1 ), the image display section of the display 28 displays the contour line coordinates (x 1 ,y 1 ) is the center of the confirmation area 301. Next, the processor 12 reads the contour coordinates (x 2 ,y 2 ), the image display section of the display 28 displays the contour line coordinates (x 2 ,y 2 ) as the center of the confirmation area (not shown). In this way, the processor 12 reads the contour line coordinates from the contour line information 70 in sequence and continuously displays the confirmation area on the image display unit. Figure 8 Moving in the direction of the arrow (counterclockwise) shown in FIG. 1 , each confirmation area of ​​the closed loop along the outline OL of the cropping area 68A is sequentially displayed on the image display unit. Figure 7 In FIG. 1 , confirmation areas 301, 302, 303, ... 313 are depicted, and the confirmation areas displayed on the image display unit are Figure 7 There are also multiple confirmation areas 301, 302, 303, ... 313 between each of them. By the above control, the confirmation areas 301, 302, 303, ... 313 and the confirmation areas (not shown) between them are displayed on the image display unit in a counterclockwise order.

[0063] Alternatively, the processor 12 may read out the elements of the contour information 70 in descending order (e.g., read out the elements in a direction from element No. n to a direction in which the value of the element No. decreases), and sequentially display the confirmation areas centered on the contour coordinates of the elements on the image display portion of the display 28. In this case, the confirmation area moves clockwise along the contour OL of the cropping area 68A.

[0064] Fig. 9 2 is a diagram showing a confirmation area 301 displayed on the image display unit 74 of the display 28. Fig. 9 In the example, the center pixel CP of the image display portion 74 is the contour line pixel of element No. 1. In this example, the position of the contour line OL of the cropped area 68A is offset near the center pixel CP relative to the position of the actual contour of the sofa. Such “offset” is achieved by Fig. 9 Thus, by enlarging and displaying a part of the mask image or displaying the mask image without thinning out the pixels, detailed confirmation is possible.

[0065] In the above description, the outline pixel appears at the center of the image display unit 74, but the outline pixel may appear at a position slightly offset from the center of the image display unit 74. That is, the outline pixel may appear in the central region 72 of the image display unit 74. Here, the central region 72 may be defined as a rectangular shape with a position less than 1 / 3 of the distance from the center of the image display unit 74 as a corner when the distance from the center of the image display unit 74 to one corner is set to 1 (see Fig. 9 ) area.

[0066] In a specific embodiment of the mask image confirmation screen described later, the image display unit 74 that displays the confirmation area is a part of the screen of the display 28 , but it may be the entire screen of the display 28 .

[0067] Next, a specific embodiment of the mask image confirmation screen will be described. First, a method of moving the confirmation area according to the operator's mouse wheel operation will be described. Fig.10 This is the confirmation screen for the mask image of this method. Fig.10 The confirmation screen includes an overall image display unit 76 that displays the entire mask image 64, an image display unit 74 that displays the confirmation area (also referred to as the confirmation image display unit 74), and a "wheel" button 80. The overall image display unit 76 is a portion that displays the mask image 64 with pixels thinned out. The overall image display unit 76 includes a frame 78 that indicates the confirmation area displayed on the image display unit 74.

[0068] The operator presses the "wheel" button 80 by operating the mouse or the like. Thus, image display control based on the mouse wheel operation starts. Fig.11 1 is a flowchart showing the process of image display control based on mouse wheel operation. First, in S100, processor 12 confirms whether there is a mouse wheel operation and waits for the wheel operation to occur. In the case of a wheel operation (S100: "Yes"), in S102, processor 12 confirms whether the wheel operation is upward or downward.

[0069] When the scroll wheel is operated downward (S102: "No"), in S106, the processor 12 takes out the contour coordinates of the next element of the contour information 70. Here, the element currently being focused on of the contour information 70 (hereinafter referred to as the focus element) is stored in the storage unit 14. In S106, if the focus element is No. 1 of the contour information 70, the processor 12 takes out the contour coordinates of No. 2. Then, in S108, the processor 12 displays a confirmation area centered on the extracted contour coordinates on the image display unit 74. At this time, the focus element is increased by 1 and updated to No. 2. Then, return to S100.

[0070] For example, when the operator repeatedly performs a downward scroll wheel operation, the focus element gradually becomes larger, and along with this, the confirmation area moving counterclockwise along the outline OL of the cropping area 68A is displayed in sequence on the image display unit 74. Figure 7 , 8 The confirmation area moves counterclockwise as shown in the figure. Fig.10 The frame 78 shown in the entire image display portion 76 also moves counterclockwise along the outline OL of the cropped area 68A.

[0071] On the other hand, Fig.11 In S102, when the scroll wheel operation is upward (S102: "Yes"), in S104, the processor 12 extracts the contour line coordinates of the previous element of the contour line information 70. If the element of interest is No. 1, the processor 12 extracts the contour line coordinates of No. n (since there is no element smaller than No. 1, the contour line coordinates of the element No. n are extracted). Then, in S108, the processor 12 displays a confirmation area centered on the extracted contour line coordinates on the image display unit 74. At this time, the element of interest is subtracted by 1 and updated to No. n-1. Then, return to S100.

[0072] For example, when the operator repeatedly performs the upward scroll wheel operation, the focus element gradually becomes smaller, and along with this, the confirmation area moving clockwise along the outline OL of the cropping area 68A is sequentially displayed on the image display unit 74. This is the clockwise movement of the confirmation area described above. At this time, Fig.10 The frame 78 shown in the entire image display portion 76 also moves clockwise along the outline OL of the cropped area 68A.

[0073] in addition, Fig.11 The process can also be ended by pressing a predetermined button of the keyboard. Thus, the mouse wheel becomes a state that can be used for normal operation of the PC.

[0074] According to the above-described embodiment, since the confirmation area of ​​the mask image is sequentially moved by the operation of one finger of the operator, the position of the contour line of the cropping area can be confirmed very easily. Compared with the case where the operator operates the vertical and horizontal scroll bars to confirm the contour of the cropping area, the confirmation operation can be performed more simply.

[0075] In addition, in the above Fig.11In the description of the process, the previous or next element is taken out in S104 and S106, but the previous or next elements of more than 2 (for example, any number of 10, 100, 1000, etc.) can also be taken out. In addition, the number of jumps (how many previous or next elements are taken out) when taking out the elements before or after S104 and S106 can also be determined so that the confirmation area currently displayed on the image display unit 74 and the confirmation area displayed on the image display unit 74 next by the scroll wheel operation do not overlap.

[0076] In the above-described embodiment, the position of the confirmation area is moved according to the operation of the mouse wheel, but the position of the confirmation area may also be moved according to the operation of the mouse wheel. Fig.10 The position of the confirmation area is moved by operating the scroll bar 82 as shown. That is, instead of operating the mouse wheel downward, the confirmation area is moved counterclockwise along the outline OL of the cropping area 68A by moving the mouse or the like from one side of the scroll bar 82 to the other side. In addition, instead of operating the mouse wheel upward, the confirmation area is moved clockwise along the outline OL of the cropping area 68A by moving the mouse or the like from the other side of the scroll bar 82. According to this structure, the confirmation area of ​​the mask image is moved sequentially by moving the mouse or the like on a straight line.

[0077] In addition, other means may be used instead of the mouse wheel or the scroll bar 82. The processor 12 may control the display in such a manner that the contour line pixels corresponding to the contour line coordinates appearing in the center area of ​​the image display unit 74 are sequentially changed according to the continuous operation of the operator using the mouse wheel, the scroll bar 82 or other means. Thus, the confirmation area moving at the speed desired by the operator is displayed on the image display unit 74, and the position of the contour line OL of the cropping area 68A can be confirmed at the speed desired by the operator.

[0078] Next, a mask image confirmation screen in a method of automatically moving the confirmation area (also referred to as an automatic preview function) will be described. Fig.12 This is the confirmation screen for the mask image of this method. Fig.12 The confirmation screen includes an entire image display unit 76 that displays the entire mask image 64 , an image display unit 74 that displays the confirmation area (confirmation image display unit 74 ), a switch 98 , and a plurality of buttons 90 to 96 . Fig.12 The overall image display unit 76 and the image display unit 74 adopt the same Fig.10 The overall image display unit 76 has the same structure as the image display unit 74.

[0079] The operator presses the "preview" button 90 by operating the mouse or the like. This starts the image display control of the automatic preview function. Fig.13 FIG. 1 is a flowchart showing the process of image display control of the automatic preview function. Fig.13 It is shown in Fig.12 The flow when the switch 98 is confirmed to be in the "counterclockwise direction" is shown. First, in S200, the processor 12 confirms whether the "preview" button 90 is pressed, and waits for the "preview" button 90 to be pressed. In addition, pressing the "preview" button 90 is also called a preview instruction or a start instruction.

[0080] When the "Preview" button 90 is pressed (S200: Yes), in S202, the processor 12 extracts the contour coordinates of the next element of the contour information 70. Here, the element currently being focused on (focus element) of the contour information 70 is stored in the storage unit 14. In S202, if the focus element is No. 1, the processor 12 extracts the contour coordinates of No. 2. Then, in S204, the processor 12 displays a confirmation area centered on the extracted contour coordinates on the image display unit 74. At this time, the focus element is increased by 1 and updated to No. 2.

[0081] Then, in S206, the processor 12 confirms whether the focus element has become No. 1 (starting point). If S206 is "No", S202 and S204 are repeated again. That is, after the focus element is incremented and becomes No. n, S202 and S204 are repeated again until it becomes No. 1 (since there is no element larger than No. n, it becomes No. 1). Thus, the confirmation area moving counterclockwise along the outline OL of the cropping area 68A is displayed in sequence on the image display unit 74. This is to use Figure 7 , 8 The confirmation area moves counterclockwise as shown in the figure. Fig.12 The frame 78 shown in the entire image display portion 76 also moves counterclockwise along the outline OL of the cropped area 68A.

[0082] Then, if S206 is “YES” (when the focus element has returned to the starting point), the movement of the confirmation area is stopped, and the process returns to S200 , where the processor 12 waits for the “Preview” button 90 to be pressed again.

[0083] Next, Fig.12 The switch 98 shown in the figure is confirmed to be in the "clockwise direction", and the image display control when the "preview" button 90 is pressed will be described. Fig.13The control of "taking out the next element" in S202 is replaced by "taking out the previous element". That is, when the "Preview" button 90 is pressed (S200: "Yes"), in S202, the processor 12 takes out the contour coordinates of the previous element of the contour information 70. In S202, if the focus element is No.1, the processor 12 takes out the contour coordinates of No.n (since there is no element smaller than No.1, the contour coordinates of the element No.n are taken out). Then, in S204, the processor 12 displays a confirmation area centered on the taken contour coordinates on the image display unit 74. At this time, the focus element is reduced by 1 and updated to No.n-1. Then, in S206, the processor 12 confirms whether the focus element is No.1 (starting point). If S206 is "No", S202 and S204 are repeated again. That is, when the focus element is decremented, S202 and S204 are repeated again until it becomes No.1. Thus, the confirmation area moving clockwise along the outline OL of the cropping area 68A is sequentially displayed on the image display unit 74. This is the movement of the confirmation area in the clockwise direction described above. Fig.12 The frame 78 shown in the entire image display portion 76 also moves clockwise along the outline OL of the cropped area 68A.

[0084] According to the above-described embodiment, by pressing the "Preview" button 90 once, the confirmation area is closed around the contour line OL of the cropping area 68A. Therefore, when confirming the position of the contour line OL (edge) of the cropping area 68A, the operator can reduce the operation labor compared to the case where the operator always operates the mouse. Fig.10 The same as the embodiment of the present invention, the confirmation operation can be performed more simply than when the operator operates the vertical and horizontal scroll bars to confirm the outline of the cropping area.

[0085] In addition, if Fig.14 As shown, by pressing the "Preview" button 90 once, the confirmation area can be moved on the contour lines of multiple cropping areas 68A, 68B, and 68C, so that after the confirmation area circles the closed loop of the contour line of cropping area 68A, the confirmation area is transferred to the contour line of other cropping area 68B and circles the closed loop of the contour line of cropping area 68B.

[0086] Next, Fig.12 The buttons 91 to 96 other than the "Preview" button 90 shown in the figure are described below. The "Fast Forward" button 91 is a button for increasing the speed of moving the confirmation area. After pressing the "Preview" button 90, if the "Fast Forward" button 91 is pressed, Fig.13 The repetition speed of S202 to S206 of the process becomes faster. Or, Fig.13The "take out the next element" of S202 of the process is replaced by "take out the elements of the number greater than 2 (for example, 10, 100, 1000, etc., any number n)" (the number of elements of the jump contour information 70 increases). In addition, if the "fast forward" button 91 is pressed multiple times, the moving speed of the confirmation area becomes faster. For example, each time the "fast forward" button 91 is pressed, the number of elements to be jumped in S202 can be increased.

[0087] The "fast rewind" button 93 is a button for increasing the speed of movement of the confirmation area in the opposite direction to the case where the "fast forward" button 91 is pressed. That is, after pressing the "preview" button 90, if the "fast rewind" button 93 is pressed, the confirmation area moves at a faster speed in the direction opposite to the direction set by the switching switch 98. It has the same function as the "fast forward" button 91 except that the confirmation area moves in the opposite direction.

[0088] The "pause" button 96 is a button for temporarily stopping the movement of the confirmation area. After pressing the "preview" button 90, if the "pause" button 96 is pressed, the focus element described above is stored in the storage unit 14, and the process ends. Fig.13 Then, when the "Preview" button 90 is pressed again, the focus element is read from the storage unit 14 and the process is restarted. Fig.13 Thus, the movement of the confirmation area can be restarted from the position where the "temporary stop" button 96 is pressed.

[0089] The "Stop" button 95 is a button for stopping the movement of the confirmation area. After pressing the "Preview" button 90, if the "Stop" button 95 is pressed, the focus element described above is reset to No. 1 and stored in the storage unit 14, and the process ends. Fig.13 Then, when the "Preview" button 90 is pressed again, the focus element is read from the storage unit 14 and the preview starts. Fig.13 At this time, the focus element is No. 1, so the movement of the area is confirmed from the initial position (starting point).

[0090] The "jump" button 92 is a button for moving the confirmation area to a predetermined position at once. Figure 6 As shown, the outline information 70 may include chapter points corresponding to the elements. The chapter points are, for example, the start point SP1 corresponding to the element No. 1, the middle point MP1 corresponding to the element No. m in the middle of the outline information 70, and the end point EP1 corresponding to the element No. n. Such chapter points may be added when the outline information 70 is generated, for example.

[0091] exist Fig.14, a mask image showing the positions of the outline pixels of SP1, MP1, and EP1 is shown. After pressing the "Preview" button 90, if the "Jump" button 92 is pressed, the confirmation area moves to MP1 at once. When the "Jump" button 92 is pressed again, the confirmation area moves to EP1 at once. In addition, chapter points can be added to more elements.

[0092] As described above, the outline information 70 is provided for each cropping area 68A, 68B, 68C. A chapter point may be added to the outline information 70 of each cropping area 68A, 68B, 68C so as to be distinguishable from chapter points of other outline information 70 . Fig.14 , the outline pixels of these chapter points are shown in the case where SP2, MP2, and EP2 are added as chapter points of the cropping area 68B and SP3, MP3, and EP3 are added as chapter points of the cropping area 68C. When the "jump" button 92 is pressed continuously, the confirmation area may also move in a manner of jumping in the order of MP1, EP1, SP2, MP2, EP2, SP3, ... across the boundaries of the cropping areas 68A, 68B, and 68C.

[0093] Fig.12 The "reverse jump" button 94 shown is a button for moving the confirmation area to the chapter point in a single motion in the opposite direction to the case where the "jump" button 92 is pressed. It has the same function as the "jump" button 92 except that the confirmation area moves in the opposite direction.

[0094] In addition, in the above-mentioned method of moving the confirmation area according to the mouse wheel operation, it is also possible to set Fig.12 The same functions of the "jump" button 92 and the "reverse jump" button 94 are achieved. For example, the left click of the mouse can play the same function as the case of pressing the "jump" button 92, and the right click of the mouse can play the same function as the case of pressing the "reverse jump" button 94.

[0095] Next, the structure applicable to each embodiment described above will be described. Fig.15 As shown, the contour line OL of the cropping area includes a simple-shaped portion and a complex-shaped portion. Generally speaking, the complex-shaped portion requires more detailed confirmation of the "offset" of the contour line OL than the simple-shaped portion. Therefore, in the above-mentioned automatic preview function, when the confirmation area moves along the contour line OL, the complex-shaped portion can reduce the moving speed of the confirmation area compared to the simple-shaped portion of the contour line OL. Fig.15 In the above, the moving speed of the confirmation area in the jagged portion between the upper and lower straight line portions of the outline OL is reduced compared to the moving speed of the confirmation area in the jagged portion between the upper and lower straight line portions of the outline OL.

[0096] The above functions are implemented, for example, in the following manner. Figure 6 As shown, the contour information 70 may include a slope change point FP corresponding to the element. The slope change point FP corresponds to the element whose slope change of the contour line OL exceeds a predetermined reference. Here, the change of the slope of the contour line OL can be obtained by calculating the secondary differential value of the contour line OL. In addition, the slope change point FP can be added when the contour information 70 is generated. In the automatic preview function, the processor 12 controls the display in the following manner: according to whether the slope change point FP is added to the focus element (according to the change of the slope of the contour line OL of the cropped area), the speed at which the contour line pixels corresponding to the contour line coordinates appearing in the central area of ​​the image display unit 74 are sequentially changed is changed. That is, the processor 12 controls the display in the following manner: when the slope change point FP is added to the focus element, the speed at which the contour line pixels corresponding to the contour line coordinates appearing in the central area of ​​the image display unit 74 are sequentially changed is reduced. Thereby, the change of the moving speed of the confirmation area corresponding to the shape of the above-mentioned contour line OL is achieved.

[0097] In addition, the above configuration is a configuration in which the processor 12 reduces the moving speed of the confirmation area when the slope change point FP is added to the focus element, but it may also be a configuration in which the processor 12 further enlarges and displays the image of the confirmation area when the slope change point FP is added to the focus element. That is, the part with a complex shape of the contour line OL is displayed with an enlarged image composed of pixels constituting the image of the confirmation area and interpolated pixels based on them. Thereby, the operator can confirm the part with a complex shape of the contour line OL in more detail.

[0098] In addition, if Fig.15 As shown in FIG. 1 , when the jagged portion of the contour line OL moves in the confirmation area, the confirmation area moves while shaking left and right or up and down, so it may be difficult to confirm the deviation of the contour line OL in the confirmation area displayed on the image display unit 74. Fig.16 As shown in FIG. 1 , in the region having the element to which the slope change point FP is added, the approximate function (approximate line 110) can also be estimated, and the confirmation region moves along the approximate line. This can provide a smooth and easy-to-see display. In addition, this structure can be applied to a method of moving the confirmation region according to the mouse wheel operation ( Fig.10 ) and the automatic preview function ( Fig.12 )both sides.

[0099] Alternatively, instead of estimating the approximate function, in the region having the element to which the slope change point FP is added, Fig.11In the process of S104 and S106, the first or last element is replaced by the first or last multiple (for example, 10, 100, 1000, etc.) elements. Similarly, in the area with the element with the slope change point FP added, Fig.13 The one element after taking out in S202 of the process is replaced by multiple elements after taking out (for example, 10, 100, 1000, etc., any number). In this structure, it is also possible to suppress the confirmation area from shaking left and right or up and down, and become a smooth and easy-to-observe display.

[0100] The processor in the above-mentioned embodiment is a processor that acts according to a program, but the processor can also be in other forms. The so-called processor refers to a processor in a broad sense, including general-purpose processors (such as CPU: Central Processing Unit, etc.), special-purpose processors (such as GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic devices, etc.).

[0101] In addition, the actions of the processors in the above-mentioned embodiments may be performed not only by one processor but also by cooperation of multiple processors located in physically separate locations. In addition, the order of the actions of the processors is not limited to the order described in the above-mentioned embodiments and may be changed as appropriate.

Claims

1. An information processing device, wherein: The information processing device includes a processor, The processor obtains a plurality of contour line coordinates of an original image and a contour line of a cropping area in the original image, The processor performs the following control: A portion of the original image and the image of the contour line are displayed on the image display unit in an overlapping manner so that each pixel corresponding to the plurality of contour line coordinates appears in a central area of ​​the image display unit in a clockwise or counterclockwise order. Display is performed sequentially in such a manner that after a first pixel corresponding to a first contour line coordinate among the plurality of contour line coordinates appears in the central area of ​​the image display unit, a second pixel corresponding to the next second contour line coordinate appears in the central area of ​​the image display unit.

2. The information processing device according to claim 1, wherein: The processor controls the display in such a manner that pixels corresponding to the coordinates of the contour line appearing in the central area of ​​the image display section are sequentially changed according to continuous operations of the operator.

3. The information processing device according to claim 1, wherein: The processor controls the display in such a manner that, when receiving a start instruction from an operator, pixels corresponding to the contour line coordinates appearing in a central area of ​​the image display unit are automatically changed in sequence.

4. The information processing device according to claim 2, wherein: The processor controls the display in such a manner that pixels corresponding to the outline coordinates appearing in the central area of ​​the image display section are sequentially changed according to an operator's operation of a mouse wheel.

5. The information processing device according to claim 2, wherein: The processor controls the display in such a manner that pixels corresponding to the outline coordinates appearing in the center area of ​​the image display section are sequentially changed in accordance with an operator's operation of a scroll bar displayed on a display screen of the image display device.

6. The information processing device according to claim 3, wherein: The processor controls the display by changing a speed at which pixels corresponding to the coordinates of the outline appearing in the center area of ​​the image display unit are sequentially changed according to a change in the slope of the outline of the cropping area.

7. The information processing device according to any one of claims 1 to 6, wherein: The image displayed on the image display unit includes an image representing a portion of the original image in units of pixels or an image obtained by enlarging a portion of the original image.

8. A computer-readable medium storing a program for causing a computer to execute a process, wherein: The process comprises the following steps: Acquire multiple contour line coordinates of the original image and the contour lines of the cropping area in the original image; and The following control is performed: a portion of the original image and the image of the contour line are overlapped and displayed on the image display unit in such a manner that each pixel corresponding to the plurality of contour line coordinates appears in a central area of ​​the image display unit in a clockwise or counterclockwise order, Display is performed sequentially in such a manner that after a first pixel corresponding to a first contour line coordinate among the plurality of contour line coordinates appears in the central area of ​​the image display unit, a second pixel corresponding to the next second contour line coordinate appears in the central area of ​​the image display unit.

9. An information processing method, wherein: The information processing method comprises the following steps: Acquire multiple contour line coordinates of the original image and the contour lines of the cropping area in the original image; and The following control is performed: a portion of the original image and the image of the contour line are overlapped and displayed on the image display unit in such a manner that each pixel corresponding to the plurality of contour line coordinates appears in a central area of ​​the image display unit in a clockwise or counterclockwise order, Display is performed sequentially in such a manner that after a first pixel corresponding to a first contour line coordinate among the plurality of contour line coordinates appears in the central area of ​​the image display unit, a second pixel corresponding to the next second contour line coordinate appears in the central area of ​​the image display unit.

10. A program product comprising a program causing a computer to execute a process, wherein: The process comprises the following steps: Acquire multiple contour line coordinates of the original image and the contour lines of the cropping area in the original image; and The following control is performed: a portion of the original image and the image of the contour line are overlapped and displayed on the image display unit in such a manner that each pixel corresponding to the plurality of contour line coordinates appears in a central area of ​​the image display unit in a clockwise or counterclockwise order, Display is performed sequentially in such a manner that after a first pixel corresponding to a first contour line coordinate among the plurality of contour line coordinates appears in the central area of ​​the image display unit, a second pixel corresponding to the next second contour line coordinate appears in the central area of ​​the image display unit.

Images