Program, image processing method, and image processing device

Abstract

To reduce time for magnifying or reducing an image.SOLUTION: A program causes a computer to function as: an image data identification unit 141 for identifying target image data on the basis of an operation for specifying the target image data to be displayed in a paste region on a screen; an image data selection unit 142 for selecting one item of level-classified image data, on the basis of the relationship between the size of the level-classified image data and the size of the paste region, from the target image data or from multiple items of level-classified image data, which are stored in a storage unit 13 in association with the paste region and include multiple items of partial image data and a division number, which is the number of items of partial image data included in the level-classified image data; and a display processing unit 144 for displaying, in the paste region, at least one of the multiple items of partial image data included in selected level-classified image data, which is the one item of level-classified image data selected by the image data selection unit.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a program, an image processing method, and an image processing device. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there has been known an image layout device that pastes an image selected by a user onto a mount image and displays the image on a display device (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-55533 A Summary of the Invention [Problem to be solved by the invention]

[0004] In a conventional image layout device, an image pasted at a position selected by a user on a mount image can be displayed on a display device. However, when a user performs an operation to enlarge or reduce a displayed image, the larger the image size, the longer the time required to enlarge or reduce the image, which causes a problem that it takes a long time from when the user performs the operation until the image is displayed on the display device.

[0005] The present invention has been made in consideration of these points, and has an object to reduce the time required to enlarge or reduce an image. [Means for solving the problem]

[0006] A program according to a first aspect of the present invention causes a computer to function as an image data identification unit that identifies target image data based on an operation of specifying target image data to be displayed in a paste area on a screen; an image data selection unit that selects one level-classified image data from the multiple level-classified image data including a plurality of part image data created by dividing the target image data and stored in a memory unit in association with the target image data or the paste area, the multiple level-classified image data including a division number that is the number of part image data contained in the level-classified image data and the multiple part image data, based on the relationship between the size of the level-classified image data and the size of the paste area; and a display processing unit that displays in the paste area one or more part image data from the multiple part image data included in the selected level-classified image data, which is the one level-classified image data selected by the image data selection unit.

[0007] The computer may further function as an area identification unit that identifies a display target area of ​​the target image data to be displayed in the paste area, and the display processing unit may display in the paste area the one or more part image data corresponding to the display target area among the multiple part image data included in the image data for each selection level.

[0008] The level-based image data may further include pixel count data indicating the number of pixels of the level-based image data, and the image data selection unit may select, from among one or more of the level-based image data in which the number of pixels indicated by the pixel count data is greater than the number of pixels of the pasting area, one of the level-based image data in which the ratio of the number of pixels indicated by the pixel count data to the number of pixels of the pasting area is within a predetermined range.

[0009] The image data specification unit may store an image object including the plurality of level-classified image data in the storage unit in association with the attachment area.

[0010] The display processing unit may display, in the first pasting area, first selected level-based image data selected by the image data selection unit based on the relationship between the size of the level-based image data and the size of a first pasting area displaying the target image data, and then display, in the second pasting area, second selected level-based image data selected by the image data selection unit based on the relationship between the size of a second pasting area included in the first pasting area and the size of the level-based image data.

[0011] The display processing unit may also display image data associated with the one or more part image data superimposed on the one or more part image data when the magnification ratio of the one or more part image data displayed in the attachment area relative to the target image data is within a predetermined range.

[0012] The image data identification unit may identify the multiple target image data based on an operation of specifying the multiple target image data to be displayed in the pasting area, and the display processing unit may, when it receives a predetermined operation for changing the magnification ratio when displaying after displaying the one or more part image data included in first selection level image data of a predetermined level associated with first target image data among the multiple target image data, display in the pasting area one or more part image data included in the second selection level image data corresponding to second target image data associated with the first target image data among the multiple target image data.

[0013] The computer may further function as a creation unit that creates the multiple level-based image data associated with the target image data when the multiple level-based image data are not stored in the memory unit based on an operation of specifying the target image data.

[0014] The creation unit determines whether the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the target image data are two. j (j is a natural number), the target image data is 4k The image data may be divided into a plurality of levels (k is a natural number), each of which has a different value of k, to create the plurality of level-specific image data.

[0015] The creation unit is configured to create a target image data having a pixel count in either the vertical direction or the horizontal direction. j If j is not a natural number, the number of vertical pixels is 2. m (m is a natural number) and the number of pixels in the horizontal direction is 2 n (n is a natural number) k By dividing the image data into pieces, the plurality of level-specific image data each having a different value of k may be created.

[0016] The creation unit may create the plurality of part image data included in the plurality of level-by-level image data by dividing image data obtained by excluding an area within a predetermined range from an outer periphery of the target image data.

[0017] The creation unit may convert the paste area in which the one or more part image data are displayed into target image data of the same size as the paste area, and create an image object including the plurality of level-specific image data corresponding to the target image data.

[0018] The creation unit may determine a maximum value of the division number based on the number of pixels of the target image data, and create the multiple part image data included in the multiple level-specific image data corresponding to the multiple division numbers by dividing the target image data into multiple division numbers that are less than or equal to the maximum division number.

[0019] An image processing method according to a second aspect of the present invention includes a step of identifying target image data based on an operation of specifying target image data to be displayed in a paste area on a screen; a step of selecting one level-classified image data from a plurality of level-classified image data including a plurality of part image data created by dividing the target image data associated with the target image data or the paste area, the plurality of level-classified image data including a division number which is the number of part image data contained in the level-classified image data and the plurality of part image data, based on a relationship between a size of the level-classified image data and a size of the paste area; and a step of displaying one or more part image data from the plurality of part image data included in the selected level-classified image data which is the one level-classified image data in the paste area.

[0020] An image processing device according to a third aspect of the present invention has an image data identification unit that identifies the target image data based on an operation of specifying the target image data to be displayed in a paste area on a screen, an image data selection unit that selects one level-classified image data from the multiple level-classified image data including a number of part image data created by dividing the target image data and stored in a memory unit in association with the target image data or the paste area, the multiple level-classified image data including a division number that is the number of part image data contained in the level-classified image data and the multiple part image data, based on a relationship between the size of the level-classified image data and the size of the paste area, and a display processing unit that displays one or more part image data from the multiple part image data included in the selected level-classified image data, which is the one level-classified image data selected by the image data selection unit, in the paste area. Effect of the Invention

[0021] According to the present invention, an effect of reducing the time required to enlarge or reduce an image is achieved. [Brief description of the drawings]

[0022] [Figure 1]FIG. 1 is a diagram for explaining an overview of an image processing device 1 according to the present embodiment. [Diagram 2] FIG. 2 is a diagram for explaining an operation of the image processing device 1 for displaying an image. [Diagram 3] 1 is a diagram illustrating a configuration of an image processing device 1. [Figure 4] FIG. 2 is a diagram showing an example of a parts image database stored in a storage unit 13. [Diagram 5] FIG. 13 is a diagram for explaining a part image region. [Figure 6] FIG. 13 is a diagram for explaining an operation of displaying an enlarged image. [Figure 7] 13 is a diagram for explaining an operation for displaying a first paste area and a second paste area. FIG. [Figure 8] FIG. 11 is a diagram for explaining an operation of displaying related image data. [Figure 9] FIG. 13 is a diagram for explaining an operation of displaying image data by second selection level. [Figure 10] This is division number information for determining the maximum division number. [Figure 11] 3 is a flowchart showing a process flow in the image processing device 1. [Figure 12] FIG. 13 is a diagram for explaining an overview of an image processing device 1 according to a third modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] <Overview of image processing device 1> 1 is a diagram for explaining an overview of an image processing device 1 according to this embodiment. The image processing device 1 is a terminal having a display for displaying images, such as a smartphone, a tablet, or a personal computer. The image processing device 1 may be connected to an external display device (not shown) having a display via a digital interface such as HDMI (High-Definition Multimedia Interface) (registered trademark).

[0024] A dedicated application program (hereinafter, referred to as a "dedicated app") for displaying an image on the display is installed in the image processing device 1. Through the dedicated app, a user can select an image to be displayed by overlaying it on a mount on the display, specify an area in which the image is to be displayed, and specify the size of the image to be displayed on the display.

[0025] 1, the image processing device 1 stores an image object database and a mount database. The image object database includes a plurality of image objects D (D1 to D3 in FIG. 1), and each of the plurality of image objects D includes original image data, image information, and a part image database.

[0026] The original image data is image data in which pixels have not been thinned or compressed among the multiple image data registered in the image object database, and is data indicating the pixel values ​​of each of the multiple pixels. The image information includes, for example, the file name of the original image data and information regarding the size of the original image data (for example, the number of pixels).

[0027] The part image database includes a plurality of level-based image data corresponding to the original image data. The plurality of level-based image data corresponding to one original image data are created based on one original image data, but each has a different number of pixels. The level-based image data includes a plurality of part image data created by dividing the original image data. The level-based image data includes a division number that is the number of part image data included in the level-based image data, and the plurality of part image data. The level-based image data may further include pixel number data indicating the number of pixels of the part image data included in the level-based image data. Details of the part image database, the level-based image data, and the part image data will be described later using FIG. 4.

[0028] The mount database includes multiple mount image data B (mount image data B1, B2 in FIG. 1) for pasting image data. Pasting image data to mount image data means associating the image data with the mount image database. The display window is a window for displaying the image data pasted on the mount image data superimposed on the mount image data on the display.

[0029] When a user selects an image to be displayed superimposed on a mount on the screen of a display, the image processing device 1 specifies level-classified image data corresponding to the selected image. If the level-classified image data corresponding to the selected image is not included in the parts image database, the image processing device 1 creates level-classified image data based on the original image data of the selected image.

[0030] When the image processing device 1 receives an operation from a user to paste image data onto mount image data and display it, it displays part image data included in an image object D corresponding to the image data on the display by superimposing the part image data on the mount image data. In Fig. 1, the image processing device 1 displays part image data included in each of image objects D1 and D2 by superimposing the part image data on mount image data B1, and displays part image data included in image object D3 by superimposing the part image data on mount image data B2. The details of the above-mentioned pasting process and display process will be described later.

[0031] 2 is a diagram for explaining the operation of the image processing device 1 to display an image. The mount space is an area in the mount image data where part image data is pasted. The display space is a display area on the display screen, for example, a window area set by the user via a dedicated application.

[0032] The image processing device 1 accepts an operation to specify original image data (hereinafter referred to as "target image data") to be pasted onto mount image data, mount image data onto which the target image data is pasted, and an area in the display area into which the target image data is pasted onto the mount image data (hereinafter referred to as "pasting area"). The image processing device 1 specifies an image object D corresponding to the target image data specified by the user by referring to the image object database shown in Fig. 1. The image processing device 1 specifies mount image data B specified by the user by referring to the mount database shown in Fig. 1.

[0033] Next, the image processing device 1 specifies an area in which to display the target image data in the mount space of the specified mount image data B, based on the attachment area specified by the user in the display area. The image processing device 1 selects level-classified image data corresponding to the number of pixels of the specified area by referring to the part image database. The image processing device 1 displays the part image data included in the selected level-classified image data by superimposing it on the mount image data (shown in FIG. 2 (1)).

[0034] The image processing device 1 displays the part image data superimposed on the mount image data in the paste area (paste areas C1, C2 in FIG. 2) specified by the user in the display space (shown in FIG. 2 as (2)). By operating in this manner, the image processing device 1 can display the part image data corresponding to the size of the paste area on the display. As a result, the image processing device 1 can display the target image data in the paste area without performing a process of enlarging or reducing the target image data to the size specified by the user, thereby shortening the time it takes to display the target image data on the display. The configuration and operation of the image processing device 1 will be described in detail below.

[0035] <Configuration of image processing device 1> 3 is a diagram showing the configuration of the image processing device 1. The image processing device 1 has an input unit 11, a display unit 12, a storage unit 13, and a control unit .

[0036] The input unit 11 is an input device for receiving input operations from a user of the image processing device 1, and is, for example, a keyboard, a touch panel, a mouse, a joystick, or a microphone. The input unit 11 receives input operations from the user, such as an operation for registering multiple original image data in an image object database, an operation for pasting original image data (i.e., target image data) selected by the user from the multiple original image data onto mount image data, an operation for enlarging or reducing the size of the target image data, etc. The display unit 12 is a display device for displaying image data, and is, for example, a display.

[0037] The storage unit 13 has a storage medium such as a ROM (Read Only Memory), a RAM (Random Access Memory), a HDD (Hard Disk Drive), or an SSD (Solid State Drive). The storage unit 13 stores a program executed by the control unit 14. The storage unit 13 also stores image data, mount image data, and data used to execute various processes based on the image data or mount image data.

[0038] The storage unit 13 stores in a database various information used to display the target image data pasted on the mount image data. For example, the storage unit 13 stores mount image data B in the mount database. For example, the storage unit 13 stores in an image object database an image object D including original image data (i.e., target image data) or a pasting area, image information of the original image data, and a parts image database including a plurality of level-specific image data corresponding to the original image data.

[0039] Fig. 4 is a diagram showing an example of a part image database stored in storage unit 13. In the part image database shown in Fig. 4, the original image data name, the level-based image data ID which is level-based image data identification information for identifying the level-based image data, the number of divisions, the number of pixels, the part image data name, and the part image area are associated with each other.

[0040] The original image data name is the file name of the original image data, and the control unit 14 can access the original image data stored in the memory unit 13 by specifying the original image data name. The number of divisions is the number of part image data that make up each of the multiple level-based image data. The number of pixels is the number of pixels in the level-based image data. The part image data name is the file name of the part image data, and the control unit 14 can access the part image data by specifying the part image data name. The part image area is information that indicates the area of ​​each part image data in the original image data.

[0041] Fig. 5 is a diagram for explaining part image areas. Fig. 5(a) shows part image areas of four part image data "P102" (P102-1 to P102-4) generated by dividing level-specific image data "L102" corresponding to original image data "S100" shown in Fig. 4. Fig. 5(b) shows part image areas of 16 part image data "P103" (P103-1 to P103-16) generated by dividing level-specific image data "L103" corresponding to original image data "S100" shown in Fig. 4.

[0042] As shown in FIG. 5(a), the part image area of ​​each of the four part image data "P102" is represented by a combination of horizontal addresses x1-x2 and vertical addresses y1-y2. The number of pixels of each of the four part image data "P102" is the same, which is 250,000 pixels obtained by dividing the number of pixels of the level-specific image data "L102" shown in FIG. 4 (1 million pixels) by 4. As shown in FIG. 5(b), the part image area of ​​each of the 16 part image data "P103" is represented by a combination of horizontal addresses x1-x4 and vertical addresses y1-y4. The number of pixels of each of the 16 part image data "P103" is the same, which is 250,000 pixels obtained by dividing the number of pixels of the level-specific image data "L103" shown in FIG. 4 (4 million pixels) by 16.

[0043] The control unit 14 is, for example, a central processing unit (CPU) or a graphical processing unit (GPU). The control unit 14 executes a program stored in the storage unit 13 to function as at least one of an image data specification unit 141, an image data selection unit 142, an area specification unit 143, a display processing unit 144, and a creation unit 145. The control unit 14 may execute the functions of all of these components, or may execute the functions of some of these components.

[0044] The configuration of each unit realized by the control unit 14 will be described below. The image data specification unit 141 specifies the target image data based on an operation of specifying the target image data to be displayed in the paste area on the screen of the display. The image data specification unit 141 may specify a plurality of target image data based on an operation of specifying a plurality of target image data to be displayed in the paste area. The paste area is an area of ​​the mount image, an area of ​​the mount image displayed on the display, or an area of ​​the mount image selected by the user. The target image data is original image data selected by the user from a plurality of original image data.

[0045] For example, the image data specification unit 141 specifies original image data (i.e., target image data) corresponding to the image by receiving an operation by the user to select a file name of an image to be pasted on a mount image or to paste an image on a mount image from the input unit 11. The image data specification unit 141 specifies the target image data associated with the file name of the image selected by the user, by referring to a plurality of original image data stored in the storage unit 13, for example.

[0046] For example, the image data specification unit 141 associates an image object D including a plurality of level-specific image data with the pasted area and stores it in the storage unit 13. For example, the image data specification unit 141 associates information indicating an area selected by the user in the pasted area (for example, coordinate information indicating the area selected by the user) with the image object D corresponding to the target image data selected by the user and stores them in the storage unit 13.

[0047] The image data selection unit 142 selects one level-based image data (i.e., selected level-based image data) from a plurality of level-based image data included in the image object D stored in the storage unit 13 in association with the pasting area, based on the relationship between the size of the level-based image data and the size of the pasting area. The size of the level-based image data and the size of the pasting area are information represented by, for example, the number of pixels or data in which the number of pixels is encoded. The image data selection unit 142 may select one level-based image data from a plurality of level-based image data included in the image object D stored in the storage unit 13 in association with the target image data, based on the relationship between the size of the level-based image data and the size of the pasting area.

[0048] The image data selection unit 142, for example, identifies one or more level-based image data in which the number of pixels indicated by the pixel count data of the level-based image data is greater than the number of pixels in the pasting area. The image data selection unit 142 selects one of the identified level-based image data in which the ratio of the number of pixels indicated by the pixel count data to the number of pixels in the pasting area is within a predetermined range as the selected level-based image data. The predetermined range is, for example, a range in which the ratio of the number of pixels indicated by the pixel count data to the number of pixels in the pasting area is smaller than 1:4.

[0049] As an example, suppose that the image data selection unit 142, which has received an operation to display a part or all of the area of ​​the target image data in the mount space in the pastement area, has determined that the number of pixels in the pastement area is 500,000. In this case, the image data selection unit 142 refers to the "number of pixels" shown in Fig. 4 to determine the level-specific image data "L102", "L103", and "L104" that indicate a number of pixels greater than 500,000.

[0050] Next, the image data selection unit 142 selects "L102" from among the multiple identified level-based image data, which is level-based image data in which the pixel count of the level-based image data relative to the pixel count of the pasting area (500,000 pixels) is in a range less than 1:4 (i.e., level-based image data showing a pixel count less than 2 million pixels) as the selected level-based image data.

[0051] By operating in this manner, the image data selection unit 142 can select level-based image data according to the size of the pasting area. Furthermore, it can select level-based image data that displays the pasting area using four or less part image data among a plurality of part image data. As a result, the image data selection unit 142 can reduce the amount of image data acquired by the display processing unit 144 to display in the pasting area compared to the amount of target image data, thereby increasing the display speed.

[0052] When the level-specific image data associated with the target image data is not stored in the storage unit 13, the image data selection unit 142 causes the creation unit 145 to create the level-specific image data. The process of creating the level-specific image data by the creation unit 145 will be described later in detail.

[0053] The area specifying unit 143 specifies an area in which an image based on the parts image data included in the level-by-level image data is to be displayed. The area specifying unit 143 obtains from the input unit 11 the contents of an operation for specifying a paste area selected by a user in the display space shown in FIG. 2, thereby specifying an area corresponding to the paste area in the mount space shown in FIG. 2. The area specifying unit 143 specifies the specified area of ​​the target image data displayed superimposed on the mount image data as a display target area. The area specifying unit 143 notifies the display processing unit 144 of the specified display target area. By the area specifying unit 143 specifying the display target area, the display processing unit 144 can select the parts image data corresponding to the display target area from the multiple parts image data associated with the target image data.

[0054] There are cases where a user wishes to enlarge and display a partial area of ​​the target image data. In this case, the user can enlarge the image by, for example, selecting a partial area of ​​the displayed target image data, enlarging the pasting area, or inputting a magnification ratio. When an enlarging operation is performed, the area specifying unit 143 specifies a display target area of ​​the target image data to be displayed in the pasting area in an enlarged state. The area specifying unit 143 specifies, for example, an area of ​​the image indicated by the target image data specified by the image data specifying unit 141 that will be included in the pasting area after enlargement.

[0055] The display processing unit 144 displays in the pasting area one or more part image data out of the multiple part image data included in the selection level-based image data, which is one level-based image data selected by the image data selection unit 142. The display processing unit 144, for example, refers to the "part image data name" shown in Fig. 4 to identify one or more part image data included in the selection level-based image data, and displays them in the pasting area.

[0056] By operating in this manner, the display processing unit 144 can display part image data corresponding to the size of the paste area, so that the display processing unit 144 can obtain image data with a data amount smaller than that of the target image data and display it in the paste area without performing processing to reduce or enlarge the image data at that point. As a result, the display processing unit 144 can shorten the time from when the user specifies the paste area to when the image is displayed in the paste area. Such an operation of the display processing unit 144 is suitable when the size of the paste area is smaller than the size of the target image data (i.e., the magnification ratio when displaying the target image data is large).

[0057] For example, when a user performs an operation to enlarge an image, the display processing unit 144 displays, in the attachment area, one or more part image data items corresponding to the display target area identified by the area identification unit 143, among the multiple part image data items included in the image data by selection level. The display processing unit 144 identifies one or more part image data items included in the display target area by referring to the "part image area" shown in Fig. 4, for example, and displays them in the attachment area.

[0058] FIG. 6 is a diagram for explaining the operation of displaying an enlarged image. FIG. 6(a) shows a screen displaying an image before enlargement, and FIG. 6(b) shows a screen displaying an enlarged image. In FIG. 6(a), four parts image data "P102" included in the level-specific image data "L102" shown in FIG. 5 are displayed in the attachment area C. Area A is an area designated by the user in an operation to enlarge an image, and corresponds to one of the four areas obtained by dividing the parts image data "P102-2" shown in FIG. 5. In FIG. 6(b), an image obtained by enlarging area A shown in FIG. 6(a) is displayed in the attachment area C.

[0059] First, as shown in FIG. 6(a), the display processing unit 144 displays in the attachment area C four part image data "P102" included in the level-specific image data "L102" selected by the image data selection unit 142 based on the size of the attachment area C.

[0060] Next, the user performs an operation to enlarge and display area A, so that the image data selection unit 142 selects level-based image data "L103" based on the size of the attachment area C and the size of area A in the mount image data. The area identification unit 143 identifies part image data "P103-8" corresponding to area A from among the multiple part image data included in the selection level-based image data "L103" by referring to the "part image area" shown in Fig. 5. The display processing unit 144 displays the part image data "P103-8" in the attachment area C, as shown in Fig. 6(b).

[0061] By operating the display processing unit 144 in this manner, when the user performs an operation to enlarge or reduce a part of an image, the display processing unit 144 can display the part image data corresponding to the size and area specified by the user in the paste area in a short time. As a result, the display processing unit 144 can shorten the time from the user performing an operation to specify a part of an image to displaying the area specified by the user in the paste area compared to the case where the target image data is enlarged or reduced and displayed.

[0062] However, there are cases where the user wants to display a selected image and an enlarged image of a part of the selected image on the same screen. Specifically, this is the case when the user wants to view a map image displayed in the pasting area while enlarging and viewing a part of the map image. In this case, the display processing unit 144 may display an image (e.g., a map image) displayed in the first pasting area and an image (e.g., a part of the map image) displayed in the second pasting area included in the first pasting area on the same screen.

[0063] The display processing unit 144 displays in the first paste area the first selected level-based image data selected by the image data selection unit 142 based on the relationship between the size of the level-based image data and the size of the first paste area displaying the target image data. Next, the display processing unit 144 displays in the second paste area the second selected level-based image data selected by the image data selection unit 142 based on the relationship between the size of the second paste area included in the first paste area and the size of the level-based image data.

[0064] Fig. 7 is a diagram for explaining the operation of displaying the first paste area and the second paste area. Fig. 7(a) is a diagram showing the first image data by selection level displayed in the first paste area C1. Fig. 7(b) is a diagram showing the first image data by selection level displayed in the first paste area C1 and the second image data by selection level displayed in the second paste area C2. The second image data by selection level shown in Fig. 7(b) is an image obtained by enlarging and displaying the area A shown in Fig. 7(a).

[0065] 7(a), the display processing unit 144 displays in the first attachment area C1 the first selection level-based image data selected by the image data selection unit 142. Next, as shown in FIG 7(b), the display processing unit 144 displays in the second attachment area C2 the second selection level-based image data selected by the image data selection unit 142 based on the size of the second attachment area C2 and the size of the area A.

[0066] For example, when the first selection level-based image data is the level-based image data "L102" shown in Fig. 4, the second selection level-based image data is the level-based image data "L103" or "L104" shown in Fig. 4. The display processing unit 144 displays, in the attachment area C2, the part image data corresponding to the display target area identified by the area identifying unit 143, among the multiple part image data included in the second selection level-based image data.

[0067] By operating in this manner, the display processing unit 144 can display level-specific image data with different division numbers associated with the same target image data in each of the multiple pasting areas. As a result, the user can view the original image data and start viewing a part of the original image data in detail in a short period of time.

[0068] When the magnification ratio of the target image data displayed on the display is within a predetermined range, the user may wish to display other information different from the target image data by superimposing it. Specifically, when a group photo taken at a place where many people gather is displayed at a magnification ratio that allows people's faces to be identified, the user may wish to display the nameplates of the people displayed by superimposing them. In this case, when the magnification ratio of one or more part image data displayed in the attachment area with respect to the target image data is within a predetermined range, the display processing unit 144 displays image data associated with the one or more part image data (hereinafter referred to as "related image data") by superimposing it on the one or more part image data. The magnification ratio is, for example, a value obtained by dividing the number of pixels of the target image data (i.e., the number of pixels of the part image data with a division number of 1) by the number of pixels of the attachment area.

[0069] The display processing unit 144 accepts, from the user, for example, an area in which the related image data is to be displayed and a range of the magnification rate of the part image data when the related image data is to be displayed, and associates the area with the target image data. The related image data is stored in the storage unit 13, and can be associated with the part image data by the user operating the image processing device 1. The related image data may be original image data registered in the image object database, or may be image data that is not registered in the image object database.

[0070] Fig. 8 is a diagram for explaining the operation of displaying related image data. Fig. 8(a) shows the pasted area C without the related image data being displayed superimposed thereon, and Fig. 8(b) shows the pasted area C with the related image data being displayed superimposed thereon. The image of the pasted area C shown in Fig. 8(b) is an enlarged image of the area A shown in Fig. 8(a). Images N1 and N2 shown in Fig. 8(b) are related image data associated with part image data showing person P1 and person P2.

[0071] 8(a), the display processing unit 144 specifies the magnification ratio of the part image data displayed in the paste area C by dividing the number of pixels of the part image data with a division number of 1 by the number of pixels of the paste area C. When the display processing unit 144 determines that the specified magnification ratio is not within a predetermined range set by the user, it displays the part image data on the display without displaying the related image data.

[0072] 8(b), the display processing unit 144 determines that the magnification ratio of the part image data displayed in the pasting area C is within a predetermined range. The display processing unit 144 displays images N1 and N2, which are related image data associated with the part image data displayed in the pasting area C, superimposed on the part image data.

[0073] By operating in this manner, the display processing unit 144 can superimpose and display part image data within a predetermined magnification range and image data associated with the part image data. As a result, the display processing unit 144 can superimpose and display other image data set by the user according to the magnification ratio of the target image data.

[0074] Furthermore, when the magnification ratio of the target image data displayed on the display is a predetermined magnification ratio, the user may wish to display other target image data in the attachment area, which is different from the displayed target image data. One example is when an image of an animal is enlarged to display an image of the animal's skeleton, muscles, or internal organs.

[0075] Therefore, when the display processing unit 144 receives an operation for changing the magnification ratio of the first target image data to a predetermined magnification ratio after displaying the part image data obtained by dividing the first target image data, the display processing unit 144 displays the part image data obtained by dividing the second target image data associated with the first target image data. The second target image data is original image data associated with the first target image data by the user operating the image processing device 1, and is stored in the image object database in association with the image information and the part image database of the second target image data.

[0076] The display processing unit 144, for example, displays one or more part image data included in the first selection level image data of a predetermined level associated with the first target image data among the multiple target image data, and then accepts a predetermined operation for changing the magnification ratio when displaying. In this case, the display processing unit 144 displays in the attachment area one or more part image data included in the second selection level image data corresponding to the second target image data associated with the first target image data among the multiple target image data, the second selection level image data including a division number different from the division number included in the first selection level image data. The user can specify the first selection level image data of a predetermined level or set a predetermined operation for changing the magnification ratio by operating the image processing device 1.

[0077] Fig. 9 is a diagram for explaining the operation of displaying the second selection level-based image data. Fig. 9(a) is a diagram showing first object image data Q1 showing the appearance of an animal and second object image data Q2 showing the animal's skeleton. The storage unit 13 stores the first object image data Q1 and the second object image data Q2. Fig. 9(b) is a diagram showing part image data included in the first selection level-based image data. Fig. 9(c) is a diagram showing the second selection level-based image data.

[0078] First, as shown in Fig. 9(b), the display processing unit 144 displays part image data included in the first selection level-based image data associated with the first target image data Q1 in the pasting area C. Next, when an operation for changing the magnification ratio for displaying the pasting area C to a magnification ratio within a predetermined range is received, the display processing unit 144 displays part image data included in the second selection level-based image data corresponding to the second target image data in the pasting area C as shown in Fig. 9(c).

[0079] By operating in this manner, the display processing unit 144 can display other target image data associated with the target image data when displaying the pasted area at the magnification ratio specified by the user. As a result, the user can create image content that combines, for example, an image of the outside of the subject and an image of the inside of the subject.

[0080] [Creating image data by level] The creation unit 145 creates the plurality of level-based image data associated with the target image data based on an operation of designating the target image data when the plurality of level-based image data associated with the target image data is not stored in the storage unit 13. The creation unit 145 creates the level-based image data when it determines that the plurality of level-based image data associated with the target image data is not stored in the storage unit 13, for example, by referring to the image object database shown in FIG. 1. The creation unit 145 creates the plurality of level-based image data by creating a plurality of part image data by dividing the target image data by a plurality of division numbers, and stores the plurality of level-based image data in the storage unit 13.

[0081] The creation unit 145, for example, determines the maximum number of divisions based on the number of pixels of the target image data, and creates multiple part image data included in multiple level-specific image data corresponding to the multiple division numbers by dividing the target image data into multiple division numbers that are equal to or less than the maximum number of divisions.

[0082] Fig. 10 shows division number information for determining the maximum division number. The division number information shown in Fig. 10 is stored in the storage unit 13, and associates the number of levels, the number of divisions, and the number of pixels of the target image data. The division number is the number of part image data created by dividing the target image data. The level number is the number of image data by level, and is determined by the size of the target image data (e.g., the number of pixels).

[0083] Specifically, when the number of pixels of the target image data is 12 million pixels, the creation unit 145 specifies that four level-specific image data should be created by referring to the "number of pixels of the target image data" and the "number of levels" shown in Fig. 10. The creation unit 145 specifies that the maximum number of divisions of the target image data is 64 by referring to the "number of divisions" shown in Fig. 10. The creation unit 145 creates level-specific image data corresponding to level 4, including 64 part image data generated by dividing the target image data into 64 parts, and information indicating that the number of divisions is 64.

[0084] Next, the creation unit 145 creates level-specific image data corresponding to level 3, which includes 16 parts image data generated by dividing the first reduced image data generated by reducing the target image data into 16 pieces, and information indicating that the division number is 16. The first reduced image data is image data created, for example, by thinning out some pixels so that the number of pixels in the vertical and horizontal directions of the target image data is reduced by half.

[0085] Furthermore, the creation unit 145 creates level-by-level image data corresponding to level 2, which includes four parts image data generated by dividing the second reduced image data, which is generated by further reducing the first reduced image data, into four pieces, and information indicating that the division number is four. Similarly, the creation unit 145 creates level-by-level image data corresponding to level 1. By creating the parts image data in this manner, the creation unit 145 can create a plurality of level-by-level image data suitable for the number of pixels of the target image data.

[0086] The creation unit 145 may, for example, determine that the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the target image data are 2. j (j is a natural number), the target image data is 4 k (k is a natural number) and generate a plurality of level-specific image data, each of which has a different value of k. Specifically, the generation unit 145 generates a plurality of level-specific image data, each of which has a different number of pixels in the vertical direction of the target image data specified by the image data specification unit 141. 11) and the number of pixels in the horizontal direction is 4096 (i.e., 2 12 In this case, the creation unit 145 creates a plurality of level-specific image data in which the target image data is divided into 4, 16, and 64 parts, respectively. By creating the level-specific image data in this manner, the creation unit 145 can make the number of vertical pixels and the number of horizontal pixels of each of the plurality of part image data equal.

[0087] The creation unit 145 creates a pixel value when either the number of pixels in the vertical direction or the number of pixels in the horizontal direction of the target image data is 2. j If j is not a natural number, the number of vertical pixels is 2. m (m is a natural number) and the number of pixels in the horizontal direction is 2 n (n is a natural number) to create image data by adding pixels. The creation unit 145 creates the created image data in four steps. k By dividing the image data into pieces, a plurality of level-specific image data, each of which has a different value of k, is created. For example, the creation unit 145 determines whether at least one of the number of pixels in the vertical direction or the number of pixels in the horizontal direction of the target image data specified by the image data specification unit 141 is greater than or equal to 2 j (j is a natural number), the number of pixels in the vertical direction is 2 on the outer periphery of the target image data. m (m is a natural number) and the number of pixels in the horizontal direction is 2 n (n is a natural number) k Divide into pieces.

[0088] The pixels that the creation unit 145 adds to the periphery of the target image data are, for example, pixels on the periphery of the target image data, pixels of a single color such as white or black, or pixels included in the area surrounding the area where the target image data is displayed in an overlapping manner in the mount image data. By creating image data in this manner, the creation unit 145 can create multiple part image data with the same number of vertical pixels and horizontal pixels, regardless of the size of the target image data.

[0089] When the captured image data generated by the camera is the target image data, the brightness of the periphery of the target image data may be lower than the brightness of the center of the target image data due to peripheral light reduction. In such a case, the user may not want to display the periphery of the target image data. In response to this, the creation unit 145 may create multiple parts image data included in multiple level-specific image data by dividing the image data excluding the area within a predetermined range from the periphery of the target image data. The area within the predetermined range is, for example, an area of ​​10% of the number of pixels in the vertical and horizontal directions, and can be set by the user operating the image processing device 1.

[0090] By operating in this manner, the creation unit 145 can create multiple part image data excluding areas that are darker than the areas near the center due to peripheral light falloff when the captured image data generated by the camera is the target image data.

[0091] However, there are cases where a user wishes to display the mount image data displayed in the paste area as target image data on other mount image data. In response to this, the creation unit 145 converts the paste area displaying one or more parts image data into target image data of the same size as the paste area (i.e., the same number of pixels as the number of pixels in the vertical and horizontal directions of the paste area), and creates an image object D including a plurality of level-specific image data corresponding to the target image data. For example, upon receiving an operation from the user to designate the mount image data as the target image data, the creation unit 145 creates an image object D with the mount image data as the target image data.

[0092] By the creation unit 145 operating in this manner, even when the display processing unit 144 enlarges or reduces image data larger than conventional image data to display it, the display processing unit 144 can display it using level-specific image data suitable for the size to be displayed by the display processing unit 144. As a result, the display processing unit 144 can reduce the time it takes to display the image even if the target image data becomes large.

[0093] <Processing flow in image processing device 1> Fig. 11 is a flowchart showing the flow of processing in the image processing device 1. The flowchart shown in Fig. 11 shows the operation from when the image processing device 1 receives designation of target image data and a paste area to when the image processing device 1 displays the target image data in the paste area.

[0094] The image data specification unit 141 receives designation of target image data and an attachment area from the input unit 11 (S1). The image data specification unit 141 specifies the target image data received from the input unit 11 by referring to the image object database shown in FIG.

[0095] If level-based image data associated with the identified target image data cannot be identified (NO in S3), i.e., if the level-based image data is not stored in the storage unit 13, the creation unit 145 creates multiple level-based image data (S4). If level-based image data associated with the identified target image data can be identified (YES in S3), i.e., if level-based image data associated with the target image data is stored in the storage unit 13, the creation unit 145 does not create level-based image data.

[0096] The image data selection unit 142 identifies the number of pixels of the paste area that the image data specification unit 141 has received from the input unit 11 (S5). The image data selection unit 142 selects one level-based image data (i.e., selected level-based image data) based on the number of pixels of the specified paste area and the number of pixels of the level-based image data associated with the target image data (S6).

[0097] The area specifying unit 143 specifies a display target area to be displayed in the paste area from among the target image data (S7). The display processing unit 144 specifies part image data to be displayed in the paste area from among the multiple part image data included in the image data by selection level, based on the display target area specified by the area specifying unit 143 and the "part image area" shown in Fig. 4 (S8). The display processing unit 144 displays the specified part image data in the paste area (S9).

[0098] When an operation to end the process has not been performed (NO in S10), the image processing device 1 repeats the processes from S1 to S9. When an operation to end the process has been performed (YES in S10), the image processing device 1 ends the process.

[0099] <First Modification> In the above description, the image processing device 1 has been described as displaying the target image data in the pasting area of ​​the mount image data, but the present invention is not limited to this. The image processing device 1 may display other mount image data designated by the user in the pasting area of ​​the mount image data. The other mount image data may display one or more target image data.

[0100] <Second Modification> In the above description, the image processing device 1 has been described as displaying the paste area on the display unit 12 such as a display, but the present invention is not limited to this. The image processing device 1 may store the part image data displayed in the paste area as an image file in the storage unit 13, or may transmit the data to a printing device such as a printer to print it.

[0101] <Third Modification> In the above description, the image processing device 1 specifies an area in the mount space of the mount image data B where the target image data is to be displayed, and overlays part image data corresponding to the number of pixels of the specified area on the mount image data B, thereby displaying the part image data overlaid on the mount image data B in the display window, but this is not limiting. The image processing device 1 may create a mount object in which the part image data is overlaid on the mount image data B, and then create a paper object including display image data generated by enlarging or reducing the mount object, and display the display image data in the display window.

[0102] 12 is a diagram for explaining an overview of the image processing device 1 according to the third modified example. The image processing device 1 specifies an area in which to display the target image data in the mount space of the mount image data B1, based on a pasting area specified by a user in the display area. The image processing device 1 creates a mount object in which the part image data included in the level-based image data corresponding to the number of pixels of the specified area is superimposed on the mount image data B1 by referring to a part image database included in the image object ((1) shown in FIG. 12).

[0103] The image processing device 1 creates a mount paper, which is display image data obtained by reducing the created mount object (as shown in FIG. 12 (2)). The image processing device 1 creates a partial enlargement paper, which is display image data obtained by enlarging a partial area (area A1 in FIG. 12) of the mount object (as shown in FIG. 12 (3)). The image processing device 1 displays the mount paper in an area specified by the user in the display window (i.e., the display area) (as shown in FIG. 12 (4)). The image processing device 1 displays the partial enlargement paper in an area specified by the user in the display area (as shown in FIG. 12 (5)).

[0104] In addition, the image processing device 1 may use display image data such as a backing paper or a partial enlargement paper included in a paper object to create an image object D4 including multiple level-specific image data corresponding to the display image data (shown in (6) in Figure 12).

[0105] <Effects of image processing device 1> As described above, the image processing device 1 has an image data identification unit 141 that identifies target image data based on an operation of specifying target image data to be displayed in the paste area by executing a program stored in the memory unit 13, and an image data selection unit 142 that selects one level-specific image data from among multiple level-specific image data associated with the target image data based on the size of the paste area.

[0106] Then, the display processing unit 144 displays, in the paste area, one or more part image data out of the multiple part image data included in the level-specific image data selected by the image data selection unit 142. By operating in this manner, the image processing device 1 displays part image data corresponding to the size of the paste area specified by the user, so that it is possible to display using an image with a smaller data amount than the data amount of the target image data. Furthermore, it is possible to display the target image data without performing a process of enlarging or reducing it to the size of the paste area specified by the user. As a result, the image processing device 1 can reduce the time required to display the target image data.

[0107] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0108] 1 Image processing device 11 Input section 12 Display section 13 Storage section 14 Control section 141 Image data specification unit 142 Image data selection section 143 Area identification part 144 Display processing unit 145 Creation Department

Claims

1. Computer, an image data specifying unit that receives an operation to specify target image data; a creating unit that creates a plurality of level-based image data associated with the target image data, the level-based image data including a plurality of part image data obtained by dividing the target image data, the level-based image data including a division number that is the number of part image data included in the level-based image data, and the plurality of part image data; A program to function as a

2. the creating unit creates the plurality of level-classified image data when the plurality of level-classified image data associated with the target image data is not stored in a storage unit; The program according to claim 1.

3. The creation unit determines whether the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the target image data are 2. ｊ (j is a natural number), the target image data is 4 ｋ (k is a natural number) pieces of image data, each of which has a different value of k, to create the plurality of level-specific image data. The program according to claim 1 or 2.

4. The creation unit is configured to create a target image data having a pixel count of 2 or a pixel count of 2 in either the vertical direction or the horizontal direction. ｊ (j is a natural number), the number of vertical pixels is 2 ｍ (m is a natural number) and the number of pixels in the horizontal direction is 2 ｎ (n is a natural number) ｋ by dividing the image data into pieces, each having a different value of k, to create the plurality of level-specific image data. The program according to claim 3.

5. the creating unit creates the plurality of part image data included in the plurality of level-by-level image data by dividing image data obtained by excluding an area within a predetermined range from the outer periphery of the target image data. The program according to claim 1 or 2.

6. causing the computer to further function as a display processing unit that displays the part image data on a display unit; the creation unit converts the paste area of ​​the display unit in which the display processing unit has displayed the parts image data into the target image data having the same size as the paste area, and creates an image object including the plurality of level-based image data corresponding to the target image data. The program according to claim 1 or 2.

7. the creation unit determines a maximum value of the number of divisions based on the number of pixels of the target image data, and creates the plurality of part image data included in the plurality of level-by-level image data corresponding to the plurality of division numbers by dividing the target image data into a plurality of division numbers equal to or less than the maximum number of divisions. The program according to claim 1 or 2.

8. On the computer, receiving an operation to designate target image data; a step of creating a plurality of level-based image data associated with the target image data, the level-based image data including a plurality of part image data obtained by dividing the target image data, the level-based image data including a division number that is the number of part image data included in the level-based image data, and the plurality of part image data; An image processing method comprising:

9. an image data specifying unit that receives an operation to specify target image data; a creating unit that creates a plurality of level-based image data associated with the target image data, the level-based image data including a plurality of part image data obtained by dividing the target image data, the level-based image data including a division number that is the number of part image data included in the level-based image data, and the plurality of part image data; An image processing device having:

Images