Storage medium, computer control method and information processing device

Abstract

The present invention relates to a storage medium, a computer control method, and an information processing device. An object of the present invention is to improve the operability of a user when printing content data. One embodiment of the present invention is a non-transitory computer-readable storage medium storing a program for causing a computer to operate as a display control unit, the display control unit being configured to cause a display unit to display a graphical user interface having a first area for specifying a content image from a plurality of content images constituting a content image group, a second area for specifying a content image group from a plurality of content image groups, a third area for specifying an individual reflection object reflecting the content image, and a fourth area for specifying a reflection object group including a plurality of individual reflection objects.

Description

Technical Field

[0001] The present invention relates to a technology for laying out content. Background Art

[0002] In recent years, it has become possible to print nail art on fingernails by using a printer. In the following, a printer for printing nail designs for nail art on fingernails is referred to as a nail printer.

[0003] Japanese Patent Laid-Open No. 2013-63282 describes a technique for displaying an image of a selected nail design on printing target fingers (ie, the index finger, the middle finger, the ring finger, and the little finger, respectively) in an overlapping manner. Summary of the invention

[0004] However, there has been a demand for better improvement in user operability in printing of content data.

[0005] One embodiment of the present invention is a non-transitory computer-readable storage medium storing a program for causing a computer to execute: a display control step for causing a display unit to display a graphical user interface having a first area for specifying a content image from a plurality of content images constituting a content image group, a second area for specifying a content image group from a plurality of content image groups, a third area for specifying an individual reflection object reflecting the content image, and a fourth area for specifying a reflection object group including a plurality of individual reflection objects; and a reflection step for, when a user specifies the first area and the third area, reflecting the content image corresponding to the first area in the reflection object corresponding to the third area, and, when a user specifies the second area and the fourth area, reflecting each of the plurality of content images constituting the content image group corresponding to the second area in each of the plurality of individual reflection objects constituting the reflection object group corresponding to the fourth area according to correspondence information indicating the correspondence between each of the plurality of content images and each of the plurality of individual reflection objects.

[0006] A computer control method includes: a display control step for causing a display unit to display a graphical user interface, the graphical user interface having a first area for specifying a content image from a plurality of content images constituting a content image group, a second area for specifying a content image group from a plurality of content image groups, a third area for specifying an individual reflection object reflecting the content image, and a fourth area for specifying a reflection object group including a plurality of individual reflection objects; and a reflection step for reflecting the content image corresponding to the first area in the reflection object corresponding to the third area when a user specifies the first area and the third area, and reflecting each of the plurality of content images constituting the content image group corresponding to the second area in each of the plurality of individual reflection objects constituting the reflection object group corresponding to the fourth area according to correspondence information indicating the correspondence between each of the plurality of content images and each of the plurality of individual reflection objects when a user specifies the second area and the fourth area.

[0007] An information processing device includes: a display control unit, which is configured to cause the display unit to display a graphical user interface, the graphical user interface having a first area for specifying a content image from a plurality of content images constituting a content image group, a second area for specifying a content image group from a plurality of content image groups, a third area for specifying an individual reflection object reflecting the content image, and a fourth area for specifying a reflection object group including a plurality of individual reflection objects; and a reflection unit, which is configured to, when a user specifies the first area and the third area, reflect the content image corresponding to the first area in the reflection object corresponding to the third area, and, when a user specifies the second area and the fourth area, reflect each of the plurality of content images constituting the content image group corresponding to the second area in each of the plurality of individual reflection objects constituting the reflection object group corresponding to the fourth area according to correspondence information indicating the correspondence between each of the plurality of content images and each of the plurality of individual reflection objects.

[0008] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1A and Figure 1B is a diagram showing the structure of the system in the first embodiment;

[0010] Figure 2 is a diagram illustrating a first GUI screen;

[0011] FIG. 3A to FIG. 3C They are diagrams illustrating the second GUI screen respectively;

[0012] FIG. 4A to FIG. 4C They are diagrams illustrating an example of designating a fingernail preview after designating nail image data;

[0013] FIG. 5A to FIG. 5C are diagrams illustrating an example of designating a hand preview after designating nail image data;

[0014] FIG. 6A to FIG. 6C are diagrams illustrating an example of designating nail image data after designating a fingernail preview;

[0015] 7A to 7C They are diagrams illustrating an example of designating nail art data after designating a fingernail preview;

[0016] FIG. 8A to FIG. 8D are diagrams illustrating an example of displaying a preview of only one hand;

[0017] Fig. 9 is a diagram showing a print data creation screen; and

[0018] Fig.10 is a flowchart of information processing in the first embodiment. DETAILED DESCRIPTION

[0019] In the following, embodiments of the present invention are described in detail. The following embodiments are illustrations for illustrating the present invention and are not intended to limit the present invention to these embodiments. In addition, the present invention can be modified in many ways as long as the modification does not deviate from the gist of the invention.

[0020] [First embodiment]

[0021] <System Structure>

[0022] The system of this embodiment has an information processing device and a printer. In this embodiment, a tablet terminal is used as an example of the information processing device for explanation. However, the information processing device is not limited to the tablet terminal. As the information processing device, various items such as a mobile terminal, a notebook PC, a smart phone, a PDA (personal digital assistant), and a digital camera can be used.

[0023] In addition, as the printer in the present embodiment, for example, an inkjet printer, a monochrome printer, and a 3D printer, etc. can be adopted. However, the printer of the present embodiment can be a multi-function printer including multiple functions (such as a copy function, a fax function, and a print function, etc.). The printer of the present embodiment has a function of drawing directly on the fingernails of the human hand. In the present embodiment, the description is given by distinguishing the information processing device and the printer as separate devices, but the following aspect can be accepted: using a device having the functions of two devices in an integrated manner.

[0024] Figure 1A and Figure 1B 1 is a diagram illustrating a system having an information processing apparatus 101 and a printer 151 according to the present embodiment. Figure 1A 1 is a block diagram of a system having an information processing apparatus 101 and a printer 151 . Figure 1B is a schematic diagram of the appearance of the printer 151. Figure 1A and Figure 1B , describing the structures of the information processing device 101 and the printer 151.

[0025] <Information Processing Equipment>

[0026] like Figure 1A As shown, the information processing apparatus 101 has an input interface 102, a CPU 103, a ROM 104, a RAM 105, an external storage device 106, an output interface 107, and a communication unit 109. They are connected to each other via a system bus.

[0027] The input interface 102 is an interface for receiving data input and operation instructions from a user via an operation unit (not schematically shown) including a physical keyboard, buttons, and a touch panel, etc. An aspect of the information processing device 101 in the present embodiment is such that a display unit 108 (described later) and at least a part of the operation unit are integrated into one unit, and, for example, output of a screen and reception of an operation from a user are performed on the same screen.

[0028] The CPU 103 is a system control unit, and controls the entire information processing device 101 by executing programs and starting hardware. In the ROM 104, control programs executed by the CPU 103, data tables, a built-in operating system (hereinafter referred to as OS), and data of the programs, etc. are stored. In the present embodiment, each control program stored in the ROM 104 performs software execution control such as scheduling, task switching, and interrupt processing under the management of the built-in OS stored in the ROM 104.

[0029] The RAM 105 includes an SRAM (static random access memory) or a DRAM, etc. In the RAM 105, data can be stored by a primary battery (not schematically shown) for data backup. In this case, data such as program control variables can be stored in the RAM 105 without losing the data. In addition, a storage area for storing setting information related to the information processing device 101 and management data related to the information processing device 101 is also provided in the RAM 105. In addition, the RAM 105 is also used as a main memory and a working memory of the CPU 103.

[0030] In the external storage device 106, an application for providing a print execution function, a print information generation program for generating a print job that can be interpreted by the printer 151, and the like are stored. In addition, in the external storage device 106, various programs such as an information transmission and reception control program for transmitting and receiving information with the connected printer 151 via the communication unit 109, and various information used by these programs and the like are stored.

[0031] The output interface 107 is an interface that performs control of display of data by the display unit 108 , notification of the status of the information processing device 101 , and the like.

[0032] The display unit 108 has an LED (light emitting diode) or an LCD (liquid crystal display) or the like, and performs display of data, notification of the state of the information processing device 101, and the like. It is also possible to receive input from a user via the display unit 108 by installing a soft keyboard including keys such as a numeric value input key, a mode setting key, an OK key, a cancel key, and a power key on the display unit 108. In addition, the display unit 108 can be configured as a touch panel display. The display unit 108 is connected to the system bus of the information processing device 101 through the output interface 107.

[0033] The communication unit 109 is configured to perform data communication by connecting to an external device such as a printer 151. The communication unit 109 can be connected to an access point (not schematically shown) in the printer 151. That is, in the present embodiment, the communication unit 156 in the printer 151 can operate as an access point. The access point is an example, and what is required is that the communication unit 156 operates as a master station when performing wireless communication in accordance with the IEEE 802.11 series, and, for example, the communication unit 156 can operate as a group owner of Wi-Fi Direct. By connecting the communication unit 109 to the access point in the printer, the information processing device 101 and the printer 151 can perform direct wireless communication with each other. The communication unit 109 can also perform direct communication with the printer 151 by using wireless communication, or communicate with the printer 151 via an external access point (access point 131) existing outside. As a wireless communication method, for example, Bluetooth (registered trademark) and the like can be used, without being limited to Wi-Fi (Wireless Fidelity) (registered trademark). As the external access point 131, for example, a device such as a wireless LAN router is mentioned. In the present embodiment, a method of directly connecting the information processing device 101 and the printer 151 to each other without the intervention of the external access point 131 is referred to as a direct connection method. In addition, a method of connecting the information processing device 101 and the printer 151 to each other via the external access point 131 is referred to as an infrastructure connection method. This aspect may also be an aspect in which the information processing device 101 and the printer 151 are connected via a wire.

[0034] In the present embodiment, it is assumed that the information processing device 101 stores a predetermined application in the ROM 104 or the external storage device 106, etc. The predetermined application is an application for sending a print job for printing nail art data to the printer 151 in response to, for example, an operation from a user. An application having such a function is hereinafter referred to as a nail application. In addition to the printing function, the nail application may have other functions. For example, the nail application in the present embodiment may have a function of starting the camera of the imaging unit 157 of the printer 151 by communicating with the printer 151. That is, the nail application may have a function of sending a camera start-up job instead of a print job to the printer 151. In addition, the predetermined application stored in the ROM 104 or the external storage device 106, etc. is not limited to the nail application, and may be an application having functions other than printing.

[0035] <Printer>

[0036] The printer 151 has a ROM 152, a RAM 153, a CPU 154, a print engine 155, a communication unit 156, and an imaging unit 157. These components are connected to each other via a system bus. In addition, the printer 151 has a print object insertion unit 158 ​​as a space for inserting a print object. Figure 1B 1 is a schematic diagram showing the appearance of the printer 151. Figure 1B As shown, a print object insertion unit 158 ​​is provided inside the printer 151 . Figure 1B It is shown in a manner that the user inserts his / her right hand into the print object insertion unit 158. As described above, in the present embodiment, it is assumed that a human hand is inserted into the print object insertion unit 158, and it is assumed that the print object is a fingernail.

[0037] In the ROM 152, control programs executed by the CPU 154, data tables, data of OS programs, etc. are stored. In the present embodiment, each control program stored in the ROM 152 performs software execution control such as scheduling, task switching, and interrupt processing under the management of the built-in OS stored in the ROM 152.

[0038] The RAM 153 includes an SRAM or a DRAM, etc. In the RAM 153, data can be stored by a primary battery (not schematically shown) for data backup. In this case, data such as program control variables can be stored in the RAM 153 without losing the data. In addition, a storage area for storing setting information related to the printer 151 and management data related to the printer 151 is also provided in the RAM 153. In addition, the RAM 153 is also used as a main memory and a working memory of the CPU 154, and the RAM 153 can temporarily store printing information and various information received from the information processing device 101.

[0039] The CPU 154 is a system control unit, and controls the entire printer 151 by executing programs and activating hardware. The print engine 155 forms an image on a print object medium such as a fingernail inserted into the print object insertion unit 158 ​​by using a printing material such as ink based on information stored in the RAM 153 or a print job received from the information processing device 101.

[0040] The communication unit 156 can operate as an access point for wirelessly communicating with an external device such as the information processing device 101 by a direct connection method. In the present embodiment, the communication unit 156 operating as the access point can be connected to the communication unit 109 of the information processing device 101. The communication unit 156 can also communicate directly with the information processing device 101 by using wireless communication, or communicate with the information processing device 101 via the external access point 131. In the case where the communication unit 156 is connected to the external access point 131 in the infrastructure connection method, the communication unit 156 operates as a slave station, and the external access point 131 operates as a master station. In addition, the communication unit 156 may have hardware that functions as an access point, or the communication unit 156 may operate as an access point by software for causing the communication unit 156 to function as an access point.

[0041] The camera unit 157 is a device having a camera function, and belongs to the printer 151 and is arranged in the printer 151. The camera unit 157 has a function of photographing a predetermined area including a print object (specifically, a fingernail) inserted into the print object insertion unit 158 ​​and sending the photographed image (still image or moving image) to the information processing device 101 in real time. In the present embodiment, the camera unit 157 photographs a moving image and is a camera module having at least a lens and an image sensor. The lens collects light from the print object inserted into the print object insertion unit 158, and forms an image on the image sensor. The image sensor converts the light collected by the lens into an electrical signal that can be processed by the CPU 154. In the case where the device has such a function, as a device having a camera function, a smart phone, a mobile terminal, a digital camera, etc. can also be used instead of the camera module. The print engine 155 prints the print object inserted into the print object insertion unit 158.

[0042] A memory such as an external HDD and an SD card may also be attached to the printer 151, and information stored in the printer 151 may be stored in the memory. Figure 1A and Figure 1B The structure shown in is merely typical, and the information processing apparatus 101 and the printer 151 may each have components other than those described previously, but a description thereof is omitted here.

[0043] <Definition of terms>

[0044] Next, the terms used in this embodiment are explained. This embodiment is an aspect in which nail art is mainly printed on fingernails. In addition, Figure 1BThe aspect shown in is the aspect of printing nail art on each fingernail of one hand. Generally, the nail art printed on each fingernail has the same concept, but there is a case where the nail art printed on each individual fingernail is not completely the same. For example, in the nail art set of design A, ten nail arts are included (corresponding to the fingernails of the five fingers of each hand in both hands), and the ten nail arts have a common design concept, but there is a case where the patterns are not completely the same. In view of the above points, in this embodiment, the terms are defined as follows.

[0045] "Nail image data": refers to image data of nail art printed on one fingernail.

[0046] "Nail art data": refers to an aggregation of multiple nail image data. That is, nail art data can also be referred to as a data set of multiple nail image data. Generally, nail art data is image data that aggregates images of individual nail image data corresponding to the nail art of ten fingernails. The nail art data may be data that aggregates individual nail image data of ten nail image data (i.e., a set of ten image data), or may be image data obtained by combining individual nail image data of ten nail image data into one image. Alternatively, the nail art data may be a data set of five representative nail image data of ten nail image data by considering a display area of ​​the nail art data described later.

[0047] As described above, it is assumed that when “nail image data” is mentioned, it refers to data of images of nail art of each individual fingernail, and when “nail art data” is mentioned, it refers to a data set of images of a plurality of nail art.

[0048] <Overview of nail art printing>

[0049] In this embodiment, the nail application is started by the CPU 103 of the information processing device 101 executing a program of the nail application stored in the ROM 104 or the external storage device 106. Then, by using the nail application, the user can print nail art on the fingernails by reflecting the nail image data selected by the user in the print area. That is, by using the nail application, the following series of operations are performed: (1) The user selects nail image data to be printed on one or more fingernails on the application. (2) The user inserts his / her hand into the nail printer. (3) The hand inserted by the user is photographed by the camera in the nail printer. (4) The application generates a display based on the photographed image data sent from the nail printer. (5) On the displayed photographed image, the user sets the area of ​​the fingernails desired to be printed as the print area of ​​the nail art. (6) The application reflects the nail image data selected in (1) in the print area set by the user. For example, the application displays the nail image data in the print area set by the user in an overlapping manner. (7) The application causes the printer 151 to print using the reflected nail image data.

[0050] In the following, the following aspects are explained: In the process of (1) above, the user can easily select nail image data that is desired to be printed on one or each of the plurality of fingernails. The user who inserts his / her hand into the printer 151 and the user who operates the application may be the same user or different users. In this embodiment, a nail printer capable of printing up to four fingernails at a time is used as an example for explanation.

[0051] <GUI for nail application>

[0052] For ease of understanding, the graphical user interface (hereinafter, described as GUI) screen displayed in the nail application is first described. The GUI screen described below is displayed on the display unit 108 by the CPU 103 executing the nail application. In addition, it is assumed that the input interface 102 used as the operation unit and the display unit 108 are integrated into one unit for description. The GUI screen of the nail application in this embodiment is roughly divided into two types. The first GUI screen is Figure 2 The second GUI screen is FIG. 3A to FIG. 3C The screen for creating print data is shown in FIG. Figures 2 to 3C , illustrating the GUI screen of the nail application.

[0053] Figure 2A nail image data selection screen 201 is shown as the first GUI screen in this embodiment. In the nail image data selection screen 201, first nail data 211 and second nail data 221 are displayed. In this embodiment, two types of nail data are displayed as described above, but the number of displayed nail data may be one, three, or four or more.

[0054] The area including all nail image data included in the first nail data 211 is regarded as the first nail data area 212, and the area including all nail image data included in the second nail data 221 is regarded as the second nail data area 222. The respective nail image data for the respective fingers displayed in the nail data area are displayed at the positions predefined for the respective fingers. The nail data area including the respective areas of a plurality of individual nail image data is also referred to as the content image group selection area.

[0055] In the following, the nail image data displayed in the first nail data area 212 is explained. In order from the leftmost data in the upper row, the image data is a nail image data 230 for the little finger of the left hand, a nail image data 231 for the ring finger of the left hand, a nail image data 232 for the middle finger of the left hand, a nail image data 233 for the index finger of the left hand, and a nail image data 234 for the thumb of the left hand. Continuing from the above, in order from the leftmost data in the lower row, the image data is a nail image data 235 for the thumb of the right hand, a nail image data 236 for the index finger of the right hand, a nail image data 237 for the middle finger of the right hand, a nail image data 238 for the ring finger of the right hand, and a nail image data 239 for the little finger of the right hand. That is, the nail application stores corresponding information for corresponding each nail image data included in the nail data to each fingernail preview area. The corresponding information is created at the time point of creating the nail data. The arrangement of the nail image data described here is an example, and an arrangement other than the arrangement described here can also be adopted.

[0056] On the nail image data selection screen 201, a hand preview 241 is displayed so that the user can check a preview of the selected nail image data reflected on each fingernail of each finger. The hand preview 241 is assumed to be an image prepared in advance, but the hand preview 241 may be, for example, an image captured in a case where the user inserts his / her hand into the print object insertion unit 158 ​​of the printer 151. Furthermore, on the nail image data selection screen 201, there is a hand preview area 242 for enabling the user to select the hand preview 241. The hand preview area 242 including a plurality of individual reflection objects (areas of fingernails of respective fingers) is also referred to as a reflection object group selection area.

[0057] As in the present embodiment, the hand preview area 242 may be a range overlapping with the hand preview 241, or may be an area slightly larger than the hand preview 241 to improve the ease of selection. Of course, a frame clearly surrounding the hand preview may be displayed and the inside of the frame may be the hand preview area 242. In the hand preview 241, preview areas of fingernails of respective fingers are included. Specifically, in order from the leftmost area of ​​the hand preview 241, the areas are the fingernail preview area 250 of the little finger of the left hand, the fingernail preview area 251 of the ring finger of the left hand, the fingernail preview area 252 of the middle finger of the left hand, the fingernail preview area 253 of the index finger of the left hand, and the fingernail preview area 254 of the thumb of the left hand. Furthermore, following the above, the areas are the fingernail preview area 255 of the thumb of the right hand, the fingernail preview area 256 of the index finger of the right hand, the fingernail preview area 257 of the middle finger of the right hand, the fingernail preview area 258 of the ring finger of the right hand, and the fingernail preview area 259 of the little finger of the right hand.

[0058] As the hand preview 241, in the case of reflecting the nail image data, both hands may be displayed by emphasizing the overview visibility, or a partial enlarged portion of the hand may be displayed by emphasizing the visual recognizability. That is, for example, only the little finger, ring finger, middle finger, and index finger of the left hand may be displayed, or only the thumb of the right hand may be displayed.

[0059] FIG. 3A to FIG. 3C 241 as a print target, the user specifies the first nail data area 212, such as Figure 3A At this time, Figure 3A As shown, in order to designate the first nail art data area 212, the user designates a position that does not overlap with the nail image data 230 to 239 of each finger displayed on the first nail art data area 212. As another embodiment for the user to designate the first nail art data area 212, the batch selection switch 261 may be enabled. In a state where the batch selection switch 261 is enabled, even if the user designates a position that overlaps with the nail image data 230 to 239 of each finger displayed on the first nail art data area 212, the first nail art data 211 is deemed to have been designated. In the case where the first nail art data area 212 is designated, as shown in FIG. Figure 3BAs shown, a display frame 263 indicating the state of selecting nail data is displayed, so that the first nail data 211 can be visually recognized to be selected. In the present embodiment, the display frame 263 is displayed so that the first nail data 211 can be visually recognized to be selected, but other aspects are acceptable. For example, the following aspect is acceptable: an icon indicating that the nail data is selected is temporarily displayed on the first nail data 211. This aspect is not limited as long as the user can recognize that the nail data is selected. In addition, in the present embodiment, it is assumed that the batch selection switch 261 is invalid for description.

[0060] When the user designates the hand preview area 242 while selecting the first nail art data 211, Figure 3C As shown, the first nail art data 211 is reflected in the fingernail preview areas 250 to 259 of each finger included in the hand preview 241. That is, the nail image data 230 to 293 corresponding to each finger is reflected at once in each corresponding fingernail preview area of ​​each finger. For example, the nail image data 230 of the little finger of the left hand is reflected in the corresponding fingernail preview area 250 of the little finger of the left hand. For other fingers, the nail image data is reflected similarly. The hand preview area 242 includes the fingernail preview areas 250 to 259 of each finger, but in the state of selecting the nail art data, even when one of the fingernail preview areas 250 to 259 of each finger is specified, it is processed as if the hand preview area 242 is specified. That is, the nail application reflects the corresponding nail art image of each finger for all the fingers of the displayed fingernail preview. For example, in Figure 3B In the state of selecting nail data shown in FIG. 1 , even when the left little fingernail preview area 250 is designated, the same as when the hand preview area 242 is designated, causes Figure 3C The status shown in .

[0061] In the previously described embodiment, the nail data is reflected by specifying the hand preview area 242 after specifying the first nail data area 212, but the aspect of reflecting the nail data is not limited thereto. In order to reduce one user operation, the nail data can also be reflected at the time point of specifying the first nail data area 212. However, in this case, it is preferable to prevent the work that has been completed so far from becoming invalid due to an erroneous touch operation. For example, in the case where even one nail image data is not reflected in the fingernail preview area of ​​all fingers, the nail data is reflected without causing the user to specify the hand preview area 242. On the contrary, in the case where at least one nail image data is reflected in the fingernail preview area, the nail data is not reflected, or the user may be asked whether to allow the reflection of the nail data.

[0062] FIG. 4A to FIG. 4C2 shows an example of a process of reflecting one nail image data in the nail art data in the hand preview. In the case where the user wishes to reflect the nail image data 232 of the left middle finger in the first nail art data 211 in the fingernail preview area 250 of the left little finger, as shown in FIG. Figure 4A As shown in FIG. 2 , the user specifies the nail image data 232 of the left middle finger. When the nail image data 232 is specified, as shown in FIG. Figure 4B As shown, a display frame 264 indicating a state in which nail image data is selected is displayed so that the nail image data 232 of the left middle finger can be visually recognized as having been selected. Regarding the method of making the user recognize that the nail image data has been selected, as in the previously described display frame displayed when the nail art data is selected, this aspect is not limited to Figure 4B In the aspect, any aspect can be adopted as long as it can make the user recognize that the nail image data has been selected. In the case where the user specifies the left little finger nail preview area 250 in the state of selecting the left middle finger nail image data 232, as shown in FIG. Figure 4C As shown, the nail image data 232 of the left middle finger is reflected in the left little finger nail preview area 250. As another example, in the case where the user desires to reflect the nail image data 232 of the left ring finger in the nail preview area 258 of the right ring finger (instead of the left little finger), the nail image data 232 of the left middle finger is reflected in the nail preview area 258 of the right ring finger by specifying the nail preview area 258 of the right ring finger in a state where the nail image data 232 of the right middle finger is selected.

[0063] In the previously described aspects, by Figure 4A After specifying the nail image data 232 in the image processing, the fingernail preview area 250 is specified to reflect the nail image data, but the aspect of reflecting the nail image data is not limited to this. In order to reduce one user operation, the nail image data can also be reflected in the fingernail preview area 252 of the left middle finger at the time point of specifying the nail image data 232 of the left middle finger. In this case, under the condition that the user desires to reflect the nail image data in the fingernail preview area 252 of the left middle finger, it is sufficient to leave it as it is. On the other hand, in the case where the user desires to reflect the nail image data in the fingernail preview area of ​​another finger, for example, it is sufficient to specify the fingernail preview area 250 of the left little finger in a state where the nail image data 232 is reflected in the fingernail preview area 252 of the middle finger. By doing so, as Figure 4C As shown, the nail image data is reflected in the fingernail preview area specified later. At this time, the reflection of the nail image data in the fingernail preview area of ​​the left middle finger reflected in the unspecified case is cancelled. Of course, the user can also be asked whether to allow cancellation before canceling the reflection, although it increases the user's time and energy.

[0064] FIG. 5A to FIG. 5C Each shows another example of the process of reflecting one nail image data in the nail art data in the hand preview. In the case where the user wishes to reflect the nail image data 232 of the left middle finger in the first nail art data 211 as it is in the hand nail preview area 252 of the left middle finger, first, as shown in FIG. Figure 5A As shown, the user specifies the nail image data 232 of the left middle finger. Then, the nail image data 232 can be reflected by specifying the fingernail preview area 252 of the left middle finger as described above, but here, as shown in FIG. Figure 5B As shown, the user specifies the hand preview area 242. When specifying the nail image data 232, in the state where the area of ​​the hand preview area 242 that does not overlap with the fingernail preview area is specified, as shown in FIG. Figure 5C As shown in FIG. 1 , the nail image data is reflected in the fingernail preview area corresponding to the finger of the designated nail image data. That is, the nail art of the left middle finger is reflected on the left middle finger. FIG. 5A to FIG. 5C In the case where nail image data is selected after selecting the hand preview area 242 in the image, the nail image data is reflected in the fingernail preview area corresponding to the selected nail image data. Figure 5A When the nail image data 232 is designated in this way, the nail image data 232 is reflected in the nail preview area 252 which is the nail of the middle finger of the left hand corresponding to the nail image data 232 .

[0065] On the other hand, when the fingernail preview area is designated while the nail image data 232 is designated, the nail image data 232 is reflected in the designated fingernail preview area. Figure 5A When the fingernail preview area 258 is designated while the nail image data 232 is designated in this manner, the nail image data 232 is reflected in the fingernail preview area 258 of the ring finger of the right hand.

[0066] exist FIG. 3A to FIG. 5C In the embodiment, the user specifies a hand preview or a fingernail preview reflecting the nail art data or the nail image data after specifying the nail art data or the nail image data. As another embodiment, the nail art data or the nail image data may be specified after specifying the hand preview or the fingernail preview that is expected to reflect the nail art data or the nail image data. By using FIG. 6A to FIG. 6C In the case where the nail image data 232 of the left middle finger in the first nail art data 211 is reflected in the left middle finger nail preview area 252, first, Fig. 6A As shown in FIG. 25, the fingernail preview area 252 of the left middle finger is specified. Figure 6BAs shown, a display frame 265 indicating that the fingernail preview is selected is displayed. Figure 6B In the case where the user specifies the nail image data 232 while the display frame 265 is displayed as shown in FIG. Figure 6C As shown, the nail image data 232 is reflected in the fingernail preview area 252 of the left middle finger. Figure 6B In the aspect of specifying the nail image data 232 of the left middle finger in the left hand, another embodiment is also considered. For example, as another embodiment, when the nail image data 234 of the left thumb is specified, of course, the nail image data 234 of the left thumb is reflected in the fingernail preview area 252 of the left middle finger.

[0067] exist FIG. 6A to FIG. 6C In the example, the nail image data is specified after the fingernail preview area is specified, but 7A to 7C Each shows a process in which, as another embodiment, an area in the first nail data area 212 that does not overlap with the nail image data area is specified after the fingernail preview area is specified. Fig. 7A As shown, the user specifies the fingernail preview area 252 of the left middle finger. Figure 7B As shown, a display frame 265 indicating that the finger preview is selected is displayed. Next, the user specifies an area in the first nail data area 212 that does not overlap with the nail image data. By this specification, the CPU 103 determines that the user desires to reflect the nail data and reflects the first nail data 211 in the preview areas 250 to 259 of each fingernail, as shown in FIG. Figure 7C As shown. In the case where there is space in the designated area of ​​the nail data, the judgment is valid. As another embodiment, in the case where there is no space in the designated area of ​​the nail data, although the user attempts to specify the nail image data, it may sometimes happen that the user specifies the nail data area. In this case, the nail image data closest to the position on the designated nail data area may also be reflected, or the designation of the nail image data that the user can easily designate again may be ignored. Optionally, the nail application may also ask the user whether to select the closest nail image data or the nail data by displaying a check screen. In the case of ignoring the designation, the nail image data is reflected in the fingernail preview area under the condition that the re-designation of the nail image data is successful. That is, the judgment method in the case where the user specifies an area that does not overlap with the nail image data in the nail data area can be freely determined according to the size of the display area or the layout of the nail image data of each finger in the nail data area.

[0068] The designation may be performed by other methods. For example, the fingernail preview area may be designated after the nail art data is designated. In this case, the nail image data corresponding to the fingernail preview area designated in the nail image data included in the nail art data is reflected in the fingernail preview area. For example, in the case where the fingernail preview area 258 is selected after the nail art data is selected, the nail image data corresponding to the right ring finger included in the nail art data is reflected in the fingernail preview area 258.

[0069] exist FIG. 3A to FIG. 7C , both hands (i.e., left and right hands) are displayed as hand previews, but FIG. 8A to FIG. 8D Each shows a flow in a case where previews of both hands cannot be displayed due to a narrow display area. Fig. 8A 243 can be displayed. In this state, when the left-hand preview area 244 is specified, the first nail art data area 212 is specified and the display frame 263 is displayed. Figure 8B As shown, the nail image data 230 to 234 corresponding to the respective fingers of the left hand in the nail art data are reflected in the fingernail preview areas 250 to 254 of the respective fingers of the left hand. At this time, which nail image data is reflected in which finger's fingernail preview is defined in advance.

[0070] then, Figure 8C 245 can be displayed only in the case where the first nail data area 212 is specified and the display frame 263 is displayed. In this state, when the right preview area 246 is specified, as shown in FIG. Fig.8D As shown, for the fingernail preview areas 255 to 259 of the respective fingers of the right hand, the nail image data 235 to 239 corresponding to the respective fingers of the right hand in the nail art data are reflected. At this time, as in the case of the left hand, it is predefined which nail image data is reflected in which finger's fingernail preview. FIG. 8A to FIG. 8D In the embodiment, the state where only the left hand or the right hand can be displayed is used as an example for explanation. As another example, even in a state where only the left thumb can be displayed, the present embodiment can be applied if the correspondence between the finger of the nail art data and the fingernail preview of the finger is predefined. Furthermore, as another example, the present embodiment can be applied even in a state where, for example, a total of eight fingers excluding the thumbs of both hands are displayed.

[0071] In by FIG. 3A to FIG. 8D In the embodiment shown in the figure, when the completion button 262 is pressed after determining which nail image data is to be reflected on which fingernail, the screen changes to the following figure. Fig. 9 A print data creation screen 901 is shown.

[0072] Fig. 9: is a diagram showing a print data creation screen 901 as a second GUI screen for creating print data. The print data creation screen 901 has a captured image display area 902, a fingernail recognition button 903, and a print execution button 904. In addition, the print data creation screen 901 has a nail image data display area 911 of four fingers of the left hand, an icon 915 indicating which finger corresponds to each of these fingers, a nail image data display area 912 of one finger of the left hand, and an icon 916 indicating which finger corresponds to the finger. In addition, the print data creation screen 901 has a nail image data display area 913 of four fingers of the right hand, an icon 917 indicating which finger corresponds to each of these fingers, a nail image data display area 914 of one finger of the right hand, and an icon 918 indicating which finger corresponds to the finger.

[0073] In the finger nail image data display area 911 to 914, the nail image data of each finger selected on the first GUI screen is displayed, and it is indicated which finger's fingernail is printed at which position in the nail printer of the present embodiment capable of printing up to four fingers at a time. For example, in the nail image data display area 911 of the four fingers of the left hand, as the nail image data selected on the first GUI screen, the nail image data of the little finger, the ring finger, the middle finger and the index finger of the left hand are displayed in order from the left, and it is indicated at which position of the nail printer which finger will be placed. Which finger each finger displayed in the nail image data display area 911 corresponds to is indicated by an icon 915, and this can be visually understood. Similarly, in the nail image data display area 912 of one finger of the left hand, at the second position from the left, the nail image data of the thumb of the left hand is displayed as the nail image data selected on the first GUI screen. This indicates that it is sufficient to place the thumb of the left hand at the second printing position from the left among the four printing positions in the nail printer. Icon 916 can identify that the displayed nail image data is the data of the thumb of the left hand. Similarly, with respect to the four fingers of the right hand and one finger of the right hand, the same situation as described above is indicated by the nail image data display areas 913 and 914 and icons 917 and 918 .

[0074] In the following, an example of processing until actual printing on a fingernail is shown. The user inserts the finger on which the fingernail is desired to be printed into the print object insertion unit 158, and presses the fingernail recognition button 903. Here, an explanation is given assuming that it is desired to print the four fingers of the right hand. By pressing the fingernail recognition button 903, the camera unit 157 captures the hand inserted into the print object insertion unit 158, and displays the camera result in the captured image display area 902. Next, by pressing the fingernail recognition button 903, the nail application recognizes the fingernail area in the captured image, and displays the recognized result in the captured image display area 902 as the fingernail area 905. In the case where the fingernail recognition result is different from the expected result, the user selects the nail image data display area 913 of the four fingers of the right hand after adjusting the fingernail area. The adjustment of the fingernail area is to change at least one of the position, size and orientation of the fingernail area by user operation. In response to selecting the nail image data display area 913 of the four fingers of the right hand, the nail application displays a display frame 919 for clearly indicating the nail image data selected by the user. Next, when the print button 904 is pressed, a print job is created for printing the fingernail area 905 at the corresponding position based on the nail image data of each finger included in the selected nail image data display area 913. The print job created by the nail application is sent to the nail printer, and the nail printer prints based on the sent print job. Here, for the nail image data included in the print job, the size and shape, etc. are determined based on the information about the fingernail area. Display control processing can also be performed by the nail application to display the layout result of the selected nail image data arranged in the print target fingernail area 905 before generating the print job.

[0075] The display order can be other orders. For example, the nail application can also be displayed in Fig. 9 , and starts to capture images with the camera. Therefore, before pressing the fingernail recognition button 903, the capture result of the camera unit 157 can be displayed in the captured image display area 902. In addition, the nail application selects one of the nail image data display areas 911 to 914 as the default nail image data. Then, when the user presses the fingernail recognition button 903, the nail application can also perform display control processing to display the layout result, in which the respective nail image data selected as the default nail image data display area 913 are arranged in the identified fingernail area. Display the respective nail image data based on the position and size of the identified fingernail area. Then, the nail application can also change at least one of the position, size and orientation of the fingernail area displaying the respective nail image data based on the user's instruction. The operation after pressing the print button 904 is as described above.

[0076] <Processing Flow>

[0077] Fig.10 In this embodiment FIG. 3A to FIG. 5C A flowchart of a series of processes shown.

[0078] First, in step S1001, CPU 103 detects a user's touch in the nail art data area on the first GUI. The touch detected in this step is defined as the first touch. In the following, "step S-" is abbreviated as "S-".

[0079] At S1002, CPU 103 sets the value of the group flag to ON. The group flag is a flag indicating whether the touch area is an area of ​​the image group. Here, it is assumed that the value is set to ON when the touch area is an area regarded as an image group, and the value is set to OFF when the touch area is an area regarded as a single image area.

[0080] In S1003, CPU 103 determines whether the first touch as the touch in the nail art data area is a touch in the nail image data area. If the judgment result of this step is affirmative, the process proceeds to S1004, and on the other hand, if the judgment result is negative, the process proceeds to S1006.

[0081] At S1004, the CPU 103 determines which finger's nail image data is touched, and acquires the number of the finger as the data finger number N. The finger numbers in this example are obtained by sequentially assigning 1 to the little finger of the left hand, 2 to the ring finger of the left hand, and so on, and thus, the thumb number of the thumb of the right hand is 6, and the finger number of the little finger of the right hand is 10. The method of assigning the finger numbers is not limited to such an aspect, and an arbitrary method may be adopted.

[0082] At S1005, the CPU 103 sets the value of the group flag to OFF. The reason is that at S1003, the CPU 103 determines that the user has selected a single finger when receiving the result.

[0083] In S1006, CPU 103 determines whether a user's touch on the first GUI is detected. The touch detected in this step is defined as a second touch. In the case where the judgment result of this step is positive, the process proceeds to S1007, and on the other hand, in the case where the judgment result is negative, CPU 103 stands by until the second touch is detected.

[0084] In S1007, CPU 103 determines whether the second touch detected in S1006 is a touch within the hand preview area. In the case where the determination result of this step is positive, the process proceeds to S1008, and on the other hand, in the case of negative determination result, the process proceeds to S1014.

[0085] At S1008, CPU 103 determines whether the second touch is a touch within the fingernail preview area of ​​one of the fingers. If the judgment result of this step is affirmative, the process proceeds to S1010, and on the other hand, if the judgment result of this step is negative, the process proceeds to S1009.

[0086] In S1009, the CPU 103 determines whether the value of the group flag is ON. In the case where the determination result of this step is affirmative, the process proceeds to S1012, and on the other hand, in the case where the determination result of this step is negative, the process proceeds to S1013.

[0087] In S1010, the CPU 103 determines whether the value of the group flag is ON. In the case where the determination result of this step is affirmative, the process proceeds to S1012, and on the other hand, in the case where the determination result of this step is negative, the process proceeds to S1011.

[0088] When the value of the group flag is OFF, nail image data of a single finger is selected by the first touch, and therefore, in S1011, the CPU 103 reflects the nail image data selected by the first touch in the fingernail preview area of ​​the finger selected by the second touch.

[0089] In the case where it is judged as "yes" at S1009 or S1010, it can be considered that the entire nail art data has been selected by the first touch, rather than the nail image data of a single finger. Therefore, in this case, at S1012, the CPU 103 reflects the nail image data of each finger in the nail art data in the finger preview of each corresponding finger.

[0090] In the case where it is determined at S1009 that the value of the group flag is not "ON" (i.e., "OFF") (in the case of "No" at S1009), the CPU 103 determines that the nail image data of a single finger has been selected by the first touch. Therefore, in this case, in S1013, the CPU 103 reflects the nail image data selected by the first touch in the fingernail preview of the finger corresponding to the finger number N acquired at S1004.

[0091] If it is determined at S1007 that the second touch is not a touch within the hand preview area (NO at S1007 ), there is no area reflecting the nail art selected by the first touch, and therefore at S1014 , CPU 103 cancels the selection of the first touch.

[0092] exist Fig.10 In the aspect shown, the finger number is acquired at S1004, and the nail image data reflected in the fingernail preview is determined by using the finger number at S1013, but in the case where the finger can be specified, the parameter may not be a number. For example, the parameter may be a letter such as A, B, and C, and the aspect is not limited as long as the finger can be specified.

[0093] As mentioned above, through Fig.10 In the reflection processing, you can obtain the reflection result of which nail image data is reflected in which fingernail preview area. The nail application can be used Fig.10 The reflection result in the image obtained by photographing the fingernail as the printing object is displayed by arranging the nail image data in Fig. 9 The layout result in the fingernail area on the screen in .

[0094] According to the present embodiment, the user is enabled to reflect nail image data on desired fingernails through easy operations.

[0095] [Other embodiments]

[0096] In the present embodiment, the printer 151 in which one hand is inserted into the print object insertion unit 158 ​​is described as an example, but the printer is not limited thereto. For example, the printer may be a printer in which both hands are inserted, such as a printer installed in a store, etc. In this case, a person other than the user, such as a store assistant of the store, may perform the operation.

[0097] In addition, in the above-described embodiments, as the content image, a nail image is used as its reflection object, the fingernails of a hand are used as the reflection object group, and the hand region is used, but the content image and the reflection object in the present invention are not limited to these. For example, as the reflection object group, a foot region can be used, and the processing of each embodiment can be used when printing the fingernails of a foot.

[0098] Furthermore, the process can be used for purposes other than nail printing, and the process of each embodiment described previously can be used when a specific image group is arranged for a plurality of layout objects.

[0099] Furthermore, in the various embodiments described above, explanations are mainly given by taking an example of printing an image (pattern) as nail art, but it is acceptable to form a structure including a pattern as nail art by using shape data and image data representing a three-dimensional structure, etc.

[0100] In addition, in the various embodiments described above, the explanation is given by taking the aspect of inserting the hand into the printer 151 and printing directly on the fingernail, but other aspects are acceptable. For example, the present invention of the various embodiments described above can be applied to the case of printing by using a printer that prints an object attached to a fingernail (such as a seal, etc.).

[0101] Furthermore, in the various embodiments described above, the imaging unit 157 is included in the printer 151, but imaging may be performed by, for example, installing a camera-attached device (such as a smartphone) on the top of the printer 151. In this case, when the fingernail recognition button 903 is pressed, an instruction to perform imaging is given by communicating with the camera-attached device, and the information processing device 101 acquires a captured image and displays the captured image in the captured image display area 902. As long as the information processing device can acquire an image by performing communication, any device may be employed, and the device may be a camera in addition to a camera-attached device (such as a smartphone).

[0102] Other embodiments

[0103] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0104] According to an embodiment of the present invention, user operability can be improved.

[0105] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments.The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. A non-transitory computer-readable storage medium storing a program for causing a computer to execute: a display control step for causing a display unit to display a graphical user interface having a first area for specifying one content image from a plurality of content images constituting a content image group, a second area for specifying one content image group from a plurality of content image groups, a third area for specifying an individual reflection object reflecting the content image, and a fourth area for specifying one reflection object group including the plurality of individual reflection objects; and a reflection step for reflecting the content image corresponding to the first area in the reflection object corresponding to the third area when the user specifies the first area and the third area, and for reflecting each of the plurality of content images constituting the content image group corresponding to the second area in each of the plurality of individual reflection objects constituting the reflection object group corresponding to the fourth area based on correspondence information indicating the correspondence between each of the plurality of content images and each of the plurality of individual reflection objects when the user specifies the second area and the fourth area, in, The content image is a nail image, The individual reflects that the object is the fingernail area, and The reflection object group is a hand area or a foot area.

2. The storage medium according to claim 1, wherein: When the first area is designated after the fourth area is designated, the content image corresponding to the first area is reflected in the reflection object corresponding to the designated content image in the reflection object group according to the correspondence relationship information.

3. The storage medium according to claim 1, wherein: In a case where the third area is designated after the second area is designated, the content image corresponding to the third area in the content image group corresponding to the second area is reflected in the reflection object in the designated third area.

4. The storage medium according to claim 1, wherein: When a reflection target group is specified in the fourth area after a content image is specified in the first area, the specified content image is reflected in individual reflection targets that are included in the specified reflection target group and correspond to the content image.

5. The storage medium according to claim 1, wherein: When a content image is specified in the first area after an individual reflection target is specified in the third area, the specified content image is reflected in the specified individual reflection target.

6. The storage medium according to claim 1, wherein: When a content image group is specified in the second area after an individual reflection object is specified in the third area, each of the multiple content images included in the specified content image group is reflected in an individual reflection object included in the reflection object group including the specified individual reflection object and corresponding to the each content image.

7. The storage medium according to claim 1, further configured to cause the computer to execute an instruction step for giving an instruction for photographing a print object based on a user operation after the reflection processing of the reflection step is completed.

8. The storage medium according to claim 7, wherein: In the display control step, the display unit is caused to display a layout result based on the reflection result of the reflection step and an image obtained by photographing the print object.

9. A computer control method comprising: a display control step for causing a display unit to display a graphical user interface having a first area for specifying one content image from a plurality of content images constituting a content image group, a second area for specifying one content image group from a plurality of content image groups, a third area for specifying an individual reflection object reflecting the content image, and a fourth area for specifying one reflection object group including the plurality of individual reflection objects; as well as a reflection step for reflecting the content image corresponding to the first area in the reflection object corresponding to the third area when the user specifies the first area and the third area, and for reflecting each of the plurality of content images constituting the content image group corresponding to the second area in each of the plurality of individual reflection objects constituting the reflection object group corresponding to the fourth area based on correspondence information indicating the correspondence between each of the plurality of content images and each of the plurality of individual reflection objects when the user specifies the second area and the fourth area, Wherein, the content image is a nail image, The individual reflects that the object is the fingernail area, and The reflection object group is a hand area or a foot area.

10. An information processing device, comprising: a display control unit configured to cause the display unit to display a graphical user interface having a first area for specifying one content image from a plurality of content images constituting a content image group, a second area for specifying one content image group from the plurality of content image groups, a third area for specifying an individual reflection object reflecting the content image, and a fourth area for specifying one reflection object group including the plurality of individual reflection objects; as well as a reflection unit configured to, when a user specifies the first area and the third area, reflect the content image corresponding to the first area in the reflection object corresponding to the third area, and, when a user specifies the second area and the fourth area, reflect each of the plurality of content images constituting a content image group corresponding to the second area in each of the plurality of individual reflection objects constituting a reflection object group corresponding to the fourth area based on correspondence information indicating a correspondence between each of the plurality of content images and each of the plurality of individual reflection objects, Wherein, the content image is a nail image, The individual reflects that the object is the fingernail area, and The reflection object group is a hand area or a foot area.

11. The information processing device according to claim 10, wherein: When the first area is designated after the fourth area is designated, the content image corresponding to the first area is reflected in the reflection object corresponding to the designated content image in the reflection object group according to the correspondence relationship information.

12. The information processing device according to claim 10, wherein: In a case where the third area is designated after the second area is designated, the content image corresponding to the third area in the content image group corresponding to the second area is reflected in the reflection object in the designated third area.

13. The information processing device according to claim 10, wherein: When a reflection target group is specified in the fourth area after a content image is specified in the first area, the specified content image is reflected in individual reflection targets that are included in the specified reflection target group and correspond to the content image.

14. The information processing device according to claim 10, wherein: When a content image is specified in the first area after an individual reflection target is specified in the third area, the specified content image is reflected in the specified individual reflection target.

15. The information processing device according to claim 10, wherein: When a content image group is specified in the second area after an individual reflection object is specified in the third area, each of the multiple content images included in the specified content image group is reflected in an individual reflection object included in the reflection object group including the specified individual reflection object and corresponding to the each content image. 16 . The information processing apparatus according to claim 10 , further comprising an instruction unit configured to give an instruction to photograph a print object based on a user operation after a reflection process by the reflection unit is completed.

17. The information processing device according to claim 16, wherein: The display control unit is further configured to cause the display unit to display a layout result based on the reflection result of the reflection unit and an image obtained by photographing the print object.

Images