Rename Processing Device and Print Product Sales System

Abstract

To efficiently and accurately perform rename processing on a file name of an image file.SOLUTION: A rename processing apparatus comprises a registration unit which stores master information on facial images and names in a storage unit, a reception unit which receives a photographic image having a first file name, an image analysis unit which obtains similarity degrees between a facial image in the photographic image and the facial images in the master information, and a rename processing unit which changes the file name of the photographic image. The rename processing unit displays the facial images in the master information on an operator terminal in order of similarity degree, uses a name selected by the operator terminal and corresponding to the facial image to generate a second file name, and changes the file name of the photographic image. If a personal name included in a third file name inputted by the operator terminal is registered with the master information, the rename processing unit corrects the file name of the photographic image to the third file name.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a renaming processing device and a print sales system.

Background Art

[0002] In baseball stadiums, soccer stadiums, etc., photos (bromides) related to players are sold. For example, a PC and a printer are installed in the sales space, and a staff member operates the PC to download an image from a server to the PC, and then prints the image on paper with the printer to produce and sell the photo.

[0003] A large number of images are stored in the server. In order to improve the searchability when searching for an image to be printed, it is preferable to use a person's name (e.g., a player's name) etc. in the file name of the image. For an image taken of a player with a digital camera, a file name composed of alphanumeric characters is automatically assigned by the digital camera. Conventionally, since an operator visually confirmed the image and manually changed it after thinking of an appropriate file name, the renaming work took time.

[0004] Recently, a service has been provided in which a photo taken by a professional cameraman during a game is printed and sold on the same day. When providing such a service, it is required to quickly perform the renaming work of the file name of the image file. However, when the name of the player shown in the image is unknown, it is necessary to search for the name from a player list such as a roster, which is a time-consuming problem. Also, when entering the file name, there has been a case where the name of another player is accidentally entered or a character is mis-converted.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] The present invention has been made in view of the above-described conventional situation, and an object thereof is to provide a renaming processing apparatus and a print sales system that can efficiently and accurately perform renaming processing of the file name of an image file.

Means for Solving the Problems

[0007] The renaming processing apparatus according to the present invention includes a registration unit that receives registration of face images and names of a plurality of persons and stores them in a storage unit as master information, a reception unit that receives a captured image of a first file name, and analyzes the captured image. An image analysis unit that extracts a face image of a person shown in the captured image and obtains a similarity between the extracted face image and the face image in the master information, and a renaming processing unit that changes the file name of the captured image. The renaming processing unit arranges the face images in the master information in order of similarity and displays them on an operator terminal, generates a second file name using the name corresponding to the face image selected by the operator terminal, and changes the file name of the captured image from the first file name to the second file name. When correcting the changed file name of the captured image, the third file name input by the operator terminal is compared with the master information. If the person's name included in the third file name is registered in the master information, the file name of the captured image is corrected from the second file name to the third file name.

[0008] The print sales system according to the present invention includes the above-described renaming processing apparatus and a printer control apparatus that receives image data of a captured image of the second file name from the renaming processing apparatus and transfers the image data to a printer for print output.

Effects of the Invention

[0009] According to the present invention, renaming processing of the file name of an image file can be efficiently and accurately performed.

Brief Description of Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Modes for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0012] FIG. 1 is a schematic configuration diagram of a print sales system according to an embodiment of the present invention. The print sales system is a system for selling prints such as photos at event venues such as sports facilities and concert halls. It includes a management device 5 for managing sales images, an operator terminal 7 used by an operator for renaming and processing images, a printer 4 for printing and outputting prints (photos), a printer control device 3 for controlling the printer 4, an image printing device 2 for automatically printing and outputting prints (photos) when an image is selected from a customer and a fee is inserted, and the like. In the following embodiments, the case of selling photos of players during a sports game will be described.

[0013] Photos of players during a sports game are taken by the camera 6 of a professional cameraman. The images taken by the camera 6 are uploaded to the management device 5 and are set to be sold on the same day.

[0014] The file name (first file name) of the captured image uploaded to the management device 5 is automatically assigned by the camera 6. The file name of the captured image is composed of alphanumeric characters such as "IMG5531.jpg" or "P5050012.jpg", and it is impossible to tell what kind of image it is from the file name.

[0015] In the management device 5, the face images and names (full names) of the players are registered in advance as master information. The management device 5 performs image analysis on the captured image, extracts the face image shown in the captured image, compares the extracted face image with the pre-registered face images, and obtains the similarity. On the operator terminal 7, the pre-registered face images and names are displayed in order of similarity. The operator selects the name of the player shown in the captured image with reference to the similarity displayed on the operator terminal 7. The management device 5 creates a new file name (second file name) using the selected name and changes the file name of the captured image to the new file name.

[0016] For example, when a captured image with the file name "IMG5531.jpg" showing a player, as shown in FIG. 2, is uploaded to the management device 5, the management device 5 performs image analysis on this captured image and extracts the face image of the player. The management device 5 calculates the similarity between the face image extracted from the captured image and the pre-registered face image.

[0017] When the operator selects the extracted face image of the player, on the operator terminal 7, the pre-registered face image and name are displayed in descending order of similarity to the selected face image. The operator selects the name of this player with reference to the similarity. The management device 5 creates a file name such as "01_〇〇 Taro.jpg" using the selected name and changes (renames) the file name of the captured image. The "01" in the file name is a serial number.

[0018] In addition to the person's name, position, scene, etc. may also be included in the file name. For example, if multiple positions are pre-registered and the operator selects the position of the player, it is reflected in the file name. For example, a file name such as "01_〇〇 Taro_Forward.jpg" is created.

[0019] On the operator terminal 7, not only renaming by selecting similar face images as described above, but also direct manual input of the name enables renaming.

[0020] After the renaming operation, the file name of the renamed image may be modified by the same or another operator. When the operator enters the modified file name (the third file name), the management device 5 compares the player name in the entered file name with the master information. If there is no player with the same name in the master information, an error message is displayed. If there is a player with the same name in the master information, the management device 5 compares the face image of this player in the master information with the face image in the image whose file name is being modified. If the similarity is low (less than a predetermined value), an error message is displayed. This can prevent incorrect input when modifying the file name.

[0021] The printer control device 3 and the printer 4 are installed in the photo sales space of the event venue. The staff operates the printer control device 3 to download the images to be sold from the management device 5. Since the captured images stored in the management device 5 are renamed, for example, the images can be filtered and downloaded by searching by the name of the athlete.

[0022] The image data is transferred from the printer control device 3 to the printer 4 for print output. The staff sells the photos printed out from the printer 4 to the customers.

[0023] The management device 5 sends the captured images after the renaming process to the image printing device 2. For example, the customer inputs the name of the athlete whose photo they want to purchase into the image printing device 2 for searching. The image printing device 2 displays a thumbnail list screen of the image files including the athlete name input by the customer in the file name.

[0024] When the customer selects the image they wish to purchase, the image printing device 2 performs a charging process, accepts the currency paid by the customer, and dispenses change. After that, the selected image is printed out from the printer housed in the image printing device 2. The image printing device 2 can function as a photo vending machine.

[0025] Thus, according to this embodiment, the management device 5 performs image analysis of the captured images and obtains the similarity between the faces shown in the captured images and the pre-registered face images. On the operator terminal 7, the pre-registered face images and names are displayed in the order of similarity. The operator only needs to select the name of the pre-registered face image with a high similarity when renaming the image file name. Therefore, the renaming process of the image file name can be performed efficiently and accurately.

[0026] Also, when modifying the file name of the renamed image, compare the player name and master information in the modified file name to check if there is a player with the same name or if the face of a player with the same name is similar. If there is a problem, an error message is displayed, thus preventing incorrect input when modifying the file name.

[0027] Next, a management device 5 having a function as a rename processing device will be described. As shown in FIG. 3, the management device 5 is a computer having a storage unit 50 including a ROM (Read Only Memory), a RAM (Random Access Memory), a non-volatile memory, a hard disk device, etc. The storage unit 50 stores a rename program, master information, photographed image data, renamed images, etc. The master information is, for example, what associates the face image of a sports player with the player name. Also, not only the player name but also the player number may be associated.

[0028] When the CPU (Central Processing Unit) of the management device 5 executes the rename program, as shown in FIG. 3, the functions of the registration unit 51, the photographed image reception unit 52, the rename processing unit 53, the image analysis unit 54, and the image transmission unit 55 are realized.

[0029] The registration unit 51 receives the pre-registration of the face image and name of the player via the operator terminal 7. For example, the registration unit 51 transmits a registration screen as shown in FIG. 4 to the operator terminal 7. The registration screen is provided with an image addition button 11, a name input area 12, a player number input area 13, a registration button 14, etc. When the operator operates the operator terminal 7 and presses the image addition button 11, the images in the terminal can be selected. When the operator selects an image to register, the image is displayed in the image display area 10. The addition of the image may also be by drag and drop. At least one face image of one player is registered.

[0030] Enter the name of the player in the name input field 12 and enter the player's jersey number in the jersey number input field 13. When the registration button 14 is pressed, the pre-registered face image including the face image and the player name (and further the jersey number) is stored in the storage unit 50 as master information. Such pre-registration of master information is performed for all players.

[0031] The photographed image receiving unit 52 receives the photographed image data from the camera 6 and stores it in the storage unit 50.

[0032] FIG. 5 is a flowchart for explaining the flow of the rename process. The functions of the rename processing unit 53 and the image analysis unit 54 will be described along the flowchart shown in FIG. 5.

[0033] The rename processing unit 53 creates a rename processing screen and transmits it to the operator terminal 7. An example of the rename processing screen is shown in FIG. 6. For example, the file name of the photographed image for which the rename is to be performed is displayed in the image file list 100 of the rename processing screen.

[0034] The operator selects the image file to be renamed (step S1). As shown in FIG. 7, the selected image is displayed in the image display area 102. The image analysis unit 54 analyzes the selected photographed image and extracts the face image of the player shown in the photographed image (step S2). The extracted face images are arranged and displayed in the extracted image display area 104 (step S3). In the example shown in FIG. 7, since only one player is shown, one face image G1 is extracted from the photographed image and displayed in the extracted image display area 104.

[0035] The image analysis unit 54 calculates the similarity between the pre-registered face image and the face image extracted from the photographed image. The calculation of the similarity may be performed by a computer different from the management device 5. In that case, the image analysis unit 54 obtains the similarity calculation result from the different computer. The face image extracted from the photographed image has its similarity calculated for all the pre-registered face images. For example, when the face images of 100 players are pre-registered, for the face image G1, the similarity to the pre-registered face images of 100 players is calculated.

[0036] The operator operates the operator terminal 7 and selects a face image for which the name of the person is to be identified (step S4). For example, as shown in FIG. 8, the face image G1 is selected. The renaming processing unit 53 displays the pre-registered face images and names in the pre-registered image display area 106 in descending order of the similarity to the selected face image G1 (step S5). At this time, the similarity is also displayed.

[0037] The operator selects the person in the face image G1 as shown in FIG. 9 with reference to the similarity (step S6). Since the operator can check in order from the person with the highest similarity, it is easy to identify the person.

[0038] The renaming processing unit 53 generates a file name including the name of the selected person and displays it in the completed file name display area 120 (step S7). The operator can select whether to add a serial number to the file name using the serial number addition button 116, and if so, whether to add it at the beginning or the end of the file name. FIG. 9 shows the case where the serial number is added at the beginning of the file name.

[0039] When frequently used words such as positions and scenes are pre-registered, they are displayed in the registered word display areas 108 and 112. When the operator selects a word to be used as the file name, the selected word is displayed in the selected word display areas 110 and 114 and reflected in the file name.

[0040] For example, in the example shown in FIG. 9, when the word "forward" in the registered word display area 108 is further selected, a file name such as "01_〇〇 Taro_forward.jpg" is generated.

[0041] When the clear button 124 is pressed, the file name is erased and a new file name can be generated.

[0042] By the processing history addition button 130, a processing history indicating whether the image has already been processed or not processed yet on the operator terminal 7 can be added to this image. The processing is performed for image sales, and for example, it is changing the image size, compositing the team logo, etc.

[0043] When the operator presses the registration button 122, the rename processing unit 53 stores the image data (renamed image) with the file name changed in the storage unit 50 (step S8). At this time, it may be stored in association with the original captured image data before renaming.

[0044] For example, when one captured image data is processed to generate a plurality of images with different image sizes and each of these plurality of images is renamed, the plurality of images after renaming are associated with each other as being related. Then, based on the processing history added to each image, it becomes possible to easily classify and handle the images that have been renamed but not processed, and the images that have been renamed and processed and are available for sale.

[0045] Next, the correction process of the file name of the renamed image will be described according to the flowchart shown in FIG. 10.

[0046] The operator operates the operator terminal 7 to select the image to be corrected (step S11). The rename processing unit 53 creates a file name correction screen as shown in FIG. 11 and transmits it to the operator terminal 7.

[0047] The operator inputs the corrected file name on the file name correction screen and presses the change button 140 (step S12).

[0048] The rename processing unit 53 extracts the player name (person name) from the input file name and compares it with the master information (step S13). If the extracted player name is not in the master information (step S14_No), an error message is displayed (step S16).

[0049] For example, when you want to change the file name "08_Saburo Yamada.jpg" to "08_Taro Yamada.jpg" but accidentally enter "08_Tarou Yamada.jpg" and there is no athlete named Tarou Yamada, an error message as shown in Fig. 12 will be displayed.

[0050] If the extracted athlete name exists in the master information (step S14_Yes), the image analysis unit 54 calculates the similarity between the face image in the image to be renamed and the face image in the master information corresponding to this athlete name. If the similarity is less than the predetermined value and the faces are not similar (step S15_No), an error message is displayed (step S16).

[0051] For example, when you want to change the file name "08_Saburo Yamada.jpg" to "08_Taro Yamada.jpg" but accidentally enter "08_Jiro Yamada.jpg" and there is an athlete named Jiro Yamada, the image analysis unit 54 will display an error message as shown in Fig. 13.

[0052] If the similarity is greater than or equal to the predetermined value and the faces are similar (step S15_Yes), the renamed file name is newly registered.

[0053] The operator checks the error message and enters the correct file name. This can prevent incorrect input when renaming the file.

[0054] In Figs. 7 to 9, the renaming process for an image showing only one athlete was described. An example of the renaming process for an image showing multiple athletes will be described with reference to Figs. 14 and 15.

[0055] For example, as shown in FIG. 14, when two players are shown in the captured image to be renamed, two face images G1 and G2 are displayed in the extracted image display area 104. When the operator selects the face image G1, the pre-registered face images and names are displayed in the pre-registered image display area 106 in descending order of similarity to the face image G1. When the operator selects the person corresponding to the face image G1, a file name including the name of the selected person is generated. For example, a file name such as "01_〇〇 Taro.jpg" is generated.

[0056] Next, as shown in FIG. 15, when the operator selects the face image G2, the pre-registered face images and names are displayed in the pre-registered image display area 106 in descending order of similarity to the face image G2. When the operator selects the person corresponding to the face image G2, the name of that person is reflected in the file name. For example, the name of the person "△△ Daisuke" selected this time is appended to the file name "01_〇〇 Taro.jpg" to form a file name "01_〇〇 Taro_△△ Daisuke.jpg".

[0057] In this way, when multiple players are shown in the captured image, the operator selects names one by one in order. A new file name using the names of multiple players is created.

[0058] In the above embodiment, when displaying the pre-registered face images in the pre-registered image display area 106, for pre-registered face images with a similarity below a predetermined threshold, the similarity may be displayed as 0%. This allows images with low similarity to be excluded from consideration as candidates.

[0059] The image analysis unit 54 may perform scene analysis of the captured image and change the threshold for setting the similarity to 0% according to the scene. In a high-five scene or a baseball batting scene, the face may be hidden, and even if it is a face image of the person, the similarity may be calculated low. For example, usually the threshold is set to 75%, and when it is determined by scene analysis that it is a high-five or batting scene, the threshold is changed to 30%. This makes it easier to search for the names of the players.

[0060] Of the plurality of people shown in the captured image, the blurred face images may not be extracted.

[0061] When a plurality of face images are pre-registered for one player, the average value of the similarity of each face image may be calculated, and the pre-registered face image with the similarity closest to the calculated average value may be displayed in the pre-registered image display area 106, or the pre-registered face image with the highest similarity among the plurality of face images may be displayed in the pre-registered image display area 106.

[0062] The back number in the captured image may be read by OCR (Optical Character Recognition), and the player name may be specified by referring to the back number list stored in the storage unit 50.

[0063] In the above embodiment, when modifying the file name of the renamed image, it was confirmed whether the person name included in the new file name was included in the master information and whether the face image in the master information corresponding to this person name was similar to the face image in the image to be modified, but it may be configured to confirm only whether the person name included in the new file name is included in the master information.

[0064] The above-described rename program may be stored in a recording medium, read by a computer, and executed. The recording medium is not limited to removable ones such as magnetic disks and optical disks, and may also be a fixed recording medium such as a hard disk device or a memory. Further, the rename program may be distributed via a communication line (including wireless communication) such as the Internet. Furthermore, the program may be encrypted, modulated, compressed, and distributed via a wired or wireless line such as the Internet or stored in a recording medium.

[0065] The present invention is not limited to the above-described embodiments as they are, and at the implementation stage, the components can be modified and embodied without departing from the gist thereof. Also, various inventions can be formed by appropriately combining a plurality of components disclosed in the above-described embodiments. For example, some components may be deleted from all the components shown in the embodiments. Furthermore, components from different embodiments may be appropriately combined.

Explanation of Signs

[0066] 2 Image printing device 3 Printer control device 4 Printer 5 Management device (renaming processing device) 6 Camera 7 Operator terminal 50 Storage unit 51 Registration unit 52 Captured image reception unit 53 Renaming processing unit 54 Image analysis unit 55 Image transmission unit

Claims

1. A registration unit that accepts registration of face images and names of a plurality of persons and stores them in a storage unit as master information; A receiving unit that receives a captured image with a first file name; An image analysis unit that analyzes the captured image, extracts a face image of a person shown in the captured image, and obtains a similarity between the extracted face image and the face images in the master information; A rename processing unit that changes the file name of the captured image; Comprising: The rename processing unit: Arranges the face images in the master information in order of similarity and displays them on an operator terminal, generates a second file name using the name corresponding to the face image selected by the operator terminal, and changes the file name of the captured image from the first file name to the second file name; When correcting the file name of the captured image after the change, compare the third file name input by the operator terminal with the master information, and if the person name included in the third file name is registered in the master information, correct the file name of the captured image from the second file name to the third file name. A rename processing device.

2. The rename processing unit according to claim 1, wherein when the person name included in the third file name is not registered in the master information, an error message is displayed on the operator terminal.

3. When the person name included in the third file name is registered in the master information, the image analysis unit calculates the similarity between the face image in the master information corresponding to this person name and the face image in the captured image whose file name is to be corrected, and the rename processing unit, when the calculated similarity is equal to or greater than a predetermined value, corrects the file name of the captured image from the second file name to the third file name, and when the calculated similarity is less than the predetermined value, displays an error message on the operator terminal. The rename processing device according to claim 1 or 2.

4. The rename processing device according to any one of claims 1 to 3, wherein the rename processing unit stores the captured image with the second file name in the storage unit in association with the captured image with the first file name.

5. The rename processing device according to any one of claims 1 to 4; A printer control device that receives the image data of the captured image with the second file name from the rename processing device, transfers the image data to a printer, and causes the printer to perform a print output. A print sales system comprising

Images