Image processing device, image processing method, and image processing system

Abstract

To address the issue where it is difficult for an image processing device to select an image when the desired image is not included among a plurality of images.SOLUTION: An image processing device comprises an identification information acquisition part to acquire identification information for identifying a person, an image acquisition part to acquire multiple images, a setting part to set the check timing for confirming the images, and a control part to generate an album. The control part identifies the person included in the image using the identification information, generates person information related to the identified person, compares the person information of the person with setting information at the check timing, and outputs notification information indicating that the setting information is not satisfied when the person information does not satisfy the setting information.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to an image processing device, an image processing method, and an image processing system. [Background technology]

[0002] Image processing devices that create photo albums are known. The image processing device described in Patent Document 1 acquires a plurality of images to be used in a photo album in accordance with a user's instructions. Each of the plurality of images includes a plurality of people. The image processing device analyzes the acquired images. The image processing device detects the people included in the images and counts the number of times the people appear. The image processing device lays out the plurality of images in accordance with a user's instructions. The image processing device selects a predetermined image from among the plurality of images based on the number of times the people included in the laid out images appear. By selecting the predetermined image, the image processing device averages the number of times the people appear. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-115305 A Summary of the Invention [Problem to be solved by the invention]

[0004] If the desired image is not included in the multiple images, it is difficult for the image processing device to select an image. [Means for solving the problem]

[0005] The image processing device disclosed herein comprises an identification information acquisition unit that acquires identification information that identifies a person, an image acquisition unit that acquires a plurality of images, a setting unit that sets a check timing for checking the images, and a control unit that generates an album, wherein the control unit identifies the person included in the image using the identification information, generates personal information relating to the identified person, compares the personal information of the person with setting information at the check timing, and, if the personal information does not satisfy the setting information, outputs notification information indicating that the setting information is not satisfied.

[0006] The image processing method disclosed herein acquires identification information that identifies a person included in an image and a check timing for checking the image, acquires a plurality of the images, identifies the person included in the image using the identification information, stores personal information relating to the identified person, compares the stored personal information with setting information at the check timing, and if the personal information does not satisfy the setting information, outputs notification information indicating that the setting information is not satisfied.

[0007] The image processing system of the present disclosure includes an image processing device having an identification information acquisition unit that acquires identification information that identifies a person, an image acquisition unit that acquires a plurality of images, a setting unit that sets a check timing for checking the images, and a control unit that generates an album, and an input / output device operated by a user, wherein the control unit identifies the person included in the image using the identification information, stores personal information relating to the identified person, compares the stored personal information with setting information at the check timing, and if the personal information does not satisfy the setting information, outputs notification information to the input / output device indicating that the setting information is not satisfied, and the input / output device inputs the notification information and displays the notification information. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a photo album creating system. [Diagram 2] FIG. 1 is a block diagram showing the configuration of a photo album creating system. [Diagram 3] FIG. 2 is a diagram showing an outline of a captured image. [Figure 4] FIG. 4 is a diagram showing an example of an application screen. [Diagram 5] FIG. 4 is a diagram showing an example of an application screen. [Figure 6] FIG. 4 is a diagram showing an example of an application screen. [Figure 7] FIG. 4 is a diagram showing an example of an application screen. [Figure 8] FIG. 4 is a diagram showing an example of an application screen. [Figure 9] FIG. 4 is a diagram showing an example of an application screen. [Figure 10] FIG. 4 is a diagram showing an example of an application screen. [Figure 11] Diagram showing the control flow that takes place on the server. [Figure 12] Diagram showing the control flow that takes place on the server. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] FIG. 1 shows a schematic configuration of a photo album creation system 1. The photo album creation system 1 creates various photo albums PA, including kindergarten graduation albums, elementary school graduation albums, and the like. The photo album PA corresponds to an example of an album. The photo album creation system 1 includes a server 10, a personal computer 100, a digital camera 200, a smartphone 300, and a printer 400. The server 10, the personal computer 100, the digital camera 200, the smartphone 300, and the printer 400 are connected to each other so as to be able to communicate with each other via a communication network NW. The photo album creation system 1 corresponds to an example of an image processing system.

[0010] The server 10 generates a photo album PA in the form of electronic data. The server 10 generates the photo album PA in a format such as PDF (Portable Document Format) or JPEG (Joint Photographic Experts Group). The server 10 acquires imaging data PD from a digital camera 200 or the like. The server 10 generates the photo album PA using the imaging data PD. The server 10 corresponds to an example of an image processing device. The imaging data PD corresponds to an example of an image.

[0011] The server 10 shown in Fig. 1 is configured as one server device, but is not limited to this. The server 10 may be configured as multiple server devices. The multiple server devices are connected to each other via a communication network NW. The server 10 may be configured as a virtualized cloud server.

[0012] The personal computer 100 is used by the creator of the photo album PA. The creator uses the personal computer 100 to perform various registration processes, confirmation processes, correction processes, etc. The personal computer 100 transmits various data entered by the creator to the server 10. The personal computer 100 outputs various data generated by the server 10. The personal computer 100 outputs various data using the display unit 120, a speaker (not shown), etc. The creator corresponds to an example of a user. The personal computer 100 corresponds to an example of an input / output device.

[0013] 1 shows a notebook computer as the personal computer 100, but is not limited to this. The personal computer 100 may be configured as a desktop computer or a tablet computer. The configuration of the personal computer 100 is not limited as long as it is capable of inputting and outputting various data.

[0014] The digital camera 200 captures an image of a subject or the like and generates imaging data PD. The digital camera 200 shown in FIG. 1 transmits the imaging data PD to the server 10 via a communication network NW. The digital camera 200 may transmit the imaging data PD to the personal computer 100 via a memory card or a communication cable. The personal computer 100 receives and stores the imaging data PD. The personal computer 100 transmits the imaging data PD to the server 10 via the communication network NW. The photo album creation system 1 shown in FIG. 1 includes one digital camera 200, but is not limited to this. The photo album creation system 1 may include multiple digital cameras 200.

[0015] The smartphone 300 captures an image of a subject or the like and generates imaging data PD. The smartphone 300 transmits the imaging data PD to the server 10 via the communication network NW. The photo album creation system 1 shown in FIG. 1 includes the smartphone 300, but is not limited to this. The photo album creation system 1 does not necessarily have to include the smartphone 300. The photo album creation system 1 may include a plurality of smartphones 300.

[0016] The printer 400 prints the photo album PA generated in the form of electronic data. The printer 400 receives print data for printing the photo album PA from the server 10 via the communication network NW. The printer 400 prints the photo album PA using the print data. The printer 400 is configured as an inkjet printer or an electrophotographic printer. The printer 400 may have a print processing device with a bookbinding function. The printer 400 shown in FIG. 1 is connected to the server 10 via the communication network NW, but is not limited to this. The printer 400 may be connected to the server 10 or the personal computer 100 via a connection cable.

[0017] Fig. 2 shows a block configuration of the photo album creation system 1. Fig. 2 shows a server 10, a personal computer 100, a digital camera 200, and a printer 400. Fig. 2 omits the smartphone 300 shown in Fig. 1.

[0018] The server 10 is communicatively connected to a personal computer 100, a digital camera 200, and a printer 400 via a communication network NW. The server 10 includes a server communication unit 20, a server control unit 30, and a server storage unit 50.

[0019] The server communication unit 20 is an interface circuit that connects and communicates with the personal computer 100 and the like via the communication network NW. The server communication unit 20 connects to the personal computer 100 and the like via a wired or wireless connection in accordance with a predetermined communication protocol. The server communication unit 20 includes a wired connector, a wireless communication port, and the like. The wired connector is a Universal Serial Bus (USB) connector, a Local Area Network (LAN) connector, and the like. The wireless communication port is a Wi-Fi communication port, a Bluetooth communication port, and the like. Wi-Fi and Bluetooth are registered trademarks. The server communication unit 20 receives imaging data PD and the like from the personal computer 100, the digital camera 200, and the like. The server communication unit 20 transmits various display data, print data, and the like to the personal computer 100 and the like.

[0020] The server control unit 30 is a controller that controls the server 10. As an example, the server control unit 30 is a processor having a CPU (Central Processing Unit). The server control unit 30 is composed of one or more processors. The server control unit 30 may have a semiconductor memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The semiconductor memory functions as a work area of ​​the server control unit 30. The server control unit 30 operates as various functional units by executing a control program (not shown). The control program is stored in advance in the server storage unit 50. The server control unit 30 functions as an identification data generation unit 31, a clock unit 33, an execution unit 35, and a display control unit 37 by executing the control program. The server control unit 30 may operate as a functional unit other than the identification data generation unit 31, the clock unit 33, the execution unit 35, and the display control unit 37.

[0021] The identification data generating unit 31 acquires the identification data MD. The identification data MD is used when identifying a subject corresponding to the subject image HG included in the imaging data PD. The identification data generating unit 31 generates and acquires the identification data MD. If the photo album PA is, for example, an elementary school graduation album, the subject is a child enrolled in the elementary school. The subject corresponds to an example of a person. The identification data generating unit 31 acquires subject data HD related to a subject registered in the personal computer 100. The identification data generating unit 31 acquires one or more subject data HD. Details of the registration of the subject data HD by the creator will be described later. The subject data HD includes a registered image RG. The registered image RG is a face photo of the subject and a full-body photo of the subject. The registered image RG corresponds to an example of a person image. The identification data MD corresponds to an example of identification information. The identification data generating unit 31 corresponds to an example of an identification information acquiring unit.

[0022] The identification data generating unit 31 generates identification data MD using the registered image RG. The identification data MD is composed of model data such as three-dimensional face information and skin information used for face authentication, for example. The model data corresponds to an example of model information. The identification data generating unit 31 generates identification data MD for each of the multiple registered images RG. The form of the identification data MD is not limited as long as it can distinguish and identify each subject. The identification data generating unit 31 transmits the identification data MD to the server storage unit 50.

[0023] The subject data HD includes a registered image RG relating to the subject. It is preferable that the identification data generating unit 31 generates the model data using the registered image RG. The identification data generating unit 31 generates model data, thereby enabling the subject to be identified with high accuracy.

[0024] The identification data generating unit 31 may generate the identification data MD using a plurality of pieces of imaging data PD transmitted from the digital camera 200 or the like. The plurality of pieces of imaging data PD transmitted from the digital camera 200 or the like are stored in the server storage unit 50. The identification data generating unit 31 reads out the imaging data PD from the server storage unit 50 and generates the identification data MD. The identification data generating unit 31 generates the identification data MD by performing machine learning such as deep learning. The identification data generating unit 31 analyzes the imaging data PD. The identification data generating unit 31 extracts a subject that does not correspond to the identification data MD stored in advance. The identification data generating unit 31 determines that the extracted subject is an unregistered subject. The identification data generating unit 31 newly generates identification data MD related to the unregistered subject.

[0025] The identification data generating unit 31 may update the identification data MD using a plurality of pieces of imaging data PD transmitted from the digital camera 200 or the like. The identification data generating unit 31 updates the identification data MD by performing machine learning such as deep learning. The identification data generating unit 31 analyzes the imaging data PD. The identification data generating unit 31 analyzes changes in the subject related to the identification data MD stored in advance. The identification data generating unit 31 updates the identification data MD in response to the changes in the subject.

[0026] It is preferable that the identification data generating unit 31 uses the imaging data PD acquired by the server storage unit 50 to generate the identification data MD. The identification data generating unit 31 can distinguish an unregistered subject and generate identification data MD relating to the unregistered subject.

[0027] The timekeeping unit 33 determines whether the event date and time or the intermediate check date has passed. The event data ED indicating the event date and time and the intermediate check date is registered in advance by the creator. Details of the registration of the event data ED will be described later. The timekeeping unit 33 acquires the event data ED. The timekeeping unit 33 sets one or more check timings using the event data ED. The check timing is the end time of the event or a time when a predetermined time has passed since the end time of the event. The check timing is a predetermined time within the intermediate check date or a predetermined date and time after the intermediate check date. The check timing is a timing at which the creator checks the captured image PG or the photo album PA. The timekeeping unit 33 generates schedule data SD including one or more check timings. The timekeeping unit 33 generates the schedule data SD based on a preset condition. The timekeeping unit 33 measures the date and time. When the timekeeping unit 33 determines that the check timing included in the schedule data SD has been reached, it transmits an arrival signal to the execution unit 35, the display control unit 37, etc. The arrival signal is a signal indicating that the check timing has passed. The timer unit 33 corresponds to an example of a setting unit.

[0028] The execution unit 35 generates a photo album PA. The execution unit 35 may generate an event album PA1 that constitutes a part of the photo album PA. The execution unit 35 generates the photo album PA by using the imaging data PD stored in the server storage unit 50. The execution unit 35 generates the photo album PA by selecting and editing the imaging data PD based on preset creation conditions. The creation conditions are the number of captured images PG included in the photo album PA, the number of captured images PG for each subject, the layout of the captured images PG, and the like. The execution unit 35 may generate and edit the photo album PA based on an instruction from the creator. The execution unit 35 corresponds to an example of a control unit. The event album PA1 corresponds to an example of a partial album.

[0029] The execution unit 35 may create a plurality of event albums PA1 as creation samples of the event album PA1. The plurality of event albums PA1 include a first event album PA1A and a second event album PA1B. The first event album PA1A corresponds to an example of a first candidate. The second event album PA1B corresponds to an example of a second candidate. When the execution unit 35 creates the plurality of event albums PA1, it outputs the plurality of event albums PA1 to the personal computer 100. The personal computer 100 displays the plurality of event albums PA1. The creator can check and compare the plurality of event albums PA1. The creator can select a preferred event album PA1 from the plurality of event albums PA1.

[0030] It is preferable that the execution section 35 generates a first event album PA1A and a second event album PA1B as the event album PA1, and outputs the first event album PA1A and the second event album PA1B. The creator can select a preferred event album PA1 from among a plurality of event albums PA1.

[0031] The execution unit 35 uses the identification data MD to identify a subject included in the imaging data PD indicating the captured image PG. The execution unit 35 acquires the identification data MD generated by the identification data generation unit 31. The execution unit 35 uses the identification data MD to identify a subject included in the imaging data PD. The execution unit 35 may analyze the position of the identified subject, the imaging area of ​​the subject in the imaging data PD, the posture, etc. When one imaging data PD includes multiple subjects, the execution unit 35 identifies each subject. The execution unit 35 may analyze the imaging area, posture, etc. for each subject.

[0032] FIG. 3 shows an outline of a captured image PG. FIG. 3 shows a first captured image PG1, which is an example of the captured image PG. The captured image PG including the first captured image PG1 is captured by the digital camera 200, the smartphone 300, etc. The digital camera 200, the smartphone 300, etc. generate imaging data PD indicating the captured image PG. The digital camera 200, the smartphone 300, etc. transmit the imaging data PD to the server 10. The execution unit 35 of the server 10 acquires the imaging data PD. FIG. 3 shows a first captured image PG1 including three subjects as an example.

[0033] The execution unit 35 identifies a subject image HG included in the imaging data PD related to the first captured image PG1. The imaging data PD related to the first captured image PG1 shown in Fig. 3 includes a first subject image HG1, a second subject image HG2, and a third subject image HG3 as the subject images HG. The execution unit 35 identifies the first subject image HG1, the second subject image HG2, and the third subject image HG3.

[0034] After identifying the subject images HG, the execution unit 35 extracts the face image area FR of each subject image HG. The execution unit 35 extracts a first face image area FR1, a second face image area FR2, and a third face image area FR3 from the imaging data PD. The first face image area FR1 is an area including the face image of the first subject image HG1. The second face image area FR2 is an area including the face image of the second subject image HG2. The third face image area FR3 is an area including the face image of the third subject image HG3.

[0035] The execution unit 35 reads out the identification data MD from the server storage unit 50. The execution unit 35 performs face authentication on the face image included in the face image area FR using the identification data MD. The execution unit 35 identifies each subject image HG by performing face authentication. The execution unit 35 performs face authentication on the face images included in each of the first face image area FR1, the second face image area FR2, and the third face image area FR3. The execution unit 35 identifies subjects corresponding to each of the first subject image HG1, the second subject image HG2, and the third subject image HG3 by performing face authentication on each face image in the face image area FR. The execution unit 35 generates identification information that identifies the subject for the imaging data PD.

[0036] The execution unit 35 shown in FIG. 2 identifies the subject included in the imaging data PD for each of the multiple imaging data PD stored in the server storage unit 50, and generates identification information. The execution unit 35 may analyze the imaging area of ​​the subject included in the imaging data PD for each of the multiple imaging data PD stored in the server storage unit 50, and generate analysis information. When the server storage unit 50 classifies and stores the multiple imaging data PD into folders, the execution unit 35 may identify the subject included in the imaging data PD stored in each folder. When the event album PA1 is created, the execution unit 35 may identify the subject for the imaging data PD included in the event album PA1, and generate identification information. When the event album PA1 is created, the execution unit 35 may generate analysis information by analyzing the imaging area of ​​the subject for the imaging data PD included in the event album PA1.

[0037] The execution unit 35 generates the analysis data AD using the identification information. The analysis data AD includes the number of imaging data PD including the subject, etc. The execution unit 35 may generate the analysis data AD using analysis information obtained by analyzing the imaging data PD. The analysis information includes the imaging area, imaging position, etc. of the subject. The analysis data AD includes an average imaging area which is the average value of the imaging area analyzed for each imaging data PD, an average imaging position which is the average value of the imaging position analyzed for each imaging data PD, etc. The analysis data AD includes data corresponding to each of the multiple subjects. The analysis data AD corresponds to an example of person information. The execution unit 35 transmits the analysis data AD to the server storage unit 50. The server storage unit 50 stores the analysis data AD.

[0038] When the execution unit 35 generates the event album PA1, the analysis data AD is generated by analyzing the imaging data PD included in the event album PA1. The analysis data AD includes the number of imaging data PD of each subject, etc. The execution unit 35 may generate the analysis data AD based on the analysis information of the imaging data PD included in the event album PA1.

[0039] When generating a plurality of event albums PA1, the execution unit 35 preferably generates analysis data AD for each event album PA1. The execution unit 35 stores the analysis data AD in the server storage unit 50 in association with each of the plurality of event albums PA1.

[0040] The execution unit 35 acquires the imaging data PD at a predetermined timing, and generates analysis data AD. The execution unit 35 may acquire the imaging data PD when the server communication unit 20 receives the imaging data PD. The execution unit 35 may acquire the imaging data PD from the server storage unit 50 at predetermined time intervals. The execution unit 35 may acquire the imaging data PD from the server storage unit 50 when an arrival signal is received. When the execution unit 35 acquires the imaging data PD, it generates or updates analysis data AD.

[0041] When the execution unit 35 receives the arrival signal, it compares the analysis data AD with the reference data RD. As an example, the execution unit 35 compares the number of imaging data PD including the subject included in the analysis data AD with the reference data RD. The reference data RD may be a preset value or a value generated based on the analysis data AD. When the creator registers the creation conditions for creating the photo album PA in advance, the reference data RD may be included in the creation conditions. As an example, the execution unit 35 calculates an average value obtained by averaging the number of imaging data PD of each of the multiple subjects included in the analysis data AD. The execution unit 35 sets a predetermined numerical range including the average value as the reference data RD. The analysis data AD and the reference data RD are not limited to the number of imaging data PD including the subject. The execution unit 35 may make a comparison using a value calculated from analysis information such as the imaging area and posture of the subject. The execution unit 35 is not limited in form as long as it is possible to evaluate the frequency of the photo album PA for each subject by comparing the analysis data AD with the reference data RD. The reference data RD corresponds to an example of setting information.

[0042] The execution unit 35 compares the analysis data AD with the reference data RD to determine whether the analysis data AD satisfies the reference data RD. When the analysis data AD is within the range of the reference data RD, the execution unit 35 determines that the analysis data AD satisfies the reference data RD. When the analysis data AD is outside the range of the reference data RD, the execution unit 35 determines that the analysis data AD does not satisfy the reference data RD.

[0043] The reference data RD is, for example, a numerical range including an average value obtained by averaging the number of imaging data PD of each of the multiple subjects. The execution unit 35 compares the number of imaging data PD of each of the multiple subjects included in the analysis data AD with the numerical range. The number of imaging data PD corresponds to an example of the number of images. When the number of imaging data PD of one subject among the multiple subjects is smaller than the lower limit of the numerical range, the execution unit 35 determines that the number of imaging data PD of the subject does not satisfy the reference data RD. The lower limit of the numerical range is the lower limit of the number of imaging data PD, and corresponds to an example of a threshold. When the number of imaging data PD of one subject among the multiple subjects is larger than the upper limit of the numerical range, the execution unit 35 may determine that the number of imaging data PD of the subject does not satisfy the reference data RD. The execution unit 35 compares the number of imaging data PD of each of the multiple subjects with a numerical range including the average value. The execution unit 35 determines whether the number of imaging data PD of each of the multiple subjects satisfies the reference data RD.

[0044] The reference data RD may be a frequency range including an average frequency obtained by averaging the frequencies of the multiple subjects. The frequency is, for example, a point value obtained by converting analysis information such as the imaging area and posture of the subject into a point value based on a preset calculation formula. The average frequency is obtained by calculating the average of the point values ​​of the multiple subjects. The execution unit 35 compares the frequency of each of the multiple subjects with the frequency range to determine whether the analysis data AD satisfies the reference data RD.

[0045] When the execution unit 35 determines that the analysis data AD does not satisfy the reference data RD, it outputs warning information to the display control unit 37. The warning information is information indicating that the analysis data AD does not satisfy the reference data RD. The warning information is information that causes the creator to output a predetermined message. The analysis data AD includes subject information indicating the number of imaging data PD related to each of multiple subjects, analysis information, etc. When the execution unit 35 determines that one or more pieces of subject information of the subject information related to multiple subjects does not satisfy the reference data RD, it outputs warning information to the display control unit 37.

[0046] The execution unit 35 may generate and output print data for printing the photo album PA. The execution unit 35 generates print data using the photo album PA in electronic data format. The execution unit 35 outputs the print data to the server communication unit 20. The server communication unit 20 transmits the print data to the printer 400 via the communication network NW. The execution unit 35 transmits the print data to the printer 400, thereby causing the printer 400 to print the photo album PA. The execution unit 35 may also transmit the print data to the personal computer 100.

[0047] The execution unit 35 may generate and output print data for printing the event album PA1. The execution unit 35 generates the print data using the event album PA1 in electronic data format. The execution unit 35 outputs the print data to the server communication unit 20. The server communication unit 20 transmits the print data to the printer 400 via the communication network NW. The execution unit 35 transmits the print data to the printer 400, thereby causing the printer 400 to print the event album PA1.

[0048] The execution section 35 preferably generates and outputs print data for printing the generated photo album PA. The creator can obtain a printed copy of the photo album PA.

[0049] The display control unit 37 generates message data for displaying various messages to the creator operating the personal computer 100. The various messages include a warning message 537 based on the warning information. The display control unit 37 inputs the warning information from the execution unit 35. When the display control unit 37 inputs the warning information, it generates warning message data for displaying the warning message 537. The warning message 537 is a message indicating that the analysis data AD does not satisfy the reference data RD. The display control unit 37 transmits the warning message data to the personal computer 100. The display control unit 37 causes the personal computer 100 to display the warning message 537 by transmitting the warning message data to the personal computer 100. The warning message 537 and the warning message data correspond to an example of notification information.

[0050] The display control unit 37 may generate various display data and transmit it to the personal computer 100. As an example, the display control unit 37 acquires the analysis data AD from the execution unit 35 or the server storage unit 50. The display control unit 37 generates display data using the analysis data AD. The display control unit 37 may generate display data other than the display data generated using the analysis data AD. The display control unit 37 transmits the display data to the personal computer 100 and causes the personal computer 100 to display the display data.

[0051] The server control unit 30 may include an audio control unit (not shown). The audio control unit inputs warning information from the execution unit 35. When the audio control unit inputs the warning information, it generates warning audio data that causes a warning sound to be output. The warning audio data is audio data that indicates that the analysis data AD does not satisfy the reference data RD. The audio control unit transmits the warning audio data to the personal computer 100. By transmitting the warning audio data to the personal computer 100, the audio control unit causes the personal computer 100 to output the warning audio.

[0052] The server storage unit 50 stores various data, various programs, etc. The server storage unit 50 is composed of a volatile semiconductor memory such as RAM, a non-volatile memory such as ROM, a flash memory, etc. The server storage unit 50 may have a magnetic memory such as an HDD (Hard Disk Drive). The server storage unit 50 stores identification data MD, schedule data SD, analysis data AD, and reference data RD. The server storage unit 50 stores a plurality of imaging data PD. The server storage unit 50 acquires and stores the imaging data PD transmitted to the server communication unit 20 from the digital camera 200, etc. The server storage unit 50 may store various display data, print data, etc. The server storage unit 50 corresponds to an example of an image acquisition unit.

[0053] The identification data MD is generated by the identification data generating unit 31. The identification data MD identifies a subject related to the subject image HG included in the captured image PG. The server storage unit 50 stores the identification data MD in association with an identification code CN of the subject. The identification code CN will be described later. The server storage unit 50 may store the identification data MD and the identification code CN in a table format.

[0054] The schedule data SD is generated by the timing unit 33. The schedule data SD is generated using the event data ED transmitted from the personal computer 100. The schedule data SD includes one or more check timings. The timing unit 33 may set information included in the event data ED as the check timing to generate the schedule data SD. The schedule data SD is generated by the timing unit 33 for each of the event date and time and intermediate check date transmitted from the personal computer 100.

[0055] The analysis data AD is generated by the execution unit 35. The analysis data AD is generated using identification information and analysis information for each piece of imaging data PD. The analysis data AD includes the number and frequency of imaging data PD for each of a plurality of subjects. The server storage unit 50 may store a table that associates the subject's identification code CN with the imaging data PD, including the analysis data AD.

[0056] The reference data RD is data to be compared with the analysis data AD. The reference data RD is a preset value or a value calculated using identification information or the like. The reference data RD is expressed by one or more numerical values ​​or a numerical range. The execution unit 35 may update the reference data RD when receiving an arrival signal.

[0057] The imaging data PD is transmitted from the digital camera 200 or the like via the communication network NW. The server storage unit 50 stores a plurality of imaging data PD. The server storage unit 50 may classify and store the plurality of imaging data PD according to the imaging date and time of the imaging data PD. As an example, the server storage unit 50 classifies the imaging data PD according to the imaging date and time and stores the imaging data PD in folders. The server storage unit 50 may store the imaging data PD in association with identification information of the imaging data PD.

[0058] The personal computer 100 is operated by the creator. The personal computer 100 inputs various input data input by the creator. The personal computer 100 transmits various input data to the server 10, etc. via the communication network NW. The personal computer 100 inputs display data, etc. transmitted from the server 10. The personal computer 100 outputs various information to the creator using the display data, etc. The personal computer 100 corresponds to an example of an input / output device. The personal computer 100 includes a PC communication unit 110, a display unit 120, an input unit 130, a PC control unit 140, and a PC storage unit 150. PC is an abbreviation for personal computer.

[0059] The PC communication unit 110 is an interface circuit that communicates with the server 10 and the like via the communication network NW. The PC communication unit 110 connects to the server 10 and the like by wire or wirelessly in accordance with a predetermined communication protocol. The PC communication unit 110 includes a wired connector, a wireless communication port, and the like. The wired connector is a USB connector, a LAN connector, and the like. The wireless communication port is a Wi-Fi communication port, a Bluetooth communication port, and the like. The PC communication unit 110 receives various data such as display data from the server 10. The PC communication unit 110 may receive imaging data PD and the like from the digital camera 200 and the like. The PC communication unit 110 transmits input data and the like input by the creator using the input unit 130 to the server 10 and the like. The PC communication unit 110 may transmit the imaging data PD to the server 10.

[0060] The display unit 120 displays various data. The display unit 120 is configured with various display devices such as a liquid crystal display and an organic EL (electro-luminescence) display. The display unit 120 may be configured integrally with the personal computer 100, or may be configured separately and externally attached to the personal computer 100. The display unit 120 may have a touch input function. When the display unit 120 has the touch input function, it operates as the input unit 130.

[0061] The input unit 130 is operated by the creator. When the creator operates the input unit 130, various input data is input to the personal computer 100. The input unit 130 is composed of devices such as a mouse, a keyboard, and a liquid crystal tablet. The input unit 130 may be configured as an integral part of the personal computer 100, or may be configured as a separate external unit.

[0062] The PC control unit 140 is a controller that controls the personal computer 100. As an example, the PC control unit 140 is a processor having a CPU. The PC control unit 140 is composed of one or more processors. The PC control unit 140 may have a semiconductor memory such as a ROM or a RAM. The semiconductor memory functions as a work area of ​​the PC control unit 140. The PC control unit 140 operates as various functional units by executing an album creation application AP. As an example, the album creation application AP is stored in advance in the PC storage unit 150. By executing the album creation application AP, the PC control unit 140 functions as an application execution unit 141, a screen generation unit 143, and a communication control unit 145. The PC control unit 140 may operate as a functional unit other than the application execution unit 141, the screen generation unit 143, and the communication control unit 145.

[0063] The application execution unit 141 generates various registration data based on the input data. The application execution unit 141 controls the screen generation unit 143 to display various application screens 500 on the display unit 120. The creator operates the application screen 500 displayed on the display unit 120 to input input data. The application execution unit 141 acquires the input data and generates various registration data based on the input data. The application execution unit 141 generates subject data HD, event data ED, and the like as the registration data. The application execution unit 141 may generate registration data different from the subject data HD and the event data ED. The application execution unit 141 transmits the registration data to the communication control unit 145. The application execution unit 141 controls the communication control unit 145 to transmit the registration data to the server 10 via the PC communication unit 110.

[0064] The application execution unit 141 allows the creator to edit, check, and the like the photo album PA. The application execution unit 141 acquires display data transmitted from the server 10. The display data includes display data for displaying the photo album PA, message data including the warning message 537, and the like. The application execution unit 141 may acquire display data for displaying the analysis data AD. The application execution unit 141 causes the screen generation unit 143 to display various display data and message data on the display unit 120. The application execution unit 141 may acquire display data for displaying the event album PA1. The application execution unit 141 causes the display unit 120 to display the display data for displaying the event album PA1.

[0065] The screen generation unit 143 generates various application screens 500 related to the album creation application AP. The screen generation unit 143 displays the application screen 500 on the display unit 120. The screen generation unit 143 prompts the creator to input various input data by displaying the application screen 500 on the display unit 120. The screen generation unit 143 prompts the creator to edit and check the photo album PA, etc. by displaying the application screen 500 on the display unit 120. The application screen 500 generated by the screen generation unit 143 will be described in detail later.

[0066] The communication control unit 145 controls communication with the server 10, etc. The communication control unit 145 controls various data transmitted from the PC communication unit 110 to the server 10, etc., and the timing of data transmission, etc. The communication control unit 145 controls reception of various data transmitted from the server 10, etc. to the PC communication unit 110. The communication control unit 145 controls the destination of the received data. As an example, the communication control unit 145 transmits the imaging data PD transmitted from the digital camera 200 to the PC storage unit 150 via the communication network NW. The communication control unit 145 transmits the imaging data PD stored in the PC storage unit 150 to the server 10 at a predetermined timing via the communication network NW.

[0067] The PC storage unit 150 stores various data, various applications, etc. The PC storage unit 150 is composed of a volatile semiconductor memory such as a RAM, a non-volatile memory such as a ROM, a flash memory, etc. The PC storage unit 150 may have a magnetic memory such as a HDD. The PC storage unit 150 stores applications such as an album creation application AP, and registered data such as registered images RG. The PC storage unit 150 may store imaging data PD.

[0068] The album creation application AP is an application that causes the PC control unit 140 to function as various functional units such as the application execution unit 141. The album creation application AP may be a web application that runs on a web browser. The creator can create a photo album PA by starting the album creation application AP.

[0069] The subject data HD is registered by the creator before creating the photo album PA. The subject data HD is data relating to the subject. The subject data HD includes a registered image RG, which is an image relating to the subject. The subject data HD is used in the identification data generation unit 31 of the server 10. The subject data HD is input by the creator using the application screen 500 and stored in the PC storage unit 150. As an example, the subject data HD is stored in the PC storage unit 150 in a table format in which the registered image RG is associated with an identification code CN. The subject data HD is transmitted to the server 10 via the communication network NW.

[0070] The imaging data PD stored in the PC storage unit 150 is transmitted to the server 10 via the personal computer 100. The digital camera 200 is locally connected to the personal computer 100 via a cable or the like. When the digital camera 200 transmits the imaging data PD to the personal computer 100 via the cable, the imaging data PD is stored in the PC storage unit 150. When the personal computer 100 has an imaging function such as an imaging unit, the PC storage unit 150 stores the imaging data PD captured by the imaging unit.

[0071] Figures 4, 5, 6, 7, 8, 9, and 10 show examples of the application screen 500. The application screen 500 shown in Figures 4, 5, 6, 7, 8, 9, and 10 can be displayed on the display unit 120 when the PC control unit 140 executes the album creation application AP. The application screen 500 is generated by the screen generation section 143 and displayed on the display unit 120.

[0072] 4 shows an application initial screen 501, which is one of the application screens 500. The application initial screen 501 is displayed on the display unit 120 when the PC control unit 140 executes the album creation application AP. The application initial screen 501 displays a member registration icon 510, a schedule registration icon 520, and an album creation icon 530.

[0073] Member registration icon 510 is an icon that is operated by the creator when registering a target person. At the time of initial setting before starting the creation of the photo album PA, member registration icon 510 is operated by the creator. When the creator operates member registration icon 510 using input unit 130, member registration screen 503 shown in FIG. 5 is displayed on display unit 120.

[0074] The schedule registration icon 520 is an icon that is operated when the creator registers event data ED including the event date and time, etc. The schedule registration icon 520 is operated by the creator at the time of initial setup before starting to create the photo album PA. When the creator operates the schedule registration icon 520 using the input unit 130, the schedule registration screen 505 shown in FIG. 6 is displayed on the display unit 120.

[0075] The album creation icon 530 is an icon operated when editing or checking the photo album PA. The album creation icon 530 is operated by the creator when editing the photo album PA or the event album PA1 that the creator is creating. When the creator operates the album creation icon 530 using the input unit 130, an album creation screen 507 shown in Figs. 7, 8, 9, and 10 is displayed on the display unit 120.

[0076] FIG. 5 shows a member registration screen 503, which is one of the application screens 500. The member registration screen 503 is a screen for registering subject data HD including a registered image RG of a subject. The creator uses the member registration screen 503 to input text information and image information included in the subject data HD. The member registration screen 503 shown in FIG. 5 shows a member registration table 511. The member registration table 511 is composed of a plurality of input columns and a plurality of input rows. The input columns include a code input field 513, an image input field 515, and a remarks input field 517. The input columns may include input fields other than the code input field 513, the image input field 515, and the remarks input field 517. Each of the plurality of input rows corresponds to the subject data HD of each subject.

[0077] The code input field 513 is a field for inputting the identification code CN. The identification code CN is a unique code that indicates each of the subjects. The identification code CN shown in FIG. 5 is input in the order of the rows in consecutive numbers, but is not limited to this. The code input field 513 is not limited to a form as long as it is a code that can distinguish the subjects, such as an employee code or a student code. The name of the subject may be input into the code input field 513. The identification code CN shown in FIG. 5 is input in advance by the album creation application AP, but may be input manually by the creator. The first identification code CN1 is input into the first row of the member registration table 511 shown in FIG. 5, the second identification code CN2 is input into the second row, and the third identification code CN3 is input into the third row.

[0078] The image input field 515 is a field that displays the registered image RG of the subject. The creator captures the registered image RG of each subject in advance and stores it in the PC storage unit 150. When the creator inputs a file name corresponding to the registered image RG in the image input field 515, the registered image RG is displayed in the image input field 515. The first registered image RG1 is registered in the first row of the member registration table 511 shown in FIG. 5, the second registered image RG2 is registered in the second row, and the third registered image RG3 is registered in the third row. The image input field 515 shown in FIG. 5 displays one registered image RG per row, but is not limited to this. The creator may input multiple registered images RG in each row of the image input field 515. The registered image RG shown in FIG. 5 shows an image of the upper body of the subject, but is not limited to this. The image of the registered image RG is not limited as long as it is an image from which identification data MD can be generated by the identification data generation unit 31 of the server 10.

[0079] The remarks input field 517 is a field in which information related to each subject can be input. The subject's name, affiliation, relationship with other subjects, etc. can be input in the remarks input field 517. The member registration table 511 shown in FIG. 5 shows the remarks input field 517, but is not limited to this. The member registration table 511 does not have to include the remarks input field 517.

[0080] When the creator inputs the registered image RG and the like into the member registration table 511, the application execution unit 141 acquires the input data. The application execution unit 141 generates first target data HD1 including the first identification code CN1 input into the first row of the member registration table 511 and the first registered image RG1. The application execution unit 141 generates second target data HD2 including the second identification code CN2 input into the second row of the member registration table 511 and the second registered image RG2. The application execution unit 141 generates third target data HD3 including the third identification code CN3 input into the third row of the member registration table 511 and the third registered image RG3. When the creator inputs the identification code CN and the identification image RG into each row from the fourth row onwards, the application execution unit 141 generates target data HD for each row. The application execution unit 141 may generate target data HD including the data input into the remarks input field 517. The application execution unit 141 transmits the subject data HD to the server 10 via the PC communication unit 110 at a predetermined timing.

[0081] FIG. 6 shows a schedule registration screen 505, which is one of the application screens 500. The schedule registration screen 505 is a screen for registering event data ED including the event date and time, etc. The creator uses the schedule registration screen 505 to input text information corresponding to the event data ED. The schedule registration screen 505 shown in FIG. 6 shows each input field as a plurality of input rows. Each of the plurality of input rows corresponds to the event data ED. The input column includes an event name input field 521, a start date and time input field 523, an end date and time input field 525, and an all-day setting button 527. The input column may include input fields other than the event name input field 521, the start date and time input field 523, and the end date and time input field 525. The input column may include setting buttons other than the all-day setting button 527.

[0082] The event name input field 521 is an input field for inputting the name of the event. The creator inputs text information into the event name input field 521. When the photo album PA is a graduation album as an example, the creator inputs the name of an event such as an athletic meet or a school trip as the event name. A name indicating an intermediate confirmation date for the photo album PA may be input into the event name input field 521.

[0083] The start date and time input field 523 is an input field for inputting the start date and time of the event. The start date and time input field 523 shown in Fig. 6 is shown as a separate field for inputting the start date and a field for inputting the start time, but is not limited to this. The start date and time input field 523 for inputting the start date and start time may be configured as a single input field.

[0084] The end date and time input field 525 is an input field for inputting the end date and time of the event. The end date and time input field 525 shown in Fig. 6 is shown as a separate field for inputting the end date and a field for inputting the end time, but is not limited to this. The end date and time input field 525 for inputting the end date and the end time may be configured as a single input field.

[0085] The all-day setting button 527 is an input button for inputting when the end time is undecided. When the creator inputs information into the all-day setting button 527, the start time and end time of the event cannot be input. The schedule registration screen 505 shown in FIG. 6 shows the all-day setting button 527, but is not limited to this. The schedule registration screen 505 does not have to include the all-day setting button 527.

[0086] The first line of the schedule registration screen 505 corresponds to the first event data ED1. The second line of the schedule registration screen 505 corresponds to the second event data ED2. The third line of the schedule registration screen 505 corresponds to the third event data ED3. The application execution unit 141 transmits each event data ED to the server 10. The timing unit 33 of the server 10 acquires each event data ED. The timing unit 33 generates schedule data SD using the event data ED. The application execution unit 141 may generate event data ED that combines the first event data ED1, the second event data ED2, and the third event data ED3, and transmit the event data ED to the server 10. The timing unit 33 generates schedule data SD that includes multiple check timings using the event data ED.

[0087] FIG. 7 shows an album creation screen 507, which is one of the application screens 500. FIG. 7 shows a first album creation screen 507A, which is an example of the album creation screen 507. The first album creation screen 507A is a screen that displays an event album PA1. For example, when the execution unit 35 of the server 10 receives an arrival signal from the clock unit 33, the execution unit 35 generates an event album PA1. The execution unit 35 transmits the generated event album PA1 to the display control unit 37. The display control unit 37 generates display data for displaying the event album PA1. The display control unit 37 transmits the display data to the personal computer 100 via the server communication unit 20. The application execution unit 141 of the personal computer 100 acquires the display data and displays the event album PA1 on the display unit 120. The screen generation unit 143 displays the event album PA1 on the first album creation screen 507A. The first album creation screen 507A displays the event album PA1.

[0088] First album creation screen 507A shown in Fig. 7 displays a part of event album PA1 and page forward icon 531. First album creation screen 507A shown in Fig. 7 displays one page of multiple pages of event album PA1. First album creation screen 507A may display multiple pages, such as two or more pages. First album creation screen 507A may display a photo album PA.

[0089] The page forward icon 531 is operated when the creator switches the page of the event album PA1 displayed on the first album creation screen 507A. When the creator operates the page forward icon 531, the page of the event album PA1 displayed on the first album creation screen 507A is switched.

[0090] 7 includes a first captured image PG1, a second captured image PG2, and an event name display 533. The event album PA1 may display captures of the captured images PG, other comments, illustrations, and the like (not shown).

[0091] The captured images PG displayed in the event album PA1 on the first album creation screen 507A are, for example, selected by the execution unit 35 of the server 10. The event name display 533 is created by the execution unit 35 of the server 10. The creator can confirm and edit the contents of the event album PA1 on the first album creation screen 507A. The creator can replace the captured images PG and change the layout. The creator can change the terminology of the event name display 533, change the display position, etc.

[0092] FIG. 8 shows an album creation screen 507, which is one of the application screens 500. FIG. 8 shows a second album creation screen 507B, which is an example of the album creation screen 507. The second album creation screen 507B is a screen that displays information related to the analysis data AD analyzed by the server 10. For example, when the execution unit 35 of the server 10 receives an arrival signal from the clock unit 33, the execution unit 35 generates the analysis data AD. The execution unit 35 transmits the generated analysis data AD to the display control unit 37. The display control unit 37 generates display data for displaying information related to the analysis data AD. The display control unit 37 transmits the display data to the personal computer 100 via the server communication unit 20. The application execution unit 141 of the personal computer 100 acquires the display data and causes the display unit 120 to display information related to the analysis data AD. The screen generation unit 143 causes the second album creation screen 507B to display information related to the analysis data AD. The second album creation screen 507B displays information related to the analysis data AD.

[0093] The second album creation screen 507B shown in FIG. 8 displays an evaluation result list 535. The evaluation result list 535 displays information related to the analysis data AD. The evaluation result list 535 shown in FIG. 8 displays information related to the analysis data AD analyzed at the time when the event 1 was ended. The evaluation result list 535 shows the identification code CN, the number of images taken, the evaluation points, and the file names. The evaluation result list 535 shows the number of images taken, the evaluation points, and the file names for each identification code CN. The evaluation result list 535 may include items other than the number of images taken, the evaluation points, and the file names for each identification code CN. The creator can check the number of captured images PG taken of each subject by visually checking the evaluation result list 535. The creator can recognize which subjects should be the focus of the photos taken at the next event.

[0094] The identification code CN included in the evaluation result list 535 is the identification code CN registered on the member registration screen 503. When the identification data generation unit 31 newly generates identification data MD relating to an unregistered subject, the identification code CN corresponding to the unregistered subject is added to the evaluation result list 535.

[0095] The number of images captured is the number of pieces of imaging data PD including a specific subject. The number of images captured in each row is the number of pieces of imaging data PD for each subject corresponding to the identification code CN. The number of images captured is the number of pieces of imaging data PD including a subject image HG of the subject among the imaging data PD stored in the server storage unit 50. The number of images captured may be the number of pieces of imaging data PD including a subject image HG of the subject among the imaging data PD showing a plurality of captured images PG included in the event album PA1.

[0096] The evaluation points are evaluation values ​​obtained by converting the analysis information by the execution unit 35 into points. The evaluation points for each row are the evaluation values ​​of the subject corresponding to the identification code CN. The evaluation points are calculated from analysis information obtained by analyzing the imaging data PD stored in the server storage unit 50. The evaluation points may be calculated from analysis information obtained by analyzing the imaging data PD indicating a plurality of captured images PG included in the event album PA1.

[0097] The file name is the file name of the imaging data PD including the subject. The file name of each row is the file name of the imaging data PD including the subject corresponding to the identification code CN. The file name is the file name of the imaging data PD including the subject image HG of the subject, among the imaging data PD stored in the server storage unit 50. The file name may be the file name of the imaging data PD including the subject image HG of the subject, among the imaging data PD showing the multiple captured images PG included in the event album PA1.

[0098] The evaluation result list 535 shown in Fig. 8 shows file names, but is not limited to this. Instead of file names, the evaluation result list 535 may show display positions of captured images PG displayed in the event album PA1. The positions of captured images PG displayed in each row are display positions of captured images PG including subject images HG of subjects corresponding to the identification code CN. The evaluation result list 535 may display captured images PG instead of file names. The evaluation result list 535 does not have to display file names.

[0099] FIG. 9 shows an album creation screen 507, which is one of the application screens 500. FIG. 9 shows a third album creation screen 507C, which is an example of the album creation screen 507. The third album creation screen 507C is a screen that displays information related to the analysis data AD analyzed by the server 10 and a warning message 537. For example, when the execution unit 35 of the server 10 receives an arrival signal from the timer unit 33, the execution unit 35 generates the analysis data AD. The execution unit 35 compares the reference data AD with the reference data RD. When the execution unit 35 determines that the analysis data AD does not satisfy the reference data RD, the execution unit 35 generates warning information. The execution unit 35 transmits the generated analysis data AD to the display control unit 37. When the execution unit 35 generates the warning information, the execution unit 35 transmits the warning information to the display control unit 37. The display control unit 37 generates display data that displays information related to the analysis data AD. The display control unit 37 generates warning message data based on the warning information. The display control unit 37 transmits the display data and the warning message data to the personal computer 100 via the server communication unit 20. The application executing section 141 of the personal computer 100 acquires the display data and the warning message data, and causes the display unit 120 to display information related to the analysis data AD and warning message 537. The screen generating section 143 causes the third album creation screen 507C to display information related to the analysis data AD and warning message 537. The third album creation screen 507C displays information related to the analysis data AD and warning message 537.

[0100] Evaluation result list 535 displayed on third album creation screen 507C in Fig. 9 is the same as evaluation result list 535 displayed on second album creation screen 507B shown in Fig. 8. Evaluation result list 535 displayed on third album creation screen 507C may be the same as evaluation result list 535 displayed on second album creation screen 507B, or may have a different configuration. Third album creation screen 507C does not have to display evaluation result list 535. Third album creation screen 507C preferably displays evaluation result list 535. When evaluation result list 535 is displayed on third album creation screen 507C, it becomes easier for the creator to check the details of warning message 537.

[0101] The warning message 537 indicates that the analysis data AD does not satisfy the reference data RD. As an example, the warning message 537 is displayed on the third album creation screen 507C when the number of imaging data PD including the subject does not satisfy the reference data RD. Here, the reference data RD compared with the number of imaging data PD is a numerical range including the average value of the number of imaging data PD for each of a plurality of subjects.

[0102] The text information included in the warning message 537 can be set appropriately. The warning message 537 shown in Fig. 9 indicates that the number of imaging data PD is the number of images. The reference data RD is represented as a comparison value. The warning message 537 includes a comment to the creator to increase the number of imaging data PD of the subject corresponding to the identification code CN at the next event. By visually checking the warning message 537, the creator can recognize which subject should be the main subject to photograph at the next event.

[0103] The warning message 537 is displayed on the third album creation screen 507C, but is not limited to this. When the personal computer 100 receives warning message data from the server 10, the warning message 537 may be displayed on any of the album creation screens 507. When the personal computer 100 receives warning audio data, it may output a warning audio.

[0104] FIG. 10 shows an album creation screen 507, which is one of the application screens 500. FIG. 10 shows a fourth album creation screen 507D, which is an example of the album creation screen 507. The fourth album creation screen 507D is a screen displayed when the server 10 outputs a plurality of event albums PA1 to the personal computer 100. The fourth album creation screen 507D is a screen displayed in place of the first album creation screen 507A. As an example, when the execution unit 35 of the server 10 receives an arrival signal from the clock unit 33, it generates a first event album PA1A and a second event album PA1B. The execution unit 35 transmits the generated first event album PA1A and second event album PA1B to the display control unit 37. The display control unit 37 generates display data for displaying the first event album PA1A and display data for displaying the second event album PA1B. The display control unit 37 transmits the two pieces of display data to the personal computer 100 via the server communication unit 20. The application execution unit 141 of the personal computer 100 acquires the two pieces of display data and displays the first event album PA1A and the second event album PA1B on the display unit 120. The screen generation unit 143 displays the first event album PA1A and the second event album PA1B on the fourth album creation screen 507D. The fourth album creation screen 507D displays the first event album PA1A and the second event album PA1B.

[0105] The fourth album creation screen 507D shown in Fig. 10 displays a part of the first event album PA1A, a part of the second event album PA1B, and two page forward icons 531. The fourth album creation screen 507D shown in Fig. 10 displays one page of the multiple pages that make up the first event album PA1A. The fourth album creation screen 507D displays one page of the multiple pages that make up the second event album PA1B.

[0106] The two page forward icons 531 respectively correspond to the first event album PA1A and the second event album PA1B. The page forward icon 531 has the same function as the page forward icon 531 displayed on the first album creation screen 507A.

[0107] The server 10 includes an identification data generating unit 31 that acquires subject data HD for identifying a subject, a server storage unit 50 that acquires a plurality of imaging data PD, a timer unit 33 that sets a check timing for confirming the imaging data PD, and an execution unit 35 that generates a photo album PA. The execution unit 35 identifies a subject included in the imaging data PD using the subject data HD, and generates analysis data AD related to the identified subject. The execution unit 35 compares the subject analysis data AD with the reference data RD at the check timing, and if the analysis data AD does not satisfy the reference data RD, outputs a warning message 537 indicating that the reference data RD is not satisfied. The creator can understand that it is difficult to create a desired photo album PA from the multiple captured image data PD stored in the server 10. The desired photo album PA is, for example, an album in which the number of captured images PG including each subject is equal or approximately equal among the multiple captured images PG. The server 10 can notify the creator that it is difficult to create a desired photo album PA from the stored captured image data PD.

[0108] It is preferable that the execution section 35 generates, at the check timing, an event album PA1 that constitutes a part of the photo album PA and that includes the captured image data PD. The creator can check and edit parts of the photo album PA at preset times.

[0109] The analysis data AD is the number of imaging data PD including the subject among the multiple imaging data PD. The reference data RD is a lower limit of the number of imaging data PD. The warning message data preferably indicates that the number of imaging data PD does not exceed the lower limit of the number of imaging data PD. The creator can distinguish subjects with a small number of imaging data PD from among a plurality of subjects.

[0110] The photo album creation system 1 includes a server 10 having an identification data generation unit 31 for acquiring identification data MD for identifying a subject, a server storage unit 50 for acquiring a plurality of imaging data PD, a timer unit 33 for setting a check timing for confirming the imaging data PD, and an execution unit 35 for generating a photo album PA, and a personal computer 100 operated by a creator. The execution unit 35 identifies a subject included in the imaging data PD using the identification data MD, and stores analysis data AD related to the identified subject. The execution unit 35 compares the stored analysis data AD with the reference data RD at the check timing. If the analysis data AD does not satisfy the reference data RD, the execution unit 35 outputs a warning message 537 indicating that the reference data RD is not satisfied to the personal computer 100. The personal computer 100 receives the warning message 537 and displays the warning message. The creator can understand that it is difficult to create a desired photo album PA from the multiple pieces of imaging data PD stored. The server 10 can notify the creator that it is difficult to create a desired photo album PA from the stored imaging data PD.

[0111] First embodiment The first embodiment shows a photo album creating method for identifying imaging data PD stored in a server storage unit 50 and notifying the creator of a warning message or the like. The photo album creating method corresponds to an example of an image processing method. The server 10 compares analysis data AD generated based on imaging data PD stored in the server storage unit 50 with reference data RD. The server 10 outputs a warning message 537 according to the comparison result of the analysis data AD.

[0112] Fig. 11 shows a control flow performed by the server 10. Fig. 11 shows the control flow in a flowchart. The server 10 receives various registration data from the personal computer 100. The server 10 receives imaging data PD from the digital camera 200 or the like.

[0113] In step S101, the server 10 generates and acquires the identification data MD and the check timing. When creating a photo album PA, the creator uses the personal computer 100 to perform various registrations. The server 10 acquires the registration data by the creator and generates the identification data MD and the check timing. The server 10 acquires the identification data MD and the check timing by generating the identification data MD and the check timing.

[0114] The creator inputs the subject data HD into the member registration screen 503 shown in FIG. 5. The creator inputs the identification code CN, the registered image RG, notes, etc. for each subject. The application execution unit 141 of the personal computer 100 generates the subject data HD for each subject using the input data. The application execution unit 141 causes the PC communication unit 110 to transmit the subject data HD. The PC communication unit 110 transmits the subject data HD to the server 10 via the communication network NW. The server communication unit 20 of the server 10 receives the subject data HD. The server communication unit 20 transmits the subject data HD to the identification data generation unit 31 of the server control unit 30.

[0115] The identification data generating unit 31 receives the subject data HD. The identification data generating unit 31 generates identification data MD using the subject data HD. As an example, the identification data generating unit 31 performs various analyses on the registered image RG included in the subject data HD to generate the identification data MD. The identification data generating unit 31 stores the identification data MD in the server storage unit 50 in advance.

[0116] The creator inputs the event data ED into the schedule registration screen 505 shown in FIG. 6. The creator inputs the event name, start date and time of the event, end date and time of the event, etc. for each event. The creator may also input an intermediate check date. The application execution unit 141 uses the input data to generate event data ED for each event or intermediate check date. The application execution unit 141 causes the PC communication unit 110 to transmit the event data ED. The PC communication unit 110 transmits the event data ED to the server communication unit 20 via the communication network NW. The server communication unit 20 receives the event data ED. The server communication unit 20 transmits the event data ED to the timing unit 33.

[0117] The timing unit 33 receives the event data ED. The timing unit 33 sets one or more check timings using the event data ED. The timing unit 33 generates schedule data SD including one or more check timings. The timing unit 33 stores the schedule data SD in the server storage unit 50. The execution unit 35 appropriately reads the schedule data SD from the server storage unit 50 and acquires the check timings.

[0118] After generating and acquiring the identification data MD and check timing, the server 10 acquires the imaging data PD in step S103. The server communication unit 20 receives the imaging data PD transmitted from the digital camera 200 and the smartphone 300. The server communication unit 20 may receive the imaging data PD from the personal computer 100. The server communication unit 20 transmits the imaging data PD to the server storage unit 50. The server storage unit 50 acquires the imaging data PD by receiving the imaging data PD from the server communication unit 20. The server storage unit 50 stores the imaging data PD.

[0119] After acquiring the imaging data PD, the server 10 identifies the subject included in the imaging data PD in step S105. The execution unit 35 reads out the identification data MD from the server storage unit 50. As an example, the execution unit 35 performs face authentication on the face image included in the face image area FR in the imaging data PD using the identification data MD. The execution unit 35 identifies each subject image HG included in the imaging data PD by performing face authentication. The execution unit 35 generates identification information that identifies the subject image HG for each imaging data PD. The execution unit 35 may analyze the posture, position, etc. of the subject image HG to generate analysis information.

[0120] After identifying the subjects included in the imaging data PD, the server 10 generates and stores analysis data AD in step S107. The execution unit 35 uses the identification information to generate analysis data AD including the number of imaging data PD for each subject, etc. The execution unit 35 generates and updates the analysis data AD when it generates identification information for the imaging data PD. The execution unit 35 may obtain the identification information at a predetermined timing and generate the analysis data AD. The execution unit 35 may generate the analysis data AD including the analysis information. The execution unit 35 stores the generated analysis data AD in the server memory unit 50. The server memory unit 50 stores the analysis data AD.

[0121] After generating and storing the analysis data AD, the server 10 determines in step S109 whether or not the check timing has been reached. The execution unit 35 reads out the schedule data SD from the server storage unit 50. The execution unit 35 acquires the check timing included in the schedule data SD. The execution unit 35 determines whether or not the check timing has been reached. When the execution unit 35 determines that the check timing has been reached, the execution unit 35 proceeds to step S111 (step S109: YES). When the execution unit 35 determines that the check timing has not been reached, the execution unit 35 returns to step S103 (step S109: NO).

[0122] In step S111, the execution unit 35 determines whether the analysis data AD satisfies the reference data RD. The execution unit 35 acquires the reference data RD in advance. The reference data RD is a value that is determined in advance or a value that is calculated using the identification information. The execution unit 35 compares the analysis data AD with the reference data RD. The execution unit 35 determines whether the analysis data AD satisfies the reference data RD. As an example, the execution unit 35 determines whether the number of imaging data PD for each subject included in the analysis data AD is equal to or greater than a preset number of imaging data PD that is determined in advance. When the number of imaging data PD for each subject is greater than the set number, the execution unit 35 determines that the analysis data AD satisfies the reference data RD. When the number of imaging data PD for each subject is less than the set number, the execution unit 35 determines that the analysis data AD does not satisfy the reference data RD. When the execution unit 35 determines that the analysis data AD does not satisfy the reference data RD, the execution unit 35 proceeds to step S113 (step S111: NO). When the execution unit 35 determines that the analysis data AD satisfies the reference data RD, it ends the process (step S111: YES).

[0123] In step S113, the server 10 generates and transmits a warning message 537. When the execution unit 35 determines that the analysis data AD does not satisfy the reference data RD, it generates warning information. The execution unit 35 transmits the warning information to the display control unit 37. When the display control unit 37 receives the warning information, it generates warning message data including the warning message 537. The display control unit 37 transmits the warning message data to the server communication unit 20. The server communication unit 20 transmits the warning message data to the personal computer 100 via the communication network NW. By transmitting the warning message data to the personal computer 100, the server 10 causes the personal computer 100 to display the warning message.

[0124] The photo album creation method includes obtaining identification data MD for identifying a subject included in imaging data PD and a check timing for confirming the imaging data PD, obtaining a plurality of imaging data PD, identifying a subject included in the imaging data PD using the identification data MD, storing analysis data AD relating to the identified subject, comparing the stored analysis data AD with reference data RD at the check timing, and, if the analysis data AD does not satisfy the reference data RD, outputting a warning message 537 indicating that the reference data RD is not satisfied. The creator can understand that it is difficult to create a desired photo album PA from the multiple pieces of imaging data PD stored. The server 10 can notify the creator that it is difficult to create a desired photo album PA from the stored imaging data PD.

[0125] Second embodiment The second embodiment shows a photo album creation method for identifying the imaging data PD included in the event album PA1 and notifying the creator of a warning message or the like. The server 10 compares the analysis data AD generated based on the imaging data PD included in the event album PA1 with the reference data RD. The server 10 outputs a warning message 537 according to the comparison result.

[0126] Fig. 12 shows a control flow performed by the server 10. Fig. 12 shows the control flow in a flowchart. The server 10 receives various registration data from the personal computer 100. The server 10 receives imaging data PD from the digital camera 200 or the like.

[0127] In step S201, the server 10 generates and acquires the identification data MD and the check timing. When creating a photo album PA, the creator uses the personal computer 100 to perform various registrations. The server 10 acquires the creator's registration data and generates the identification data MD and the check timing. The server 10 acquires the identification data MD and the check timing by generating the identification data MD and the check timing.

[0128] After generating and acquiring the identification data MD and check timing, the server 10 acquires the imaging data PD in step S203. The server communication unit 20 receives the imaging data PD transmitted from the digital camera 200 and the smartphone 300. The server communication unit 20 may receive the imaging data PD from the personal computer 100. The server communication unit 20 transmits the imaging data PD to the server storage unit 50. The server storage unit 50 acquires the imaging data PD by receiving the imaging data PD from the server communication unit 20. The server storage unit 50 stores the imaging data PD.

[0129] When the server 10 acquires the imaging data PD, in step S205, the execution unit 35 determines whether or not the check timing has been reached. The execution unit 35 reads out the schedule data SD from the server storage unit 50. The execution unit 35 acquires the check timing included in the schedule data SD. The execution unit 35 determines whether or not the check timing has been reached. When the execution unit 35 determines that the check timing has been reached, the execution unit 35 proceeds to step S207 (step S205: YES). When the execution unit 35 determines that the check timing has not been reached, the execution unit 35 returns to step S203 (step S205: NO).

[0130] After the check timing is reached, the server 10 generates an event album PA1 in step S207. As an example, the execution unit 35 generates the event album PA1 based on preset setting conditions. The execution unit 35 may transmit an album creation instruction to the personal computer 100 to create the event album PA1, and cause the creator to create the event album PA1. The event album PA1 is created using the imaging data PD stored in the server storage unit 50.

[0131] After generating the event album PA1, the server 10 identifies subjects included in the imaging data PD in the event album PA1 in step S209. The execution unit 35 reads out the identification data MD from the server storage unit 50. As an example, the execution unit 35 performs face authentication on a face image included in a face image area FR in the imaging data PD using the identification data MD. The execution unit 35 identifies each subject image HG included in the imaging data PD by performing face authentication. The execution unit 35 generates identification information that identifies the subject image HG for each imaging data PD. The execution unit 35 may analyze the posture, position, etc. of the subject image HG to generate analysis information.

[0132] After identifying the subjects included in the imaging data PD, the server 10 generates and stores analysis data AD in step S211. The execution unit 35 uses the identification information to generate analysis data AD including the number of imaging data PD for each subject, etc. The execution unit 35 generates and updates the analysis data AD when it generates identification information for the imaging data PD. The execution unit 35 may obtain the identification information at a predetermined timing and generate the analysis data AD. The execution unit 35 may generate the analysis data AD including the analysis information. The execution unit 35 stores the generated analysis data AD in the server memory unit 50. The server memory unit 50 stores the analysis data AD.

[0133] The analysis data AD is preferably information relating to subjects in the imaging data PD contained in the event album PA1. The server 10 is able to create a desired photo album PA by identifying the imaging data PD used in the event album PA1.

[0134] In step S213, the execution unit 35 determines whether the analysis data AD satisfies the reference data RD. The execution unit 35 acquires the reference data RD in advance. The reference data RD is a value that is determined in advance or a value that is calculated using the identification information. The execution unit 35 compares the analysis data AD with the reference data RD. The execution unit 35 determines whether the analysis data AD satisfies the reference data RD. As an example, the execution unit 35 determines whether the number of imaging data PD for each subject included in the analysis data AD is equal to or greater than a preset number of imaging data PD that is determined in advance. When the number of imaging data PD for each subject is greater than the set number, the execution unit 35 determines that the analysis data AD satisfies the reference data RD. When the number of imaging data PD for each subject is less than the set number, the execution unit 35 determines that the analysis data AD does not satisfy the reference data RD. When the execution unit 35 determines that the analysis data AD does not satisfy the reference data RD, the execution unit 35 proceeds to step S215 (step S213: NO). If the execution unit 35 determines that the analysis data AD satisfies the reference data RD, it ends the process (step S213: YES).

[0135] In step S215, the server 10 generates and transmits a warning message 537. When the execution unit 35 determines that the analysis data AD does not satisfy the reference data RD, it generates warning information. The execution unit 35 transmits the warning information to the display control unit 37. When the display control unit 37 receives the warning information, it generates warning message data including the warning message 537. The display control unit 37 transmits the warning message data to the server communication unit 20. The server communication unit 20 transmits the warning message data to the personal computer 100 via the communication network NW. By transmitting the warning message data to the personal computer 100, the server 10 causes the personal computer 100 to display the warning message. [Explanation of symbols]

[0136] 1...photo album creation system, 10...server, 20...server communication section, 30...server control unit, 31...identification data generation section, 33...timekeeping section, 35...execution section, 37...display control section, 50...server storage section, 100...personal computer, 110...PC communication section, 120...display unit, 130...input unit, 140...PC control unit, 141...application execution section, 143...screen generation section, 145...communication control section, 150...PC storage section, 200...digital camera, 300...smartphone, 400...printer, 500...application screen, 501...application initial screen screen, 503...member registration screen, 505...schedule registration screen, 507...album creation screen, 507A...first album creation screen, 507B...second album creation screen, 507C...third album creation screen, 507D...fourth album creation screen, 510...member registration icon, 511...member registration table, 513...code input field, 515...image input field, 517...remarks input field, 520...schedule registration icon, 521...event name input field, 523...start date and time input field, 525...end date and time input field, 527...all day setting button, 530...album creation icon , 531...page forward icon, 533...event name display, 535...evaluation result list, 537...warning message, AD...analysis data, AP...album creation application, CN...identification code, CN1...first identification code, CN2...second identification code, CN3...third identification code, ED...event data, ED1...first event data, ED2...second event data, ED3...third event data, FR...face image area, FR1...first face image area, FR2...second face image area, FR3...third face image area, HD...subject data, HD1...first subject data, HD2...third 2 subject data, HD3...third subject data, HG...subject image, HG1...first subject image, HG2...second subject image, HG3...third subject image, MD...identification data, NW...communications network, PA...photo album, PA1...event album, PA1A...first event album, PA1B...second event album, PD...captured data, PG...captured image, PG1...first captured image, PG2...second captured image, RD...reference data, RG...registered image, RG1...first registered image, RG2...second registered image, RG3...third registered image, SD...schedule data.

Claims

1. an identification information acquisition unit that acquires identification information for identifying a person; an image acquisition unit that acquires a plurality of images; A setting unit that sets a check timing for checking the image; A control unit that generates an album, The control unit is Identifying the person included in the image using the identification information; generating personal information relating to the identified person; At the check timing, the person information of the person is compared with setting information; If the personal information does not satisfy the setting information, outputting notification information indicating that the setting information is not satisfied. Image processing device.

2. The control unit is a partial album is generated at the check timing, the partial album being a part of the album and including the image; The image processing device according to claim 1 .

3. the person information is information related to the person in the image included in the partial album; The image processing device according to claim 2 .

4. The control unit generates a first candidate and a second candidate as the partial album, outputting the first candidate and the second candidate; The image processing device according to claim 2 .

5. the identification information includes a person image related to the person, the identification information acquisition unit generates model information using the person image; The image processing device according to claim 1 .

6. The identification information acquisition unit generates the identification information by using the image acquired by the image acquisition unit. The image processing device according to claim 1 .

7. The control unit generates and outputs print data for printing the generated album. The image processing device according to claim 1 .

8. the person information is the number of images including the person among the plurality of images; the setting information is a threshold value for the number of images, the notification information indicating that the number of the images does not exceed the threshold. The image processing device according to claim 1 .

9. Acquire identification information for identifying a person included in the image and a check timing for confirming the image; acquiring a plurality of said images; using the identification information to identify the person in the image; storing personal information relating to the identified person; At the check timing, the stored person information is compared with setting information; If the personal information does not satisfy the setting information, outputting notification information indicating that the setting information is not satisfied. Image processing methods.

10. an image processing device having an identification information acquisition unit that acquires identification information that identifies a person, an image acquisition unit that acquires a plurality of images, a setting unit that sets a check timing for checking the images, and a control unit that generates an album; an input / output device operated by a user; The control unit is Identifying the person included in the image using the identification information; storing personal information relating to the identified person; At the check timing, the stored person information is compared with setting information; If the person information does not satisfy the setting information, outputting notification information indicating that the setting information is not satisfied to the input / output device; The input / output device is inputting the notification information and displaying the notification information; Image processing system.

Images