Information processing apparatus, information processing method, and program

Abstract

To provide an information processing apparatus, an information processing method, and a program which give proper date to image data having no date.SOLUTION: In an information processing system, a CPU of a server generates dated image data list by classifying a plurality of dated image data, associates the dated image data list with a specific user, acquires dated image data of a subject similar to a subject of undated image data from the dated image data list, and derives a date given to the undated image data on the basis of the date given to the acquired dated image data. The plurality of dated image data are image data of a plurality of users including the specific user. The dated image data list is created for each subject by classifying the plurality of dated image data. The dated image data list of the subject similar to the subject of the dated image data is associated with the specific user.SELECTED DRAWING: Figure 38

Description

Technical Field

[0001] The technology of the present disclosure relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Japanese Unexamined Patent Application Publication No. 2006-252025 discloses an image management apparatus including extraction means and estimation means. The extraction means extracts feature amounts of image data with an unknown shooting date from the image data. The estimation means estimates the shooting date of the image data with an unknown shooting date by comparing the extracted feature amounts with a time dictionary collecting objects for specifying the date.

[0003] Further, the time dictionary records the relationship between objects representing parts of a subject such as a face, hair, body shape, clothing, and the date. The object is at least one of text data, image data, and moving image data describing the feature amounts, or at least one of text data, image data, and moving image data describing the feature amounts representing a specific era or a specific season. Furthermore, the image management apparatus described in Japanese Unexamined Patent Application Publication No. 2006-252025 further includes update means for updating the time dictionary based on the estimation result of the estimation means.

Summary of the Invention

[0004] However, when the types of objects included in the time dictionary are insufficient, it becomes difficult to accurately estimate the shooting date of image data with an unknown shooting date.

[0005] One embodiment of the technology according to the present disclosure provides an information processing apparatus, an information processing method, and a program capable of assigning an appropriate date to date-less image data as compared with a case of deriving a date to be assigned to the date-less image data based only on date-included image data owned by a specific user.

Means for Solving the Problems

[0006] A first aspect of the technology disclosed herein includes a processor and a memory built in or connected to the processor. The processor creates a list of date-added image data by classifying a plurality of date-added image data with dates, associates the list of date-added image data with a specific user, and from the list of date-added image data associated with the specific user, obtains date-added image data for a subject similar to the subject shown by the date-less image data of the specific user, and based on the date assigned to the obtained date-added image data, derives the date to be assigned to the date-less image data. The plurality of date-added image data is image data for a plurality of users including the specific user, the list of date-added image data is created for each subject by classifying the plurality of date-added image data for each subject shown by each of the plurality of date-added image data, and the list of date-added image data for a subject similar to the subject shown by the date-added image data of the specific user is associated with the specific user. It is an information processing apparatus.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39A

Figure 39B

Figure 39C

Figure 39D

Figure 39E

Figure 40

Figure 41

Figure 42

Figure 43

Figure 44

Figure 45

Figure 46

Figure 47A

Figure 47B

Figure 48

Figure 49A

Figure 49B

Figure 50

Figure 51

Figure 52

Figure 53

Figure 54

Figure 55

Mode for Carrying Out the Invention

[0008] An example of an embodiment of an information processing apparatus, an information processing method, and a program according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0009] First, the terms used in the following description will be explained.

[0010] CPU refers to the abbreviation of "Central Processing Unit". RAM refers to the abbreviation of "Random Access Memory". SSD refers to the abbreviation of "Solid State Drive". HDD refers to the abbreviation of "Hard Disk Drive". EEPROM refers to the abbreviation of "Electrically Erasable and Programmable Read Only Memory". ASIC refers to the abbreviation of "Application Specific Integrated Circuit". PLD refers to the abbreviation of "Programmable Logic Device". FPGA refers to the abbreviation of "Field-Programmable Gate Array". So C refers to the abbreviation of "System-on-a-chip". CMOS refers to the abbreviation of "Complementary Metal Oxide Semiconductor". CCD refers to the abbreviation of "Charge Coupled Device". EL refers to the abbreviation of "Electro-Luminescence". UI refers to the abbreviation of "User Interface". USB refers to the abbreviation of "Universal Serial Bus". GPU refers to the abbreviation of "Graphics Processing Unit". GPS refers to the abbreviation of "Global Positioning System" which refers to the abbreviation of "Real Time Clock". ID refers to the abbreviation of "Identification". Exif refers to the abbreviation of "exchangeable image file format" which refers to the abbreviation of "Wide Area Network". LAN refers to the abbreviation of "Local Area Network".

[0011] In addition, in the description of this specification, "match" refers to a match including errors generally acceptable in the technical field to which the technology of the present disclosure belongs (a match including errors to the extent that they do not conflict with the gist of the technology of the present disclosure), in addition to a perfect match. Also, in the description of this specification, "identical" in "the same date" refers to identity including errors generally acceptable in the technical field to which the technology of the present disclosure belongs (an identity including errors to the extent that they do not conflict with the gist of the technology of the present disclosure), in addition to being completely identical.

[0012] [First Embodiment]As an example, as shown in FIG. 1, the information processing system 10 includes a plurality of user devices 12 and a server 14. The user device 12 is a terminal device that transmits and receives input information and / or image information, etc. by the user 16 to and from the server 14, and is, for example, a smartphone. In the example shown in FIG. 1, as the plurality of user devices 12, user devices 12A, 12B, 12C, and 12D are shown. Hereinafter, for convenience of explanation, when it is not necessary to distinguish and explain user devices 12A, 12B, 12C, and 12D, they are simply referred to as "user device 12". Note that here, for convenience of explanation, four user devices 12 are exemplified, but the technology of the present disclosure is not limited thereto, and the number of user devices 12 may be plural. Also, here, a smartphone is exemplified as the user device 12, but the technology of the present disclosure is not limited thereto, and it may be a tablet terminal, a personal computer, a wearable terminal, and / or a photographing terminal such as a digital camera.

[0013] The information processing system 10 is used by a plurality of users 16. In the example shown in FIG. 1, as the plurality of users 16, users 16A, 16B, 16C, and 16D are shown. Hereinafter, for convenience of explanation, when it is not necessary to distinguish and explain users 16A, 16B, 16C, and 16D, they are simply referred to as "user 16".

[0014] To each of the plurality of users 16, one user device 12 is assigned. To user 16A, user device 12A is assigned. To user 16B, user device 12B is assigned. To user 16C, user device 12C is assigned. To user 16D, user device 12D is assigned. For example, user 16A is the owner of user device 12A, user 16B is the owner of user device 12B, user 16C is the owner of user device 12C, and user 16D is the owner of user device 12D. Note that Although the case where each of the users 16 using the user device 12 is one person is exemplified, two or more users 16 may use one user device 12, and one user 16 may use two or more user devices 12.

[0015] The plurality of user devices 12 are connected to the server 14 via the network 18. The plurality of user devices 12 and the server 14 are communicably connected to the network 18, for example. Also, the network 18 is composed of at least one of, for example, a WAN or a LAN. Further, the plurality of user devices 12 and the network 18, and the server 14 and the network 18 may be connected by a wireless communication method or a wired communication method, respectively. Also, in the example shown in FIG. 1, although not shown, the network 18 includes, for example, a base station. The network 18 establishes communication between the plurality of user devices 12 and the server 14 and performs transmission and reception of various information between the plurality of user devices 12 and the server 14. The server 14 receives a request from the user device 12 via the network 18 and provides a service corresponding to the request to the user device 12 that is the request source via the network 18. Note that the server 14 is an example of an "information processing apparatus" according to the technology of the present disclosure.

[0016] The user device 12 calculates GPS information as position-specifying information that can specify the current position of the user device 12 by using radio waves transmitted from the GPS satellites 20. The GPS information is, for example, latitude and longitude. In the present first embodiment, for convenience of explanation, latitude and longitude are given as an example of the GPS information. However, the technology of the present disclosure is not limited thereto, and the GPS information may be latitude, longitude, and altitude. Note that the GPS information is an example of the "position-specifying information" according to the technology of the present disclosure.

[0017] As shown in FIG. 2 as an example, the user device 12 includes a computer 22, an imaging device 24, a clock 26, a communication I / F 28, a GPS receiver 30, a reception device 32, a display 34, a microphone 36, a speaker 38, and an external I / F 40. The computer 22 includes a CPU 42, a storage 44, and a memory 46. The CPU 42, the storage 44, and the memory 46 are connected to a bus 48. Also, the imaging device 24, the clock 26, the communication I / F 28, the GPS receiver 30, the reception device 32, the display 34, the microphone 36, the speaker 38, and the external I / F 40 are also connected to the bus 48. In the example shown in FIG. 2, for convenience of illustration, one bus is shown as the bus 48. However, the bus 48 includes a data bus, an address bus, a control bus, and the like.

[0018] The CPU 42 controls the entire user device 12. The storage 44 stores various parameters and various programs. The storage 44 is a non-volatile storage device. Here, as an example of the storage 44, an EEPROM is adopted, but it is not limited thereto, and an SSD and / or an HDD or the like may be used. The memory 46 is a volatile storage device. The memory 46 is used as a work memory by the CPU 42 and temporarily stores various information. Here, as an example of the memory 46, a DRAM is adopted, but it is not limited thereto, and other types of volatile storage devices such as an SRAM may be used.

[0019] The imaging device 24 is a device that generates image data. The imaging device 24 has, for example, a CMOS image sensor and is equipped with a zoom mechanism, a focus adjustment mechanism, and the like. Here, as the image sensor included in the imaging device 24, a CMOS image sensor is exemplified, but it is not limited thereto, and other types of image sensors such as a CCD image sensor may also be used. The imaging device 24 captures an object according to an instruction from the CPU 42. Then, the imaging device 24 generates image data indicating the object by capturing the object. The CPU 42 acquires the image data generated by the imaging device 24 and stores the acquired image data in the storage 44.

[0020] The clock 26 acquires the current time. The clock 26 is, for example, an RTC, and receives power supply for driving from a power supply system separated from the power supply system for the computer 22, and continues to count the current time (year / month / day / hour / minute / second) even when the computer 22 is in a shutdown state. Every time the current time is updated, the clock 26 outputs the current time to the CPU 42.

[0021] The communication I / F 28 is connected to the network 18 by a wireless communication method and controls the exchange of various information between the CPU 42 and the server 14 via the network 18.

[0022] The GPS receiver 30 receives radio waves from a plurality of GPS satellites (not shown) including the GPS satellite 20 according to an instruction from the CPU 42 and outputs reception result information indicating the reception result to the CPU 42. The CPU 42 calculates the above-described GPS information based on the reception result information input from the GPS receiver 30.

[0023] The reception device 32 receives instructions from the user 16 or the like. Examples of the reception device 32 include a touch panel 32A and hard keys. The instructions received by the reception device 32 are acquired by the CPU 42. The reception device 32 may receive instructions from the user 16 or the like by voice input via the microphone 36.

[0024] The display 34 displays various information under the control of the CPU 42. As an example of the display 34, a liquid crystal display can be mentioned. Note that not limited to the liquid crystal display, other types of displays such as an organic EL display may be adopted as the display 34.

[0025] In the present first embodiment, an out-cell type touch panel display in which the touch panel 32A is overlaid on the surface of the display area of the display 34 is adopted. However, the out-cell type touch panel display is merely an example, and for example, an on-cell type or in-cell type touch panel display can also be applied.

[0026] The microphone 36 converts the collected sound into an electrical signal and outputs the electrical signal obtained by converting the sound to the CPU 42.

[0027] The speaker 38 converts the electrical signal input from a specific device (for example, the CPU 42) into sound and outputs the sound obtained by converting the electrical signal to the outside of the user device 12.

[0028] The external I / F 40 controls the exchange of various information with devices existing outside the user device 12. As an example of the external I / F 40, a USB interface can be mentioned. A user device, a personal computer, a server, a USB memory, a memory card, and / or a printer, etc. are connected to the USB interface.

[0029] As an example, as shown in FIG. 3, the server 14 includes a computer 50, a communication I / F 52, a reception device 54, a display 56, and an external I / F 58. The computer 50 includes a CPU 60, a storage 62, and a memory 64. The CPU 60, the storage 62, and the memory 64 are connected to a bus 66. Also, the communication I / F 52, the reception device 54, the display 56, and the external I / F 58 are connected to the bus 66. In the example shown in FIG. 3, for the sake of illustration, one bus is shown as the bus 66, but the bus 66 includes a data bus, an address bus, a control bus, and the like.

[0030] The CPU 60 controls the entire server 14. The storage 62 stores various parameters and various programs. The storage 62 is a non-volatile storage device. Here, as an example of the storage 62, an SSD is adopted, but it is not limited thereto, and it may be an EEPROM and / or an HDD or the like. The memory 64 is a volatile storage device. The memory 64 is used as a work memory by the CPU 60 and temporarily stores various information. Here, as an example of the memory 64, a DRAM is adopted, but it is not limited thereto, and other types of volatile storage devices such as SRAM may also be used. Note that the CPU 60 is an example of the "processor" according to the technology of the present disclosure, and the storage 62 and the memory 64 are examples of the "memory" according to the technology of the present disclosure.

[0031] The communication I / F 52 is communicably connected to the network 18 and controls the exchange of various information between the CPU 60 and the user device 12 via the network 18.

[0032] The reception device 54 receives instructions from the administrator or the like of the server 14. Examples of the reception device 54 include a remote controller, a touch panel, a hard key, and / or voice input via a microphone or the like. The instruction received by the reception device 54 is acquired by the CPU 60.

[0033] The display 56 displays various types of information under the control of the CPU 60. As an example of the display 56, a liquid crystal display can be mentioned. Note that not limited to the liquid crystal display, other types of displays such as an EL display may be adopted as the display 56.

[0034] The external I / F 58 controls the exchange of various types of information with devices existing outside the server 14. As an example of the external I / F 58, a USB interface can be mentioned. A user device, a personal computer, a server, a USB memory, a memory card, and / or a printer, etc. are connected to the USB interface.

[0035] By the way, in the information processing system 10, a plurality of user devices 12 upload date-added image data to the server 14, and the server 14 manages the uploaded date-added image data. Here, the date-added image data refers to image data to which a date is attached. The date-added image data is created by the user device 12, for example.

[0036] In the user device 12, the date-added image data is created by executing the date-added image data creation process by the CPU 42. As shown in FIG. 4 as an example, the storage 44 stores a date-added image data creation program 68. The CPU 42 reads out the date-added image data creation program 68 from the storage 44. Then, the CPU 42 operates as an imaging control unit 42A, an image data acquisition unit 42B, a GPS information calculation unit 42C, an attribute data creation unit 42D, and a date-added image data creation unit 42E by executing the date-added image data creation program 68 read out from the storage 44 on the memory 46. That is, the date-added image data creation process is realized by the CPU 42 operating as the imaging control unit 42A, the image data acquisition unit 42B, the GPS information calculation unit 42C, the attribute data creation unit 42D, and the date-added image data creation unit 42E.

[0037] As an example, as shown in FIG. 5, when an instruction to start imaging (hereinafter also referred to as an "imaging start instruction") is received by the reception device 32, the imaging control unit 42A controls the imaging device 24 to cause the imaging device 24 to image a subject. The imaging device 24 generates image data by imaging the subject. The image data acquisition unit 42B acquires the image data from the imaging device 24.

[0038] The GPS information calculation unit 42C calculates GPS information based on the reception result information input from the GPS receiver 30.

[0039] The storage 44 stores a user ID that can identify the user 16. The attribute data creation unit 42D creates attribute data indicating the attributes of the image data acquired by the image data acquisition unit 42B. The timing of creating the attribute data is the timing at which one frame of imaging is performed by the imaging device 24. That is, the attribute data is created by the attribute data creation unit 42D every time one frame of imaging is performed by the imaging device 24.

[0040] The attribute data creation unit 42D acquires the GPS information from the GPS information calculation unit 42C. Also, the attribute data creation unit 42D acquires the user ID from the storage 44. Further, the attribute data creation unit 42D acquires the current time from the clock 26. Then, the attribute data creation unit 42D creates attribute data including the user ID, date, and GPS information. The GPS information is included in the attribute data as information for specifying the imaging position. Also, the attribute data includes Exif information and the like.

[0041] Here, as the date included in the attribute data, the current time acquired from the clock 26 by the attribute data creation unit 42D is adopted. Since the attribute data is created at the timing when one frame of imaging is performed by the imaging device 24 as described above, the date included in the attribute data is the date on which the imaging was performed (hereinafter also referred to as the "imaging date").

[0042] Each time imaging for one frame is performed, the date-added image data creation unit 42E acquires image data from the image data acquisition unit 42B and acquires attribute data from the attribute data creation unit 42D. Then, the date-added image data creation unit 42E creates date-added image data by associating the image data and the attribute data in units of one frame.

[0043] As an example, as shown in FIG. 6, each time the date-added image data creation unit 42E creates date-added image data, the storage 44 stores the date-added image data created by the date-added image data creation unit 42E. The storage 44 holds a plurality of date-added image data (for example, date-added image data for a plurality of frames) as an image data group. In this way, in each of the plurality of user devices 12, date-added image data is created each time imaging is performed, and as shown in FIG. 7 as an example, a plurality of date-added image data are held as an image data group in the storage 44 of each of the plurality of user devices 12.

[0044] As an example, as shown in FIG. 8, each of the plurality of users 16 operates their respective user device 12 to upload the image data group held in the storage 44 to the server 14. In this way, the image data group uploaded to the server 14 is stored and managed in the server 14.

[0045] By the way, in the information processing system 10, when the user 16 has image data without a date (hereinafter, also referred to as "date-less image data"), the user can use the user device 12 to request the server 14 to add a date to the date-less image data. In this case, in the user device 12, the CPU 42 executes date addition request processing to request the server 14 to add a date to the date-less image data.

[0046] As an example, as shown in FIG. 9, the storage 44 stores a date - adding request processing program 70. The CPU 42 reads out the date - adding request processing program 70 from the storage 44. Then, the CPU 42 operates as a request data creation unit 42F, a request data transmission unit 42G, and a display control unit 42H by executing the read - out date - adding request processing program 70 on the memory 46. That is, the date - adding request processing is realized by the CPU 42 operating as the request data creation unit 42F, the request data transmission unit 42G, and the display control unit 42H.

[0047] As an example, as shown in FIG. 10, when an instruction to create request data (hereinafter also referred to as "request data creation instruction") is received by the reception device 32, the request data creation unit 42F creates request data. Here, the request data refers to data indicating a request to the server 14 to assign a date to date-less image data. When the reception device 32 receives a request data creation instruction, first, the request data creation unit 42F acquires the user ID from the storage 44, and acquires date-less image data from an external device (for example, a USB memory or an SSD) via the external I / F 40. Next, the request data creation unit 42F creates request data by associating the acquired user ID and the date-less image data. Then, the request data creation unit 42F outputs the created request data to the request data transmission unit 42G. In the information processing system 10, it is assumed that the user device 12 assigns a user ID as attribute data included in the date-added image data or the date-less image data, but the technology of the present disclosure is not limited to this. For example, a user authentication process for identifying the user 16 who uses the user device 12 may be performed between the server 14 and the user device 12, and the date-added image data or the date-less image data may be generated by associating the uploaded image after authentication with the user ID associated with the authenticated user 16. Further, the user device 12 may assign a device ID for identifying the user device 12 as attribute data included in the date-added image data or the date-less image data, and the server 14 may hold a correspondence list of the user 16 and the device IDs corresponding to each of the users 16 in the storage 62, and the user ID may be specified from the device ID included in the date-added image data or the date-less image data based on the correspondence list.

[0048] The request data transmission unit 42G transmits the request data input from the request data creation unit 42F to the server 14 via the communication I / F 28.

[0049] Server 14 receives the request data transmitted from the request data transmission unit 42G, generates date-added image data by adding a date to the date-less image data included in the received request data, and provides it to the user device 12 of the requester.

[0050] The display control unit 42H causes the display 34 to display an image (hereinafter also referred to as a "date-added image") indicated by the date-added image data provided from the server 14.

[0051] The date-added image data is generated by the CPU 60 of the server 14 executing a date-added image data list creation process (see FIG. 11) and a date addition process (see FIG. 34).

[0052] As shown in FIG. 11 as an example, the storage 62 stores a date-added image data list creation program 72. The CPU 60 reads out the date-added image data list creation program 72 from the storage 62. Then, the CPU 60 executes the date-added image data list creation program 72 read out from the storage 62 on the memory 64, thereby operating as a date-added image data acquisition unit 60A, a user ID extraction unit 60B, a storage control unit 60C, an image data group acquisition unit 60D, a person image data extraction unit 60E, an erasure unit 60F, a GPS information extraction unit 60G, a distribution area map creation unit 60H, a duplicate area ratio calculation unit 60I, a user information acquisition unit 60J, a user information match degree calculation unit 60K, a non-person image data extraction unit 60L, an image data list creation unit 60M, an image data list classification unit 60N, and a determination unit 60P. That is the date-added image data list creation process is realized by the CPU 60 operating as the date-added image data acquisition unit 60A, the user ID extraction unit 60B, the storage control unit 60C, the image data group acquisition unit 60D, the person image data extraction unit 60E, the erasure unit 60F, the GPS information extraction unit 60G, the distribution area map creation unit 60H, the duplicate area ratio calculation unit 60I, the user information acquisition unit 60J, the user information match degree calculation unit 60K, the non-person image data extraction unit 60L, the image data list creation unit 60M, the image data list classification unit 60N, and the determination unit 60P.

[0053] The CPU 60 creates a date-added image data list by executing a date-added image data list creation process. The date-added image data list is created for each subject by classifying a plurality of date-added image data for each subject indicated by each of the plurality of date-added image data. Here, the "subject" refers to a subject whose mode of temporal change can be visually specified. Also, here, the "plurality of date-added image data" to be classified are a plurality of date-added image data with different dates and are image data of a plurality of users 16 including a specific user. The specific user refers to, for example, the user 16 (e.g., the owner of the user device 12) to which the user device 12 that transmitted the requested data to the server 14 is assigned among the plurality of users 16.

[0054] Also, the CPU 60 associates the date-added image data list with a specific user by executing a date-added image data list creation process. The date-added image data list for a subject similar to the subject indicated by the date-added image data of the specific user is associated with the specific user.

[0055] As an example, as shown in FIG. 12, when the image data group transmitted from the user device 12 is received by the communication I / F 52, the date-added image data acquisition unit 60A acquires the image data group received by the communication I / F 52. Then, the date-added image data acquisition unit 60A acquires the date-added image data from the image data group. The user ID extraction unit 60B extracts the user ID from the attribute data included in the date-added image data acquired by the date-added image data acquisition unit 60A. Although the user ID extraction unit 60B is assumed to extract the user ID from the attribute data included in the date-added image data, it is not particularly limited thereto. The server 14 may hold in the storage 62 a list in which the user IDs of a plurality of users are associated with the date-added image data associated with each of the plurality of users 16, and the user ID extraction unit 60B may select the user ID of a predetermined condition or an arbitrary user 16 from the plurality of stored users 16. The predetermined condition may be, for example, the timing when the user 16 uploads the date-added image data via the user device 12.

[0056] As an example, as shown in FIG. 13, the storage 62 stores a registered user list. The registered user list is a list indicating a plurality of user IDs that can identify a group of users who have completed registration agreeing to share information including date-added image data. That is, the plurality of users 16 identified by the plurality of user IDs indicated by the registered user list are a group of users (hereinafter, also referred to as "registered user group") who have completed registration agreeing to share information including date-added image data.

[0057] For the registered user group, further narrowing down is performed by the CPU 60 executing the date-added image data list creation process shown below. As described above, an image data group is associated with each of the plurality of users 16, and the registered user group is narrowed down to users who satisfy the condition that the image data groups are similar to each other. Further, the registered user group is narrowed down to users who satisfy the condition that the registered user information is similar. This will be described in more detail below.

[0058] The determination unit 60P refers to the registered user list in the storage 62 and determines whether the user ID extracted by the user ID extraction unit 60B is a registered user ID. When the determination unit 60P determines that the user ID is a registered user ID, the memory control unit 60C stores the image data group acquired by the date-added image data acquisition unit 60A in the storage 62.

[0059] When the determination unit 60P determines that the user ID extracted by the user ID extraction unit 60B is not a registered user ID, next, the determination unit 60P determines whether the number of groups of the image data groups stored in the storage 62 is plural. When the number of groups of the image data groups stored in the storage 62 is not plural, the determination unit 60P waits until the next determination timing arrives.

[0060] When the determination unit 60P determines that the number of groups of the image data groups stored in the storage 62 is plural, it instructs the image data group acquisition unit 60D to acquire the image data group.

[0061] As an example, as shown in FIG. 14, when the image data group acquisition unit 60D is instructed by the determination unit 60P to acquire an image data group, it acquires the image data group from the storage 62. The person image data extraction unit 60E executes image recognition processing on the date-added image data included in the image data group, extracts person image data indicating a person from the date-added image data, and associates the extracted person image data with the original date-added image data. Then, the person image data extraction unit 60E stores the date-added image data associated with the person image data in the storage 62 for each image data group, thereby returning the date-added image data to the storage 62 for each image data group.

[0062] In the first embodiment, as the image recognition processing, a process of performing image analysis using a cascade classifier is applied. However, this is merely an example, and other image recognition processes such as pattern matching may be used, and any process may be used as long as it can recognize subject image data indicating a specific subject from the date-added image data.

[0063] As an example, as shown in FIG. 15, the determination unit 60P determines, for each image data group stored in the storage 62, whether the number of frames of person image data (hereinafter, also referred to as "same person image data") for the same person is equal to or greater than a first predetermined number of frames (for example, 10). Here, the determination as to whether the data is the same person image data is made based on the image recognition result obtained by executing image recognition processing on the person image data associated with the date-added image data. Here, the first predetermined number of frames is a fixed value. However, this is merely an example, and the first predetermined number of frames may be a natural number of 2 or more, and may be a fixed value or a variable value. Examples of the variable value include a value that can be changed according to an instruction received by the reception device 54, or a value that is periodically changed.

[0064] When the determination unit 60P determines that the number of frames of the same-person image data is less than the first predetermined number of frames, it instructs the deletion unit 60F to delete the image data group to be determined from the image data group to be used for creating the image data list. When the deletion of the image data group is instructed by the determination unit 60P, the deletion unit 60F deletes the image data group to be determined from the image data group to be used for creating the image data list in the storage 62. In this embodiment, the CPU 60 is assumed to have the deletion unit 60F that deletes the image data group to be determined from the image data group to be used for creating the image data list by the determination unit 60P, but it is not limited thereto. For example, the determination unit 60P may have an extraction unit that extracts the image data group to be determined as the image data group to be used for creating the image data list from the storage 44.

[0065] As an example, as shown in FIG. 16, on the other hand, when the determination unit 60P determines that the number of frames of the same-person image data is equal to or greater than the first predetermined number of frames, it determines whether the number of groups of the image data group stored in the storage 62 and determined to have the number of frames of the same-person image data equal to or greater than the first predetermined number of frames is plural. Here, when the number of groups of the image data group is not plural, the determination unit 60P waits until the next determination timing arrives. On the other hand, when the number of groups of the image data group is plural, the determination unit 60P determines for each of the image data groups determined to have the number of frames of the same-person image data equal to or greater than the first predetermined number of frames whether the number of frames of the common same-person image data is equal to or greater than the second predetermined number of frames (for example, 5).

[0066] Here, when there is image data in which the number of frames of the common identical person image data is less than the second predetermined number of frames, the determination unit 60P instructs the deletion unit 60F to delete the image data from the image data group to be used for creating the image data list of the image data group in which the number of frames of the common identical person image data is less than the second predetermined number of frames. When the deletion of the image data group is instructed by the determination unit 60P, the deletion unit 60F deletes the image data group in which the number of frames of the common identical person image data is less than the second predetermined number of frames from the image data group to be used for creating the image data list in the storage 62. On the other hand, when there is an image data group in which the number of frames of the common identical person image data is equal to or greater than the second predetermined number of frames, the determination unit 60P gives an instruction to the image data group acquisition unit 60D to acquire the image data group in which the number of frames of the common identical person image data is equal to or greater than the second predetermined number of frames from the storage 62 as the image data group to be used for creating the image data list.

[0067] As an example, as shown in FIG. 17, when the acquisition of the image data group is instructed by the determination unit 60P, the image data group acquisition unit 60D acquires an image data group in which the number of frames of the common identical person image data is equal to or greater than the second predetermined number of frames from the storage 62. The GPS information extraction unit 60G extracts GPS information from the attribute data in the date-added image data included in the image data group acquired by the image data group acquisition unit 60D.

[0068] As an example, as shown in FIG. 18, the distribution area map creation unit 60H acquires the GPS information extracted by the GPS information extraction unit 60G for each image data group. Then, the distribution area map creation unit 60H creates an imaging position distribution area map of the image data group based on the GPS information for each image data group. The imaging position distribution area map is a map showing the area where the positions where imaging is performed (hereinafter also referred to as "imaging positions") indicated by the GPS information are distributed. In the example shown in FIG. 18, the imaging position distribution area maps of two image data groups are shown, but the technology of the present disclosure is not limited to this, and the imaging position distribution area maps corresponding to the number of groups of the image data group are created.

[0069] As an example, as shown in FIG. 19, the overlapping area ratio calculation unit 60I calculates the ratio of an area where the imaging position distribution area maps overlap between image data groups (hereinafter, also referred to as "overlapping area"). The determination unit 60P determines whether the ratio of the overlapping area is equal to or greater than a preset ratio (e.g., 60%). Here, the preset ratio is a fixed value. However, this is merely an example, and the preset ratio may be a variable value. Examples of the variable value include a value that can be changed according to an instruction accepted by the accepting device 54, or a value that is changed periodically. In the example shown in FIG. 19, the hatched area indicates the overlapping area, which is equal to or greater than the preset ratio.

[0070] 20, when the determination unit 60P determines that the ratio of the overlapping area is less than a preset ratio, the determination unit 60P instructs the erasing unit 60F to erase the image data group that is the determination target. For example, when the ratio of the overlapping area of the imaging position distribution area map between two image data groups is less than a preset ratio, the determination unit 60P instructs the erasing unit 60F to erase the two image data groups.

[0071] The erasing unit 60F creates a list of date-stamped image data from among the multiple date-stamped image data. The date-stamped image data to be targeted is limited to image data obtained by capturing images within a range determined based on GPS information. That is, when the determination unit 60P instructs the deletion of the image data group from the image data group targeted for creating the image data list, the deletion unit 60F deletes the image data group targeted for the determination from the image data group targeted for creating the image data list in the storage 62, thereby limiting the date-stamped image data to be targeted for creating the date-stamped image data list.

[0072] On the other hand, when the determination unit 60P determines that the ratio of overlapping areas among all the image data groups is equal to or greater than the predetermined ratio, it determines whether the number of image data groups stored in the storage 62 is more than one.

[0073] As an example, as shown in FIG. 21, when the number of groups of the image data groups stored in the storage 62 is not plural, the determination unit 60P waits until the next determination timing arrives. On the other hand, when it is determined by the determination unit 60P that the number of groups of the image data groups stored in the storage 62 is plural, the deletion unit 60F acquires, from the distribution area map creation unit 60H, the GPS information outside the overlapping area between the image data groups stored in the storage 62. Then, with reference to the GPS information acquired from the distribution area map creation unit 60H, the deletion unit 60F deletes, from the date-added image data included in the image data groups stored in the storage 62, the date-added image data with GPS information outside the overlapping area from the date-added image data to be the creation target of the image data list.

[0074] As an example, as shown in FIG. 22, user information is associated with the registered user ID in the storage 62. The user information is information regarding the user 16 specified by the corresponding user ID. Examples of the user information include generation-specifying information, family composition information, address information, gender information, occupation information, and hobby information.

[0075] The generation-specific information is information indicating the generation of the user 16. For example, if the user 16 was born in 1975, the information "1970s - 1980s" is used as the generation-specific information. The family composition information is information indicating the family composition of the user 16. Examples of the family composition information include information indicating married, unmarried, the number of older brothers, the number of younger brothers, the number of older sisters, the number of younger sisters, the age difference between siblings, and / or the age of parents, etc. The address information is information indicating the address of the user 16. Examples of the address information include information indicating the country name, prefecture name, and / or city / town / village name, etc. The gender information is information indicating the gender of the user 16. Examples of the gender information include information indicating male and female, etc. The occupation information is information indicating the occupation of the user 16. Examples of the occupation information include information indicating sales occupation, technical occupation, teaching occupation, unemployed, and / or housewife, etc. The hobby information is information indicating the hobbies of the user 16. Examples of the hobby information include outdoor enthusiasts, indoor enthusiasts, golf, soccer, baseball, fishing, movie watching, reading, and / or Internet games, etc.

[0076] The user ID extraction unit 60B extracts the user ID from each of the image data groups stored in the storage 62. The user information acquisition unit 60J acquires the user information corresponding to the user ID extracted by the user ID extraction unit 60B, and associates the acquired user information with the corresponding user ID.

[0077] As shown in FIG. 23 as an example, the user information matching degree calculation unit 60K acquires the user information for each user ID from the user information acquisition unit 60J, and calculates the matching degree of the user information between user IDs (hereinafter, also referred to as "user information matching degree"). The determination unit 60P determines whether there is an image data group in which the user information matching degree is less than a predetermined matching degree (for example, 5%) with any user ID stored in the storage 62. Here, a fixed value is adopted as the predetermined matching degree. However, this is only an example, and the predetermined matching degree may be a variable value. For example, a value that can be changed according to an instruction received by the reception device 54, or a value that is changed periodically can be mentioned as the variable value.

[0078] When there is no group of image data with a user information matching degree less than the predetermined matching degree stored in the storage 62 for any user ID, the determination unit 60P waits until the next determination timing arrives. When there is a group of image data with a user information matching degree less than the predetermined matching degree stored in the storage 62 for any user ID, the determination unit 60P instructs the deletion unit 60F to delete the group of image data to be the target of creating an image data list from the group of image data with a user information matching degree less than the predetermined matching degree. In response to this, the deletion unit 60F deletes the group of image data with a user information matching degree less than the predetermined matching degree from the group of image data to be the target of creating an image data list in the storage 62.

[0079] As shown in FIG. 24 as an example, the date-added image data acquisition unit 60A acquires date-added image data from each group of image data in the storage 62. The non-human image data extraction unit 60L executes image recognition processing on the date-added image data acquired by the date-added image data acquisition unit 60A, extracts non-human image data indicating a non-human from the date-added image data, and associates the extracted non-human image data with the date-added image data of the extraction source. The non-human image data extraction unit 60L stores the date-added image data associated with the non-human image data in the storage 62 for each group of image data, thereby returning the date-added image data to the storage 62 for each group of image data.

[0080] Here, a non-human refers to an object other than a person and is an object whose mode of change over time can be visually specified. Here, examples of the mode of change over time include the mode of an object symbolizing an era. Examples of an object symbolizing an era include a building, a road, a streetscape, a signboard, a poster, and food.

[0081] As an example, as shown in FIG. 25, the image data list creation unit 60M acquires date-added image data (hereinafter also referred to as "date-added image data with person image data") associated with person image data from the storage 62. Further, the image data list creation unit 60M acquires date-added image data (hereinafter also referred to as "date-added image data with non-person image data") associated with non-person image data from the storage 62.

[0082] Then, the image data list creation unit 60M determines whether the person image data is similar among the date-added image data with person image data. Also, the image data list creation unit 60M determines whether the non-person image data is similar among the date-added image data with non-person image data.

[0083] In the example shown in FIG. 25, for the sake of convenience of explanation, only one person image data or non-person image data is associated with one date-added image data, but the technology of the present disclosure is not limited thereto. For example, there may be a mode in which at least one person image data and at least one non-person image data are associated with one date-added image data.

[0084] As an example, as shown in FIGS. 26 to 28, the image data list creation unit 60M creates a date-added image data list for each subject by classifying the date-added image data for each subject shown by each of all the date-added image data stored in the storage 62 as the target for creating the image data list. The date-added image data to be the target for creating the image data list includes, for example, date-added image data respectively associated with a plurality of users. In the example shown in FIGS. 26 to 28, the first to Nth subject image data lists are shown.

[0085] In the example shown in FIG. 26, the first subject image data list and the second subject image data list are It is shown. The first subject image data list is a date - included image data list composed of a plurality of date - included image data in which the first subject is captured. Also, the first subject image data list is, for example, a list formed from the date - included image data included in a plurality of image data groups A to D respectively associated with users 16A to 16D. The second subject image data list is a date - included image data list composed of a plurality of date - included image data in which the second subject is captured. Also, the second subject image data list is, for example, a list formed from the date - included image data included in a plurality of image data groups A and image data group C respectively associated with user 16A and user 16C. In the example shown in FIG. 26, as an example of the first subject, a radio tower is shown, and as an example of the second subject, "XX Soft Cream" is shown. The radio tower and "XX Soft Cream" are non - human objects. Also, the radio tower is an example of the above - mentioned building, and "XX Soft Cream" is an example of the above - mentioned food.

[0086] In the example shown in FIG. 27, a third subject image data list and a fourth subject image data list are shown. The third subject image data list is a date - included image data list composed of a plurality of date - included image data in which the third subject is captured. Also, the third subject image data list is, for example, a list formed from the date - included image data included in a plurality of image data groups A to C respectively associated with users 16A to 16C. The fourth subject image data list is a date - included image data list composed of a plurality of date - included image data in which the fourth subject is captured. Also, the fourth subject image data list is, for example, a list formed from the date - included image data included in a plurality of image data groups A and image data group C respectively associated with user 16A and user 16C. In the example shown in FIG. 27, as an example of the third subject, a soccer player is shown, and as an example of the fourth subject, a woman is shown. The soccer player and the woman are human beings.

[0087] In the example shown in FIG. 28, a fifth subject image data list is shown. The fifth subject image data list is a date-added image data list composed of a plurality of date-added image data in which the fifth subject is captured. Further, the fifth subject image data list is, for example, a list formed from the date-added image data included in a plurality of image data groups A and image data groups D respectively associated with the user 16A and the user 16D. In the example shown in FIG. 28, as an example of the fifth subject, a signboard and posters are shown. The signboard and posters are non-human subjects.

[0088] As shown in FIG. 29 as an example, the image data list classification unit 60N associates a date-added image data list with each of the plurality of users 16 by classifying the date-added image data list created by the image data list creation unit 60M for each user ID. In this case, first, the image data list classification unit 60N extracts the user ID from each of the plurality of date-added image data included in the date-added image data list. Then, the image data list classification unit 60N associates the date-added image data list including the date-added image data whose extraction source is the extracted user ID with the user ID that matches the extracted user ID among the plurality of user IDs stored in the storage 62.

[0089] In this way, by associating a date-added image data list with each of the plurality of user IDs in the storage 62, as shown in FIGS. 30 to 33 as an example, a date-added image data list is associated with each of the plurality of users 16.

[0090] In the example shown in FIG. 30, a state in which the first to fifth subject image data lists are associated with the user 16A is shown. The image data group uploaded from the user device 12A assigned to the user 16A to the server 14 includes date-added image data in which subjects similar to the first to fifth subjects are captured. Therefore, the image data The list classification unit 60N associates the first to fifth subject image data lists related to the first to fifth subjects with the user 16A.

[0091] In the example shown in FIG. 31, a state is shown in which the first subject image data list and the third subject image data list are associated with the user 16B. The image data group uploaded from the user device 12B assigned to the user 16B to the server 14 includes date-added image data in which subjects similar to the first and third subjects are captured. Therefore, the image data list classification unit 60N associates the first subject image data list and the third subject image data list related to the first and third subjects with the user 16B.

[0092] In the example shown in FIG. 32, a state is shown in which the first to fourth subject image data lists are associated with the user 16C. The image data group uploaded from the user device 12C assigned to the user 16C to the server 14 includes date-added image data in which subjects similar to the first to fourth subjects are captured. Therefore, the image data list classification unit 60N associates the first to fourth subject image data lists related to the first to fourth subjects with the user 16C.

[0093] In the example shown in FIG. 33, a state is shown in which the first subject image data list and the fifth subject image data list are associated with the user 16D. The image data group uploaded from the user device 12D assigned to the user 16D to the server 14 includes date-added image data in which subjects similar to the first and fifth subjects are captured. Therefore, the image data list classification unit 60N associates the first subject image data list and the fifth subject image data list related to the first and fifth subjects with the user 16D.

[0094] As shown in FIG. 34 as an example, a date - adding processing program 74 is stored in the storage 62. The CPU 60 reads the date - adding processing program 74 from the storage 62. Then, the CPU 60 executes the date - adding processing program 74 read from the storage 62 on the memory 64, and operates as a user ID extraction unit 60B, a determination unit 60P, an image data list acquisition unit 60Q, a date - less image data extraction unit 60R, a date derivation unit 60S, a date - adding unit 60T, and an image data transmission unit 60U. That is, the date - adding processing is realized by the CPU 60 operating as the user ID extraction unit 60B, the determination unit 60P, the image data list acquisition unit 60Q, the date - less image data extraction unit 60R, the date derivation unit 60S, the date - adding unit 60T, and the image data transmission unit 60U.

[0095] By executing the date - adding processing, the CPU 60 acquires date - added image data about a subject similar to the subject indicated by the date - less image data of a specific user from the list of date - added image data associated with the specific user. Also, by executing the date - adding processing, the CPU 60 derives the date to be added to the date - less image data based on the date attached to the acquired date - added image data, and attaches the derived date to the date - less image data. This will be described in more detail below.

[0096] As shown in FIG. 35 as an example, when a date - adding request process (see FIG. 9) is executed by the CPU 42 of the user device 12, request data is transmitted to the server 14 by the request data transmission unit 42G (see FIG. 10), and the request data is received by the communication I / F 52 of the server 14. The user ID extraction unit 60B extracts the user ID from the request data received by the communication I / F 52, and outputs the extracted user ID to the image data list acquisition unit 60Q.

[0097] As shown in FIG. 36 as an example, the image data list acquisition unit 60Q acquires a list of date - added image data corresponding to the user ID input from the user ID extraction unit 60B from the storage 62.

[0098] As an example, as shown in FIG. 37, the date-less image data extraction unit 60R extracts date-less image data from the request data received by the communication I / F 52, and outputs the extracted date-less image data to the determination unit 60P. The determination unit 60P determines whether there is date-containing image data similar to the date-less image data input from the date-less image data extraction unit 60R in the date-containing image data list acquired by the image data list acquisition unit 60Q. Here, "similar" means being identical within a predetermined error range. The predetermined error may be a fixed value or a variable value.

[0099] Examples of the variable value include a value that can be changed according to an instruction received by the reception device 54, a value that is changed according to the number of frames of the date-containing image data included in the date-containing image data list, a value determined according to the degree of variation (e.g., variance or standard deviation) of the dates assigned to the date-containing image data included in the date-containing image data list, a value changed according to the user 16 who provided the date-less image data, and / or a value that is periodically changed.

[0100] As an example, as shown in FIG. 38, when the determination unit 60P determines that there is no date-containing image data similar to the date-less image data input from the date-less image data extraction unit 60R in the date-containing image data list acquired by the image data list acquisition unit 60Q, it waits until the next determination timing arrives. On the other hand, when the determination unit 60P determines that there is date-containing image data similar to the date-less image data input from the date-less image data extraction unit 60R in the date-containing image data list acquired by the image data list acquisition unit 60Q, it determines whether the number of frames of the date-containing image data similar to the date-less image data is plural.

[0101] When the determination unit 60P determines that there are not multiple frames of date-added image data similar to the date-less image data, the date derivation unit 60S extracts the date from the date-added image data to be determined, that is, the date-added image data similar to the date-less image data. When the determination unit 60P determines that there are multiple frames of date-added image data similar to the date-less image data, the date derivation unit 60S extracts the date from each of the multiple date-added image data to be determined, that is, the multiple date-added image data similar to the date-less image data. Then, the date derivation unit 60S derives the date of the date-less image data based on the multiple dates extracted from each of the multiple date-added image data. The date derived by the date derivation unit 60S may be only the year, month, and day, only the year and month, or only the year among the year, month, day, hour, minute, and second.

[0102] Here, the date derived by the date derivation unit 60S as the date of the date-less image data is, for example, a date based on the average value of the multiple dates extracted from each of the multiple date-added image data. The date based on the average value of the multiple dates refers to, for example, the date obtained by rounding the average value of the multiple dates.

[0103] Note that here, a date based on the average value of multiple dates is exemplified, but the technology of the present disclosure is not limited to this, and it may be the most frequent value or the median value among the multiple dates. When the date derived as the date of the date-less image data is the most frequent value or the median value among the multiple dates, it may be the most frequent value or the median value of the period with the highest date density among the periods in which the multiple dates are distributed. Also, the date of the date-less image data with the highest similarity to the date-less image data may be derived by the date derivation unit 60S as the date of the date-less image data. derived in this way.

[0104] The date derivation unit 60S outputs the date derived as the date of the date-less image data to the date assignment unit 60T. The date assignment unit 60T assigns the date input from the date derivation unit 60S to the date-less image data extracted from the request data by the date-less image data extraction unit 60R, that is, the date-less image data compared with the date-containing image data by the determination unit 60P. In this way, by assigning a date to the date-less image data, a date is assigned to the date-less image data. In this way, the date assignment unit 60T assigns a date to the date-less image data, thereby generating date-assigned image data.

[0105] The image data transmission unit 60U transmits the date-assigned image data generated by the date assignment unit 60T to the user device 12A, which is the source of the request data, via the communication I / F 52. As a result, the date-assigned image data is provided to the user 16 assigned to the user device 12A, which is the source of the request data.

[0106] Next, the operation of the information processing system 10 will be described.

[0107] First, the date-containing image data list creation process executed by the CPU 60 of the server 14 will be described with reference to FIGS. 39A to 39E. The flow of the date-containing image data list creation process shown in FIGS. 39A to 39E is an example of the "information processing method" according to the technology of the present disclosure.

[0108] In the date-added image data list creation process shown in FIG. 39A, first, in step ST10, the determination unit 60P determines whether the image data group transmitted from the user device 12 has been received by the communication I / F 52. In step ST10, if the image data group transmitted from the user device 12 has not been received by the communication I / F 52, the determination is negative, and the date-added image data list creation process proceeds to step ST80 shown in FIG. 39E. In step ST10, if the image data group transmitted from the user device 12 has been received by the communication I / F 52, the determination is positive, and the date-added image data list creation process proceeds to step ST12.

[0109] In step ST12, the date-added image data acquisition unit 60A acquires the date-added image data from the image data group received by the communication I / F 52, and then the date-added image data list creation process proceeds to step ST14.

[0110] In step ST14, the user ID extraction unit 60B extracts the user ID from the date-added image data acquired in step ST12, and then the date-added image data list creation process proceeds to step ST16.

[0111] In step ST16, the determination unit 60P determines whether the user ID extracted in step ST14 is registered. The determination of whether the user ID is registered is made by determining whether the user ID is included in the registered user list in the storage 62. In step ST16, if the user ID extracted in step ST14 is not registered, the determination is negative, and the date-added image data list creation process proceeds to step ST20. In step ST16, if the user ID extracted in step ST14 is registered, the determination is positive, and the date-added image data list creation process proceeds to step ST18.

[0112] In step ST18, the memory control unit 60C stores the image data group that was the source of the date-added image data in step ST12 in the storage 62, and then, the date-added image data list creation process proceeds to step ST20.

[0113] In step ST20, the determination unit 60P determines whether or not two or more groups of image data are stored in the storage 62. In step ST20, if two or more groups of image data are not stored in the storage 62, the determination is negative and the date-added image data list creation process proceeds to step ST10. In step ST20, if two or more groups of image data are stored in the storage 62, the determination is positive and the date-added image data list creation process proceeds to step ST22.

[0114] In step ST22, the image data group acquisition unit 60D acquires one unprocessed group of image data from the storage 62. In step ST22, one unprocessed group of image data refers to a group of image data for which the processing in steps ST24 to ST30 has not yet been performed. After the process of step ST22 is executed, the date-added image data list creation process proceeds to step ST24.

[0115] In step ST24, the person image data extraction unit 60E extracts person image data from each of the date-added image data included in the image data group acquired in step ST22, and associates the extracted person image data with the date-added image data from which it was extracted. Then, the person image data extraction unit 60E stores the date-added image data associated with the person image data in the storage 62 for each image data group, thereby returning the date-added image data to the storage 62. After the process of step ST24 is executed, the date-added image data list creation process proceeds to step ST26.

[0116] In step ST26, the determination unit 60P determines whether the number of frames of the same-person image data in the latest image data group stored in the storage 62 in step ST24 is equal to or greater than a first predetermined number of frames. In step ST26, if the number of frames of the same-person image data is less than the first predetermined number of frames, the determination is negative, and the date-added image data list creation process proceeds to step ST34 shown in FIG. 39B. In step ST26, if the number of frames of the same-person image data is equal to or greater than the first predetermined number of frames, the determination is positive, and the date-added image data list creation process proceeds to step ST28.

[0117] In step ST28, the determination unit 60P determines whether a group of image data for which a positive determination has been made is stored in the storage 62. Here, the group of image data for which a positive determination has been made refers to the group of image data for which the determination was positive in step ST26. In step ST28, if a group of image data for which a positive determination has been made is not stored in the storage 62, the determination is negative, and the date-added image data list creation process proceeds to step ST80 shown in FIG. 39E. In step ST28, if a group of image data for which a positive determination has been made is stored in the storage 62, the determination is positive, and the date-added image data list creation process proceeds to step ST30.

[0118] In step ST30, the determination unit 60P determines whether the latest image data group for which the determination was positive in step ST26 contains the same-person image data in common with the group of image data for which a positive determination has been made and equal to or greater than a second predetermined number of frames. In step ST30, if the latest image data group for which the determination was positive in step ST26 does not contain the same-person image data in common with the group of image data for which a positive determination has been made and equal to or greater than the second predetermined number of frames, the determination is negative, and the date-added image data list creation process proceeds to step ST34 shown in FIG. 39B. In step ST30, if the latest image data group for which the determination was positive in step ST26 contains the same-person image data in common with the group of image data for which a positive determination has been made and equal to or greater than the second predetermined number of frames, the determination is positive, and the date-added image data list creation process proceeds to step ST32.

[0119] In step ST32, the determination unit 60P determines whether the processes of steps ST24 to ST30 have been performed on all the image data groups stored in the storage 62. In step ST32, if the processes of steps ST24 to ST30 have not been performed on all the image data groups stored in the storage 62, the determination is negative, and the date-added image data list creation process proceeds to step ST20. In step ST32, if the processes of steps ST24 to ST30 have been performed on all the image data groups stored in the storage 62, the determination is affirmative, and the date-added image data list creation process proceeds to step ST38 shown in FIG. 39C.

[0120] In step ST34 shown in FIG. 39B, the deletion unit 60F deletes the image data group to be processed from the storage 62, and then the date-added image data list creation process proceeds to step ST36.

[0121] In this step ST34, the image data group to be processed refers to the image data group determined by the determination unit 60P that the number of frames of the same-person image data is less than the first predetermined number of frames, and the latest image data group determined by the determination unit 60P that the same-person image data common to the image data group with an affirmative determination does not contain the second predetermined number of frames or more.

[0122] In this step ST34, the image data group erased by the erasing unit 60F is an image data group that does not satisfy the conditions determined in step ST26 or step ST30. This means that the image data group erased by the erasing unit 60F is an image data group that is not similar to other image data groups stored in the storage 62. Also, the image data group corresponds one-to-one to the registered user 16. Therefore, by erasing the image data group by the erasing unit 60F in this step ST34, the image data groups provided by the registered users 16 that satisfy the condition of being similar to each other are narrowed down as candidates for creating the dated image data list.

[0123] In step ST36, the determination unit 60P determines whether the processes of steps ST24 to ST30 have been performed on all the image data groups stored in the storage 62. In step ST36, if the processes of steps ST24 to ST30 have not been performed on all the image data groups stored in the storage 62, the determination is negative and the dated image data list creation process proceeds to step ST20. In step ST36, if the processes of steps ST24 to ST30 have been performed on all the image data groups stored in the storage 62, the determination is positive and the dated image data list creation process proceeds to step ST37.

[0124] In step ST37, the determination unit 60P determines whether two or more image data groups are stored in the storage 62. In step ST37, if two or more image data groups are not stored in the storage 62, the determination is negative and the dated image data list creation process proceeds to step ST80 shown in FIG. 39E. In step ST37, if two or more image data groups are stored in the storage 62, the determination is positive and the dated image data list creation process proceeds to step ST38 shown in FIG. 39C.

[0125] In step ST38 shown in FIG. 39C, the image data group acquisition unit 60D acquires one unprocessed image data group from the storage 62. In step ST38, one unprocessed image data group refers to an image data group for which the processing in steps ST40 to ST46 has not yet been performed. After the processing of step ST38 is executed, the date-added image data list creation process proceeds to step ST40.

[0126] In step ST40, the GPS information extraction unit 60G extracts GPS information from the attribute data in the date-added image data included in the image data group acquired in step ST38, and then the date-added image data list creation process proceeds to step ST42. In step ST42, the distribution area map creation unit 60H creates an imaging position distribution area map of the image data group based on the GPS information extracted in step ST40, and then the date-added image data list creation process proceeds to step ST44.

[0127] In step ST44, the determination unit 60P determines whether there is an imaging position distribution area map to be compared with the imaging position distribution area map created in step ST42, that is, whether there is another imaging position distribution area map. In step ST44, if there is no imaging position distribution area map to be compared with the imaging position distribution area map created in step ST42, the determination is negative and the date-added image data list creation process proceeds to step ST50. In step ST44, if there is an imaging position distribution area map to be compared with the imaging position distribution area map created in step ST42, the determination is negative and the date-added image data list creation process proceeds to step ST46.

[0128] In step ST44, the determination unit 60P determines whether there is an imaging position distribution area map to be compared with the imaging position distribution area map created in step ST42, that is, whether there is another imaging position distribution area map. In step ST44, if there is no imaging position distribution area map to be compared with the imaging position distribution area map created in step ST42, the determination is negative and the date-added image data list creation process proceeds to step ST50. In step ST44, if there is an imaging position distribution area map to be compared with the imaging position distribution area map created in step ST42, the determination is negative and the date-added image data list creation process proceeds to step ST46.

[0129] In step ST46, the overlapping area ratio calculation unit 60I calculates the ratio of the overlapping area between the imaging position distribution area diagram created in step ST42 and other imaging position distribution area diagrams, and then the date-added image data list creation process proceeds to step ST48. Here, other imaging position distribution area diagrams refer to existing imaging position distribution area diagrams, that is, all imaging position distribution area diagrams created before the imaging position distribution area diagram created in step ST42 (hereinafter also referred to as "all imaging position distribution area diagrams").

[0130] In step ST48, the determination unit 60P determines whether the ratio calculated for all imaging position distribution area diagrams in step ST46 is equal to or greater than a predetermined ratio. In step ST48, if the ratio calculated for all imaging position distribution area diagrams in step ST46 is less than the predetermined ratio, the determination is negative, and the date-added image data list creation process proceeds to step ST60 shown in FIG. 39D. In step ST48, if the ratio calculated for all imaging position distribution area diagrams in step ST46 is equal to or greater than the predetermined ratio, the determination is positive, and the date-added image data list creation process proceeds to step ST50.

[0131] In step ST50, the determination unit 60P determines whether the processes of steps ST40 to ST48 have been performed for all image data groups stored in the storage 62. In step ST50, if the processes of steps ST40 to ST48 have not been performed for all image data groups stored in the storage 62, the determination is negative, and the date-added image data list creation process proceeds to step ST38. In step ST50, if the processes of steps ST40 to ST48 have been performed for all image data groups stored in the storage 62, the determination is positive, and the date-added image data list creation process proceeds to step ST52.

[0132] In step ST60 shown in FIG. 39D, the deletion unit 60F deletes the image data group to be processed from the storage 62, and then the date-added image data list creation process proceeds to step ST62.

[0133] In this step ST60, the image data group to be processed refers to the image data group determined by the determination unit 60P that the ratio calculated for the entire imaging position distribution area map is not equal to or greater than the predetermined ratio.

[0134] The image data group erased by the erasing unit 60F in this step ST60 is an image data group that does not satisfy the conditions defined in step ST48. This means that the image data group erased by the erasing unit 60F is an image data group that is not similar to other image data groups stored in the storage 62. Also, the image data group corresponds one-to-one to the registered user 16. Therefore, when the image data group is erased by the erasing unit 60F in this step ST60, the image data groups provided by the registered users 16 that satisfy the condition that the image data groups are similar to each other (for example, the geographical distribution of the imaging positions among the image data groups is similar) are narrowed down as candidates for creating the date-added image data list.

[0135] In step ST62, the determination unit 60P determines whether the processes of steps ST40 to ST48 have been performed for all the image data groups stored in the storage 62. In step ST62, if the processes of steps ST40 to ST48 have not been performed for all the image data groups stored in the storage 62, the determination is negative, and the date-added image data list creation process proceeds to step ST38 shown in FIG. 39C. In step ST62, if the processes of steps ST40 to ST48 have been performed for all the image data groups stored in the storage 62, the determination is positive, and the date-added image data list creation process proceeds to step ST52 shown in FIG. 39C.

[0136] In step ST52 shown in FIG. 39C, the determination unit 60P determines whether two or more groups of image data groups are stored in the storage 62. In step ST52, if two or more groups of image data groups are not stored in the storage 62, the determination is negative, and the date-added image data list creation process proceeds to step ST80 shown in FIG. 39E. In step ST52, if two or more groups of image data groups are stored in the storage 62, the determination is positive, and the date-added image data list creation process proceeds to step ST54.

[0137] In step ST54, the deletion unit 60F deletes the date-added image data whose imaging positions are distributed outside the overlapping region of the imaging position distribution diagrams of each image data group stored in the storage 62, and then the date-added image data list creation process proceeds to step ST56.

[0138] In step ST56, the user ID extraction unit 60B extracts the user ID from all the image data groups stored in the storage 62, and then the date-added image data list creation process proceeds to step ST58.

[0139] In step ST58, the user information acquisition unit 60J acquires the user information corresponding to the user ID extracted from all the image data groups in step ST56 from the storage 62, and then the date-added image data list creation process proceeds to step ST64 shown in FIG. 39E.

[0140] In step ST64 shown in FIG. 39E, the user information matching degree calculation unit 60K calculates the user information matching degree between the image data groups using all the user information acquired in step ST58, and then the date-added image data list creation process proceeds to step ST66.

[0141] In step ST66, the determination unit 60P determines whether there is a group of image data whose user information matching degree calculated in step ST64 is less than the predetermined matching degree. In step ST66, if there is no group of image data whose user information matching degree calculated in step ST64 is less than the predetermined matching degree, the determination is negative, and the date-added image data list creation process proceeds to step ST70. In step ST66, if there is a group of image data whose user information matching degree calculated in step ST64 is less than the predetermined matching degree, the determination is affirmative, and the date-added image data list creation process proceeds to step ST68.

[0142] In step ST68, the deletion unit 60F deletes from the storage 62 the group of image data whose user information matching degree calculated in step ST64 is less than the predetermined matching degree, and then the date-added image data list creation process proceeds to step ST70.

[0143] The group of image data deleted by the deletion unit 60F in this step ST68 is the group of image data whose user information matching degree calculated in step ST64 is less than the predetermined matching degree. This means that the group of image data deleted by the deletion unit 60F is a group of image data that is not similar to other groups of image data stored in the storage 62. Also, the group of image data corresponds one-to-one to the registered user 16. Therefore, by deleting the group of image data by the deletion unit 60F in this step ST68, the group of image data provided by the registered user 16 that satisfies the condition of being similar to each other is narrowed down as the target for creating the date-added image data list.

[0144] In step ST70, the image data group acquisition unit 60D acquires one piece of unprocessed date-added image data from the storage 62. In step ST70, one piece of unprocessed date-added image data refers to image data for which the processing in steps ST72 to ST78 has not yet been performed. After the process of step ST70 is executed, the date-added image data list creation process proceeds to step ST72.

[0145] In step ST72, the non-human image data extraction unit 60L extracts non-human image data from the date-added image data acquired in step ST70, and associates the extracted non-human image data with the date-added image data of the extraction source. Then, the non-human image data extraction unit 60L stores the date-added image data associated with the non-human image data in the storage 62 for each group of image data, thereby returning the date-added image data to the storage 62. After the process of step ST72 is executed, the date-added image data list creation process proceeds to step ST74.

[0146] In step ST74, the determination unit 60P determines whether the process of step ST72 has been performed on all the date-added image data stored in the storage 62. In step ST74, if the process of step ST72 has not been performed on all the date-added image data stored in the storage 62, the determination is negative, and the date-added image data list creation process proceeds to step ST70. In step ST74, if the process of step ST72 has been performed on all the date-added image data stored in the storage 62, the determination is positive, and the date-added image data list creation process proceeds to step ST76.

[0147] In step ST76, the image data list creation unit 60M acquires the date-added image data with person image data from the storage 62, and determines whether the person image data is similar among the date-added image data with person image data. Also, the image data list creation unit 60M acquires the date-added image data with non-human image data from the storage 62, and determines whether the non-human image data is similar among the date-added image data with non-human image data. Then, the image data list creation unit 60M classifies the date-added image data for each subject indicated by each of all the date-added image data stored in the storage 62, thereby creating a date-added image data list for each subject. After that, the date-added image data list creation process proceeds to step ST78.

[0148] In step ST78, the image data list classification unit 60N classifies the date-added image data list created by the image data list creation unit 60M for each user ID, thereby associating a date-added image data list with each of a plurality of users 16. Thereafter, the date-added image data list creation process proceeds to step ST80.

[0149] In step ST80, the determination unit 60P determines whether or not a condition for ending the date-added image data list creation process (hereinafter, also referred to as the "image data list creation process end condition") is satisfied. As an example of the image data list creation process end condition, there is a condition that an instruction to end the date-added image data list creation process is given to the server 14. The instruction to end the date-added image data list creation process is received, for example, by the reception device 54. In step ST80, if the image data list creation process end condition is not satisfied, the determination is negative and the date-added image data list creation process proceeds to step ST10 shown in FIG. 39A. In step ST80, if the image data list creation process end condition is satisfied, the determination is positive and the date-added image data list creation process ends.

[0150] Next, the date assignment process executed by the CPU 60 of the server 14 will be described with reference to FIG. 40. Note that the flow of the date assignment process shown in FIG. 40 is an example of the "information processing method" according to the technology of the present disclosure.

[0151] In the date assignment process shown in FIG. 40, first, in step ST100, the determination unit 60P determines whether or not the request data transmitted from the user device 12 has been received by the communication I / F 52. In step ST100, if the request data transmitted from the user device 12 has not been received by the communication I / F 52, the determination is negative and the date assignment process proceeds to step ST120. In step ST100, if the request data transmitted from the user device 12 has been received by the communication I / F 52, the determination is positive and the date assignment process proceeds to step ST102.

[0152] In step ST102, the user ID extraction unit 60B extracts the user ID from the request data received by the communication I / F 52, and then the date assignment process proceeds to step ST104.

[0153] In step ST104, the image data list acquisition unit 60Q acquires the date-added image data list corresponding to the user ID extracted in step ST102 from the storage 62, and then the date assignment process proceeds to step ST106.

[0154] In step ST106, the date-less image data extraction unit 60R extracts the date-less image data from the source request data from which the user ID was extracted in step ST102, and then the date assignment process proceeds to step ST108.

[0155] In step ST108, the determination unit 60P determines whether there is date-added image data similar to the date-less image data extracted in step ST106 in the date-added image data list acquired in step ST104. In step ST108, if there is no date-added image data similar to the date-less image data extracted in step ST106 in the date-added image data list acquired in step ST104, the determination is negative and the date assignment process proceeds to step ST120. In step ST108, if there is date-added image data similar to the date-less image data extracted in step ST106 in the date-added image data list acquired in step ST104, the determination is positive and the date assignment process proceeds to step ST110.

[0156] In step ST110, the determination unit 60P determines whether there are a plurality of frames of date-added image data similar to the date-less image data extracted in step ST106. In step ST110, if there is a single frame of date-added image data similar to the date-less image data extracted in step ST106, the determination is negative, and the date assignment process proceeds to step ST114. In step ST110, if there are a plurality of frames of date-added image data similar to the date-less image data extracted in step ST106, the determination is positive, and the date assignment process proceeds to step ST112. If there are a plurality of frames of date-added image data similar to the date-less image data extracted in step ST106, the determination is positive, and the date assignment process proceeds to step ST112.

[0157] In step ST112, the date derivation unit 60S extracts the date from each of the plurality of date-added image data similar to the date-less image data extracted in step ST106. Then, based on the plurality of dates extracted from each of the plurality of date-added image data, the date derivation unit 60S derives the date of the date-less image data, and then the date assignment process proceeds to step ST116.

[0158] In step ST114, the date derivation unit 60S extracts the date from the date-added image data similar to the date-less image data extracted in step ST106, and then the date assignment process proceeds to step ST116.

[0159] In step ST116, the date assignment unit 60T generates date-assigned image data by assigning the date derived in step ST112 or the date extracted in step ST114 to the date-less image data extracted in step ST106, and then the date assignment process proceeds to step ST118.

[0160] In step ST118, the image data transmission unit 60U transmits the date-assigned image data generated in step ST116 to the user device 12 of the transmission source of the request data via the communication I / F 52, and then the date assignment process proceeds to step ST120.

[0161] In step ST120, the determination unit 60P determines whether a condition for ending the date assignment process (hereinafter also referred to as the "date assignment process end condition") is satisfied. As an example of the date assignment process end condition, there is a condition that an instruction to end the date assignment process is given to the server 14. The instruction to end the date assignment process is received, for example, by the reception device 54. In step ST120, if the date assignment process end condition is not satisfied, the determination is negative and the date assignment process proceeds to step ST100. In step ST120, if the date assignment process end condition is satisfied, the determination is affirmative and the date assignment process ends.

[0162] Next, the date assignment request process executed by the CPU 42 of the user device 12 will be described with reference to FIG. 41. Here, it is assumed that the request data has already been created by the request data creation unit 42F.

[0163] In the date assignment request process shown in FIG. 41, first, in step ST150, the request data transmission unit 42G transmits the request data created by the request data creation unit 42F to the server 14 via the communication I / F 28, and then the date assignment request process proceeds to step ST152.

[0164] When the request data is transmitted to the server 14 by executing the process of step ST150, in response, the server 14 generates the date-assigned image data as described above and transmits the generated date-assigned image data to the user device 12 that is the transmission source of the request data.

[0165] Therefore, in step ST152, the display control unit 42H determines whether the date-assigned image data has been received by the communication I / F 28. In step ST152, if the date-assigned image data has not been received by the communication I / F 28, the determination is negative and the date assignment process proceeds to step ST156. In step ST152, if the date-assigned image data has been received by the communication I / F 28, the determination is affirmative and the date The assignment process proceeds to step ST154.

[0166] In step ST154, the display control unit 42H causes the display 34 to display the date-assigned image indicated by the date-assigned image data received by the communication I / F 28. Then, the date assignment request process proceeds to step ST156. By executing the process of this step ST154, the date-assigned image is displayed on the display 34. As a result, the date derived by the date derivation unit 60S is presented to the specific user via the display 34. Note that the display 34 is an example of the "presentation device" according to the technology of the present disclosure.

[0167] In step ST156, the determination unit 60P determines whether or not a condition for ending the date assignment request process (hereinafter also referred to as the "date assignment request process end condition") is satisfied. As an example of the date assignment request process end condition, there is a condition that an instruction to end the date assignment request process is given to the user device 12. The instruction to end the date assignment request process is received, for example, by the reception device 32. In step ST156, if the date assignment process request end condition is not satisfied, the determination is negative, and the date assignment request process proceeds to step ST150. In step ST156, if the date assignment request process end condition is satisfied, the determination is affirmative, and the date assignment request process ends.

[0168] As described above, in the first embodiment, in server 14, the CPU 60 creates a list of date-added image data by classifying a plurality of pieces of date-added image data, and associates the list of date-added image data with a specific user. The plurality of pieces of date-added image data are image data for a plurality of users 16 including the specific user. The list of date-added image data is created for each subject by classifying the plurality of pieces of date-added image data for each subject indicated by each of the plurality of pieces of date-added image data. The specific user is associated with a list of date-added image data for a subject similar to the subject indicated by the date-added image data of the specific user. Further, from the list of date-added image data associated with the specific user, the CPU 60 acquires date-added image data for a subject similar to the subject indicated by the date-less image data provided by the specific user. Then, based on the date assigned to the acquired date-added image data, the CPU 60 derives the date to be assigned to the date-less image data.

[0169] Therefore, according to this configuration, compared with the case of deriving the date to be assigned to the date-less image data based only on the date-added image data owned by the specific user, an appropriate date can be assigned to the date-less image data.

[0170] Also, in the first embodiment, in server 14, the list of date-added image data is created by classifying a plurality of pieces of date-added image data for each subject whose mode of change over time can be visually identified. Therefore, according to this configuration, compared with the case where a plurality of pieces of date-added image data are classified for each subject whose mode of change over time cannot be visually identified, a list of date-added image data can be created for each subject that can be visually distinguished.

[0171] Also, in the first embodiment, in server 14, a list including a plurality of date-added image data with different dates is created as a date-added image data list. The date given to the date-added image data is the imaging date. Therefore, according to this configuration, an appropriate date can be assigned to the date-less image data as compared with the case where all the dates given to the plurality of date-added image data included in the date-added image data are the same date.

[0172] Also, in the first embodiment, the plurality of users 16 are a group of users who satisfy the condition that they have completed registration agreeing to share information including date-added image data. Therefore, according to this configuration, it is possible to suppress the use of the date-added image data provided to the server 14 from a person who does not desire to share the information including the date-added image data, as compared with the case of processing using all the date-added image data provided to the server 14 regardless of whether the registration agreeing to share the information including the date-added image data has been completed or not. That is, it is possible to contribute to the protection of personal information.

[0173] Also, in the first embodiment, an image data group is associated with each of the plurality of users 16, and the plurality of users 16 are a group of users who satisfy the condition that the image data groups are similar to each other. Therefore, according to this configuration, the processing load required to derive an appropriate date to be assigned to the date-less image data can be reduced as compared with the case of deriving the date by referring to the date-added image data provided to the server 14 from a person who does not satisfy the condition that the image data groups are similar to each other among the users 16. Also, since only the image data groups provided from the group of users who satisfy the condition that the image data groups are similar to each other are used, it is possible to contribute to the protection of personal information.

[0174] Also, in the present first embodiment, the plurality of users 16 are a group of users who satisfy the condition that the registered user information is similar. Therefore, according to this configuration, compared with the case of deriving the date using the date-added image data provided to the server 14 from a person whose registered user information is not similar, the processing load required to derive an appropriate date to be assigned to the date-less image data can be reduced. Further, since only the image data group provided from the group of users who satisfy the condition that the registered user information is similar is used, it is possible to contribute to the protection of personal information.

[0175] Also, in the present first embodiment, in the server 14, among the plurality of date-added image data, the date-added image data to be the target for creating the date-added image data list is limited to the image data obtained by being captured within the range determined based on the GPS information. Therefore, according to this configuration, compared with the case of deriving the date with reference to the date-added image data obtained by being captured outside the range determined based on the GPS information, the processing load required to derive an appropriate date to be assigned to the date-less image data can be reduced.

[0176] Furthermore, in the present first embodiment, a date-added image is displayed on the display 34. That is, the date assigned to the date-less image data is displayed on the display 34. Therefore, according to this configuration, it is possible to make the user aware of the date assigned to the date-less image data.

[0177] In the above first embodiment, an example of the form in which the date-added image data list is updated is not given, but the technology of the present disclosure is not limited to this. For example, the CPU 42 may update the date-added image data list associated with a specific user according to an instruction received by the reception device 32 or 54. In this case, some of the plurality of date-added image data may be reduced from the date-added image data list according to an instruction received by the reception device 32 or 54, or the latest date-added image data uploaded from the user device 12 may be added to a specific date-added image data list, so that the date-added image data list may be updated. Further, the specific date-added image data list may be updated by adding new date-added image data (see FIG. 43) generated based on the date-added image data to a specific date-added image data list.

[0178] In this way, by updating the date-added image data list associated with a specific user according to an instruction given from the outside, the content of the date-added image data list can be made to reflect the intention of the user 16.

[0179] In the above first embodiment, an example in which date-added image data is uploaded from the user device 12 to the server 14 has been described, but the technology of the present disclosure is not limited to this. For example, a group of image data associated with a plurality of users 16 may be stored in advance in the storage 62. Further, the server 14 may capture a group of image data associated with a plurality of users 16 from another device (such as a USB memory or a memory card) via the external I / F 58. Also in this case, the group of image data is stored in the storage 62 in a state associated with a plurality of users 16.

[0180] In the first embodiment described above, an example of a form in which the display 34 is caused to display the date given to the date-less image data has been described. However, the technology of the present disclosure is not limited to this. For example, instead of the visual presentation of the date by the display 34, or together with the visual presentation of the date by the display 34, a voice indicating the date may be output from the speaker 38 (see FIG. 2). Further, the date may be printed on a recording medium (for example, paper) by a printer (not shown).

[0181] In the first embodiment described above, an example of a form in which the date-added image data creation process and the date addition request process are executed by the user device 12, and the date-added image data list creation process and the date addition process are executed by the server 14 has been described. However, the technology of the present disclosure is not limited to this. For example, the date-added image data creation process, the date addition request process, the date-added image data list creation process, and the date addition process may be executed by one device (for example, the user device 12, the server 14, or a personal computer, etc.). Further, at least one of the date-added image data creation process, the date addition request process, the date-added image data list creation process, and the date addition process may be executed distributively by a plurality of devices. For example, the date-added image data list creation process and the date addition process may be executed by separate devices. Further, for example, various processes may be executed for a plurality of servers including an image data storage server that stores the date-added image data and the date-less image data provided from a plurality of users 16, an image analysis server that executes an image recognition process, and a list storage server that stores the date-added image data list.

[0182] [Second Embodiment] In this second embodiment, an example of a form in which the date-added image data list is updated will be described. In this second embodiment, the same components as those described in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted, and the configuration and operation different from those of the first embodiment will be described.

[0183] The update of the dated image data list is realized by the CPU 60 of the server 14 executing the dated image data list update process (see FIG. 42). As shown in FIG. 42 as an example, the storage 62 stores a dated image data list update program 76. The CPU 60 reads out the dated image data list update program 76 from the storage 62. Then, the CPU 60 executes the dated image data list update program 76 read out from the storage 62 on the memory 64, thereby operating as a determination unit 60P, a date derivation unit 60S, a date assignment unit 60T, a dated image data generation unit 60V, a similarity calculation unit 60W, an image quality specification unit 60X, and an image data addition unit 60Y. That is, the dated image data list update process is realized by the CPU 60 operating as the determination unit 60P, the date derivation unit 60S, the date assignment unit 60T, the dated image data generation unit 60V, the similarity calculation unit 60W, the image quality specification unit 60X, and the image data addition unit 60Y.

[0184] By executing the dated image data list update process, when the CPU 60 satisfies the first condition, the CPU 60 updates the dated image data list by adding new image data provided as new image data as dated image data to the dated image data list. Here the first condition refers to the condition that the image quality of the new image data is equal to or higher than the reference image quality.

[0185] Also, by executing the dated image data list update process, when the CPU 60 satisfies the second condition, the CPU 60 updates the dated image data list by adding new image data to the dated image data list associated with a specific user. Here, the second condition refers to the condition that the subject indicated by the new image data newly provided as dated image data is not similar to the subject indicated by the dated image data included in the dated image data list associated with the specific user. Note that the new image data is an example of the "first new image data" and the "second new image data" according to the technology of the present disclosure.

[0186] The following describes in more detail an example form in which the date-added image data list is updated. As shown in FIG. 43 as an example, the date-added image data generation unit 60V generates new date-added image data based on the date-added image data generated by the date-adding unit 60T and the date-added image data used for deriving the date included in the date-added image data. The new date-added image data is an example of the "first new image data" and "second new image data" according to the technology of the present disclosure, and is generated by updating the date-added image data used for deriving the date included in the date-added image data based on the date-added image data. More specifically, the image data included in the date-added image data used for deriving the date included in the date-added image data is replaced with the date-free image data included in the date-added image data. Further, the date of the attribute data (hereinafter, also referred to as "date-free image use attribute data") included in the date-added image data used for deriving the date (the date included in the date-added image data) given to the date-free image data by the date-adding unit 60T is replaced with the date included in the date-added image data.

[0187] The data other than the date included in the date-free image use attribute data is generated based on, for example, the user ID of the provider of the date-free image data and the attribute data of one or more date-added image data targeted for date derivation by the date derivation unit 60S.

[0188] More specifically, as the user ID included in the attribute data of the new date-added image data, the user ID of the provider of the date-less image data is adopted. Also, when there is one piece of date-added image data targeted for date derivation by the date derivation unit 60S, among the data included in the attribute data of the date-added image data, the data of each item other than the user ID and the date (for example, GPS information, Exif information, etc.) is the data included in the attribute data of the date-added image data. When there are a plurality of date-added image data targeted for date derivation by the date derivation unit 60S, the data of each item other than the user ID and the date is data based on the average value of the data included in the attribute data of the plurality of date-added image data.

[0189] Here, data based on the average value of the data included in the attribute data of a plurality of date-added image data is exemplified, but the technology of the present disclosure is not limited thereto, and it may be data based on the mode value or the median value of the data included in the attribute data of the plurality of date-added image data. Also, the user ID and data other than the date included in the attribute data of the date-less image data having the highest similarity to the date-less image data may be used as part of the attribute data included in the new date-added image data.

[0190] As an example, as shown in FIG. 44, the similarity calculation unit 60W calculates the similarity between the new date-added image data generated by the date-added image data generation unit 60V and the date-added image data targeted for date derivation by the date derivation unit 60S. The similarity is, for example, the average value of the similarity between the image data and the similarity between the attribute data.

[0191] The similarity between the image data refers to the similarity between the image data included in the new date-added image data and the image data included in the date-added image data targeted for date derivation by the date derivation unit 60S. The similarity between the attribute data refers to the similarity between the attribute data included in the new date-added image data and the attribute data included in the date-added image data targeted for date derivation by the date derivation unit 60S.

[0192] ​ Different weight values may be assigned to the similarity between image data and the similarity between attribute data. The weight value may be a fixed value or a variable value. Examples of the variable value in this case include a value that can be changed according to an instruction received by the reception device 54, the number of frames of date-added image data for which the date is to be derived by the date derivation unit 60S, a value determined according to the degree of variation (e.g., variance or standard deviation) of the dates assigned to the date-added image data for which the date is to be derived by the date derivation unit 60S, a value changed according to the user 16 who provided the date-less image data, and / or a value that is changed periodically.

[0193] When there are multiple frames of date-added image data for which the date is to be derived by the date derivation unit 60S, for example, the similarity between the composite image data obtained by adding and averaging multiple image data included in the date-added image data for multiple frames for which the date is to be derived by the date derivation unit 60S on a pixel-by-pixel basis and the image data included in the new date-added image data may be used as the similarity between image data. Also, when there are multiple frames of date-added image data for which the date is to be derived by the date derivation unit 60S, the similarity between the image data included in one frame of the date-added image data for multiple frames and the image data included in the new date-added image data may be used as the similarity between image data.

[0194] The determination unit 60P determines whether the similarity calculated by the similarity calculation unit 60W is outside a predetermined range. The predetermined range in this case may be a fixed value or a variable value. Examples of the variable value in this case include a value that can be changed according to an instruction received by the reception device 54, the number of frames of date-added image data for which the date is to be derived by the date derivation unit 60S, a value determined according to the degree of variation (e.g., variance or standard deviation) of the dates assigned to the date-added image data for which the date is to be derived by the date derivation unit 60S, a value changed according to the user 16 who provided the date-less image data, and / or a value that is changed periodically.

[0195] When the determination unit 60P determines that the similarity calculated by the similarity calculation unit 60W is within the predetermined range, it waits until the next determination timing arrives. When the determination unit 60P determines that the similarity calculated by the similarity calculation unit 60W is outside the predetermined range, it instructs the image quality specifying unit 60X to specify the image quality of the image data.

[0196] The image quality specifying unit 60X specifies the image quality of the image data included in the new date-added image data generated by the date-added image data generation unit 60V according to the instruction from the determination unit 60P. Here, the image quality refers to, for example, the resolution and the amount of noise. The lower the resolution, the lower the image quality, and the more the amount of noise, the lower the image quality.

[0197] As shown in FIG. 45 as an example, the determination unit 60P determines whether the image quality specified by the image quality specifying unit 60X is equal to or higher than a reference image quality. Here, a fixed value is adopted as the reference image quality. However, this is merely an example, and a variable value may be used. Examples of the variable value in this case include a value that can be changed according to an instruction received by the reception device 54, the number of frames of date-added image data for which the date is to be derived by the date derivation unit 60S, a value determined according to the degree of variation (e.g., variance or standard deviation) of the dates assigned to the date-added image data for which the date is to be derived by the date derivation unit 60S, Values that are changed according to user 16 who provided date-less image data, and / or values that are changed periodically, can be mentioned.

[0198] When determination unit 60P determines that the image quality specified by image quality specifying unit 60X is less than the reference image quality, it waits until the next determination timing arrives. When determination unit 60P determines that the image quality specified by image quality specifying unit 60X is equal to or higher than the reference image quality, it instructs image data addition unit 60Y to add new date-added image data to storage 62.

[0199] In response to an instruction from determination unit 60P, image data addition unit 60Y adds the new date-added image data generated by date-added image data generation unit 60V to a specific date-added image data list in storage 62. Thereby, the specific date-added image data list is updated. Here, the specific date-added image data list refers to the date-added image data list that includes the date-added image data for which the date derivation unit 60S has set the date as the derivation target.

[0200] Next, the date-added image data list update process executed by CPU 60 of server 14 will be described with reference to FIG. 46.

[0201] In the date-added image data list update process shown in FIG. 46, first, in step ST200, determination unit 60P determines whether date-added image data has been generated by date adding unit 60T. In step ST200, if the date-added image data has not been generated by date adding unit 60T, the determination is negative, and the date-added image data list update process proceeds to step ST202. In step ST200, if the date-added image data has been generated by date adding unit 60T, the determination is positive, and the date-added image data list update process proceeds to step ST214.

[0202] In step ST202, the date-added image data generation unit 60V generates new date-added image data based on the date-added image data generated by the date-adding unit 60T and the date-added image data used for deriving the date included in the date-added image data. Then, the date-added image data list update process proceeds to step ST204.

[0203] In step ST204, the similarity calculation unit 60W calculates the similarity between the new date-added image data generated in step ST202 and the date-added image data to be the target of date derivation by the date derivation unit 60S. Then, the date-added image data list update process proceeds to step ST206.

[0204] In step ST206, the determination unit 60P determines whether the similarity calculated in step ST204 is outside the predetermined range. In step ST206, if the similarity calculated in step ST204 is within the predetermined range, the determination is negative, and the date-added image data list update process proceeds to step ST214. In step ST206, if the similarity calculated in step ST204 is outside the predetermined range, the determination is positive, and the date-added image data list update process proceeds to step ST208.

[0205] In step ST208, the image quality identification unit 60X identifies the image quality of the image data included in the new date-added image data generated by the date-added image data generation unit 60V. Then, the date-added image data list update process proceeds to step ST210.

[0206] In step ST210, the determination unit 60P determines whether the image quality identified in step ST208 is equal to or higher than the reference image quality. In step ST210, if the image quality identified in step ST208 is less than the reference image quality, the determination is negative, and the date-added image data list update process proceeds to step ST214. In step ST210, if the step ST If the image quality specified by 208 is equal to or higher than the reference image quality, the determination is affirmative, and the date-added image data list update process proceeds to step ST212.

[0207] In step ST212, the image data addition unit 60Y updates the specific date-added image data list by adding the new date-added image data generated by the date-added image data generation unit 60V to the specific date-added image data list, and then the date-added image data list update process proceeds to step ST214.

[0208] In step ST214, the determination unit 60P determines whether a condition for ending the date-added image data list update process (hereinafter also referred to as the "list update process end condition") is satisfied. As an example of the list update process end condition, there is a condition that an instruction to end the date-added image data list update process is given to the server 14. The instruction to end the date-added image data list update process is received, for example, by the reception device 54. In step ST214, if the list update process end condition is not satisfied, the determination is negative, and the date-added image data list update process proceeds to step ST200. In step ST214, if the list update process end condition is satisfied, the determination is affirmative, and the date-added image data list update process ends.

[0209] Next, the date assignment process according to the second embodiment will be described with reference to FIGS. 47A and 47B. The flowcharts shown in FIGS. 47A and 47B are different from the flowchart shown in FIG. 40 in that they have step ST108A instead of step ST108, and further have steps ST122 and ST124. In FIG. 47A, the same step numbers are assigned to the same steps as those shown in FIG. 40, and the description thereof is omitted.

[0210] In step ST108A shown in FIG. 47A, the determination unit 60P determines whether there is date-added image data similar to the date-less image data extracted in step ST106 in the list of date-added image data obtained in step ST104 or step ST124 (see FIG. 47B). In step ST108A, if there is date-added image data similar to the date-less image data extracted in step ST106 in the list of date-added image data obtained in step ST104 or step ST124, the determination is affirmative, and the date assignment process proceeds to step ST110. In step ST108A, if there is no date-added image data similar to the date-less image data extracted in step ST106 in the list of date-added image data obtained in step ST104 or step ST124, the determination is negative, and the date assignment process proceeds to step ST122 shown in FIG. 47B.

[0211] In step ST122 shown in FIG. 47B, the determination unit 60P determines whether a specific list of date-added image data has been updated by executing the list update process for date-added image data. In step ST122, if the specific list of date-added image data has not been updated, the determination is negative, and the date assignment process proceeds to step ST120 shown in FIG. 47A. In step ST122, if the specific list of date-added image data has been updated, the determination is affirmative, and the date assignment process proceeds to step ST124.

[0212] In step ST124, the image data list acquisition unit 60Q acquires from the storage 62 the list of date-added image data corresponding to the user ID extracted in step ST102, and then the date assignment process proceeds to step ST108A.

[0213] Then, the CPU 60 executes the processes of steps ST108A to ST114 shown in FIG. 47A, so as to be similar to the subject indicated by the date-less image data of a specific user Acquire date-added image data for the subject in question. That is, the CPU 60 updates the list of date-added image data associated with a specific user by executing the date assignment process according to the second embodiment. On the condition that the list of date-added image data associated with the specific user has been updated, the CPU 60 acquires date-added image data for the subject similar to the subject indicated by the date-less image data of the specific user from the updated list of date-added image data associated with the specific user, that is, the specific list of date-added image data.

[0214] Here, a morphological example is given in which, on the condition that the specific list of date-added image data is updated by executing the date-added image data list update process, the image data list acquisition unit 60Q acquires date-added image data for the subject similar to the subject indicated by the date-less image data of the specific user from the specific list of date-added image data. However, the technology of the present disclosure is not limited to this. Date-added image data may be newly provided from the user device 12 to the server 14, and the newly provided date-added image data may be acquired by the image data list acquisition unit 60Q from the updated list of date-added image data updated by adding the newly provided date-added image data to the list of date-added image data.

[0215] As described above, in the second embodiment, in the server 14, when the image quality of the new date-added image data is equal to or higher than the reference image quality, the list of date-added image data is updated by adding the new date-added image data to the list of date-added image data. Therefore, according to this configuration, regardless of the image quality of the new date-added image data, compared with the case where the new date-added image data is added to the list of date-added image data, it is possible to suppress the addition of date-added image data that is not suitable for the image recognition process (for example, date-added image data in which a person and / or a non-person cannot be recognized by executing the image recognition process) to the list of date-added image data.

[0216] Also, in the second embodiment, in the server 14, when the subject shown by the new date-added image data and the subject shown by the date-added image data included in the date-added image data list associated with the specific user are not similar, the new date-added image data is added to the specific date-added image data list. Therefore, according to this configuration, regardless of whether the subject shown by the new date-added image data and the subject shown by the date-added image data included in the date-added image data list associated with the specific user are similar, compared with the case where the new date-added image data is added to the specific date-added image data list, an increase in the data amount of the date-added image data list can be suppressed.

[0217] Also, in the second embodiment, in the server 14, on the condition that the specific date-added image data list is updated, the date-added image data for the subject similar to the subject shown by the date-less image data provided by the specific user is acquired from the specific date-added image data list. Therefore, according to this configuration, compared with the case where the date-added image data for the subject similar to the subject shown by the date-less image data provided by the specific user is not acquired from the specific date-added image data list even though the specific date-added image data list is updated, an immediate derivation of an appropriate date to be assigned to the date-less image data can be realized.

[0218] Note that in the above second embodiment, an example has been described in which new date-added image data is added to a specific date-added image data list when the image quality specified by the image quality specifying unit 60X is equal to or higher than the reference image quality. However, the technology of the present disclosure is not limited to this. For example, when the image quality of the new date-added image data exceeds the image quality of the date-added image data (hereinafter also referred to as "similar image data") similar within a predetermined similar range among a plurality of date-added image data in the specific date-added image data list, the similar image data may be deleted from the specific date-added image data list and the new date-added image data may be added. Also referred to) exceeds, the similar image data may be deleted from the specific date-added image data list and the new date-added image data may be added.

[0219] Also, in each of the above embodiments, an example form in which a plurality of date-added image data is included in the date-added image data list has been described. However, as an example, as shown in FIG. 48, the image data list creation unit 60M may include, in the date-added image data list instead of the same-day image data group, feature data indicating the characteristics of the same-day image data group to which the same date is assigned among the plurality of date-added image data. In the example shown in FIG. 48, as an example of the same-day image data group, a plurality of date-added image data with a date of May 19, 1985 are shown. However, the image data list creation unit 60M extracts feature data from the plurality of date-added image data with a date of May 19, 1985 and replaces the plurality of date-added image data with a date of May 19, 1985 with the feature data.

[0220] Here, as a first example of the feature data, data (for example, the spatial frequency, contrast value, and luminance of the image data included in each date-added image data, etc.) that is predetermined as the minimum data capable of specifying the outline of the date-added image data included in the same-day image data group can be mentioned. As a second example of the feature data, person image data and non-person image data associated with the date-added image data included in the same-day image data group can be mentioned. As a third example of the feature data, data (for example, the spatial frequency, contrast value, and luminance of the image data included in each date-added image data, etc.) that is predetermined as the minimum data capable of specifying the outline of the person image data and non-person image data associated with the date-added image data can be mentioned.

[0221] In this way, by including, in the date-added image data list, feature data indicating the characteristics of the same-day image data group instead of the same-day image data group, the data amount of the date-added image data list can be reduced compared to the case where the date-added image data list is composed only of a plurality of date-added image data.

[0222] In each of the above-described embodiments, an example of a form in which a list of date-added image data corresponding to a user ID is acquired by executing date-adding processing (see step ST104 shown in FIG. 40) has been described. However, a priority may be assigned to a plurality of lists of date-added image data, and the lists may be acquired in order from the list of date-added image data with the highest priority.

[0223] In this case, when the CPU 60 executes the date-adding processing shown in FIGS. 49A and 49B and a plurality of lists of date-added image data are associated with a specific user, among the plurality of lists of date-added image data associated with the specific user, for each list of date-added image data, date-added image data for a subject similar to the subject shown by the date-less image data is acquired in order from the list of date-added image data with a high priority based on the image data included in each list of date-added image data.

[0224] In each of the above-described embodiments, when date-adding processing is executed and there is no date-added image data similar to the date-less image data in the list of date-added image data related to a specific user, the date is not added to the date-less image data. However, the technology of the present disclosure is not limited to this. For example, when there is no date-added image data similar to the date-less image data in the list of date-added image data related to a specific user, date-added image data similar to the date-less image data may be acquired from the list of date-added image data related to a user 16 other than the specific user.

[0225] In this case, when the CPU 60 executes the date-adding processing shown in FIGS. 49A and 49B and there is no date-added image data for a subject similar to the subject shown by the date-less image data in the list of date-added image data associated with the specific user, date-added image data for a subject similar to the subject shown by the date-less image data is acquired from the group of image data associated with at least one user other than the specific user among the plurality of users.

[0226] Here, priority is assigned to a plurality of date-added image data lists, and a morphological example in which the lists are sequentially acquired from the date-added image data list with the highest priority, and a morphological example in which date-added image data similar to the date-less image data is acquired from the date-added image data list related to user 16 other than the specific user will be described in more detail with reference to FIGS. 49A and 49B.

[0227] The flowcharts shown in FIGS. 49A and 49B are different from the flowchart shown in FIG. 40 in that they have step ST104A instead of step ST104, step ST108B instead of step ST108, and further have steps ST130 to ST136. In FIG. 49A, the same step numbers are assigned to the same steps as those shown in FIG. 40, and the description thereof is omitted.

[0228] In step ST104A shown in FIG. 49A, the image data list acquisition unit 60Q acquires, from the storage 62, the date-added image data list with the highest priority among the unprocessed date-added image data lists corresponding to the user ID extracted in step ST102. The highest priority means the highest priority order. Also, in this step ST104A, the unprocessed date-added image data list refers to the date-added image data list for which the process of step ST108B has not been performed yet.

[0229] In step ST108B, the determination unit 60P determines whether there is date-added image data similar to the date-less image data extracted in step ST106 in the list of date-added image data obtained in step ST104A. In step ST108B, if there is date-added image data similar to the date-less image data extracted in step ST106 in the list of date-added image data obtained in step ST104A, the determination is affirmative, and the date assignment process proceeds to step ST110. In step ST108B, if there is no date-added image data similar to the date-less image data extracted in step ST106 in the list of date-added image data obtained in step ST104A, the determination is negative, and the date assignment process proceeds to step ST130 shown in FIG. 49B.

[0230] In step ST130, the determination unit 60P determines whether all of the list of date-added image data corresponding to the user ID extracted in step ST102 has been obtained in step ST104. In step ST130, if not all of the list of date-added image data corresponding to the user ID extracted in step ST102 has been obtained in step ST104, the determination is negative, and the date assignment process proceeds to step ST104A shown in FIG. 49A. In step ST130, if all of the list of date-added image data corresponding to the user ID extracted in step ST102 has been obtained in step ST104, the determination is affirmative, and the date assignment process proceeds to step ST132.

[0231] In step ST132, the image data list acquisition unit 60Q acquires from the storage 62 a list of unprocessed date-added image data corresponding to a user ID other than the user ID extracted in step ST102 (hereinafter also referred to as "other user ID"), and then proceeds to step ST134. Note that in this step ST132, the list of unprocessed date-added image data refers to the list of date-added image data that has not yet been used in the process of step ST134. to point.

[0232] In step ST134, the determination unit 60P determines whether there is date-added image data similar to the date-less image data extracted in step ST106 in the date-added image data list obtained in step ST132. In step ST134, if there is date-added image data similar to the date-less image data extracted in step ST106 in the date-added image data list obtained in step ST132, the determination is affirmed, and the date assignment process proceeds to step ST110 shown in FIG. 49A. In step ST134, if there is no date-added image data similar to the date-less image data extracted in step ST106 in the date-added image data list obtained in step ST132, the determination is negated, and the date assignment process proceeds to step ST136.

[0233] In step ST136, it is determined whether the number of times the date-added image data list has been obtained in step ST132 (hereinafter, also referred to as the "acquisition list number") has reached the upper limit. The upper limit may be a fixed value or a variable value. Examples of the variable value in this case include a value that can be changed according to an instruction received by the reception device 54, the number of date-added image data lists corresponding to other user IDs, a value changed according to the user 16 who provided the date-less image data, and / or a value that is periodically changed.

[0234] In step ST136, if the acquisition list number has not reached the upper limit, the determination is negated, and the date assignment process proceeds to step ST132. In step ST136, if the acquisition list number has reached the upper limit, the determination is affirmed, and the date assignment process proceeds to step ST120 shown in FIG. 49A.

[0235] FIG. 50 shows an example of a list of date-added image data with priorities assigned. In the example shown in FIG. 50, as a list of date-added image data with priorities assigned, sixth to ninth subject image data lists associated with a user ID for a specific user are shown. The sixth subject image data list is a list of date-added image data consisting of a plurality of date-added image data in which the sixth subject is captured. The seventh subject image data list is a list of date-added image data consisting of a plurality of date-added image data in which the seventh subject is captured. The eighth subject image data list is a list of date-added image data consisting of a plurality of date-added image data in which the eighth subject is captured. The ninth subject image data list is a list of date-added image data consisting of a plurality of date-added image data in which the ninth subject is captured.

[0236] In the example shown in FIG. 50, a prepubescent male is shown as an example of the sixth subject. Also, in the example shown in FIG. 50, an example of an adult male is shown as an example of the seventh subject. Also, in the example shown in FIG. 50, an example of a middle-aged male is shown as an example of the eighth subject. Also, in the example shown in FIG. 50, an example of an elderly male in the later stage is shown as an example of the ninth subject.

[0237] The image data list creation unit 60M classifies prepubescent males, adult males, middle-aged males, and elderly males in the later stage and creates sixth to ninth subject image data lists by performing image recognition processing on the person image data associated with the date-added image data. Generally, the physical aspects of prepubescent males, adult males, middle-aged males, and elderly males in the later stage are different. The physical aspect refers to, for example, the aspect of the head (for example, at least one of the face and hair). Generally, as humans age, the roundness of the face, the amount of hair, and the hair color change. Therefore, by performing image recognition processing based on these characteristics, it is possible to classify prepubescent males, adult males, middle-aged males, and elderly males in the later stage.

[0238] Generally, the magnitude of the changes in appearance associated with aging in prepubescent males, prime-aged males, pre-senile males, and late elderly males follows the order of "prepubescent males > prime-aged males > pre-senile males > late elderly males". That is, the lower the age, the greater the change in appearance associated with aging. For example, the lower the age, the rounder the facial contour, and the amount of change in roundness is also greater than that in the elderly.

[0239] Therefore, it is highly likely that the date-stamped image data in which males in an age group with relatively large changes in physical aspects associated with aging are captured as subjects has a greater degree of variation in the captured subjects than the date-stamped image data in which males in an age group with relatively small changes in physical aspects associated with aging are captured as subjects. This means that it is more likely that the date can be accurately and quickly specified for the date-stamped image data without a date than for the date-stamped image data in which males in an age group with relatively small changes in physical aspects associated with aging are captured as subjects, when the date is obtained from the date-stamped image data in which males in an age group with relatively large changes in physical aspects associated with aging are captured as subjects. Thus, in the example shown in FIG. 26, the first priority is assigned to the sixth subject image data list, the second priority is assigned to the seventh subject image data list, the third priority is assigned to the eighth subject image data list, and the fourth priority is assigned to the ninth subject image data list.

[0240] Note that in the example shown in FIG. 26, a morphological example is shown in which a date-stamped image data list is created for each generation of males, but the technology of the present disclosure is not limited to this. For example, a date-stamped image data list may be created for each generation of females. Also, the generation may be set more finely or more coarsely.

[0241] Further, the technology of the present disclosure is not limited to the form example in which a date-added image data list is created for each generation. For example, a date-added image data list with different priorities may be created for each characteristic of the user 16. Examples of the characteristics of the user 16 include family composition, address, occupation, and hobbies. Also, the date-added image data list with a larger number of frames of the date-added image data may be given a higher priority. Further, the date-added image data list with a larger number of frames of the date-added image data with different dates may be given a higher priority.

[0242] As described above, by executing the date assignment process shown in FIGS. 49A and 49B, among the plurality of date-added image data lists, date-added image data for a subject similar to the subject indicated by the date-less image data is acquired in order from the date-added image data list with a high priority based on the date-added image data included in each date-added image data list. Therefore, according to this configuration, compared with the case where date-added image data is acquired from the date-added image data list regardless of the priority based on the date-added image data included in each date-added image data list, the date to be assigned to the date-less image data can be specified accurately and quickly.

[0243] Also, by executing the date assignment process shown in FIGS. 49A and 49B, date-added image data similar to the date-less image data is acquired from the date-added image data list related to the user 16 other than the specific user. Therefore, according to this configuration, the possibility of assigning an appropriate date to the date-less image data can be increased compared with the case where date-added image data to be the target of date derivation is acquired only from the date-added image data list related to the specific user.

[0244] Also, in each of the above embodiments, a form example in which a date-added image data list in which date-added image data with a person image and date-added image data with a non-person image are mixed is created is described, but the technology of the present disclosure is not limited to this. For example, the date-added image data is a portrait The image data with dates can be roughly classified into image data with dates and a person's image and image data with dates and a non-person image. The image data list creation unit 60M may acquire only the image data with dates and a non-person image, and create an image data list with dates using the acquired image data with dates and a non-person image. According to this configuration, it is possible to prevent the date assigned to the image data with dates and a person's image from being assigned to the image data without a date.

[0245] In each of the above embodiments, a morphological example has been described in which the image data with dates to be the object of creating the image data list with dates is restricted based on the similarity of the persons captured as subjects in the image data, the similarity of the geographical distribution of the imaging positions, and the similarity of the user information. However, the technology of the present disclosure is not limited to this. For example, as an example, the CPU 60 may execute the image data list creation process shown in FIG. 51 to restrict the image data with dates to be the object of creating the image data list with dates among a plurality of image data with dates to the image data in which persons having a specific relationship are captured.

[0246] Here, the persons having a specific relationship refer to friends, family members, relatives, or employees belonging to a specific organization, etc. The persons having a specific relationship may be registered in the server 14 by each of the plurality of users 16 via the user device 12. Further, image recognition processing may be performed by the CPU 42 and / or 60 on the image data group held by the plurality of user devices 12, so that the image data in which persons having a specific relationship are captured as subjects is specified, and the specified image data is registered in the storage 62 of the server 14. Further, when the number of frames of the image data with dates in which the same person is captured as a subject in the folder in the user device 12 is a certain number or more (for example, 10 or more), the image data with dates in which the same person is captured as a subject in the folder may be registered in the server 14 as the image data in which persons having a specific relationship are captured.

[0247] The flowchart shown in FIG. 51 differs from the flowchart shown in FIG. 39A in that it has step ST19 between step ST18 and step ST20. In FIG. 51, the same step numbers are assigned to the steps identical to those in the flowchart shown in FIG. 39A, and the description thereof is omitted.

[0248] In step ST19 shown in FIG. 51, the erasing unit 60F erases the date-added image data in which a person having a specific relationship is not captured as a subject from the image data group stored in the storage 62. Thereby, among the plurality of date-added image data, the date-added image data to be the creation target of the date-added image data list is limited to the image data in which a person having a specific relationship is captured. Therefore, according to this configuration, compared with the case where the date-added image data to be the creation target of the date-added image data list is not limited to the image data in which a person having a specific relationship is captured, when a person having a specific relationship as a subject is captured in the date-less image data, an appropriate date can be quickly derived.

[0249] Also, in each of the above embodiments, as the attribute data included in the date-added image data, data including the user ID, the date, and the GPS information is exemplified, but the technology of the present disclosure is not limited thereto. For example, generation specifying information may be given to a plurality of date-added image data, and the CPU 60 may limit the date-added image data to be the creation target of the date-added image data list among the plurality of date-added image data by the generation specified by the generation specifying information.

[0250] In this case, as shown in FIG. 52 as an example, the generation specifying information may be included in the attribute data, and the date-added image data list creation process shown in FIG. 53 may be executed as an example. The flowchart shown in FIG. 53 differs from the flowchart shown in FIG. 39E in that the step It is different in that there are steps ST69A to ST69E between step ST68 and step ST70. In FIG. 53, the same step numbers are assigned to the steps identical to the flowchart shown in FIG. 39E, and the description thereof is omitted.

[0251] In step ST69A shown in FIG. 53, the CPU 60 determines whether or not two or more groups of image data groups are stored in the storage 62. In step ST69A, if two or more groups of image data groups are not stored in the storage 62, the determination is negative, and the date-added image data list creation process proceeds to step ST80 (see FIG. 39E). In step ST69A, if two or more groups of image data groups are stored in the storage 62, the determination is affirmative, and the date-added image data list creation process proceeds to step ST69B.

[0252] In step ST69B, the CPU 60 extracts generation identification information from all the image data groups stored in the storage 62, and then the date-added image data list creation process proceeds to step ST69C.

[0253] In step ST69C, the CPU 60 calculates the generation consistency degree between the image data groups using all the generation identification information extracted in step ST69B, and then the date-added image data list creation process proceeds to step ST69D. The generation consistency degree refers to the consistency degree between the generation identification information. For example, the consistency degree between the generations of 1970 to 1980 is 100%, the consistency degree between the generation of 1970 to 1980 and the generation of 1975 to 1985 is 50%, and the consistency degree between the generation of 1970 to 1980 and the generation of 1930 to 1940 is 0%.

[0254] In step ST69D, the CPU 60 determines whether an image data group with a generation matching degree equal to or higher than a predetermined matching degree (for example, 50%) is stored in the storage 62. In this step ST69D, a fixed value is adopted as the predetermined matching degree. However, this is merely an example, and the predetermined matching degree used in step ST69D may be a variable value. Examples of the variable value include a value that can be changed according to an instruction received by the reception device 54, or a value that is changed periodically.

[0255] In step ST69D, if an image data group with a generation matching degree equal to or higher than the predetermined matching degree is not stored in the storage 62, the determination is negative, and the date-added image data list creation process proceeds to step ST70. In step ST69D, if an image data group with a generation matching degree equal to or higher than the predetermined matching degree is stored in the storage 62, the determination is positive, and the date-added image data list creation process proceeds to step ST69E.

[0256] In step ST69E, the CPU 60 deletes an image data group with a generation matching degree less than the predetermined matching degree from the storage 62, and then the date-added image data list creation process proceeds to step ST70.

[0257] By executing the processes of steps ST69A to ST69E in this way, among the plurality of date-added image data, the date-added image data to be the object of creating the date-added image data list is restricted by the generation specified by the generation specifying information. Therefore, according to this configuration, compared with the case where the date-added image data to be the object of creating the date-added image data list is not restricted by generation, the possibility of appropriately assigning a date to the date-less image data can be increased.

[0258] Also, in each of the above embodiments, the date-added image data creation program 68 and the date assignment request processing program 70 are stored in the storage 44 (hereinafter, it is necessary to explain these programs separately Although an example form in which the "terminal-side program" (referred to as such without a reference number when not necessary) is stored has been described, the technology of the present disclosure is not limited thereto. For example, as shown in FIG. 54, the terminal-side program may be stored in the storage medium 100. The storage medium 100 is a non-transitory storage medium. As an example of the storage medium 100, any portable storage medium such as an SSD or a USB memory can be mentioned.

[0259] The terminal-side program stored in the storage medium 100 is installed in the computer 22. The CPU 42 executes the date-added image data creation process according to the date-added image data creation program 68, and executes the date-adding request process according to the date-adding request process program 70. Hereinafter, for convenience of explanation, when it is not necessary to distinguish between the date-added image data creation process and the date-adding request process, it is referred to as the "terminal-side process".

[0260] Alternatively, the terminal-side program may be stored in the storage unit of another computer or server connected to the computer 22 via a communication network (not shown), and the terminal-side program may be downloaded and installed in the computer 22 in response to a request from the user device 12.

[0261] Note that it is not necessary to store all of the terminal-side program in the storage unit of another computer or server connected to the computer 22, or in the storage 44, and a part of the terminal-side program may be stored.

[0262] In the example shown in FIG. 54, the CPU 42 is a single CPU, but it may be a plurality of CPUs. Further, instead of the CPU 42, or together with the CPU 42, a GPU may be applied.

[0263] In the example shown in FIG. 54, the computer 22 is illustrated. However, the technology of the present disclosure is not limited thereto, and instead of the computer 22, devices including ASIC, FPGA, and / or PLD may be applied. Further, instead of the computer 22, a combination of a hardware configuration and a software configuration may be used.

[0264] As the hardware resources for executing the terminal-side processing described in each of the above embodiments, the following various processors can be used. As the processor, for example, a general-purpose processor such as a CPU that functions as a hardware resource for executing terminal-side processing by executing software, that is, a program, can be mentioned. Further, as the processor, for example, a dedicated electric circuit that is a processor having a circuit configuration dedicated to executing specific processing such as FPGA, PLD, or ASIC can be mentioned. A memory is built in or connected to any of the processors, and any of the processors executes terminal-side processing by using the memory.

[0265] The hardware resources for executing the terminal-side processing may be constituted by one of these various processors, or may be constituted by a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs, or a combination of a CPU and an FPGA). Further, the hardware resources for executing the terminal-side processing may be one processor.

[0266] As an example of being constituted by one processor, first, there is a form in which one processor is constituted by a combination of one or more CPUs and software, and this processor functions as a hardware resource for executing terminal-side processing. Second, there is a form in which a processor that realizes the functions of the entire system including a plurality of hardware resources for executing terminal-side processing with one IC chip, as represented by SoC, is used. Thus, the terminal-side processing is realized as a hardware resource by using one or more of the above various processors.

[0267] Furthermore, as the hardware structure of these various processors, more specifically, an electric circuit combining circuit elements such as semiconductor elements can be used. Also, the above terminal-side processing is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be changed within the scope not departing from the gist.

[0268] Also, in each of the above embodiments, a form example has been described in which a date-added image data list creation program 72, a date-attachment processing program 74, and a date-added image data list update program 76 (hereinafter, when it is not necessary to distinguish these programs for explanation, they are referred to as "server-side programs" without reference numerals) are stored in the storage 62. However, the technology of the present disclosure is not limited to this. For example, as shown in FIG. 55, the server-side program may be stored in the storage medium 200. The storage medium 200 is a non-temporary storage medium. As an example of the storage medium 200, any portable storage medium such as an SSD or a USB memory can be mentioned. Note that the server-side program is an example of the "program" according to the technology of the present disclosure.

[0269] The server-side program stored in the storage medium 200 is installed in the computer 50. The CPU 60 executes a date-added image data list creation process according to the date-added image data list creation program 72, executes a date-attachment process according to the date-attachment processing program 74, and executes a date-added image data list update process according to the date-added image data list update program 76. In the following, for convenience of explanation, when it is not necessary to distinguish between the date-added image data creation process and the date-attachment request process, they are referred to as "server-side processing".

[0270] Also, the server-side program may be stored in the storage unit of another computer or server connected to the computer 50 via a communication network (not shown), and the server-side program may be downloaded in response to a request from the server 14 and installed in the computer 50.

[0271] Note that it is not necessary to store all of the server - side programs in a storage unit such as another computer or server connected to the computer 50, or in the storage 62. A part of the server - side programs may be stored instead.

[0272] In the example shown in FIG. 55, the CPU 60 is a single CPU, but it may be a plurality of CPUs. Also, instead of the CPU 60, or together with the CPU 60, a GPU may be applied.

[0273] In the example shown in FIG. 55, the computer 50 is illustrated, but the technology of the present disclosure is not limited thereto. Instead of the computer 50, devices including ASIC, FPGA, and / or PLD may be applied. Also, instead of the computer 50, a combination of a hardware configuration and a software configuration may be used.

[0274] As the hardware resources for executing the server - side processing described in each of the above embodiments, the following various processors can be used. As the processor, for example, a general - purpose processor that functions as a hardware resource for executing server - side processing by executing software, that is, a program, such as a CPU can be mentioned. Also, as the processor, for example, a dedicated electric circuit which is a processor having a circuit configuration designed specifically for executing a specific process such as an FPGA, a PLD, or an ASIC can be mentioned. A memory is built - in or connected to any of these processors, and any of these processors executes server - side processing by using the memory.

[0275] The hardware resources for executing the server - side processing may be composed of one of these various processors or may be composed of a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resources for executing the server - side processing may be a single processor.

[0276] As an example of a configuration consisting of one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource for executing server-side processing. Second, as represented by an SoC or the like, there is a form in which a processor that realizes the functions of the entire system including a plurality of hardware resources for executing server-side processing is used on one IC chip. Thus, server-side processing is realized as a hardware resource using one or more of the above various processors.

[0277] Furthermore, as a more specific hardware structure of these various processors, an electric circuit combining circuit elements such as semiconductor elements can be used. Also, the above server-side processing is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be changed within the scope of not departing from the gist.

[0278] The description content and illustration content shown above are detailed explanations of the part related to the technology of the present disclosure and are only examples of the technology of the present disclosure. For example, the explanations regarding the above configuration, function, operation, and effect are explanations regarding an example of the configuration, function, operation, and effect of the part related to the technology of the present disclosure. Therefore, it goes without saying that within the scope of not departing from the gist of the technology of the present disclosure, the above description content and illustration content may be deleted of unnecessary parts, new elements may be added, or replacements may be made. Also, in order to avoid complication and facilitate the understanding of the part related to the technology of the present disclosure, the description regarding common technical knowledge that does not particularly require explanation for enabling the implementation of the technology of the present disclosure has been omitted from the above description content and illustration content.

[0279] In this specification, "A and / or B" is synonymous with "at least one of A and B". That is, "A and / or B" means that it may be only A, only B, or a combination of A and B. Also, in this specification, when expressing three or more matters connected by "and / or", the same concept as "A and / or B" is applied.

[0280] All documents, patent applications, and technical standards described in this specification are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually stated to be incorporated by reference.

[0281] Regarding the above embodiments, the following additional remarks are disclosed.

[0282] (Supplementary Note 1) A processor, a memory built in or connected to the above processor, The above processor creates a list of date-added image data by classifying a plurality of date-added image data with dates assigned thereto, associates the above list of date-added image data with a specific user, obtains the date-added image data regarding a subject similar to the subject indicated by the date-less image data of the above specific user from the above list of date-added image data associated with the above specific user, Based on the above date assigned to the obtained date-added image data, derives the date to be assigned to the date-less image The above plurality of date-added image data is image data for a plurality of users including the above specific user, The above list of date-added image data is created for each subject by classifying the above plurality of date-added image data for each subject indicated by each of the above plurality of date-added image data, The date-added image data list for a subject similar to the subject shown by the date-added image data of the specific user is associated with the specific user Information processing apparatus

[0283] (Appendix 2) The date-added image data list is an information processing apparatus according to Appendix 1 created by classifying the plurality of date-added image data for each subject whose mode of change over time can be specified visually

[0284] (Appendix 3) The dates assigned to the plurality of date-added image data are imaging dates The date-added image data list is an information processing apparatus according to Appendix 1 or Appendix 2 that includes a plurality of the date-added image data with different imaging dates

[0285] (Appendix 4) The plurality of users is a group of users that satisfies the condition that registration for sharing information including the date-added image data has been completed, and is an information processing apparatus according to any one of Appendices 1 to 3

[0286] (Appendix 5) An image data group is associated with each of the plurality of users The plurality of users is a group of users that satisfies the condition that the image data groups are similar to each other, and is an information processing apparatus according to any one of Appendices 1 to 4

[0287] (Appendix 6) The plurality of users is a group of users that satisfies the condition that the registered user information is similar, and is an information processing apparatus according to any one of Appendices 1 to 5

[0288] (Appendix 7) The date-added image data is roughly classified into person-included image data in which a person is captured as a subject and person-excluded image data in which only non-persons are captured as a subject The processor Acquire only the image data without a person as the date-added image data, An information processing apparatus according to any one of Supplementary Notes 1 to 6 that creates a list of date-added image data using the acquired image data without a person.

[0289] (Supplementary Note 8) The processor restricts the date-added image data to be the subject of creating the date-added image data list among the plurality of date-added image data to image data in which a person having a specific relationship is captured. An information processing apparatus according to any one of Supplementary Notes 1 to 7.

[0290] (Supplementary Note 9) The plurality of date-added image data includes image data to which position specifying information for specifying an imaging position is given, The processor restricts the date-added image data to be the subject of creating the date-added image data list among the plurality of date-added image data to image data obtained by being imaged within a range determined based on the position specifying information. An information processing apparatus according to any one of Supplementary Notes 1 to 8.

[0291] (Supplementary Note 10) Generation specifying information capable of specifying the generation of the user is given to the plurality of date-added image data, The processor restricts the date-added image data to be the subject of creating the date-added image data list among the plurality of date-added image data to the generation specified by the generation specifying information. An information processing apparatus according to any one of Supplementary Notes 1 to 9.

[0292] (Supplementary Note 11) When the above-mentioned processor determines that the list of date-stamped image data associated with the above-mentioned specific user does not include date-stamped image data for a subject similar to the subject shown by the date-less image data, the processor acquires, from the group of image data associated with at least one user other than the above-mentioned specific user among the above-mentioned plurality of users, the date-stamped image data for a subject similar to the subject shown by the date-less image data. The information processing apparatus according to any one of Supplementary Notes 1 to 10.

[0293] (Supplementary Note 12) When the above-mentioned processor is provided with first new image data as new image data as the above-mentioned date-stamped image data and the image quality of the above-mentioned first new image data is equal to or higher than a reference image quality, the processor updates the list of date-stamped image data by adding the above-mentioned first new image data to the list of date-stamped image data. The information processing apparatus according to any one of Supplementary Notes 1 to 11.

[0294] (Supplementary Note 13) When the subject shown by the second new image data newly provided as the above-mentioned date-stamped image data is not similar to the subject shown by the date-stamped image data included in the list of date-stamped image data associated with the above-mentioned specific user, the processor updates the list of date-stamped image data by adding the above-mentioned second new image data to the list of date-stamped image data associated with the above-mentioned specific user. The information processing apparatus according to any one of Supplementary Notes 1 to 12.

[0295] (Supplementary Note 14) When the above-mentioned processor updates the list of date-stamped image data associated with the above-mentioned specific user, the processor acquires, from the updated list of date-stamped image data associated with the above-mentioned specific user, the date-stamped image data for a subject similar to the subject shown by the date-less image data of the above-mentioned specific user. The information processing apparatus according to Supplementary Note 12 or Supplementary Note 13.

[0296] (Supplementary Note 15) The processor is an information processing apparatus according to any one of Appendices 1 to 14, which includes, in place of the same-day image data group among the plurality of date-added image data, feature data indicating the features of the same-day image data group to which the same date is assigned, in the date-added image data list.

[0297] (Appendix 16) When a plurality of the date-added image data lists are associated with the specific user, the processor obtains, in order from the date-added image data list with a high priority based on the image data included in each of the date-added image data lists among the plurality of date-added image data lists associated with the specific user, the date-added image data for a subject similar to the subject indicated by the date-less image data. The information processing apparatus according to any one of Appendices 1 to 15. The processor is an information processing apparatus according to any one of Appendices 1 to 15, which obtains the date-added image data for a subject similar to the subject indicated by the date-less image data.

[0298] (Appendix 17) The processor is an information processing apparatus according to any one of Appendices 1 to 16, which causes the presentation device to present the derived date.

[0299] (Appendix 18) The processor is an information processing apparatus according to any one of Appendices 1 to 17, which updates the date-added image data list associated with the specific user according to an instruction received by the reception device.

[0300] (Appendix 19) The processor is an information processing apparatus according to any one of Appendices 1 to 18, which creates a date-added image data list for each subject by classifying the plurality of date-added image data for each subject including the physical aspect that appears with aging.

[0301] (Appendix 20) The physical aspect includes the aspect of the head including at least one of the face and hair. The information processing apparatus according to Appendix 19.

[0302] (Appendix 21) When a plurality of the date-added image data lists are associated with the specific user, among the plurality of the date-added image data lists associated with the specific user, in order from the date-added image data list having a larger number of frames of the date-added image data, the date-added image data regarding a subject similar to the subject indicated by the date-less image data is acquired. The information processing apparatus according to any one of Supplementary Notes 1 to 20.

[0303] (Supplementary Note 22) The number of the date-added image data is the number of the date-added image data to which different dates are assigned. The information processing apparatus according to Supplementary Note 21.

[0304] (Supplementary Note 23) An image data group is associated with each of the plurality of users, The plurality of users are a group of users who satisfy the condition that the image data groups are similar to each other, The condition that the image data groups are similar to each other includes the condition that the image data group includes a predetermined plurality or more pieces of image data to which the same person is assigned. The information processing apparatus according to any one of Supplementary Notes 1 to 22.

[0305] (Supplementary Note 24) Position specifying information for specifying an imaging position is given to the image data group, The condition that the image data groups are similar to each other includes the condition that the distribution defined based on the position specifying information as the geographical distribution of the imaging positions is similar among the image data groups. The information processing apparatus according to Supplementary Note 23.

[0306] (Supplementary Note 25) Creating a date-added image data list by classifying a plurality of date-added image data to which dates are assigned, Associating the date-added image data list with a specific user, Obtaining date-added image data for a subject similar to the subject shown by the date-less image data of the specific user from the list of date-added image data associated with the specific user, and Deriving a date to be assigned to the date-less image data based on the date assigned to the obtained date-added image data, including The plurality of date-added image data is image data for a plurality of users including the specific user, The list of date-added image data is created for each subject by classifying the plurality of date-added image data for each subject shown by each of the plurality of date-added image data, An information processing method in which the list of date-added image data for a subject similar to the subject shown by the date-added image data of the specific user is associated with the specific user.

[0307] (Supplementary Note 26) A program for causing a computer to execute processing, The processing includes Creating a list of date-added image data by classifying a plurality of date-added image data to which dates are assigned, Associating the list of date-added image data with a specific user, Obtaining date-added image data for a subject similar to the subject shown by the date-less image data of the specific user from the list of date-added image data associated with the specific user, and Deriving a date to be assigned to the date-less image data based on the date assigned to the obtained date-added image data, including The plurality of date-added image data is image data for a plurality of users including the specific user, The list of date-added image data is created for each subject by classifying the plurality of date-added image data for each subject shown by each of the plurality of date-added image data, The date-added image data list for a subject similar to the subject shown by the date-added image data of the specific user is associated with the specific user. Program.

Claims

1. A processor, and a memory built-in or connected to the processor, and comprises: The processor creates a list of date-stamped image data by classifying a plurality of date-stamped image data with dates assigned thereto, wherein the plurality of date-stamped image data are image data for a plurality of users, and the list of date-stamped image data is created for each subject by classifying the plurality of date-stamped image data for each subject shown by each of the plurality of date-stamped image data. An information processing apparatus.

2. The list of date-stamped image data is associated with each user of the plurality of date-stamped image data included in the list of date-stamped image data and the list of date-stamped image data for a subject similar to the subject shown by the date-stamped image data. The information processing apparatus according to claim 1.

3. The list of date-stamped image data is created by classifying the plurality of date-stamped image data for each subject whose mode of change over time can be visually specified. The information processing apparatus according to claim 1 or claim 2.

4. The date assigned to the plurality of date-stamped image data is the imaging date, and the list of date-stamped image data includes a plurality of the date-stamped image data with different imaging dates. The information processing apparatus according to any one of claims 1 to 3.

5. The plurality of users are a group of users who satisfy the condition that they have completed registration for agreeing to share information including the date-stamped image data. The information processing apparatus according to any one of claims 1 to 4.

6. An image data group is associated with each of the plurality of users, and the plurality of users are a group of users who satisfy the condition that the image data groups are similar to each other. The information processing apparatus according to any one of claims 1 to 5.

7. The plurality of users are a group of users who satisfy the condition that the registered user information is similar. The information processing apparatus according to any one of claims 1 to 6.

8. The date-stamped image data is roughly classified into person-included image data in which a person is captured as a subject and person-excluded image data in which only non-persons are captured as a subject, and the processor acquires only the person-excluded image data as the date-stamped image data, and creates the list of date-stamped image data using the acquired person-excluded image data. The information processing apparatus according to any one of claims 1 to 7.

9. The processor restricts the date-added image data to be the target for creating the date-added image data list among the plurality of date-added image data to image data in which a person having a specific relationship is captured. The information processing apparatus according to any one of claims 1 to 8.

10. The plurality of date-added image data includes image data to which position specifying information for specifying an imaging position is added. The processor restricts the date-added image data to be the target for creating the date-added image data list among the plurality of date-added image data to image data obtained by being imaged within a range determined based on the position specifying information. The information processing apparatus according to any one of claims 1 to 9.

11. Generation specifying information capable of specifying the generation of the user is added to the plurality of date-added image data. The processor restricts the date-added image data to be the target for creating the date-added image data list among the plurality of date-added image data to the generation specified by the generation specifying information. The information processing apparatus according to any one of claims 1 to 10.

12. Creating a date-added image data list by classifying a plurality of date-added image data to which dates are added, The plurality of date-added image data is image data for a plurality of users. The date-added image data list is created for each subject by classifying the plurality of date-added image data for each subject indicated by each of the plurality of date-added image data. Information processing method.

13. A program for causing a computer to execute processing, The processing includes: Creating a date-added image data list by classifying a plurality of date-added image data to which dates are added, The plurality of date-added image data is image data for a plurality of users. The date-added image data list is created for each subject by classifying the plurality of date-added image data for each subject indicated by each of the plurality of date-added image data. Program. ​

Images