Information processing device, information processing method, and program

Abstract

To provide an information processing apparatus, an information processing method, and a program which give proper date to image data having no date.SOLUTION: In an information processing system, a CPU of a server generates dated image data list by classifying a plurality of dated image data, associates the dated image data list with a specific user, acquires dated image data of a subject similar to a subject of undated image data from the dated image data list, and derives a date given to the undated image data on the basis of the date given to the acquired dated image data. The plurality of dated image data are image data of a plurality of users including the specific user. The dated image data list is created for each subject by classifying the plurality of dated image data. The dated image data list of the subject similar to the subject of the dated image data is associated with the specific user.SELECTED DRAWING: Figure 12

Description

[Technical field]

[0001] The technology disclosed herein relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Japanese Patent Application Laid-Open Publication No. 2006-252025 discloses an image management device equipped with an extraction means and an estimation means. The extraction means extracts features of an image from image data whose shooting date and time is unknown. The estimation means estimates the shooting date and time of the image data whose shooting date and time is unknown by comparing the extracted features with a time dictionary that collects objects for identifying the date and time.

[0003] The time dictionary records the relationship between the date and objects expressing the face, hair, body type, clothing, and other parts of the subject. The object is at least one of text data, image data, and video data describing a feature, or at least one of text data, image data, and video data describing a feature representing a specific era or a specific season. Furthermore, the image management device described in JP 2006-252025 A further includes an update means for updating the time dictionary based on the estimation result of the estimation means. Summary of the Invention

[0004] However, if the time dictionary does not contain enough object types, it becomes difficult to accurately estimate the shooting date and time of image data whose shooting date and time is unknown.

[0005] One embodiment of the technology disclosed herein provides an information processing device, an information processing method, and a program that can assign an appropriate date to undated image data, compared to deriving a date to be assigned to undated image data based solely on dated image data owned by a specific user. [Means for solving the problem]

[0006] A first aspect of the technology disclosed herein is an information processing device that includes a processor and a memory built into or connected to the processor, in which the processor creates a dated image data list by classifying multiple dated image data to which dates have been assigned, associates the dated image data list with a specific user, obtains dated image data of a subject similar to a subject indicated by the specific user's undated image data from the dated image data list associated with the specific user, and derives a date to be assigned to the undated image data based on the date assigned to the obtained dated image data, the multiple dated image data being image data for multiple users including the specific user, the dated image data list being created for each subject by classifying the multiple dated image data for each subject indicated by each of the multiple dated image data, and the dated image data list of subjects similar to subjects indicated by the specific user's dated image data is associated with the specific user. [Brief description of the drawings]

[0007] [Figure 1] 1 is a conceptual diagram showing a schematic configuration of an information processing system according to first and second embodiments. [Diagram 2] 2 is a block diagram showing an example of a hardware configuration of an electrical system of a user device included in the information processing system according to the first and second embodiments. FIG. [Diagram 3] 2 is a block diagram showing an example of a hardware configuration of an electrical system of a server included in the information processing system according to the first and second embodiments. FIG. [Figure 4] 11 is a block diagram showing an example of essential functions of a CPU when a date-stamped image data creation process is executed by the CPU of a user device included in the information processing system according to the first embodiment. FIG. [Diagram 5] A block diagram showing an example of the processing contents when the CPU of a user device included in the information processing system according to the first embodiment operates as an imaging control unit, an image data acquisition unit, a GPS information calculation unit, an attribute data creation unit, and a date-stamped image data creation unit. [Figure 6] FIG. 11 is a block diagram showing an example of processing contents when a CPU of a user device included in the information processing system according to the first embodiment operates as a date-stamped image data creation section. [Figure 7] FIG. 2 is a conceptual diagram showing an example of a state in which a plurality of date-stamped image data are stored in the respective storages of a plurality of user devices included in the information processing system according to the first embodiment. [Figure 8] 1 is a conceptual diagram showing an example of how a plurality of user devices included in the information processing system according to the first embodiment upload a group of image data to a server. [Figure 9] 11 is a block diagram showing an example of essential functions of a CPU when a date assignment request process is executed by the CPU of a user device included in the information processing system according to the first embodiment. FIG. [Figure 10] 4] FIG. 4 is a block diagram showing an example of processing contents when a CPU of a user device included in the information processing system according to the first embodiment operates as a request data creating unit, a request data transmitting unit, and a display control unit. [Figure 11] 11 is a block diagram showing an example of essential functions of a CPU of a server included in the information processing system according to the first embodiment when the CPU executes a date-stamped image data list creation process. FIG. [Figure 12] FIG. 11 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a date-stamped image data acquisition unit and a user ID extraction unit. [Figure 13] A block diagram showing an example of the processing contents when the CPU of the server included in the information processing system according to the first embodiment operates as a user ID extraction unit, a determination unit, an image data group acquisition unit, a memory control unit, and a date-stamped image data acquisition unit. [Figure 14] 4 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as an image data group acquisition unit, a determination unit, and a person image data extraction unit. FIG. [Figure 15]10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a determination unit and an erasure unit. FIG. [Figure 16] 10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a determination unit and an erasure unit. FIG. [Figure 17] 4 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as an image data group acquisition unit, a determination unit, and a GPS information extraction unit. FIG. [Figure 18] 1 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a GPS information extraction unit and a distribution area map creation unit. FIG. [Figure 19] 10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a distribution area map creating unit, an overlapping area ratio calculating unit, and a determining unit. FIG. [Figure 20] 10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a determination unit and an erasure unit. FIG. [Figure 21] 10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a distribution area diagram creating unit, a determining unit, and an erasing unit. FIG. [Figure 22] 10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a user ID extraction unit and a user information acquisition unit. FIG. [Figure 23] 11 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a user information acquisition unit, a user information coincidence calculation unit, a determination unit, and an erasure unit. FIG. [Figure 24]FIG. 11 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a date-stamped image data acquisition unit and a non-human image data extraction unit. [Diagram 25] 10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as an image data list creation unit. FIG. [Figure 26] 4 is a conceptual diagram showing an example of first and second object image data lists created by a CPU of a server included in the information processing system according to the first embodiment operating as an image data list creation section. FIG. [Figure 27] 13 is a conceptual diagram showing an example of third and fourth object image data lists created by a CPU of a server included in the information processing system according to the first embodiment operating as an image data list creation section. FIG. [Figure 28] 10 is a conceptual diagram showing an example of fifth to Nth object image data lists created by a CPU of a server included in the information processing system according to the first embodiment operating as an image data list creation section. FIG. [Figure 29] 10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as an image data list creating unit and an image data list sorting unit. FIG. [Diagram 30] FIG. 11 is a conceptual diagram showing an example of a state in which a first user is associated with a date-stamped image data list as a result of a date-stamped image data list creation process being executed by a CPU of a server included in the information processing system according to the first embodiment. [Diagram 31] FIG. 11 is a conceptual diagram showing an example of a state in which a second user is associated with a date-stamped image data list as a result of a date-stamped image data list creation process being executed by a CPU of a server included in the information processing system according to the first embodiment. [Diagram 32]FIG. 11 is a conceptual diagram showing an example of a state in which a third user is associated with a date-stamped image data list as a result of a date-stamped image data list creation process being executed by a CPU of a server included in the information processing system according to the first embodiment. [Diagram 33] FIG. 11 is a conceptual diagram showing an example of a state in which a fourth user is associated with a date-stamped image data list as a result of a date-stamped image data list creation process being executed by a CPU of a server included in the information processing system according to the first embodiment. [Diagram 34] 10 is a block diagram showing an example of essential functions of a CPU when a date assignment process is executed by the CPU of a user device included in the information processing system according to the first embodiment. FIG. [Diagram 35] 10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a user ID extraction unit and an image data list acquisition unit. FIG. [Diagram 36] 10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as a user ID extraction unit and an image data list acquisition unit. FIG. [Figure 37] 10 is a block diagram showing an example of processing contents when a CPU of a server included in the information processing system according to the first embodiment operates as an image data list acquisition unit, an undated image data extraction unit, and a determination unit. FIG. [Figure 38] A block diagram showing an example of the processing contents when the CPU of the server included in the information processing system according to the first embodiment operates as a determination unit, a date derivation unit, a date-undated image data extraction unit, a date assignment unit, and an image data transmission unit. [Figure 39A] 10 is a flowchart showing an example of the flow of date-stamped image data list creation processing according to the first embodiment. [Figure 39B] This is a continuation of the flowchart shown in Figure 39A. [Figure 39C] This is a continuation of the flowchart shown in Figures 39A and 39B. [Figure 39D]This is a continuation of the flowchart shown in Figure 39C. [Figure 39E] This is a continuation of the flowchart shown in Figure 39C. [Diagram 40] 10 is a flowchart showing an example of the flow of a date assignment process according to the first embodiment. [Diagram 41] 13 is a flowchart showing an example of the flow of a date assignment request process according to the first embodiment. [Diagram 42] FIG. 11 is a block diagram showing an example of essential functions of a CPU of a server included in an information processing system according to a second embodiment when the CPU executes a date-stamped image data list update process. [Diagram 43] FIG. 11 is a block diagram showing an example of processing contents when a CPU of a server included in an information processing system according to a second embodiment operates as a date adding section, a date deriving section, and a date-stamped image data generating section. [Diagram 44] A block diagram showing an example of processing contents when a CPU of a server included in an information processing system according to a second embodiment operates as a date-stamped image data generating unit, a date derivation unit, a similarity calculating unit, a judgment unit, and an image quality specifying unit. [Diagram 45] FIG. 11 is a block diagram showing an example of processing contents when a CPU of a server included in an information processing system according to a second embodiment operates as an image quality specifying unit, a determining unit, an image data adding unit, and a date-stamped image data generating unit. [Diagram 46] 13 is a flowchart showing an example of the flow of date-stamped image data list update processing according to the second embodiment. [Figure 47A] 13 is a flowchart showing an example of the flow of a date assignment process according to the second embodiment. [Figure 47B] This is a continuation of the flowchart shown in FIG. 47A. [Figure 48] FIG. 13 is a block diagram showing a modified example of the image data list creation unit. [Figure 49A] 13 is a flowchart showing a modified example of the flow of the date assignment process. [Figure 49B] This is a continuation of the flowchart shown in Figure 49A. [Figure 50] FIG. 13 is a conceptual diagram showing an example of a list of a plurality of date-stamped image data to which priority is assigned. [Figure 51] 13 is a flowchart showing a modified example of the flow of the date-included image data list creation process. [Figure 52] 13A and 13B are conceptual diagrams showing modified examples of attribute data included in date-stamped image data. [Figure 53] This is a modified example of the flowchart shown in FIG. 39E. [Figure 54] A block diagram showing an example of how a dated image data creation program and a date-adding request processing program are installed on a computer in a user device from a storage medium on which the dated image data creation program and the date-adding request processing program are stored. [Figure 55] A block diagram showing an example of how a dated image data list creation program, a date assignment processing program, and a dated image data list update program are installed on a computer in a server from a storage medium on which the dated image data list creation program, the date assignment processing program, and the dated image data list update program are stored. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] An example of an embodiment of an information processing device, an information processing method, and a program according to the technology of the present disclosure will be described with reference to the attached drawings.

[0009] First, the terms used in the following description will be explained.

[0010] CPU is an abbreviation for "Central Processing Unit". RAM is an abbreviation for "Random Access Memory". SSD is an abbreviation for "Solid State Drive". HDD is an abbreviation for "Hard Disk Drive". EEPROM is an abbreviation for "Electrically Erasable and Programmable Read Only Memory". ASIC is an abbreviation for "Application Specific Integrated Circuit". PLD is an abbreviation for "Programmable Logic Device". FPGA is an abbreviation for "Field-Programmable Gate Array". SoC is an abbreviation for "System-on-a-chip". CMOS is an abbreviation for "Complementary Metal Oxide Semiconductor". CCD is an abbreviation for "Charge Coupled Device". EL is an abbreviation for "Electro-Luminescence". UI is an abbreviation for "User Interface". USB is an abbreviation for "Universal Serial Bus". GPU is an abbreviation for "Graphics Processing Unit". GPS is an abbreviation for "Global Positioning System". RTC is an abbreviation for "Real Time Clock". ID is an abbreviation for "Identification". Exif is an abbreviation for "exchangeable image file format". WAN is an abbreviation for "Wide Area Network". LAN is an abbreviation for "Local Area Network".

[0011] In addition, in the explanation of this specification, "match" refers to a perfect match as well as a match that includes a generally acceptable margin of error in the technical field to which the technology of the present disclosure belongs (including a margin of error that does not contradict the spirit of the technology of the present disclosure). In addition, in the explanation of this specification, "same" in "same date" refers to a perfect match as well as a match that includes a generally acceptable margin of error in the technical field to which the technology of the present disclosure belongs (including a margin of error that does not contradict the spirit of the technology of the present disclosure).

[0012] [First embodiment] As an example, as shown in FIG. 1, an information processing system 10 includes a plurality of user devices 12 and a server 14. The user device 12 is a terminal device that transmits and receives input information and / or image information by a user 16 to and from the server 14, and is, for example, a smartphone. In the example shown in FIG. 1, user devices 12A, 12B, 12C, and 12D are shown as the plurality of user devices 12. In the following, for convenience of explanation, when it is not necessary to distinguish between the user devices 12A, 12B, 12C, and 12D, they are simply referred to as "user devices 12". Note that, for convenience of explanation, four user devices 12 are illustrated here, but the technology of the present disclosure is not limited thereto, and the number of user devices 12 may be more than one. In addition, a smartphone is illustrated here as the user device 12, but the technology of the present disclosure is not limited thereto, and the user device 12 may be a tablet terminal, a personal computer, a wearable terminal, and / or a photographing terminal such as a digital camera.

[0013] The information processing system 10 is used by multiple users 16. In the example shown in Fig. 1, users 16A, 16B, 16C, and 16D are shown as the multiple users 16. For convenience of explanation, in the following, when there is no need to distinguish between the users 16A, 16B, 16C, and 16D, they will be simply referred to as "users 16".

[0014] Each of the multiple users 16 is assigned one user device 12. User 16A is assigned user device 12A. User 16B is assigned user device 12B. User 16C is assigned user device 12C. User 16D is assigned user device 12D. For example, user 16A is the owner of user device 12A, user 16B is the owner of user device 12B, user 16C is the owner of user device 12C, and user 16D is the owner of user device 12D. Note that, although a case where each user 16 uses a user device 12 is illustrated, two or more users 16 may use one user device 12, and one user 16 may use two or more user devices 12.

[0015] The multiple user devices 12 are connected to the server 14 via a network 18. The multiple user devices 12 and the server 14 are connected to the network 18 so as to be able to communicate with each other. The network 18 is configured, for example, as at least one of a WAN and a LAN. The multiple user devices 12 and the network 18, and the server 14 and the network 18 may be connected to each other via a wireless communication method or a wired communication method. Although not shown in the example shown in FIG. 1, the network 18 includes, for example, a base station. The network 18 establishes communication between the multiple user devices 12 and the server 14, and transmits and receives various information between the multiple user devices 12 and the server 14. The server 14 receives a request from the user device 12 via the network 18, and provides a service according to the request to the user device 12 that is the request source via the network 18. The server 14 is an example of an "information processing device" according to the technology of the present disclosure.

[0016] The user device 12 uses radio waves transmitted from the GPS satellites 20 to calculate GPS information as location identification information capable of identifying the current location of the user device 12. The GPS information is, for example, latitude and longitude. In the first embodiment, for convenience of explanation, latitude and longitude are given as an example of GPS information, but the technology of the present disclosure is not limited thereto, and the GPS information may be latitude, longitude, and altitude. Note that the GPS information is an example of "location identification information" according to the technology of the present disclosure.

[0017] As an example, as shown in FIG. 2, the user device 12 includes a computer 22, an imaging device 24, a clock 26, a communication I / F 28, a GPS receiver 30, an accepting device 32, a display 34, a microphone 36, a speaker 38, and an external I / F 40. The computer 22 includes a CPU 42, a storage 44, and a memory 46. The CPU 42, the storage 44, and the memory 46 are connected to a bus 48. The imaging device 24, the clock 26, the communication I / F 28, the GPS receiver 30, the accepting device 32, the display 34, the microphone 36, the speaker 38, and the external I / F 40 are also connected to the bus 48. In the example shown in FIG. 2, for convenience of illustration, one bus is shown as the bus 48, but the bus 48 includes a data bus, an address bus, a control bus, and the like.

[0018] The CPU 42 controls the entire user device 12. The storage 44 stores various parameters and various programs. The storage 44 is a non-volatile storage device. Here, an EEPROM is used as an example of the storage 44, but the storage 44 is not limited to this and may be an SSD and / or an HDD. The memory 46 is a volatile storage device. The memory 46 is used as a work memory by the CPU 42 and temporarily stores various information. Here, a DRAM is used as an example of the memory 46, but the storage 44 is not limited to this and may be another type of volatile storage device such as an SRAM.

[0019] The imaging device 24 is a device that generates image data. The imaging device 24 has, for example, a CMOS image sensor, and is equipped with a zoom mechanism and a focus adjustment mechanism. Here, a CMOS image sensor is exemplified as the image sensor of the imaging device 24, but the image sensor is not limited to this and may be another type of image sensor such as a CCD image sensor. The imaging device 24 captures an image of a subject according to an instruction from the CPU 42. The imaging device 24 captures an image of the subject to generate image data indicating the subject. The CPU 42 acquires the image data generated by the imaging device 24, and stores the acquired image data in the storage 44.

[0020] The clock 26 acquires the current time. The clock 26 is, for example, an RTC, and receives a supply of driving power from a power supply system that is separated from the power supply system for the computer 22, and continues to keep track of the current time (year, month, day, hour, minute, and second) even when the computer 22 is shut down. The clock 26 outputs the current time to the CPU 42 every time the current time is updated.

[0021] The communication I / F 28 is connected to the network 18 via wireless communication, and controls the transmission and reception of various types of information between the CPU 42 and the server 14 via the network 18.

[0022] The GPS receiver 30 receives radio waves from a plurality of GPS satellites (not shown) including the GPS satellite 20 in response to an instruction from the CPU 42, and outputs reception result information indicating the reception result to the CPU 42. The CPU 42 calculates the above-mentioned GPS information based on the reception result information input from the GPS receiver 30.

[0023] The receiving device 32 receives instructions from the user 16, etc. Examples of the receiving device 32 include a touch panel 32A and a hard key. The instructions received by the receiving device 32 are acquired by the CPU 42. The receiving device 32 may also receive instructions from the user 16, etc. by voice input via the microphone 36.

[0024] The display 34 displays various information under the control of the CPU 42. An example of the display 34 is a liquid crystal display. Note that the display 34 is not limited to a liquid crystal display, and other types of displays such as an organic electroluminescence (EL) display may be used.

[0025] In the first embodiment, an out-cell type touch panel display is used in which the touch panel 32A is overlaid on the surface of the display area of ​​the display 34. However, the out-cell type touch panel display is merely one example, and for example, an on-cell type or in-cell type touch panel display can also be applied.

[0026] The microphone 36 converts the collected sound into an electrical signal, and outputs the electrical signal obtained by converting the sound to the CPU 42.

[0027] The speaker 38 converts an electrical signal input from a specific device (eg, the CPU 42) into sound, and outputs the sound obtained by converting the electrical signal to the outside of the user device 12.

[0028] The external I / F 40 is responsible for transmitting and receiving various types of information between the user device 12 and devices external to the user device 12. An example of the external I / F 40 is a USB interface. A user device, a personal computer, a server, a USB memory, a memory card, and / or a printer, etc., are connected to the USB interface.

[0029] As an example, as shown in Fig. 3, the server 14 includes a computer 50, a communication I / F 52, a receiving device 54, a display 56, and an external I / F 58. The computer 50 includes a CPU 60, a storage 62, and a memory 64. The CPU 60, the storage 62, and the memory 64 are connected to a bus 66. The communication I / F 52, the receiving device 54, the display 56, and the external I / F 58 are also connected to the bus 66. Note that in the example shown in Fig. 3, for convenience of illustration, one bus is shown as the bus 66, but the bus 66 includes a data bus, an address bus, a control bus, and the like.

[0030] The CPU 60 controls the entire server 14. The storage 62 stores various parameters and various programs. The storage 62 is a non-volatile storage device. Here, an SSD is used as an example of the storage 62, but the storage 62 may be an EEPROM and / or an HDD. The memory 64 is a volatile storage device. The memory 64 is used as a work memory by the CPU 60 and temporarily stores various information. Here, a DRAM is used as an example of the memory 64, but the storage 62 may be another type of volatile storage device such as an SRAM. The CPU 60 is an example of a "processor" according to the technology of the present disclosure, and the storage 62 and the memory 64 are an example of a "memory" according to the technology of the present disclosure.

[0031] The communication I / F 52 is communicatively connected to the network 18 and controls the exchange of various information between the CPU 60 and the user device 12 via the network 18.

[0032] The receiving device 54 receives instructions from an administrator of the server 14. Examples of the receiving device 54 include a remote controller, a touch panel, a hard key, and / or voice input via a microphone. The instructions received by the receiving device 54 are acquired by the CPU 60.

[0033] The display 56 displays various information under the control of the CPU 60. An example of the display 56 is a liquid crystal display. Note that the display 56 is not limited to a liquid crystal display, and other types of displays such as an EL display may be used.

[0034] The external I / F 58 controls the transmission and reception of various information between the server 14 and devices existing outside the server 14. An example of the external I / F 58 is a USB interface. A user device, a personal computer, a server, a USB memory, a memory card, and / or a printer, etc. are connected to the USB interface.

[0035] In the information processing system 10, a plurality of user devices 12 upload date-stamped image data to the server 14, and the server 14 manages the uploaded date-stamped image data. Here, the date-stamped image data refers to image data to which a date has been added. The date-stamped image data is created by the user device 12, for example.

[0036] In the user device 12, the CPU 42 executes a date-stamped image data creation process to create date-stamped image data. As an example, as shown in FIG. 4, a date-stamped image data creation program 68 is stored in the storage 44. The CPU 42 reads out the date-stamped image data creation program 68 from the storage 44. The CPU 42 then executes the date-stamped image data creation program 68 read out from the storage 44 on the memory 46 to operate as the imaging control unit 42A, the image data acquisition unit 42B, the GPS information calculation unit 42C, the attribute data creation unit 42D, and the date-stamped image data creation unit 42E. That is, the date-stamped image data creation process is realized by the CPU 42 operating as the imaging control unit 42A, the image data acquisition unit 42B, the GPS information calculation unit 42C, the attribute data creation unit 42D, and the date-stamped image data creation unit 42E.

[0037] 5, when an instruction to start imaging (hereinafter also referred to as an "imaging start instruction") is received by the receiving device 32, the imaging control unit 42A controls the imaging device 24 to cause the imaging device 24 to capture an image of the subject. The imaging device 24 captures an image of the subject to generate image data. The image data acquisition unit 42B acquires the image data from the imaging device 24.

[0038] The GPS information calculation unit 42C calculates GPS information based on the reception result information input from the GPS receiver 30.

[0039] The storage 44 stores a user ID capable of identifying the user 16. The attribute data creation unit 42D creates attribute data indicating attributes of the image data acquired by the image data acquisition unit 42B. The attribute data is created when one frame of image data is captured by the imaging device 24. That is, the attribute data is created by the attribute data creation unit 42D every time one frame of image data is captured by the imaging device 24.

[0040] The attribute data creation unit 42D acquires GPS information from the GPS information calculation unit 42C. The attribute data creation unit 42D also acquires a user ID from the storage 44. Furthermore, the attribute data creation unit 42D acquires the current time from the clock 26. Then, the attribute data creation unit 42D creates attribute data including the user ID, date, and GPS information. The GPS information is included in the attribute data as information for identifying the imaging position. The attribute data also includes Exif information and the like.

[0041] Moreover, here, the current time obtained by attribute data creation unit 42D from clock 26 is used as the date included in the attribute data. Since the attribute data is created at the timing when one frame of image is captured by imaging device 24 as described above, the date included in the attribute data is the date when the image was captured (hereinafter also referred to as the "image capture date").

[0042] Each time one frame's worth of imaging is performed, dated image data creation unit 42E acquires image data from image data acquisition unit 42B and acquires attribute data from attribute data creation unit 42D. Then, dated image data creation unit 42E creates dated image data by associating image data and attribute data on a frame-by-frame basis.

[0043] As shown in Fig. 6 as an example, each time dated image data is created by dated image data creation unit 42E, the dated image data is stored in storage 44 by dated image data creation unit 42E. Storage 44 holds a plurality of dated image data (e.g., a plurality of frames of dated image data) as an image data group. In this manner, in each of the plurality of user devices 12, dated image data is created each time an image is captured, and as shown in Fig. 7 as an example, a plurality of dated image data is held as an image data group in storage 44 of each of the plurality of user devices 12.

[0044] 8, each of a plurality of users 16 operates their own user device 12 to upload a group of image data stored in the storage 44 to the server 14. In this manner, the group of image data uploaded to the server 14 is stored and managed by the server 14.

[0045] In the information processing system 10, when the user 16 has image data that does not contain a date (hereinafter also referred to as "undated image data"), the user 16 can use the user device 12 to request the server 14 to add a date to the undated image data. In this case, in the user device 12, a date addition request process is executed by the CPU 42, whereby a request is made to the server 14 to add a date to the undated image data.

[0046] 9, a date assignment request processing program 70 is stored in the storage 44. The CPU 42 reads out the date assignment request processing program 70 from the storage 44. The CPU 42 then executes the date assignment request processing program 70 read out from the storage 44 on the memory 46, thereby operating as a request data creation unit 42F, a request data transmission unit 42G, and a display control unit 42H. In other words, the date assignment request processing is realized by the CPU 42 operating as the request data creation unit 42F, the request data transmission unit 42G, and the display control unit 42H.

[0047] As an example, as shown in FIG. 10, when an instruction to create request data (hereinafter also referred to as a "request data creation instruction") is received by the receiving device 32, the request data creation unit 42F creates the request data. Here, the request data refers to data indicating a request to the server 14 to add a date to undated image data. When the request data creation instruction is received by the receiving device 32, the request data creation unit 42F first acquires a user ID from the storage 44, and acquires undated image data from an external device (e.g., a USB memory or an SSD) via the external I / F 40. Next, the request data creation unit 42F creates the request data by associating the acquired user ID with the undated image data. Then, the request data creation unit 42F outputs the created request data to the request data transmission unit 42G. Note that, in the information processing system 10, the user device 12 assigns a user ID as attribute data included in the dated image data or undated image data, but the technology of the present disclosure is not limited to this. For example, a user authentication process for identifying the user 16 who uses the user device 12 may be performed between the server 14 and the user device 12, and dated image data or undated image data may be generated by assigning a user ID associated with the image uploaded after authentication and the authenticated user 16. Alternatively, the user device 12 may assign a device ID for identifying the user device 12 instead of the user ID as attribute data included in the dated image data or undated image data, and the server 14 may hold a correspondence list of the users 16 and the device IDs corresponding to each of the users 16 in the storage 62, and identify the user ID from the device ID included in the dated image data or undated image data based on the correspondence list.

[0048] The request data transmission unit 42G transmits the request data input from the request data creation unit 42F to the server 14 via the communication I / F .

[0049] The server 14 receives the request data sent from the request data sending unit 42G, and generates date-added image data by adding a date to the undated image data included in the received request data, and provides the image data to the user device 12 that made the request.

[0050] The display control unit 42H causes the display 34 to display an image represented by the date-added image data provided by the server 14 (hereinafter, also referred to as a "dated image").

[0051] The date-added image data is generated by the CPU 60 of the server 14 executing a date-added image data list creation process (see FIG. 11) and a date addition process (see FIG. 34).

[0052] 11 as an example, a date-printed image data list creation program 72 is stored in storage 62. CPU 60 reads out date-printed image data list creation program 72 from storage 62. Then, CPU 60 executes date-printed image data list creation program 72 read out from storage 62 on memory 64 to operate as date-printed image data acquisition unit 60A, user ID extraction unit 60B, memory control unit 60C, image data group acquisition unit 60D, person image data extraction unit 60E, deletion unit 60F, GPS information extraction unit 60G, distribution area map creation unit 60H, overlap area ratio calculation unit 60I, user information acquisition unit 60J, user information coincidence calculation unit 60K, non-person image data extraction unit 60L, image data list creation unit 60M, image data list classification unit 60N, and determination unit 60P. In other words, the date-stamped image data list creation process is realized by the CPU 60 operating as a date-stamped image data acquisition unit 60A, a user ID extraction unit 60B, a memory control unit 60C, an image data group acquisition unit 60D, a person image data extraction unit 60E, an erasure unit 60F, a GPS information extraction unit 60G, a distribution area map creation unit 60H, an overlap area percentage calculation unit 60I, a user information acquisition unit 60J, a user information consistency calculation unit 60K, a non-person image data extraction unit 60L, an image data list creation unit 60M, an image data list classification unit 60N, and a judgment unit 60P.

[0053] The CPU 60 creates a dated image data list by executing a dated image data list creation process. The dated image data list is created for each subject by classifying the dated image data for each subject indicated by each of the dated image data. The "subject" here refers to a subject whose change over time can be visually identified. The "date-stamped image data" to be classified here refers to date-stamped image data with different dates, and image data for multiple users 16 including a specific user. The specific user refers to, for example, a user 16 (e.g., the owner of the user device 12) to which the user device 12 that transmitted the request data to the server 14 is assigned among the multiple users 16.

[0054] Furthermore, CPU 60 executes the dated image data list creation process to associate the dated image data list with a specific user. The specific user is associated with a dated image data list of subjects similar to subjects represented by the dated image data of the specific user.

[0055] As an example, as shown in FIG. 12, when the image data group transmitted from the user device 12 is received by the communication I / F 52, the dated image data acquisition unit 60A acquires the image data group received by the communication I / F 52. Then, the dated image data acquisition unit 60A acquires the dated image data from the image data group. The user ID extraction unit 60B extracts the user ID from the attribute data included in the dated image data acquired by the dated image data acquisition unit 60A. Note that the user ID extraction unit 60B extracts the user ID from the attribute data included in the dated image data, but this is not limited to this. The server 14 may hold in the storage 62 a list in which the user IDs of multiple users are associated with the dated image data associated with each of the multiple users 16, and the user ID extraction unit 60B may select a predetermined condition or a user ID of an arbitrary user 16 from the multiple users 16 stored. The predetermined condition may be, for example, the timing when the user 16 uploads the dated image data via the user device 12.

[0056] 13, a registered user list is stored in storage 62. The registered user list is a list showing a plurality of user IDs that can identify a group of users who satisfy the condition that they have registered and agreed to share information including date-stamped image data. In other words, a plurality of users 16 identified by a plurality of user IDs shown in the registered user list is a group of users who have registered and agreed to share information including date-stamped image data (hereinafter also referred to as a "registered user group").

[0057] The registered user group is further narrowed down by executing the date-stamped image data list creation process shown below by the CPU 60. As described above, each of the multiple users 16 is associated with an image data group, and the registered user group is narrowed down to users who satisfy the condition that the image data groups are similar to each other. Furthermore, the registered user group is narrowed down to users who satisfy the condition that the registered user information is similar. This will be explained in more detail below.

[0058] The determination unit 60P determines whether or not the user ID extracted by the user ID extraction unit 60B is a registered user ID by referring to the registered user list in the storage 62. If the determination unit 60P determines that the user ID is a registered user ID, the storage control unit 60C stores in the storage 62 the image data group acquired by the dated image data acquisition unit 60A.

[0059] When the determination unit 60P determines that the user ID extracted by the user ID extraction unit 60B is not a registered user ID, the determination unit 60P then determines whether or not there are multiple groups of image data groups stored in the storage 62. When the number of groups of image data groups stored in the storage 62 is not multiple, the determination unit 60P waits until the next determination timing arrives.

[0060] When the determination unit 60P determines that the number of image data groups stored in the storage 62 is plural, it instructs the image data group acquisition unit 60D to acquire the image data groups.

[0061] 14, when image data group acquisition unit 60D is instructed by determination unit 60P to acquire an image data group, it acquires the image data group from storage 62. Person image data extraction unit 60E executes image recognition processing on dated image data included in the image data group to extract person image data showing a person from the dated image data and associates the extracted person image data with the dated image data from which it was extracted. Person image data extraction unit 60E then stores the dated image data associated with the person image data in storage 62 for each image data group, and returns the dated image data for each image data group to storage 62.

[0062] In the first embodiment, image recognition processing is performed by image analysis using a cascade classifier. However, this is merely one example, and other image recognition processing such as pattern matching may be used, and any processing may be used as long as it is possible to recognize object image data showing a specific object from date-stamped image data.

[0063] As an example, as shown in FIG. 15, the determination unit 60P determines whether or not the number of frames of person image data of the same person (hereinafter also referred to as "same person image data") is equal to or greater than a first preset frame number (for example, 10) for each image data group stored in the storage 62. Here, the determination of whether or not it is the same person image data is performed based on an image recognition result obtained by executing an image recognition process on the person image data associated with the date-stamped image data. Note that here, the first preset frame number is a fixed value. However, this is merely an example, and the first preset frame number may be a fixed value or a variable value as long as it is a natural number equal to or greater than 2. Examples of the variable value include a value that can be changed according to an instruction accepted by the accepting device 54, or a value that is changed periodically.

[0064] When the determination unit 60P determines that the number of frames of the same person image data is less than the first preset number of frames, it instructs the erasing unit 60F to erase the image data group determined as the determination target from the image data group for which an image data list is to be created. When the erasing of the image data group is instructed by the determination unit 60P, the erasing unit 60F erases the image data group determined as the determination target from the image data group for which an image data list is to be created in the storage 62. Note that, in this embodiment, the CPU 60 has the erasing unit 60F that erases the image data group determined as the determination target by the determination unit 60P from the image data group for which an image data list is to be created, but this is not limited thereto. For example, the determination unit 60P may have an extraction unit that extracts the image data group determined as the determination target from the storage 44 as the image data group for which an image data list is to be created.

[0065] 16 as an example, on the other hand, when the determination unit 60P determines that the number of frames of the same person image data is equal to or greater than the first preset frame number, the determination unit 60P determines whether or not there are a plurality of groups of image data groups stored in the storage 62, the groups being determined to have the number of frames of the same person image data equal to or greater than the first preset frame number. Here, if there are not a plurality of groups of image data groups, the determination unit 60P waits until the next determination timing arrives. On the other hand, when there are a plurality of groups of image data groups, the determination unit 60P determines whether or not the number of frames of the common same person image data is equal to or greater than a second preset frame number (for example, 5) for each of the image data groups determined to have the number of frames of the same person image data equal to or greater than the first preset frame number.

[0066] Here, when image data in which the number of frames of common same person image data is less than the second preset frame number exists, the determination unit 60P instructs the erasing unit 60F to erase the image data group in which the number of frames of common same person image data is less than the second preset frame number from the image data group for which an image data list is to be created. When the erasure of the image data group is instructed by the determination unit 60P, the erasing unit 60F erases the image data group in which the number of frames of common same person image data is less than the second preset frame number from the image data group in the storage 62 for which an image data list is to be created. On the other hand, when an image data group in which the number of frames of common same person image data is equal to or greater than the second preset frame number exists, the determination unit 60P instructs the image data group acquisition unit 60D to acquire the image data group in which the number of frames of common same person image data is equal to or greater than the second preset frame number from the storage 62 as the image data group for which an image data list is to be created.

[0067] 17, when the image data group acquisition unit 60D is instructed by the determination unit 60P to acquire an image data group, the image data group acquisition unit 60D acquires an image data group in which the number of frames of common image data of the same person is equal to or greater than a second default number of frames from the storage 62. The GPS information extraction unit 60G extracts GPS information from attribute data in date-stamped image data included in the image data group acquired by the image data group acquisition unit 60D.

[0068] As an example, as shown in FIG. 18, the distribution area map creating unit 60H acquires the GPS information extracted by the GPS information extracting unit 60G for each image data group. Then, the distribution area map creating unit 60H creates an imaging position distribution area map for the image data group based on the GPS information for each image data group. The imaging position distribution area map is a diagram showing an area where the positions where imaging was performed (hereinafter also referred to as "imaging positions") indicated by the GPS information are distributed. In the example shown in FIG. 18, imaging position distribution area maps for two image data groups are shown, but the technology of the present disclosure is not limited to this, and imaging position distribution area maps are created for the number of image data groups.

[0069] As an example, as shown in FIG. 19, the overlapping area ratio calculation unit 60I calculates the ratio of an area where the imaging position distribution area maps overlap between image data groups (hereinafter, also referred to as "overlapping area"). The determination unit 60P determines whether the ratio of the overlapping area is equal to or greater than a preset ratio (e.g., 60%). Here, the preset ratio is a fixed value. However, this is merely an example, and the preset ratio may be a variable value. Examples of the variable value include a value that can be changed according to an instruction accepted by the accepting device 54, or a value that is changed periodically. In the example shown in FIG. 19, the hatched area indicates the overlapping area, which is equal to or greater than the preset ratio.

[0070] 20, when the determination unit 60P determines that the ratio of the overlapping area is less than a preset ratio, the determination unit 60P instructs the erasing unit 60F to erase the image data group that is the determination target. For example, when the ratio of the overlapping area of ​​the imaging position distribution area map between two image data groups is less than a preset ratio, the determination unit 60P instructs the erasing unit 60F to erase the two image data groups.

[0071] The erasing unit 60F limits the dated image data to be used for creating the dated image data list to image data obtained by capturing images within a range determined based on GPS information. That is, when the determination unit 60P instructs the erasing unit 60F to erase the image data group from the image data group for which the image data list is to be created, the erasing unit 60F erases the image data group determined to be the object of the determination from the image data group in the storage 62 for which the image data list is to be created, thereby limiting the dated image data to be used for creating the dated image data list.

[0072] On the other hand, when the determination unit 60P determines that the ratio of overlapping areas among all the image data groups is equal to or greater than the predetermined ratio, it determines whether the number of image data groups stored in the storage 62 is more than one.

[0073] 21, when the number of image data groups stored in storage 62 is not multiple, determination unit 60P waits until the next determination timing arrives. On the other hand, when determination unit 60P determines that the number of image data groups stored in storage 62 is multiple, erasure unit 60F acquires GPS information outside the overlapping area between image data groups stored in storage 62 from distribution area map creation unit 60H. Then, erasure unit 60F refers to the GPS information acquired from distribution area map creation unit 60H and erases dated image data to which GPS information outside the overlapping area is added, from among the dated image data included in the image data groups stored in storage 62, from the dated image data for which an image data list is to be created.

[0074] 22, user information is associated with a registered user ID in the storage 62. The user information is information about a user 16 identified by the corresponding user ID. Examples of user information include generation identification information, family structure information, address information, gender information, occupation information, and hobby information.

[0075] The generation identification information is information indicating the generation of the user 16. For example, if the user 16 was born in 1975, information such as "1970 to 1980s" is used as the generation identification information. The family structure information is information indicating the family structure of the user 16. Examples of the family structure information include information indicating married or unmarried, the number of older siblings, the number of younger siblings, the number of older siblings, the number of younger siblings, the age difference between siblings, and / or the ages of the parents. The address information is information indicating the address of the user 16. Examples of the address information include information indicating the country name, prefecture name, and / or city / town name. The gender information is information indicating the gender of the user 16. Examples of the gender information include information indicating male and female. The occupation information is information indicating the occupation of the user 16. Examples of the occupation information include information indicating sales, technical, teaching, unemployed, and / or housewife. The hobby information is information indicating the hobby of the user 16. Hobby information may include, for example, outdoors, indoors, golf, soccer, baseball, fishing, watching movies, reading, and / or internet games.

[0076] The user ID extraction unit 60B extracts a user ID from each of the image data groups stored in the storage 62. The user information acquisition unit 60J acquires user information corresponding to the user ID extracted by the user ID extraction unit 60B, and associates the acquired user information with the corresponding user ID.

[0077] As an example, as shown in FIG. 23, the user information coincidence calculation unit 60K acquires user information for each user ID from the user information acquisition unit 60J, and calculates the coincidence of user information between user IDs (hereinafter also referred to as "user information coincidence"). The determination unit 60P determines whether or not a group of image data whose user information coincidence between any user ID is less than a default coincidence (e.g., 5%) is stored in the storage 62. Note that here, a fixed value is adopted as the default coincidence. However, this is merely an example, and the default coincidence may be a variable value. Examples of the variable value include a value that can be changed according to an instruction accepted by the accepting device 54, or a value that is changed periodically.

[0078] When no image data group with a user information coincidence degree less than the default coincidence degree is stored in the storage 62 for any user ID, the determination unit 60P waits until the next determination timing arrives. When an image data group with a user information coincidence degree less than the default coincidence degree is stored in the storage 62 for any user ID, the determination unit 60P instructs the erasing unit 60F to erase the image data group with a user information coincidence degree less than the default coincidence degree from the image data group for which the image data list is to be created. In response to this, the erasing unit 60F erases the image data group with a user information coincidence degree less than the default coincidence degree from the image data group in the storage 62 for which the image data list is to be created.

[0079] 24, dated image data acquisition unit 60A acquires dated image data from each image data group in storage 62. Non-person image data extraction unit 60L extracts non-person image data indicating non-people from the dated image data by performing image recognition processing on the dated image data acquired by dated image data acquisition unit 60A, and associates the extracted non-person image data with the dated image data from which it was extracted. Non-person image data extraction unit 60L stores the dated image data associated with the non-person image data in storage 62 for each image data group, and returns the dated image data to storage 62 for each image data group.

[0080] Here, a non-human refers to an object other than a human, whose manner of change over time can be visually identified. Here, examples of the manner of change over time include the manner of an object that symbolizes an era. Examples of objects that symbolize an era include buildings, roads, streetscapes, signs, posters, and food.

[0081] 25, the image data list creation unit 60M acquires dated image data associated with person image data (hereinafter also referred to as "dated image data with person image data") from the storage 62. The image data list creation unit 60M also acquires dated image data associated with non-person image data (hereinafter also referred to as "dated image data with non-person image data") from the storage 62.

[0082] The image data list creation unit 60M then determines whether the person image data is similar between date-stamped image data with person image data, and whether the non-person image data is similar between date-stamped image data with non-person image data.

[0083] 25, for convenience of explanation, only one person image data or one non-person image data is associated with one dated image data, but the technology of the present disclosure is not limited to this. For example, there may be a mode in which at least one person image data and at least one non-person image data are associated with one dated image data.

[0084] As an example, as shown in Figures 26 to 28, image data list creation unit 60M creates a dated image data list for each subject by classifying dated image data for each subject indicated by all dated image data stored in storage 62 as the subject for which an image data list is to be created. The dated image data for which an image data list is to be created includes, for example, dated image data associated with each of a plurality of users. In the example shown in Figures 26 to 28, first to Nth subject image data lists are shown.

[0085] In the example shown in FIG. 26, a first object image data list and a second object image data list are shown. The first object image data list is a dated image data list consisting of a plurality of dated image data in which the first object is reflected. The first object image data list is, for example, a list formed from dated image data included in a plurality of image data groups A to D associated with the users 16A to 16D, respectively. The second object image data list is a dated image data list consisting of a plurality of dated image data in which the second object is reflected. The second object image data list is, for example, a list formed from dated image data included in a plurality of image data groups A and C associated with the users 16A and 16C, respectively. In the example shown in FIG. 26, a radio tower is shown as an example of the first object, and "xx soft serve ice cream" is shown as an example of the second object. The radio tower and "xx soft serve ice cream" are non-human objects. The radio tower is an example of the above-mentioned building, and "xx soft serve ice cream" is an example of the above-mentioned food.

[0086] In the example shown in FIG. 27, a third object image data list and a fourth object image data list are shown. The third object image data list is a dated image data list consisting of a plurality of dated image data in which the third object is captured. The third object image data list is, for example, a list formed from dated image data included in a plurality of image data groups A to C associated with the users 16A to 16C, respectively. The fourth object image data list is a dated image data list consisting of a plurality of dated image data in which the fourth object is captured. The fourth object image data list is, for example, a list formed from dated image data included in a plurality of image data groups A and C associated with the users 16A and 16C, respectively. In the example shown in FIG. 27, a soccer player is shown as an example of the third object, and a woman is shown as an example of the fourth object. The soccer player and the woman are people.

[0087] In the example shown in Fig. 28, a fifth subject image data list is shown. The fifth subject image data list is a dated image data list consisting of a plurality of dated image data in which the fifth subject is captured. The fifth subject image data list is, for example, a list formed from dated image data included in a plurality of image data groups A and D associated with user 16A and user 16D, respectively. In the example shown in Fig. 28, signs and posters are shown as examples of the fifth subject. The signs and posters are non-human figures.

[0088] 29, the image data list classification unit 60N classifies the dated image data list created by the image data list creation unit 60M by user ID, thereby associating a dated image data list with each of the multiple users 16. In this case, the image data list classification unit 60N first extracts a user ID from each of the multiple dated image data included in the dated image data list. Then, the image data list classification unit 60N associates, with a user ID that matches the extracted user ID among the multiple user IDs stored in the storage 62, a dated image data list that includes the dated image data from which the user ID was extracted.

[0089] In this way, a dated image data list is associated with each of a plurality of user IDs in storage 62, and thus, as shown in Figs. 30 to 33 as an example, a dated image data list is associated with each of a plurality of users 16.

[0090] 30 shows a state in which the first to fifth subject image data lists are associated with the user 16A. The image data group uploaded to the server 14 from the user device 12A assigned to the user 16A includes date-stamped image data in which subjects similar to the first to fifth subjects appear. Therefore, the image data list classification unit 60N associates the first to fifth subject image data lists related to the first to fifth subjects with the user 16A.

[0091] 31 shows a state in which the first subject image data list and the third subject image data list are associated with the user 16B. The image data group uploaded to the server 14 from the user device 12B assigned to the user 16B includes dated image data in which subjects similar to the first and third subjects are captured. Therefore, the image data list classification unit 60N associates the first subject image data list and the third subject image data list related to the first and third subjects with the user 16B.

[0092] 32 shows a state in which the first to fourth subject image data lists are associated with the user 16C. The image data group uploaded to the server 14 from the user device 12C assigned to the user 16C includes date-stamped image data in which subjects similar to the first to fourth subjects are captured. Therefore, the image data list classification unit 60N associates the first to fourth subject image data lists related to the first to fourth subjects with the user 16C.

[0093] 33 shows a state in which the first subject image data list and the fifth subject image data list are associated with the user 16D. The image data group uploaded to the server 14 from the user device 12D assigned to the user 16D includes dated image data in which subjects similar to the first and fifth subjects are captured. Therefore, the image data list classification unit 60N associates the first subject image data list and the fifth subject image data list related to the first and fifth subjects with the user 16D.

[0094] As an example, as shown in Fig. 34, a date assignment processing program 74 is stored in the storage 62. The CPU 60 reads out the date assignment processing program 74 from the storage 62. The CPU 60 then executes the date assignment processing program 74 read out from the storage 62 on the memory 64, thereby operating as a user ID extraction unit 60B, a determination unit 60P, an image data list acquisition unit 60Q, an undated image data extraction unit 60R, a date derivation unit 60S, a date assignment unit 60T, and an image data transmission unit 60U. That is, the date assignment processing is realized by the CPU 60 operating as the user ID extraction unit 60B, the determination unit 60P, the image data list acquisition unit 60Q, an undated image data extraction unit 60R, a date derivation unit 60S, a date assignment unit 60T, and an image data transmission unit 60U.

[0095] By executing the date assignment process, the CPU 60 acquires dated image data of a subject similar to the subject shown in the undated image data of the specific user from the dated image data list associated with the specific user. Furthermore, by executing the date assignment process, the CPU 60 derives a date to be assigned to the undated image data based on the date assigned to the acquired dated image data, and assigns the derived date to the undated image data. This will be described in more detail below.

[0096] 35, as an example, when the CPU 42 of the user device 12 executes a date assignment request process (see FIG. 9), and the request data sending unit 42G sends request data to the server 14 (see FIG. 10), the request data is received by the communication I / F 52 of the server 14. The user ID extraction unit 60B extracts the user ID from the request data received by the communication I / F 52, and outputs the extracted user ID to the image data list acquisition unit 60Q.

[0097] As an example, as shown in FIG. 36, image data list acquisition section 60Q acquires from storage 62 a date-stamped image data list corresponding to the user ID input from user ID extraction section 60B.

[0098] As an example, as shown in Fig. 37, undated image data extraction unit 60R extracts undated image data from the request data received by communication I / F 52 and outputs the extracted undated image data to determination unit 60P. Determination unit 60P determines whether or not the dated image data list acquired by image data list acquisition unit 60Q contains dated image data that is similar to the undated image data input from undated image data extraction unit 60R. Here, "similar" means that they match within a predetermined error range. The predetermined error may be a fixed value or a variable value.

[0099] Variable values ​​include, for example, values ​​that can be changed in response to instructions received by the reception device 54, values ​​that change in response to the number of frames of dated image data included in the dated image data list, values ​​determined in response to the degree of variation (e.g., variance or standard deviation) of the dates assigned to the dated image data included in the dated image data list, values ​​that change in response to the user 16 who provided the undated image data, and / or values ​​that change periodically.

[0100] 38, when determination unit 60P determines that the dated image data list acquired by image data list acquisition unit 60Q does not contain dated image data similar to the undated image data input from undated image data extraction unit 60R, it waits until the next determination timing arrives. On the other hand, when determination unit 60P determines that the dated image data list acquired by image data list acquisition unit 60Q contains dated image data similar to the undated image data input from undated image data extraction unit 60R, it determines whether there are multiple frames of dated image data similar to the undated image data.

[0101] If the determination unit 60P determines that the dated image data similar to the undated image data does not have multiple frames, the date derivation unit 60S extracts the date from the dated image data to be determined, i.e., the dated image data similar to the undated image data. If the determination unit 60P determines that the dated image data similar to the undated image data has multiple frames, the date derivation unit 60S extracts the date from each of the multiple dated image data to be determined, i.e., the multiple dated image data similar to the undated image data. Then, the date derivation unit 60S derives the date of the undated image data based on the multiple dates extracted from each of the multiple dated image data. The date derived by the date derivation unit 60S may be only the year, month, and day, or only the year and month, out of the year, month, day, hour, minute, and second.

[0102] Here, the date derived by the date derivation unit 60S as the date of the undated image data is, for example, a date based on the average value of multiple dates extracted from each of the multiple dated image data. The date based on the average value of multiple dates refers to, for example, a date obtained by rounding off the average value of the multiple dates.

[0103] Here, a date based on the average value of multiple dates is exemplified, but the technology of the present disclosure is not limited to this, and the date may be the mode or median date of the multiple dates. When the date derived as the date of the undated image data is the mode or median date of the multiple dates, the date may be the mode or median date of the period in which the multiple dates are distributed and in which the dates are most densely distributed. In addition, the date of the undated image data that has the highest similarity to the undated image data may be derived by the date derivation unit 60S as the date of the undated image data.

[0104] The date derivation unit 60S outputs the date derived as the date of the undated image data to the date assignment unit 60T. The date assignment unit 60T assigns the date input from the date derivation unit 60S to the undated image data extracted from the request data by the undated image data extraction unit 60R, i.e., the undated image data compared with the dated image data by the determination unit 60P. In this way, a date is assigned to the undated image data. In this way, the date assignment unit 60T assigns a date to the undated image data, generating date-assigned image data.

[0105] The image data transmission unit 60U transmits the date-added image data generated by the date adding unit 60T to the user device 12A that is the source of the requested data via the communication I / F 52. As a result, the date-added image data is provided to the user 16 to which the user device 12A that is the source of the requested data is assigned.

[0106] Next, the operation of the information processing system 10 will be described.

[0107] First, the date-stamped image data list creation process executed by the CPU 60 of the server 14 will be described with reference to Figures 39A to 39E. Note that the flow of the date-stamped image data list creation process shown in Figures 39A to 39E is an example of the "information processing method" according to the technique of the present disclosure.

[0108] In the date-stamped image data list creation process shown in Fig. 39A, first, in step ST10, the determination unit 60P determines whether or not the image data group transmitted from the user device 12 has been received by the communication I / F 52. If the image data group transmitted from the user device 12 has not been received by the communication I / F 52 in step ST10, the determination is negative, and the date-stamped image data list creation process proceeds to step ST80 shown in Fig. 39E. If the image data group transmitted from the user device 12 has been received by the communication I / F 52 in step ST10, the determination is positive, and the date-stamped image data list creation process proceeds to step ST12.

[0109] In step ST12, the dated image data acquisition section 60A acquires dated image data from the image data group received by the communications I / F 52, and thereafter, the dated image data list creation process proceeds to step ST14.

[0110] In step ST14, the user ID extraction section 60B extracts the user ID from the date-stamped image data acquired in step ST12, and thereafter, the date-stamped image data list creation process proceeds to step ST16.

[0111] In step ST16, the judgment unit 60P judges whether or not the user ID extracted in step ST14 has been registered. Whether or not the user ID has been registered is judged by judging whether or not the user ID is included in the registered user list in the storage 62. In step ST16, if the user ID extracted in step ST14 has not been registered, the judgment is negative, and the date-stamped image data list creation process proceeds to step ST20. In step ST16, if the user ID extracted in step ST14 has been registered, the judgment is positive, and the date-stamped image data list creation process proceeds to step ST18.

[0112] In step ST18, the storage control section 60C stores in the storage 62 the image data group designated as the acquisition source of the date-stamped image data in step ST12, and thereafter, the date-stamped image data list creation process proceeds to step ST20.

[0113] In step ST20, the determination unit 60P determines whether or not two or more groups of image data are stored in the storage 62. If two or more groups of image data are not stored in the storage 62 in step ST20, the determination is negative, and the date-stamped image data list creation process proceeds to step ST10. If two or more groups of image data are stored in the storage 62 in step ST20, the determination is positive, and the date-stamped image data list creation process proceeds to step ST22.

[0114] In step ST22, the image data group acquisition unit 60D acquires one unprocessed image data group from the storage 62. In step ST22, the one unprocessed image data group refers to an image data group for which the processes of steps ST24 to ST30 have not yet been performed. After the process of step ST22 is executed, the date-stamped image data list creation process proceeds to step ST24.

[0115] In step ST24, the person image data extraction unit 60E extracts person image data from each of the dated image data included in the image data group acquired in step ST22, and associates the extracted person image data with the dated image data from which it was extracted. The person image data extraction unit 60E then stores the dated image data associated with the person image data in the storage 62 for each image data group, thereby returning the dated image data to the storage 62. After the process of step ST24 is executed, the dated image data list creation process proceeds to step ST26.

[0116] In step ST26, the determination unit 60P determines whether or not the number of frames of the same person image data is equal to or greater than the first preset frame number for the latest group of image data stored in the storage 62 in step ST24. If the number of frames of the same person image data is less than the first preset frame number in step ST26, the determination is negative, and the date-stamped image data list creation process proceeds to step ST34 shown in Fig. 39B. If the number of frames of the same person image data is equal to or greater than the first preset frame number in step ST26, the determination is positive, and the date-stamped image data list creation process proceeds to step ST28.

[0117] In step ST28, the determination unit 60P determines whether or not a positively determined image data group is stored in the storage 62. Here, a positively determined image data group refers to an image data group for which a positive determination has been made in step ST26. In step ST28, if a positively determined image data group is not stored in the storage 62, the determination is negative, and the date-stamped image data list creation process proceeds to step ST80 shown in FIG. 39E. In step ST28, if a positively determined image data group is stored, the determination is positive, and the date-stamped image data list creation process proceeds to step ST30.

[0118] In step ST30, the judgment unit 60P judges whether the latest image data group for which the judgment in step ST26 is positive contains the same person image data common to the positively judged image data group for the second preset frame number or more. In step ST30, if the latest image data group for which the judgment in step ST26 is positive does not contain the same person image data common to the positively judged image data group for the second preset frame number or more, the judgment is negative and the date-stamped image data list creation process proceeds to step ST34 shown in Fig. 39B. In step ST30, if the latest image data group for which the judgment in step ST26 is positive contains the same person image data common to the positively judged image data group for the second preset frame number or more, the judgment is positive and the date-stamped image data list creation process proceeds to step ST32.

[0119] In step ST32, the determination unit 60P determines whether or not the processes of steps ST24 to ST30 have been performed on all image data groups stored in the storage 62. If the processes of steps ST24 to ST30 have not been performed on all image data groups stored in the storage 62 in step ST32, the determination is negative, and the date-stamped image data list creation process proceeds to step ST20. If the processes of steps ST24 to ST30 have been performed on all image data groups stored in the storage 62 in step ST32, the determination is positive, and the date-stamped image data list creation process proceeds to step ST38 shown in FIG. 39C.

[0120] In step ST34 shown in FIG. 39B, the erasing section 60F erases the image data group to be processed from the storage 62, and thereafter, the date-stamped image data list creation process proceeds to step ST36.

[0121] In this step ST34, the image data group to be processed refers to an image data group for which the judgment unit 60P has judged that the number of frames of image data of the same person is less than a first predetermined number of frames, and the latest image data group for which the judgment unit 60P has judged that the image data does not contain more than a second predetermined number of frames of image data of the same person in common with an image data group for which a positive judgment has been made.

[0122] The image data group erased by the erasing unit 60F in this step ST34 is an image data group that does not satisfy the condition determined in step ST26 or step ST30. This means that the image data group erased by the erasing unit 60F is an image data group that is not similar to other image data groups stored in the storage 62. In addition, the image data group has a one-to-one correspondence with the registered user 16. Therefore, by erasing the image data group by the erasing unit 60F in this step ST34, image data groups provided by the registered user 16 that satisfy the condition that the image data groups are similar to each other are narrowed down as candidates for which a date-stamped image data list is to be created.

[0123] In step ST36, the determination unit 60P determines whether or not the processes of steps ST24 to ST30 have been performed on all image data groups stored in the storage 62. If the processes of steps ST24 to ST30 have not been performed on all image data groups stored in the storage 62 in step ST36, the determination is negative, and the date-stamped image data list creation process proceeds to step ST20. If the processes of steps ST24 to ST30 have been performed on all image data groups stored in the storage 62 in step ST36, the determination is positive, and the date-stamped image data list creation process proceeds to step ST37.

[0124] In step ST37, the determination unit 60P determines whether or not two or more groups of image data are stored in the storage 62. If two or more groups of image data are not stored in the storage 62 in step ST37, the determination is negative, and the date-stamped image data list creation process proceeds to step ST80 shown in Fig. 39E. If two or more groups of image data are stored in the storage 62 in step ST37, the determination is positive, and the date-stamped image data list creation process proceeds to step ST38 shown in Fig. 39C.

[0125] In step ST38 shown in Fig. 39C, the image data group acquisition unit 60D acquires one unprocessed image data group from the storage 62. In step ST38, the one unprocessed image data group refers to an image data group for which the processes of steps ST40 to ST46 have not yet been performed. After the process of step ST38 is performed, the date-stamped image data list creation process proceeds to step ST40.

[0126] In step ST40, the GPS information extraction section 60G extracts GPS information from the attribute data in the date-stamped image data included in the image data group acquired in step ST38, and then the date-stamped image data list creation process proceeds to step ST42.

[0127] In step ST42, the distribution area map creating section 60H creates an imaging position distribution area map of the image data group based on the GPS information extracted in step ST40, and then the date-stamped image data list creating process proceeds to step ST44.

[0128] In step ST44, the determination unit 60P determines whether or not there is an imaging position distribution area map to be compared with the imaging position distribution area map created in step ST42, i.e., whether or not there is another imaging position distribution area map. In step ST44, if there is no imaging position distribution area map to be compared with the imaging position distribution area map created in step ST42, the determination is negative and the date-stamped image data list creation process proceeds to step ST50. In step ST44, if there is an imaging position distribution area map to be compared with the imaging position distribution area map created in step ST42, the determination is negative and the date-stamped image data list creation process proceeds to step ST46.

[0129] In step ST46, the overlapping area ratio calculation unit 60I calculates the ratio of overlapping areas between the imaging position distribution area map created in step ST42 and another imaging position distribution area map, and then the date-stamped image data list creation process proceeds to step ST48. Note that here, the other imaging position distribution area maps refer to existing imaging position distribution area maps, i.e., all imaging position distribution area maps (hereinafter also referred to as "all imaging position distribution area maps") created before the imaging position distribution area map created in step ST42.

[0130] In step ST48, the determination unit 60P determines whether or not the ratio calculated for all imaging position distribution area maps in step ST46 is equal to or greater than the preset ratio. If the ratio calculated for all imaging position distribution area maps in step ST46 is not equal to or greater than the preset ratio in step ST48, the determination is negative, and the date-stamped image data list creation process proceeds to step ST60 shown in Fig. 39D. If the ratio calculated for all imaging position distribution area maps in step ST46 is equal to or greater than the preset ratio in step ST48, the determination is positive, and the date-stamped image data list creation process proceeds to step ST50.

[0131] In step ST50, the judgment unit 60P judges whether or not the processing of steps ST40 to ST48 has been performed for all image data groups stored in the storage 62. If the processing of steps ST40 to ST48 has not been performed for all image data groups stored in the storage 62 in step ST50, the judgment is negative and the date-stamped image data list creation process proceeds to step ST38. If the processing of steps ST40 to ST48 has been performed for all image data groups stored in the storage 62 in step ST50, the judgment is positive and the date-stamped image data list creation process proceeds to step ST52.

[0132] In step ST60 shown in FIG. 39D, the erasing section 60F erases the image data group to be processed from the storage 62, and thereafter, the date-stamped image data list creation process proceeds to step ST62.

[0133] In this step ST60, the image data group to be processed refers to an image data group for which the determination unit 60P has determined that the ratio calculated for the entire imaging position distribution area map is not equal to or greater than the preset ratio.

[0134] The image data group erased by the erasing unit 60F in this step ST60 is an image data group that does not satisfy the condition determined in step ST48. This means that the image data group erased by the erasing unit 60F is an image data group that is not similar to other image data groups stored in the storage 62. In addition, the image data group has a one-to-one correspondence with the registered user 16. Therefore, by erasing the image data group by the erasing unit 60F in this step ST60, image data groups provided by the registered user 16 that satisfy the condition that the image data groups are similar to each other (for example, the geographical distribution of the imaging positions between the image data groups is similar) are narrowed down as candidates for creating a date-stamped image data list.

[0135] In step ST62, the judgment unit 60P judges whether or not the processing of steps ST40 to ST48 has been performed for all image data groups stored in the storage 62. If the processing of steps ST40 to ST48 has not been performed for all image data groups stored in the storage 62 in step ST62, the judgment is negative, and the date-stamped image data list creation process proceeds to step ST38 shown in Fig. 39C. If the processing of steps ST40 to ST48 has been performed for all image data groups stored in the storage 62 in step ST62, the judgment is positive, and the date-stamped image data list creation process proceeds to step ST52 shown in Fig. 39C.

[0136] In step ST52 shown in Fig. 39C, the determination unit 60P determines whether or not two or more groups of image data are stored in the storage 62. If two or more groups of image data are not stored in the storage 62 in step ST52, the determination is negative, and the date-stamped image data list creation process proceeds to step ST80 shown in Fig. 39E. If two or more groups of image data are stored in the storage 62 in step ST52, the determination is positive, and the date-stamped image data list creation process proceeds to step ST54.

[0137] In step ST54, the erasure unit 60F erases dated image data whose imaging positions are distributed outside the overlapping areas of the imaging position distribution area maps from each image data group stored in the storage 62, and then the dated image data list creation process proceeds to step ST56.

[0138] In step ST56, the user ID extraction section 60B extracts user IDs from all image data groups stored in the storage 62, and then the date-stamped image data list creation process proceeds to step ST58.

[0139] In step ST58, the user information acquisition unit 60J acquires from the storage 62 user information corresponding to the user ID extracted from all image data groups in step ST56, and then the date-stamped image data list creation process proceeds to step ST64 shown in FIG. 39E.

[0140] In step ST64 shown in FIG. 39E, the user information consistency calculation unit 60K calculates the user information consistency between the image data groups using all the user information acquired in step ST58, and then the date-stamped image data list creation process proceeds to step ST66.

[0141] In step ST66, the judgment unit 60P judges whether or not there is an image data group whose user information coincidence degree calculated in step ST64 is less than the default coincidence degree. If there is no image data group whose user information coincidence degree calculated in step ST64 is less than the default coincidence degree in step ST66, the judgment is negative, and the date-stamped image data list creation process proceeds to step ST70. If there is an image data group whose user information coincidence degree calculated in step ST64 is less than the default coincidence degree in step ST66, the judgment is positive, and the date-stamped image data list creation process proceeds to step ST68.

[0142] In step ST68, the deletion section 60F deletes from the storage 62 the image data group whose user information coincidence degree calculated in step ST64 is less than a predetermined coincidence degree, and thereafter, the date-stamped image data list creation process proceeds to step ST70.

[0143] The image data group deleted by the deletion unit 60F in this step ST68 is an image data group whose user information coincidence degree calculated in step ST64 is less than a predetermined coincidence degree. This means that the image data group deleted by the deletion unit 60F is an image data group that is not similar to other image data groups stored in the storage 62. In addition, the image data group has a one-to-one correspondence with the registered user 16. Therefore, by deleting the image data group by the deletion unit 60F in this step ST68, the image data groups provided by the registered user 16 that satisfy the condition that the image data groups are similar to each other are narrowed down as targets for creating the date-stamped image data list.

[0144] In step ST70, the image data group acquisition section 60D acquires one unprocessed date-stamped image data from the storage 62. In step ST70, the one unprocessed date-stamped image data refers to image data for which the processes of steps ST72 to ST78 have not yet been performed. After the process of step ST70 is executed, the date-stamped image data list creation process proceeds to step ST72.

[0145] In step ST72, non-person image data extraction unit 60L extracts non-person image data from the dated image data acquired in step ST70, and associates the extracted non-person image data with the dated image data from which it was extracted. Then, non-person image data extraction unit 60L returns the dated image data to storage 62 by storing the dated image data associated with the non-person image data for each image data group in storage 62. After the processing of step ST72 is executed, the dated image data list creation processing proceeds to step ST74.

[0146] In step ST74, the determination unit 60P determines whether or not the processing of step ST72 has been performed on all dated image data stored in the storage 62. If the processing of step ST72 has not been performed on all dated image data stored in the storage 62 in step ST74, the determination is negative, and the dated image data list creation process proceeds to step ST70. If the processing of step ST72 has been performed on all dated image data stored in the storage 62 in step ST74, the determination is positive, and the dated image data list creation process proceeds to step ST76.

[0147] In step ST76, image data list creation unit 60M obtains dated image data with person image data from storage 62, and determines whether the person image data is similar between the dated image data with person image data. Image data list creation unit 60M also obtains dated image data with non-person image data from storage 62, and determines whether the non-person image data is similar between the dated image data with non-person image data. Then, image data list creation unit 60M creates a dated image data list for each subject by classifying the dated image data for each subject represented by each of all the dated image data stored in storage 62, and then the dated image data list creation process proceeds to step ST78.

[0148] In step ST78, the image data list classification unit 60N classifies the dated image data list created by the image data list creation unit 60M by user ID, thereby associating a dated image data list with each of the multiple users 16, and then the dated image data list creation process proceeds to step ST80.

[0149] In step ST80, the determination unit 60P determines whether or not a condition for terminating the date-stamped image data list creation process (hereinafter also referred to as an "image data list creation process termination condition") has been satisfied. One example of the image data list creation process termination condition is that an instruction to terminate the date-stamped image data list creation process has been given to the server 14. The instruction to terminate the date-stamped image data list creation process is accepted, for example, by the acceptance device 54. In step ST80, if the image data list creation process termination condition is not satisfied, the determination is negative, and the date-stamped image data list creation process proceeds to step ST10 shown in FIG. 39A. In step ST80, if the image data list creation process termination condition is satisfied, the determination is positive, and the date-stamped image data list creation process ends.

[0150] Next, the date assignment process executed by the CPU 60 of the server 14 will be described with reference to Fig. 40. Note that the flow of the date assignment process shown in Fig. 40 is an example of the "information processing method" according to the technique of the present disclosure.

[0151] In the date assignment process shown in Fig. 40, first, in step ST100, the judgment unit 60P judges whether or not the request data transmitted from the user device 12 has been received by the communication I / F 52. In step ST100, if the request data transmitted from the user device 12 has not been received by the communication I / F 52, the judgment is negative, and the date assignment process proceeds to step ST120. In step ST100, if the request data transmitted from the user device 12 has been received by the communication I / F 52, the judgment is positive, and the date assignment process proceeds to step ST102.

[0152] In step ST102, the user ID extraction section 60B extracts the user ID from the request data received by the communication I / F 52, and then the date assignment process proceeds to step ST104.

[0153] In step ST104, the image data list acquisition section 60Q acquires from the storage 62 the date-stamped image data list corresponding to the user ID extracted in step ST102, and then the date assignment process proceeds to step ST106.

[0154] In step ST106, the undated image data extraction section 60R extracts undated image data from the request data from which the user ID was extracted in step ST102, and then the date assignment process proceeds to step ST108.

[0155] In step ST108, the judgment unit 60P judges whether or not dated image data similar to the undated image data extracted in step ST106 is present in the dated image data list acquired in step ST104. In step ST108, if dated image data similar to the undated image data extracted in step ST106 is not present in the dated image data list acquired in step ST104, the judgment is negative and the date assignment process proceeds to step ST120. In step ST108, if dated image data similar to the undated image data extracted in step ST106 is present in the dated image data list acquired in step ST104, the judgment is positive and the date assignment process proceeds to step ST110.

[0156] In step ST110, the judgment unit 60P judges whether or not there are multiple frames of dated image data similar to the undated image data extracted in step ST106. If there is a single frame of dated image data similar to the undated image data extracted in step ST106, the judgment is negative and the date assignment process proceeds to step ST114. If there are multiple frames of dated image data similar to the undated image data extracted in step ST106, the judgment is positive and the date assignment process proceeds to step ST112.

[0157] In step ST112, the date derivation unit 60S extracts a date from each of the multiple dated image data that is similar to the undated image data extracted in step ST106. The date derivation unit 60S then derives the date of the undated image data based on the multiple dates extracted from each of the multiple dated image data, and the date assignment process then proceeds to step ST116.

[0158] In step ST114, the date derivation section 60S extracts the date from the dated image data that is similar to the undated image data extracted in step ST106, and then the date assignment process proceeds to step ST116.

[0159] In step ST116, the date assignment unit 60T generates date-assigned image data by assigning the date derived in step ST112 or the date extracted in step ST114 to the undated image data extracted in step ST106, and then the date assignment process proceeds to step ST118.

[0160] In step ST118, the image data transmission unit 60U transmits the date-added image data generated in step ST116 via the communication I / F 52 to the user device 12 that sent the request data, and then the date addition process proceeds to step ST120.

[0161] In step ST120, the judgment unit 60P judges whether or not a condition for terminating the date assignment process (hereinafter also referred to as a "date assignment process termination condition") has been satisfied. One example of the date assignment process termination condition is a condition in which an instruction to terminate the date assignment process has been given to the server 14. The instruction to terminate the date assignment process is accepted, for example, by the acceptance device 54. In step ST120, if the date assignment process termination condition is not satisfied, the judgment is negative, and the date assignment process proceeds to step ST100. In step ST120, if the date assignment process termination condition is satisfied, the judgment is positive, and the date assignment process ends.

[0162] Next, a date assignment request process executed by the CPU 42 of the user device 12 will be described with reference to Fig. 41. Note that the description here is based on the premise that the request data has already been created by the request data creation unit 42F.

[0163] In the date assignment request processing shown in FIG. 41, first, in step ST150, the request data sending unit 42G sends the request data created by the request data creation unit 42F to the server 14 via the communication I / F 28, and then the date assignment request processing proceeds to step ST152.

[0164] When the request data is sent to the server 14 by executing the processing of step ST150, the server 14 in response generates date-added image data as described above, and sends the generated date-added image data to the user device 12 that sent the request data.

[0165] Therefore, in step ST152, the display control unit 42H determines whether or not date-added image data has been received by the communication I / F 28. If date-added image data has not been received by the communication I / F 28 in step ST152, the determination is negative, and the date addition process proceeds to step ST156. If date-added image data has been received by the communication I / F 28 in step ST152, the determination is positive, and the date addition process proceeds to step ST154.

[0166] In step ST154, the display control unit 42H causes the display 34 to display the date-added image indicated by the date-added image data received by the communication I / F 28, and then the date addition request process proceeds to step ST156. Execution of the process of this step ST154 causes the date-added image to be displayed on the display 34, and as a result, the date derived by the date derivation unit 60S is presented to the specific user via the display 34. Note that the display 34 is an example of a "presentation device" according to the technology of the present disclosure.

[0167] In step ST156, the judgment unit 60P judges whether or not a condition for terminating the date assignment request process (hereinafter also referred to as a "date assignment request process termination condition") has been satisfied. One example of the date assignment request process termination condition is a condition in which an instruction to terminate the date assignment request process is given to the user device 12. The instruction to terminate the date assignment request process is accepted, for example, by the acceptance device 32. In step ST156, if the date assignment request process termination condition is not satisfied, the judgment is negative, and the date assignment request process proceeds to step ST150. In step ST156, if the date assignment request process termination condition is satisfied, the judgment is positive, and the date assignment request process ends.

[0168] As described above, in the first embodiment, in the server 14, the CPU 60 classifies the dated image data to create a dated image data list, and the dated image data list is associated with the specific user. The dated image data is image data for 16 users including the specific user. The dated image data list is created for each subject by classifying the dated image data for each subject indicated by each of the dated image data. The specific user is associated with a dated image data list for a subject similar to the subject indicated by the dated image data of the specific user. In addition, the CPU 60 acquires dated image data for a subject similar to the subject indicated by the undated image data provided by the specific user from the dated image data list associated with the specific user. Then, the CPU 60 derives a date to be assigned to the undated image data based on the date assigned to the acquired dated image data.

[0169] Therefore, with this configuration, it is possible to assign an appropriate date to undated image data compared to deriving a date to be assigned to undated image data based solely on dated image data owned by a specific user.

[0170] Furthermore, in the first embodiment, the dated image data list is created in server 14 by classifying multiple dated image data for each subject whose manner of change over time is visually identifiable. Therefore, with this configuration, it is possible to create a dated image data list for each visually distinguishable subject, compared to a case where multiple dated image data are classified for each subject whose manner of change over time is not visually identifiable.

[0171] Furthermore, in the first embodiment, the server 14 creates a dated image data list that includes a plurality of dated image data with different dates. The date added to the dated image data is the date of capture. Therefore, with this configuration, it is possible to add an appropriate date to undated image data, compared to a case where the dates added to the plurality of dated image data included in the dated image data are all the same date.

[0172] Furthermore, in the first embodiment, the multiple users 16 are a group of users who satisfy the condition that they have registered to agree to the sharing of information including dated image data. Therefore, according to this configuration, it is possible to prevent the use of dated image data provided to server 14 by people who do not wish to share information including dated image data, compared to a case in which all dated image data provided to server 14 is used for processing regardless of whether or not they have registered to agree to the sharing of information including dated image data. In other words, this can contribute to the protection of personal information.

[0173] In the first embodiment, an image data group is associated with each of the multiple users 16, and the multiple users 16 are a user group that satisfies the condition that the image data groups are similar to each other. Therefore, according to this configuration, the processing load required to derive an appropriate date to be assigned to dateless image data can be reduced compared to a case in which a date is derived by referring to date-stamped image data provided to the server 14 by a person who does not satisfy the condition that the image data groups are similar to each other between the users 16. Also, since only image data groups provided by a user group that satisfies the condition that the image data groups are similar to each other are used, it is possible to contribute to the protection of personal information.

[0174] In the first embodiment, the multiple users 16 are a group of users who satisfy the condition that the registered user information is similar. Therefore, according to this configuration, the processing load required to derive an appropriate date to be added to dateless image data can be reduced compared to a case where a date is derived using dated image data provided to the server 14 by a person whose registered user information is not similar. Also, since only image data provided by a group of users who satisfy the condition that the registered user information is similar is used, it is possible to contribute to the protection of personal information.

[0175] Furthermore, in the first embodiment, server 14 limits dated image data, among a plurality of dated image data, for which a dated image data list is to be created to image data obtained by capturing images within a range determined based on GPS information. Therefore, with this configuration, the processing load required to derive an appropriate date to be assigned to undated image data can be reduced, compared to a case in which the date is derived by also referring to dated image data obtained by capturing images outside a range determined based on GPS information.

[0176] Furthermore, in the first embodiment, a date-added image is displayed on the display 34. That is, the date added to the undated image data is displayed on the display 34. Therefore, according to this configuration, the date added to the undated image data can be perceived.

[0177] In the first embodiment, no example of updating the dated image data list is given, but the technology of the present disclosure is not limited to this. For example, the CPU 42 may update the dated image data list associated with a specific user according to an instruction received by the reception device 32 or 54. In this case, the dated image data list may be updated by deleting some of the dated image data from the dated image data list according to the instruction received by the reception device 32 or 54, or by adding the latest dated image data uploaded from the user device 12 to the specific dated image data list. Also, the specific dated image data list may be updated by adding new dated image data (see FIG. 43) generated based on the date-added image data to the specific dated image data list.

[0178] In this way, the dated image data list associated with a particular user can be updated in accordance with instructions given from outside, so that the contents of the dated image data list reflect the intentions of user 16.

[0179] In the above first embodiment, an example has been described in which date-stamped image data is uploaded from the user device 12 to the server 14, but the technology of the present disclosure is not limited to this. For example, a group of image data associated with a plurality of users 16 may be stored in advance in the storage 62. Also, the server 14 may import a group of image data associated with a plurality of users 16 from another device (such as a USB memory or a memory card) via the external I / F 58. In this case as well, the group of image data is stored in the storage 62 in a state associated with a plurality of users 16.

[0180] In the above first embodiment, an example was given in which the date assigned to the undated image data was displayed on the display 34, but the technology of the present disclosure is not limited to this. For example, instead of or in addition to visually displaying the date on the display 34, a sound indicating the date may be output from the speaker 38 (see FIG. 2). Also, the date may be printed on a recording medium (e.g., paper) by a printer (not shown).

[0181] In the above-described first embodiment, the date-stamped image data creation process and the date-adding request process are executed by the user device 12, and the date-stamped image data list creation process and the date-adding process are executed by the server 14. However, the technology of the present disclosure is not limited to this. For example, the date-stamped image data creation process, the date-adding request process, the date-stamped image data list creation process, and the date-adding process may be executed by one device (for example, the user device 12, the server 14, or a personal computer). Also, at least one of the date-stamped image data creation process, the date-adding request process, the date-stamped image data list creation process, and the date-adding process may be executed in a distributed manner by a plurality of devices. For example, the date-stamped image data list creation process and the date-adding process may be executed by separate devices. Also, for example, various processes may be executed by a plurality of servers including an image data storage server that stores date-stamped image data and date-less image data provided by a plurality of users 16, an image analysis server that performs image recognition processing, and a list storage server that stores date-stamped image data lists.

[0182] [Second embodiment] In this second embodiment, an example in which the date-stamped image data list is updated will be described. In this second embodiment, the same components as those described in the first embodiment above will be given the same reference numerals, their description will be omitted, and only the configurations and functions different from those in the first embodiment will be described.

[0183] The date-stamped image data list is updated by the CPU 60 of the server 14 executing a date-stamped image data list update process (see FIG. 42). As an example, as shown in FIG. 42, a date-stamped image data list update program 76 is stored in the storage 62. The CPU 60 reads out the date-stamped image data list update program 76 from the storage 62. The CPU 60 then executes the date-stamped image data list update program 76 read out from the storage 62 on the memory 64, thereby operating as the determination unit 60P, the date derivation unit 60S, the date assignment unit 60T, the date-stamped image data generation unit 60V, the similarity calculation unit 60W, the image quality specification unit 60X, and the image data addition unit 60Y. That is, the date-stamped image data list update process is realized by the CPU 60 operating as the determination unit 60P, the date derivation unit 60S, the date assignment unit 60T, the date-stamped image data generation unit 60V, the similarity calculation unit 60W, the image quality specification unit 60X, and the image data addition unit 60Y.

[0184] When the first condition is satisfied, the CPU 60 executes the dated image data list update process to update the dated image data list by adding new image data provided as new image data as dated image data to the dated image data list. Here, the first condition refers to a condition that the image quality of the new image data is equal to or higher than the reference image quality.

[0185] Furthermore, by executing the dated image data list update process, CPU 60 updates the dated image data list by adding new image data to the dated image data list associated with the specific user when the second condition is satisfied. Here, the second condition refers to a condition in which the subject shown by the new image data newly provided as dated image data is not similar to the subject shown by the dated image data included in the dated image data list associated with the specific user. Note that the new image data is an example of the "first new image data" and "second new image data" according to the technology of the present disclosure.

[0186] An example of the form in which the dated image data list is updated will be described in more detail below. As an example, as shown in FIG. 43, the dated image data generating unit 60V generates new dated image data based on the dated image data generated by the date assigning unit 60T and the dated image data used to derive the date included in the dated image data. The new dated image data is an example of the "first new image data" and the "second new image data" according to the technology of the present disclosure, and is generated by updating the dated image data used to derive the date included in the dated image data based on the dated image data. To explain in more detail, the image data included in the dated image data used to derive the date included in the dated image data is replaced with the undated image data included in the dated image data. In addition, the date of the attribute data (hereinafter also referred to as "undated image attribute data") included in the dated image data used to derive the date (date included in the dated image data) assigned to the undated image data by the date assigning unit 60T is replaced with the date included in the dated image data.

[0187] Data other than the date contained in the attribute data for an undated image is generated, for example, based on the user ID of the provider of the undated image data and the attribute data of one or more dated image data for which the date is derived by the date derivation unit 60S.

[0188] More specifically, the user ID of the provider of the undated image data is used as the user ID included in the attribute data of the new dated image data. When the date derivation unit 60S selects one dated image data as the target for deriving the date, the data included in the attribute data of the dated image data other than the user ID and date (e.g., GPS information and Exif information) is the data included in the attribute data of the dated image data. When the date derivation unit 60S selects multiple dated image data as the target for deriving the date, the data included in the attribute data of the dated image data other than the user ID and date is the data based on the average value of the data included in the attribute data of the multiple dated image data.

[0189] Note that, although data based on the average value of data included in the attribute data of multiple dated image data is exemplified here, the technology of the present disclosure is not limited to this, and data based on the mode or median of data included in the attribute data of multiple dated image data may also be used. Furthermore, data other than the user ID and date included in the attribute data of the undated image data that has the highest similarity to the undated image data may be used as part of the attribute data included in the new dated image data.

[0190] 44, similarity calculation section 60W calculates the similarity between new dated image data generated by dated image data generation section 60V and dated image data from which the date is derived by date derivation section 60S. The similarity is, for example, the average value of the inter-image data similarity and the inter-attribute data similarity.

[0191] The image data similarity refers to the similarity between image data included in the new dated image data and image data included in the dated image data from which the date is derived by the date derivation unit 60S. The attribute data similarity refers to the similarity between attribute data included in the new dated image data and attribute data included in the dated image data from which the date is derived by the date derivation unit 60S.

[0192] Different weight values ​​may be assigned to the image data similarity and the attribute data similarity. The weight value may be a fixed value or a variable value. In this case, the variable value may be, for example, a value that can be changed according to an instruction received by the receiving device 54, a value determined according to the number of frames of dated image data from which the date derivation unit 60S derives a date, a value determined according to the degree of variation (e.g., variance or standard deviation) of the dates assigned to the dated image data from which the date derivation unit 60S derives a date, a value that is changed according to the user 16 who provided the undated image data, and / or a value that is changed periodically.

[0193] In addition, when the date-stamped image data for which the date derivation unit 60S has set a date to be derived is a plurality of frames, the similarity between the composite image data obtained by averaging, on a pixel-by-pixel basis, the plurality of image data included in the date-stamped image data for which the date derivation unit 60S has set a date to be derived may be used as the inter-image data similarity. In addition, when the date-stamped image data for which the date derivation unit 60S has set a date to be derived is a plurality of frames, the similarity between the image data included in one frame of the date-stamped image data for which the date derivation unit 60S has set a date to be derived may be used as the inter-image data similarity.

[0194] The determination unit 60P determines whether the similarity calculated by the similarity calculation unit 60W is outside a predetermined range. The predetermined range in this case may be a fixed value or a variable value. Examples of the variable value in this case include a value that can be changed in response to an instruction received by the reception device 54, a value determined in response to the number of frames of dated image data from which the date derivation unit 60S is to derive a date, a value determined in response to the degree of variation (e.g., variance or standard deviation) of the dates given to the dated image data from which the date derivation unit 60S is to derive a date, a value that is changed in response to the user 16 who provided the undated image data, and / or a value that is changed periodically.

[0195] When the determination unit 60P determines that the similarity calculated by the similarity calculation unit 60W is within the predetermined range, the determination unit 60P waits until the next determination timing arrives. When the determination unit 60P determines that the similarity calculated by the similarity calculation unit 60W is outside the predetermined range, the determination unit 60P instructs the image quality specification unit 60X to specify the image quality of the image data.

[0196] The image quality specification unit 60X specifies the image quality of the image data included in the new date-stamped image data generated by the date-stamped image data generation unit 60V in response to an instruction from the determination unit 60P. Here, image quality refers to, for example, resolution and noise amount. The lower the resolution, the lower the image quality, and the higher the noise amount.

[0197] As an example, as shown in FIG. 45, the determination unit 60P determines whether the image quality specified by the image quality specification unit 60X is equal to or higher than the reference image quality. Here, a fixed value is adopted as the reference image quality. However, this is merely an example, and a variable value may be used. In this case, the variable value may be, for example, a value that can be changed according to an instruction accepted by the acceptance device 54, a value determined according to the number of frames of dated image data from which the date derivation unit 60S is to derive a date, a value determined according to the degree of variation (e.g., variance or standard deviation) of the dates given to the dated image data from which the date derivation unit 60S is to derive a date, a value that is changed according to the user 16 who provided the undated image data, and / or a value that is changed periodically.

[0198] If the judgment unit 60P judges that the image quality specified by the image quality specification unit 60X is lower than the standard image quality, the judgment unit 60P waits until the next judgment timing arrives. If the judgment unit 60P judges that the image quality specified by the image quality specification unit 60X is equal to or higher than the standard image quality, the judgment unit 60P instructs the image data addition unit 60Y to add new date-stamped image data to the storage 62.

[0199] In response to an instruction from determination unit 60P, image data addition unit 60Y adds new dated image data generated by dated image data generation unit 60V to the specific dated image data list in storage 62. This updates the specific dated image data list. Here, the specific dated image data list refers to the dated image data list that includes the dated image data for which the date derivation unit 60S has determined that the date is to be derived.

[0200] Next, the date-stamped image data list update process executed by the CPU 60 of the server 14 will be described with reference to FIG.

[0201] In the date-stamped image data list update process shown in Fig. 46, first, in step ST200, the determination section 60P determines whether date-stamped image data has been generated by the date assignment section 60T. If date-stamped image data has not been generated by the date assignment section 60T in step ST200, the determination is negative and the date-stamped image data list update process proceeds to step ST202. If date-stamped image data has been generated by the date assignment section 60T in step ST200, the determination is positive and the date-stamped image data list update process proceeds to step ST214.

[0202] In step ST202, the dated image data generation unit 60V generates new dated image data based on the dated image data generated by the date assignment unit 60T and the dated image data used to derive the date contained in the dated image data, and then the dated image data list update process proceeds to step ST204.

[0203] In step ST204, the similarity calculation unit 60W calculates the similarity between the new dated image data generated in step ST202 and the dated image data for which the date was derived by the date derivation unit 60S, and then the dated image data list update process proceeds to step ST206.

[0204] In step ST206, the judgment unit 60P judges whether or not the similarity calculated in step ST204 is outside the predetermined range. In step ST206, if the similarity calculated in step ST204 is within the predetermined range, the judgment is negative, and the date-stamped image data list update process proceeds to step ST214. In step ST206, if the similarity calculated in step ST204 is outside the predetermined range, the judgment is positive, and the date-stamped image data list update process proceeds to step ST208.

[0205] In step ST208, the image quality specifying section 60X specifies the image quality of the image data contained in the new dated image data generated by the dated image data generating section 60V, and then the dated image data list update process proceeds to step ST210.

[0206] In step ST210, the judgment unit 60P judges whether the image quality specified in step ST208 is equal to or higher than the standard image quality. In step ST210, if the image quality specified in step ST208 is lower than the standard image quality, the judgment is negative, and the date-stamped image data list update process proceeds to step ST214. In step ST210, if the image quality specified in step ST208 is equal to or higher than the standard image quality, the judgment is positive, and the date-stamped image data list update process proceeds to step ST212.

[0207] In step ST212, the image data addition unit 60Y updates the specific dated image data list by adding the new dated image data generated by the dated image data generation unit 60V to the specific dated image data list, and then the dated image data list update process proceeds to step ST214.

[0208] In step ST214, the judgment unit 60P judges whether or not a condition for terminating the dated image data list update process (hereinafter also referred to as the "list update process termination condition") has been satisfied. One example of the list update process termination condition is that an instruction to terminate the dated image data list update process has been given to the server 14. The instruction to terminate the dated image data list update process is accepted, for example, by the acceptance device 54. In step ST214, if the list update process termination condition is not satisfied, the judgment is negative, and the dated image data list update process proceeds to step ST200. In step ST214, if the list update process termination condition is satisfied, the judgment is positive, and the dated image data list update process ends.

[0209] Next, the date assignment process according to the second embodiment will be described with reference to Figures 47A and 47B. The flowcharts shown in Figures 47A and 47B differ from the flowchart shown in Figure 40 in that they have step ST108A instead of step ST108, and further have steps ST122 and ST124. Note that in Figure 47A, the same steps as those in the flowchart shown in Figure 40 are given the same step numbers, and their description will be omitted.

[0210] In step ST108A shown in FIG. 47A, the judgment unit 60P judges whether or not dated image data similar to the undated image data extracted in step ST106 is present in the dated image data list acquired in step ST104 or step ST124 (see FIG. 47B). In step ST108A, if dated image data similar to the undated image data extracted in step ST106 is present in the dated image data list acquired in step ST104 or step ST124, the judgment is affirmative, and the date assignment process proceeds to step ST110. In step ST108A, if dated image data similar to the undated image data extracted in step ST106 is not present in the dated image data list acquired in step ST104 or step ST124, the judgment is negative, and the date assignment process proceeds to step ST122 shown in FIG. 47B.

[0211] In step ST122 shown in Fig. 47B, the judgment unit 60P judges whether or not the specific dated image data list has been updated by executing the dated image data list update process. If the specific dated image data list has not been updated in step ST122, the judgment is negative, and the date assignment process proceeds to step ST120 shown in Fig. 47A. If the specific dated image data list has been updated in step ST122, the judgment is positive, and the date assignment process proceeds to step ST124.

[0212] In step ST124, the image data list acquisition section 60Q acquires from the storage 62 the date-stamped image data list corresponding to the user ID extracted in step ST102, and then the date assignment process proceeds to step ST108A.

[0213] Then, CPU 60 executes the processes of steps ST108A to ST114 shown in Fig. 47A to acquire dated image data of a subject similar to the subject shown in the undated image data of the specific user. That is, CPU 60 executes the date assignment process according to the second embodiment to acquire dated image data of a subject similar to the subject shown in the undated image data of the specific user from the updated dated image data list associated with the specific user, i.e., the specific dated image data list, on the condition that the dated image data list associated with the specific user has been updated.

[0214] Note that, in this embodiment, on condition that a specific dated image data list is updated by executing the dated image data list update process, image data list acquisition unit 60Q acquires dated image data of a subject similar to a subject represented by undated image data of a specific user from the specific dated image data list, but the technology of the present disclosure is not limited to this. New dated image data may be provided from user device 12 to server 14, and the newly provided dated image data may be added to the dated image data list to thereby acquire the newly provided dated image data from the updated dated image data list.

[0215] As described above, in the second embodiment, in server 14, if the image quality of new dated image data is equal to or higher than the standard image quality, the dated image data list is updated by adding the new dated image data to the dated image data list. Therefore, with this configuration, it is possible to prevent dated image data that is not suitable for image recognition processing (for example, dated image data in which people and / or non-people cannot be recognized by performing image recognition processing) from being added to the dated image data list, compared to when new dated image data is added to the dated image data list regardless of the image quality of the new dated image data.

[0216] Furthermore, in the second embodiment, server 14 adds the new dated image data to the specific dated image data list if the subject indicated by the new dated image data is not similar to the subject indicated by the dated image data included in the dated image data list associated with the specific user. Therefore, with this configuration, it is possible to suppress an increase in the amount of data in the dated image data list compared to a case in which new dated image data is added to the specific dated image data list regardless of whether the subject indicated by the new dated image data is similar to the subject indicated by the dated image data included in the dated image data list associated with the specific user.

[0217] Furthermore, in the second embodiment, on condition that the specific dated image data list has been updated, server 14 obtains dated image data of a subject similar to a subject shown in undated image data provided by a specific user from the specific dated image data list. Therefore, according to this configuration, it is possible to instantly derive an appropriate date to be assigned to undated image data, compared to a case in which dated image data of a subject similar to a subject shown in undated image data provided by a specific user is not obtained from the specific dated image data list even though the specific dated image data list has been updated.

[0218] In the above second embodiment, an example was given in which new dated image data is added to the specific dated image data list when the image quality specified by image quality specification unit 60X is equal to or higher than the reference image quality, but the technology of the present disclosure is not limited to this. For example, when the image quality of the new dated image data exceeds the image quality of similar dated image data (hereinafter also referred to as "similar image data") within a predetermined similarity range among the multiple dated image data in the specific dated image data list, the similar image data may be deleted from the specific dated image data list and the new dated image data may be added.

[0219] In addition, in each of the above embodiments, an example was given in which the dated image data list includes a plurality of dated image data, but as an example, as shown in Fig. 48, the image data list creation unit 60M may include, in the dated image data list, feature data indicating the features of a same-day image data group, which has the same date attached, among the plurality of dated image data, instead of the same-day image data group. In the example shown in Fig. 48, a plurality of dated image data dated May 19, 1985 is shown as an example of a same-day image data group, but the image data list creation unit 60M extracts feature data from the plurality of dated image data dated May 19, 1985, and replaces the plurality of dated image data dated May 19, 1985 with the feature data.

[0220] Here, a first example of the feature data is data that is predetermined as the minimum data that can identify the outline of dated image data included in the same-day image data group (e.g., spatial frequency, contrast value, brightness, etc. of image data included in each dated image data). A second example of the feature data is person image data and non-person image data associated with dated image data included in the same-day image data group. A third example of the feature data is data that is predetermined as the minimum data that can identify the outline of person image data and non-person image data associated with dated image data (e.g., spatial frequency, contrast value, brightness, etc. of image data included in each dated image data).

[0221] In this way, by including in the dated image data list characteristic data indicating the characteristics of the same-day image data group instead of the same-day image data group, the amount of data in the dated image data list can be reduced compared to when the dated image data list is composed only of multiple dated image data.

[0222] In addition, in each of the above embodiments, an example is given in which a date-stamped image data list corresponding to a user ID is obtained by executing a date-stamping process (see step ST104 shown in FIG. 40), but priorities may be assigned to multiple date-stamped image data lists, and the date-stamped image data lists with the highest priorities may be acquired in order.

[0223] In this case, by executing the date assignment process shown in Figures 49A and 49B, when multiple dated image data lists are associated with a specific user, CPU 60 obtains dated image data of a subject similar to the subject indicated by the undated image data, from among the multiple dated image data lists associated with the specific user, in order of priority based on the image data contained in each dated image data list.

[0224] In addition, in each of the above embodiments, when the date-adding process is executed and there is no date-added image data similar to the undated image data in the date-added image data list related to the specific user, no date is added to the undated image data, but the technology disclosed herein is not limited to this. For example, when there is no date-added image data similar to the undated image data in the date-added image data list related to the specific user, date-added image data similar to the undated image data may be obtained from the date-added image data list related to a user 16 other than the specific user.

[0225] In this case, by executing the date assignment process shown in Figures 49A and 49B, if the dated image data list associated with a specific user does not include dated image data of a subject similar to the subject indicated by the undated image data, the CPU 60 obtains dated image data of a subject similar to the subject indicated by the undated image data from a group of image data associated with at least one user other than the specific user among the multiple users.

[0226] Here, we will explain in more detail with reference to Figures 49A and 49B an example of a form in which priorities are assigned to multiple dated image data lists and the dated image data lists with the highest priority are retrieved in order, and an example of a form in which dated image data similar to undated image data is retrieved from a dated image data list related to a user 16 other than a specific user.

[0227] The flowcharts shown in Figures 49A and 49B differ from the flowchart shown in Figure 40 in that they include step ST104A instead of step ST104, step ST108B instead of step ST108, and further include steps ST130 to ST136. Note that in Figure 49A, the same steps as those in the flowchart shown in Figure 40 are given the same step numbers and their explanations will be omitted.

[0228] In step ST104A shown in Fig. 49A, the image data list acquisition unit 60Q acquires the date-stamped image data list with the highest priority from among the unprocessed date-stamped image data lists corresponding to the user ID extracted in step ST102, from the storage 62. The highest priority means the highest priority order. In addition, in this step ST104A, the unprocessed date-stamped image data list refers to a date-stamped image data list for which the processing in step ST108B has not yet been performed.

[0229] In step ST108B, the judgment unit 60P judges whether or not dated image data similar to the undated image data extracted in step ST106 is present in the dated image data list acquired in step ST104A. In step ST108B, if dated image data similar to the undated image data extracted in step ST106 is present in the dated image data list acquired in step ST104A, the judgment is affirmative, and the date assignment process proceeds to step ST110. In step ST108B, if dated image data similar to the undated image data extracted in step ST106 is not present in the dated image data list acquired in step ST104A, the judgment is negative, and the date assignment process proceeds to step ST130 shown in FIG. 49B.

[0230] In step ST130, the judgment unit 60P judges whether all of the date-stamped image data lists corresponding to the user ID extracted in step ST102 have been acquired in step ST104. In step ST130, if all of the date-stamped image data lists corresponding to the user ID extracted in step ST102 have not been acquired in step ST104, the judgment is negative, and the date assignment process proceeds to step ST104A shown in Fig. 49A. In step ST130, if all of the date-stamped image data lists corresponding to the user ID extracted in step ST102 have been acquired in step ST104, the judgment is positive, and the date assignment process proceeds to step ST132.

[0231] In step ST132, the image data list acquisition unit 60Q acquires from the storage 62 an unprocessed date-stamped image data list corresponding to a user ID other than the user ID extracted in step ST102 (hereinafter also referred to as "other user ID"), and then proceeds to step ST134. Note that in this step ST132, the unprocessed date-stamped image data list refers to a date-stamped image data list that has not yet been used in the processing of step ST134.

[0232] In step ST134, the judgment unit 60P judges whether or not dated image data similar to the undated image data extracted in step ST106 is present in the dated image data list acquired in step ST132. In step ST134, if dated image data similar to the undated image data extracted in step ST106 is present in the dated image data list acquired in step ST132, the judgment is affirmative, and the date assignment process proceeds to step ST110 shown in Fig. 49A. In step ST134, if dated image data similar to the undated image data extracted in step ST106 is not present in the dated image data list acquired in step ST132, the judgment is negative, and the date assignment process proceeds to step ST136.

[0233] In step ST136, it is determined whether the number of times the dated image data list was acquired in step ST132 (hereinafter also referred to as the "acquired list number") has reached an upper limit. The upper limit may be a fixed value or a variable value. In this case, the variable value may be, for example, a value that can be changed according to an instruction accepted by the accepting device 54, the number of dated image data lists corresponding to other user IDs, a value that changes according to the user 16 who provided the undated image data, and / or a value that is changed periodically.

[0234] In step ST136, if the number of acquired lists has not reached the upper limit, the determination is negative and the date assignment process proceeds to step ST132. In step ST136, if the number of acquired lists has reached the upper limit, the determination is positive and the date assignment process proceeds to step ST120 shown in FIG. 49A.

[0235] FIG. 50 shows an example of a plurality of date-stamped image data lists to which priorities have been assigned. In the example shown in FIG. 50, sixth to ninth subject image data lists associated with a user ID related to a specific user are shown as a plurality of date-stamped image data lists to which priorities have been assigned. The sixth subject image data list is a date-stamped image data list consisting of a plurality of date-stamped image data in which the sixth subject is captured. The seventh subject image data list is a date-stamped image data list consisting of a plurality of date-stamped image data in which the seventh subject is captured. The eighth subject image data list is a date-stamped image data list consisting of a plurality of date-stamped image data in which the eighth subject is captured. The ninth subject image data list is a date-stamped image data list consisting of a plurality of date-stamped image data in which the ninth subject is captured.

[0236] In the example shown in Fig. 50, a young male is shown as an example of the sixth subject. In addition, in the example shown in Fig. 50, a middle-aged male is shown as an example of the seventh subject. In addition, in the example shown in Fig. 50, an elderly male is shown as an example of the eighth subject. In addition, in the example shown in Fig. 50, an elderly male is shown as an example of the ninth subject.

[0237] The image data list creation unit 60M executes an image recognition process on the person image data associated with the date-included image data, and creates sixth to ninth subject image data lists by classifying the images into a child male, a middle-aged male, a middle-aged male, and a very old male. Generally, the physical features of a child male, a middle-aged male, a middle-aged male, and a very old male are different. The physical features refer to, for example, the features of the head (for example, at least one of the face and the hair). Generally, as a person ages, the roundness of the face, the amount of hair, and the color of hair change, so that by executing an image recognition process based on these characteristics, it becomes possible to classify the images into a child male, a middle-aged male, a middle-aged male, and a very old male.

[0238] The degree of change in appearance with aging for young men, middle-aged men, middle-aged men, and very old men is generally in the order of "young men > middle-aged men > middle-aged men > very old men aging." In other words, the younger the person, the greater the change in appearance with aging. For example, the younger the person, the rounder the facial contour is, and the amount of change in roundness is also greater than that of older people.

[0239] Therefore, dated image data in which the subject is a man of an age where physical changes with age are relatively large is more likely to have a greater degree of variation in the subjects than dated image data in which the subject is a man of an age where physical changes with age are relatively small. This means that it is more likely that the date to be assigned to the undated image data can be determined more accurately and quickly by obtaining a date from dated image data in which the subject is a man of an age where physical changes with age are relatively large than by obtaining a date from dated image data in which the subject is a man of an age where physical changes with age are relatively small. Therefore, in the example shown in FIG. 26, the sixth subject image data list is given the first priority, the seventh subject image data list is given the second priority, the eighth subject image data list is given the third priority, and the ninth subject image data list is given the fourth priority.

[0240] In the example shown in FIG. 26, a form example is shown in which a date-printed image data list is created for each generation of men, but the technology of the present disclosure is not limited to this. For example, a date-printed image data list may be created for each generation of women. In addition, the generations may be set more finely or more roughly.

[0241] Furthermore, the technology disclosed herein is not limited to the example in which a date-stamped image data list is created for each generation, and for example, a date-stamped image data list with a different priority may be created for each characteristic of user 16. Examples of the characteristics of user 16 include family structure, address, occupation, and hobbies. Also, a date-stamped image data list with a larger number of frames of date-stamped image data may be given a higher priority. Furthermore, a date-stamped image data list with a larger number of frames of date-stamped image data to which different dates are assigned may be given a higher priority.

[0242] 49A and 49B, dated image data of a subject similar to the subject shown in the undated image data is obtained from the dated image data lists having the highest priority based on the dated image data included in each dated image data list among the multiple dated image data lists. Therefore, with this configuration, the date to be assigned to the undated image data can be specified more accurately and quickly than when dated image data is obtained from the dated image data lists regardless of the priority based on the dated image data included in each dated image data list.

[0243] 49A and 49B, dated image data similar to undated image data is obtained from a dated image data list associated with a user 16 other than the specific user. Therefore, with this configuration, it is possible to increase the possibility of assigning an appropriate date to undated image data, compared to a case in which dated image data for which a date is to be derived is obtained only from a dated image data list associated with a specific user.

[0244] In addition, in each of the above embodiments, an example of a form in which a dated image data list is created that contains a mixture of dated image data with a person image and dated image data with a non-person image has been described, but the technology of the present disclosure is not limited to this. For example, dated image data may be broadly divided into dated image data with a person image and dated image data with a non-person image, and the image data list creation unit 60M may acquire only dated image data with a non-person image, and create a dated image data list using the acquired dated image data with a non-person image. With this configuration, it is possible to prevent the date that is assigned to the dated image data with a person image from being assigned to the undated image data.

[0245] In addition, in each of the above embodiments, an example was given in which dated image data for which a dated image data list is to be created is limited based on the similarity of people appearing as subjects in the image data, the similarity of the geographical distribution of the image capture positions, and the similarity of user information, but the technology of the present disclosure is not limited to this. For example, the CPU 60 may execute the dated image data list creation process shown in Fig. 51 as an example, to limit dated image data for which a dated image data list is to be created, out of multiple dated image data, to image data in which a person having a specific relationship is appearing.

[0246] Here, a person having a specific relationship refers to a friend, a family member, a relative, or an employee belonging to a specific organization. A person having a specific relationship may be registered in the server 14 by each of the multiple users 16 via the user device 12. In addition, the CPU 42 and / or 60 may perform image recognition processing on a group of image data held by the multiple user devices 12 to identify image data in which a person having a specific relationship appears as a subject, and the identified image data may be registered in the storage 62 of the server 14. In addition, when the number of frames of date-stamped image data in which the same person appears as a subject in a folder in the user device 12 is equal to or greater than a certain number (for example, 10 or more), the date-stamped image data in which the same person appears as a subject in the folder may be registered in the server 14 as image data in which a person having a specific relationship appears.

[0247] The flowchart shown in Fig. 51 differs from the flowchart shown in Fig. 39A in that step ST19 is provided between step ST18 and step ST20. Note that in Fig. 51, the same steps as those in the flowchart shown in Fig. 39A are given the same step numbers, and their explanations will be omitted.

[0248] In step ST19 shown in Fig. 51, erasing unit 60F erases dated image data that does not include a person with a specific relationship as a subject from the image data group stored in storage 62. As a result, dated image data that is used to create a dated image data list from among multiple dated image data is limited to image data that includes a person with a specific relationship. Therefore, with this configuration, an appropriate date can be derived more quickly when a person with a specific relationship is included as a subject in dateless image data, compared to when the dated image data that is used to create a dated image data list is not limited to image data that includes a person with a specific relationship.

[0249] In addition, in each of the above embodiments, data including a user ID, date, and GPS information is exemplified as attribute data included in dated image data, but the technology of the present disclosure is not limited to this. For example, generation identification information may be added to multiple dated image data, and the CPU 60 may limit the dated image data that is to be used to create a dated image data list from among the multiple dated image data to the generation identified by the generation identification information.

[0250] In this case, as shown in Fig. 52 as an example, generation specification information may be included in the attribute data, and as shown in Fig. 53 as an example, a date-included image data list creation process may be executed. The flowchart shown in Fig. 53 differs from the flowchart shown in Fig. 39E in that steps ST69A to ST69E are provided between step ST68 and step ST70. In Fig. 53, the same steps as those in the flowchart shown in Fig. 39E are given the same step numbers, and their explanations will be omitted.

[0251] In step ST69A shown in Fig. 53, the CPU 60 judges whether or not two or more groups of image data are stored in the storage 62. If two or more groups of image data are not stored in the storage 62 in step ST69A, the judgment is negative, and the date-stamped image data list creation process proceeds to step ST80 (see Fig. 39E). If two or more groups of image data are stored in the storage 62 in step ST69A, the judgment is positive, and the date-stamped image data list creation process proceeds to step ST69B.

[0252] In step ST69B, the CPU 60 extracts generation specification information from all image data groups stored in the storage 62, and then the date-stamped image data list creation process proceeds to step ST69C.

[0253] In step ST69C, the CPU 60 calculates the degree of generation agreement between the image data groups using all the generation identification information extracted in step ST69B, and then the date-stamped image data list creation process proceeds to step ST69D. The degree of generation agreement refers to the degree of agreement between the generation identification information. For example, the degree of agreement between the generations 1970-1980 is 100%, the degree of agreement between the generations 1970-1980 and 1975-1985 is 50%, and the degree of agreement between the generations 1970-1980 and 1930-1940 is 0%.

[0254] In step ST69D, the CPU 60 determines whether or not a group of image data whose generation matching degree is equal to or greater than a default matching degree (e.g., 50%) is stored in the storage 62. In step ST69D, a fixed value is used as the default matching degree. However, this is merely an example, and the default matching degree used in step ST69D may be a variable value. Examples of the variable value include a value that can be changed according to an instruction accepted by the accepting device 54, or a value that is changed periodically.

[0255] In step ST69D, if an image data group having a generation matching degree equal to or greater than the predetermined matching degree is not stored in storage 62, the determination is negative and the date-stamped image data list creation process proceeds to step ST70. In step ST69D, if an image data group having a generation matching degree equal to or greater than the predetermined matching degree is stored in storage 62, the determination is positive and the date-stamped image data list creation process proceeds to step ST69E.

[0256] In step ST69E, the CPU 60 erases from the storage 62 the image data group whose generation coincidence degree is less than a predetermined coincidence degree, and thereafter, the date-stamped image data list creation process proceeds to step ST70.

[0257] By executing the processes of steps ST69A to ST69E in this manner, the dated image data to be used to create the dated image data list is limited to the generation specified by the generation specification information among the multiple dated image data. Therefore, according to this configuration, it is possible to increase the possibility that an appropriate date will be assigned to undated image data, compared to a case in which the dated image data to be used to create the dated image data list is not limited by generation.

[0258] In addition, in each of the above embodiments, an example has been described in which the dated image data creation program 68 and the date assignment request processing program 70 (hereinafter, when there is no need to distinguish between these programs, they will be referred to as the "terminal-side program" without reference numbers) are stored in the storage 44, but the technology of the present disclosure is not limited to this. For example, as shown in FIG. 54, the terminal-side program may be stored in a storage medium 100. The storage medium 100 is a non-transitory storage medium. An example of the storage medium 100 is any portable storage medium such as an SSD or a USB memory.

[0259] The terminal-side program stored in storage medium 100 is installed in computer 22. CPU 42 executes dated image data creation processing in accordance with dated image data creation program 68, and executes date assignment request processing in accordance with date assignment request processing program 70. In the following, for ease of explanation, when there is no need to distinguish between the dated image data creation processing and the date assignment request processing, they will be referred to as "terminal-side processing".

[0260] In addition, the terminal side program may be stored in a memory unit of another computer or server connected to the computer 22 via a communication network (not shown), and the terminal side program may be downloaded and installed on the computer 22 in response to a request from the user device 12.

[0261] It is not necessary to store all of the terminal-side programs in the storage unit of another computer or server connected to the computer 22, or in the storage 44; only a part of the terminal-side programs may be stored therein.

[0262] 54, the CPU 42 is a single CPU, but it may be a plurality of CPUs. Also, a GPU may be applied in place of or together with the CPU 42.

[0263] 54 illustrates a computer 22, but the technology of the present disclosure is not limited to this, and a device including an ASIC, an FPGA, and / or a PLD may be applied instead of the computer 22. Also, a combination of a hardware configuration and a software configuration may be used instead of the computer 22.

[0264] The hardware resources for executing the terminal-side processing described in each of the above embodiments can be various processors as shown below. An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing terminal-side processing by executing software, i.e., a program. Another example of a processor is a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing specific processing, such as an FPGA, a PLD, or an ASIC. Each processor has a built-in or connected memory, and each processor executes terminal-side processing by using the memory.

[0265] The hardware resource for executing the terminal side processing may be one of these various processors, or may be a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource for executing the terminal side processing may be a single processor.

[0266] As an example of a configuration using one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes terminal-side processing. Second, there is a configuration using a processor that realizes the functions of the entire system including multiple hardware resources that execute terminal-side processing on a single IC chip, as typified by SoC. In this way, terminal-side processing is realized using one or more of the above-mentioned various processors as hardware resources.

[0267] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor elements. Also, the above terminal side processing is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be changed within the scope of the gist.

[0268] In addition, in each of the above embodiments, an example was given in which the dated image data list creation program 72, the date assignment processing program 74, and the dated image data list update program 76 (hereinafter, when there is no need to distinguish between these programs and describe them separately, they will be referred to as the "server-side programs" without reference numbers) are stored in the storage 62, but the technology of the present disclosure is not limited to this. For example, as shown in FIG. 55, the server-side programs may be stored in a storage medium 200. The storage medium 200 is a non-transitory storage medium. An example of the storage medium 200 is any portable storage medium such as an SSD or a USB memory. The server-side program is an example of a "program" according to the technology of the present disclosure.

[0269] The server-side program stored in storage medium 200 is installed in computer 50. CPU 60 executes dated image data list creation processing in accordance with dated image data list creation program 72, executes date assignment processing in accordance with date assignment processing program 74, and executes dated image data list update processing in accordance with dated image data list update program 76. Note that, for ease of explanation, in the following, unless there is a need to distinguish between the dated image data creation processing and the date assignment request processing, they will be referred to as "server-side processing."

[0270] In addition, the server-side program may be stored in a memory unit of another computer or server connected to computer 50 via a communication network (not shown), and the server-side program may be downloaded and installed on computer 50 in response to a request from server 14.

[0271] It is not necessary to store all of the server-side programs in the storage unit of another computer or server connected to computer 50, or in storage 62; only a portion of the server-side programs may be stored.

[0272] 55, the CPU 60 is a single CPU, but it may be a plurality of CPUs. Also, a GPU may be applied in place of the CPU 60 or together with the CPU 60.

[0273] 55 illustrates a computer 50, but the technology of the present disclosure is not limited thereto, and a device including an ASIC, an FPGA, and / or a PLD may be applied instead of the computer 50. Also, instead of the computer 50, a combination of a hardware configuration and a software configuration may be used.

[0274] The hardware resources for executing the server-side processing described in each of the above embodiments can be various processors as shown below. An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing server-side processing by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, which is a processor having a circuit configuration designed specifically for executing a specific process, such as an FPGA, PLD, or ASIC. Each processor has a built-in or connected memory, and each processor executes the server-side processing by using the memory.

[0275] The hardware resource that executes the server-side processing may be composed of one of these various processors, or may be composed of a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the server-side processing may be a single processor.

[0276] As an example of a configuration using one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes server-side processing. Second, there is a configuration using a processor that realizes the functions of the entire system including multiple hardware resources that execute server-side processing on a single IC chip, as typified by SoC. In this way, server-side processing is realized using one or more of the above various processors as hardware resources.

[0277] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor elements. Also, the above server-side processing is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be changed, without departing from the spirit of the invention.

[0278] The above description and illustrations are detailed descriptions of the parts related to the technology of the present disclosure, and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, function, action, and effect is an example of the configuration, function, action, and effect of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above description and illustrations, within the scope of the gist of the technology of the present disclosure. In addition, in order to avoid confusion and to facilitate understanding of the parts related to the technology of the present disclosure, the above description and illustrations omit explanations of technical common sense that do not require explanation in order to enable the implementation of the technology of the present disclosure.

[0279] In this specification, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0280] All publications, patent applications, and standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or standard was specifically and individually indicated to be incorporated by reference.

[0281] The following supplementary notes are further disclosed regarding the above embodiment.

[0282] (Appendix 1) A processor; A memory included in or connected to the processor; The processor is A list of dated image data is created by classifying multiple dated image data. Associating said dated image data list with a particular user; obtaining, from the dated image data list associated with the specific user, the dated image data for a subject similar to a subject represented by the undated image data of the specific user; deriving a date to be assigned to the undated image data based on the date assigned to the acquired dated image data; The plurality of date-stamped image data are image data for a plurality of users including the specific user, the dated image data list is created for each subject by classifying the dated image data for each subject represented by each of the dated image data; The dated image data list for subjects similar to the subjects represented by the dated image data of the particular user is associated with the particular user. Information processing device.

[0283] (Appendix 2) 2. The information processing device according to claim 1, wherein the dated image data list is created by classifying the plurality of dated image data for each subject whose manner of change over time is visually identifiable.

[0284] (Appendix 3) The dates attached to the plurality of dated image data are the dates of image capture, 3. The information processing device according to claim 1, wherein the dated image data list includes a plurality of the dated image data items captured on different dates.

[0285] (Appendix 4) 4. The information processing device according to any one of claims 1 to 3, wherein the plurality of users are a group of users who satisfy a condition that they have registered to agree to sharing information including the date-stamped image data.

[0286] (Appendix 5) an image data group is associated with each of the plurality of users; 5. The information processing device according to any one of claims 1 to 4, wherein the plurality of users are a group of users who satisfy a condition that the image data groups are similar to each other.

[0287] (Appendix 6) The information processing device according to any one of claims 1 to 5, wherein the plurality of users are a group of users that satisfy a condition that registered user information is similar.

[0288] (Appendix 7) The date-stamped image data is roughly divided into image data with people, in which a person is photographed as a subject, and image data without people, in which only non-people are photographed as a subject. The processor is acquiring only the image data without people as the date-included image data, 7. The information processing device according to claim 1, wherein the acquired person-free image data is used to create the date-included image data list.

[0289] (Appendix 8) The information processing device of any one of appendix 1 to appendix 7, wherein the processor limits the dated image data, among the plurality of dated image data, that is to be used to create the dated image data list to image data that includes a person having a specific relationship.

[0290] (Appendix 9) The plurality of date-stamped image data include image data to which position identification information for identifying an image capture position is added, The information processing device according to any one of appendix 1 to appendix 8, wherein the processor limits the dated image data, among the plurality of dated image data, that is to be used to create the dated image data list to image data obtained by capturing an image within a range determined based on the location identification information.

[0291] (Appendix 10) generation identification information capable of identifying a generation of the user is added to the plurality of date-stamped image data; The processor is an information processing device according to any one of appendix 1 to appendix 9, which limits the dated image data among the plurality of dated image data that is to be used to create the dated image data list to a generation identified by the generation identification information.

[0292] (Appendix 11) An information processing device according to any one of claims 1 to 10, wherein the processor obtains the dated image data of a subject similar to the subject indicated by the undated image data from an image data group associated with at least one user other than the specific user among the multiple users when the dated image data list associated with the specific user does not include the dated image data of a subject similar to the subject indicated by the undated image data.

[0293] (Appendix 12) An information processing device according to any one of appendices 1 to 11, wherein the processor updates the dated image data list by adding the first new image data to the dated image data list, provided that first new image data is provided as new image data for the dated image data and the image quality of the first new image data is equal to or higher than a standard image quality.

[0294] (Appendix 13) An information processing device according to any one of appendices 1 to 12, wherein the processor updates the dated image data list by adding the second new image data to the dated image data list associated with the specific user when the subject indicated by the second new image data newly provided as the dated image data is not similar to the subject indicated by the dated image data included in the dated image data list associated with the specific user.

[0295] (Appendix 14) An information processing device according to claim 12 or 13, wherein the processor, on condition that the dated image data list associated with the specific user has been updated, obtains the dated image data for a subject similar to a subject indicated by the undated image data of the specific user from the updated dated image data list associated with the specific user.

[0296] (Appendix 15) The processor includes, in the dated image data list, feature data indicating characteristics of a same-day image data group among the plurality of dated image data, the same date being assigned to the same image data group, in place of the same-day image data group.

[0297] (Appendix 16) An information processing device relating to any one of Appendix 1 to Appendix 15, wherein, when a plurality of the dated image data lists are associated with the specific user, the processor acquires the dated image data of a subject similar to a subject indicated by the undated image data in order from the dated image data lists with the highest priority based on the image data contained in each of the dated image data lists among the plurality of dated image data lists associated with the specific user.

[0298] (Appendix 17) 17. The information processing device according to any one of claims 1 to 16, wherein the processor causes a presentation device to present the derived date.

[0299] (Appendix 18) 18. The information processing apparatus according to any one of claims 1 to 17, wherein the processor updates the dated image data list associated with the particular user in accordance with an instruction accepted by a accepting device.

[0300] (Appendix 19) The information processing device of any one of appendices 1 to 18, wherein the processor creates a dated image data list for each subject by classifying the multiple dated image data for each subject of a person that includes physical characteristics that appear with aging.

[0301] (Appendix 20) 20. The information processing device of claim 19, wherein the physical features include a head feature including at least one of a face and hair.

[0302] (Appendix 21) An information processing device as described in any one of Appendix 1 to Appendix 20, wherein when multiple dated image data lists are associated with the specific user, the processor acquires the dated image data for a subject similar to a subject indicated by the undated image data, in order from the dated image data list having the largest number of frames of dated image data among the multiple dated image data lists associated with the specific user.

[0303] (Appendix 22) 22. The information processing device according to claim 21, wherein the number of sheets of dated image data is the number of sheets of dated image data to which different dates have been assigned.

[0304] (Appendix 23) an image data group is associated with each of the plurality of users; The plurality of users are a group of users that satisfy a condition that the image data groups are similar to each other, An information processing device described in any one of Appendix 1 to Appendix 22, wherein the condition for the image data groups to be similar to each other includes a condition that the image data groups contain a predetermined number or more of image data assigned to the same person.

[0305] (Appendix 24) The image data group is provided with position identification information that identifies an imaging position, The information processing device described in Appendix 23, wherein the condition for the image data groups to be similar to each other includes a condition that the distribution of the imaging positions determined based on the position identification information as the geographical distribution of the imaging positions between the image data groups is similar.

[0306] (Appendix 25) Creating a dated image data list by classifying a plurality of dated image data to which dates have been assigned; associating said list of dated image data with a particular user; obtaining the dated image data from the dated image data list associated with the particular user for a subject similar to a subject represented by the undated image data of the particular user; and deriving a date to be assigned to the undated image data based on the date assigned to the acquired dated image data; The plurality of date-stamped image data are image data for a plurality of users including the specific user, the dated image data list is created for each subject by classifying the dated image data for each subject represented by each of the dated image data; The method of information processing, wherein the dated image data list for subjects similar to subjects represented by the dated image data of the specific user is associated with the specific user.

[0307] (Appendix 26) A program for causing a computer to execute a process, The above process is Creating a dated image data list by classifying a plurality of dated image data to which dates have been assigned; associating said list of dated image data with a particular user; obtaining the dated image data from the dated image data list associated with the particular user for a subject similar to a subject represented by the undated image data of the particular user; and deriving a date to be assigned to the undated image data based on the date assigned to the acquired dated image data; The plurality of date-stamped image data are image data for a plurality of users including the specific user, the dated image data list is created for each subject by classifying the dated image data for each subject represented by each of the dated image data; The dated image data list for subjects similar to the subjects represented by the dated image data of the particular user is associated with the particular user. program.

Claims

1. A processor; A memory included in or connected to the processor; The processor, A list of dated image data is created by classifying multiple dated image data. Associating said list of dated image data with a particular user; the plurality of date-stamped image data are image data for a plurality of users including the specific user, the dated image data list is created for each subject by classifying the plurality of dated image data for each subject represented by each of the plurality of dated image data; The dated image data list for subjects similar to those represented by the dated image data of the particular user is associated with the particular user. Information processing device.

2. The information processing apparatus according to claim 1 , wherein the date-stamped image data list is created by classifying the plurality of date-stamped image data for each subject whose manner of change over time is visually identifiable.

3. the dates attached to the plurality of date-stamped image data are image capture dates, 3. The information processing apparatus according to claim 1, wherein the date-stamped image data list includes a plurality of date-stamped image data items each having a different capture date.

4. 4 . The information processing apparatus according to claim 1 , wherein the plurality of users are a group of users who have registered to agree to sharing information including the date-stamped image data.

5. an image data group is associated with each of the plurality of users; The information processing apparatus according to claim 1 , wherein the plurality of users are a group of users who satisfy a condition that the image data groups are similar to each other.

6. The information processing apparatus according to claim 1 , wherein the plurality of users are a group of users that satisfy a condition that registered user information is similar to one another.

7. The date-stamped image data is roughly divided into image data with people, in which a person is photographed as a subject, and image data without people, in which only non-people are photographed as a subject, The processor, acquiring only the image data without people as the date-inscribed image data, The information processing apparatus according to claim 1 , wherein the acquired image data without people is used to create the date-included image data list.

8. An information processing device as described in any one of claims 1 to 7, wherein the processor limits the dated image data among the plurality of dated image data that is to be used to create the dated image data list to image data that contains a person having a specific relationship.

9. The plurality of date-stamped image data include image data to which position identification information for identifying an image capture position is added, An information processing device as described in any one of claims 1 to 8, wherein the processor limits the dated image data among the plurality of dated image data that is to be used to create the dated image data list to image data obtained by capturing an image within a range determined based on the location identification information.

10. generation identification information capable of identifying a generation of the user is added to the plurality of date-stamped image data; 10. An information processing device according to claim 1, wherein the processor limits the dated image data among the plurality of dated image data that is to be used to create the dated image data list to a generation identified by the generation identification information.

11. An information processing device as described in any one of claims 1 to 10, wherein when the dated image data list associated with the specific user does not include dated image data of a subject similar to the subject indicated by the undated image data of the specific user, the processor obtains the dated image data of a subject similar to the subject indicated by the undated image data from a group of image data corresponding to at least one user other than the specific user among the multiple users.

12. An information processing device as described in any one of claims 1 to 11, wherein the processor updates the dated image data list by adding the first new image data to the dated image data list, provided that first new image data is provided as new image data as the dated image data and the image quality of the first new image data is equal to or higher than a standard image quality.

13. An information processing device as described in any one of claims 1 to 12, wherein the processor updates the dated image data list by adding the second new image data to the dated image data list associated with the specific user when the subject indicated by the second new image data newly provided as the dated image data is not similar to the subject indicated by the dated image data included in the dated image data list associated with the specific user.

14. An information processing device as described in claim 12 or claim 13, wherein the processor, on condition that the dated image data list associated with the specific user has been updated, obtains dated image data for a subject similar to a subject indicated by the undated image data of the specific user from the updated dated image data list associated with the specific user.

15. An information processing device as described in any one of claims 1 to 14, wherein the processor includes, in the dated image data list, feature data indicating characteristics of a same-day image data group among the multiple dated image data, which has the same date assigned to it, instead of the same-day image data group.

16. An information processing device as described in any one of claims 1 to 15, wherein when multiple dated image data lists are associated with the specific user, the processor acquires dated image data of a subject similar to a subject indicated by the undated image data of the specific user from among the multiple dated image data lists associated with the specific user, in order of the dated image data list with the highest priority based on the image data contained in each dated image data list.

17. The information processing apparatus of claim 1 , wherein the processor updates the dated image data list associated with the specific user in accordance with an instruction received by a reception device.

18. Creating a dated image data list by classifying a plurality of dated image data to which dates have been assigned; and associating said list of dated image data with a particular user; the plurality of date-stamped image data are image data for a plurality of users including the specific user, the dated image data list is created for each subject by classifying the plurality of dated image data for each subject represented by each of the plurality of dated image data; The dated image data list for subjects similar to those represented by the dated image data of the particular user is associated with the particular user. Information processing methods.

19. A program for causing a computer to execute a process, The process comprises: Creating a dated image data list by classifying a plurality of dated image data to which dates have been assigned; and associating said list of dated image data with a particular user; the plurality of date-stamped image data are image data for a plurality of users including the specific user, the dated image data list is created for each subject by classifying the plurality of dated image data for each subject represented by each of the plurality of dated image data; The dated image data list for subjects similar to those represented by the dated image data of the particular user is associated with the particular user. program.

Images