Image processing apparatus, image processing method, image processing program, and recording medium storing the program

Abstract

To provide an image processor, an image processing method, an image processing program, and a recording medium storing the program, capable of determining a commodity and a service in which a user is interested, based on a plurality of images photographed by the user.SOLUTION: An image is read from a plurality of images captured by the first user, and an object in which the first user is interested is determined from the read image by the CPU (step 34). Information regarding a commodity or a service different from the commodity of the subject itself included in the read image or the service for selling the subject itself is determined by the CPU11 from the determined target (step 35). The decided information is transmitted to the second user or the third user (step 38), and the decided information is transmitted from the second user or the third user to the first user.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an image processing device, an image processing method, an image processing program, and a recording medium storing the program. [Background technology]

[0002] When a user searches for or purchases a product over the Internet, they must input the product name. Since a search cannot be performed unless the user knows the product name, systems have been devised that search for the target product or similar objects (Patent Document 1). Furthermore, when purchasing a product over the Internet, there are systems that recognize the product category of an item contained in an image posted by the user and determine recommended products from product categories other than the recognized product category (Patent Document 2). Furthermore, there are also systems that obtain product names from posted information, identify the user's preferences, and generate recommended information (Patent Document 3). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-006660 [Patent Document 2] Japanese Patent Application Laid-Open No. 2011-141892 [Patent Document 3] Japanese Patent Application Laid-Open No. 2016-184369 Summary of the Invention [Problem to be solved by the invention]

[0004] When a user tries to find an object of interest using an image they have taken, they may be interested in things that are not included in the image in addition to the subject itself. In cited document 1, when a user searches for a product called shoes, the system suggests clothes that go well with the shoes, and does not use images taken by the user. In cited document 2, an item category other than the item category included in the posted image is identified from the posted image, but because only one posted image is used, it is not necessarily clear whether the user has found an object of interest. In cited document 3, a user's preferences are identified based on text posted by the user on a social networking service (SNS), etc., and are not related to the user's images.

[0005] The object of this invention is to determine products and services that a user may be potentially interested in based on images read from a recording device that stores multiple images taken by the user. [Means for solving the problem]

[0006] The image processing device of the present invention comprises a reading means for reading images from a recording device that records multiple images taken by a first user, a subject detection means for detecting a subject contained in the image read by the reading means, and a first determination means for determining information about at least one of a product other than the subject itself detected by the subject detection means or a service other than a service that sells the subject itself.

[0007] The present invention also provides an image processing method, in which a reading means reads an image from a recording device that records a plurality of images taken by a first user, a subject detection means detects a subject included in the image read by the reading means, and a determining means determines information about at least one of a product different from the subject itself detected by the subject detection means or a service different from a service selling the subject itself.

[0008] The present invention also provides a program for controlling a computer of an image processing device and a recording medium storing the program.

[0009] The image processing device may include a reading means for reading images from a recording device that records multiple images taken by a first user, and a processor, and the processor may detect a subject included in the image read by the reading means and determine information about at least one of a product other than the detected subject itself or a service other than a service that sells the subject itself.

[0010] It is preferable that the first determination means determines information about a product or service related to the subject detected by the subject detection means, which is information about a product other than the subject itself detected by the subject detection means or a service other than a service selling the subject itself.

[0011] The reading means, for example, reads two or more images from the recording device.

[0012] The subject detection means detects, for example, subjects that appear more than a threshold value among subjects obtained from two or more images read by the reading means.

[0013] The subject is, for example, the main subject.

[0014] The subject detection means may detect a first subject included in a first image and a second subject included in a second image from among the multiple images read by the reading means. In this case, the first determination means determines, for example, information about at least one of a product different from both the first subject and the second subject detected by the subject detection means or a service different from the service sold by both the first subject and the second subject.

[0015] The subject detection means detects, for example, at least two subjects included in the image read by the reading means, and in this case, the first determination means determines information about at least one of a product or a service related to a combination of at least two subjects, which is, for example, a product different from the subject itself detected by the subject detection means or a service different from a service selling the subject itself.

[0016] The system may further comprise a notification means for notifying a second user who sells the product or a third user who provides the service of information about the product or service determined by the first determination means.

[0017] The device may further include a photography skill determination means for determining the photography skill of the first user based on the image read by the reading means, and a second determination means for determining information about products or services related to photography based on the determination result of the photography skill determination means.

[0018] The device may further include a photographing device information detection means for detecting information about the first photographing device that captured the images based on the multiple images read by the reading means, and a third determination means for determining information about the second photographing device based on the information about the first photographing device.

[0019] The device may further comprise a display control means for causing a display device to display the information determined by the first determination means.

[0020] The first determination means may, for example, determine information about a product or service related to the subject itself detected by the subject detection means, but may also determine information about at least one of a product other than the subject itself detected by the subject detection means or a service other than a service selling the subject itself. [Effects of the Invention]

[0021] According to this invention, it is possible to determine products and services in which a user is interested based on a plurality of images taken by the user. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is an overview of an image processing system. [Figure 2] FIG. 2 is a block diagram showing the electrical configuration of the storage server. [Figure 3] It shows the user's image recorded on the hard disk. [Figure 4] 10 is a flowchart showing a processing procedure of a storage server. [Figure 5] 10 is a flowchart showing a processing procedure of a storage server. [Figure 6] 10 is an example of an image of a first user. [Figure 7] 10 is an example of management information about a product. [Figure 8] 10 is an example of management information about a service. [Figure 9] 10 is an example of an image of a second user. [Figure 10] 10 is a flowchart showing a processing procedure for determining an object of interest to a first user. [Figure 11] 10 is a flowchart showing a processing procedure of a storage server. [Figure 12] 10 is a flowchart showing a processing procedure of a storage server. DETAILED DESCRIPTION OF THE INVENTION

[0023] [First Example] FIG. 1 shows an embodiment of the present invention, and shows an overview of an image processing system.

[0024] The image processing system includes n (n is a positive integer) client computers 1-n, which are connected to the Internet. The image processing system also includes a storage server 10 and an information providing server 20, each of which can communicate with each of the n client computers 1-n via the Internet.

[0025] The client computers 1-n transmit image files representing images taken by users to the storage server 10, and the storage server 10 receives and stores the image files transmitted from the client computers 1-n. The information providing server 20 transmits information to users, but the storage server 10 may transmit information to users.

[0026] Although n client computers 1-n are shown in Figure 1, only one client computer may be included in the image processing system. Regardless of the number of client computers, it is sufficient that multiple users use the client computers to upload image data to the storage server 10. Furthermore, communication devices such as smartphones may be used instead of the client computers 1-n.

[0027] Furthermore, the image processing system may be configured without using the information providing server 20.

[0028] FIG. 2 is a block diagram showing the electrical configuration of the storage server 10. As shown in FIG.

[0029] The overall operation of the storage server 10 (an example of an image processing device) is controlled by a CPU (central processing unit) 11 .

[0030] Storage server 10 includes communication device 12 for connecting to the Internet, memory card reader / writer 13 for accessing memory card 14, compact disk drive 15 for reading data recorded on compact disk 16, hard disk 18 for recording image files sent from users (client computers 1-n), and hard disk drive 17 for writing image files to hard disk 18 and reading image files from hard disk 18. Storage server 10 also includes memory 19 and display device 19A.

[0031] Compact disc 16 (portable recording medium) stores a program that controls the operation of storage server 10, and the program recorded on compact disc 16 is read by compact disc drive 15 and installed on storage server 10. The program may not be read from compact disc 16 and installed on storage server 10, but may instead be received by storage server 10 via a network such as the Internet, and the received program may be installed on storage server 10.

[0032] The information providing server 20 also has the same electrical configuration as the storage server 10, and includes a CPU, a communication device, a memory, and the like.

[0033] FIG. 3 shows several images stored on the hard disk 18.

[0034] Hard disk 18 (an example of a recording device) stores multiple images taken by multiple users, such as images P1 to P100 taken by user U1, images P101 to P200 taken by user U2, and images P201 to P300 taken by user U3. Images of users other than users U1, U2, and U3 are also stored on hard disk 18. By using a user ID and password, user U1 can access user U1's images P1 to P100, but cannot access other users' images, such as user U2's images P101 to P200 or user U3's images P201 to P300. Other users are also managed so that they can access their own images but cannot access other users' images.

[0035] In this embodiment, a subject included in multiple images taken by a user (an example of a first user, hereinafter referred to as the first user) is detected, and information about at least one of a product other than the subject itself or a service other than a service selling the subject itself is determined. The determined information is transmitted to the first user.

[0036] 4 and 5 are flowcharts showing the processing procedure of the storage server 10 (image processing device).

[0037] 4 and 5 may be started when the determined information is sent to the first user, or may be started at any timing, or may be started periodically, or may be started when an image is sent from a user to the storage server 10. Which of the multiple users is to be the first user may be decided in any way. The order may be simply based on the user's ID, or on the number of images uploaded by the most recent or oldest users who uploaded images, or on the frequency of uploads by the most recent users.

[0038] In any case, when it comes time to determine the information about the first user, the CPU 11 of the storage server 10 determines whether it is set to read one image, or two or more images, of the multiple images taken by the first user from the hard disk 18 of the storage server 10. This setting may be set, for example, for each user, or may be set uniformly regardless of the user.

[0039] If it is set to read one image (YES in step 31), one of the multiple images taken by the first user and stored on hard disk 18 is read by hard disk drive 17 (an example of a reading means) (step 32). Any of the multiple images taken by the first user may be read by hard disk drive 17. For example, the hard disk drive 17 may read the last image taken or the last image sent to storage server 10. An image taken at the time when information is to be notified to the first user may be read by hard disk drive 17, or if there is an image taken of a special event, the image of that special event may be read by hard disk drive 17. Data such as the time when an image was taken and the event represented by the image are recorded in the header of the image file representing the image, and can be determined from the header. However, data such as the time when an image was taken and the event represented by the image may also be recorded in hard disk 18 as an image data table for each user, corresponding to the image (image file name). In this case, the data recorded in the image data table is updated by the CPU 11 every time an image is uploaded.

[0040] When the image is read, the subject (which may be the main subject) included in the read image is detected by the CPU 11 (which is an example of subject detection means) (step 33).

[0041] FIG. 6 is an example of an image 50 read from the hard disk 18.

[0042] Figure 6 is an image of a person riding a bicycle.

[0043] Image 50 includes, as subjects, a bicycle 51, a water bottle 52, cycling wear 53, sunglasses 54, a helmet 55, and the like. The bicycle 51, water bottle 52, cycling wear 53, sunglasses 54, and helmet 55 are detected by CPU 11 as subjects included in image 50. Subject detection is performed, for example, by performing edge detection on image 50 and matching the shape, color distribution, etc. of the obtained area with product images previously stored on hard disk 18 or a storage device external to storage server 10. Through subject detection, CPU 11 recognizes the specific products, etc. that are subjects included in image 50 (note that the terms "products" and "products, etc." may also include services; the same applies below).

[0044] When the CPU 11 detects a main subject, for example, a bicycle 51 is detected as the main subject. Of the bicycle 51, water bottle 52, cycling wear 53, sunglasses 54, helmet 55, etc. detected as subjects in image 50, the subject that is located near the center of the image and has a size ratio to image 50 that is equal to or greater than a certain value is detected as the main subject, but the main subject may also be determined by CPU 11 using other methods. The number of main subjects is not limited to one, and may be two or more.

[0045] When the CPU 11 detects a subject (main subject) from within the image 50, the CPU 11 determines an object that is likely to be of interest to the first user from the detected subjects (main subject) (step 34 in FIG. 5).

[0046] In image 50, bicycle 51, water bottle 52, cycling wear 53, sunglasses 54, and helmet 55 are detected as subjects. Therefore, CPU 11 determines, from the subjects, for example, road racing, bicycle, etc., as the object of interest to the first user. This determination can be made using, for example, AI (artificial intelligence) or a correspondence table between subjects and objects. For example, the correspondence table can be stored in advance on hard disk 18, storage server 10, etc., and CPU 11 can determine the object of interest to the first user from the correspondence between the subjects. When CPU 11 determines the object of interest to the first user using bicycle 51, which is the main subject, CPU 11 determines, for example, road racing, cycling, bicycle, etc. The object of interest to the first user may be the subject (main subject) itself detected from image 50, or it may not be the subject (main subject) itself but something related to the subject (main subject). In this embodiment, it is assumed that the object of interest to the first user is determined to be a bicycle.

[0047] When the CPU 11 determines the subject of interest to the first user, the CPU 11 determines information to be notified to the first user based on the determined subject (step 35). In this way, the determined information is, for example, about the subject of interest to the first user. However, the CPU 11 may also determine the information to be notified to the first user by using the subject (main subject) detected from the image 50 as described above, without determining the subject of interest to the first user. In either case, the CPU 11 determines the information to be notified to the first user so that it is a product different from the subject itself detected from the image 50 or a service different from a service selling the subject itself. In this embodiment, a case will be mainly described in which the subject of interest to the first user is first determined from the detected subject (main subject), and then the product information management structure for the subject of interest is referenced to determine information about the product to be notified to the first user.

[0048] Figure 7 shows an example of a product information management structure.

[0049] The management structure consists of multiple hierarchies. The first hierarchical level is "sporting goods," and the second hierarchical level below it manages products that are concepts below "sporting goods" in the first hierarchical level. "Bicycles" are an example of products in the second hierarchical level, but other products (e.g., mountain climbing equipment) also exist. The third hierarchical level below the second hierarchical level manages products that are concepts below products in the second hierarchical level. For example, "bicycle accessories," "maintenance products," and "apparel / shoes," which are products that are concepts below "bicycles," an example of a product in the second hierarchical level, are shown as examples of products in the third hierarchical level. Similarly, the fourth hierarchical level below the third hierarchical level manages products that are concepts below products in the third hierarchical level. For example, "smartphone folders," "cycle computers," and "locks," which are examples of products in the fourth hierarchical level, are managed as products that are concepts below "bicycle accessories," an example of a product in the third hierarchical level. Similarly, products that are concepts below "maintenance products" and "apparel / shoes," which are examples of products in the third hierarchical level, are managed. Not all sports goods are specified to have 1st to 4th hierarchies, and depending on the type of sports goods, the number of hierarchies may be less than or more than four.

[0050] The first level of the product information management structure shown in Figure 7 only shows "sports goods," but other classifications are similarly defined, such as "musical goods," "travel goods," "health goods," "animals," and "plants."

[0051] FIG. 8 shows an example of the management structure of service information.

[0052] In Figure 8, services related to events such as "bicycle tours," "bicycle maintenance," "road races," and "cycling competitions" are specified in the hierarchy below the product "bicycle." However, services for selling "bicycles" themselves are not specified, although they may be.

[0053] A management structure similar to that shown in FIG. 8 is also defined for products other than the product "bicycle."

[0054] The product information management structure shown in Figure 7 and the service information management structure shown in Figure 8 are determined for various products, and data representing these management structures is stored in the hard disk 18 or an external storage device of the storage server 10.

[0055] The CPU 11 can determine information about products to notify the first user by referring to the product information management structure shown in Figure 7, and can determine information about services to notify the first user by referring to the service information management structure shown in Figure 8.

[0056] When the object of interest of the first user is determined to be "bicycle" (the same applies when the object of interest is not determined and the detected subject or main subject is determined to be "bicycle"), the CPU 11 reads out "bicycle" defined in the second layer with reference to FIG. 7. Products defined in layers below the second layer that are different from the subject detected from image 50 become information about products to be notified to the first user. For example, "smartphone folder" and "cycle computer" defined in the fourth layer below "bicycle accessories" in the third layer below the second layer where bicycles are defined, as well as "air pump" and "tools" defined in the fourth layer below "maintenance supplies" in the third layer below the second layer where bicycles are defined, become information about products to be notified to the first user.

[0057] The first user may be notified of information about multiple products, or information about one product. The first user may be notified of information about products that are selling well in numbers above a certain level. However, among the products defined in the fourth layer, which is below "Clothing / Shoes" in the third layer below the second layer where bicycles are defined, "helmets" and "cycling clothing" are detected as subjects in image 50, and therefore do not constitute information about the products to be notified to the first user.

[0058] Similarly, referring to Figure 8, services related to events and the like defined in the hierarchy below the "bicycle" hierarchy, such as "bicycle trips" and "bicycle maintenance," become information about services to be notified to the first user. Since services that sell "bicycles" themselves are not defined in the hierarchy below "bicycles," services that sell bicycles themselves do not become information about services to be notified to the first user. Information about services with a certain number of users or more may be notified to the first user.

[0059] It is also possible that a plurality of subjects (main subjects) are detected from one image 50, and the CPU 11 determines information on at least one of products and services to be notified to the first user using the plurality of subjects (main subjects). In such a case, the CPU 11 determines information on products other than the products corresponding to the plurality of detected subjects from the product management structure shown in Fig. 7. In addition, with regard to services, the CPU 11 determines information on services defined in a hierarchy below the detected subjects as shown in Fig. 8.

[0060] Information about the products and services thus determined is displayed on the display screen of the display device 19A by the CPU 11 (an example of a display control means) (step 36).

[0061] If the information about the determined product or service is the subject itself included in image 50 or the service itself that sells that subject (YES in step 37), the object of interest to the first user is determined again by CPU 11, and new information to be notified to the first user is determined by CPU 11. If the information about the determined product or service is not the subject itself included in image 50 or the service itself that sells that subject (NO in step 37), the information about the determined product is transmitted to the second user by communication device 12, and the information about the determined service is transmitted to the third user by communication device 12 (step 38).

[0062] Information about the determined product is sent from the second user to the first user, and the first user can purchase the product by knowing that information. Also, information about the determined product is sent from the third user to the first user, and the first user can purchase a service by knowing that information. Both information about the determined product and information about the determined service may be sent to the second user or the third user. Both information about the determined product and information about the determined service is sent to the first user from at least one of the second user and the third user.

[0063] When two or more images out of the multiple images taken by the first user are read by the hard disk drive 17 (an example of a reading means) (NO in step 31 of Figure 4, YES in step 42), the subject (main subject) is detected from each of the two or more images read by the CPU 11 (an example of a subject detection means) (step 43).

[0064] For example, assume that image 50 shown in FIG. 6 and image 70 shown in FIG. 9 are read by hard disk drive 17. As described above, subjects detected from image 50 shown in FIG. 6 include bicycle 51, water bottle 52, cycling wear 53, sunglasses 54, and helmet 55 (all or any one of the subjects bicycle 51, water bottle 52, cycling wear 53, sunglasses 54, and helmet 55 are examples of first subjects). Subjects detected from image 70 shown in FIG. 9 include dogs 71-75 (all or any one of the dogs 71-75 are examples of second subjects). From the subjects bicycle 51, water bottle 52, cycling wear 53, sunglasses 54, and helmet 55 included in image 50 shown in FIG. 6, CPU 11 determines "bicycle" as the subject of interest to the first user, and from the dogs 71-75 included in image 70 shown in FIG. 9, CPU 11 determines "dog" as the subject of interest to the first user (step 34 in FIG. 5).

[0065] From these objects of interest, the CPU 11 (an example of a first determination means) determines information to be notified to the first user (step 35 in FIG. 5). When multiple objects of interest have been determined in this manner, the CPU 11 determines at least one of a product and a service that are commonly used by the multiple objects of interest and are a product other than the detected object itself or a service other than a service selling the detected object itself. For example, if "bicycles" and "dogs" have been determined as the objects of interest to the first user, first, all data in the management structures of product information and service information related to bicycles is read. Then, all data in the management structures of product information and service information related to dogs is read. Then, information about a product that appears in both the management structures of product information related to bicycles and the management structures of product information related to dogs, in this case a "bicycle pet carrier case" used for transporting a dog on a bicycle, is determined by the CPU 11 as information about a product to be notified to the first user. Furthermore, information about a service that appears in both the management structure of service information related to bicycles and the management structure of service information related to dogs, in this case "hotels where you can cycle with your pet," is determined by the CPU 11 as information about the service to be notified to the first user. Of course, other products and services may also be determined by the CPU 11 as information to be notified to the first user.

[0066] AI may be used to determine related products and services from multiple subjects of interest, and information about those products and services may be provided to the first user. For example, CPU 11 may find images (not limited to images taken by the first user in this case) from hard disk 18 that contain all of the multiple subjects of interest, determine the shooting conditions represented by the found images (for example, travel for travel images, or pet meet for pet meet images), and set the shooting conditions as the subject of interest to the user. From the subjects determined in this way, CPU 11 may determine at least one piece of information about products and services to provide to the first user.

[0067] If the determined information is neither the subject itself detected from the image read from hard disk 18 nor a service selling the detected subject itself (NO in step 37), information about the determined product is transmitted by communication device 12 (an example of a notification means) to, for example, a second user who sells the determined product, and information about the determined service is transmitted by communication device 12 to, for example, a third user who provides the determined service (step 38). The information may also be transmitted to the first user. Both the information about the product and the information about the service may be transmitted by communication device 12 to the second user or the third user, or may be transmitted by communication device 12 to the first user.

[0068] According to the above-described embodiment, it is possible to determine products and services in which the user is interested based on a plurality of images taken by the user.

[0069] FIG. 10 is a flowchart showing the processing procedure for determining an object of interest to the first user (the processing procedure of step 34 in FIG. 5).

[0070] When a subject (main subject) is detected from each of two or more images, the CPU 11 calculates the number of times of detection (number of times of appearance) for each type of detected subject (main subject) (step 61).The CPU 11 determines an object of interest to the first user from the subjects (main subjects) whose number of times of detection is equal to or greater than a threshold value (first threshold value) (step 62).

[0071] The more frequently a subject (main subject) is detected, the more the subject (main subject) is considered to be the subject (main subject) that the first user is interested in. From the subjects (subjects) that the first user is interested in, the CPU 11 can determine the target that the first user is interested in.

[0072] [Second Example] 11, showing the second embodiment, is a flowchart illustrating the processing procedure of the storage server 10. The processing procedure shown in FIG. 11 corresponds to the processing procedures shown in FIGS.

[0073] As in the first embodiment, when the hard disk drive 17 of the storage server 10 reads an image taken by a first user from the hard disk 18, if the storage server 10 is set to read one image (YES in step 81), one image is read by the hard disk drive 17 (step 82), and if the storage server 10 is set to read two or more images (NO in step 81), two or more images are read by the hard disk drive 17 (step 83).

[0074] The first user's photography skill is determined by CPU 11 (an example of photography skill determination means) using one or more scanned images (step 84). CPU 11 analyzes the images to determine the first user's photography skill based on the degree of blur of the main subject included in the image, its brightness, its contrast, the size and position of the main subject relative to the entire image, and the like (step 85).

[0075] Once the photography skill is determined, information about products and services related to photography is determined by CPU 11 (an example of a second determination means) according to the photography skill (step 85). For example, if the photography skill of the first user is determined to be beginner, products such as books on how to take photos for beginners, cameras for beginners, and services such as photography classes for intermediate users are determined by CPU 11 as information about products and services related to photography. For example, if the photography skill of the first user is determined to be intermediate, products such as books on how to take photos for intermediate users, cameras, cameras and lenses for intermediate users, and services such as photography classes for intermediate users are determined by CPU 11 as information about products and services related to photography. Furthermore, if the photography skill of the first user is determined to be advanced, products such as cameras, lenses, and camera filters for advanced users, services such as introductions to jobs as photographers, and introductions to photography class instructors are determined by CPU 11 as information about products and services related to photography. Information about products and services may be predetermined for each photography skill.

[0076] Once the information about the product and service has been determined, the CPU 11 displays the determined information on the display screen of the display device 19A of the storage server 10 (step 86). The information about the determined product is transmitted to the second user by the communication device 12, and the information about the determined service is transmitted to the third user by the communication device 12 (step 87). The information about the determined product is transmitted from the second user to the first user, and the information about the determined service is transmitted from the third user to the first user. The communication device 12 of the storage server 10 may transmit information about at least one of the determined product and service to at least one of the second user and the third user.

[0077] In the processing procedure shown in FIG. 11, the processing of steps 84 to 86 may be performed between the processing of steps 35 and 36 in FIG.

[0078] According to the second embodiment, the storage server 10 can determine information about products and services according to photography skills.

[0079] [Third Example] 12, which shows the third embodiment, is a flowchart showing the processing procedure of the storage server 10. The processing procedure shown in FIG. 12 corresponds to the processing procedures shown in FIGS.

[0080] As in the first and second embodiments, when the hard disk drive 17 of the storage server 10 reads an image taken by a first user from the hard disk 18, if the storage server 10 is set to read one image (YES in step 91), one image is read by the hard disk drive 17 (step 92), and if the storage server 10 is set to read two or more images (NO in step 91), two or more images are read by the hard disk drive 17 (step 93).

[0081] Using the one or more images that have been read, information about the first image capture device (the image capture device of the first user) is read by the CPU 11 (which is an example of an image capture device information detection means) (step 94). The information about the first image capture device is recorded in the header of the image file that represents the image read from the hard disk 18, and therefore can be read by the CPU 11 from the header.

[0082] When the information about the first photographing device is read, information about the second photographing device is determined by CPU 11 (an example of a third determination means) (step 95). The information about the first photographing device is information about the device with which the first user took an image, and the information about the second photographing device is, for example, information about a photographing device recommended to the first user, such as information for encouraging the first user to purchase a product, etc. For example, information about a photographing device that is a higher-end model than the first photographing device, or information about a higher-end camera, are examples of information about the second photographing device.

[0083] When the information regarding the second imaging device is determined, the CPU 11 displays the determined information on the display screen of the display device 19A of the storage server 10 (step 96). The determined information is transmitted to the second user by the communication device 12 (step 97). The communication device 12 of the storage server 10 may transmit the determined information to the second user.

[0084] In the processing procedure shown in FIG. 11, the processing of steps 94 and 95 may be performed between the processing of steps 35 and 36 in FIG.

[0085] According to the third embodiment, for example, the storage server 10 can determine information about a second imaging device to recommend to a first user.

[0086] The processing units that perform the above-mentioned processes include the CPU 11, which executes software and functions as various processing units, as well as programmable logic devices such as FPGAs (field-programmable gate arrays), whose circuit configuration can be changed after manufacture, and dedicated electrical circuits, such as ASICs (application specific integrated circuits), which are processors with circuit configurations specifically designed to perform specific processes.

[0087] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Examples of multiple processing units configured with a single processor include, first, a configuration in which a single processor is configured with a combination of one or more CPUs and software, as typified by computers such as client computers and servers, and this processor functions as multiple processing units. Second, a configuration in which a processor is used to realize the functions of an entire system including multiple processing units on a single IC (integrated circuit) chip, as typified by systems-on-chips. In this way, the various processing units are configured using one or more processors of each type as a hardware structure.

[0088] Furthermore, the hardware structure of these various processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor elements. [Explanation of symbols]

[0089] 1-n: Computer, 10: Storage server, 11: CPU, 12: Communication device, 13: Memory card reader / writer, 14: Memory card, 15: Compact disk drive, 16: Compact disk, 17: Hard disk drive, 18: Hard disk, 19: Memory, 19A: Display device, 20: Information server, 50: Image, 51: Bicycle, 52: Water bottle, 53: Cycling wear, 54: Sunglasses, 55: Helmet, 70: Image, P1-P300: Image, U1-U3: User

Claims

1. reading means for reading two or more images from a recording device that records a plurality of images taken by a first user; a subject detection means for detecting at least two subjects whose appearance frequency is equal to or exceeds a threshold value among the subjects obtained from the two or more images read by the reading means; a determining means for determining information on at least one of a commodity and a service commonly used by at least two subjects detected by the subject detecting means, the commodity being different in type from the detected subjects themselves, or a service different in type from a service selling the detected subjects themselves; An image processing device comprising:

2. setting at least two subjects detected by the subject detection means as predetermined targets; The commonly used products and services are products and services commonly used by the specified target. The image processing device according to claim 1 .

3. a reading means for reading two or more images from a recording device that records a plurality of images taken by a first user; the subject detection means detects at least two subjects, the number of appearances of which is equal to or greater than a threshold, from among the subjects obtained from the two or more images read by the reading means; the determining means determines information on at least one of a product and a service that are commonly used by at least two subjects detected by the subject detection means, and which are different in type from the detected subjects themselves, or a service that is different in type from a service that sells the detected subjects themselves; Image processing methods.

4. A computer-readable program for an image processing device, reading two or more images from a recording device that records a plurality of images taken by a first user; Detecting at least two subjects whose appearance frequency is equal to or greater than a threshold value from among the subjects obtained from the two or more scanned images; A program for controlling the computer of an image processing device to determine information about goods and services commonly used by at least two detected subjects, the goods and services being different in type from the detected subjects themselves, or the services selling the detected subjects themselves and the services being different in type.

5. A recording medium storing the program according to claim 4.

Images