Image processing apparatus and information processing system

Abstract

The present disclosure relates to an image processing apparatus and an information processing system capable of suppressing a decrease in reliability of a comment. User information is generated on the condition that a session is being established with a provision destination of a captured image, and the user information is provided to an information processing device that stores imaging location information. Alternatively, on the condition that a session is being established with a provision destination of a captured image, permission to acquire imaging location information is acquired based on permission information obtained from the provision destination, in a state where permission is acquired, imaging location information provided from an information processing device associated with an imaging location is acquired, and the imaging location information and the user information are provided to an external device that authenticates the user information. The present disclosure can be applied, for example, to an image processing apparatus, an information processing device, an imaging device, an electronic device, an information processing method, or a program, or the like.

Description

Technical Field

[0001] This disclosure relates to image processing apparatus and information processing system, and more specifically, to image processing apparatus and information processing system capable of suppressing the reduction of the reliability of comments. Background Technology

[0002] Typically, there are online forums (so-called "review sites") that accept and publicly share user reviews of facilities such as hotels, accommodations, and gaming facilities. Users of such forums can refer to these reviews to decide whether to use the facilities or to select the facilities they wish to use. The facilities providers can also consider these reviews as user feedback.

[0003] However, in such services, unauthorized individuals who do not use the facility can use fake images to post false reviews as if the photos were taken inside the facility. These fake reviews not only reduce the reliability of the facility itself, but also the reliability of all reviews published on the posting site—that is, the reliability of evaluations of all facilities. In other words, there is a risk of reduced reliability for the posting site's service.

[0004] For example, there is a method that converts images captured in a digital camera or similar device into hash values ​​and applies an electronic signature using those hash values ​​to the captured images for tampering detection (e.g., Patent Document 1). By applying this technology, it is possible to suppress the forgery of captured images used for commentary by third parties.

[0005] Citation List

[0006] Patent documents

[0007] Patent Document 1: Japanese Patent Application Publication No. 2008-22372 Summary of the Invention

[0008] The problem to be solved by the present invention

[0009] However, in this technology, for example, it is difficult to prevent contributors from using images taken outside the facility they are reviewing to post fake reviews.

[0010] This disclosure enables, for example, in such a service, the suppression of a decrease in the reliability of reviews.

[0011] Solution to the problem

[0012] An image processing apparatus according to one aspect of the present technology is an image processing apparatus comprising: a user information generation unit that generates user information in condition that a session is being established with a destination for providing captured images; and a providing unit that provides the user information to an information processing device that stores imaging location information.

[0013] Another aspect of the present technology is an image processing apparatus comprising: an acquisition control unit, which, conditioned on establishing a session with a destination for providing captured images, authorizes the acquisition of imaging location information based on authorization information obtained from the destination; an imaging location information acquisition unit, which, under the authorization of the acquisition control unit, acquires the imaging location information provided from an information processing device associated with the imaging location; and a providing unit, which provides the imaging location information and user information to an external device that verifies the user information.

[0014] According to another aspect of the present technology, an information processing system includes the following components: an image processing device; a first information processing device; and a second information processing device, wherein the image processing device includes: a user information generation unit that generates user information based on the condition that a session is being established with a destination providing a captured image; a user information providing unit that provides the user information generated by the user information generation unit to the first information processing device; a captured image validity period information acquisition unit that acquires captured image validity period information provided by the second information processing device that corresponds to the user information provided by the user information providing unit; and an imaging control unit that authorizes the imaging unit to process the captured image validity period information. The first information processing device includes: a user information acquisition unit, which acquires user information provided by the image processing device; and an imaging location information and user information providing unit, which provides imaging location information and user information acquired by the user information acquisition unit to the second information processing device. The second information processing device includes: an imaging location information and user information acquisition unit, which acquires imaging location information and user information provided by the first information processing device; a verification unit, which verifies the imaging location information and user information acquired by the imaging location information and user information acquisition unit; and an image validity period information providing unit, which provides the image validity period information corresponding to the imaging location information and user information to the image processing device when the verification result of the verification unit determines that the imaging location information and user information are valid.

[0015] According to another aspect of the present technology, an information processing system includes the following components: an image processing device; a first information processing device; and a second information processing device, wherein the image processing device includes: an acquisition control unit, which, conditioned on establishing a session with a destination providing a captured image, authorizes the acquisition of imaging location information based on authorization information obtained from the destination; an imaging location information acquisition unit, which, under the authorization of the acquisition control unit, acquires the imaging location information provided by the first information processing device; an imaging location information and user information providing unit, which provides the imaging location information and user information acquired by the imaging location information acquisition unit to the second information processing device; a captured image validity period information acquisition unit, which acquires captured image validity period information provided by the second information processing device, corresponding to the imaging location information and user information provided by the imaging location information and user information providing unit; and an imaging control unit, which authorizes the imaging unit to acquire the captured image... Imaging is performed within the validity period indicated by the validity period information of the captured image obtained by the validity period information acquisition unit. The first information processing device includes: an imaging location information generation unit, which generates the imaging location information based on the condition that a session is being established with the destination providing the captured image; and an imaging location information providing unit, which provides the imaging location information generated by the imaging location information generation unit to the image processing device. The second information processing device includes: an imaging location information and user information acquisition unit, which acquires the imaging location information and user information provided by the image processing device; a verification unit, which verifies the imaging location information and user information acquired by the imaging location information and user information acquisition unit; and a captured image validity period information providing unit, which provides the captured image validity period information corresponding to the imaging location information and user information to the image processing device when the verification result of the verification unit determines that the imaging location information and user information are valid.

[0016] According to another aspect of the present technology, an information processing system includes the following components: an image processing device; a first information processing device; and a second information processing device, wherein the image processing device includes: a user information generation unit that generates user information; a user information providing unit that provides the user information generated by the user information generation unit to the first information processing device; and a stay information extraction unit that extracts stay information from a receipt printed with stay information including a session key and time information, wherein the session key is based on the user information provided to the first information processing device by the user information providing unit and time information. The first information processing device includes: a location information dissemination unit; a dwell information providing unit, which provides dwell information extracted by the dwell information extraction unit to the second information processing device; and an image capturing unit, which provides the second information processing device with an image captured by an imaging unit. The first information processing device includes: a user information acquisition unit, which acquires user information provided by the image processing device; an imaging location information and user information providing unit, which provides the imaging location information and the user information acquired by the user information acquisition unit to the second information processing device. The system comprises: a session key acquisition unit, which acquires the session key provided by the second information processing device; and a receipt issuance unit, which issues the receipt, the receipt of which is printed with dwell information including the session key acquired by the session key acquisition unit and the time information; and the second information processing device comprising: an imaging location information and user information acquisition unit, which acquires the imaging location information and user information provided by the first information processing device; a verification unit, which verifies the imaging location information and user information acquired by the imaging location information and user information acquisition unit; and a session key acquisition unit. The system comprises: a session key providing unit, wherein, if the verification result of the verification unit determines that the imaging location information and the user information are valid, the session key providing unit issues the session key corresponding to the imaging location information and the user information, and provides the session key to the first information processing device; a dwell information acquisition unit, wherein the dwell information acquisition unit acquires the dwell information provided by the image processing device; a captured image acquisition unit, wherein the captured image acquisition unit acquires a captured image provided by the image processing device; and a control unit, wherein the control unit controls the permission to publish the captured image acquired by the captured image acquisition unit based on the dwell information acquired by the dwell information acquisition unit.

[0017] In an image processing apparatus according to one aspect of the present technology, user information is generated on the condition that a session is being established with a destination providing the captured image, and the user information is provided to an information processing device that stores imaging location information.

[0018] In an image processing apparatus according to another aspect of the present technology, under the condition that a session is being established with a destination for providing captured images, based on permission information obtained from the destination, permission is granted to acquire imaging location information, and under the permission state, imaging location information provided from an information processing device associated with the imaging location is acquired, and the imaging location information and user information are provided to an external device for verifying the user information.

[0019] In another aspect of the information processing system according to this technology, in an image processing device, user information is generated under the condition that a session is being established with a destination providing a captured image. The user information is provided to a first information processing device. Captured image validity period information corresponding to the user information is obtained from a second information processing device. An imaging unit is authorized to perform imaging within the validity period indicated by the captured image validity period information. In the first information processing device, the user information provided by the image processing device is obtained. Imaging location information and the user information are provided to the second information processing device. In the second information processing device, the imaging location information and the user information provided by the first information processing device are obtained. The imaging location information and the user information are verified. As a result of the verification, if the imaging location information and the user information are determined to be valid, the captured image validity period information corresponding to the imaging location information and the user information is provided to the image processing device.

[0020] In another aspect of the information processing system according to this technology, in an image processing device, under the condition that a session is being established with a destination providing the captured image, based on permission information obtained from the destination, permission is granted to acquire imaging location information. Under this permission, the imaging location information provided by a first information processing device is acquired, and the imaging location information and user information are provided to a second information processing device. Captured image validity period information corresponding to the imaging location information and the user information is acquired from the second information processing device. An imaging unit is permitted to perform imaging within the validity period indicated by the acquired captured image validity period information. In the first information processing device, the imaging location information is generated under the condition that a session is being established with the destination providing the captured image, and the generated imaging location information is provided to the image processing device. In the second information processing device, the imaging location information and the user information provided by the image processing device are acquired, the imaging location information and the user information are verified, and if, as a result of the verification, the imaging location information and the user information are determined to be valid, the captured image validity period information corresponding to the imaging location information and the user information is provided to the image processing device.

[0021] In another aspect of the information processing system according to this technology, in an image processing device, user information is generated and provided to a first information processing device. The user information is then extracted from a receipt containing dwell information including a session key and time information, the session key being issued based on the user information and imaging location information provided to the first information processing device. The dwell information is provided to a second information processing device, and an image captured by an imaging unit is provided to the second information processing device. In the first information processing device, the user information provided by the image processing device is retrieved, and the imaging location information and the user information are provided to the second information processing device. The image captured by the second information processing device is then retrieved. The system provides a session key, issues a receipt containing the session key and time information, and in the second information processing device, obtains the imaging location information and user information provided by the first information processing device, verifies the obtained imaging location information and user information, and if the imaging location information and user information are deemed valid as a result of the verification, issues the session key corresponding to the imaging location information and user information, and provides the session key to the first information processing device, obtains the stay information provided by the image processing device, obtains the captured image provided by the image processing device, and controls the permission to publish the captured image based on the obtained stay information. Attached Figure Description

[0022] Figure 1 This is an example illustration illustrating a summary of the guarantees for imaging position and imaging time.

[0023] Figure 2 This is a diagram illustrating an example of the main components of a comment system.

[0024] Figure 3 It is a block diagram illustrating examples of the main components of an imaging device.

[0025] Figure 4 It is a functional block diagram illustrating the functions implemented in an imaging device.

[0026] Figure 5 This is a block diagram illustrating the main components of a store's terminal equipment.

[0027] Figure 6 It is a functional block diagram illustrating the functions implemented in the store's terminal equipment.

[0028] Figure 7 This is a block diagram illustrating an example of the main components of a verification server.

[0029] Figure 8 This is a functional block diagram illustrating the functions implemented in the verification server.

[0030] Figure 9 This is a flowchart illustrating the main components of a posting website server.

[0031] Figure 10 This is a diagram illustrating the functionalities implemented in the posting website server.

[0032] Figure 11 This is a flowchart illustrating an example of the process related to posting comments.

[0033] Figure 12 This is a flowchart illustrating an example of the process for processing entry permits.

[0034] Figure 13 This is an illustration showing an example of information contained in a QR code.

[0035] Figure 14 This is a flowchart illustrating an example of the imaging verification process.

[0036] Figure 15 This is a flowchart illustrating an example of the process for processing a check-out certificate.

[0037] Figure 16 This is an illustration of an example of a comment screen.

[0038] Figure 17 This is another example of a diagram illustrating the outline of guarantees for imaging position and imaging time.

[0039] Figure 18 It is a functional block diagram illustrating the functions implemented in an imaging device.

[0040] Figure 19 This diagram illustrates the functional block diagram of the functions implemented in the store's terminal equipment.

[0041] Figure 20 This is a diagram illustrating the functionalities implemented in the posting website server.

[0042] Figure 21 This is a flowchart illustrating an example of the process for processing entry permits.

[0043] Figure 22 It was immediately afterwards Figure 21 This is a flowchart illustrating an example of the process for processing entry verification.

[0044] Figure 23 This is an illustration showing an example of information contained in a QR code.

[0045] Figure 24 This is a flowchart illustrating an example of the process for processing a check-out certificate.

[0046] Figure 25 It was immediately afterwards Figure 24 This is a flowchart illustrating an example of the process for processing departure certificates.

[0047] Figure 26 This is a diagram illustrating an example of the main components of a comment system.

[0048] Figure 27 It is a block diagram illustrating examples of the main components of a user terminal device.

[0049] Figure 28 It is a functional block diagram illustrating the functions implemented in a user terminal device.

[0050] Figure 29 It is a functional block diagram illustrating the functions implemented in an imaging device.

[0051] Figure 30 This is a functional block diagram illustrating the functions implemented in the verification server.

[0052] Figure 31 This is a flowchart illustrating an example of the process related to comment posting.

[0053] Figure 32 It was immediately afterwards Figure 31This is a flowchart illustrating an example of the process related to comment posting.

[0054] Figure 33 This is a flowchart illustrating an example of the imaging processing workflow.

[0055] Figure 34 This is a diagram illustrating an example of metadata.

[0056] Figure 35 It is a functional block diagram illustrating the functions implemented in a user terminal device.

[0057] Figure 36 This is a diagram illustrating an example of the main components of a comment system.

[0058] Figure 37 It is a functional block diagram illustrating the functions implemented in a user terminal device.

[0059] Figure 38 This is a functional block diagram illustrating the functions implemented in the verification server.

[0060] Figure 39 This is a flowchart illustrating an example of the process related to comment posting.

[0061] Figure 40 It was immediately afterwards Figure 39 This is a flowchart illustrating an example of the process related to comment posting.

[0062] Figure 41 This is a flowchart illustrating an example of the imaging processing workflow.

[0063] Figure 42 This is a diagram illustrating an example of metadata.

[0064] Figure 43 It is a functional block diagram illustrating the functions implemented in a user terminal device.

[0065] Figure 44 It is a functional block diagram illustrating the functions implemented in a user terminal device.

[0066] Figure 45 It is a functional block diagram illustrating the functions implemented in the store's terminal equipment.

[0067] Figure 46 This is a functional block diagram illustrating the functions implemented in the verification server.

[0068] Figure 47 This is a flowchart illustrating an example of the process related to comment posting.

[0069] Figure 48It was immediately afterwards Figure 47 This is a flowchart illustrating an example of the process related to comment posting.

[0070] Figure 49 This is a flowchart illustrating an example of the process for processing entry and exit certificates.

[0071] Figure 50 This is an illustration showing an example of information contained in a QR code. Detailed Implementation

[0072] The following will describe the patterns used to implement this disclosure (hereinafter referred to as embodiments). Note that the descriptions will be presented in the following order.

[0073] 1. Guaranteeing imaging position and imaging time

[0074] 2. First Implementation Example (Comment System)

[0075] 3. Second Implementation Example (Comment System)

[0076] 4. Third Implementation Example (Comment System)

[0077] 5. Fourth Implementation Example (Comment System)

[0078] 6. Fifth Implementation (Comment System)

[0079] 7. Appendix

[0080] <1. Guaranteeing Imaging Position and Imaging Time>

[0081] <Posting sites and fake comments>

[0082] Typically, there are online forums (so-called "review sites") that accept and publicly share user reviews of facilities such as hotels, accommodations, and gaming facilities. Users of such forums can refer to these reviews to decide whether to use the facilities or to select the facilities they wish to use. The facilities providers can also consider these reviews as user feedback.

[0083] The ratings on such reputation-based websites directly impact a store's sales, making them a crucial indicator for ordinary customers when choosing a store. However, these ratings are often manipulated by fake reviews to artificially inflate or lower scores. Therefore, it's necessary to curb this unauthorized review manipulation. While various reputation-based websites provide guidelines or conduct pre-posting searches and deletions, the freedom users have to post makes it difficult to prevent fake reviews in advance.

[0084] As a type of fake review, there exist so-called "fictional reviews" that offer high (or low) ratings without any actual visit. Unauthorized contributors use images taken outside the facility being reviewed to publish such fictional reviews.

[0085] For example, as described in Patent Document 1, there exists a method for detecting tampering by converting images captured in a digital camera or similar device into hash values ​​and applying an electronic signature using those hash values ​​to the captured images to be used. By applying this technology, the forgery of images used for comments by third parties can be suppressed. However, this technology is insufficient to prevent contributors, as parties involved, from using images captured outside the facility to be commented on to publish false comments. That is, it is difficult to suppress the publication of fictitious comments as described above.

[0086] Furthermore, because it is difficult to determine which of the published comments is fictitious, it is difficult to take appropriate measures against fictitious comments. That is, without measures to suppress the publication of fictitious comments, not only the reliability of the facilities, but also the reliability of all comments published on the posting website—that is, the reliability of all facility evaluations—may decrease. In other words, there is a risk of reduced reliability of the posting website's service.

[0087] <Guarantee of image validity>

[0088] Therefore, by ensuring the imaging location and time of the images to be posted, it is guaranteed that the user actually entered and left the store, and that the posted images were taken at that time. In this way, it is easier for the posting website to detect and delete or reject fictitious review posts using images taken from locations other than the facility being reviewed. That is, the posting of such fictitious reviews can be suppressed. Therefore, the decrease in the reliability of reviews can be suppressed. In other words, it is possible to suppress the decrease in the reliability of the posting website's service.

[0089] <2. First Embodiment>

[0090] <Verification upon entering and leaving the store, as well as guarantees for imaging time and imaging location>

[0091] For example, such as Figure 1 As shown in the diagram, suppose a user of imaging device A visits store B, takes pictures of products in store B to generate image C, uses image C to generate a review of store B, and posts the review to a posting website.

[0092] In this scenario, the user's entry time (time X) and exit time (time Y) are recorded. This ensures that imaging device A remains within store B between time X and time Y. Furthermore, imaging device A uses a dedicated camera application to generate and capture image C, and uploads image C in association with information about the capture time and location. This ensures the capture location and time of image C are accurate. Therefore, it ensures that image C was generated by imaging device A within store B between time X and time Y. In other words, it ensures that image C was posted by a user who actually visited store B.

[0093] For example, user information is generated based on the condition that a session is being established with the destination providing the captured image, and this user information is provided to an information processing device that stores imaging location information. For instance, the image processing device includes a user information generation unit that generates user information based on the condition that a session is being established with the destination providing the captured image, and a providing unit that provides the user information to the information processing device that stores imaging location information. This allows for verification of entry and exit from the store, and ensures the imaging location and imaging time.

[0094] <Comment System>

[0095] Figure 2 This is a diagram illustrating an example of the main components of a comment system as an embodiment of an information processing system to which this technology is applied. Figure 2 The comment system 100 shown in the diagram is a system in which users who have visited a store (facility) use photos taken at the store to post comments about the store.

[0096] like Figure 2 As shown in the diagram, the comment system 100 includes an imaging device 101, a store terminal device 102, a verification server 103, and a posting website server 104. The devices are communicatively connected to each other via a network 105. Furthermore, the imaging device 101 and the store terminal device 102 can exchange information using QR codes (registered trademark).

[0097] Imaging device 101 is an image processing device owned by the user who posts the review. The user visits the store they want to review, uses imaging device 101 to capture an image of the subject within the store, and generates the captured image for the review. Imaging device 101 has communication capabilities, enabling it to provide the captured image to a verification server 103, etc. Imaging device 101 also has a display function, enabling it to display QR codes, etc.

[0098] The store terminal device 102 is an information processing device installed in the store visited by the user of the imaging device 101. The store terminal device 102 has communication capabilities and can use these capabilities to provide location information indicating the store's location to the verification server 103, etc. The store terminal device 102 includes a QR code reader and can use this reader to read the information indicated by the QR code displayed by the imaging device 101.

[0099] From the perspective of imaging device 101, verification server 103 is an external device that verifies various types of information. Verification server 103 has communication capabilities, enabling it to verify information provided from imaging device 101 or store terminal device 102 using this communication function, and to return the verification results.

[0100] From the perspective of imaging device 101, posting website server 104 is the destination for capturing images and a server providing posting website services. Posting website server 104 has communication functions and uses these functions to receive comment posts from imaging device 101 and others. Posting website server 104 uses these communication functions to publicly publish the posted comments.

[0101] Network 105 is a communication network that includes any communication medium. Communication via network 105 can be wired communication, wireless communication, or both. That is, network 105 can be a communication network for wired communication, a communication network for wireless communication, or a communication network that includes both. Furthermore, network 105 can include a single communication network or multiple communication networks.

[0102] For example, network 105 may include the Internet. Furthermore, network 105 may include a public telephone network. Furthermore, network 105 may include a wide-area communication network for wireless mobile devices, such as so-called 3G lines, 4G lines, 5G lines, etc. Furthermore, network 105 may include a wide area network (WAN), a local area network (LAN), etc. Furthermore, network 105 may include a wireless communication network for communication compliant with the Bluetooth (registered trademark) standard. Furthermore, network 105 may include a near-field communication (NFC) communication path. Furthermore, network 105 may include a communication path for infrared communication. Furthermore, network 105 may include a communication network for wired communication compliant with standards such as High Definition Multimedia Interface (HDMI) (registered trademark) or Universal Serial Bus (USB) (registered trademark). As described above, network 105 may include communication networks or communication paths of any communication standard.

[0103] Note that the verification server 103 and the posting website server 104 can be integrated as a single server (information processing device).

[0104] The review system 100 performs entry verification as proof that a user has entered the store and exit verification as proof that a user has left the store. Based on these processes, imaging is permitted from the time a user enters the store until they leave. Furthermore, the imaging device 101 provides user information to the store terminal device 102 using a QR code. The store terminal device 102 uses this user information and location information indicating the store's location to perform entry verification and exit verification.

[0105] This process ensures that users take photos and generate images within the store before actually entering and leaving.

[0106] For example, in an information processing system (e.g., a comment system 100) including an image processing device (e.g., an imaging device 101), a first information processing device (e.g., a store terminal device 102), and a second information processing device (e.g., a verification server 103), the image processing device may include: a user information generation unit that generates user information conditioned on the establishment of a session with a destination providing the captured image (e.g., a posting website server 104); a user information providing unit that provides the user information generated by the user information generation unit to the first information processing device; a captured image validity period information acquisition unit that acquires captured image validity period information provided by the second information processing device that corresponds to the user information provided by the user information providing unit; and an imaging control unit that authorizes the imaging unit to perform imaging within the validity period indicated by the captured image validity period information acquired by the captured image validity period information acquisition unit. The first information processing device may include: a user information acquisition unit, which acquires user information provided by an image processing device; and an imaging location information and user information providing unit, which provides imaging location information and user information acquired by the user information acquisition unit to a second information processing device. The second information processing device may include: an imaging location information and user information acquisition unit, which acquires imaging location information and user information provided by the first information processing device; a verification unit, which verifies the imaging location information and user information acquired by the imaging location information and user information acquisition unit; and a captured image validity period information providing unit, which provides captured image validity period information corresponding to the imaging location information and user information to the image processing device when the imaging location information and user information are determined to be valid by the verification unit.

[0107] Imaging equipment

[0108] Figure 3 This is a diagram illustrating an example of the main components of an imaging device 101, which is an embodiment of an image processing apparatus to which this technology is applied. (See diagram for details.) Figure 3 As shown in the diagram, the imaging device 101 includes an information processing unit 111, an imaging unit 112, an input unit 121, an output unit 122, a storage unit 123, a communication unit 124, and a driver 125.

[0109] The information processing unit 111 includes, for example, a central processing unit (CPU), read-only memory (ROM), and random access memory (RAM), and is a computer capable of executing application programs (software) using the CPU, ROM, RAM, etc., to perform various functions. For example, the information processing unit 111 can install and execute application programs (software) that perform imaging-related processing for generating captured images for posting comments. Here, the computer includes, for example, a computer incorporating dedicated hardware, or a general-purpose personal computer capable of performing various functions by installing various programs.

[0110] The imaging unit 112 includes an optical system, an image sensor, etc., and is capable of imaging a subject to generate a captured image. The imaging unit 112 can provide the generated captured image to the information processing unit 111.

[0111] The input unit 121 includes, for example, input devices such as a keyboard, mouse, microphone, touch panel and input terminals, and can provide information input via these input devices to the information processing unit 111.

[0112] The output unit 122 includes, for example, output devices such as a display (show unit), a speaker (audio output unit), and output terminals, and can output information provided from the information processing unit 111 via these output devices.

[0113] Storage unit 123 may include, for example, a storage medium such as a hard disk, RAM disk, or non-volatile memory, and may store information provided from information processing unit 111 in the storage medium. Storage unit 123 may read information stored in the storage medium and provide that information to information processing unit 111.

[0114] The communication unit 124 includes, for example, a network interface, which can receive information sent from other devices via the network 105 and provide the received information to the information processing unit 111. The communication unit 124 can also send information provided by the information processing unit 111 to other devices via the network 105.

[0115] The drive 125 has an interface to a removable recording medium 131 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and can read information recorded on the removable recording medium 131 attached to the drive 125 and provide that information to the information processing unit 111. The drive 125 can record information provided from the information processing unit 111 into the writable removable recording medium 131 attached to the drive 125.

[0116] For example, the information processing unit 111 loads and executes an application program stored in the storage unit 123. At this time, the information processing unit 111 may appropriately store data, etc., required for performing various processes. The application program, data, etc., can be provided, for example, by recording on a removable recording medium 131, such as a package medium. In this case, the application program, data, etc., are read by a drive 125 attached to the removable recording medium 131 and installed in the storage unit 123 via the information processing unit 111. Furthermore, the application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In this case, the application program, data, etc., are received by a communication unit 124 and installed in the storage unit 123 via the information processing unit 111. Additionally, the application program, data, etc., can be pre-installed in a ROM within the information processing unit 111 or in the storage unit 123.

[0117] Functional blocks of imaging equipment

[0118] Figure 4 The diagram illustrates the functions implemented by the information processing unit 111 executing the application program, as a functional block diagram. For example... Figure 4 As shown in the diagram, by executing the application, the information processing unit 111, as a functional block, may include a session key request unit 141, a QR code generation unit 142, a QR code providing unit 143, a control information acquisition unit 144, an imaging control unit 145, an image providing unit 146, and a publishing processing unit 147.

[0119] Session key request unit 141 performs processing related to requesting a session key. QR code generation unit 142 performs processing related to generating a QR code. QR code providing unit 143 performs processing related to providing a QR code. Control information acquisition unit 144 performs processing related to acquiring control information. Imaging control unit 145 performs processing related to controlling the imaging unit 112. Image providing unit 146 performs processing related to providing the image generated by the imaging unit 112. Publishing processing unit 147 performs processing related to publishing comments.

[0120] <Store Terminal Equipment>

[0121] Figure 5 This is an illustration showing an example of the main components of a shop terminal device 102, which is an embodiment of an image processing apparatus to which this technology is applied. Figure 5 As shown in the diagram, the store terminal device 102 includes an information processing unit 161, a reader 162, an input unit 171, an output unit 172, a storage unit 173, a communication unit 174, and a driver 175.

[0122] The information processing unit 161 is, for example, a computer that includes a CPU, ROM, RAM, etc., and can perform various functions by executing application programs (software) using the CPU, ROM, RAM, etc. For example, the information processing unit 161 can install and execute application programs (software) related to processing user entry and exit certificates.

[0123] The reader 162 includes an optical system, an image sensor, etc., and is capable of reading QR codes (i.e., information indicated by a QR code). The reader 162 can provide the read information to the information processing unit 161.

[0124] The input unit 171 includes, for example, input devices such as a keyboard, mouse, microphone, touch panel and input terminals, and can provide information input via these input devices to the information processing unit 161.

[0125] The output unit 172 includes, for example, output devices such as a display (show unit), a speaker (audio output unit), and output terminals, and can output information provided from the information processing unit 161 via these output devices.

[0126] Storage unit 173 may include, for example, a storage medium such as a hard disk, RAM disk, or non-volatile memory, and may store information provided from information processing unit 161 in the storage medium. Storage unit 173 may read information stored in the storage medium and provide that information to information processing unit 161.

[0127] The communication unit 174 includes, for example, a network interface, which can receive information sent from other devices via the network 105 and provide the received information to the information processing unit 161. The communication unit 174 can also send information provided by the information processing unit 161 to other devices via the network 105.

[0128] The drive 175 has an interface to a removable recording medium 181 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and can read information recorded on the removable recording medium 181 attached to the drive 175 and provide that information to the information processing unit 161. The drive 175 can record information provided from the information processing unit 161 into the writable removable recording medium 181 attached to the drive 175.

[0129] For example, the information processing unit 161 loads and executes an application program stored in the storage unit 173. At this time, the information processing unit 161 may appropriately store data, etc., required for performing various processes. The application program, data, etc., can be provided, for example, by recording on a removable recording medium 181, such as a package medium. In this case, the application program, data, etc., are read by a drive 175 attached to the removable recording medium 181 and installed in the storage unit 173 via the information processing unit 161. Furthermore, the application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In this case, the application program, data, etc., are received by a communication unit 174 and installed in the storage unit 173 via the information processing unit 161. Additionally, the application program, data, etc., can be pre-installed in a ROM or storage unit 173 within the information processing unit 161.

[0130] <Functional Blocks of Store Terminal Equipment>

[0131] Figure 6 The diagram illustrates the functions implemented by the information processing unit 161 executing the application program, as a functional block diagram. For example... Figure 6 As shown in the diagram, by executing the application, the information processing unit 161, as a functional block, may include a store information registration unit 191, a QR code reading unit 192, an entry certificate information providing unit 193, and an exit certificate information providing unit 194.

[0132] The store information registration unit 191 performs processing related to registering store information as information about the store. The QR code reading unit 192 performs processing related to reading QR codes. The store entry verification information providing unit 193 performs processing related to providing store entry verification information as proof of a user's entry into the store. The store exit verification information providing unit 194 performs processing related to providing store exit verification information as proof of a user's departure from the store.

[0133] <Verification Server>

[0134] Figure 7 This is a diagram illustrating a main component example of a verification server 103, which is an embodiment of an image processing apparatus to which this technology is applied. Figure 7As shown in the diagram, the verification server 103 includes an information processing unit 211, a verification data storage unit 212, an input unit 221, an output unit 222, a storage unit 223, a communication unit 224, and a driver 225.

[0135] The information processing unit 211 is, for example, a computer that includes a CPU, ROM, RAM, etc., and can perform various functions by executing application programs (software) using the CPU, ROM, RAM, etc. For example, the information processing unit 211 can install and execute application programs (software) that perform processing related to the verification of various information.

[0136] The verification data storage unit 212 may include a storage medium such as a hard disk, RAM disk, or non-volatile memory, and may store verification data provided by the information processing unit 211 as verification information in the storage medium. The verification data storage unit 212 may read the verification data stored in the storage medium and provide the verification data to the information processing unit 211.

[0137] The input unit 221 may include input devices such as a keyboard, mouse, microphone, touch panel and input terminal, and may provide information input via these input devices to the information processing unit 211.

[0138] The output unit 222 includes, for example, output devices such as a display (show unit), a speaker (audio output unit), and output terminals, and can output information provided from the information processing unit 211 via these output devices.

[0139] Storage unit 223 may include, for example, a storage medium such as a hard disk, RAM disk, or non-volatile memory, and may store information provided from information processing unit 211 in the storage medium. Storage unit 223 may read information stored in the storage medium and provide that information to information processing unit 211.

[0140] The communication unit 224 includes, for example, a network interface, which can receive information sent from other devices via the network 105 and provide the received information to the information processing unit 211. The communication unit 224 can also send information provided by the information processing unit 211 to other devices via the network 105.

[0141] The drive 225 has an interface to a removable recording medium 231, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and can read information recorded on the removable recording medium 231 attached to the drive 225 and provide that information to the information processing unit 211. The drive 225 can record information provided from the information processing unit 211 in the writable removable recording medium 231 attached to the drive 225.

[0142] For example, the information processing unit 211 loads and executes an application program stored in the storage unit 223. At this time, the information processing unit 211 may appropriately store data, etc., required for performing various processes. The application program, data, etc., can be provided, for example, by recording on a removable recording medium 231, such as a package medium. In this case, the application program, data, etc., are read by a drive 225 attached to the removable recording medium 231 and installed in the storage unit 223 via the information processing unit 211. Furthermore, the application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In this case, the application program, data, etc., are received by a communication unit 224 and installed in the storage unit 223 via the information processing unit 211. Additionally, the application program, data, etc., can be pre-installed in a ROM or storage unit 223 within the information processing unit 211.

[0143] <Function block for verifying the server>

[0144] Figure 8 The diagram illustrates the functions implemented by the information processing unit 211 through the execution of the application program, which functions as a functional block. For example... Figure 8 As shown in the diagram, by executing the application, the information processing unit 211, as a functional block, may include a store ID issuance and registration unit 241, an entry certificate information acquisition unit 242, an entry certificate information verification unit 243, an entry time recording unit 244, an imaging control unit 245, an image acquisition unit 246, an image verification unit 247, an image management unit 248, a departure certificate information acquisition unit 249, a departure certificate information verification unit 250, a departure time recording unit 251, and a release control unit 252.

[0145] The store ID issuance and registration unit 241 processes the issuance and registration of store IDs, which serve as the store's identification information. The entry verification information acquisition unit 242 processes the acquisition of entry verification information. The entry verification information verification unit 243 processes the verification of entry verification information. The entry time recording unit 244 processes the recording of the entry time, which is the time a user enters the store. The imaging control unit 245 processes the control of imaging by the imaging device 101. The image acquisition unit 246 processes the acquisition of captured images. The image verification unit 247 processes the verification of captured images. The image management unit 248 processes the management of captured images. The departure verification information acquisition unit 249 processes the acquisition of departure verification information. The departure verification information verification unit 250 processes the verification of departure verification information. The departure time recording unit 251 processes the recording of the departure time, which is the time a user leaves the store. The posting control unit 252 processes the control of posting comments.

[0146] <Posting website server>

[0147] Figure 9 This is a diagram illustrating an example of the main components of a posting website server 104, an embodiment of an image processing apparatus to which this technology is applied. (See diagram for details.) Figure 9 As shown in the diagram, the posting website server 104 includes an information processing unit 261, a posting data storage unit 262, an input unit 271, an output unit 272, a storage unit 273, a communication unit 274, and a driver 275.

[0148] The information processing unit 261 is, for example, a computer that includes a CPU, ROM, RAM, etc., and can perform various functions by executing application programs (software) using the CPU, ROM, RAM, etc. For example, the information processing unit 261 can install and execute application programs (software) that perform processing related to the verification of various information.

[0149] The publishing data storage unit 262 includes, for example, a storage medium such as a hard disk, RAM disk, or non-volatile memory, and can store publishing data provided by the information processing unit 261 in the storage medium, the publishing data being information such as published captured images or comments. The publishing data storage unit 263 can read the publishing data stored in the storage medium and provide the publishing data to the information processing unit 261.

[0150] The input unit 271 includes, for example, input devices such as a keyboard, mouse, microphone, touch panel and input terminals, and can provide information input via these input devices to the information processing unit 261.

[0151] The output unit 272 includes, for example, output devices such as a display (show unit), a speaker (audio output unit), and output terminals, and can output information provided from the information processing unit 261 via these output devices.

[0152] Storage unit 273 may include, for example, a storage medium such as a hard disk, RAM disk, or non-volatile memory, and may store information provided from information processing unit 261 in the storage medium. Storage unit 273 may read information stored in the storage medium and provide that information to information processing unit 261.

[0153] The communication unit 274 includes, for example, a network interface, which can receive information sent from other devices via the network 105 and provide the received information to the information processing unit 261. The communication unit 274 can also send information provided by the information processing unit 261 to other devices via the network 105.

[0154] The drive 275 has an interface to a removable recording medium 281 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and can read information recorded on the removable recording medium 281 attached to the drive 275 and provide that information to the information processing unit 261. The drive 275 can record information provided from the information processing unit 261 in the writable removable recording medium 281 attached to the drive 275.

[0155] For example, the information processing unit 261 loads and executes an application program stored in the storage unit 273. At this time, the information processing unit 261 may appropriately store data, etc., required for performing various processes. The application program, data, etc., can be provided, for example, by recording on a removable recording medium 281, such as a package medium. In this case, the application program, data, etc., are read by a drive 275 attached to the removable recording medium 281 and installed in the storage unit 273 via the information processing unit 261. Furthermore, the application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In this case, the application program, data, etc., are received by a communication unit 274 and installed in the storage unit 273 via the information processing unit 261. Additionally, the application program, data, etc., can be pre-installed in a ROM or storage unit 273 within the information processing unit 261.

[0156] <Functional blocks of the posting website server>

[0157] Figure 10 The diagram illustrates the functions implemented by the information processing unit 261 as functional blocks through the execution of the application program. For example... Figure 10As shown in the diagram, by executing the application, the information processing unit 261, as a functional block, may include a request acceptance unit 291, a session key issuance unit 292, a published image acquisition unit 293, and a published processing unit 294.

[0158] The request acceptance unit 291 performs processing related to accepting requests from other devices. The session key issuance unit 292 performs processing related to issuing session keys. The published image acquisition unit 293 performs processing related to acquiring published images as captured images. The publication processing unit 294 performs processing related to publishing comments.

[0159] <Process for handling comments>

[0160] Reference Figure 11 The flowchart illustrates an example of the processes related to comment posting performed by the comment system 100. Each device in the comment system 100 enables a user to post a comment by executing the various processes shown in the flowchart.

[0161] When processing begins, in step S101, the store information registration unit 191 of the store terminal device 102 controls the communication unit 174 to provide store information (information about the store where the store is installed) to the verification server 103 via network 105, and causes the verification server 103 to register the store information. In step S131, the store ID issuance and registration unit 241 of the verification server 103 controls the communication unit 224 to receive the store information sent through the processing in step S101. Based on the control, the communication unit 224 receives the store information sent via network 105 and provides the store information to the information processing unit 211.

[0162] The store information includes location information indicating the store's location. In step S132, the store ID issuance and registration unit 241 generates a store ID as identification information associated with the location information. The store ID issuance and registration unit 241 controls the communication unit 224 to send the store ID to the store terminal device 102. Based on this control, the communication unit 224 sends the store ID provided from the information processing unit 211 to the store terminal device 102 via the network 105. Furthermore, the store ID issuance and registration unit 241 provides the store ID to the verification data storage unit 212 to store (register) the store ID.

[0163] In step S102, the store information registration unit 191 controls the communication unit 174 to receive the store ID sent through the processing in step S132. Based on the control, the communication unit 174 receives the store ID sent via network 105 and provides the store ID to the information processing unit 161. The store information registration unit 191 provides the store ID to the storage unit 173 and stores the store ID therein.

[0164] Once the store information registration is completed as described above, the imaging device 101 to the posting website server 104 performs store entry verification processing. This store entry verification processing is the process of proving that the user of the imaging device 101 has entered the store where the store terminal device 102 is installed (steps S103, S111, S121, and S133). Details of the store entry verification processing will be explained later.

[0165] From the time of entry verification to the time of exit verification, imaging is permitted using the imaging unit 112 of imaging device 101. Imaging device 101 and verification server 103 perform imaging verification processing, which involves imaging and verifying the captured image obtained through the imaging (steps S112 and S134). Details of the imaging verification process will be described later.

[0166] When a user leaves the store, the imaging device 101 to the posting website server 104 performs a departure certificate processing to prove the user's departure (steps S104, S113, S122, and S135). Details of the departure certificate processing will be explained later.

[0167] After processing the departure certificate, in step S136, the release control unit 252 of the verification server 103 controls the communication unit 224 to send control information for the release of the licensed review to the imaging device 101 via the network 105. Based on this control, the communication unit 224 sends the control information provided by the information processing unit 111 to the imaging device 101 via the network 105. In step S114, the control information acquisition unit 144 of the imaging device 101 controls the communication unit 124 to acquire the control information.

[0168] In step S137, the publishing control unit 252 of the verification server 103 controls the communication unit 224 to upload the captured image from the imaging device 101 to the verification server 103, providing it as a publishable image to the posting website server 104. In step S123, the publishing image acquisition unit 293 of the posting website server 104 controls the communication unit 274 to receive the publishable image sent from the verification server 103. Based on the control, the communication unit 274 receives the publishable image sent from the verification server 103 and provides the image to the information processing unit 261.

[0169] When posting is permitted as described above, the posting processing unit 147 of the imaging device 101 performs posting processing in step S115 and posts a comment. In response to this processing, the posting processing unit 294 of the posting website server 104 performs posting processing in step S124, accepts the posting of the comment, and posts the accepted comment. When the posting of the comment ends in this manner, the series of processes related to the posting of the comment ends.

[0170] <Process for handling entry permits>

[0171] Reference Figure 12 The flowchart is explained in Figure 11 An example of the process for processing entry verification in China.

[0172] When the entry verification process begins, in step S161, the session key request unit 141 of the imaging device 101 controls the communication unit 124 to log in to the posting website server 104 and request a session key. During login, the session key request unit 141 provides user information, which is information about the user, to the posting website server 104. The user information includes information required for login, such as the user ID and password, which serve as the user's identification information. In step S171, the request acceptance unit 291 of the posting website server 104 accepts the access, performs the login process for the imaging device 101, and receives the request.

[0173] In step S172, the session key issuance unit 292 issues a session key associated with the user ID of the logged-in user. That is, the session key issuance unit 292 generates a session key associated with the user ID and controls the communication unit 274 to provide the session key to the imaging device 101. In step S162, the session key request unit 141 of the imaging device 101 obtains the session key via the communication unit 124.

[0174] When the session key is obtained, in step S163, the QR code generation unit 142 of the imaging device 101 uses the session key to generate a QR code with an expiration time. The expiration time of the information indicated by the QR code is predetermined in this QR code. Figure 13 The diagram illustrates an example of information indicated by a QR code. For example... Figure 13 As shown in the diagram, the information indicated by QR code 301 includes user information. For example, this includes the user ID, the session key issued from the posting website server 104 through the aforementioned processing, and location information indicating the location of the imaging device 101. That is, the QR code generation unit 142 generates user information based on the condition that a session is being established with the posting website server 104, which is the destination for providing the captured image.

[0175] Of course, other information can be included. Note that location information can be omitted. However, including the location information of the imaging device 101 in the QR code improves the reliability of the entry verification.

[0176] return Figure 12 In step S163, the QR code providing unit 143 controls the display (display unit) of the output unit 122 to display an image of a QR code with an expiration time generated by the QR code generating unit 142. Then, the user places the display showing the image of the QR code with the expiration time above the reader 162 of the store terminal device 102. That is, the QR code providing unit 143 provides user information to the store terminal device 102, which is an information processing device that stores imaging location information as information indicating the imaging location (i.e., the store location).

[0177] In step S151, the QR code reading unit 192 of the store terminal device 102 controls the reader to read the QR code (i.e., the information indicated by the QR code) held above the reader 162. For example, the reader 162 uses an image sensor or the like to capture an image of the held QR code, analyzes the QR code contained in the captured image, and reads the information. The reader 162 provides the read information to the information processing unit 161 (QR code reading unit 192). As described above, user information, etc., is provided from the imaging device 101 to the store terminal device 102 by using the QR code.

[0178] In step S152, the store terminal device 102's entry verification information providing unit 193 controls the communication unit 174 to provide the verification server 103 with the QR code (information indicated by the QR code) read as described above, the store ID issued from the verification server 103, and the entry flag indicating information used to verify entry. This entry verification information is used to prove that the user has entered the store. According to this control, the communication unit 174 sends the entry verification information provided by the entry verification information providing unit 193 to the verification server 103 via network 105. In step S181, the verification server 103's entry verification information obtaining unit 242 obtains the entry verification information via the communication unit 224.

[0179] In step S182, the store entry verification unit 243 verifies whether the location information (information indicating the location of the imaging device 101) and the session key (session key issued by the posting website server 104) as information indicated by the QR code contained in the store entry verification information are valid.

[0180] For example, the store entry verification unit 243 determines whether the location information of the imaging device 101 corresponds to the location information of the store corresponding to the store ID based on the verification data stored in the verification data storage unit 212. For example, if the location information indicated by the QR code (the location information of the imaging device 101) matches the location information of the store or is close enough to the store, the store entry verification unit 243 determines that the location information indicated by the QR code is valid.

[0181] Furthermore, for example, the store entry verification unit 243 queries the posting website server 104 to inquire whether the session key indicated by the QR code is valid. If the posting website server 104 confirms that the session key is valid, it determines that the session key indicated by the QR code is valid.

[0182] If the location information indicated by the QR code and the session key are deemed valid, in step S183, the entry time recording unit 244 records the current time (which can be the time of sending or receiving the entry verification information) as the entry time in the verification data storage unit 212.

[0183] Then, in step S184, the imaging control unit 245 controls the communication unit 224 to provide control information for permitting imaging to the imaging device 101. According to this control, the communication unit 224 transmits the control information (control information for permitting imaging) provided by the imaging control unit 245 to the imaging device 101 via the network 105. In step S164, the control information acquisition unit 144 of the imaging device 101 acquires the control information via the communication unit 124.

[0184] In step S165, the imaging control unit 145 activates the dedicated application based on the control information and authorizes the imaging unit 112 to perform imaging (start authorization imaging). That is, the imaging control unit 145 initiates authorization for imaging by the imaging unit 112 based on authorization start information (control information for authorizing imaging) obtained from an external device (verification server 103) by providing user information to the information processing device (store terminal device 102). When authorization for imaging begins, the store entry verification process ends, and the process returns to normal. Figure 11 .

[0185] <Imaging Verification Process>

[0186] Reference Figure 14 The flowchart is explained in Figure 11 An example of the imaging verification process executed in the process.

[0187] When the imaging verification process begins, in step S201, the imaging control unit 145 of the imaging device 101 controls the imaging unit 112 according to the user's operation and performs imaging through a dedicated application. The user uses the imaging unit 112 of the imaging device 101 to capture images such as the landscape inside a store or the goods sold in the store. The imaging unit 112 is controlled by the dedicated application to perform imaging, generate captured images, and provide the captured images to the imaging control unit 145. The imaging control unit 145 associates information such as imaging time and imaging location as metadata with the captured images.

[0188] In step S202, the image providing unit 146 controls the communication unit 124 to provide the captured image and metadata to the verification server 103. According to this control, the communication unit 124 sends the captured image and metadata provided by the information processing unit 111 to the verification server via the network 105. In step S211, the image acquiring unit 246 of the verification server 103 acquires the captured image and metadata via the communication unit 224. Note that the provision of captured images, etc., can be performed at any time. For example, multiple captured images, etc., can be provided collectively, or captured images can be provided each time a captured image is generated.

[0189] In step S212, the image verification unit 247 verifies the captured image based on metadata and verification data stored in the verification data storage unit 212. For example, if the location information indicating the imaging location included in the metadata corresponds to the store's location information (matches or is located near the store's location information), the image verification unit 247 determines that the captured image is valid. Furthermore, if the imaging time included in the metadata is between the store entry time and the store exit time (described later), the image verification unit 247 determines that the captured image is valid. Of course, the image may also be determined to be valid only if both the imaging location and the imaging time are valid.

[0190] If the captured image is valid, in step S213, the captured image management unit 248 stores the captured image as a publishable image in the storage unit 223. When the processing in step S213 ends, the imaging verification process ends, and the process returns to normal. Figure 11 .

[0191] <Process for processing departure certificates>

[0192] Reference Figure 15 The flowchart is explained in Figure 11 An example of the process for processing departure certificates implemented in China.

[0193] When the departure verification process begins, in step S241, the session key request unit 141 of the imaging device 101 controls the communication unit 124 to request a session key from the posting website server 104. In step S251, the request acceptance unit 291 of the posting website server 104 receives the request. In step S252, the session key issuance unit 292 issues a session key associated with the user ID. In step S242, the session key request unit 141 of the imaging device 101 obtains the session key via the communication unit 124.

[0194] Upon obtaining the session key, in step S243, the QR code generation unit 142 of the imaging device 101 uses the session key to generate a QR code with an expiration time. This QR code includes the same information as in the case of store entry verification (e.g., ...). Figure 13 That is, the QR code generation unit 142 generates user information based on the condition that a session is being established with the posting website server 104, which is the destination for providing the captured image. Note that location information can be omitted. However, by including the location information of the imaging device 101 in the QR code, the reliability of the proof of departure is improved.

[0195] In step S243, the QR code providing unit 143 controls the display (display unit) of the output unit 122 to display an image of a QR code with an expiration time generated by the QR code generating unit 142. Then, the user places the display showing the image of the QR code with the expiration time above the reader 162 of the store terminal device 102. That is, the QR code providing unit 143 provides user information to the store terminal device 102, which is an information processing device that stores imaging location information as information indicating the imaging location (i.e., the store location).

[0196] In step S231, the QR code reading unit 192 of the store terminal device 102 controls the reader 162 to read the QR code (i.e., the information indicated by the QR code) held above the reader 162. The reader 162 provides the read information to the information processing unit 161 (QR code reading unit 192). As described above, user information, etc., is provided from the imaging device 101 to the store terminal device 102 by using the QR code.

[0197] In step S232, the departure verification information providing unit 194 of the store terminal device 102 controls the communication unit 174 to provide the QR code (information represented by the QR code) read as described above, the store ID issued from the verification server 103, and the departure flag (a flag indicating information used to prove that the user has left) as departure verification information to the verification server 103. The departure verification information is used to prove that the user has left the store. According to this control, the communication unit 174 sends the departure verification information provided by the departure verification information providing unit 195 to the verification server 103 via the network 105. In step S261, the departure verification information obtaining unit 249 of the verification server 103 obtains the departure verification information via the communication unit 224.

[0198] In step S262, the departure certificate information verification unit 250 verifies whether the location information (information indicating the location of the imaging device 101) is valid, which is the information indicated by the QR code contained in the departure certificate information.

[0199] For example, the departure verification unit 250 determines whether the location information of the imaging device 101 corresponds to the location information of the store corresponding to the store ID based on the verification data stored in the verification data storage unit 212. For example, if the location information indicated by the QR code (the location information of the imaging device 101) matches the location information of the store or is close enough to the store, the departure verification unit 250 determines that the location information indicated by the QR code is valid.

[0200] If the location information indicated by the QR code is deemed valid, in step S263, the departure time recording unit 215 records the current time (which can be the time of sending or receiving the departure certificate information) as the departure time in the verification data storage unit 212.

[0201] Then, in step S264, the imaging control unit 245 controls the communication unit 224 to provide control information for terminating imaging permission to the imaging device 101. According to this control, the communication unit 224 transmits the control information (control information for terminating imaging permission) provided by the imaging control unit 245 to the imaging device 101 via the network 105. In step S244, the control information acquisition unit 144 of the imaging device 101 acquires the control information via the communication unit 124.

[0202] In step S245, the imaging control unit 145 terminates the dedicated application based on the control information and terminates the imaging permission of the imaging unit 112. That is, the imaging control unit 145 stops (terminates) the imaging permission of the imaging unit 112 based on the permission stop information (control information for terminating the imaging permission) obtained from the external device (verification server 103) by providing user information to the information processing device (store terminal device 102). When the imaging permission is terminated, the departure certificate processing ends, and the process returns to normal. Figure 11 .

[0203] By performing the processes described above, the user's entry and exit times are verified, thus allowing imaging to take place during the time between these times. That is, it is guaranteed that the image is captured between the entry and exit times. Furthermore, since location information ensures that the imaging device 101 is located within the store from the entry to the exit time, it is guaranteed that the image is captured by a user who actually visited the store while inside the store.

[0204] Therefore, the posting of fictitious comments can be suppressed, and the decrease in the reliability of comments can be prevented. That is, it is possible to suppress the decrease in the reliability of the posting website's service.

[0205] <Release Processing>

[0206] exist Figure 11 In steps S115 and S124 of the publishing process, the posting website server 104 presents a list of images that can be published to the imaging device 101. The user of the imaging device 101 selects the desired image from the list and enters a comment. When the imaging device 101 uploads the selection information and comment to the posting website server 104, the posting website server 104 associates the uploaded comment with the selected image based on the selection information. Then, the posting website server 104 publishes the associated comment and the image.

[0207] At this time, the imaging device 101 displays a comment screen and receives user operations, the comment screen being displayed on the monitor (display unit) of the output unit 122. Figure 16 The diagram illustrates an example of a comment screen display. A comment screen is a graphical user interface (GUI) used to receive user instructions on posting comments.

[0208] First, the output processing unit 147 of the imaging device 101 displays on the monitor. Figure 16The comment screen 311 is located on the right. For example, comment screen 311 displays a list of stores that the user can comment on. That is, comment screen 311 displays a list of stores the user has actually visited. For example, after visiting store C (when store C undergoes departure verification), store C is added to the store list, as shown on comment screen 312. The user can then select store C as the object of their comment. That is, they can post a comment on store C.

[0209] For example, when an action is performed to select store C (e.g., click), the publishing processing unit 147 of the imaging device 101 displays a review screen 313 on the monitor. The review screen 313 is a screen used to create a review for store C. Figure 16 As shown in the diagram, the comment screen 313 is equipped with a comment input field 321 for writing comments, an image selection field 322 for selecting images to be captured, and a send button 323 for instructing the upload of comments.

[0210] In the image selection bar 322, various publishable images are displayed as icons 331. Additionally, an upload button 332 is displayed to confirm the image selection. When a user selects the icon 331 corresponding to the desired image in the image selection bar 322 and presses the upload button 332, the captured image for commenting is specified. The publishing processing unit 147 of the imaging device 101 displays a comment screen 314 on the monitor. On the comment screen 314, the icons 331 corresponding to the captured images selected by the user are displayed in a different mode than the icons 331 corresponding to captured images not selected by the user, in order to distinguish the icons.

[0211] When a user writes a comment in the comment input field 321, selects a captured image in the image selection field 322 as described above, and then presses the send button 323, the posting processing unit 147 uploads the input comment and the captured image selection information to the posting website server 104.

[0212] By using such a comment screen, users can easily post comments using valid captured images.

[0213] <Situation where only entry certificate processing is performed>

[0214] Note that, in the above-described processes of entering and leaving the store, only the entry verification process may be performed. In this case, for example, as shown... Figure 17 As shown in diagram A, an entry certificate can be processed to permit imaging for a predetermined period starting from the entry time (time X).

[0215] That is, the imaging control unit 145 can permit imaging by the imaging unit 112 within a validity period, the validity period being indicated by the validity period information of the captured image obtained from an external device (e.g., verification server 103) by providing user information (e.g., QR code) to an information processing device (e.g., store terminal device 102). For example, the control information acquisition unit 144 can obtain the validity period information of the captured image indicating a predetermined validity period after the provision of user information from the external device (e.g., verification server 103), and the imaging control unit 145 can permit imaging within the specified validity period based on the captured image validity period information.

[0216] This eliminates the need for proof of departure and makes it easier to suppress the decline in the reliability of reviews.

[0217] <Cases where only a departure certificate is processed>

[0218] Note that, in the above-described processes of entry and exit verification, only the exit verification process may be performed. In this case, for example, as follows: Figure 17 As shown in diagram B, the release of captured images generated within a predetermined validity period up to the time of departure (time Y) can be permitted through departure certificate processing.

[0219] That is, imaging can always be permitted, and the publishing processing unit 147 can provide user information (e.g., QR code) to the information processing device (e.g., store terminal device 102) to permit the publishing of images taken within the validity period indicated by the image validity period information obtained from an external device (e.g., verification server 103). For example, the control information acquisition unit 144 can obtain image validity period information indicating a predetermined validity period before providing user information from an external device (e.g., verification server 103), and the publishing processing unit 147 can permit the publishing of images taken within the specified validity period based on the image validity period information.

[0220] This eliminates the need for proof of entry to the store, making it easier to prevent a decrease in the reliability of reviews.

[0221] <3. Second Embodiment>

[0222] <Store Information Transmission>

[0223] In the first embodiment, it was described that user information was provided from imaging device 101 to store terminal device 102 using a QR code in the entry verification and exit verification processes. However, it can be changed to provide store information from store terminal device 102 to imaging device 101 using a QR code. That is, in the entry verification process of the first embodiment, store terminal device 102 provides entry verification information to verification server 103, but in this embodiment, imaging device 101 provides entry verification information to verification server 103. Similarly, in the exit verification process of the first embodiment, store terminal device 102 provides exit verification information to verification server 103, but in this embodiment, imaging device 101 provides exit verification information to verification server 103.

[0224] For example, in an information processing system (e.g., a comment system 100) including an image processing device (e.g., an imaging device 101), a first information processing device (e.g., a store terminal device 102), and a second information processing device (e.g., a verification server 103), the image processing device may include: an acquisition control unit that, conditioned on establishing a session with a destination providing the captured image (e.g., a posting website server 104), authorizes the acquisition of imaging location information based on authorization information obtained from the destination; and an imaging location information acquisition unit that, in a state authorized by the acquisition control unit, acquires information provided by the first information processing device. The first information processing device may include: an imaging location information generation unit that generates imaging location information based on the condition that a session is being established with a destination providing the captured image; and an imaging location information providing unit that provides the imaging location information and user information acquired by the imaging location information acquisition unit to a second information processing device; an image validity period information acquisition unit that acquires image validity period information provided by the second information processing device that corresponds to the imaging location information and user information provided by the imaging location information acquisition unit; and an imaging control unit that authorizes the imaging unit to perform imaging within the validity period indicated by the image validity period information acquired by the image validity period information acquisition unit. The second information processing device may include: an imaging location information and user information acquisition unit, which acquires imaging location information and user information provided by an image processing device; a verification unit, which verifies the imaging location information and user information acquired by the imaging location information and user information acquisition unit; and a captured image validity period information providing unit, which provides captured image validity period information corresponding to the imaging location information and user information to the image processing device when the imaging location information and user information are determined to be valid through verification by the verification unit.

[0225] Functional blocks of imaging equipment

[0226] Figure 18 The functions implemented by the information processing unit 111 of the imaging device 101 executing the application program in this case are illustrated in the form of function blocks. For example... Figure 18As shown in the diagram, by executing the application, the information processing unit 111, as a functional block, may include a reader control unit 341, a QR code reading unit 342, an entry certificate information providing unit 343, a control information acquisition unit 144, an imaging control unit 145, an exit certificate information providing unit 344, and a release processing unit 147.

[0227] The reader control unit 341 performs processing related to the control of the reader. In this case, the imaging device 101 can use the imaging unit 112 as a QR code reader. The reader control unit 341 performs processing related to the control of the imaging unit 112.

[0228] The QR code reading unit 342 performs processing related to reading QR codes. The store entry verification information providing unit 343 performs processing related to providing store entry verification information, which is used to prove that a user has entered the store. The store exit verification information providing unit 344 performs processing related to providing store exit verification information, which is used to prove that a user has left the store.

[0229] <Functional Blocks of Store Terminal Equipment>

[0230] Figure 19 The functions implemented by the information processing unit 161 of the store terminal device 102 executing the application are illustrated in the form of function blocks. For example... Figure 19 As shown in the diagram, by executing the application, the information processing unit 161, as a functional block, may include a store information registration unit 191, a session key request unit 351, a QR code generation unit 352, and a QR code providing unit 353.

[0231] The session key request unit 351 performs processing related to requesting a session key. The QR code generation unit 352 performs processing related to generating a QR code. The QR code providing unit 353 performs processing related to providing a QR code.

[0232] <Functional blocks of the posting website server>

[0233] Figure 20 The functions implemented by the information processing unit 211 of the posting website server 104 executing the application are illustrated in the form of functional blocks. For example... Figure 20 As shown in the diagram, by executing the application, the information processing unit 261, as a functional block, may include a request acceptance unit 291, a session key issuance unit 292, a reader control unit 361, a published image acquisition unit 293, and a published processing unit 294.

[0234] The reader control unit 361 performs processing related to the control of the reader (imaging unit 112) of the imaging device 101.

[0235] <Process for handling entry permits>

[0236] In this case, the situation is the same as that of the first embodiment ( Figure 11 A similar process is executed, involving comment posting related processing performed by the comment system 100. Furthermore, the process is also similar to that in the first embodiment (…). Figure 13 A similar process is used to perform the imaging verification processing within it.

[0237] Reference Figure 21 and Figure 22 The flowchart below illustrates an example of the process for processing entry verification in this situation.

[0238] When the process of obtaining proof of entry to the store begins, Figure 21 In step S301, the session key request unit 351 of the store terminal device 102 controls the communication unit 174 to request a session key from the posting website server 104. At this time, the session key request unit 351 provides store information, i.e., information about the store, to the posting website server 104. The store information includes, for example, the store ID, which serves as the store's identification information. As described in the first embodiment, the store ID is associated with the store's location information through the verification server 103. That is, the store ID can also be referred to as the store's location information. Thus, this store information can also be described as location information indicating the store's location (in other words, the imaging location). In step S321, the request acceptance unit 291 of the posting website server 104 accepts the request.

[0239] In step S322, the session key issuing unit 292 issues a session key associated with the provided store ID. That is, the session key issuing unit 292 generates a session key associated with the store ID and controls the communication unit 274 to provide the session key to the store terminal device 102. In step S302, the session key requesting unit 351 of the store terminal device 102 obtains the session key via the communication unit 174.

[0240] Furthermore, in step S311, the reader control unit 341 of the imaging device 101 controls the communication unit 124 to log in to the posting website server 104 and requests permission to start the reader. During login, the reader control unit 341 provides user information (i.e., information about the user) to the posting website server 104. The user information includes information required for login, such as the user ID and password as user identification information. In step S323, the request acceptance unit 291 of the posting website server 104 accepts the access, performs login processing for the imaging device 101, and receives the request.

[0241] In step S324, the reader control unit 361 authorizes the activation of the reader. That is, the reader control unit 361 controls the communication unit 274 to provide control information for authorizing the activation of the reader to the imaging device 101. In step S312, the reader control unit 341 of the imaging device 101 obtains this control information via the communication unit 124. In step S313, the reader control unit 341 activates an application using the imaging unit 112 as a QR code reader based on the control information. This application uses the imaging unit 112 as a reader. That is, the acquisition of imaging location information (store information) is authorized based on authorization information obtained from the providing destination (control information for authorizing the activation of the reader) conditioned on the establishment of a session with the image-providing destination (e.g., posting website server 104).

[0242] When the session key is obtained in the store terminal device 102, in step S303, the QR code generation unit 352 uses the session key to generate a QR code with an expiration time. Figure 23 Figure A illustrates an example of information indicated by a QR code. For example... Figure 23 As illustrated in Figure A, the information indicated by QR code 371 includes store information. For example, this includes the store ID, the session key issued from the posting website server 104 through the aforementioned processing, and an entry marker. Of course, it may include other information as well. That is, QR code generation unit 352 generates store information based on the condition that a session is being established with the posting website server 104, which is the destination for providing the captured image.

[0243] return Figure 21 In step S303, the QR code providing unit 353 controls the display (display unit) of the output unit 172 to display an image of a QR code with an expiration time generated by the QR code generating unit 352. The user places the reader (imaging unit 112) of the imaging device 101 above the display of the store terminal device 102 that displays the image of the QR code with the expiration time. That is, the QR code providing unit 353 provides store information to the imaging device 101.

[0244] In step S314, the QR code reading unit 342 of the imaging device 101 controls the imaging unit 112 to read the QR code (i.e., the information indicated by the QR code) displayed on the screen of the store terminal device 102. The imaging unit 112 captures an image of the QR code displayed on the screen of the store terminal device 102, analyzes the QR code contained in the captured image, and reads the information. The imaging unit 112 provides the read information to the information processing unit 111 (QR code reading unit 342). As described above, store information, etc., is provided from the store terminal device 102 to the imaging device 101 by using the QR code.

[0245] In step S315, the entry verification information providing unit 343 of the imaging device 101 controls the communication unit 124 to provide the QR code (information indicated by the QR code) and user information read as described above to the verification server 103 as entry verification information. Note that the user information includes the user ID and the location information of the imaging device 101. According to the control, the communication unit 124 sends the entry verification information provided by the entry verification information providing unit 343 to the verification server 103 via the network 105. In step S331, the entry verification information obtaining unit 242 of the verification server 103 obtains the entry verification information via the communication unit 224.

[0246] exist Figure 22 In step S351, the store entry verification unit 243 verifies whether the location information of the imaging device 101 included in the store entry verification information is valid. For example, if the location information of the imaging device 101 matches the location information corresponding to the store ID indicated by the QR code or is close enough to the store ID, the store entry verification unit 243 determines that the location information of the imaging device 101 is valid.

[0247] If the location information of the imaging device 101 is determined to be valid, in step S352, the entry time recording unit 244 records the current time (which may be the time of sending or receiving the entry certificate information) as the entry time in the verification data storage unit 212.

[0248] Then, in step S353, the imaging control unit 245 controls the communication unit 224 to provide control information for permitting imaging to the imaging device 101. According to this control, the communication unit 224 transmits the control information (control information for permitting imaging) provided by the imaging control unit 245 to the imaging device 101 via the network 105. In step S341, the control information acquisition unit 144 of the imaging device 101 acquires the control information via the communication unit 124.

[0249] In step S342, the imaging control unit 145 starts the dedicated application based on the control information and authorizes the use of the imaging unit 112 for imaging (initiation of imaging authorization). When imaging authorization is granted, the entry verification process ends and returns to normal. Figure 11 .

[0250] <Process for processing departure certificates>

[0251] Reference Figure 24 and Figure 25 The flowchart illustrates an example of the process for processing departure certificates in this situation.

[0252] When processing the check-out certificate begins, Figure 24In step S361, the session key request unit 351 of the store terminal device 102 controls the communication unit 174 to request a session key from the posting website server 104. At this time, the session key request unit 351 provides store information, i.e., information about the store, to the posting website server 104. The store information includes, for example, the store ID, which serves as the store's identification information. In step S381, the request receiving unit 291 of the posting website server 104 receives the request.

[0253] In step S382, the session key issuing unit 292 issues a session key associated with the provided store ID. That is, the session key issuing unit 292 generates a session key associated with the store ID and controls the communication unit 274 to provide the session key to the store terminal device 102. In step S362, the session key requesting unit 351 of the store terminal device 102 obtains the session key via the communication unit 174.

[0254] Furthermore, in step S371, the reader control unit 341 of the imaging device 101 controls the communication unit 124 to request the posting website server 104 to start the reader. In step S383, the request receiving unit 291 of the posting website server 104 accepts the request.

[0255] In step S384, the reader control unit 361 authorizes the reader's startup. That is, the reader control unit 361 controls the communication unit 274 to provide control information for authorizing the reader's startup to the imaging device 101. In step S372, the reader control unit 341 of the imaging device 101 obtains this control information via the communication unit 124. In step S373, based on the control information, the reader control unit 341 starts an application that uses the imaging unit 112 as a QR code reader. This application uses the imaging unit 112 as a reader.

[0256] When the session key is obtained in the store terminal device 102, in step S363, the QR code generation unit 352 uses the session key to generate a QR code with an expiration time. Figure 23 The diagram in section B illustrates an example of information indicated by a QR code. For example... Figure 23 As shown in Figure B, the information indicated by QR code 372 includes store information. For example, this includes the store ID, the session key issued from the posting website server 104 through the aforementioned processing, and a departure indicator. Of course, other information may also be included. That is, QR code generation unit 352 generates store information based on the condition that a session is being established with the posting website server 104, which is the destination for the captured image.

[0257] return Figure 24In step S363, the QR code providing unit 353 controls the display (display unit) of the output unit 172 to display an image of a QR code with an expiration time generated by the QR code generating unit 352. The user places the reader (imaging unit 112) of the imaging device 101 above the display of the store terminal device 102 that displays the image of the QR code with the expiration time. That is, the QR code providing unit 353 provides store information to the imaging device 101.

[0258] In step S374, the QR code reading unit 342 of the imaging device 101 controls the imaging unit 112 to read the QR code (i.e., the information indicated by the QR code) displayed on the screen of the store terminal device 102. The imaging unit 112 captures an image of the QR code displayed on the screen of the store terminal device 102, analyzes the QR code contained in the captured image, and reads the information. The imaging unit 112 provides the read information to the information processing unit 111 (QR code reading unit 342). As described above, store information, etc., is provided from the store terminal device 102 to the imaging device 101 by using the QR code.

[0259] In step S375, the departure verification information providing unit 344 of the imaging device 101 controls the communication unit 124 to provide the QR code (information indicated by the QR code) and user information, read as described above, to the verification server 103 as departure verification information. Note that the user information includes the user ID and the location information of the imaging device 101. According to the control, the communication unit 124 sends the departure verification information provided by the departure verification information providing unit 344 to the verification server 103 via network 105. In step S391, the departure verification information obtaining unit 249 of the verification server 103 obtains the departure verification information via the communication unit 224.

[0260] exist Figure 25 In step S411, the departure verification information verification unit 250 verifies whether the location information of the imaging device 101 included in the departure verification information is valid. For example, if the location information of the imaging device 101 matches the location information corresponding to the store ID indicated by the QR code or is close enough to the store ID, the departure verification information verification unit 250 determines that the location information of the imaging device 101 is valid.

[0261] If the location information of the imaging device 101 is determined to be valid, in step S412, the departure time recording unit 251 records the current time (which may be the time of sending or receiving the entry certificate information) as the departure time in the verification data storage unit 212.

[0262] Then, in step S413, the imaging control unit 245 controls the communication unit 224 to provide control information for terminating imaging permission to the imaging device 101. According to this control, the communication unit 224 transmits the control information (control information for terminating imaging permission) provided by the imaging control unit 245 to the imaging device 101 via the network 105. In step S401, the control information acquisition unit 144 of the imaging device 101 acquires the control information via the communication unit 124.

[0263] In step S402, the imaging control unit 145 terminates the dedicated application based on control information and terminates imaging using the imaging unit 112 (termination of imaging permission). When the imaging permission is terminated, the departure certificate processing ends, and the process returns. Figure 11 .

[0264] By performing the various processes in this manner, similar to the first embodiment, the posting of fictitious comments can be suppressed, and the decrease in the reliability of the comments can be prevented. That is, it is possible to suppress the decrease in the reliability of the posting website's service.

[0265] <Situation where only entry certificate processing is performed>

[0266] Note that, similarly to the first embodiment, in the same case, only the entry verification process can be performed in the entry verification process and exit verification process described above. For example, as... Figure 17 As shown in diagram A, an entry certificate can be processed to permit imaging for a predetermined period starting from the entry time (time X).

[0267] That is, the imaging control unit 145 can permit imaging by the imaging unit 112 within a validity period, the validity period being indicated by the validity period information of the captured image obtained from an external device by providing imaging location information and user information to an external device (e.g., verification server 103). For example, when the store entry verification information providing unit 343 provides imaging location information and user information to an external device, the control information acquisition unit 144 can obtain the validity period information of the captured image indicating the validity period after the provision of user information from the external device, and the imaging control unit 145 can permit imaging within the specified validity period based on the captured image validity period information.

[0268] This eliminates the need for proof of departure, making it easier to prevent a decrease in the reliability of reviews.

[0269] <Cases where only a departure certificate is processed>

[0270] Furthermore, similar to the first embodiment, in the same situation, between the entry verification processing and exit verification processing described above, only the exit verification processing can be performed. For example, as... Figure 17 As shown in diagram B, the release of captured images generated within a predetermined validity period up to the time of departure (time Y) can be permitted through departure certificate processing.

[0271] That is, imaging can always be permitted, and the publishing processing unit 147 can provide imaging location information and user information to an external device (e.g., verification server 103) to permit the publishing of images taken within the validity period indicated by the image validity period information obtained from the external device. For example, when the departure certificate information providing unit 344 provides imaging location information and user information to an external device, the control information acquisition unit 144 can obtain image validity period information indicating the validity period prior to the provision of user information from the external device, and the imaging control unit 145 can permit imaging within the specified validity period based on the image validity period information.

[0272] This eliminates the need for proof of entry to the store, making it easier to prevent a decrease in the reliability of reviews.

[0273] <4. Third Embodiment>

[0274] Imaging using registered imaging equipment

[0275] In the first and second embodiments, it was described that the imaging device 101 performs entry verification processing, exit verification processing, etc. However, such processing can be performed by devices other than the imaging device. In this case, information about the imaging device can be registered in the review system 100 (verification server 103, etc.). When the imaging device has been registered, similar to the first and second embodiments, the identification information of the imaging device is used to ensure image capture (i.e., to perform entry verification processing and exit verification processing).

[0276] <Comment System>

[0277] Figure 26 The diagram illustrates a key component example of a comment system in this scenario. Figure 26 The comment system 400 shown in the diagram is similar to comment system 100. Figure 2 The comment system 400 includes a user terminal device 401 and an imaging device 402, instead of an imaging device 101. The user terminal device 401 and the imaging device 402 are image processing devices owned by the user who posts the comment.

[0278] Similar to imaging device 101, user terminal device 401 has communication capabilities, which can be used to communicate with various devices among store terminal device 102 to posting website server 104 via network 105. Furthermore, user terminal device 401 can exchange information with store terminal device 102 using QR codes. For example, user terminal device 401 has a display function, capable of displaying QR codes, etc. Additionally, user terminal device 401 may have a QR code reader function, capable of reading QR code information. User terminal device 401 has communication capabilities, can communicate with imaging device 402, and can exchange information (e.g., captured images, control information, etc.).

[0279] Imaging device 402 has imaging capabilities and can generate captured images by imaging a subject. Furthermore, imaging device 402 has communication capabilities, enabling it to communicate with user terminal device 401 and exchange information (e.g., captured images, control information, etc.).

[0280] In the review system 400, user terminal device 401 and the like perform entry and exit verification processing, and based on these processes, allow imaging device 402 to capture images from the time the user enters the store until they leave. Furthermore, user terminal device 401 provides user information to store terminal device 102 using a QR code. Store terminal device 102 uses this user information and location information indicating the store's location to perform entry and exit verification processing.

[0281] This process ensures that users take photos and generate images within the store before actually entering and leaving.

[0282] <User terminal equipment>

[0283] Figure 27 This is an illustration showing an example of the main components of a user terminal device 401, which is an embodiment of an image processing apparatus to which this technology is applied. For example... Figure 27 As shown in the diagram, the user terminal device 401 includes an information processing unit 411, an input unit 421, an output unit 422, a storage unit 423, a communication unit 424, and a driver 425.

[0284] The information processing unit 411 is, for example, a computer that includes a CPU, ROM, RAM, etc., and can perform various functions by executing application programs (software) using the CPU, ROM, RAM, etc. For example, the information processing unit 411 can install and execute application programs (software) that perform processing related to the publication of comments.

[0285] The input unit 421 includes, for example, input devices such as a keyboard, mouse, microphone, touch panel and input terminals, and can provide information input via these input devices to the information processing unit 411.

[0286] The output unit 422 includes, for example, output devices such as a display (display unit), a speaker (audio output unit), and output terminals, and can output information provided from the information processing unit 411 via these output devices.

[0287] Storage unit 423 may include, for example, a storage medium such as a hard disk, RAM disk, or non-volatile memory, and may store information provided from information processing unit 411 in the storage medium. Storage unit 423 may read information stored in the storage medium and provide that information to information processing unit 411.

[0288] The communication unit 424 includes, for example, a network interface, which can receive information sent from other devices via the network 105 and provide the received information to the information processing unit 411. The communication unit 424 can send information provided by the information processing unit 411 to other devices via the network 105.

[0289] The drive 425 has an interface to a removable recording medium 431, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and can read information recorded on the removable recording medium 431 attached to the drive 425 and provide that information to the information processing unit 411. The drive 425 can record information provided from the information processing unit 411 into the writable removable recording medium 431 attached to the drive 425.

[0290] For example, the information processing unit 411 loads and executes an application program stored in the storage unit 423. At this time, the information processing unit 411 may appropriately store data, etc., required for performing various processes. The application program, data, etc., can be provided, for example, by recording on a removable recording medium 431, such as a package medium. In this case, the application program, data, etc., are read by a drive 425 attached to the removable recording medium 431 and installed in the storage unit 423 via the information processing unit 411. Furthermore, the application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In this case, the application program, data, etc., are received by a communication unit 424 and installed in the storage unit 423 via the information processing unit 411. Additionally, the application program, data, etc., can be pre-installed in a ROM or storage unit 423 within the information processing unit 411.

[0291] <Functional blocks of user terminal equipment>

[0292] Figure 28 The diagram illustrates the functions implemented by the information processing unit 411 through the execution of the application program as a functional block. For example... Figure 28 As shown in the diagram, by executing the application program, the information processing unit 411, as a functional block, may include an imaging device registration unit 441, a session key request unit 442, a QR code generation unit 443, a QR code providing unit 444, a control information acquisition unit 445, an imaging control unit 446, a captured image acquisition unit 447 with electronic signature, a captured image providing unit 448 with electronic signature, and a publishing processing unit 449.

[0293] Imaging device registration unit 441 performs processing related to the registration of imaging device 402. Session key request unit 442 performs processing related to requesting a session key. QR code generation unit 443 performs processing related to generating a QR code. QR code providing unit 444 performs processing related to providing a QR code. Control information acquisition unit 445 performs processing related to acquiring control information. Imaging control unit 446 performs processing related to controlling imaging unit 112. Electronically signed image acquisition unit 447 performs processing related to acquiring an electronically signed image. Electronically signed image providing unit 448 performs processing related to providing an electronically signed image. Publishing processing unit 449 performs processing related to publishing comments.

[0294] Functional blocks of imaging equipment

[0295] Imaging device 402 has a similar configuration to imaging device 101. That is, referring to... Figure 3 The configuration described can also be applied to imaging device 402.

[0296] Figure 29 The functions implemented by the information processing unit 111 of the imaging device 402 through the execution of the application program are illustrated in the form of function blocks. For example... Figure 29 As shown in the diagram, by executing the application, the information processing unit 111, as a functional block, may include an imaging processing unit 451, a metadata adding unit 452, an electronic signature adding unit 453, and a captured image providing unit 454 with an electronic signature.

[0297] Imaging processing unit 451 performs imaging-related processing. Metadata adding unit 452 performs processing related to adding (associating) metadata to the captured image. Electronic signature adding unit 453 performs processing related to adding (associating) an electronic signature to the captured image and metadata. Electronically signed captured image providing unit 454 performs processing related to providing the electronically signed captured image.

[0298] <Function block for verifying the server>

[0299] The store terminal device 102 and the posting website server 104 each have a similar configuration to those in the first and second embodiments, and are able to perform similar functions (have similar functional blocks).

[0300] Figure 30 The diagram illustrates the functions implemented as functional blocks by the information processing unit 211 of the verification server 103 executing the application. For example... Figure 30 As shown in the diagram, by executing the application, the information processing unit 211, as a functional block, may include a store ID issuance and registration unit 241, an imaging device registration unit 461, an entry certificate information acquisition unit 242, an entry certificate information verification unit 243, an entry time recording unit 244, an imaging control unit 245, a departure certificate information acquisition unit 249, a departure certificate information verification unit 250, a departure time recording unit 251, a captured image acquisition unit 462 with an electronic signature, a captured image verification unit 463 with an electronic signature, a captured image providing unit 464, and a release control unit 252.

[0301] Imaging device registration unit 461 performs processing related to the registration of imaging device 402. Image acquisition unit 462 with electronic signature performs processing related to acquiring images with electronic signature. Image verification unit 463 with electronic signature performs processing related to verifying images with electronic signature. Image provision unit 464 performs processing related to providing images.

[0302] <Process for handling comments>

[0303] Reference Figure 31 and Figure 32 The flowchart illustrates an example of the processes related to comment posting performed by the comment system 400. Each device in the comment system 400 enables a user to post a comment by executing the various processes shown in the flowchart.

[0304] When processing begins, the registration of stores (store information) is performed. Figure 31In step S501, the store information registration unit 191 of the store terminal device 102 controls the communication unit 174 to provide store information (information about the store where the store terminal device 102 is installed) to the verification server 103 via the network 105, and causes the verification server 103 to register the store information. In step S541, the store ID issuance and registration unit 241 of the verification server 103 controls the communication unit 224 to receive the store information sent through the processing in step S501. The communication unit 224 receives the store information sent via the network 105 based on the control and provides the store information to the information processing unit 211.

[0305] The store information includes location information indicating the store's location. In step S542, the store ID issuance and registration unit 241 generates a store ID as identification information associated with the location information. The store ID issuance and registration unit 241 controls the communication unit 224 to send the store ID to the store terminal device 102. Based on this control, the communication unit 224 sends the store ID provided from the information processing unit 211 to the store terminal device 102 via the network 105. Furthermore, the store ID issuance and registration unit 241 provides the store ID to the verification data storage unit 212 to store (register) the store ID.

[0306] In step S502, the store information registration unit 191 controls the communication unit 174 to receive the store ID sent through the processing in step S542. Based on the control, the communication unit 174 receives the store ID sent via network 105 and provides the store ID to the information processing unit 161. The store information registration unit 191 provides the store ID to the storage unit 173 and stores the store ID therein.

[0307] Next, the registration of imaging device 402 is performed. In step S511, the imaging device registration unit 441 of the user terminal device 401 controls the communication unit 424 to provide the imaging device ID, which serves as the identification information of the imaging device 402, to the verification server 103. In step S543, the imaging device registration unit 461 of the verification server 103 obtains the imaging device ID via the communication unit 224 and stores the imaging device ID in association with the user ID in the verification data storage unit 212 (registering the imaging device ID).

[0308] When imaging device 402 is registered, store terminal device 102, posting website server 104, and user terminal device 401 perform entry verification processing (steps S503, S512, S531, and S544). This entry verification processing follows a similar procedure to the first embodiment. Figure 12 However, the processing performed by the imaging device 101 is performed by the user terminal device 401.

[0309] When the store entry certificate processing is completed, the user terminal device 401 and the imaging device 402 perform imaging processing to capture images of the store and generate captured images (steps S513 and S521).

[0310] When a user leaves the store, the store terminal device 102, the posting website server 104, and the user terminal device 401 perform departure verification processing (steps S504, S514, S532, and S545). This departure verification processing follows a similar procedure to that in the first embodiment. Figure 15 However, the processing performed by the imaging device 101 is performed by the user terminal device 401.

[0311] After processing the check-out certificate, upload the photos you took. Figure 32 In step S571, the image acquisition unit 462 with electronic signature of the verification server 103 controls the communication unit 224 to provide control information for license issuance to the user terminal device 401. In step S551, the image delivery unit 448 with electronic signature of the user terminal device 401 obtains the control information via the communication unit 424.

[0312] In step S552, the image providing unit 448 with an electronic signature provides (uploads) the image with an electronic signature acquired from the imaging device 402 to the verification server 103 based on the permission control communication unit 424. In step S572, the image acquiring unit 462 with an electronic signature of the verification server 103 acquires the image with an electronic signature sent from the user terminal device 401 via the communication unit 224. Because of the added electronic signature, forgery of the captured image is suppressed.

[0313] In step S573, the image verification unit 463 with electronic signature verifies the location information indicating the imaging location, the imaging time, and the imaging device ID, which serves as the identifier of the imaging device 402 that generated the image, contained in the metadata of the acquired image with electronic signature, by using the verification data stored in the verification data storage unit 212.

[0314] If the imaging device ID is the registered ID, the imaging location corresponds to the store's location, and the imaging time falls between the store entry and exit times, the image verification unit 463 with an electronic signature determines that the captured image is valid. If the captured image is determined to be valid, in step S574, the image providing unit 464 controls the communication unit 224 to provide the captured image as a publishable image to the posting website server 104. In step S561, the image acquisition unit 293 of the posting website server 104 acquires the captured image via the communication unit 274. Note that an electronic signature can be added to the captured image.

[0315] In step S553, the publishing processing unit 449 of the user terminal device 401 performs publishing processing to publish a comment. In response to this processing, the publishing processing unit 294 of the posting website server 104 performs publishing processing in step S562, accepting the publication of the comment and publishing the accepted comment. When the comment publication ends in this manner, the series of processes related to the comment publication ends.

[0316] <Image Processing Flow>

[0317] Reference Figure 33 The flowchart is explained in Figure 31 An example of the imaging processing flow performed in the process.

[0318] When imaging processing begins, in step S581, the imaging control unit 446 of the user terminal device 401 controls the communication unit 424 and provides control information to the imaging device 402, thereby initiating imaging permission. In step S591, the imaging processing unit 451 of the imaging device 402 obtains the control information via the communication unit 124.

[0319] In step S592, the imaging processing unit 451 of the imaging device 402 uses the imaging unit 112 to perform imaging according to the user's operation. The user uses the imaging unit 112 of the imaging device 402 to take pictures of, for example, the scenery inside a store, or the goods sold in the store. The imaging unit 112 images the subject to generate a captured image and provides the captured image to the imaging processing unit 451.

[0320] In step S593, the metadata adding unit 452 adds (associates) information such as imaging time and imaging location as metadata to the captured image. Figure 34 The diagram illustrates an example of information contained in metadata. Figure 34The metadata 471 shown in the diagram includes the imaging device ID, which serves as identification information for the imaging device 402 that performed the imaging, location information indicating the imaging location (the location of the imaging device 402), and the imaging time. Of course, the metadata may include other information as well. In step S594, the electronic signature adding unit 453 generates an electronic signature of the captured image and the metadata, and adds (associates) the electronic signature to the captured image.

[0321] In step S595, the image providing unit 454 with electronic signature controls the communication unit 124 to provide the image (image + metadata + electronic signature) with electronic signature generated as described above to the user terminal device 401. In step S582, the image acquiring unit 447 with electronic signature of the user terminal device 401 acquires the image with electronic signature via the communication unit 424. In step S583, the image acquiring unit 447 with electronic signature stores the acquired image with electronic signature in the storage unit 423.

[0322] In step S584, the imaging control unit 446 controls the communication unit 424 to provide control information for terminating imaging permission to the imaging device 402. In step S596, the imaging processing unit 451 of the imaging device 402 obtains the control information via the communication unit 124. The imaging processing unit 451 terminates imaging based on the obtained control information. When imaging ends, the imaging process ends and returns to normal. Figure 31 .

[0323] By performing the various processes as described above, even when imaging is performed using the registered imaging device 402, it is possible to perform store entry verification processing and store exit verification processing in a manner similar to that in the first embodiment, thereby ensuring that the captured images are taken by users who actually visited the store while the store was in the store.

[0324] Therefore, the posting of fictitious comments can be suppressed, and the decrease in the reliability of comments can be prevented. That is, it is possible to suppress the decrease in the reliability of the posting website's service.

[0325] <Situation where only entry certificate processing is performed>

[0326] Furthermore, in this embodiment, similar to the first embodiment, only the entry verification process can be performed between the entry verification process and the exit verification process. In this case, for example, as... Figure 17 As illustrated in diagram A, an entry verification process can be used to permit imaging for a predetermined validity period starting from the entry time (time X). This eliminates the need for an exit verification process, making it easier to mitigate the decrease in the reliability of reviews.

[0327] <Cases where only a departure certificate is processed>

[0328] Furthermore, in this embodiment, similar to the first embodiment, only the departure verification process can be performed between the entry verification processing and the departure verification processing. In this case, for example, as... Figure 17 As illustrated in diagram B, exit verification can be used to permit the publication of images taken within a predetermined validity period up to the exit time (time Y). This eliminates the need for entry verification, making it easier to suppress the deterioration of review reliability.

[0329] <Store Information Transmission>

[0330] Similar to the second embodiment, in the processing of entry and exit verification, a QR code can be used to provide store information from the store terminal device 102 to the user terminal device 401. In this case, the user terminal device 401 provides entry and exit verification information to the verification server 103.

[0331] <Functional blocks of user terminal equipment>

[0332] Figure 35 The functions implemented by the information processing unit 411 of the user terminal device 401 executing the application program in this case are illustrated in the form of function blocks. For example... Figure 35 As shown in the diagram, by executing the application, the information processing unit 411, as a functional block, may include an imaging device registration unit 441, a reader control unit 481, a QR code reading unit 482, an entry certificate information providing unit 483, a control information acquisition unit 445, an imaging control unit 446, a captured image acquisition unit 447 with electronic signature, an exit certificate information providing unit 484, a captured image providing unit 448 with electronic signature, and a release processing unit 449.

[0333] The reader control unit 481 performs processing related to the control of the reader. In this case, the user terminal device 401 includes a QR code reader as an input device for the input unit 421. The reader control unit 481 performs processing related to the control of this reader (input unit 421).

[0334] The QR code reading unit 482 performs processing related to reading QR codes. The store entry verification information providing unit 483 performs processing related to providing store entry verification information as proof of a user's entry into the store. The store exit verification information providing unit 484 performs processing related to providing store exit verification information as proof of a user's departure from the store.

[0335] <Function blocks of other devices>

[0336] In this case, the imaging device 402 can have the same Figure 29 Similar functional blocks to the example. The store terminal device 102 can have similar... Figure 19 Similar function blocks to the example. Verification server 103 can have similar... Figure 30 Similar function blocks to the example. The posting website server 104 can have similar functionality. Figure 20 Similar function blocks to the example.

[0337] <Process flow of each step>

[0338] In this case, to be with Figure 31 and Figure 32 The flowchart-like process executes the related processing for comment posting. Furthermore, it is similar to... Figure 33 The imaging process is performed using a flowchart similar to the one used in the previous process. Figure 21 and Figure 22 The process of processing entry verification is similar to the flowchart, and is performed in a manner similar to... Figure 24 and Figure 25 The flowchart shows a similar process for processing exit certificates. However, in both entry and exit certificate processing, the processes described as being performed by imaging device 101 are performed by user terminal device 401.

[0339] By performing each process in this way, similar to using a QR code to provide user information from user terminal device 401 to store terminal device 102 in the entry and exit verification processes, the posting of fictitious reviews can be suppressed, and the reduction in the reliability of reviews can be prevented. That is, it is possible to suppress the reduction in the reliability of the posting website's service.

[0340] <Situation where only entry certificate processing is performed>

[0341] Furthermore, similar to the second embodiment, in this case, only the entry verification process can be performed between the entry verification process and the exit verification process. For example, in this case... Figure 17 As illustrated in diagram A, an entry verification process can be used to permit imaging for a predetermined validity period starting from the entry time (time X). This eliminates the need for an exit verification process, making it easier to mitigate the decrease in the reliability of reviews.

[0342] <Cases where only a departure certificate is processed>

[0343] Furthermore, similar to the second embodiment, in this case, only the departure verification process can be performed between the entry verification process and the departure verification process. For example, in this case... Figure 17As illustrated in diagram B, exit verification can be used to permit the publication of images taken within a predetermined validity period up to the exit time (time Y). This eliminates the need for entry verification, making it easier to mitigate the degradation of review reliability.

[0344] <5. Fourth Embodiment>

[0345] Imaging using unregistered imaging devices

[0346] In the third embodiment, although it is described that imaging is performed using a registered imaging device 402, this disclosure is not limited thereto. It can be guaranteed that the captured image generated using an unregistered imaging device is a captured image taken by a user who actually visited the store inside the store. In this case, since the imaging device is not registered, the identification information cannot be used. Therefore, the session key, which serves as the identification information of the session, is used to guarantee the captured image (i.e., to perform entry verification processing and exit verification processing).

[0347] <Comment System>

[0348] Figure 36 The diagram illustrates a key example of the components of a comment system in this scenario. Figure 36 The comment system 500 shown in the diagram is similar to comment system 400. Figure 26 The comment system 500 includes an unregistered imaging device 502, instead of the registered imaging device 402. Similar to user terminal device 401, the imaging device 502 is an image processing device owned by the user who posted the comment.

[0349] Imaging device 502 is a device similar to imaging device 402, except that it is not registered in the review system 500 (verification server 103, etc.) (i.e., except that an imaging device ID is not issued). That is, imaging device 502 has a similar configuration to imaging device 402 (i.e., Figure 3 The structure is illustrated in the diagram, and similar functionality can be achieved by executing an application. Figure 29 (The functional blocks shown in the diagram).

[0350] In the review system 500, user terminal device 401 and the like perform entry and exit verification processing, and based on this processing, permit imaging by imaging device 502 is allowed from the time a user enters the store until they leave. Furthermore, user terminal device 401 provides user information to store terminal device 102 using a QR code. Store terminal device 102 uses this user information and location information indicating the store's location to perform entry and exit verification processing.

[0351] This process ensures that users take photos and generate images within the store before actually entering and leaving.

[0352] <Functional blocks of user terminal equipment>

[0353] Figure 37 The diagram illustrates the functions implemented by the information processing unit 411 as a functional block in this case, through the execution of the application program. For example... Figure 37 As shown in the diagram, by executing the application, the information processing unit 411, as a functional block, may include a session key request unit 442, a QR code generation unit 443, a QR code providing unit 444, a control information acquisition unit 445, an imaging control unit 446, a captured image acquisition unit 447 with electronic signature, a captured image providing unit 448 with electronic signature, and a publishing processing unit 449.

[0354] <Function block for verifying the server>

[0355] Figure 38 The functions implemented by the information processing unit 211 of the verification server 103 executing the application are illustrated in the form of function blocks. For example... Figure 38 As shown in the diagram, by executing the application, the information processing unit 211, as a functional block, may include a store ID issuance and registration unit 241, an entry certificate information acquisition unit 242, an entry certificate information verification unit 243, an entry time recording unit 244, an imaging control unit 245, a session key issuance and registration unit 511, a departure certificate information acquisition unit 249, a departure certificate information verification unit 250, a departure time recording unit 251, a captured image acquisition unit 462 with an electronic signature, a captured image verification unit 463 with an electronic signature, a captured image providing unit 464, and a publishing control unit 252.

[0356] Session key issuance and registration unit 511 performs processing related to the issuance and registration of session keys.

[0357] <Other Equipment>

[0358] The store terminal device 102 and the posting website server 104 each have a similar configuration to those in the first and second embodiments, and are able to perform similar functions (have similar functional blocks).

[0359] <Process for handling comments>

[0360] Reference Figure 39 and Figure 40The flowchart illustrates an example of the processes related to comment posting performed by the comment system 500. Each device in the comment system 500 enables a user to post a comment by executing the various processes shown in the flowchart.

[0361] When processing begins, the registration of stores (store information) is performed. Figure 39 In step S601, the store information registration unit 191 of the store terminal device 102 controls the communication unit 174 to provide store information (information about the store where the store terminal device 102 is installed) to the verification server 103 via the network 105, and causes the verification server 103 to register the store information. In step S641, the store ID issuance and registration unit 241 of the verification server 103 controls the communication unit 224 to receive the store information sent through the processing in step S601. The communication unit 224 receives the store information sent via the network 105 based on the control and provides the store information to the information processing unit 211.

[0362] The store information includes location information indicating the store's location. In step S642, the store ID issuance and registration unit 241 generates a store ID as identification information associated with the location information. The store ID issuance and registration unit 241 controls the communication unit 224 to send the store ID to the store terminal device 102. Based on this control, the communication unit 224 sends the store ID provided from the information processing unit 211 to the store terminal device 102 via the network 105. Furthermore, the store ID issuance and registration unit 241 provides the store ID to the verification data storage unit 212 to store (register) the store ID.

[0363] In step S602, the store information registration unit 191 controls the communication unit 174 to receive the store ID sent through the processing in step S642. Based on the control, the communication unit 174 receives the store ID sent via network 105 and provides the store ID to the information processing unit 161. The store information registration unit 191 provides the store ID to the storage unit 173 and stores the store ID therein.

[0364] Next, the store terminal device 102, the posting website server 104, and the user terminal device 401 perform entry verification processing (steps S603, S611, S631, and S643). This entry verification processing follows a similar procedure to the first embodiment. Figure 12 However, the processing performed by the imaging device 101 is performed by the user terminal device 401.

[0365] When the store entry verification process is completed, in step S644, the session key issuance and registration unit 511 of the verification server 103 generates a session key associated with the user ID and store ID obtained through the store entry verification process, and controls the communication unit 224 to provide the session key to the user terminal device 401. That is, the session key issuance and registration unit 511 issues a session key associated with the user ID and store ID to the user terminal device 401. In step S612, the control information acquisition unit 445 of the user terminal device 401 obtains the session key issued by the verification server 103 as control information via the communication unit 424.

[0366] In addition, in step S645, the session key issuance and registration unit 511 of the verification server 130 stores the session key in association with the entry time obtained through the entry verification process in the verification data storage unit 212.

[0367] When the user terminal device 401 obtains the session key, the user terminal device 401 and the imaging device 502 perform imaging processing (steps S613 and S621). That is, imaging is performed within the store according to the user's operation, thereby generating a captured image.

[0368] When a user leaves the store, the store terminal device 102, the posting website server 104, and the user terminal device 401 perform departure verification processing (steps S604, S614, S632, and S646). This departure verification processing follows a similar procedure to that in the first embodiment. Figure 15 However, the processing performed by the imaging device 101 is performed by the user terminal device 401.

[0369] After processing the check-out certificate, upload the photos you took. Figure 40 In step S671, the image acquisition unit 462 with electronic signature of the verification server 103 controls the communication unit 224 to provide control information for license issuance to the user terminal device 401. In step S651, the image delivery unit 448 with electronic signature of the user terminal device 401 obtains the control information via the communication unit 424.

[0370] In step S652, the image providing unit 448 with an electronic signature provides (uploads) the image with an electronic signature acquired from the imaging device 402 to the verification server 103 based on the permission control communication unit 424. In step S672, the image acquiring unit 462 with an electronic signature of the verification server 103 acquires the image with an electronic signature sent from the user terminal device 401 via the communication unit 224. Because of the added electronic signature, forgery of the captured image is suppressed.

[0371] In step S673, the image verification unit 463 with electronic signature verifies the location information indicating the imaging location, imaging time, and session key contained in the metadata of the acquired image with electronic signature by using the verification data stored in the verification data storage unit 212.

[0372] If the session key in the metadata is issued by the verification server 103 to the imaging device 502, the imaging location corresponds to the store's location, and the imaging time falls between the store entry and exit times, the image verification unit 463 with an electronic signature determines that the captured image is valid. If the captured image is determined to be valid, in step S674, the image providing unit 464 controls the communication unit 224 to provide the captured image as a publishable image to the posting website server 104. In step S661, the image acquisition unit 293 of the posting website server 104 acquires the captured image via the communication unit 274. Note that an electronic signature can be added to the captured image.

[0373] In step S653, the publishing processing unit 449 of the user terminal device 401 performs publishing processing to publish a comment. In response to this processing, the publishing processing unit 294 of the posting website server 104 performs publishing processing in step S662, accepting the publication of the comment and publishing the accepted comment. When the comment publication ends in this manner, the series of processes related to the comment publication ends.

[0374] <Image Processing Flow>

[0375] Reference Figure 41 The flowchart is explained in Figure 39 An example of the imaging processing flow performed in the process.

[0376] When imaging processing begins, in step S681, the imaging control unit 446 of the user terminal device 401 controls the communication unit 424 to provide the session key and control information for granting permission to begin imaging to the imaging device 502. In step S691, the imaging processing unit 451 of the imaging device 502 obtains the control information and session key via the communication unit 124.

[0377] In step S692, the imaging processing unit 451 of the imaging device 502 performs imaging using the imaging unit 112 according to the user's operation. The user uses the imaging unit 112 of the imaging device 502 to capture images such as the landscape inside a store or the goods sold in the store. The imaging unit 112 images the subject to generate a captured image and provides the captured image to the imaging processing unit 451.

[0378] In step S693, the metadata adding unit 452 adds (associates) information such as imaging time, imaging location and session key as metadata to the captured image. Figure 42 The diagram illustrates an example of information contained in metadata. Figure 42 The metadata 521 shown in the diagram includes a session key issued by the verification server 103, location information indicating the imaging location (the location of the imaging device 502), and the imaging time. Of course, the metadata may include other information as well. In step S694, the electronic signature adding unit 453 generates an electronic signature of the captured image and the metadata, and adds (associates) the electronic signature to the captured image.

[0379] In step S695, the image providing unit 454 with electronic signature controls the communication unit 124 to provide the image with electronic signature (image + metadata + electronic signature) generated as described above to the user terminal device 401. In step S682, the image acquiring unit 447 with electronic signature of the user terminal device 401 acquires the image with electronic signature via the communication unit 424. In step S683, the image acquiring unit 447 with electronic signature stores the acquired image with electronic signature in the storage unit 423.

[0380] In step S684, the imaging control unit 446 controls the communication unit 424 to provide control information for terminating imaging permission to the imaging device 502. In step S596, the imaging processing unit 451 of the imaging device 502 obtains the control information via the communication unit 124. The imaging processing unit 451 terminates imaging based on the obtained control information. When imaging ends, the imaging process ends and returns to normal. Figure 39 .

[0381] By performing the various processes as described above, even when imaging is performed using an unregistered imaging device 502, it is possible to perform store entry verification processing and store exit verification processing in a manner similar to the case of the first embodiment, thereby ensuring that the captured image is taken by a user who actually visited the store in the store.

[0382] Therefore, the posting of fictitious comments can be suppressed, and the decrease in the reliability of comments can be prevented. That is, it is possible to suppress the decrease in the reliability of the posting website's service.

[0383] <Situation where only entry certificate processing is performed>

[0384] Furthermore, in this embodiment, similar to the first embodiment, only the entry verification process can be performed between the entry verification process and the exit verification process. In this case, for example, as... Figure 17As illustrated in diagram A, an entry verification process can be used to permit imaging for a predetermined validity period starting from the entry time (time X). This eliminates the need for an exit verification process, making it easier to mitigate the decrease in the reliability of reviews.

[0385] <Store Information Transmission>

[0386] Similar to the second embodiment, in the processing of entry and exit verification, a QR code can be used to provide store information from the store terminal device 102 to the user terminal device 401. In this case, the user terminal device 401 provides entry and exit verification information to the verification server 103.

[0387] <Functional blocks of user terminal equipment>

[0388] Figure 43 The functions implemented by the information processing unit 411 of the user terminal device 401 executing the application program in this case are illustrated in the form of function blocks. For example... Figure 43 As shown in the diagram, by executing the application, the information processing unit 411, as a functional block, may include a session key request unit 442, a reader control unit 481, a QR code reading unit 482, an entry verification information providing unit 483, a control information acquisition unit 445, an imaging control unit 446, a captured image acquisition unit 447 with electronic signature, an exit verification information providing unit 484, a captured image providing unit 448 with electronic signature, and a release processing unit 449.

[0389] <Function blocks of other devices>

[0390] In this case, the imaging device 502 can have the same Figure 29 Similar functional blocks to the example. The store terminal device 102 can have similar... Figure 19 Similar function blocks to the example. Verification server 103 can have similar... Figure 38 Similar function blocks to the example. The posting website server 104 can have similar functionality. Figure 20 Similar function blocks to the example.

[0391] <Process flow of each step>

[0392] In this case, to be with Figure 39 and Figure 40 The flowchart-like process executes the related processing for comment posting. Furthermore, it is similar to... Figure 41 The imaging process is performed using a flowchart similar to the one used in the previous process. Figure 21 and Figure 22 The process of processing entry verification is similar to the flowchart, and is performed in a manner similar to... Figure 24 and Figure 25The flowchart shows a similar process for processing exit certificates. However, in both entry and exit certificate processing, the processes described as being performed by imaging device 101 are performed by user terminal device 401.

[0393] By performing each process in this way, similar to using a QR code to provide user information from user terminal device 401 to store terminal device 102 in the entry and exit verification processes, the posting of fictitious reviews can be suppressed, and the reduction in the reliability of reviews can be prevented. That is, it is possible to suppress the reduction in the reliability of the posting website's service.

[0394] <Situation where only entry certificate processing is performed>

[0395] Furthermore, similar to the second embodiment, in this case, only the entry verification process can be performed between the entry verification process and the exit verification process. For example, in this case... Figure 17 As illustrated in diagram A, an entry verification process can be used to permit imaging for a predetermined validity period starting from the entry time (time X). This eliminates the need for an exit verification process, making it easier to mitigate the decrease in the reliability of reviews.

[0396] <6. Fifth Embodiment>

[0397] Receipts issued when purchasing goods in the store can be used as proof of entry and proof of exit.

[0398] For example, in an information processing system (e.g., a comment system 100) including an image processing device (e.g., an imaging device 101), a first information processing device (e.g., a store terminal device 102), and a second information processing device (e.g., a verification server 103), the image processing device may include: a user information generation unit that generates user information; a user information providing unit that provides the user information generated by the user information generation unit to the first information processing device; a stay information extraction unit that extracts stay information from a receipt printed with stay information including a session key and time information, the session key being issued based on the user information and imaging location information provided to the first information processing device by the user information providing unit; a stay information providing unit that provides the stay information extracted by the stay information extraction unit to the second information processing device; and a captured image providing unit that provides the second information processing device with a captured image generated by imaging through the imaging unit. The first information processing device may include: a user information acquisition unit, which acquires user information provided by an image processing device; an imaging location information and user information providing unit, which provides imaging location information and user information acquired by the user information acquisition unit to a second information processing device; a session key acquisition unit, which acquires a session key provided by the second information processing device; and a receipt issuance unit, which issues a receipt, the receipt of which is printed with dwell information including the session key acquired by the session key acquisition unit and time information, and the second information processing device may include: an imaging location information and user information acquisition unit, which acquires user information provided by the first information processing device; and an imaging location information and user information acquisition unit, which acquires user information from the image processing device; and an imaging location information and user information providing unit, which provides imaging location information and user information to a second information processing device. The system includes: imaging location information and user information; a verification unit that verifies the imaging location information and user information acquired by the imaging location information and user information acquisition unit; a session key providing unit that, when the verification result of the verification unit indicates that the imaging location information and user information are valid, issues a session key corresponding to the imaging location information and user information and provides the session key to the first information processing device; a dwell information acquisition unit that acquires dwell information provided by the image processing device; a captured image acquisition unit that acquires captured images provided by the image processing device; and a control unit that, based on the dwell information acquired by the dwell information acquisition unit, controls the permission to publish captured images acquired by the captured image acquisition unit.

[0399] The comment system 400 (will be used) Figure 26 This example illustrates the method.

[0400] <Functional blocks of user terminal equipment>

[0401] Figure 44 The diagram illustrates the functions implemented by the information processing unit 411 as a functional block in this case, through the execution of the application program. For example... Figure 44 As shown in the diagram, by executing the application, the information processing unit 411, as a functional block, may include an imaging device registration unit 441, a QR code generation unit 443, a QR code providing unit 444, an imaging control unit 446, a captured image acquisition unit 447 with electronic signature, a captured image providing unit 448 with electronic signature, a publishing processing unit 449, a QR code reading unit 482, and an entry and exit proof information providing unit 531.

[0402] The entry and exit verification information providing unit 531 performs processing related to the provision of entry and exit verification information, which is information that proves a user's entry into and exit from the store.

[0403] <Functional Blocks of Store Terminal Equipment>

[0404] Figure 45 The functions implemented by the information processing unit 161 of the store terminal device 102 executing the application are illustrated in the form of function blocks. For example... Figure 45 As shown in the diagram, by executing the application, the information processing unit 161, as a functional block, may include a store information registration unit 191, a QR code reading unit 192, a user store information providing unit 541, a session key acquisition unit 542, and a receipt issuing unit 543.

[0405] User store information providing unit 541 performs processing related to the provision of user information and store information. Session key acquisition unit 542 performs processing related to the acquisition of session keys. Receipt issuance unit 543 performs processing related to the issuance of receipts.

[0406] <Function block for verifying the server>

[0407] Figure 46 The functions implemented by the information processing unit 211 of the verification server 103 executing the application are illustrated in the form of function blocks. For example... Figure 46As shown in the diagram, by executing the application, the information processing unit 211, as a functional block, may include a store ID issuance and registration unit 241, an imaging device registration unit 461, a user store information acquisition unit 551, a user store information verification unit 552, a session key issuance unit 553, a store entry and exit certificate information acquisition unit 554, a store entry and exit time recording unit 555, a captured image acquisition unit 462 with electronic signature, a captured image verification unit 463 with electronic signature, a captured image providing unit 464, and a release control unit 252.

[0408] User store information acquisition unit 551 performs processing related to acquiring user information and store information. User store information verification unit 552 performs processing related to verifying user information and store information. Session key issuance unit 553 performs processing related to issuing session keys. Store entry and exit verification information acquisition unit 554 performs processing related to acquiring store entry and exit verification information. Store entry and exit time recording unit 555 performs processing related to recording store entry and exit times.

[0409] <Function blocks of other devices>

[0410] Imaging device 402 can have the same as Figure 29 Similar function blocks to the example. The posting website server 104 can have similar functionality. Figure 20 Similar function blocks to the example.

[0411] <Process for handling comments>

[0412] Reference Figure 47 and Figure 48 The flowchart illustrates an example of the process related to comment posting performed by the comment system 400 in this situation. Each device in the comment system 400 enables a user to post a comment by executing the various processes shown in the flowchart.

[0413] When processing begins, the registration of stores (store information) is performed. Figure 47 In step S701, the store information registration unit 191 of the store terminal device 102 controls the communication unit 174 to provide store information (information about the store where the store terminal device 102 is installed) to the verification server 103 via the network 105, and causes the verification server 103 to register the store information. In step S741, the store ID issuance and registration unit 241 of the verification server 103 controls the communication unit 224 to receive the store information sent through the processing in step S701. The communication unit 224 receives the store information sent via the network 105 based on the control and provides the store information to the information processing unit 211.

[0414] The store information includes location information indicating the store's location. In step S742, the store ID issuance and registration unit 241 generates a store ID as identification information associated with the location information. The store ID issuance and registration unit 241 controls the communication unit 224 to send the store ID to the store terminal device 102. Based on this control, the communication unit 224 sends the store ID provided from the information processing unit 211 to the store terminal device 102 via the network 105. That is, the store ID issuance and registration unit 241 issues a store ID to the store terminal device 102. In addition, the store ID issuance and registration unit 241 provides the store ID to the verification data storage unit 212 and stores the store ID (registers the store ID).

[0415] In step S702, the store information registration unit 191 controls the communication unit 174 to receive the store ID sent through the processing in step S742. Based on the control, the communication unit 174 receives the store ID sent via network 105 and provides the store ID to the information processing unit 161. The store information registration unit 191 provides the store ID to the storage unit 173 and stores the store ID therein.

[0416] Next, the registration of imaging device 402 is performed. In step S711, the imaging device registration unit 441 of the user terminal device 401 controls the communication unit 424 to provide the imaging device ID, which serves as the identification information of the imaging device 402, to the verification server 103. In step S743, the imaging device registration unit 461 of the verification server 103 obtains the imaging device ID via the communication unit 224 and stores the imaging device ID in association with the user ID in the verification data storage unit 212 (registering the imaging device ID).

[0417] When the imaging device 402 is registered, the user terminal device 401 and the imaging device 402 perform imaging processing to capture images of the store and generate captured images (steps S712 and S721).

[0418] When a user leaves the store, the store terminal device 102 issues a receipt indicating the checkout result (i.e., the checkout result for the goods purchased by the user). At this time, the store terminal device 102, the posting website server 104, and the user terminal device 401 perform entry and exit verification processing, which is related to the user's entry and exit verification (steps S703, S713, S713, S731, and S744). Although details will be explained later, the entry and exit processing is performed using the receipt issued by the store terminal device 102.

[0419] After processing the entry and exit verification documents, upload the photos taken. Figure 48 In step S771, the image acquisition unit 462 with electronic signature of the verification server 103 controls the communication unit 224 to provide control information for license issuance to the user terminal device 401. In step S751, the image delivery unit 448 with electronic signature of the user terminal device 401 obtains the control information via the communication unit 424.

[0420] In step S752, the image providing unit 448 with an electronic signature provides (uploads) the image with an electronic signature acquired from the imaging device 402 to the verification server 103 based on the permission control communication unit 424. In step S772, the image acquiring unit 462 with an electronic signature of the verification server 103 acquires the image with an electronic signature sent from the user terminal device 401 via the communication unit 224. Because of the added electronic signature, forgery of the captured image is suppressed.

[0421] In step S773, the image verification unit 463 with electronic signature verifies the location information indicating the imaging location, the imaging time, and the imaging device ID, which serves as the identification information of the imaging device 402 that generated the image, contained in the metadata of the acquired image with electronic signature, by using the verification data stored in the verification data storage unit 212.

[0422] If the imaging device ID is the registered ID, the imaging location corresponds to the store's location, and the imaging time falls between the store entry and exit times, the image verification unit 463 with an electronic signature determines that the captured image is valid. If the captured image is determined to be valid, in step S774, the image providing unit 464 controls the communication unit 224 to provide the captured image as a publishable image to the posting website server 104. In step S761, the image acquisition unit 293 of the posting website server 104 acquires the captured image via the communication unit 274. Note that an electronic signature can be added to the captured image.

[0423] In step S753, the publishing processing unit 449 of the user terminal device 401 performs publishing processing to publish a comment. In response to this processing, the publishing processing unit 294 of the posting website server 104 performs publishing processing in step S762, accepting the comment and publishing the accepted comment. When the comment publishing ends in this manner, the series of processes related to the comment publishing concludes.

[0424] <Process for handling entry and exit certificates>

[0425] Reference Figure 49 The flowchart illustrates that... Figure 47 An example of the process for processing entry and exit certificates implemented in China.

[0426] When the entry and exit verification process begins, in step S801, the QR code generation unit 443 of the user terminal device 401 generates a QR code with an expiration time. For example, as user information, the information indicated by the QR code includes the user ID and location information indicating the location of the imaging device 402. Of course, other information may be included. Note that the location information can be omitted. However, by including the location information of the imaging device 402 in the QR code, the reliability of the entry and exit verification is improved.

[0427] The QR code providing unit 444 controls the display (display unit) of the output unit 422 to display an image of a QR code with an expiration time generated by the QR code generating unit 443. Then, the user places the display showing the image of the QR code with the expiration time above the reader 162 of the store terminal device 102. That is, the QR code providing unit 444 provides user information to the store terminal device 102, which is an information processing device that stores imaging location information as information indicating the imaging location (i.e., the store location).

[0428] In step S801, the QR code reading unit 192 of the store terminal device 102 controls the reader to read the QR code (i.e., the information indicated by the QR code) held above the reader 162. For example, the reader 162 uses an image sensor or the like to capture an image of the held QR code, analyzes the QR code contained in the captured image, and reads the information. The reader 162 provides the read information to the information processing unit 161 (QR code reading unit 192). As described above, user information, etc., is provided from the user terminal device 401 to the store terminal device 102 by using the QR code.

[0429] In step S802, the user store information providing unit 541 of the store terminal device 102 controls the communication unit 174 to provide the QR code (user information indicated by the QR code) read as described above and the store ID (i.e., store information) issued from the verification server 103 to the verification server 103. According to this control, the communication unit 174 sends the information (user information and store information) provided by the user store information providing unit 541 to the verification server 103 via the network 105. In step S821, the user store information obtaining unit 551 of the verification server 103 obtains this information (user information and store information) via the communication unit 224.

[0430] In step S882, the user store information verification unit 552 verifies whether the location information (information indicating the location of the imaging device 402) indicated by the QR code is valid. For example, the store entry verification unit 243 determines whether the location information of the imaging device 402 corresponds to the location information of the store corresponding to the store ID based on the verification data stored in the verification data storage unit 212. For example, if it is determined that the location information indicated by the QR code (the location information of the imaging device 402) matches the location information of the store or is close enough to the store, the user store information verification unit 552 determines that the location information indicated by the QR code is valid.

[0431] If the location information indicated by the QR code is deemed valid, in step S823, the session key issuing unit 553 issues a session key associated with the user ID and store ID provided from the store terminal device 102. That is, the session key issuing unit 553 generates a session key associated with the user ID and store ID, and controls the communication unit 224 to provide this session key to the store terminal device 102. In step S803, the session key acquisition unit 542 of the store terminal device 102 acquires the session key provided by the verification server 103 via the communication unit 174.

[0432] Upon obtaining the session key, in step S802, the receipt issuing unit 543 issues a receipt with a printed QR code. The QR code, along with information about the user's checkout process, is printed on the receipt.

[0433] Figure 50 This illustration shows an example of information indicated by a QR code printed on a receipt. For example... Figure 50 As illustrated in the diagram, the information indicated by QR code 561 includes dwell information, which indicates the user's stay in the store. For example, dwell information may include a session key issued by verification server 103, the time of entry (e.g., the time of entry-based action, such as the initial order time), the time of departure (e.g., the time of departure-based action, such as the checkout time), and entry and departure markers indicating that this information is used to verify the user's entry and departure. Of course, the information indicated by the QR code may include other information.

[0434] When a receipt is issued, the user operates the user terminal device 401 to read the QR code (information indicated by the QR code) printed on the receipt. According to the user's operation, in step S812, the QR code reading unit 482 controls the reader, which is an input device included in the input unit 421, to read the QR code printed on the receipt.

[0435] In step S813, the entry and exit verification information providing unit 531 controls the communication unit 424 to provide the QR code (or the information indicated by the QR code) as entry and exit verification information to the verification server 103. In step S824, the entry and exit verification information obtaining unit 554 of the verification server 103 obtains the entry and exit verification information provided by the user terminal device 401 via the communication unit 224.

[0436] In step S825, the entry and exit time recording unit 555 stores the entry and exit times included in the acquired entry and exit verification information in the verification data storage unit 212. When step S825 is completed, the entry and exit verification processing is complete, and the process returns. Figure 48 .

[0437] By performing the processes described above, the user's entry and exit times are also verified in this case, and it is ensured that the captured image was taken within the time from entry to exit. Furthermore, since the imaging device 101 is located in the store from the entry to exit time, it is ensured that the captured image was taken by a user who actually visited the store while inside the store, based on the location information.

[0438] Therefore, the posting of fictitious comments can be suppressed, and the decrease in the reliability of comments can be prevented. That is, it is possible to suppress the decrease in the reliability of the posting website's service.

[0439] Although the above description describes the case of comment system 400, this technology can also be applied to comment system 500. That is, an unregistered imaging device 502 can be used instead of the registerable imaging device 402. Furthermore, this technology can also be applied to comment system 100. That is, the imaging device and the user terminal device can be integrated. Specifically, imaging device 101 can be used instead of user terminal device 401 and imaging device 402.

[0440] <7. Appendix>

[0441] <Image captured>

[0442] The images described above can be still images or moving images.

[0443] <Combination>

[0444] Note that when an entry certificate has been issued, both uploading a photograph (without an electronic signature) via a dedicated camera app and uploading a photograph with an electronic signature after leaving the store can be done simultaneously. When entry and exit certificates are issued via a receipt, a photograph with an electronic signature is uploaded. Entry certificate processing and exit certificate processing can be performed using different methods. For example, entry certificate processing can be performed using the method described in the first embodiment, while exit certificate processing can be performed using the method described in the second embodiment.

[0445] Location Information

[0446] Location information indicating the location of a store, imaging equipment, etc., can be obtained by any method. For example, this information can be obtained using the Global Positioning System (GPS) or by using beacons.

[0447] <The object to be commented on>

[0448] The subject of the review is arbitrary. For example, it can be a restaurant, a shop, a business that provides services, goods, or an event or facility that can be imaged (e.g., a hotel, tourist facility, concert venue, etc.).

[0449] <Entry and Exit Certificates>

[0450] Furthermore, as described above, QR codes are used to send and receive store and user information in processes such as entry verification, exit verification, and both entry and exit verification. However, the method for sending and receiving this information can be any local communication method that can define the location, and is not limited to QR codes. For example, information can be exchanged via Wi-Fi or neighborhood communication.

[0451] For example, if imaging device 101 and user terminal device 401 are connected to the store via Wi-Fi, it can be assumed that the user has entered the store. Furthermore, in the case of proof of entry, the entry time can be obtained from the online reservation time via a reputation website. Additionally, it is also possible to allow the user's companions to post. In this case, the companion's user ID can be entered into the reservation details, or the reservation QR code can be read using a reader.

[0452] Furthermore, exit verification can be processed using electronic money or QR code payment methods. For example, exit time can be recorded in conjunction with payment applications. Upon entering and leaving the store, a QR code image can be captured and uploaded along with the published image. The entry and exit times can be recorded from the QR code image during upload.

[0453] In addition, with only proof of entry required, location information can be monitored periodically, and a user can be considered to have left the store if they leave the store after a certain period of time.

[0454] <Regarding association>

[0455] Note that in this specification, terms such as “associate,” “add,” and “link” all mean merging multiple objects into one, for example, merging image data and metadata into a single data set. That is, these terms are synonymous.

[0456] Note that "aggregation" means that other data can be used (linked) while processing one piece of data. That is, data can be physically collected as a single data set, or data can be collected separately. For example, information associated with image data can be transmitted on a different transmission path than that of the image data. Furthermore, for example, information associated with image data can be recorded on a different recording medium (or another recording area of ​​the same recording medium) than that of the image data.

[0457] <Hardware>

[0458] The processes described above can be performed by software (application) or by hardware.

[0459] <Objects to which this technology is applied>

[0460] This technology can be applied to any configuration. For example, this technology can be implemented as part of a device, such as a processor in a system-wide integrated circuit (LSI), a module using multiple processors, a unit using multiple modules, or a collection to which other functions are further added.

[0461] Furthermore, this technology can also be applied to network systems that include multiple devices. For example, this technology can be implemented as cloud computing where multiple devices share and collaborate over a network. For example, this technology can be implemented in cloud services that provide services to any terminal such as computers, portable information processing terminals, or Internet of Things (IoT) devices.

[0462] Note that in this specification, "system" means a collection of multiple components (devices, modules (parts), etc.), and it is not important whether all components are housed in the same enclosure. Thus, multiple devices housed in separate enclosures and connected via a network, as well as a device in which multiple modules are housed in one enclosure, are all considered systems.

[0463] <Fields and Applications for which this technology is applicable>

[0464] The systems, equipment, and processing units applied to this technology can be used in any field, such as transportation, healthcare, crime prevention, agriculture, animal husbandry, mining, beauty, factories, home appliances, meteorology, and nature monitoring. Furthermore, their applications are also arbitrary.

[0465] <Other>

[0466] The embodiments of this technology are not limited to the above embodiments, and various changes can be made without departing from the spirit of this technology.

[0467] For example, a configuration described as a single device (or processing unit) can be divided and configured into multiple devices (or processing units). Conversely, a configuration described above as multiple devices (or processing units) can be combined to form a single device (or processing unit). Furthermore, configurations other than those described above can be added to the configurations of individual devices (or processing units). Moreover, as long as the configuration and operation of the entire system are substantially the same, a portion of the configuration of one device (or processing unit) can be included in the configuration of other devices (or other processing units).

[0468] Furthermore, for example, the above program can be executed on any device. In this case, it is sufficient as long as the device has the necessary functions (function blocks, etc.) and can obtain the necessary information.

[0469] Furthermore, for example, the individual steps of a flowchart can be executed by a single device, or they can be distributed among multiple devices. Additionally, when a step comprises multiple processes, these multiple processes can be executed by a single device, or they can be distributed among multiple devices. In other words, multiple processes contained in a single step can also be executed as processes for multiple steps. Conversely, processes described as multiple steps can be executed collectively as a single step.

[0470] Furthermore, for example, in a program executed by a computer, the processing of steps describing the program can be executed sequentially in the order described in this specification, or it can be executed in parallel or individually at necessary time intervals (such as when a call is made). That is, as long as there is no contradiction, the processing of each step can be executed in a different order than described above. In addition, the processing of steps describing the program can be executed in parallel with the processing of other programs, or it can be executed in combination with the processing of other programs.

[0471] Furthermore, for example, as long as there is no contradiction, various technologies related to this technology can be implemented independently as individual units. Of course, any number of these technologies can be implemented in combination. For example, some or all of the technologies described in any embodiment can be implemented in combination with some or all of the technologies described in other embodiments. Furthermore, any part or all of the aforementioned technologies can be implemented in combination with other technologies not described above.

[0472] Note that this technology can also have the following configuration.

[0473] (1) An image processing apparatus, comprising:

[0474] A user information generation unit generates user information based on the condition that a session is being established with the destination providing the captured image; and

[0475] A providing unit provides the user information to an information processing device that stores imaging location information.

[0476] (2) The image processing apparatus as described in (1), wherein,

[0477] The user information generation unit generates a QR code as the user information, and

[0478] The providing unit causes the display unit to display an image indicating the QR code.

[0479] (3) The image processing apparatus as described in (1) or (2) further includes

[0480] The control unit authorizes the imaging unit to perform imaging within the validity period indicated by the image validity period information, which is obtained from an external device by providing the user information to the information processing device.

[0481] (4) The image processing apparatus as described in (3), wherein

[0482] By providing the user information to the information processing device, the control unit obtains from the external device the validity period information of the captured image, indicating the validity period after the provision of the user information.

[0483] (5) The image processing apparatus as described in (3) or (4), wherein

[0484] The control unit controls the imaging device including the imaging unit to associate the identification information of the imaging device with the captured image generated by the imaging device.

[0485] (6) The image processing apparatus as described in any one of (3) to (5), wherein

[0486] The control unit provides the session identification information to the imaging device including the imaging unit and associates the session identification information with the captured image generated by the imaging device.

[0487] (7) The image processing apparatus as described in (1) or (2) further includes

[0488] A control unit that authorizes the release of captured images within a validity period indicated by captured image validity information, which is obtained from an external device by providing the user information to the information processing device.

[0489] (8) The image processing apparatus as described in (7), wherein

[0490] By providing the user information to the information processing device, the control unit obtains from the external device the validity period information of the captured image, which indicates the validity period prior to the provision of the user information.

[0491] (9) The image processing apparatus as described in (1) or (2) further includes

[0492] The control unit, based on permission start information obtained from an external device by providing the user information to the information processing device, initiates permission for the imaging unit to perform imaging.

[0493] Based on the permission cessation information obtained from an external device by providing the user information to the information processing device, the permission to image the imaging unit is stopped.

[0494] (10) An information processing apparatus, comprising:

[0495] The acquisition control unit, on the condition that it is establishing a session with the destination providing the captured image, authorizes the acquisition of imaging location information based on permission information obtained from the destination providing the image;

[0496] An imaging location information acquisition unit, under the permission of the acquisition control unit, acquires imaging location information provided by an information processing device associated with the imaging location; and

[0497] A providing unit provides the imaging location information and user information to an external device that verifies the user information.

[0498] (11) The image processing apparatus as described in (10), wherein

[0499] The imaging location information acquisition unit acquires the imaging location information by capturing an image of the QR code corresponding to the imaging location information.

[0500] (12) The image processing apparatus as described in (10) or (11) further includes

[0501] An imaging control unit authorizes the imaging unit to perform imaging within a validity period indicated by image validity information, which is obtained from the external device by providing the imaging location information and the user information to the external device.

[0502] (13) The image processing apparatus as described in (12), wherein

[0503] By providing the imaging location information and the user information to the external device, the imaging control unit obtains from the external device the validity period information of the captured image, indicating the validity period after the provision of the user information.

[0504] (14) The image processing apparatus as described in (12) or (13), wherein

[0505] The imaging control unit controls the imaging device including the imaging unit to associate the identification information of the imaging device with the captured image generated by the imaging device.

[0506] (15) The image processing apparatus as described in any one of (12) to (14), wherein

[0507] The imaging control unit provides the session identification information to the imaging device including the imaging unit, so as to associate the session identification information with the captured image generated by the imaging device.

[0508] (16) The image processing apparatus as described in (10) or (11) further includes

[0509] A publishing control unit, which authorizes the publishing of images captured within the validity period indicated by the image validity period information, which is obtained from the external device by providing the imaging location information and the user information to the external device.

[0510] (17) The image processing apparatus as described in (16), wherein

[0511] By providing the imaging location information and the user information to the external device, the publishing control unit obtains from the external device the validity period information of the captured image, indicating the validity period prior to the provision of the user information.

[0512] (18) The image processing apparatus as described in (10) or (11) further includes

[0513] An imaging control unit, based on permission start information obtained from the external device by providing the imaging location information and the user information to the external device, initiates permission for the imaging unit to perform imaging.

[0514] Based on the permission stop information obtained from the external device by providing the imaging location information and the user information to the external device, the permission to image the imaging unit is stopped.

[0515] (19) An information processing system, comprising: an image processing device; a first information processing device; and a second information processing device, wherein...

[0516] The image processing device includes:

[0517] The user information generation unit generates user information based on the condition that a session is being established with the destination that provides the captured image.

[0518] The user information providing unit provides the user information generated by the user information generating unit to the first information processing device.

[0519] A captured image validity period information acquisition unit acquires captured image validity period information provided by the second information processing device, which corresponds to the user information provided by the user information providing unit; and

[0520] An imaging control unit, which authorizes the imaging unit to perform imaging within the validity period indicated by the image validity period information obtained by the image validity period information acquisition unit.

[0521] The first information processing device includes:

[0522] A user information acquisition unit acquires the user information provided by the image processing device; and

[0523] An imaging location information and user information providing unit provides imaging location information and user information acquired by the user information acquisition unit to the second information processing device, and

[0524] The second information processing device includes:

[0525] An imaging location information and user information acquisition unit acquires the imaging location information and user information provided by the first information processing device;

[0526] A verification unit verifies the imaging location information and the user information acquired by the imaging location information and user information acquisition unit; and

[0527] An image validity period information providing unit provides the image processing device with the image validity period information corresponding to the imaging location information and the user information when the verification result of the verification unit determines that the imaging location information and the user information are valid.

[0528] (20) An information processing system, comprising: an image processing device; a first information processing device; and a second information processing device, wherein...

[0529] The image processing device includes:

[0530] The acquisition control unit, on the condition that it is establishing a session with the destination providing the captured image, authorizes the acquisition of imaging location information based on permission information obtained from the destination providing the image;

[0531] An imaging location information acquisition unit, wherein the imaging location information acquisition unit acquires the imaging location information provided by the first information processing device under the permission of the acquisition control unit;

[0532] An imaging location information and user information providing unit provides the imaging location information and user information acquired by the imaging location information acquisition unit to the second information processing device;

[0533] The image validity period information acquisition unit acquires image validity period information provided by the second information processing device, which corresponds to the imaging location information and user information provided by the imaging location information and user information provision unit; and

[0534] An imaging control unit, which authorizes the imaging unit to perform imaging within the validity period indicated by the image validity period information obtained by the image validity period information acquisition unit.

[0535] The first information processing device includes:

[0536] An imaging location information generation unit generates the imaging location information based on the condition that a session is being established with the destination providing the captured image; and

[0537] An imaging position information providing unit provides the imaging position information generated by the imaging position information generating unit to the image processing device, and...

[0538] The second information processing device includes:

[0539] An imaging location information and user information acquisition unit acquires the imaging location information and user information provided by the image processing device;

[0540] A verification unit verifies the imaging location information and the user information acquired by the imaging location information and user information acquisition unit; and

[0541] An image validity period information providing unit provides the image processing device with the image validity period information corresponding to the imaging location information and the user information when the verification result of the verification unit determines that the imaging location information and the user information are valid.

[0542] (21) An information processing system, comprising: an image processing device; a first information processing device; and a second information processing device, wherein

[0543] The image processing device includes:

[0544] User information generation unit, the user information generation unit generates user information;

[0545] The user information providing unit provides the user information generated by the user information generating unit to the first information processing device.

[0546] A dwell information extraction unit extracts dwell information from a receipt printed with dwell information including a session key and time information. The session key is issued based on the user information and imaging location information provided to the first information processing device by the user information providing unit.

[0547] A dwell information providing unit, which provides the dwell information extracted by the dwell information extraction unit to the second information processing device; and

[0548] An image providing unit provides the second information processing device with an image generated by the imaging unit.

[0549] The first information processing device includes:

[0550] User information acquisition unit, the user information acquisition unit acquires the user information provided by the image processing device;

[0551] An imaging location information and user information providing unit provides the imaging location information and the user information obtained by the user information acquisition unit to the second information processing device;

[0552] A session key acquisition unit acquires the session key provided by the second information processing device; and

[0553] A receipt issuing unit issues the receipt, which is printed with the stay information including the session key obtained by the session key acquisition unit and the time information.

[0554] The second information processing device includes:

[0555] An imaging location information and user information acquisition unit acquires the imaging location information and user information provided by the first information processing device;

[0556] A verification unit verifies the imaging location information and the user information obtained by the imaging location information and user information acquisition unit.

[0557] A session key providing unit, wherein if the verification result of the verification unit determines that the imaging location information and the user information are valid, the session key providing unit issues the session key corresponding to the imaging location information and the user information, and provides the session key to the first information processing device;

[0558] A dwell information acquisition unit acquires dwell information provided by the image processing device;

[0559] An image acquisition unit acquires an image provided by the image processing device; and

[0560] A control unit, which controls the permission to publish the captured image obtained by the captured image acquisition unit based on the stay information obtained by the stay information acquisition unit.

[0561] List of reference numerals

[0562] 100 Comments System

[0563] 101 Imaging Equipment

[0564] 102 store terminal equipment

[0565] 103 Verification Server

[0566] 104 Posting Website Server

[0567] 105 Network

[0568] 112 imaging units

[0569] 141 Session Key Request Unit

[0570] 142QR code generation unit

[0571] 143QR code providing unit

[0572] 144 Control Information Acquisition Unit

[0573] 145 Imaging Control Unit

[0574] 146 Image Provider Unit

[0575] 147 Release Processing Unit

[0576] 162 Reader

[0577] 191 Store Information Registration Unit

[0578] 192QR code reading unit

[0579] 193 Store Entry Verification Information Provider

[0580] 194 Departure Certificate Information Provider

[0581] 212 Verification Data Storage Unit

[0582] 241 Store ID Issuance and Registration Unit

[0583] 242 Store Entry Proof Information Acquisition Unit

[0584] 243 Store Entry Verification Unit

[0585] 244 Store Visit Time Recording Unit

[0586] 245 Imaging Control Unit

[0587] 246 Image Acquisition Unit

[0588] 247 Image Verification Unit

[0589] 248 Image Management Unit

[0590] 249 Check-out Certificate Information Acquisition Unit

[0591] 250 Check-out Certificate Information Verification Unit

[0592] 251 Departure Time Recording Unit

[0593] 252 Release Control Unit

[0594] 262 Release Data Storage Unit

[0595] 291 Request Acceptance Unit

[0596] 292 Session Key Issuance Unit

[0597] 293 Image Acquisition Unit

[0598] 294 Release Processing Unit

[0599] 341 Reader Control Unit

[0600] 342QR code reading unit

[0601] 343 Store Entry Verification Information Provider

[0602] 344 Departure Certificate Information Provider

[0603] 351 Session Key Request Unit

[0604] 352QR code generation unit

[0605] 353QR code providing unit

[0606] 361 Reader Control Unit

[0607] 400 Comments System

[0608] 401 User Terminal Equipment

[0609] 402 Imaging Equipment

[0610] 441 Imaging Equipment Registration Unit

[0611] 442 Session Key Request Unit

[0612] 443QR code generation unit

[0613] 444QR code providing unit

[0614] 445 Control Information Acquisition Unit

[0615] 446 Imaging Control Unit

[0616] 447 Image acquisition unit with electronic signature

[0617] 448 Image Providing Unit with Electronic Signature

[0618] 449 Release Processing Unit

[0619] 451 Imaging Processing Unit

[0620] 452 Metadata Addition Unit

[0621] 453 Electronic Signature Addition Unit

[0622] 454 Image Providing Unit with Electronic Signature

[0623] 461 Imaging Equipment Registration Unit

[0624] 462 Image Acquisition Unit with Electronic Signature

[0625] 463 Image verification unit with electronic signature

[0626] 464 Image Provider Unit

[0627] 481 Reader Control Unit

[0628] 482QR code reading unit

[0629] 483 Store Entry Verification Information Provider

[0630] 484 Departure Certificate Information Provider

[0631] 500 Comments System

[0632] 502 Imaging Equipment

[0633] 511 Session Key Issuance Registration Unit

[0634] 531 Unit for Proof of Entry and Exit

[0635] 541 User Store Information Provider Unit

[0636] 542 Session Key Acquisition Unit

[0637] 543 Receipt Issuance Unit

[0638] 551 User Store Information Acquisition Unit

[0639] 552 User Store Information Verification Unit

[0640] 553 Session Key Issuance Unit

[0641] 554 In-store and Out-of-store Proof Information Acquisition Unit

[0642] 555 Store Entry and Exit Time Recording Unit

Claims

1. An image processing apparatus, comprising: The user information generation unit generates user information based on the condition that a session is being established with the destination that provides the captured image. The providing unit provides the user information to the information processing device that stores the imaging location information; as well as The control unit authorizes the imaging unit to perform imaging within the validity period indicated by the image validity period information, which is obtained from an external device by providing the user information to the information processing device. By providing the user information to the information processing device, the control unit obtains from the external device the validity period information of the captured image, indicating the validity period after the provision of the user information.

2. The image processing apparatus according to claim 1, wherein, The user information generation unit generates a QR code as the user information, and The providing unit causes the display unit to display an image indicating the QR code.

3. The image processing apparatus according to claim 1, wherein The control unit controls the imaging device including the imaging unit to associate the identification information of the imaging device with the captured image generated by the imaging device.

4. The image processing apparatus according to claim 1, wherein The control unit provides the session identification information to the imaging device including the imaging unit and associates the session identification information with the captured image generated by the imaging device.

5. The image processing apparatus according to claim 1, further comprising: A publishing control unit, which authorizes the publishing of images captured within the validity period indicated by the image validity period information, which is obtained from an external device by providing the user information to the information processing device.

6. The image processing apparatus according to claim 5, wherein By providing the user information to the information processing device, the publishing control unit obtains from the external device the validity period information of the captured image, which indicates the validity period prior to the provision of the user information.

7. The image processing apparatus according to claim 1, wherein the control unit initiates an authorization for the imaging unit to perform imaging based on authorization start information obtained from an external device by providing the user information to the information processing device, and Based on the permission cessation information obtained from an external device by providing the user information to the information processing device, the permission to image the imaging unit is stopped.

8. An image processing apparatus, comprising: The acquisition control unit, on the condition that it is establishing a session with the destination providing the captured image, authorizes the acquisition of imaging location information based on permission information obtained from the destination providing the image; An imaging location information acquisition unit, under the permission of the acquisition control unit, acquires the imaging location information provided by an information processing device associated with the imaging location; A providing unit provides the imaging location information and user information to an external device that verifies the user information; as well as An imaging control unit authorizes the imaging unit to perform imaging within a validity period indicated by image validity information, which is obtained from the external device by providing the imaging location information and the user information to the external device. By providing the imaging location information and the user information to the external device, the imaging control unit obtains from the external device the validity period information of the captured image, indicating the validity period after the provision of the user information.

9. The image processing apparatus according to claim 8, wherein The imaging location information acquisition unit acquires the imaging location information by capturing an image of the QR code corresponding to the imaging location information.

10. The image processing apparatus according to claim 8, wherein The imaging control unit controls the imaging device including the imaging unit to associate the identification information of the imaging device with the captured image generated by the imaging device.

11. The image processing apparatus according to claim 8, wherein The imaging control unit provides the session identification information to the imaging device including the imaging unit, so as to associate the session identification information with the captured image generated by the imaging device.

12. The image processing apparatus according to claim 8, further comprising: A publishing control unit, which authorizes the publishing of images captured within the validity period indicated by the image validity period information, which is obtained from the external device by providing the imaging location information and the user information to the external device.

13. The image processing apparatus according to claim 12, wherein By providing the imaging location information and the user information to the external device, the publishing control unit obtains from the external device the validity period information of the captured image, indicating the validity period prior to the provision of the user information.

14. The image processing apparatus according to claim 8, wherein The imaging control unit initiates imaging permission for the imaging unit based on permission start information obtained from the external device by providing the imaging location information and the user information to the external device. Based on the permission stop information obtained from the external device by providing the imaging location information and the user information to the external device, the permission to image the imaging unit is stopped.

15. An information processing system, comprising: Image processing device; First information processing device; and a second information processing device, wherein The image processing device includes: The user information generation unit generates user information based on the condition that a session is being established with the destination that provides the captured image. The user information providing unit provides the user information generated by the user information generating unit to the first information processing device. A captured image validity period information acquisition unit acquires captured image validity period information provided by the second information processing device, which corresponds to the user information provided by the user information providing unit; and An imaging control unit, which authorizes the imaging unit to perform imaging within the validity period indicated by the image validity period information obtained by the image validity period information acquisition unit. The first information processing device includes: A user information acquisition unit acquires the user information provided by the image processing device; and An imaging location information and user information providing unit provides imaging location information and user information acquired by the user information acquisition unit to the second information processing device, and The second information processing device includes: An imaging location information and user information acquisition unit acquires the imaging location information and user information provided by the first information processing device; A verification unit verifies the imaging location information and the user information acquired by the imaging location information and user information acquisition unit; and An image validity period information providing unit provides the image processing device with the image validity period information corresponding to the imaging location information and the user information when the verification result of the verification unit determines that the imaging location information and the user information are valid.

16. An information processing system, comprising: Image processing device; First information processing device; and a second information processing device, wherein The image processing device includes: The acquisition control unit, on the condition that it is establishing a session with the destination providing the captured image, authorizes the acquisition of imaging location information based on permission information obtained from the destination providing the image; An imaging location information acquisition unit, wherein the imaging location information acquisition unit acquires the imaging location information provided by the first information processing device under the permission of the acquisition control unit; An imaging location information and user information providing unit provides the imaging location information and user information acquired by the imaging location information acquisition unit to the second information processing device; The image validity period information acquisition unit acquires image validity period information provided by the second information processing device, which corresponds to the imaging location information and user information provided by the imaging location information and user information provision unit; and An imaging control unit, which authorizes the imaging unit to perform imaging within the validity period indicated by the image validity period information obtained by the image validity period information acquisition unit. The first information processing device includes: An imaging location information generation unit generates the imaging location information based on the condition that a session is being established with the destination providing the captured image; and An imaging position information providing unit provides the imaging position information generated by the imaging position information generating unit to the image processing device. The second information processing device includes: An imaging location information and user information acquisition unit acquires the imaging location information and user information provided by the image processing device; A verification unit verifies the imaging location information and the user information acquired by the imaging location information and user information acquisition unit; and An image validity period information providing unit provides the image processing device with the image validity period information corresponding to the imaging location information and the user information when the verification result of the verification unit determines that the imaging location information and the user information are valid.

17. An information processing system, comprising: Image processing device; First information processing device; and a second information processing device, wherein The image processing device includes: User information generation unit, the user information generation unit generates user information; The user information providing unit provides the user information generated by the user information generating unit to the first information processing device. A dwell information extraction unit extracts dwell information from a receipt printed with dwell information including a session key and time information. The session key is issued based on the user information and imaging location information provided to the first information processing device by the user information providing unit. A dwell information providing unit, which provides the dwell information extracted by the dwell information extraction unit to the second information processing device; and An image providing unit provides the second information processing device with an image generated by the imaging unit. The first information processing device includes: User information acquisition unit, the user information acquisition unit acquires the user information provided by the image processing device; An imaging location information and user information providing unit provides the imaging location information and the user information obtained by the user information acquisition unit to the second information processing device; A session key acquisition unit acquires the session key provided by the second information processing device; and A receipt issuing unit issues the receipt, which is printed with the stay information including the session key obtained by the session key acquisition unit and the time information. The second information processing device includes: An imaging location information and user information acquisition unit acquires the imaging location information and user information provided by the first information processing device; A verification unit verifies the imaging location information and the user information obtained by the imaging location information and user information acquisition unit. A session key providing unit, wherein if the verification result of the verification unit determines that the imaging location information and the user information are valid, the session key providing unit issues the session key corresponding to the imaging location information and the user information, and provides the session key to the first information processing device; A dwell information acquisition unit acquires dwell information provided by the image processing device; An image acquisition unit acquires the captured image provided by the image processing device; and A control unit, which controls the permission to publish the captured image obtained by the captured image acquisition unit based on the stay information obtained by the stay information acquisition unit.

Images