Image processing device and information processing system
By generating and verifying QR codes to ensure image capture within a facility, the image processing device prevents fraudulent reviews, thereby maintaining the credibility of review platforms.
Patent Information
- Application Number
- JP2022536252
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-07-15
- Filing Date
- 2021-07-02
- Publication Date
- 2025-10-22
- Estimated Expiration
- 2041-07-02
AI Technical Summary
Existing image review systems are vulnerable to fraudulent reviews using false images taken outside the facility, which undermines the credibility of the review platform and all associated facilities.
An image processing device generates a QR code as user information during a session with the facility, allowing image capture within a valid period, and verifies the capture location and time to ensure authenticity.
This approach ensures that images are captured within the facility, preventing fictitious reviews and maintaining the reliability of the review platform and its ratings.
Smart Images

Figure 0007757963000001 
Figure 0007757963000002 
Figure 0007757963000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to an image processing device and an information processing system, and more particularly to an image processing device and an information processing system that are capable of suppressing a decrease in the reliability of reviews. [Background technology]
[0002] Conventionally, there have been posting sites (so-called word-of-mouth sites) that accept and publish reviews from facility users about facilities such as restaurants, accommodations, and amusement facilities. Users of such posting sites can refer to the published reviews when deciding whether or not to use the facility, or when selecting a facility to use. The facilities can use the reviews as a reference for the opinions of facility users.
[0003] However, with such services, it is possible for fraudulent individuals who have not used a facility to post false reviews using false images that represent images taken at the facility. Such false reviews could undermine the credibility of not only the review of that facility but also all reviews published on the posting site, i.e., the credibility of the ratings of all facilities. In other words, there is a risk that the credibility of the posting site's services could be reduced.
[0004] For example, there is a method for detecting tampering by converting captured images into hash values in digital cameras and attaching digital signatures using the hash values to the captured images (see, for example, Patent Document 1). By applying this technology, it is possible to prevent tampering of captured images used for reviews by third parties. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-22372 Summary of the Invention [Problem to be solved by the invention]
[0006] However, with this technology, it is difficult to prevent posters from posting false reviews using images taken at locations other than the facility that is the subject of the review, for example.
[0007] The present disclosure makes it possible to suppress a decrease in the reliability of reviews in such services, for example. [Means for solving the problem]
[0008] An image processing device according to one aspect of the present technology includes a user information generation unit that generates a QR code as user information on the condition that a session is being established with a destination of a captured image, and a provision unit that provides the user information to an information processing device that stores image capture location information by displaying an image representing the QR code on a display unit. a control unit that permits an image capture by an image capture unit within a valid period indicated by captured image valid period information obtained from an external device by providing the user information to the information processing device; The image processing device includes: Another aspect of the image processing device of the present technology is an image processing device that includes a user information generation unit that generates a QR code as user information on the condition that a session is established with a destination of the captured image, a provision unit that provides the user information to an information processing device that stores image capture location information by displaying an image indicating the QR code on a display unit, and a control unit that allows posting of the captured image that was captured within the validity period indicated by captured image validity period information obtained from an external device by providing the user information to the information processing device. An image processing device according to yet another aspect of the present technology is an image processing device that includes: a user information generation unit that generates a QR code as user information, on the condition that a session is being established with a destination of the captured image; a provision unit that provides the user information to an information processing device that stores image capture location information by displaying an image representing the QR code on a display unit; and a control unit that starts permitting image capture by an image capture unit based on permission start information obtained from an external device by providing the user information to the information processing device, and stops permitting image capture by the image capture unit based on permission stop information obtained from the external device by providing the user information to the information processing device.
[0009] This technology moreover An image processing device according to another aspect includes an acquisition control unit that permits acquisition of imaging location information based on permission information obtained from a destination of provision of an image on the condition that a session with the destination of provision of an image is being established; an imaging location information acquisition unit that, in a state permitted by the acquisition control unit, acquires the imaging location information provided from the information processing device by capturing an image of a QR code corresponding to the imaging location information displayed on a display unit of the information processing device associated with the imaging location; and a provision unit that provides the imaging location information and user information to an external device that verifies the user information. an imaging control unit that permits imaging by an imaging unit within a valid period indicated by captured image valid period information obtained from the external device by providing the imaging location information and the user information to the external device; The image processing device includes: An image processing device according to yet another aspect of the present technology is an image processing device including: an acquisition control unit that permits acquisition of imaging location information based on permission information obtained from a destination of an image provided on the condition that a session is established with the destination; an imaging location information acquisition unit that, in a state permitted by the acquisition control unit, acquires the imaging location information provided from the information processing device by capturing an image of a QR code corresponding to the imaging location information displayed on a display unit of the information processing device associated with the imaging location; a provision unit that provides the imaging location information and user information to an external device that verifies the user information; and a posting control unit that permits posting of an image captured within a validity period indicated by captured image validity period information obtained from the external device by providing the imaging location information and the user information to the external device. An image processing device according to yet another aspect of the present technology is an image processing device including: an acquisition control unit that permits acquisition of imaging location information based on permission information obtained from a destination of an image provided with the image, on the condition that a session is being established with the destination; an imaging location information acquisition unit that, in a state permitted by the acquisition control unit, acquires the imaging location information provided from the information processing device by capturing an image of a QR code corresponding to the imaging location information displayed on a display unit of the information processing device associated with the imaging location; a provision unit that provides the imaging location information and user information to an external device that verifies the user information; and an imaging control unit that starts permitting imaging by the imaging unit based on permission start information obtained from the external device by providing the imaging location information and the user information to the external device, and stops permitting imaging by the imaging unit based on permission stop information obtained from the external device by providing the imaging location information and the user information to the external device.
[0010] According to yet another aspect of the present technology, there is provided an information processing system including an image processing device, a first information processing device, and a second information processing device, wherein the image processing device includes: a user information generation unit that generates user information on condition that a session is being established with a destination of provision of a captured image; a user information provision unit that provides the first information processing device with the user information generated by the user information generation unit; a captured image validity period information acquisition unit that acquires captured image validity period information provided by the second information processing device and corresponding to the user information provided by the user information provision unit; and an imaging control unit that permits imaging by an imaging unit within the validity period indicated by the captured image validity period information acquired by the captured image validity period information acquisition unit, and a user information acquisition unit that acquires the user information provided by the image processing device, and a shooting location information user information provision unit that provides the second information processing device with shooting location information and the user information acquired by the user information acquisition unit, wherein the second information processing device comprises a shooting location information user information acquisition unit that acquires the shooting location information and the user information provided by the first information processing device, a verification unit that verifies the shooting location information and the user information acquired by the shooting location information user information acquisition unit, and a shooting image validity period information provision unit that provides the image processing device with the shooting location information and the shooting image validity period information corresponding to the user information when the verification by the verification unit determines that the shooting location information and the user information are valid.
[0011] According to yet another aspect of the present technology, there is provided an information processing system including an image processing device, a first information processing device, and a second information processing device, wherein the image processing device includes an acquisition control unit that permits acquisition of imaging location information based on permission information obtained from a destination of provision of captured images on the condition that a session is being established with the destination of provision of captured images, an imaging location information acquisition unit that acquires the imaging location information provided from the first information processing device in a state permitted by the acquisition control unit, an imaging location information user information providing unit that provides the imaging location information and user information acquired by the imaging location information acquisition unit to the second information processing device, a captured image valid period information acquisition unit that acquires captured image valid period information provided by the second information processing device and corresponding to the imaging location information and the user information provided by the imaging location information user information providing unit, and and an imaging control unit that permits imaging by the imaging unit within a validity period indicated in the information, wherein the first information processing device comprises an imaging location information generation unit that generates the imaging location information on the condition that a session is being established with the destination of the captured image, and an imaging location information provision unit that provides the image processing device with the imaging location information generated by the imaging location information generation unit, and the second information processing device comprises an imaging location information user information acquisition unit that acquires the imaging location information and the user information provided by the image processing device, a verification unit that verifies the imaging location information and the user information acquired by the imaging location information user information acquisition unit, and a captured image validity period information provision unit that provides the image processing device with the captured image validity period information corresponding to the imaging location information and the user information when the verification by the verification unit determines that the imaging location information and the user information are valid.
[0012] According to yet another aspect of the present technology, there is provided an information processing system including an image processing device, a first information processing device, and a second information processing device, wherein the image processing device includes: a user information generation unit that generates user information; a user information provision unit that provides the user information generated by the user information generation unit to the first information processing device; a stay information extraction unit that extracts the stay information from a receipt on which stay information including time information and a session key issued based on the user information and image capture location information provided to the first information processing device by the user information provision unit; a stay information provision unit that provides the stay information extracted by the stay information extraction unit to the second information processing device; and a captured image provision unit that provides a captured image generated by an image capture unit to the second information processing device, wherein the first information processing device includes: a user information acquisition unit that acquires the user information provided from the image processing device; an image capture location information user information provision unit that provides the image capture location information and the user information acquired by the user information acquisition unit to the second information processing device; and a receipt issuing unit that issues the receipt on which stay information including the session key acquired by the session key acquiring unit and the time information is printed, wherein the second information processing device includes: an imaging location information / user information acquiring unit that acquires the imaging location information and the user information provided from the first information processing device; a verification unit that verifies the imaging location information and the user information acquired by the imaging location information / user information acquiring unit; a session key providing unit that issues the session key corresponding to the imaging location information and the user information and provides the session key to the first information processing device when the verification by the verification unit determines that the imaging location information and the user information are valid; a stay information acquiring unit that acquires the stay information provided from the image processing device; a captured image acquiring unit that acquires the captured images provided from the image processing device; and a control unit that controls permission to post the captured images acquired by the captured image acquiring unit based on the stay information acquired by the stay information acquiring unit.
[0013] In an image processing device according to one aspect of the present technology, a QR code is generated as user information on the condition that a session is being established with a destination of provision of a captured image, and an image showing the QR code is displayed on a display unit, whereby the user information is provided to an information processing device that stores image capture location information. By providing the user information to the information processing device, image capture by the image capture unit is permitted within the validity period indicated by the captured image validity period information obtained from the external device. In an image processing device of another aspect of the present technology, a QR code is generated as user information, provided that a session is being established with the recipient of the captured image, and an image showing the QR code is displayed on a display unit, thereby providing the user information to an information processing device that stores image capture location information.By providing the user information to the information processing device, posting of captured images taken within the validity period indicated by captured image validity period information obtained from an external device is permitted. In yet another aspect of the image processing device of the present technology, on the condition that a session is being established with the destination of the captured image, a QR code is generated as user information, and an image showing the QR code is displayed on a display unit, thereby providing the user information to an information processing device that stores image capture location information, and by providing the user information to the information processing device, permission to capture images by the image capture unit is started based on permission start information obtained from an external device, and by providing the user information to the information processing device, permission to capture images by the image capture unit is stopped based on permission stop information obtained from the external device.
[0014] This technology moreover In another aspect of the image processing device, acquisition of imaging location information is permitted based on permission information obtained from a destination of provision of a captured image on the condition that a session is established with the destination of provision of the captured image, and in this permitted state, an image of a QR code corresponding to the imaging location information displayed on a display unit of the information processing device associated with the imaging location is captured, thereby obtaining the imaging location information provided from the information processing device, and the imaging location information and user information are provided to an external device that verifies the user information. By providing the image capturing location information and user information to the external device, image capturing by the image capturing unit is permitted within the validity period indicated by the captured image validity period information obtained from the external device. In yet another aspect of the present technology, in an image processing device, acquisition of imaging location information is permitted based on permission information obtained from the destination of the captured image, on the condition that a session is being established with the destination of the captured image, and in this permitted state, an image of a QR code corresponding to the imaging location information displayed on a display unit of the information processing device associated with the imaging location is captured, thereby obtaining the imaging location information provided by the information processing device, and the imaging location information and user information are provided to an external device that verifies the user information. By providing the imaging location information and user information to the external device, posting of the captured image taken within the validity period indicated by the captured image validity period information obtained from the external device is permitted. In yet another aspect of the present technology, in an image processing device, acquisition of imaging location information is permitted based on permission information obtained from a destination of a captured image, on the condition that a session is being established with the destination of the captured image, and in this permitted state, an image of a QR code corresponding to the imaging location information displayed on a display unit of the information processing device associated with the imaging location is captured, thereby obtaining the imaging location information provided from the information processing device, and the imaging location information and user information are provided to an external device that verifies the user information, and by providing the imaging location information and user information to the external device, permission for imaging by the imaging unit is started based on permission start information obtained from the external device, and by providing the imaging location information and user information to the external device, permission for imaging by the imaging unit is stopped based on permission stop information obtained from the external device.
[0015] In an information processing system according to yet another aspect of the present technology, in an image processing device, user information is generated on the condition that a session is being established with a destination of the captured image, the user information is provided to a first information processing device, captured image validity period information corresponding to the user information provided from a second information processing device is acquired, image capture by the imaging unit is permitted within the validity period indicated by the captured image validity period information, the first information processing device acquires the user information provided from the image processing device, and the image capture location information and user information are provided to the second information processing device, the second information processing device acquires the image capture location information and user information provided from the first information processing device, the image capture location information and user information are verified, and if it is determined as a result of the verification that the image capture location information and user information are valid, the captured image validity period information corresponding to the image capture location information and user information is provided to the image processing device.
[0016] In an information processing system according to yet another aspect of the present technology, an image processing device is permitted to acquire imaging location information based on permission information obtained from a destination of the captured image, on the condition that a session is being established with the destination of the captured image; in this permitted state, imaging location information provided from a first information processing device is acquired, the imaging location information and user information are provided to a second information processing device, captured image validity period information corresponding to the imaging location information and user information provided by the second information processing device is acquired, and imaging by the imaging unit is permitted within the validity period indicated by the acquired captured image validity period information; in the first information processing device, imaging location information is generated on the condition that a session is being established with the destination of the captured image, and the generated imaging location information is provided to the image processing device; in the second information processing device, the imaging location information and user information provided by the image processing device are acquired, and the imaging location information and user information are verified; and if it is determined that the imaging location information and user information are valid as a result of the verification, the captured image validity period information corresponding to the imaging location information and user information is provided to the image processing device.
[0017] In an information processing system according to yet another aspect of the present technology, in an image processing device, user information is generated, the user information is provided to a first information processing device, stay information including a session key and time information issued based on the user information and image capture location information provided to the first information processing device is extracted from a receipt on which the stay information is printed, the stay information being provided to a second information processing device, a captured image generated by capturing an image with an image capture unit is provided to the second information processing device, the user information provided by the image processing device is acquired in the first information processing device, the image capture location information and the user information are provided to the second information processing device, and the second information processing device a session key provided from the image processing device is acquired, and a receipt is issued on which stay information including the session key and time information is printed; the second information processing device acquires the image capture location information and user information provided from the first information processing device, verifies the acquired image capture location information and user information, and if it is determined as a result of the verification that the image capture location information and user information are valid, issues a session key corresponding to the image capture location information and user information and provides it to the first information processing device; acquires the stay information provided from the image processing device; acquires the captured image provided from the image processing device; and controls permission to post the captured image based on the acquired stay information. [Brief explanation of the drawings]
[0018] [Figure 1] FIG. 10 is a diagram illustrating an example of an outline of guaranteeing an image capturing location and an image capturing time. [Figure 2] FIG. 1 is a diagram illustrating an example of the main configuration of a review system. [Figure 3] FIG. 1 is a block diagram illustrating an example of the main configuration of an imaging device. [Figure 4] FIG. 2 is a functional block diagram showing functions realized in the imaging device. [Figure 5] FIG. 2 is a block diagram showing an example of the main configuration of a store terminal device. [Figure 6] FIG. 2 is a functional block diagram showing functions implemented in a store terminal device. [Figure 7]FIG. 2 is a block diagram illustrating an example of the main configuration of a validation server. [Figure 8] FIG. 2 is a functional block diagram showing functions implemented in a validation server. [Figure 9] FIG. 2 is a block diagram showing an example of the main configuration of a posting site server. [Figure 10] FIG. 2 is a functional block diagram showing functions implemented in a posting site server. [Figure 11] 10 is a flowchart illustrating an example of a processing flow related to posting a review. [Figure 12] 10 is a flowchart illustrating an example of the flow of a store entry certification process. [Figure 13] FIG. 10 is a diagram showing an example of information included in a QR code. [Figure 14] 10 is a flowchart illustrating an example of the flow of an imaging verification process. [Figure 15] 10 is a flowchart illustrating an example of the flow of a store exit certificate process. [Figure 16] FIG. 10 is a diagram showing an example of a review screen. [Figure 17] FIG. 10 is a diagram illustrating another example of the outline of guaranteeing the image capturing location and image capturing time. [Figure 18] FIG. 2 is a functional block diagram showing functions realized in the imaging device. [Figure 19] FIG. 2 is a functional block diagram showing functions implemented in a store terminal device. [Figure 20] FIG. 2 is a functional block diagram showing functions implemented in a posting site server. [Figure 21] 10 is a flowchart illustrating an example of the flow of a store entry certification process. [Figure 22] 22 is a flowchart continuing from FIG. 21 illustrating an example of the flow of store entry certification processing. [Figure 23] FIG. 10 is a diagram showing an example of information included in a QR code. [Figure 24] 10 is a flowchart illustrating an example of the flow of a store exit certificate process. [Figure 25] 25 is a flowchart continuing from FIG. 24, illustrating an example of the flow of store exit certification processing. [Figure 26] FIG. 1 is a diagram illustrating an example of the main configuration of a review system. [Figure 27] FIG. 2 is a block diagram showing an example of the main configuration of a user terminal device. [Figure 28] FIG. 2 is a functional block diagram showing functions implemented in a user terminal device. [Figure 29] FIG. 2 is a functional block diagram showing functions realized in the imaging device. [Figure 30] FIG. 2 is a functional block diagram showing functions implemented in a validation server. [Figure 31] 10 is a flowchart illustrating an example of a processing flow related to posting a review. [Figure 32] 32 is a flowchart continuing from FIG. 31 illustrating an example of the flow of processing related to posting of a review. [Figure 33] 10 is a flowchart illustrating an example of the flow of an imaging process. [Figure 34] FIG. 10 is a diagram illustrating an example of metadata. [Figure 35] FIG. 2 is a functional block diagram showing functions implemented in a user terminal device. [Figure 36] FIG. 1 is a diagram illustrating an example of the main configuration of a review system. [Figure 37] FIG. 2 is a functional block diagram showing functions implemented in a user terminal device. [Figure 38] FIG. 2 is a functional block diagram showing functions implemented in a validation server. [Figure 39] 10 is a flowchart illustrating an example of a processing flow related to posting a review. [Figure 40] 40 is a flowchart continuing from FIG. 39, illustrating an example of the flow of processing related to posting a review. [Figure 41] 10 is a flowchart illustrating an example of the flow of an imaging process. [Figure 42] FIG. 10 is a diagram illustrating an example of metadata. [Figure 43] FIG. 2 is a functional block diagram showing functions implemented in a user terminal device. [Figure 44] FIG. 2 is a functional block diagram showing functions implemented in a user terminal device. [Figure 45] FIG. 2 is a functional block diagram showing functions implemented in a store terminal device. [Figure 46] FIG. 2 is a functional block diagram showing functions implemented in a validation server. [Figure 47] 10 is a flowchart illustrating an example of a processing flow related to posting a review. [Figure 48] 48 is a flowchart continuing from FIG. 47 illustrating an example of the flow of processing related to posting of a review. [Figure 49] 10 is a flowchart illustrating an example of the flow of store entry / exit certification processing. [Figure 50] FIG. 10 is a diagram showing an example of information included in a QR code. DETAILED DESCRIPTION OF THE INVENTION
[0019] Hereinafter, modes for carrying out the present disclosure (hereinafter referred to as embodiments) will be described in the following order. 1. Guarantee of imaging location and time 2. First embodiment (review system) 3. Second embodiment (review system) 4. Third Embodiment (Review System) 5. Fourth Embodiment (Review System) 6. Fifth Embodiment (Review System) 7. Additional Notes
[0020] <1. Guarantee of imaging location and time> <Posting sites and fake reviews>
[0021] Conventionally, there have been posting sites (so-called word-of-mouth sites) that accept and publish reviews from facility users about facilities such as restaurants, accommodations, and amusement facilities. Users of such posting sites can refer to the published reviews when deciding whether or not to use the facility, or when selecting a facility to use. The facilities can use the reviews as a reference for the opinions of facility users.
[0022] Nowadays, the ratings on these review sites are directly linked to a store's sales, and are also an important indicator for general customers when choosing a store. However, these ratings can generally be fraudulently increased or decreased by creating false reviews. Therefore, there has been a need to prevent such fraudulent manipulation of ratings. Each review site has established guidelines and is working to investigate and delete posts before they are published, but since users are free to post reviews, it is currently difficult to prevent false reviews before they occur.
[0023] One type of false review is the so-called "fictitious review," in which a person gives a positive (or negative) rating to a property without actually visiting it. The fraudulent poster posts such a fictitious review using images taken outside the property being reviewed.
[0024] For example, as described in Patent Document 1, there is a method for detecting tampering by converting captured images into hash values using a digital camera or the like and attaching an electronic signature using the hash value to the captured image. By applying this technology, it is possible to prevent tampering with captured images used in reviews by third parties. However, this technology has difficulty preventing posters from posting false reviews using captured images taken at a facility other than the facility that is the subject of the review. In other words, it has been difficult to prevent the posting of fictitious reviews as described above.
[0025] Furthermore, since it is difficult to determine which of the posted reviews are fictitious, it is difficult to take appropriate measures against the posted fictitious reviews. In other words, if no measures are taken to prevent the posting of fictitious reviews, there is a risk that the reliability of not only the reviews for the facility in question but all reviews published on the posting site, i.e., the reliability of the ratings for all facilities, will be reduced. In other words, there is a risk that the reliability of the posting site's services will be reduced.
[0026] <Ensuring the authenticity of captured images> Therefore, by guaranteeing the image capture location and time of the posted image, it is possible to guarantee that the person actually entered and left the facility and that the posted image was taken at that time. By doing so, the posting site can more easily detect and delete or reject the posting of fictitious reviews that use images captured at locations other than the facility that is the subject of the review. In other words, the posting of such fictitious reviews can be suppressed. Therefore, it is possible to suppress a decrease in the reliability of reviews. In other words, it is possible to suppress a decrease in the reliability of the service provided by the posting site.
[0027] 2. First Embodiment <Proof of entry and exit and guarantee of imaging time and location> For example, as shown in FIG. 1, suppose that a user of an imaging device A visits a store B, captures images of products and the like at the store B to generate captured image C, generates a review of store B using captured image C, and posts the review to a posting site.
[0028] In such a case, the time the user (imaging device A) entered the store (X o'clock) and the time he left (Y o'clock) are recorded. This ensures that imaging device A was located within store B between X o'clock and Y o'clock. Furthermore, imaging device A generates captured image C using a dedicated camera application, links captured image C with information on the capture time and capture location, and uploads it. This ensures the capture location and capture time of captured image C. This ensures that captured image C was generated by imaging device A in store B between X o'clock and Y o'clock. In other words, it is guaranteed that captured image C was posted by a user who actually visited store B.
[0029] For example, user information is generated on the condition that a session is established with a destination of the captured image, and the user information is provided to an information processing device that stores the image capture location information. For example, an image processing device may include a user information generation unit that generates user information on the condition that a session is established with a destination of the captured image, and a provision unit that provides the user information to the information processing device that stores the image capture location information. In this way, entry and exit from a store can be proven, and the image capture location and image capture time can be guaranteed.
[0030] <Review System> Fig. 2 is a diagram showing an example of the main configuration of a review system, which is an embodiment of an information processing system to which the present technology is applied. The review system 100 shown in Fig. 2 is a system in which a user who visits a store (facility) posts a review of the store using an image captured there.
[0031] 2, the review system 100 includes an imaging device 101, a store terminal device 102, a verification server 103, and a posting site server 104. Each device is connected to each other via a network 105 so that they can communicate with each other. The imaging device 101 and the store terminal device 102 can also exchange information using a QR code (registered trademark).
[0032] The imaging device 101 is an image processing device owned by a user who posts a review. The user visits a store that is the subject of a review, captures an image of a subject using the imaging device 101 at the store, and generates a captured image to be used in the review. The imaging device 101 has a communication function, and can use the communication function to supply the captured image to the verification server 103, etc. The imaging device 101 has a display function, and can use the display function to display a QR code, etc.
[0033] The store terminal device 102 is an information processing device installed in a store visited by a user of the imaging device 101. The store terminal device 102 has a communication function, and can use this communication function to supply location information indicating the location of the store to the verification server 103, etc. The store terminal device 102 is equipped with a reader that reads QR codes, and can use this reader to read information indicated by the QR code displayed by the imaging device 101.
[0034] The verification server 103 is an external device from the perspective of the imaging device 101, and is a server that verifies various types of information. The verification server 103 has a communication function, and can use this communication function to verify information supplied from the imaging device 101 and the store terminal device 102 and return the verification results.
[0035] The posting site server 104 is a server that provides captured images from the imaging device 101 and services for the posting site. The posting site server 104 has a communication function, and uses this communication function to accept reviews posted from the imaging device 101, etc. The posting site server 104 uses this communication function to make the posted reviews public.
[0036] Network 105 is a communication network configured with any communication medium. Communication performed via network 105 may be wired communication, wireless communication, or both. In other words, network 105 may be a communication network for wired communication, a communication network for wireless communication, or a communication network configured with both. Furthermore, network 105 may be configured with a single communication network, or may be configured with multiple communication networks.
[0037] For example, the Internet may be included in the network 105. The network 105 may also include a public telephone line network. The network 105 may also include wide area communication networks for wireless mobile devices, such as so-called 3G lines, 4G lines, and 5G lines. The network 105 may also include a wide area network (WAN) or a local area network (LAN). The network 105 may also include a wireless communication network that performs communication in accordance with the Bluetooth (registered trademark) standard. The network 105 may also include a short-range wireless communication channel, such as NFC (Near Field Communication). The network 105 may also include an infrared communication channel. The network 105 may also include a wired communication network that complies with standards such as HDMI (High-Definition Multimedia Interface) (registered trademark) and USB (Universal Serial Bus) (registered trademark). In this way, the network 105 may include communication networks and communication channels of any communication standard.
[0038] The validation server 103 and the posting site server 104 may be integrated into one server (information processing device).
[0039] The review system 100 performs a store entry certification process that certifies that a user has entered a store, and a store exit certification process that certifies that the user is leaving the store. Based on these processes, image capture is permitted from the time the user enters the store until the time the user leaves. The image capture device 101 also supplies user information to the store terminal device 102 using a QR code. The store terminal device 102 performs the store entry certification process and the store exit certification process using the user information and location information indicating the location of the store.
[0040] This process ensures that an image is captured and a captured image is generated in the store from the time the user actually enters the store until the time the user leaves the store.
[0041] For example, in an information processing system (e.g., review system 100) including an image processing device (e.g., imaging device 101), a first information processing device (e.g., store terminal device 102), and a second information processing device (e.g., verification server 103), the information processing system may include a user information generation unit that generates user information on the condition that the image processing device is in the process of establishing a session with a destination (e.g., posting site server 104) of the captured image, a user information provision unit that provides the first information processing device with the user information generated by the user information generation unit, a captured image validity period information acquisition unit that acquires captured image validity period information provided by the second information processing device and corresponding to the user information provided by the user information provision unit, and a validity period indicated by the captured image validity period information acquired by the captured image validity period information acquisition unit. The first information processing device may include an imaging control unit that permits imaging by the imaging unit, a user information acquisition unit that acquires user information provided from the image processing device, and an imaging location information user information provision unit that provides the second information processing device with the imaging location information and the user information acquired by the user information acquisition unit, and the second information processing device may include an imaging location information user information acquisition unit that acquires the imaging location information and user information provided from the first information processing device, a verification unit that verifies the imaging location information and user information acquired by the imaging location information user information acquisition unit, and a captured image validity period information provision unit that provides the image processing device with captured image validity period information corresponding to the imaging location information and user information when the verification by the verification unit determines that the imaging location information and user information are valid.
[0042] <Imaging device> 3 is a diagram showing an example of the main configuration of an imaging device 101, which is an embodiment of an image processing device to which the present technology is applied. As shown in FIG. 3, the imaging device 101 has an information processing unit 111, an imaging unit 112, an input unit 121, an output unit 122, a storage unit 123, a communication unit 124, and a drive 125.
[0043] The information processing unit 111 is a computer that has, for example, a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc., and can realize various functions by executing application programs (software) using these. For example, the information processing unit 111 can install and execute an application program (software) that performs processing related to imaging to generate captured images used in posting reviews. Here, the computer includes a computer built into dedicated hardware, and, for example, a general-purpose personal computer that can execute various functions by installing various programs.
[0044] The imaging unit 112 has an optical system, an image sensor, etc., and can capture an image of a subject to generate a captured image. The imaging unit 112 can supply the generated captured image to the information processing unit 111.
[0045] The input unit 121 has input devices such as a keyboard, a mouse, a microphone, a touch panel, an input terminal, and the like, and can supply information input via these input devices to the information processing unit 111 .
[0046] The output unit 122 has output devices such as a display (display unit), a speaker (audio output unit), an output terminal, etc., and can output the information supplied from the information processing unit 111 via these output devices.
[0047] The storage unit 123 has a storage medium such as a hard disk, a RAM disk, or a non-volatile memory, and can store information supplied from the information processing unit 111 in the storage medium. The storage unit 123 can read out the information stored in the storage medium and supply it to the information processing unit 111.
[0048] The communication unit 124 may have, for example, a network interface, receive information transmitted from another device via the network 105, and supply the received information to the information processing unit 111. The communication unit 124 may transmit the information supplied from the information processing unit 111 to another device via the network 105.
[0049] The drive 125 has an interface for a removable recording medium 131 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and can read information recorded on the removable recording medium 131 attached to the drive 125 and supply the information to the information processing unit 111. The drive 125 can record the information supplied from the information processing unit 111 on the writable removable recording medium 131 attached to the drive 125.
[0050] The information processing unit 111 loads and executes, for example, an application program stored in the storage unit 123. In this case, the information processing unit 111 can also store data, etc. necessary for executing various processes, as appropriate. The application program, data, etc. can be provided by being recorded on, for example, a removable recording medium 131 such as a package medium. In this case, the application program, data, etc. are read by a drive 125 to which the removable recording medium 131 is attached and installed in the storage unit 123 via the information processing unit 111. The application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In this case, the application program, data, etc. are received by the communication unit 124 and installed in the storage unit 123 via the information processing unit 111. The application program, data, etc. can also be installed in advance in the ROM within the information processing unit 111 or in the storage unit 123.
[0051] <Functional blocks of the imaging device> The functions realized by information processing unit 111 executing the application program are shown as functional blocks in Fig. 4. As shown in Fig. 4, by executing the application program, information processing unit 111 can have, as functional blocks, session key request unit 141, QR code generation unit 142, QR code provision unit 143, control information acquisition unit 144, imaging control unit 145, captured image provision unit 146, and posting processing unit 147.
[0052] The session key request unit 141 performs processing related to a request for a session key. The QR code generation unit 142 performs processing related to generating a QR code. The QR code provision unit 143 performs processing related to providing a QR code. The control information acquisition unit 144 performs processing related to acquiring control information. The imaging control unit 145 performs processing related to controlling the imaging unit 112. The captured image provision unit 146 performs processing related to providing captured images generated by the imaging unit 112. The posting processing unit 147 performs processing related to posting a review.
[0053] <Store terminal equipment> 5 is a diagram showing an example of the main configuration of a store terminal device 102, which is an embodiment of an image processing device to which the present technology is applied. As shown in FIG. 5, the store terminal device 102 has an information processing unit 161, a reader 162, an input unit 171, an output unit 172, a storage unit 173, a communication unit 174, and a drive 175.
[0054] The information processing unit 161 is a computer that has, for example, a CPU, a ROM, a RAM, etc., and can realize various functions by using these to execute application programs (software). For example, the information processing unit 161 can install and execute an application program (software) that performs processing related to the authentication of a user's entry and exit from a store.
[0055] The reader 162 has an optical system, an image sensor, etc., and can read the QR code (that is, the information indicated by the QR code). The reader 162 can supply the read information to the information processing unit 161.
[0056] The input unit 171 has input devices such as a keyboard, a mouse, a microphone, a touch panel, an input terminal, and the like, and can supply information input via these input devices to the information processing unit 161.
[0057] The output unit 172 has output devices such as a display (display unit), a speaker (audio output unit), an output terminal, etc., and can output the information supplied from the information processing unit 161 via these output devices.
[0058] The storage unit 173 has a storage medium such as a hard disk, a RAM disk, or a non-volatile memory, and can store information supplied from the information processing unit 161 in the storage medium. The storage unit 173 can read out the information stored in the storage medium and supply it to the information processing unit 161.
[0059] The communication unit 174 may have, for example, a network interface, receive information transmitted from another device via the network 105, and supply the received information to the information processing unit 161. The communication unit 174 may transmit the information supplied from the information processing unit 161 to another device via the network 105.
[0060] The drive 175 has an interface for a removable recording medium 181 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and can read information recorded on the removable recording medium 181 attached to the drive 175 and supply the information to the information processing unit 161. The drive 175 can record the information supplied from the information processing unit 161 on the writable removable recording medium 181 attached to the drive 175.
[0061] Information processing unit 161 loads and executes, for example, an application program stored in storage unit 173. In this case, information processing unit 161 can also store data, etc. necessary for executing various processes, as appropriate. The application program, data, etc. can be provided by being recorded on removable recording medium 181, such as a package medium. In this case, the application program, data, etc. are read by drive 175 to which removable recording medium 181 is attached and installed in storage unit 173 via information processing unit 161. The application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In this case, the application program, data, etc. are received by communication unit 174 and installed in storage unit 173 via information processing unit 161. The application program, data, etc. can also be installed in advance in the ROM within information processing unit 161 or storage unit 173.
[0062] <Functional block of store terminal device> The functions realized by the information processing unit 161 executing the application program are shown as functional blocks in Fig. 6. As shown in Fig. 6, by executing the application program, the information processing unit 161 can have, as functional blocks, a store information registration unit 191, a QR code reading unit 192, a store entry certificate information providing unit 193, and a store exit certificate information providing unit 194.
[0063] The store information registration unit 191 performs processing related to the registration of store information, which is information related to a store. The QR code reading unit 192 performs processing related to reading a QR code. The store entry certificate information providing unit 193 performs processing related to the provision of store entry certificate information, which is information that certifies that a user has entered a store. The store exit certificate information providing unit 194 performs processing related to the provision of store exit certificate information, which is information that certifies that a user has left a store.
[0064] <Verification Server> 7 is a diagram showing an example of the main configuration of a verification server 103, which is an embodiment of an image processing device to which the present technology is applied. As shown in FIG. 7, the verification server 103 includes an information processing unit 211, a verification data storage unit 212, an input unit 221, an output unit 222, a storage unit 223, a communication unit 224, and a drive 225.
[0065] The information processing unit 211 is a computer that has, for example, a CPU, a ROM, a RAM, etc., and can realize various functions by executing application programs (software) using these. For example, the information processing unit 211 can install and execute application programs (software) that perform processing related to the verification of various types of information.
[0066] The verification data storage unit 212 has a storage medium such as a hard disk, a RAM disk, or a nonvolatile memory, and can store in that storage medium verification data, which is information used for verification and is supplied from the information processing unit 211. The verification data storage unit 212 can read out the verification data stored in that storage medium and supply it to the information processing unit 211.
[0067] The input unit 221 has input devices such as a keyboard, a mouse, a microphone, a touch panel, an input terminal, and the like, and can supply information input via these input devices to the information processing unit 211 .
[0068] The output unit 222 has output devices such as a display (display unit), a speaker (audio output unit), an output terminal, etc., and can output the information supplied from the information processing unit 211 via these output devices.
[0069] The storage unit 223 has a storage medium such as a hard disk, a RAM disk, or a non-volatile memory, and can store information supplied from the information processing unit 211 in that storage medium. The storage unit 223 can read out information stored in that storage medium and supply it to the information processing unit 211.
[0070] The communication unit 224 may have, for example, a network interface, receive information transmitted from other devices via the network 105, and supply the received information to the information processing unit 211. The communication unit 224 may transmit the information supplied from the information processing unit 211 to other devices via the network 105.
[0071] The drive 225 has an interface for a removable recording medium 231 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and can read information recorded on the removable recording medium 231 attached to the drive 225 and supply the information to the information processing unit 211. The drive 225 can record the information supplied from the information processing unit 211 on the writable removable recording medium 231 attached to the drive 225.
[0072] The information processing unit 211 loads and executes, for example, an application program stored in the storage unit 223. In this case, the information processing unit 211 can also store data, etc. necessary for executing various processes, as appropriate. The application program, data, etc. can be provided by being recorded on, for example, a removable recording medium 231 such as a package medium. In this case, the application program, data, etc. are read by a drive 225 to which the removable recording medium 231 is attached and installed in the storage unit 223 via the information processing unit 211. The application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In this case, the application program, data, etc. are received by the communication unit 224 and installed in the storage unit 223 via the information processing unit 211. The application program, data, etc. can also be installed in advance in the ROM within the information processing unit 211 or in the storage unit 223.
[0073] <Verification server function block> Functions realized by the information processing unit 211 executing the application program are shown as functional blocks in Fig. 8. As shown in Fig. 8, by executing the application program, the information processing unit 211 can have, as functional blocks, a store ID issuance and registration unit 241, a store entry certificate information acquisition unit 242, a store entry certificate information verification unit 243, a store entry time recording unit 244, an imaging control unit 245, a captured image acquisition unit 246, a captured image verification unit 247, a captured image management unit 248, a store exit certificate information acquisition unit 249, a store exit certificate information verification unit 250, a store exit time recording unit 251, and a posting control unit 252.
[0074] The store ID issuance and registration unit 241 performs processing related to the issuance and registration of a store ID, which is identification information for a store. The store entry certificate information acquisition unit 242 performs processing related to the acquisition of store entry certificate information. The store entry certificate information verification unit 243 performs processing related to the verification of store entry certificate information. The store entry time recording unit 244 performs processing related to the recording of the store entry time, which is the time when the user enters the store. The imaging control unit 245 performs processing related to the control of imaging by the imaging device 101. The captured image acquisition unit 246 performs processing related to the acquisition of captured images. The captured image verification unit 247 performs processing related to the verification of captured images. The captured image management unit 248 performs processing related to the management of captured images. The store exit certificate information acquisition unit 249 performs processing related to the acquisition of store exit certificate information. The store exit certificate information verification unit 250 performs processing related to the verification of store exit certificate information. The store exit time recording unit 251 performs processing related to the recording of the store exit time, which is the time when the user leaves the store. The posting control unit 252 performs processing related to the control of review posting.
[0075] <Submission site server> 9 is a diagram showing an example of the main configuration of a posting site server 104, which is an embodiment of an image processing device to which the present technology is applied. As shown in FIG. 9, the posting site server 104 has an information processing unit 261, a posting data storage unit 262, an input unit 271, an output unit 272, a storage unit 273, a communication unit 274, and a drive 275.
[0076] The information processing unit 261 is a computer that has, for example, a CPU, a ROM, a RAM, etc., and can realize various functions by using these to execute application programs (software). For example, the information processing unit 261 can install and execute application programs (software) that perform processing related to the verification of various types of information.
[0077] Posted data storage unit 262 has a storage medium such as a hard disk, a RAM disk, or a non-volatile memory, and can store posted data, which is information such as posted captured images and reviews, supplied from information processing unit 261 in the storage medium. Posted data storage unit 262 can read out the posted data stored in the storage medium and supply it to information processing unit 261.
[0078] The input unit 271 has input devices such as a keyboard, a mouse, a microphone, a touch panel, an input terminal, and the like, and can supply information input via these input devices to the information processing unit 261.
[0079] The output unit 272 has output devices such as a display (display unit), a speaker (audio output unit), an output terminal, etc., and can output the information supplied from the information processing unit 261 via these output devices.
[0080] The storage unit 273 has a storage medium such as a hard disk, a RAM disk, or a non-volatile memory, and can store information supplied from the information processing unit 261 in that storage medium. The storage unit 273 can read out information stored in that storage medium and supply it to the information processing unit 261.
[0081] The communication unit 274 may have, for example, a network interface, receive information transmitted from other devices via the network 105, and supply the received information to the information processing unit 261. The communication unit 274 may transmit the information supplied from the information processing unit 261 to other devices via the network 105.
[0082] The drive 275 has an interface for a removable recording medium 281 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and can read information recorded on the removable recording medium 281 attached to the drive 275 and supply the information to the information processing unit 261. The drive 275 can record the information supplied from the information processing unit 261 on the writable removable recording medium 281 attached to the drive 275.
[0083] The information processing unit 261 loads and executes, for example, an application program stored in the storage unit 273. In this case, the information processing unit 261 can also store data, etc. necessary for executing various processes, as appropriate. The application program, data, etc. can be provided by being recorded on, for example, a removable recording medium 281 such as a package medium. In this case, the application program, data, etc. are read by a drive 275 to which the removable recording medium 281 is attached and installed in the storage unit 273 via the information processing unit 261. The application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In this case, the application program, data, etc. are received by the communication unit 274 and installed in the storage unit 273 via the information processing unit 261. The application program, data, etc. can also be installed in advance in the ROM within the information processing unit 261 or in the storage unit 273.
[0084] <Submission site server function block> The functions realized by the information processing unit 261 executing the application program are shown as functional blocks in Fig. 10. As shown in Fig. 10, by executing the application program, the information processing unit 261 can have, as functional blocks, a request receiving unit 291, a session key issuing unit 292, a posted image obtaining unit 293, and a posting processing unit 294.
[0085] The request receiving unit 291 performs processing related to receiving requests from other devices. The session key issuing unit 292 performs processing related to issuing a session key. The posted image acquiring unit 293 performs processing related to acquiring posted images, which are captured images that have been posted. The posting processing unit 294 performs processing related to posting reviews.
[0086] <Process flow for posting reviews> An example of the flow of processing related to the posting of reviews executed by the review system 100 will be described with reference to the flowchart in Fig. 11. Each device in the review system 100 executes each process according to the flow shown in this flowchart, thereby enabling users to post reviews.
[0087] When the processing starts, in step S101, the store information registration unit 191 of the store terminal device 102 controls the communication unit 174 to supply store information, which is information about the store where the store terminal device 102 is installed, to the validation server 103 via the network 105 and register the store information in the validation server 103. In step S131, the store ID issuance and registration unit 241 of the validation server 103 controls the communication unit 224 to receive the store information transmitted by the processing of step S101. Based on this control, the communication unit 224 receives the store information transmitted via the network 105 and supplies it to the information processing unit 211.
[0088] This store information includes location information indicating the location of the store. In step S132, the store ID issuance registration unit 241 generates a store ID, which is identification information of the store linked to the location information. The store ID issuance registration unit 241 controls the communication unit 224 to transmit the store ID to the store terminal device 102. Based on this control, the communication unit 224 transmits the store ID supplied from the information processing unit 211 to the store terminal device 102 via the network 105. The store ID issuance registration unit 241 also supplies the store ID to the verification data storage unit 212 to store (register) it.
[0089] In step S102, the store information registration unit 191 controls the communication unit 174 to receive the store ID transmitted by the processing in step S132. Based on the control, the communication unit 174 receives the store ID transmitted via the network 105 and supplies it to the information processing unit 161. The store information registration unit 191 supplies the store ID to the storage unit 173, where it is stored.
[0090] Once the store information has been registered as described above, the imaging device 101 through the posting site server 104 perform a store entry certification process (steps S103, S111, S121, and S133) to certify that the user of the imaging device 101 has entered the store where the store terminal device 102 is installed. Details of this store entry certification process will be described later.
[0091] During the period from when the store entry certification process is performed until when the store exit certification process is performed, imaging using the imaging unit 112 of the imaging device 101 is permitted. The imaging device 101 and the verification server 03 perform an imaging verification process of imaging and verifying the captured image obtained by the imaging (steps S112 and S134). The imaging verification process will be described in detail later.
[0092] When a user leaves a store, the imaging device 101 to the posting site server 104 perform a store exit certification process to certify that the user has left the store (steps S104, S113, S122, and S135). The store exit certification process will be described in detail later.
[0093] After the store exit certification process is performed, in step S136, the posting control unit 252 of the verification server 103 controls the communication unit 224 to transmit control information permitting the posting of a review to the imaging device 101 via the network 105. Based on the control, the communication unit 224 transmits the control information supplied from the information processing unit 111 to the imaging device 101 via the network 105. In step S114, the control information acquisition unit 144 of the imaging device 101 controls the communication unit 124 to acquire the control information.
[0094] In step S137, the posting control unit 252 of the validation server 103 controls the communication unit 224 to supply the captured image uploaded from the imaging device 101 to the validation server 103 as an image that can be posted to the posting site server 104. In step S123, the posted image acquisition unit 293 of the posting site server 104 controls the communication unit 274 to receive the postable image transmitted from the validation server 103. Based on the control, the communication unit 274 receives the postable image transmitted from the validation server 103 and supplies it to the information processing unit 261.
[0095] When posting is permitted as described above, the posting processing unit 147 of the imaging device 101 performs posting processing in step S115 to post the review. Corresponding to this processing, the posting processing unit 294 of the posting site server 104 performs posting processing in step S124 to accept the review posting and make the accepted review public. When the review posting is completed in this manner, the series of processes related to review posting is completed.
[0096] <Entry certificate processing flow> An example of the flow of the store entry certification process executed in FIG. 11 will be described with reference to the flowchart in FIG.
[0097] When the store entry authentication process is started, in step S161, the session key request unit 141 of the imaging device 101 controls the communication unit 124 to log in to the posting site server 104 and request a session key. During the login, the session key request unit 141 provides user information, which is information about the user, to the posting site server 104. This user information includes information necessary for logging in, such as a user ID and password, which are user identification information. In step S171, the request receiving unit 291 of the posting site server 104 receives the access, performs login processing for the imaging device 101, and accepts the request.
[0098] In step S172, the session key issuing unit 292 issues a session key linked to the user ID of the logged-in user. That is, the session key issuing unit 292 generates a session key linked to the user ID and controls the communication unit 274 to supply the session key to the image capture device 101. In step S162, the session key requesting unit 141 of the image capture device 101 acquires the session key via the communication unit 124.
[0099] When the session key is acquired, in step S163, the QR code generation unit 142 of the imaging device 101 uses the session key to generate a QR code with an expiration date. The expiration date of the information indicated by the QR code is predetermined for this QR code. An example of the information indicated by this QR code is shown in FIG. 13. As shown in FIG. 13, the information indicated by the QR code 301 includes user information. For example, the information includes a user ID, a session key issued by the posting site server 104 by the above-mentioned process, and location information indicating the location of the imaging device 101. In other words, the QR code generation unit 142 generates user information on the condition that a session is currently established with the posting site server 104, which is the destination of the captured image.
[0100] Of course, other information may be included. Note that this location information may be omitted. However, by including the location information of the image capture device 101 in the QR code, the reliability of the store entry certificate is improved.
[0101] 12, in step S163, the QR code providing unit 143 controls the display (display unit) of the output unit 122 to display an image of the QR code with an expiration date generated by the QR code generating unit 142. The user then holds the display displaying the image of the QR code with an expiration date over the reader 162 of the store terminal device 102. In other words, the QR code providing unit 143 provides user information to the store terminal device 102, which is an information processing device that stores image capture location information that is information indicating the image capture location (i.e., the location of the store).
[0102] In step S151, the QR code reading unit 192 of the store terminal device 102 controls the reader 162 to read the held-up QR code (i.e., the information indicated by the QR code). For example, the reader 162 captures an image of the held-up QR code using an image sensor or the like, and analyzes the QR code included in the captured image to read the information. The reader 162 supplies the read information to the information processing unit 161 (QR code reading unit 192). As described above, user information and the like is provided from the imaging device 101 to the store terminal device 102 using the QR code.
[0103] In step S152, the store entry certificate information providing unit 193 of the store terminal device 102 controls the communication unit 174 to supply the QR code read as described above (information indicated by the QR code), the store ID issued by the validation server 103, and a store entry flag indicating that the information is for proving entry to the store, as store entry certificate information, which is information for proving the user's entry to the validation server 103. In accordance with this control, the communication unit 174 transmits the store entry certificate information supplied from the store entry certificate information providing unit 193 to the validation server 103 via the network 105. In step S181, the store entry certificate information acquisition unit 242 of the validation server 103 acquires the store entry certificate information via the communication unit 224.
[0104] In step S182, the store entry certificate information verification unit 243 verifies whether the location information (information indicating the location of the imaging device 101) and the session key (session key issued by the posting site server 104) indicated by the QR code included in the store entry certificate information are valid.
[0105] For example, the store entry certificate information verification unit 243 determines whether or not the location information of the imaging device 101 corresponds to the location information of the store corresponding to the store ID, based on the verification data stored in the verification data storage unit 212. For example, if it is determined that the location information indicated by the QR code (the location information of the imaging device 101) matches the location information of the store or is located sufficiently close to it, the store entry certificate information verification unit 243 determines that the location information indicated by the QR code is valid.
[0106] Furthermore, for example, the store entry certificate information verification unit 243 inquires of the posting site server 104 whether the session key indicated by the QR code is valid. If the posting site server 104 recognizes that the session key is valid, the store entry certificate information verification unit 243 determines that the session key indicated by the QR code is valid.
[0107] If it is determined that the location information and session key indicated by the QR code are valid, the store entry time recording unit 244 records the current time (which may be the time the store entry certification information was sent or received) as the store entry time in the verification data storage unit 212 in step S183.
[0108] Then, in step S184, the imaging control unit 245 controls the communication unit 224 to supply control information permitting imaging to the imaging device 101. In accordance with this control, the communication unit 224 transmits the control information (control information permitting imaging) supplied from the imaging control unit 245 to the imaging device 101 via the network 105. In step S164, the control information acquisition unit 144 of the imaging device 101 acquires the control information via the communication unit 124.
[0109] In step S165, the imaging control unit 145 starts a dedicated application based on the control information and permits imaging using the imaging unit 112 (starts permission to capture images). That is, the imaging control unit 145 starts permission to capture images by the imaging unit 112 based on permission start information (control information that permits imaging) obtained from an external device (verification server 103) by providing user information to the information processing device (store terminal device 102). When permission to capture images starts, the store entry certification process ends, and the process returns to FIG. 11.
[0110] <Flow of imaging verification process> An example of the flow of the imaging verification process executed in FIG. 11 will be described with reference to the flowchart in FIG.
[0111] When the imaging verification process starts, in step S201, the imaging control unit 145 of the imaging device 101 controls the imaging unit 112 in accordance with a user's operation to capture an image using a dedicated application. The user uses the imaging unit 112 of the imaging device 101 to capture, for example, an image of a scene inside a store or a product sold in the store. The imaging unit 112 is controlled by the dedicated application to capture the image, generate a captured image, and supply the captured image to the imaging control unit 145. The imaging control unit 145 associates information such as the image capture time and image capture location with the captured image as metadata.
[0112] In step S202, the captured image providing unit 146 controls the communication unit 124 to provide the captured image and metadata to the verification server 103. The communication unit 124, under its control, transmits the captured image and metadata provided from the information processing unit 111 to the verification server via the network 105. In step S211, the captured image acquiring unit 246 of the verification server 103 acquires the captured image and metadata via the communication unit 224. Note that the provision of the captured image, etc. can be performed at any timing. For example, a plurality of captured images, etc. may be provided together, or a captured image may be provided each time it is generated.
[0113] In step S212, the captured image verification unit 247 verifies the captured image based on the metadata and the verification data stored in the verification data storage unit 212. For example, if location information indicating the image capture location included in the metadata corresponds to (matches or is located nearby) the location information of the store, the captured image verification unit 247 determines that the captured image is authentic. Furthermore, if the image capture time included in the metadata is a time between the store entry time and the store exit time (described later), the captured image verification unit 247 determines that the captured image is authentic. Of course, the captured image may be determined to be authentic only if both the image capture location and the image capture time are authentic.
[0114] If the captured image is valid, in step S213 the captured image management unit 248 stores the captured image as a postable image in the storage unit 223. When the process of step S213 ends, the imaging verification process ends and the process returns to FIG.
[0115] <Store Exit Certificate Processing Flow> An example of the flow of the store exit certificate process executed in FIG. 11 will be described with reference to the flowchart in FIG.
[0116] When the store exit certificate process is started, in step S241, the session key request unit 141 of the imaging device 101 controls the communication unit 124 to request a session key from the posting site server 104. In step S251, the request acceptance unit 291 of the posting site server 104 accepts the request. In step S252, the session key issuance unit 292 issues a session key linked to the user ID. In step S242, the session key request unit 141 of the imaging device 101 acquires the session key via the communication unit 124.
[0117] When the session key is acquired, the QR code generation unit 142 of the imaging device 101 generates a QR code with an expiration date using the session key in step S243. This QR code includes the same information as in the store entry certification process (e.g., FIG. 13). That is, the QR code generation unit 142 generates user information on the condition that a session is currently established with the posting site server 104, which is the destination of the captured image. Note that the location information may be omitted. However, by including the location information of the imaging device 101 in the QR code, the reliability of the store exit certification is improved.
[0118] In step S243, the QR code providing unit 143 controls the display (display unit) of the output unit 122 to display an image of the QR code with an expiration date generated by the QR code generating unit 142. Then, the user holds the display on which the image of the QR code with an expiration date is displayed over the reader 162 of the store terminal device 102. In other words, the QR code providing unit 143 provides the user information to the store terminal device 102, which is an information processing device that stores image capture location information that is information indicating the image capture location (i.e., the location of the store).
[0119] In step S231, the QR code reading unit 192 of the store terminal device 102 controls the reader 162 to read the held-up QR code (i.e., the information indicated by the QR code). The reader 162 supplies the read information to the information processing unit 161 (QR code reading unit 192). As described above, user information and the like is provided from the imaging device 101 to the store terminal device 102 using the QR code.
[0120] In step S232, the store exit certificate information providing unit 194 of the store terminal device 102 controls the communication unit 174 to supply the QR code (information indicated by the QR code) read as described above, the store ID issued by the validation server 103, and a store exit flag, which is flag information indicating that the information is for proving store exit, to the validation server 103 as store exit certificate information, which is information for proving the user's store exit. In accordance with this control, the communication unit 174 transmits the store exit certificate information supplied from the store exit certificate information providing unit 195 to the validation server 103 via the network 105. In step S261, the store exit certificate information acquisition unit 249 of the validation server 103 acquires the store exit certificate information via the communication unit 224.
[0121] In step S262, the store exit certificate information verification unit 250 verifies whether the location information (information indicating the location of the imaging device 101) indicated by the QR code included in the store exit certificate information is valid.
[0122] For example, the store exit certificate information verification unit 250 determines whether or not the location information of the imaging device 101 corresponds to the location information of the store corresponding to the store ID, based on the verification data stored in the verification data storage unit 212. For example, if it is determined that the location information indicated by the QR code (the location information of the imaging device 101) matches the location information of the store or is located sufficiently close to it, the store exit certificate information verification unit 250 determines that the location information indicated by the QR code is valid.
[0123] If the location information indicated by the QR code is determined to be valid, the store exit time recording unit 215 records the current time (which may be the time the store exit certification information was sent or received) as the store exit time in the verification data storage unit 212 in step S263.
[0124] Then, in step S264, the imaging control unit 245 controls the communication unit 224 to supply control information for terminating permission to capture images to the imaging device 101. In accordance with this control, the communication unit 224 transmits the control information (control information for terminating permission to capture images) supplied from the imaging control unit 245 to the imaging device 101 via the network 105. In step S244, the control information acquisition unit 144 of the imaging device 101 acquires the control information via the communication unit 124.
[0125] In step S245, the imaging control unit 145 terminates the dedicated application based on the control information and terminates permission to capture images using the imaging unit 112. That is, the imaging control unit 145 terminates (terminates) permission to capture images by the imaging unit 112 based on permission suspension information (control information to terminate permission to capture images) obtained from an external device (verification server 103) by providing user information to the information processing device (store terminal device 102). When permission to capture images is terminated, the store exit certification process is terminated, and the process returns to FIG. 11.
[0126] By performing each process as described above, the store entry time and store exit time of the user are verified, and furthermore, image capture is permitted for the time between the store entry time and the store exit time. In other words, it is guaranteed that the captured image was captured between the store entry time and the store exit time. Furthermore, since the location information guarantees that the image capture device 101 was located in the store between the store entry time and the store exit time, it is guaranteed that the captured image was captured at the store by a user who actually visited the store.
[0127] Therefore, it is possible to prevent the posting of fictitious reviews and to prevent a decrease in the reliability of reviews, that is, to prevent a decrease in the reliability of the services of the posting site.
[0128] <Posting process> 11, the posting site server 104 presents a list of images that can be posted to the imaging device 101, and the user of the imaging device 101 selects a desired image from the list and inputs a review comment. When the imaging device 101 uploads the selection information and review comment to the posting site server 104, the posting site server 104 links the uploaded review comment to the selected captured image based on the selection information. The posting site server 104 then makes the linked review comment and captured image public.
[0129] At this time, the imaging device 101 displays a review screen on the display (display unit) of the output unit 122 and accepts user operations. An example of the review screen is shown in Fig. 16. The review screen is a GUI (Graphical User Interface) for accepting user instructions regarding posting of a review.
[0130] First, the posting processing unit 147 of the imaging device 101 displays the review screen 311 shown on the right side of FIG. 16 on the display. For example, the review screen 311 is a screen that shows a list of stores that the user can review. That is, this review screen 311 displays a list of stores that the user has actually visited. For example, after visiting store C (when the store exit certification process is performed at store C), store C is added to this store list, as shown in review screen 312. This allows the user to select store C as the target of the review. That is, it becomes possible to post a review about store C.
[0131] For example, when an operation to select store C (e.g., clicking) is performed, the posting processing unit 147 of the imaging device 101 displays a review screen 313 on the display. The review screen 313 is a screen for creating a review of store C. As shown in Fig. 16 , the review screen 313 is provided with a review input field 321 for writing a review comment, an image selection field 322 for selecting a captured image, and a send button 323 for instructing uploading of the review.
[0132] In the image selection field 322, each postable image is displayed as an icon 331, and an upload button 332 for confirming the image selection is also displayed. When the user selects the icon 331 corresponding to the desired captured image in the image selection field 322 and presses the upload button 332, the captured image to be used for review is designated. The posting processing unit 147 of the imaging device 101 causes a review screen 314 to be displayed on the display. In the review screen 314, the icon 331 corresponding to the captured image selected by the user is displayed in a different manner from the icon 331 corresponding to the captured image not selected by the user so that the icon 331 can be distinguished from the icon 331 corresponding to the captured image not selected by the user.
[0133] When the user writes a review comment in the review input field 321, selects a captured image in the image selection field 322 as described above, and then presses the send button 323, the posting processing unit 147 uploads the entered review comment and the selection information of the captured image to the posting site server 104.
[0134] By posting using such a review screen, the user can easily post a review using a legitimate captured image.
[0135] <For store entry proof processing only> Of the store entry certification process and store exit certification process described above, only the store entry certification process may be performed. In that case, for example, as shown in A of Fig. 17, the store entry certification process may permit image capture within a predetermined valid period from the store entry time (X o'clock).
[0136] That is, the imaging control unit 145 may provide user information (e.g., a QR code) to an information processing device (e.g., the store terminal device 102) to permit the imaging unit 112 to capture an image within a validity period indicated by captured image validity period information obtained from an external device (e.g., the verification server 103). For example, the control information acquisition unit 144 may obtain captured image validity period information indicating a predetermined validity period after the user information is provided from the external device (e.g., the verification server 103), and the imaging control unit 145 may permit imaging within a specified validity period based on the captured image validity period information.
[0137] By doing so, the store exit certification process can be omitted, and the decrease in the reliability of reviews can be more easily prevented.
[0138] <For store exit certificate processing only> Of the store entry certification process and store exit certification process described above, only the store exit certification process may be performed. In that case, for example, as shown in B of Fig. 17, the store exit certification process may permit posting of captured images generated within a predetermined valid period up to the store exit time (Y o'clock).
[0139] That is, image capture may always be permitted, and the posting processing unit 147 may permit posting of captured images captured within a validity period indicated by captured image validity period information obtained from an external device (e.g., the verification server 103) by providing user information (e.g., a QR code) to an information processing device (e.g., the store terminal device 102). For example, the control information acquisition unit 144 may acquire captured image validity period information indicating a predetermined validity period before the user information is provided from the external device (e.g., the verification server 103), and the posting processing unit 147 may permit posting of captured images captured within the specified validity period based on the captured image validity period information.
[0140] By doing so, the store entry verification process can be omitted, and the reduction in the reliability of reviews can be more easily prevented.
[0141] 3. Second Embodiment <Exchanging store information> In the first embodiment, it has been described that in the store entry certification process and the store exit certification process, user information is supplied from the imaging device 101 to the store terminal device 102 using a QR code. However, instead, store information may be supplied from the store terminal device 102 to the imaging device 101 using a QR code. That is, in the store entry certification process of the first embodiment, the store terminal device 102 supplies the store entry certification information to the verification server 103, but in this embodiment, the imaging device 101 supplies the store entry certification information to the verification server 103. Similarly, in the store exit certification process of the first embodiment, the store terminal device 102 supplies the store exit certification information to the verification server 103, but in this embodiment, the imaging device 101 supplies the store exit certification information to the verification server 103.
[0142] For example, in an information processing system (e.g., review system 100) including an image processing device (e.g., image capture device 101), a first information processing device (e.g., store terminal device 102), and a second information processing device (e.g., verification server 103), the information processing system may include an acquisition control unit that permits acquisition of image capture location information based on permission information obtained from a destination (e.g., posting site server 104) on the condition that a session is being established between the image processing device and the destination of the captured image, an image capture location information acquisition unit that acquires image capture location information provided from the first information processing device in a state permitted by the acquisition control unit, an image capture location information user information provision unit that provides the image capture location information and user information acquired by the image capture location information acquisition unit to a second information processing device, and an image capture location information acquisition unit that acquires image capture location information and user information provided by the image capture location information user information provision unit, provided by the second information processing device. and an imaging control unit that permits imaging by the imaging unit within the validity period indicated by the captured image validity period information acquired by the captured image validity period information acquisition unit, wherein the first information processing device comprises an imaging location information generation unit that generates imaging location information on the condition that a session is being established with a destination of the captured image, and an imaging location information provision unit that provides the image processing device with the imaging location information generated by the imaging location information generation unit, and the second information processing device may comprise an imaging location information user information acquisition unit that acquires the imaging location information and user information provided by the image processing device, a verification unit that verifies the imaging location information and user information acquired by the imaging location information user information acquisition unit, and, when the verification by the verification unit determines that the imaging location information and the user information are valid, an imaging image validity period information provision unit that provides the image processing device with captured image validity period information corresponding to the imaging location information and the user information.
[0143] <Functional blocks of the imaging device> In this case, the functions realized by the information processing unit 111 of the imaging device 101 executing the application program are shown as functional blocks in Fig. 18. As shown in Fig. 18, by executing the application program, the information processing unit 111 can have, as functional blocks, a reader control unit 341, a QR code reading unit 342, a store entry certificate information providing unit 343, a control information acquisition unit 144, an imaging control unit 145, a store exit certificate information providing unit 344, and a posting processing unit 147.
[0144] The reader control unit 341 performs processing related to reader control. In this case, the imaging device 101 can use the imaging unit 112 as a QR code reader. The reader control unit 341 performs processing related to the control of the imaging unit 112.
[0145] The QR code reading unit 342 performs processing related to reading a QR code. The store entry certificate information providing unit 343 performs processing related to providing store entry certificate information that is information that certifies that a user has entered a store. The store exit certificate information providing unit 344 performs processing related to providing store exit certificate information that is information that certifies that a user has left a store.
[0146] <Functional block of store terminal device> In this case, the functions realized by the information processing unit 161 of the store terminal device 102 executing the application program are shown as functional blocks in Fig. 19. As shown in Fig. 19, by executing the application program, the information processing unit 161 can have, as functional blocks, a store information registration unit 191, a session key request unit 351, a QR code generation unit 352, and a QR code provision unit 353.
[0147] The session key request unit 351 performs processing related to a request for a session key. The QR code generation unit 352 performs processing related to the generation of a QR code. The QR code provision unit 353 performs processing related to the provision of a QR code.
[0148] <Submission site server function block> In this case, the functions realized by the information processing unit 211 of the posting site server 104 executing the application program are shown as functional blocks in Fig. 20. As shown in Fig. 20, by executing the application program, the information processing unit 261 can have, as functional blocks, a request receiving unit 291, a session key issuing unit 292, a reader control unit 361, a posted image obtaining unit 293, and a posting processing unit 294.
[0149] The reader control unit 361 performs processing related to control of the reader (imaging unit 112) of the imaging device 101.
[0150] <Entry certificate processing flow> In this case, the review posting process executed by the review system 100 is executed in the same manner as in the first embodiment (FIG. 11). The imaging verification process executed therein is also executed in the same manner as in the first embodiment (FIG. 13).
[0151] An example of the flow of the store entry certification process in this case will be described with reference to the flowcharts of FIGS.
[0152] When the store entry authentication process is initiated, the session key request unit 351 of the store terminal device 102 controls the communication unit 174 to request a session key from the posting site server 104 in step S301 of FIG. 21. At that time, the session key request unit 351 supplies store information, which is information about the store, to the posting site server 104. This store information includes, for example, a store ID, which is identification information of the store. As described in the first embodiment, the store ID is linked to location information of the store by the verification server 103. In other words, this store ID can also be considered location information of the store. Therefore, this store information can also be considered location information indicating the location of the store (in other words, the image capture location). The request receiving unit 291 of the posting site server 104 receives the request in step S321.
[0153] In step S322, the session key issuing unit 292 issues a session key linked to the supplied store ID. That is, the session key issuing unit 292 generates a session key linked to the store ID and controls the communication unit 274 to supply the session key to the store terminal device 102. In step S302, the session key requesting unit 351 of the store terminal device 102 acquires the session key via the communication unit 174.
[0154] In step S311, the reader control unit 341 of the imaging device 101 controls the communication unit 124 to log in to the posting site server 104 and request permission to start the reader. When logging in, the reader control unit 341 provides user information, which is information about the user, to the posting site server 104. This user information includes information necessary for logging in, such as a user ID and password, which are user identification information. In step S323, the request receiving unit 291 of the posting site server 104 receives the access, performs login processing for the imaging device 101, and accepts the request.
[0155] In step S324, the reader control unit 361 permits activation of the reader. That is, the reader control unit 361 controls the communication unit 274 to supply control information permitting activation of the reader to the imaging device 101. In step S312, the reader control unit 341 of the imaging device 101 acquires the control information via the communication unit 124. In step S313, the reader control unit 341 activates an application that uses the imaging unit 112 as a QR code reader based on the control information. This application uses the imaging unit 112 as a reader. That is, acquisition of imaging location information (store information) is permitted based on permission information (control information permitting activation of the reader) obtained from a provider of the captured image (e.g., the posting site server 104) on the condition that a session with the provider is being established.
[0156] When the store terminal device 102 acquires the session key, the QR code generation unit 352 generates a QR code with an expiration date using the session key in step S303. An example of information indicated by this QR code is shown in A of FIG. 23. As shown in A of FIG. 23, the information indicated by the QR code 371 includes store information. For example, the information includes a store ID, a session key issued by the posting site server 104 through the above-described process, a store entry flag, and the like. Of course, other information may also be included. In other words, the QR code generation unit 352 generates store information on the condition that a session is currently established with the posting site server 104, which is the destination of the captured image.
[0157] 21 , in step S303, the QR code providing unit 353 controls the display (display unit) of the output unit 172 to display an image of the QR code with an expiration date generated by the QR code generating unit 352. The user holds the reader (imaging unit 112) of the imaging device 101 over the display of the store terminal device 102 on which the image of the QR code with an expiration date is displayed. That is, the QR code providing unit 353 provides store information to the imaging device 101.
[0158] In step S314, the QR code reading unit 342 of the imaging device 101 controls the imaging unit 112 to read the QR code (i.e., the information indicated by the QR code) displayed on the display of the store terminal device 102. The imaging unit 112 captures an image of the QR code displayed on the display of the store terminal device 102, and analyzes the QR code included in the captured image to read the information. The imaging unit 112 supplies the read information to the information processing unit 111 (QR code reading unit 342). As described above, store information and the like is provided from the store terminal device 102 to the imaging device 101 using the QR code.
[0159] In step S315, the store entry certificate information providing unit 343 of the imaging device 101 controls the communication unit 124 to supply the QR code (information indicated by the QR code) read as described above and user information as store entry certificate information to the verification server 103. This user information includes the user ID and location information of the imaging device 101. In accordance with this control, the communication unit 124 transmits the store entry certificate information supplied from the store entry certificate information providing unit 343 to the verification server 103 via the network 105. In step S331, the store entry certificate information acquisition unit 242 of the verification server 103 acquires the store entry certificate information via the communication unit 224.
[0160] 22, the store entry certificate information verification unit 243 verifies whether the location information of the imaging device 101 included in the store entry certificate information is valid. For example, if it is determined that the location information of the imaging device 101 matches the location information corresponding to the store ID indicated by the QR code or is located sufficiently close, the store entry certificate information verification unit 243 determines that the location information of the imaging device 101 is valid.
[0161] If the location information of the imaging device 101 is determined to be valid, the store entry time recording unit 244 records the current time (which may be the time the store entry certification information was sent or received) as the store entry time in the verification data storage unit 212 in step S352.
[0162] Then, in step S353, the imaging control unit 245 controls the communication unit 224 to supply control information permitting imaging to the imaging device 101. In accordance with this control, the communication unit 224 transmits the control information (control information permitting imaging) supplied from the imaging control unit 245 to the imaging device 101 via the network 105. In step S341, the control information acquisition unit 144 of the imaging device 101 acquires the control information via the communication unit 124.
[0163] In step S342, the imaging control unit 145 starts a dedicated application based on the control information and permits imaging using the imaging unit 112 (starts permission to capture images). When permission to capture images starts, the store entry certification process ends, and the process returns to FIG. 11.
[0164] <Store Exit Certificate Processing Flow> An example of the flow of the store exit certificate process in this case will be described with reference to the flowcharts of FIGS.
[0165] When the store exit certification process is initiated, the session key request unit 351 of the store terminal device 102 controls the communication unit 174 to request a session key from the posting site server 104 in step S361 of FIG. 24. At that time, the session key request unit 351 provides store information, which is information about the store, to the posting site server 104. This store information includes, for example, a store ID, which is identification information of the store. The request receiving unit 291 of the posting site server 104 receives the request in step S381.
[0166] In step S382, the session key issuing unit 292 issues a session key linked to the supplied store ID. That is, the session key issuing unit 292 generates a session key linked to the store ID and controls the communication unit 274 to supply the session key to the store terminal device 102. In step S362, the session key requesting unit 351 of the store terminal device 102 acquires the session key via the communication unit 174.
[0167] In step S371, the reader control unit 341 of the imaging device 101 controls the communication unit 124 to request permission to start the reader from the posting site server 104. In step S383, the request receiving unit 291 of the posting site server 104 receives the request.
[0168] In step S384, the reader control unit 361 permits activation of the reader. That is, the reader control unit 361 controls the communication unit 274 to supply control information permitting activation of the reader to the imaging device 101. In step S372, the reader control unit 341 of the imaging device 101 acquires the control information via the communication unit 124. In step S373, the reader control unit 341 activates an application that uses the imaging unit 112 as a QR code reader based on the control information. This application uses the imaging unit 112 as a reader.
[0169] When the store terminal device 102 acquires the session key, the QR code generation unit 352 generates a QR code with an expiration date using the session key in step S363. An example of information indicated by this QR code is shown in B of FIG. 23. As shown in B of FIG. 23, the information indicated by the QR code 372 includes store information. For example, the information includes a store ID, a session key issued by the posting site server 104 through the above-described process, a store closure flag, and the like. Of course, other information may also be included. In other words, the QR code generation unit 352 generates store information on the condition that a session is currently established with the posting site server 104, which is the destination of the captured image.
[0170] 24 , in step S363, the QR code providing unit 353 controls the display (display unit) of the output unit 172 to display an image of the QR code with an expiration date generated by the QR code generating unit 352. The user holds the reader (imaging unit 112) of the imaging device 101 over the display of the store terminal device 102 on which the image of the QR code with an expiration date is displayed. That is, the QR code providing unit 353 provides store information to the imaging device 101.
[0171] In step S374, the QR code reading unit 342 of the imaging device 101 controls the imaging unit 112 to read the QR code (i.e., the information indicated by the QR code) displayed on the display of the store terminal device 102. The imaging unit 112 captures an image of the QR code displayed on the display of the store terminal device 102, and analyzes the QR code included in the captured image to read the information. The imaging unit 112 supplies the read information to the information processing unit 111 (QR code reading unit 342). As described above, store information and the like is provided from the store terminal device 102 to the imaging device 101 using the QR code.
[0172] In step S375, the store exit certificate information providing unit 344 of the imaging device 101 controls the communication unit 124 to provide the QR code (information indicated by the QR code) read as described above and user information as store exit certificate information to the verification server 103. This user information includes the user ID and location information of the imaging device 101. In accordance with its control, the communication unit 124 transmits the store exit certificate information provided by the store exit certificate information providing unit 344 to the verification server 103 via the network 105. In step S391, the store exit certificate information acquisition unit 249 of the verification server 103 acquires the store exit certificate information via the communication unit 224.
[0173] 25, the store exit certificate information verification unit 250 verifies whether the location information of the imaging device 101 included in the store exit certificate information is valid. For example, if it is determined that the location information of the imaging device 101 matches the location information corresponding to the store ID indicated by the QR code or is located sufficiently close, the store exit certificate information verification unit 250 determines that the location information of the imaging device 101 is valid.
[0174] If the location information of the imaging device 101 is determined to be valid, the store exit time recording unit 251 records the current time (which may be the time the store entry certification information was sent or received) as the store exit time in the verification data storage unit 212 in step S412.
[0175] Then, in step S413, the imaging control unit 245 controls the communication unit 224 to supply control information for terminating permission to capture images to the imaging device 101. In accordance with this control, the communication unit 224 transmits the control information (control information for terminating permission to capture images) supplied from the imaging control unit 245 to the imaging device 101 via the network 105. In step S401, the control information acquisition unit 144 of the imaging device 101 acquires the control information via the communication unit 124.
[0176] In step S402, the imaging control unit 145 ends the dedicated application based on the control information and ends imaging using the imaging unit 112 (ends permission for imaging). When permission for imaging ends, the store exit certificate process ends, and the process returns to FIG.
[0177] By executing each process in this manner, as in the first embodiment, it is possible to prevent the posting of fictitious reviews and to prevent a decrease in the reliability of reviews, i.e., to prevent a decrease in the reliability of the service provided by the posting site.
[0178] <For store entry proof processing only> In this case, as in the first embodiment, only the store entry certification process may be performed out of the store entry certification process and store exit certification process described above. For example, as shown in A of Fig. 17, the store entry certification process may permit image capture within a predetermined valid period from the store entry time (X o'clock).
[0179] That is, the imaging control unit 145 may provide the imaging location information and user information to an external device (e.g., the verification server 103) to permit imaging by the imaging unit 112 within the validity period indicated by captured image validity period information obtained from the external device. For example, the store entry certificate information providing unit 343 may provide the imaging location information and user information to the external device, so that the control information acquiring unit 144 acquires captured image validity period information indicating the validity period after the user information is provided from the external device, and the imaging control unit 145 may permit imaging within the specified validity period based on the captured image validity period information.
[0180] By doing so, the store exit certification process can be omitted, and the decrease in the reliability of reviews can be more easily prevented.
[0181] <For store exit certificate processing only> Also in this case, as in the case of the first embodiment, only the store exit certification process may be performed out of the store entry certification process and the store exit certification process described above. For example, as shown in B of Fig. 17, the store exit certification process may permit posting of captured images generated within a predetermined valid period up to the store exit time (Y o'clock).
[0182] That is, image capture may always be permitted, and the posting processing unit 147 may provide the image capture location information and user information to an external device (e.g., the verification server 103) to permit posting of captured images captured within the validity period indicated by captured image validity period information obtained from the external device. For example, the store exit certificate information providing unit 344 may provide the image capture location information and user information to the external device, causing the control information acquiring unit 144 to acquire captured image validity period information indicating the validity period before the user information was provided from the external device, and the image capture control unit 145 may permit image capture within the specified validity period based on the captured image validity period information.
[0183] By doing so, the store entry verification process can be omitted, and the reduction in the reliability of reviews can be more easily prevented.
[0184] 4. Third Embodiment <Image capture using registered imaging device> In the first and second embodiments, the image capture device 101 has been described as performing the store entry certification process, the store exit certification process, etc., but the store entry certification process, the store exit certification process, etc. may be performed by a device other than the image capture device. In this case, information about the image capture device may be registered in the review system 100 (such as the verification server 103). If the image capture device has been registered, the captured image is guaranteed (i.e., the store entry certification process, the store exit certification process), using the identification information of the image capture device, as in the first and second embodiments.
[0185] <Review System> An example of the main configuration of a review system in this case is shown in Fig. 26. The review system 400 shown in Fig. 26 is a system similar to the review system 100 (Fig. 2). The review system 400 has a user terminal device 401 and an imaging device 402 instead of the imaging device 101. The user terminal device 401 and the imaging device 402 are image processing devices owned by the user who posts the review.
[0186] The user terminal device 401, like the imaging device 101, has a communication function and can use this communication function to communicate with each device from the store terminal device 102 to the posting site server 104 via the network 105. The user terminal device 401 can also exchange information with the store terminal device 102 using a QR code. For example, the user terminal device 401 has a display function and can display a QR code or the like. The user terminal device 401 may also have a QR code reader function and be able to read information in a QR code. The user terminal device 401 has a communication function and can communicate with the imaging device 402 to exchange information (for example, captured images, control information, etc.).
[0187] The imaging device 402 has an imaging function and can capture an image of a subject to generate a captured image. The imaging device 402 also has a communication function and can communicate with the user terminal device 401 to exchange information (e.g., captured images, control information, etc.).
[0188] In the review system 400, the user terminal device 401 or the like performs store entry certification processing and store exit certification processing, and based on these processing, the imaging device 402 is permitted to take images from the time the user enters the store until the time the user leaves. The user terminal device 401 also supplies user information to the store terminal device 102 using a QR code. The store terminal device 102 performs store entry certification processing and store exit certification processing using the user information and location information indicating the location of the store.
[0189] This process ensures that an image is captured and a captured image is generated in the store from the time the user actually enters the store until the time the user leaves the store.
[0190] <User terminal device> 27 is a diagram showing an example of the main configuration of a user terminal device 401, which is an embodiment of an image processing device to which the present technology is applied. As shown in FIG. 27, the user terminal device 401 has an information processing unit 411, an input unit 421, an output unit 422, a storage unit 423, a communication unit 424, and a drive 425.
[0191] The information processing unit 411 is a computer that has, for example, a CPU, a ROM, a RAM, etc., and can realize various functions by executing application programs (software) using these. For example, the information processing unit 411 can install and execute an application program (software) that performs processing related to posting reviews.
[0192] The input unit 421 has input devices such as a keyboard, a mouse, a microphone, a touch panel, an input terminal, and the like, and can supply information input via these input devices to the information processing unit 411 .
[0193] The output unit 422 has output devices such as a display (display unit), a speaker (audio output unit), an output terminal, etc., and can output the information supplied from the information processing unit 411 via these output devices.
[0194] The storage unit 423 has a storage medium such as a hard disk, a RAM disk, or a non-volatile memory, and can store information supplied from the information processing unit 411 in that storage medium. The storage unit 423 can read out information stored in that storage medium and supply it to the information processing unit 411.
[0195] The communication unit 424 may have, for example, a network interface, receive information transmitted from other devices via the network 105, and supply the received information to the information processing unit 411. The communication unit 424 may transmit the information supplied from the information processing unit 411 to other devices via the network 105.
[0196] The drive 425 has an interface for a removable recording medium 431 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and can read information recorded on the removable recording medium 431 attached to the drive 425 and supply the information to the information processing unit 411. The drive 425 can record the information supplied from the information processing unit 411 on the writable removable recording medium 431 attached to the drive 425.
[0197] The information processing unit 411 loads and executes, for example, an application program stored in the storage unit 423. In this case, the information processing unit 411 can also store data, etc. necessary for executing various processes, as appropriate. The application program, data, etc. can be provided by being recorded on, for example, a removable recording medium 431 such as a package medium. In this case, the application program, data, etc. are read by a drive 425 to which the removable recording medium 431 is attached and installed in the storage unit 423 via the information processing unit 411. The application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In this case, the application program, data, etc. are received by the communication unit 424 and installed in the storage unit 423 via the information processing unit 411. The application program, data, etc. can also be installed in advance in the ROM within the information processing unit 411 or the storage unit 423.
[0198] <Functional blocks of user terminal device> Functions realized by the information processing unit 411 executing the application program are shown as functional blocks in Fig. 28. As shown in Fig. 28, by executing the application program, the information processing unit 411 can have, as functional blocks, an imaging device registration unit 441, a session key request unit 442, a QR code generation unit 443, a QR code provision unit 444, a control information acquisition unit 445, an imaging control unit 446, a digitally signed captured image acquisition unit 447, a digitally signed captured image provision unit 448, and a posting processing unit 449.
[0199] The imaging device registration unit 441 performs processing related to the registration of the imaging device 402. The session key request unit 442 performs processing related to a session key request. The QR code generation unit 443 performs processing related to the generation of a QR code. The QR code provision unit 444 performs processing related to the provision of a QR code. The control information acquisition unit 445 performs processing related to the acquisition of control information. The imaging control unit 446 performs processing related to the control of the imaging unit 112. The digitally signed captured image acquisition unit 447 performs processing related to the acquisition of a digitally signed captured image. The digitally signed captured image provision unit 448 performs processing related to the provision of a digitally signed captured image. The posting processing unit 449 performs processing related to the posting of a review.
[0200] <Functional blocks of the imaging device> The imaging device 402 has the same configuration as the imaging device 101. In other words, the configuration described with reference to FIG.
[0201] The functions realized by the information processing unit 111 of the imaging device 402 executing the application program are shown as functional blocks in Fig. 29. As shown in Fig. 29, by executing the application program, the information processing unit 111 can have an imaging processing unit 451, a metadata adding unit 452, a digital signature adding unit 453, and a digitally signed captured image supply unit 454 as functional blocks.
[0202] The imaging processing unit 451 performs processing related to imaging. The metadata adding unit 452 performs processing related to adding (linking) metadata to a captured image. The digital signature adding unit 453 performs processing related to adding (linking) digital signatures to a captured image and metadata. The digitally signed captured image supply unit 454 performs processing related to supplying digitally signed captured images.
[0203] <Verification server function block> The store terminal device 102 and the posting site server 104 each have the same configuration as in the first and second embodiments and can realize the same functions (have the same functional blocks).
[0204] 30 shows, as functional blocks, functions realized by the information processing unit 211 of the verification server 103 executing an application program. As shown in Fig. 30, by executing the application program, the information processing unit 211 can have, as functional blocks, a store ID issuance registration unit 241, an imaging device registration unit 461, a store entry certificate information acquisition unit 242, a store entry certificate information verification unit 243, a store entry time recording unit 244, an imaging control unit 245, a store exit certificate information acquisition unit 249, a store exit certificate information verification unit 250, a store exit time recording unit 251, a digitally signed captured image acquisition unit 462, a digitally signed captured image verification unit 463, a captured image supply unit 464, and a posting control unit 252.
[0205] The imaging device registration unit 461 performs processing related to registration of the imaging device 402. The digitally signed captured image acquisition unit 462 performs processing related to acquisition of a digitally signed captured image. The digitally signed captured image verification unit 463 performs processing related to verification of a digitally signed captured image. The captured image supply unit 464 performs processing related to supply of a captured image.
[0206] <Process flow for posting reviews> An example of the flow of processing related to the posting of reviews executed by the review system 400 will be described with reference to the flowcharts of Figures 31 and 32. Each device in the review system 400 executes each process according to the flow shown in this flowchart, thereby enabling users to post reviews.
[0207] When the process starts, a process of registering a store (store information) is performed. In step S501 of FIG. 31 , the store information registration unit 191 of the store terminal device 102 controls the communication unit 174 to provide store information, which is information about the store where the store terminal device 102 is installed, to the validation server 103 via the network 105, and registers the store information in the validation server 103. In step S541, the store ID issuance and registration unit 241 of the validation server 103 controls the communication unit 224 to receive the store information transmitted by the process of step S501. Based on the control, the communication unit 224 receives the store information transmitted via the network 105 and supplies it to the information processing unit 211.
[0208] This store information includes location information indicating the location of the store. In step S542, the store ID issuance registration unit 241 generates a store ID, which is identification information of the store linked to the location information. The store ID issuance registration unit 241 controls the communication unit 224 to transmit the store ID to the store terminal device 102. Based on this control, the communication unit 224 transmits the store ID supplied from the information processing unit 211 to the store terminal device 102 via the network 105. The store ID issuance registration unit 241 also supplies the store ID to the verification data storage unit 212 to store (register) it.
[0209] In step S502, the store information registration unit 191 controls the communication unit 174 to receive the store ID transmitted by the processing in step S542. Based on this control, the communication unit 174 receives the store ID transmitted via the network 105 and supplies it to the information processing unit 161. The store information registration unit 191 supplies the store ID to the storage unit 173, where it is stored.
[0210] Next, processing is performed to register the imaging device 402. In step S511, the imaging device registration unit 441 of the user terminal device 401 controls the communication unit 424 to supply the imaging device ID, which is identification information of the imaging device 402, to the verification server 103. In step S543, the imaging device registration unit 461 of the verification server 103 acquires the imaging device ID via the communication unit 224, associates it with the user ID, and stores it in the verification data storage unit 212 (registers the imaging device ID).
[0211] Once the imaging device 402 is registered, the store terminal device 102 through the posting site server 104 and the user terminal device 401 perform store entry authentication processing (steps S503, S512, S531, and S544). This store entry authentication processing is performed in the same manner as in the first embodiment (FIG. 12). However, the processing performed by the imaging device 101 is executed by the user terminal device 401.
[0212] When the store entry authentication process is completed, the user terminal device 401 and the imaging device 402 perform imaging processing to capture images in the store and generate captured images (steps S513 and S521).
[0213] When a user leaves a store, the store terminal device 102, the posting site server 104, and the user terminal device 401 perform store exit certification processing (steps S504, S514, S532, and S545). This store exit certification processing is performed in the same manner as in the first embodiment (FIG. 15). However, the processing performed by the imaging device 101 is executed by the user terminal device 401.
[0214] After the store exit certification process is performed, the captured image is uploaded. In step S571 in Fig. 32, the digitally signed captured image acquisition unit 462 of the verification server 103 controls the communication unit 224 to supply control information permitting posting to the user terminal device 401. In step S551, the digitally signed captured image provision unit 448 of the user terminal device 401 acquires the control information via the communication unit 424.
[0215] In step S552, the digitally signed captured image providing unit 448 controls the communication unit 424 based on the permission to provide (upload) the digitally signed captured image acquired from the imaging device 402 to the verification server 103. In step S572, the digitally signed captured image acquiring unit 462 of the verification server 103 acquires the digitally signed captured image transmitted from the user terminal device 401 via the communication unit 224. Since the digital signature is attached, tampering with the captured image is suppressed.
[0216] In step S573, the digitally signed captured image verification unit 463 uses the verification data stored in the verification data storage unit 212 to verify the location information indicating the capture location, the capture time, and the image capture device ID, which is identification information of the image capture device 402 that generated the captured image, contained in the metadata of the acquired digitally signed captured image.
[0217] If the imaging device ID is a registered ID, the imaging location corresponds to the location of the store, and the imaging time is between the store entry time and the store exit time, the digitally signed captured image verification unit 463 determines that the captured image is authentic. If determined to be authentic, the captured image supply unit 464 controls the communication unit 224 in step S574 to supply the captured image to the posting site server 104 as an image that can be posted. In step S561, the posted image acquisition unit 293 of the posting site server 104 acquires the captured image via the communication unit 274. Note that a digital signature may be attached to this captured image.
[0218] The posting processing unit 449 of the user terminal device 401 performs posting processing in step S553 to post a review. In response to this processing, the posting processing unit 294 of the posting site server 104 performs posting processing in step S562 to accept the review posting and make the accepted review public. When the review posting is completed in this manner, the series of processes related to review posting is completed.
[0219] <Image capture process flow> An example of the flow of the imaging process executed in FIG. 31 will be described with reference to the flowchart in FIG.
[0220] When the imaging process is started, in step S581, the imaging control unit 446 of the user terminal device 401 controls the communication unit 424 to start permitting imaging by supplying control information to the imaging device 402. In step S591, the imaging processing unit 451 of the imaging device 402 acquires the control information via the communication unit 124.
[0221] In step S592, the imaging processing unit 451 of the imaging device 402 captures an image using the imaging unit 112 in accordance with a user's operation. The user captures, for example, an image of a scene inside a store or a commodity sold in the store using the imaging unit 112 of the imaging device 402. The imaging unit 112 captures an image of a subject to generate a captured image and supplies the captured image to the imaging processing unit 451.
[0222] In step S593, the metadata adding unit 452 adds (links) information such as the image capture time and image capture location to the captured image as metadata. An example of information included in this metadata is shown in FIG. 34. The metadata 471 shown in FIG. 34 includes an image capture device ID, which is identification information of the image capture device 402 that captured the image, location information indicating the image capture location (the location of the image capture device 402), and the image capture time. Of course, information other than these may also be included in the metadata. In step S594, the digital signature adding unit 453 generates a digital signature for the captured image and metadata, and adds (links) the digital signature to the captured image.
[0223] In step S595, the digitally signed captured image supplying unit 454 controls the communication unit 124 to supply the digitally signed captured image (captured image+metadata+digital signature) generated as described above to the user terminal device 401. In step S582, the digitally signed captured image acquiring unit 447 of the user terminal device 401 acquires the digitally signed captured image via the communication unit 424. In step S583, the digitally signed captured image acquiring unit 447 stores the acquired digitally signed captured image in the storage unit 423.
[0224] In step S584, the imaging control unit 446 controls the communication unit 424 to supply control information for ending permission to capture images to the imaging device 402. In step S596, the imaging processing unit 451 of the imaging device 402 acquires the control information via the communication unit 124. The imaging processing unit 451 ends imaging based on the acquired control information. When imaging ends, the imaging process ends, and the process returns to FIG. 31.
[0225] By performing each process as described above, even when capturing images using a registered imaging device 402, store entry certification processing and store exit certification processing can be performed in the same manner as in the first embodiment, and it can be guaranteed that the captured images were captured at the store by a user who actually visited the store.
[0226] Therefore, it is possible to prevent the posting of fictitious reviews and to prevent a decrease in the reliability of reviews, that is, to prevent a decrease in the reliability of the services of the posting site.
[0227] <For store entry proof processing only> In this embodiment, as in the first embodiment, only the store entry certification process may be performed out of the store entry certification process and the store exit certification process. In that case, as shown in A of FIG. 17, for example, the store entry certification process may permit image capture within a predetermined valid period from the store entry time (X o'clock). By doing so, the store exit certification process can be omitted, making it easier to prevent a decrease in the reliability of reviews.
[0228] <For store exit certificate processing only> In this embodiment, as in the first embodiment, only the store exit certification process may be performed between the store entry certification process and the store exit certification process. In this case, as shown in B of FIG. 17, for example, the store exit certification process may allow posting of captured images generated within a predetermined valid period up to the store exit time (Y o'clock). By doing so, the store entry certification process can be omitted, making it easier to prevent a decrease in the reliability of reviews.
[0229] <Exchanging store information> As in the second embodiment, in the store entry certification process and store exit certification process, store information may be provided from the store terminal device 102 to the user terminal device 401 using a QR code. In this case, the user terminal device 401 provides the store entry certification information and store exit certification information to the verification server 103.
[0230] <Functional blocks of user terminal device> In this case, the functions realized by the information processing unit 411 of the user terminal device 401 executing the application program are shown as functional blocks in Fig. 35. As shown in Fig. 35, by executing the application program, the information processing unit 411 can have, as functional blocks, an imaging device registration unit 441, a reader control unit 481, a QR code reading unit 482, a store entry certificate information providing unit 483, a control information acquisition unit 445, an imaging control unit 446, a digitally signed captured image acquisition unit 447, a store exit certificate information providing unit 484, a digitally signed captured image providing unit 448, and a posting processing unit 449.
[0231] Reader control unit 481 performs processing related to reader control. In this case, user terminal device 401 has a QR code reader as an input device for input unit 421. Reader control unit 481 performs processing related to the control of the reader (input unit 421).
[0232] The QR code reading unit 482 performs processing related to reading a QR code. The store entry certification information providing unit 483 performs processing related to providing store entry certification information which is information that certifies that a user has entered a store. The store exit certification information providing unit 484 performs processing related to providing store exit certification information which is information that certifies that a user has left a store.
[0233] <Function blocks of other devices> In this case, the imaging device 402 may have the same functional blocks as in the example of Fig. 29. The store terminal device 102 may have the same functional blocks as in the example of Fig. 19. The verification server 103 may have the same functional blocks as in the example of Fig. 30. The posting site server 104 may have the same functional blocks as in the example of Fig. 20.
[0234] <Process flow> In this case, the process for posting a review is executed in the same manner as in the flowcharts of Figures 31 and 32. Also, the imaging process is executed in the same manner as in the flowchart of Figure 33. The store entry certification process is executed in the same manner as in the flowcharts of Figures 21 and 22, and the store exit certification process is executed in the same manner as in the flowcharts of Figures 24 and 25. However, in the store entry certification process and the store exit certification process, the processes that are described as being executed by the imaging device 101 are executed by the user terminal device 401.
[0235] By executing each process in this manner, it is possible to prevent the posting of fictitious reviews and to prevent a decrease in the reliability of reviews, just as in the case where user information is supplied from the user terminal device 401 to the store terminal device 102 using a QR code in the store entry certification process and the store exit certification process. In other words, it is possible to prevent a decrease in the reliability of the review service provided by the posting site.
[0236] <For store entry proof processing only> In this case, as in the second embodiment, only the store entry certification process may be performed between the store entry certification process and the store exit certification process. In that case, as shown in A of FIG. 17, for example, the store entry certification process may permit image capture within a predetermined valid period from the store entry time (X o'clock). By doing so, the store exit certification process can be omitted, making it easier to prevent a decrease in the reliability of reviews.
[0237] <For store exit certificate processing only> In this case, as in the second embodiment, only the store exit certification process may be performed between the store entry certification process and the store exit certification process. In this case, as shown in B of FIG. 17, for example, the store exit certification process may allow posting of captured images generated within a predetermined valid period up to the store exit time (Y o'clock). By doing so, the store entry certification process can be omitted, making it easier to prevent a decrease in the reliability of reviews.
[0238] 5. Fourth Embodiment <Image capture using unregistered imaging device> In the third embodiment, it has been described that an image is captured using a registered imaging device 402, but this is not limiting, and it is also possible to ensure that a captured image generated using an unregistered imaging device is an image captured at a store by a user who actually visited the store. In this case, since the imaging device is unregistered, identification information cannot be used, so the captured image is guaranteed (i.e., store entry certification process and store exit certification process) using a session key, which is session identification information.
[0239] <Review System> An example of the main configuration of the review system in this case is shown in Fig. 36. The review system 500 shown in Fig. 36 is a system similar to the review system 400 (Fig. 26). The review system 500 has an unregistered imaging device 502 instead of the registered imaging device 402. This imaging device 502, like the user terminal device 401, is an image processing device owned by the user who posts the review.
[0240] The imaging device 502 is the same device as the imaging device 402, except that it is not registered in the review system 500 (such as the verification server 103) (i.e., it is not issued an imaging device ID). In other words, the imaging device 502 has the same configuration as the imaging device 402 (i.e., the configuration shown in FIG. 3), and can realize the same functions (functional blocks shown in FIG. 29) by executing an application program.
[0241] In the review system 500, the user terminal device 401 or the like performs store entry certification processing and store exit certification processing, and based on these processing, the imaging device 502 is permitted to take images from the time the user enters the store until the time the user leaves. In addition, the user terminal device 401 provides user information to the store terminal device 102 using a QR code. The store terminal device 102 performs store entry certification processing and store exit certification processing using the user information and location information indicating the location of the store.
[0242] This process ensures that an image is captured and a captured image is generated in the store from the time the user actually enters the store until the time the user leaves the store.
[0243] <Functional blocks of user terminal device> In this case, the functions realized by the information processing unit 411 executing the application program are shown as functional blocks in Fig. 37. As shown in Fig. 37, by executing the application program, the information processing unit 411 can have, as functional blocks, a session key request unit 442, a QR code generation unit 443, a QR code provision unit 444, a control information acquisition unit 445, an imaging control unit 446, a digitally signed captured image acquisition unit 447, a digitally signed captured image provision unit 448, and a posting processing unit 449.
[0244] <Verification server function block> In this case, the functions realized by the information processing unit 211 of the verification server 103 executing the application program are shown as functional blocks in Fig. 38. As shown in Fig. 38, by executing the application program, the information processing unit 211 can have, as functional blocks, a store ID issuance registration unit 241, a store entry certificate information acquisition unit 242, a store entry certificate information verification unit 243, a store entry time recording unit 244, an image capture control unit 245, a session key issuance registration unit 511, a store exit certificate information acquisition unit 249, a store exit certificate information verification unit 250, a store exit time recording unit 251, a digitally signed captured image acquisition unit 462, a digitally signed captured image verification unit 463, a captured image supply unit 464, and a posting control unit 252.
[0245] Session key issuance and registration unit 511 performs processing related to the issuance and registration of session keys.
[0246] <Other devices> The store terminal device 102 and the posting site server 104 each have the same configuration as in the first and second embodiments and can realize the same functions (have the same functional blocks).
[0247] <Process flow for posting reviews> An example of the flow of processing related to the posting of reviews executed by the review system 500 will be described with reference to the flowcharts of Figures 39 and 40. Each device in the review system 500 executes each process according to the flow shown in this flowchart, thereby enabling users to post reviews.
[0248] When the process starts, a process of registering a store (store information) is performed. In step S601 of FIG. 39, the store information registration unit 191 of the store terminal device 102 controls the communication unit 174 to provide store information, which is information about the store where the store terminal device 102 is installed, to the validation server 103 via the network 105, and registers the store information in the validation server 103. In step S641, the store ID issuance and registration unit 241 of the validation server 103 controls the communication unit 224 to receive the store information transmitted by the process of step S601. Based on this control, the communication unit 224 receives the store information transmitted via the network 105 and provides it to the information processing unit 211.
[0249] This store information includes location information indicating the location of the store. In step S642, the store ID issuance registration unit 241 generates a store ID, which is identification information of the store linked to the location information. The store ID issuance registration unit 241 controls the communication unit 224 to transmit the store ID to the store terminal device 102. Based on this control, the communication unit 224 transmits the store ID supplied from the information processing unit 211 to the store terminal device 102 via the network 105. The store ID issuance registration unit 241 also supplies the store ID to the verification data storage unit 212 to store (register) it.
[0250] In step S602, the store information registration unit 191 controls the communication unit 174 to receive the store ID transmitted by the processing in step S642. Based on this control, the communication unit 174 receives the store ID transmitted via the network 105 and supplies it to the information processing unit 161. The store information registration unit 191 supplies the store ID to the storage unit 173, where it is stored.
[0251] Next, the store terminal device 102 through the posting site server 104 and the user terminal device 401 perform store entry authentication processing (steps S603, S611, S631, and S643). This store entry authentication processing is performed in the same manner as in the first embodiment (FIG. 12). However, the processing performed by the imaging device 101 is executed by the user terminal device 401.
[0252] When the store entry certification process is completed, in step S644, the session key issuance and registration unit 511 of the validation server 103 generates a session key linked to the user ID and store ID obtained by the store entry certification process, and controls the communication unit 224 to supply the session key to the user terminal device 401. In other words, the session key issuance and registration unit 511 issues a session key linked to the user ID and store ID to the user terminal device 401. In step S612, the control information acquisition unit 445 of the user terminal device 401 acquires the session key issued by the validation server 103 as control information via the communication unit 424.
[0253] In step S645, the session key issue / registration unit 511 of the validation server 130 associates the session key with the store entry time obtained by the store entry certification process and stores the associated session key in the validation data storage unit 212.
[0254] When the user terminal device 401 acquires the session key, the user terminal device 401 and the imaging device 502 perform imaging processing (steps S613 and S621). That is, imaging is performed in the store in accordance with the user's operation, and a captured image is generated.
[0255] When a user leaves a store, the store terminal device 102, the posting site server 104, and the user terminal device 401 perform store exit certification processing (steps S604, S614, S632, and S646). This store exit certification processing is performed in the same manner as in the first embodiment (FIG. 15). However, the processing performed by the imaging device 101 is executed by the user terminal device 401.
[0256] After the store exit certification process is performed, the captured image is uploaded. In step S671 of Fig. 40, the digitally signed captured image acquisition unit 462 of the verification server 103 controls the communication unit 224 to supply control information permitting posting to the user terminal device 401. In step S651, the digitally signed captured image provision unit 448 of the user terminal device 401 acquires the control information via the communication unit 424.
[0257] In step S652, the digitally signed captured image providing unit 448 controls the communication unit 424 based on the permission to provide (upload) the digitally signed captured image acquired from the imaging device 402 to the verification server 103. In step S672, the digitally signed captured image acquiring unit 462 of the verification server 103 acquires the digitally signed captured image transmitted from the user terminal device 401 via the communication unit 224. Since the digital signature is attached, tampering with the captured image is suppressed.
[0258] In step S673, the digitally signed captured image verification unit 463 verifies the location information indicating the capture location, the capture time, and the session key contained in the metadata of the acquired digitally signed captured image using the verification data stored in the verification data storage unit 212.
[0259] If the session key in the metadata is the session key issued to the imaging device 502 by the verification server 103, the imaging location corresponds to the location of the store, and the imaging time is between the store entry time and the store exit time, the digitally signed captured image verification unit 463 determines that the captured image is authentic. If determined to be authentic, the captured image supply unit 464 controls the communication unit 224 in step S674 to supply the captured image to the posting site server 104 as an image that can be posted. In step S661, the posted image acquisition unit 293 of the posting site server 104 acquires the captured image via the communication unit 274. Note that a digital signature may be attached to this captured image.
[0260] The posting processing unit 449 of the user terminal device 401 performs posting processing in step S653 to post a review. Corresponding to this processing, the posting processing unit 294 of the posting site server 104 performs posting processing in step S662 to accept the review posting and make the accepted review public. When the review posting is completed in this manner, the series of processes related to review posting is completed.
[0261] <Image capture process flow> An example of the flow of the imaging process executed in FIG. 39 will be described with reference to the flowchart in FIG.
[0262] When the imaging process is started, in step S681, the imaging control unit 446 of the user terminal device 401 controls the communication unit 424 to supply a session key and control information for starting permission to capture images to the imaging device 502. In step S691, the imaging processing unit 451 of the imaging device 502 acquires the control information and the session key via the communication unit 124.
[0263] In step S692, the imaging processing unit 451 of the imaging device 502 captures an image using the imaging unit 112 in accordance with a user's operation. The user captures, for example, an image of a scene inside a store or a commodity sold in the store using the imaging unit 112 of the imaging device 502. The imaging unit 112 captures an image of a subject to generate a captured image and supplies the captured image to the imaging processing unit 451.
[0264] In step S693, the metadata adding unit 452 adds (links) information such as the image capture time, image capture location, and session key to the captured image as metadata. An example of information included in this metadata is shown in FIG. 42. The metadata 521 shown in FIG. 42 includes the session key issued by the verification server 103, location information indicating the image capture location (the location of the image capture device 502), and the image capture time. Of course, information other than these may also be included in the metadata. In step S694, the digital signature adding unit 453 generates a digital signature for the captured image and metadata, and adds (links) the digital signature to the captured image.
[0265] In step S695, the digitally signed captured image supplying unit 454 controls the communication unit 124 to supply the digitally signed captured image (captured image+metadata+digital signature) generated as described above to the user terminal device 401. In step S682, the digitally signed captured image acquiring unit 447 of the user terminal device 401 acquires the digitally signed captured image via the communication unit 424. In step S683, the digitally signed captured image acquiring unit 447 stores the acquired digitally signed captured image in the storage unit 423.
[0266] In step S684, the imaging control unit 446 controls the communication unit 424 to supply control information for ending permission to capture image to the imaging device 502. In step S596, the imaging processing unit 451 of the imaging device 502 acquires the control information via the communication unit 124. The imaging processing unit 451 ends imaging based on the acquired control information. When imaging ends, the imaging process ends, and the process returns to FIG.
[0267] By performing each process as described above, even when capturing images using an unregistered imaging device 502, the store entry certification process and store exit certification process can be performed in the same manner as in the first embodiment, and it can be guaranteed that the captured images were captured at the store by a user who actually visited the store.
[0268] Therefore, it is possible to prevent the posting of fictitious reviews and to prevent a decrease in the reliability of reviews, that is, to prevent a decrease in the reliability of the services of the posting site.
[0269] <For store entry proof processing only> In this embodiment, as in the first embodiment, only the store entry certification process may be performed out of the store entry certification process and the store exit certification process. In that case, as shown in A of FIG. 17, for example, the store entry certification process may permit image capture within a predetermined valid period from the store entry time (X o'clock). By doing so, the store exit certification process can be omitted, making it easier to prevent a decrease in the reliability of reviews.
[0270] <Exchanging store information> As in the second embodiment, in the store entry certification process and store exit certification process, store information may be provided from the store terminal device 102 to the user terminal device 401 using a QR code. In this case, the user terminal device 401 provides the store entry certification information and store exit certification information to the verification server 103.
[0271] <Functional blocks of user terminal device> In this case, the functions realized by the information processing unit 411 of the user terminal device 401 executing the application program are shown as functional blocks in Fig. 43. As shown in Fig. 43, by executing the application program, the information processing unit 411 can have, as functional blocks, a session key request unit 442, a reader control unit 481, a QR code reading unit 482, a store entry certificate information providing unit 483, a control information acquiring unit 445, an imaging control unit 446, a digitally signed captured image acquiring unit 447, a store exit certificate information providing unit 484, a digitally signed captured image providing unit 448, and a posting processing unit 449.
[0272] <Function blocks of other devices> In this case, the imaging device 502 may have the same functional blocks as in the example of Fig. 29. The store terminal device 102 may have the same functional blocks as in the example of Fig. 19. The verification server 103 may have the same functional blocks as in the example of Fig. 38. The posting site server 104 may have the same functional blocks as in the example of Fig. 20.
[0273] <Process flow> In this case, the process for posting a review is executed in the same manner as in the flowcharts of Figures 39 and 40. Also, the imaging process is executed in the same manner as in the flowchart of Figure 41. The store entry certification process is executed in the same manner as in the flowcharts of Figures 21 and 22, and the store exit certification process is executed in the same manner as in the flowcharts of Figures 24 and 25. However, in the store entry certification process and the store exit certification process, the processes that are described as being executed by the imaging device 101 are executed by the user terminal device 401.
[0274] By executing each process in this manner, it is possible to prevent the posting of fictitious reviews and to prevent a decrease in the reliability of reviews, just as in the case where user information is supplied from the user terminal device 401 to the store terminal device 102 using a QR code in the store entry certification process and the store exit certification process. In other words, it is possible to prevent a decrease in the reliability of the review service provided by the posting site.
[0275] <For store entry proof processing only> In this case, as in the second embodiment, only the store entry certification process may be performed between the store entry certification process and the store exit certification process. In that case, as shown in A of FIG. 17, for example, the store entry certification process may permit image capture within a predetermined valid period from the store entry time (X o'clock). By doing so, the store exit certification process can be omitted, making it easier to prevent a decrease in the reliability of reviews.
[0276] 6. Fifth Embodiment The store entry certification process and store exit certification process may be performed using a receipt issued when a product is purchased in a store.
[0277] For example, in an information processing system (e.g., review system 100) including an image processing device (e.g., imaging device 101), a first information processing device (e.g., store terminal device 102), and a second information processing device (e.g., verification server 103), the image processing device includes a user information generation unit that generates user information, a user information provision unit that provides the user information generated by the user information generation unit to the first information processing device, a stay information extraction unit that extracts stay information from a receipt on which stay information including a session key and time information issued based on the user information and imaging location information provided to the first information processing device by the user information provision unit is printed, a stay information provision unit that provides the stay information extracted by the stay information extraction unit to a second information processing device, and a captured image provision unit that provides the second information processing device with a captured image generated by imaging unit, and the first information processing device includes a user information acquisition unit that acquires the user information provided by the image processing device, and transmits the imaging location information and the user information acquired by the user information acquisition unit to the second information processing device. the second information processing device may include an imaging location information user information providing unit that provides the imaging location information to the first information processing device, a session key acquiring unit that acquires a session key provided from the second information processing device, and a receipt issuing unit that issues a receipt on which stay information including the session key acquired by the session key acquiring unit and time information is printed, wherein the second information processing device may include an imaging location information user information acquiring unit that acquires the imaging location information and user information provided from the first information processing device, a verification unit that verifies the imaging location information and user information acquired by the imaging location information user information acquiring unit, a session key providing unit that issues a session key corresponding to the imaging location information and the user information and provides it to the first information processing device when the verification by the verification unit determines that the imaging location information and the user information are valid, a stay information acquiring unit that acquires the stay information provided from the image processing device, a captured image acquiring unit that acquires captured images provided from the image processing device, and a control unit that controls permission to post the captured images acquired by the captured image acquiring unit based on the stay information acquired by the stay information acquiring unit.
[0278] Such a method will be described using a review system 400 (FIG. 26) as an example.
[0279] <Functional blocks of user terminal device> In this case, the functions realized by the information processing unit 411 executing the application program are shown as functional blocks in Fig. 44. As shown in Fig. 44, by executing the application program, the information processing unit 411 can have, as functional blocks, an imaging device registration unit 441, a QR code generation unit 443, a QR code provision unit 444, an imaging control unit 446, a digitally signed captured image acquisition unit 447, a digitally signed captured image provision unit 448, a posting processing unit 449, a QR code reading unit 482, and a store entry / exit certificate information provision unit 531.
[0280] The store entry / exit certificate information providing unit 531 performs processing related to the provision of store entry / exit certificate information, which is information that certifies the user's store entry and exit.
[0281] <Functional block of store terminal device> In this case, the functions realized by the information processing unit 161 of the store terminal device 102 executing the application program are shown as functional blocks in Figure 45. As shown in Figure 45, by executing the application program, the information processing unit 161 can have the following functional blocks: a store information registration unit 191, a QR code reading unit 192, a user store information provision unit 541, a session key acquisition unit 542, and a receipt issuing unit 543.
[0282] The user store information providing unit 541 performs processing related to providing user information and store information. The session key obtaining unit 542 performs processing related to obtaining a session key. The receipt issuing unit 543 performs processing related to issuing a receipt.
[0283] <Verification server function block> In this case, the functions realized by the information processing unit 211 of the verification server 103 executing the application program are shown as functional blocks in Fig. 46. As shown in Fig. 46, by executing the application program, the information processing unit 211 can have, as functional blocks, a store ID issuance and registration unit 241, an imaging device registration unit 461, a user store information acquisition unit 551, a user store information verification unit 552, a session key issuance unit 553, a store entry / exit certificate information acquisition unit 554, a store entry / exit time recording unit 555, a digitally signed captured image acquisition unit 462, a digitally signed captured image verification unit 463, a captured image supply unit 464, and a posting control unit 252.
[0284] The user store information acquisition unit 551 performs processing related to the acquisition of user information and store information. The user store information verification unit 552 performs processing related to the verification of user information and store information. The session key issuance unit 553 performs processing related to the issuance of a session key. The store entry / exit certificate information acquisition unit 554 performs processing related to the acquisition of store entry / exit certificate information. The store entry / exit time recording unit 555 performs processing related to the recording of store entry times and store exit times.
[0285] <Function blocks of other devices> The imaging device 402 may have the same functional blocks as those in the example of Fig. 29. The posting site server 104 may have the same functional blocks as those in the example of Fig. 20.
[0286] <Process flow for posting reviews> An example of the flow of the process for posting a review executed by the review system 400 in this case will be described with reference to the flowcharts in Figures 47 and 48. Each device in the review system 400 executes each process according to the flow shown in this flowchart, thereby enabling users to post reviews.
[0287] When the process starts, a process of registering a store (store information) is performed. In step S701 of FIG. 47, the store information registration unit 191 of the store terminal device 102 controls the communication unit 174 to provide store information, which is information about the store where the store terminal device 102 is installed, to the validation server 103 via the network 105, and registers the store information in the validation server 103. In step S741, the store ID issuance and registration unit 241 of the validation server 103 controls the communication unit 224 to receive the store information transmitted by the process of step S701. Based on this control, the communication unit 224 receives the store information transmitted via the network 105 and supplies it to the information processing unit 211.
[0288] This store information includes location information indicating the location of the store. In step S742, the store ID issuance registration unit 241 generates a store ID, which is identification information of the store linked to the location information. The store ID issuance registration unit 241 controls the communication unit 224 to transmit the store ID to the store terminal device 102. Based on its control, the communication unit 224 transmits the store ID supplied from the information processing unit 211 to the store terminal device 102 via the network 105. In other words, the store ID issuance registration unit 241 issues a store ID to the store terminal device 102. The store ID issuance registration unit 241 also supplies the store ID to the verification data storage unit 212 to store it (registers the store ID).
[0289] In step S702, the store information registration unit 191 controls the communication unit 174 to receive the store ID transmitted by the processing in step S742. Based on this control, the communication unit 174 receives the store ID transmitted via the network 105 and supplies it to the information processing unit 161. The store information registration unit 191 supplies the store ID to the storage unit 173, where it is stored.
[0290] Next, processing is performed to register the imaging device 402. In step S711, the imaging device registration unit 441 of the user terminal device 401 controls the communication unit 424 to supply the imaging device ID, which is identification information of the imaging device 402, to the verification server 103. In step S743, the imaging device registration unit 461 of the verification server 103 acquires the imaging device ID via the communication unit 224, associates it with the user ID, and stores it in the verification data storage unit 212 (registers the imaging device ID).
[0291] Once the imaging device 402 is registered, the user terminal device 401 and the imaging device 402 perform imaging processing to capture images in the store and generate captured images (steps S712 and S721).
[0292] When a user completes a transaction, such as when leaving a store, the store terminal device 102 issues a receipt showing the transaction results (i.e., the transaction results for the products purchased by the user). At this time, the store terminal device 102, the posting site server 104, and the user terminal device 401 perform a store entry / exit certification process, which is a process related to certification of the user's entry and exit from the store (steps S703, S713, S731, and S744). As will be described in detail later, this store entry / exit process is performed using the receipt issued by the store terminal device 102.
[0293] After the store entry / exit authentication process is performed, the captured image is uploaded. In step S771 of Fig. 48, the digitally signed captured image acquisition unit 462 of the verification server 103 controls the communication unit 224 to supply control information permitting posting to the user terminal device 401. In step S751, the digitally signed captured image provision unit 448 of the user terminal device 401 acquires the control information via the communication unit 424.
[0294] In step S752, the digitally signed captured image providing unit 448 controls the communication unit 424 based on the permission to provide (upload) the digitally signed captured image acquired from the imaging device 402 to the verification server 103. In step S772, the digitally signed captured image acquiring unit 462 of the verification server 103 acquires the digitally signed captured image transmitted from the user terminal device 401 via the communication unit 224. Since the digital signature is attached, tampering with the captured image is suppressed.
[0295] In step S773, the digitally signed captured image verification unit 463 uses the verification data stored in the verification data storage unit 212 to verify the location information indicating the capture location, the capture time, and the image capture device ID, which is identification information of the image capture device 402 that generated the captured image, contained in the metadata of the acquired digitally signed captured image.
[0296] If the imaging device ID is a registered ID, the imaging location corresponds to the location of the store, and the imaging time is between the store entry time and the store exit time, the digitally signed captured image verification unit 463 determines that the captured image is authentic. If determined to be authentic, the captured image supply unit 464 controls the communication unit 224 in step S774 to supply the captured image to the posting site server 104 as an image that can be posted. In step S761, the posted image acquisition unit 293 of the posting site server 104 acquires the captured image via the communication unit 274. Note that a digital signature may be attached to this captured image.
[0297] The posting processing unit 449 of the user terminal device 401 performs posting processing in step S753 to post a review. In response to this processing, the posting processing unit 294 of the posting site server 104 performs posting processing in step S762 to accept the review posting and make the accepted review public. When the review posting is completed in this manner, the series of processes related to review posting is completed.
[0298] <Entry / Exit Proof Processing Flow> An example of the flow of the store entry / exit certification process executed in FIG. 47 will be described with reference to the flowchart in FIG.
[0299] When the store entry / exit certification process is started, the QR code generation unit 443 of the user terminal device 401 generates a QR code with an expiration date in step S801. The information indicated by this QR code includes, for example, user information such as a user ID and location information indicating the location of the image capture device 402. Of course, other information may also be included. Note that this location information may be omitted. However, by including the location information of the image capture device 402 in the QR code, the reliability of the store entry / exit certification is improved.
[0300] The QR code providing unit 444 controls the display (display unit) of the output unit 422 to display an image of the QR code with an expiration date generated by the QR code generating unit 443. The user then holds the display displaying the image of the QR code with an expiration date over the reader 162 of the store terminal device 102. In other words, the QR code providing unit 444 provides user information to the store terminal device 102, which is an information processing device that stores image capture location information that is information indicating the image capture location (i.e., the location of the store).
[0301] In step S801, the QR code reading unit 192 of the store terminal device 102 controls the reader 162 to read the held-up QR code (i.e., the information indicated by the QR code). For example, the reader 162 captures an image of the held-up QR code using an image sensor or the like, and analyzes the QR code included in the captured image to read the information. The reader 162 supplies the read information to the information processing unit 161 (QR code reading unit 192). As described above, user information and the like is provided from the user terminal device 401 to the store terminal device 102 using the QR code.
[0302] In step S802, the user store information providing unit 541 of the store terminal device 102 controls the communication unit 174 to supply the QR code read as described above (user information indicated by the QR code) and the store ID (i.e., store information) issued by the validation server 103 to the validation server 103. In accordance with the control, the communication unit 174 transmits the information (user information and store information) supplied from the user store information providing unit 541 to the validation server 103 via the network 105. In step S821, the user store information acquiring unit 551 of the validation server 103 acquires the information (user information and store information) via the communication unit 224.
[0303] In step S822, the user store information verification unit 552 verifies whether the location information indicated by the QR code (information indicating the location of the imaging device 402) is valid. For example, the store entry certificate information verification unit 243 determines whether the location information of the imaging device 402 corresponds to the location information of the store corresponding to the store ID, based on the verification data stored in the verification data storage unit 212. For example, if it is determined that the location information indicated by the QR code (the location information of the imaging device 402) matches the location information of the store or is located sufficiently close to the store, the user store information verification unit 552 determines that the location information indicated by the QR code is valid.
[0304] If it is determined that the location information indicated by the QR code is valid, then in step S823 the session key issuing unit 553 issues a session key linked to the user ID and store ID supplied from the store terminal device 102. That is, the session key issuing unit 553 generates a session key linked to the user ID and store ID, and controls the communication unit 224 to supply the session key to the store terminal device 102. In step S803, the session key obtaining unit 542 of the store terminal device 102 obtains the session key supplied from the validation server 103 via the communication unit 174.
[0305] Once the session key is acquired, the receipt issuing unit 543 issues a receipt with a QR code printed on it in step S802. The QR code is printed on this receipt along with information about the results of the transaction performed by the user.
[0306] An example of the information indicated by the QR code printed on the receipt is shown in Figure 50. As shown in Figure 50, the information indicated by the QR code 561 includes stay information, which is information indicating that the user stayed at the store. For example, this stay information may include information such as a session key issued by the validation server 103, the time of entry (which may be the time an action equivalent to entering the store, such as the time of the first order), the time of exit (which may be the time an action equivalent to leaving the store, such as the time the transaction was processed), and an entry / exit flag indicating that the information is for verifying the user's entry and exit from the store. Of course, information other than the above may also be included in the information indicated by the QR code.
[0307] When a receipt is issued, the user operates user terminal device 401 to read the QR code (information indicated by the QR code) printed on the receipt. In response to this user operation, in step S812, QR code reading unit 482 controls the reader, which is an input device included in input unit 421, to read the QR code printed on the receipt.
[0308] In step S813, the store entry / exit certificate information providing unit 531 controls the communication unit 424 to supply the QR code (or information indicated by the QR code) as store entry / exit certificate information to the validation server 103. In step S824, the store entry / exit certificate information acquiring unit 554 of the validation server 103 acquires the store entry / exit certificate information supplied from the user terminal device 401 via the communication unit 224.
[0309] In step S825, the store entry / exit time recording unit 555 stores the store entry time and store exit time included in the acquired store entry / exit certification information in the verification data storage unit 212. When the processing of step S825 ends, the store entry / exit certification processing ends, and the processing returns to FIG.
[0310] By performing the above-described processes, the store entry time and store exit time of the user are also verified, and it is guaranteed that the captured image was captured between the store entry time and the store exit time. Furthermore, since the location information guarantees that the image capture device 101 was located in the store between the store entry time and the store exit time, it is guaranteed that the captured image was captured in the store by a user who actually visited the store.
[0311] Therefore, it is possible to prevent the posting of fictitious reviews and to prevent a decrease in the reliability of reviews, that is, to prevent a decrease in the reliability of the services of the posting site.
[0312] Although the case of the review system 400 has been described above, the present technology can also be applied to the review system 500. That is, an unregistered imaging device 502 can be applied instead of the registrable imaging device 402. The present technology can also be applied to the review system 100. That is, the imaging device and the user terminal device may be integrated. That is, the imaging device 101 can be applied instead of the user terminal device 401 and the imaging device 402.
[0313] <7. Notes> <Captured image> The captured image may be a still image or a moving image.
[0314] <Combination> If store entry certification is provided, it is possible to upload both an image captured using a dedicated camera app (without an electronic signature) and an image with an electronic signature after leaving the store. If store entry and exit certification is provided using a receipt, an image with an electronic signature is uploaded. The store entry certification process and the store exit certification process may be performed using different methods. For example, the store entry certification process may be performed using the method described in the first embodiment, and the store exit certification process may be performed using the method described in the second embodiment.
[0315] <Location information> The location information indicating the locations of the store, the imaging device, etc. may be acquired by any method, for example, by using a global positioning system (GPS) or a beacon.
[0316] <Review subject> The subject of the review is arbitrary. For example, it may be a restaurant, a retail store, a store that provides a service, a product, or an event or facility where photography is permitted (for example, a hotel, a tourist attraction, a concert venue, etc.).
[0317] <Entry / Exit Proof> In the above, QR codes have been described as being used to exchange store information and user information in the store entry certificate process, store exit certificate process, and store entry / exit certificate process, but the method for exchanging this information is not limited to QR codes and may be any local communication method that can limit the location. For example, information may be exchanged via Wi-Fi or near-field communication.
[0318] For example, if the imaging device 101 or the user terminal device 401 is connected to the store's Wi-Fi, the user may be considered to have entered the store. In addition, in the case of store entry verification processing, the store entry time may be obtained from the time of an online reservation made via a review site. Furthermore, it may be possible to allow the user's companion to post information. In this case, the user ID of the companion may be entered into the reservation details, or the QR code of the reservation may be read with a reader.
[0319] The store exit certification process may also be performed using electronic money or QR code payment processing. For example, the store exit time may be recorded by linking with a payment app. A QR code may be captured when entering or leaving the store and uploaded together with the posted image. The store entry and exit times may also be recorded from the QR code image when uploaded.
[0320] Also, when only store entry certification is required, the location information may be monitored periodically, and if the user leaves the store for a certain period of time after entering, the user may be considered to have left the store.
[0321] <About linking> In this specification, the terms "link," "assign," and "associate" all mean combining multiple items into one, such as combining image data and metadata into one piece of data. In other words, these terms are synonymous.
[0322] Note that "combining" means making it possible to use (link) one piece of data when processing the other piece of data. In other words, the data may be physically combined into one piece of data, or may be separate pieces of data. For example, information linked to image data may be transmitted over a transmission path separate from that of the image data. Also, for example, information linked to image data may be recorded on a recording medium separate from that of the image data (or on a different recording area of the same recording medium).
[0323] <Hardware> The above-described series of processes can be executed by software (application program) or by hardware.
[0324] <Applicable targets of this technology> The present technology can be applied to any configuration. For example, the present technology can be implemented as a part of an apparatus, such as a processor as a system LSI (Large Scale Integration), a module using multiple processors, a unit using multiple modules, or a set in which other functions are added to a unit.
[0325] Furthermore, for example, the present technology can also be applied to a network system configured with multiple devices. For example, the present technology may be implemented as cloud computing in which multiple devices share and collaborate on processing via a network. For example, the present technology may be implemented in a cloud service that provides services to any terminal, such as a computer, a portable information processing terminal, or an IoT (Internet of Things) device.
[0326] In this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.
[0327] <Fields and applications where this technology can be applied> Systems, devices, processing units, etc. to which the present technology is applied can be used in any field, such as transportation, medical care, crime prevention, agriculture, livestock farming, mining, beauty, factories, home appliances, weather, and nature monitoring. In addition, the applications thereof are also arbitrary.
[0328] <Other> The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present technology.
[0329] For example, a configuration described as one device (or processing unit) may be divided and configured as multiple devices (or processing units). Conversely, configurations described above as multiple devices (or processing units) may be combined and configured as one device (or processing unit). Of course, configurations other than those described above may be added to the configuration of each device (or each processing unit). Furthermore, as long as the configuration and operation of the entire system are substantially the same, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).
[0330] Furthermore, for example, the above-described program may be executed in any device, as long as the device has the necessary functions (functional blocks, etc.) and can obtain the necessary information.
[0331] Also, for example, each step of a single flowchart may be executed by one device, or may be shared and executed by multiple devices. Furthermore, when one step includes multiple processes, the multiple processes may be executed by one device, or may be shared and executed by multiple devices. In other words, multiple processes included in one step can be executed as multiple step processes. Conversely, processes described as multiple steps can be executed collectively as one step.
[0332] For example, the steps of a program executed by a computer may be executed in chronological order in the order described herein, or may be executed in parallel or individually at the required timing, such as when a call is made. In other words, as long as no contradiction occurs, the steps may be executed in an order different from the order described above. Furthermore, the steps of this program may be executed in parallel with the processing of another program, or may be executed in combination with the processing of another program.
[0333] Furthermore, for example, multiple technologies related to the present technology can be implemented independently and independently, as long as no contradiction occurs. Of course, any multiple technologies can also be implemented in combination. For example, part or all of the present technology described in any embodiment can be implemented in combination with part or all of the present technology described in another embodiment. Furthermore, part or all of any of the above-described present technologies can be implemented in combination with other technologies not described above.
[0334] The present technology can also be configured as follows. (1) a user information generating unit that generates user information on the condition that a session is being established with a destination of the captured image; a providing unit that provides the user information to an information processing device that stores imaging location information; An image processing device comprising: (2) the user information generation unit generates a QR code as the user information; The providing unit causes a display unit to display an image showing the QR code. The image processing device according to (1). (3) a control unit that permits an image capture by an image capture unit within a valid period indicated by captured image valid period information obtained from an external device by providing the user information to the information processing device; Further equipped An image processing device according to (1) or (2). (4) The control unit provides the user information to the information processing device, and thereby acquires the captured image validity period information indicating the validity period after the user information is provided from the external device. (3) An image processing device according to the present invention. (5) The control unit controls an imaging device having the imaging unit, and causes the imaging device to associate identification information of the imaging device with the captured image generated by the imaging device. An image processing device according to (3) or (4). (6) The control unit supplies the identification information of the session to an imaging device having the imaging unit, and causes the imaging device to associate the identification information of the session with the captured image generated by the imaging device. An image processing device according to any one of (3) to (5). (7) The information processing device further includes a control unit that allows posting of the captured image captured within a validity period indicated by captured image validity period information obtained from an external device by providing the user information to the information processing device. An image processing device according to (1) or (2). (8) The control unit provides the user information to the information processing device, and thereby acquires the captured image validity period information indicating the validity period before the user information is provided from the external device. (7) An image processing device according to (7). (9) starting permission for image capture by an image capture unit based on permission start information obtained from an external device by providing the user information to the information processing device; The permission for capturing an image by the imaging unit is stopped based on permission stop information obtained from an external device by providing the user information to the information processing device. Further provided with a control unit An image processing device according to (1) or (2).
[0335] (10) an acquisition control unit that permits acquisition of imaging location information based on permission information obtained from a destination of the captured image on the condition that a session with the destination of the captured image is being established; an imaging location information acquisition unit that acquires the imaging location information provided from an information processing device associated with an imaging location in a state permitted by the acquisition control unit; a providing unit that provides the imaging location information and user information to an external device that verifies the user information; An image processing device comprising: (11) The imaging location information acquisition unit acquires the imaging location information by capturing an image of a QR code corresponding to the imaging location information. The image processing device according to (10). (12) The image capturing device further includes an image capturing control unit that permits image capturing by the image capturing unit within a valid period indicated by captured image valid period information obtained from the external device by providing the image capturing location information and the user information to the external device. The image processing device according to (10) or (11). (13) The imaging control unit provides the imaging location information and the user information to the external device, and thereby acquires the captured image validity period information indicating the validity period after the user information is provided from the external device. (12) An image processing device according to (12). (14) The imaging control unit controls an imaging device having the imaging unit, and causes identification information of the imaging device to be linked to the captured image generated by the imaging device. The image processing device according to (12) or (13). (15) The imaging control unit supplies identification information of the session to an imaging device having the imaging unit, and causes the imaging device to associate the identification information of the session with the captured image generated by the imaging device. An image processing device according to any one of (12) to (14). (16) The image capturing device further includes a posting control unit that allows posting of captured images captured within a validity period indicated by captured image validity period information obtained from the external device by providing the image capturing location information and the user information to the external device. The image processing device according to (10) or (11). (17) The posting control unit provides the imaging location information and the user information to the external device, and thereby acquires the captured image validity period information indicating the validity period before the user information is provided from the external device. (16) An image processing device according to (16). (18) Providing the imaging location information and the user information to the external device, and starting permission for imaging by the imaging unit based on permission start information obtained from the external device; The imaging location information and the user information are provided to the external device, and permission for imaging by the imaging unit is stopped based on permission stop information obtained from the external device. Further provided with an imaging control unit The image processing device according to (10) or (11).
[0336] (19) An information processing system including an image processing device, a first information processing device, and a second information processing device, The image processing device includes: a user information generating unit that generates user information on the condition that a session is being established with a destination of the captured image; a user information providing unit that provides the user information generated by the user information generating unit to the first information processing device; a captured image valid period information acquisition unit provided by the second information processing device and configured to acquire captured image valid period information corresponding to the user information provided by the user information provision unit; an imaging control unit that permits imaging by the imaging unit within the valid period indicated by the captured image valid period information acquired by the captured image valid period information acquisition unit; Equipped with The first information processing device a user information acquisition unit that acquires the user information provided by the image processing device; an image capture location information and user information providing unit that provides the second information processing device with image capture location information and the user information acquired by the user information acquiring unit; Equipped with The second information processing device an image capture location information and user information acquisition unit that acquires the image capture location information and the user information provided by the first information processing device; a verification unit that verifies the image capture location information and the user information acquired by the image capture location information and user information acquisition unit; a captured image validity period information providing unit that provides the captured image validity period information corresponding to the image shooting location information and the user information to the image processing device when the image shooting location information and the user information are determined to be valid as a result of the verification by the verification unit; An information processing system comprising:
[0337] (20) An information processing system including an image processing device, a first information processing device, and a second information processing device, The image processing device includes: an acquisition control unit that permits acquisition of imaging location information based on permission information obtained from a destination of the captured image on the condition that a session with the destination of the captured image is being established; an image capture location information acquisition unit that acquires the image capture location information provided by the first information processing device in a state permitted by the acquisition control unit; an image capturing location information and user information providing unit that provides the image capturing location information and user information acquired by the image capturing location information acquiring unit to the second information processing device; a captured image valid period information acquisition unit provided by the second information processing device and acquiring captured image valid period information corresponding to the image capturing location information and the user information provided by the image capturing location information user information provision unit; an imaging control unit that permits imaging by the imaging unit within the valid period indicated by the captured image valid period information acquired by the captured image valid period information acquisition unit; Equipped with The first information processing device an image capture location information generating unit that generates the image capture location information under the condition that a session is being established with the destination of the captured image; an image capturing location information providing unit that provides the image capturing location information generated by the image capturing location information generating unit to the image processing device; Equipped with The second information processing device an image capture location information and user information acquisition unit that acquires the image capture location information and the user information provided by the image processing device; a verification unit that verifies the image capture location information and the user information acquired by the image capture location information and user information acquisition unit; a captured image validity period information providing unit that provides the captured image validity period information corresponding to the image shooting location information and the user information to the image processing device when the image shooting location information and the user information are determined to be valid as a result of the verification by the verification unit; An information processing system comprising:
[0338] (21) An information processing system including an image processing device, a first information processing device, and a second information processing device, The image processing device includes: a user information generating unit that generates user information; a user information providing unit that provides the user information generated by the user information generating unit to the first information processing device; a stay information extraction unit that extracts stay information from a receipt on which stay information including a session key and time information issued based on the user information and image capture location information provided to the first information processing device by the user information providing unit is printed; and a stay information providing unit that provides the stay information extracted by the stay information extracting unit to the second information processing device; a captured image providing unit that provides a captured image generated by the imaging unit to the second information processing device; Equipped with The first information processing device a user information acquisition unit that acquires the user information provided by the image processing device; an image capturing location information user information providing unit that provides the image capturing location information and the user information acquired by the user information acquiring unit to the second information processing device; a session key acquisition unit that acquires the session key provided by the second information processing device; a receipt issuing unit that issues the receipt on which the session key acquired by the session key acquiring unit and the stay information including the time information are printed; Equipped with The second information processing device an image capture location information and user information acquisition unit that acquires the image capture location information and the user information provided from the first information processing device; a verification unit that verifies the image capture location information and the user information acquired by the image capture location information and user information acquisition unit; a session key providing unit that issues the session key corresponding to the shooting location information and the user information and provides the session key to the first information processing device when the verification unit determines that the shooting location information and the user information are valid as a result of the verification; a stay information acquisition unit that acquires the stay information provided from the image processing device; a captured image acquisition unit that acquires the captured image provided from the image processing device; a control unit that controls permission to post the captured image acquired by the captured image acquisition unit based on the stay information acquired by the stay information acquisition unit; An information processing system comprising: [Explanation of symbols]
[0339] 100 review system, 101 imaging device, 102 store terminal device, 103 verification server, 104 posting site server, 105 network, 112 imaging unit, 141 session key request unit, 142 QR code generation unit, 143 QR code provision unit, 144 control information acquisition unit, 145 imaging control unit, 146 captured image provision unit, 147 posting processing unit, 162 reader, 191 store information registration unit, 192 QR code reading unit, 193 store entry certificate information provision unit, 194 store exit certificate information provision unit, 212 verification data storage unit, 241 store ID issuance registration unit, 242 store entry certificate information acquisition unit, 243 store entry certificate information verification unit, 244 store entry time recording unit, 245 imaging control unit, 246 Captured image acquisition unit, 247 Captured image verification unit, 248 Captured image management unit, 249 Store exit certificate information acquisition unit, 250 Store exit certificate information verification unit, 251 Store exit time recording unit, 252 Post control unit, 262 Post data storage unit, 291 Request reception unit, 292 Session key issuing unit, 293 Posted image acquisition unit, 294 Post processing unit, 341 Reader control unit, 342 QR code reading unit, 343 Store entry certificate information provision unit, 344 Store exit certificate information provision unit, 351 Session key request unit, 352 QR code generation unit, 353 QR code provision unit, 361 Reader control unit, 400 Review system, 401 User terminal device, 402 Imaging device, 441 Imaging device registration unit, 442 Session key request unit, 443 QR code generation unit, 444 QR code provision unit, 445 Control information acquisition unit, 446 Imaging control unit, 447 Digitally signed captured image acquisition unit, 448 Digitally signed captured image provision unit, 449 Posting processing unit, 451 Imaging processing unit, 452 Metadata assignment unit, 453 Digital signature assignment unit, 454 Digitally signed captured image supply unit, 461 Imaging device registration unit, 462 Digitally signed captured image verification unit, 463 Digitally signed captured image verification unit, 464 Captured image supply unit, 481 Reader control unit, 482 QR code reading unit, 483 Store entry certificate information provision unit, 484 Store exit certificate information provision unit, 500 Review system, 502 Imaging device, 511 Session key issuance registration unit, 531 Store entry / exit certificate information provision unit,541 User store information providing unit, 542 Session key acquisition unit, 543 Receipt issuing unit, 551 User store information acquisition unit, 552 User store information verification unit, 553 Session key issuing unit, 554 Store entry / exit certification information acquisition unit, 555 Store entry / exit time recording unit,
Claims
1. a user information generating unit that generates a QR code as user information on the condition that a session is being established with a destination of the captured image; a providing unit that provides the user information to an information processing device that stores image capture location information by displaying an image representing the QR code on a display unit; a control unit that permits an image capture by an image capture unit within a valid period indicated by captured image valid period information obtained from an external device by providing the user information to the information processing device; An image processing device comprising:
2. The control unit provides the user information to the information processing device, and thereby acquires, from the external device, the captured image validity period information indicating the validity period after the user information is provided. The image processing device according to claim 1 .
3. The control unit controls an imaging device having the imaging unit, and causes identification information of the imaging device to be associated with the captured image generated by the imaging device. The image processing device according to claim 1 .
4. The control unit supplies the identification information of the session to an imaging device having the imaging unit, and causes the imaging device to associate the identification information of the session with the captured image generated by the imaging device. The image processing device according to claim 1 .
5. A user information generation unit that generates a QR code as user information on the condition that a session is being established with a destination of the captured image; a providing unit that provides the user information to an information processing device that stores image capture location information by displaying an image representing the QR code on a display unit; a control unit that provides the user information to the information processing device to permit posting of the captured image captured within a validity period indicated by captured image validity period information obtained from an external device; An image processing device comprising:
6. The control unit provides the user information to the information processing device, and thereby acquires, from the external device, the captured image validity period information indicating the validity period before the user information is provided. The image processing device according to claim 5 .
7. A user information generation unit that generates a QR code as user information on the condition that a session is being established with a destination of the captured image; a providing unit that provides the user information to an information processing device that stores image capture location information by displaying an image representing the QR code on a display unit; providing the user information to the information processing device, and starting permission for image capture by an image capture unit based on permission start information obtained from an external device; The permission for capturing an image by the imaging unit is stopped based on permission stop information obtained from an external device by providing the user information to the information processing device. Control unit and An image processing device comprising:
8. an acquisition control unit that permits acquisition of imaging location information based on permission information obtained from a destination of the captured image on the condition that a session with the destination of the captured image is being established; an imaging location information acquisition unit that, in a state permitted by the acquisition control unit, acquires the imaging location information provided from the information processing device by capturing an image of a QR code corresponding to the imaging location information displayed on a display unit of the information processing device associated with the imaging location; a providing unit that provides the imaging location information and user information to an external device that verifies the user information; an imaging control unit that provides the external device with the imaging location information and the user information, thereby permitting the imaging unit to capture an image within a valid period indicated by captured image valid period information obtained from the external device; An image processing device comprising:
9. The imaging control unit provides the imaging location information and the user information to the external device, and thereby acquires the captured image validity period information indicating the validity period after the user information is provided from the external device. The image processing device according to claim 8 .
10. The imaging control unit controls an imaging device having the imaging unit, and associates identification information of the imaging device with the captured image generated by the imaging device. The image processing device according to claim 8 .
11. The imaging control unit supplies the identification information of the session to an imaging device having the imaging unit, and causes the imaging device to associate the identification information of the session with the captured image generated by the imaging device. The image processing device according to claim 8 .
12. An acquisition control unit that permits acquisition of imaging location information based on permission information obtained from a destination of a captured image on the condition that a session is being established with the destination of the captured image; an imaging location information acquisition unit that, in a state permitted by the acquisition control unit, acquires the imaging location information provided from the information processing device by capturing an image of a QR code corresponding to the imaging location information displayed on a display unit of the information processing device associated with the imaging location; a providing unit that provides the imaging location information and user information to an external device that verifies the user information; a posting control unit that allows posting of captured images captured within a valid period indicated by captured image valid period information obtained from the external device by providing the image capturing location information and the user information to the external device; An image processing device comprising:
13. The posting control unit provides the imaging location information and the user information to the external device, and thereby acquires the captured image validity period information indicating the validity period before the user information is provided from the external device. The image processing device according to claim 12.
14. An acquisition control unit that permits acquisition of imaging location information based on permission information obtained from a destination of a captured image on the condition that a session is being established with the destination of the captured image; an imaging location information acquisition unit that, in a state permitted by the acquisition control unit, acquires the imaging location information provided from the information processing device by capturing an image of a QR code corresponding to the imaging location information displayed on a display unit of the information processing device associated with the imaging location; a providing unit that provides the imaging location information and user information to an external device that verifies the user information; providing the imaging location information and the user information to the external device, and starting permission for imaging by the imaging unit based on permission start information obtained from the external device; The imaging location information and the user information are provided to the external device, and permission for imaging by the imaging unit is stopped based on permission stop information obtained from the external device. Imaging control unit An image processing device comprising:
15. An information processing system including an image processing device, a first information processing device, and a second information processing device, The image processing device includes: a user information generating unit that generates user information on the condition that a session is being established with a destination of the captured image; a user information providing unit that provides the user information generated by the user information generating unit to the first information processing device; a captured image valid period information acquisition unit provided by the second information processing device and configured to acquire captured image valid period information corresponding to the user information provided by the user information provision unit; an imaging control unit that permits imaging by the imaging unit within the valid period indicated by the captured image valid period information acquired by the captured image valid period information acquisition unit; Equipped with The first information processing device a user information acquisition unit that acquires the user information provided by the image processing device; an image capture location information and user information providing unit that provides the second information processing device with image capture location information and the user information acquired by the user information acquiring unit; Equipped with The second information processing device an image capture location information and user information acquisition unit that acquires the image capture location information and the user information provided by the first information processing device; a verification unit that verifies the image capture location information and the user information acquired by the image capture location information and user information acquisition unit; a captured image validity period information providing unit that provides the captured image validity period information corresponding to the image shooting location information and the user information to the image processing device when the image shooting location information and the user information are determined to be valid as a result of the verification by the verification unit; An information processing system comprising:
16. An information processing system including an image processing device, a first information processing device, and a second information processing device, The image processing device includes: an acquisition control unit that permits acquisition of imaging location information based on permission information obtained from a destination of the captured image on the condition that a session with the destination of the captured image is being established; an image capture location information acquisition unit that acquires the image capture location information provided by the first information processing device in a state permitted by the acquisition control unit; an image capturing location information and user information providing unit that provides the image capturing location information and user information acquired by the image capturing location information acquiring unit to the second information processing device; a captured image valid period information acquisition unit provided by the second information processing device and configured to acquire captured image valid period information corresponding to the image capturing location information and the user information provided by the image capturing location information user information provision unit; an imaging control unit that permits imaging by the imaging unit within the valid period indicated by the captured image valid period information acquired by the captured image valid period information acquisition unit; Equipped with The first information processing device an image capture location information generating unit that generates the image capture location information under the condition that a session is being established with the destination of the captured image; an image capturing location information providing unit that provides the image capturing location information generated by the image capturing location information generating unit to the image processing device; Equipped with The second information processing device an image capture location information and user information acquisition unit that acquires the image capture location information and the user information provided by the image processing device; a verification unit that verifies the image capture location information and the user information acquired by the image capture location information and user information acquisition unit; a captured image validity period information providing unit that provides the captured image validity period information corresponding to the image shooting location information and the user information to the image processing device when the image shooting location information and the user information are determined to be valid as a result of the verification by the verification unit; An information processing system comprising:
17. An information processing system including an image processing device, a first information processing device, and a second information processing device, The image processing device includes: a user information generating unit that generates user information; a user information providing unit that provides the user information generated by the user information generating unit to the first information processing device; a stay information extraction unit that extracts stay information from a receipt on which stay information including a session key and time information issued based on the user information and image capture location information provided to the first information processing device by the user information providing unit is printed; and a stay information providing unit that provides the stay information extracted by the stay information extracting unit to the second information processing device; a captured image providing unit that provides a captured image generated by the imaging unit to the second information processing device; Equipped with The first information processing device a user information acquisition unit that acquires the user information provided by the image processing device; an image capture location information user information providing unit that provides the image capture location information and the user information acquired by the user information acquiring unit to the second information processing device; a session key acquisition unit that acquires the session key provided by the second information processing device; a receipt issuing unit that issues the receipt on which the session key acquired by the session key acquiring unit and the stay information including the time information are printed; Equipped with The second information processing device an image capture location information and user information acquisition unit that acquires the image capture location information and the user information provided from the first information processing device; a verification unit that verifies the image capture location information and the user information acquired by the image capture location information and user information acquisition unit; a session key providing unit that issues the session key corresponding to the shooting location information and the user information and provides the session key to the first information processing device when the verification unit determines that the shooting location information and the user information are valid as a result of the verification; a stay information acquisition unit that acquires the stay information provided from the image processing device; a captured image acquisition unit that acquires the captured image provided from the image processing device; a control unit that controls permission to post the captured image acquired by the captured image acquisition unit based on the stay information acquired by the stay information acquisition unit; An information processing system comprising:
Citation Information
Patent Citations
Method and system for preventing tampering of certification picture
JP2003244347A
Alteration detection information generating apparatus, imaging apparatus, alteration detection information generating method, program, and storage medium
JP2008022372A
Evaluation system, and program
JP2014021772A
Use details / store information link device, program and method
JP2018072978A
System and methods to facilitate in-situ evaluations
US20160104216A1