Information processing system and camera

The information processing system uses DID and VC to authenticate and verify photography activities, addressing the challenge of proving authenticity and enabling reward-based services for users by adding activity data VC to photographic data.

WO2024241893A1PCT designated stage expired Publication Date: 2024-11-28SONY GROUP CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/017204
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-23
Filing Date
2024-05-09
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Existing systems lack a mechanism to authentically prove photographic activities taken with cameras, hindering the ability to reward users based on their photography data, such as the number of photos taken and recording time, which is essential for services like earning points or virtual currency.

Method used

An information processing system that utilizes Decentralized Identity (DID) and Verifiable Credentials (VC) based on Self-Sovereign Identity (SSI) to authenticate users and generate activity data VC, which is added to photographic data, ensuring the authenticity of photography activities and enabling benefits like points or miles.

Benefits of technology

The system effectively proves the authenticity of photography activities, allowing users to earn rewards by verifying the activity data VC, thereby enabling services that compensate users for their photographic efforts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024017204_28112024_PF_FP_ABST
    Figure JP2024017204_28112024_PF_FP_ABST
Patent Text Reader

Abstract

The present disclosure relates to an information processing device and a camera that make it possible to certify the authenticity of data of a photographing activity photographed by the camera. This information processing system includes a camera and a device owned by a user. The device transmits user identification information identifying the user to the camera. The camera authenticates the user using the user identification information, and, when a photographing activity is performed by the authenticated user, generates activity data VC that certifies the authenticity of activity data indicating the photographing activity and adds the activity data VC to photographed data to generate the photographed data having the activity data VC. The technology of the present disclosure can be applied to, for example, a system for achieving a service that provides benefits in accordance with photographing activities.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing system and camera

[0001] The present disclosure relates to an information processing system and a camera, and more particularly to an information processing system and a camera that are capable of verifying the authenticity of data of a photographic activity captured by the camera.

[0002] There are systems that provide rewards to users for their activities, such as participating in an event. For example, a system has been proposed that issues a certificate that certifies the user's event participation history and uses the certificate to provide rewards for accommodations to event participants (see, for example, Patent Document 1).

[0003] In recent years, MaaS (Mobility as a Service) has emerged, allowing users to earn points and benefits based on travel data collected from their smartphones, such as the "Miles" app, which allows users to accumulate miles while commuting to work or school. From a Web 3.0 perspective, there are apps like STEPN's "Move to Earn" app, which allows users to earn virtual currency through their activities. Web 3.0 is a decentralized web world utilizing blockchain technology and is based on the concept of self-sovereign identity (SSI). SSI allows users to own and control their own identity without the intervention of a centralized entity. To realize SSI, decentralized identity (DID) and verifiable credentials (VC) have been developed. DID is a decentralized ID managed by the blockchain, and information associated with the DID, such as a public key, is called a DID document. VC is a certificate used to verify the authenticity of received information (see, for example, non-patent literature 1 and 2). Authentication (DID authentication) and communication (DIDComm communication) using DIDs have also been defined (see, for example, non-patent literature 3 and 4).

[0004] A camera has been proposed that implements a provenance recording function that adds information such as the origin and history of an image to an image file by implementing C2PA (Coalition for Content Provenance and Authenticity), a standard established by CAI (Content Authenticity Initiative) in the camera device (see, for example, Non-Patent Document 5).

[0005] Japanese Patent Application Laid-Open No. 2018-073183

[0006] The World Wide Web Consortium (W3C), “Verifiable Credentials Data Model 1.0”, Internet <URL: https: / / www.w3.org / TR / vc-data-model / > The World Wide Web Consortium (W3C), “Decentralized Identifiers (DIDs) v1.0”, Internet <URL: https: / / www.w3.org / TR / did-core / > “Introduction to DID Auth”, Internet <URL: https: / / github.com / WebOfTrustInfo / rwot6-santabarbara / blob / master / final-documents / did-auth.md> “DIDComm Messaging v2.x Editor's Draft”, Internet <URL: https: / / identity.foundation / didcomm-messaging / spec / > Nikon Corporation, “Adobe MAX At the "2022" event, Nikon will exhibit a camera equipped with a provenance recording function that adds information such as origin and history to image files.

[0007] Incidentally, a system could be envisaged in which points or rewards could be awarded by collecting data on photography activities, such as the number of shots taken with a camera and the duration of the shots. In this case, a mechanism would be needed to certify the authenticity of the data on photography activities taken with a single-lens reflex camera or the like.

[0008] The present disclosure has been made in light of such circumstances, and makes it possible to prove the authenticity of data on photography activities captured by a camera.

[0009] An information processing system according to a first aspect of the present disclosure includes a camera and a device owned by a user, wherein the device transmits user identification information that identifies the user to the camera, and the camera authenticates the user using the user identification information, and when a photographing activity is performed by the authenticated user, generates activity data VC that proves the authenticity of activity data indicating the photographing activity and adds the activity data VC to the photographing data to generate photographing data with the activity data VC.

[0010] A first aspect of the present disclosure includes a camera and a device owned by a user, wherein the device transmits user identification information identifying the user to the camera, the camera authenticates the user using the user identification information, and when a photographing activity is performed by the authenticated user, activity data VC is generated that proves the authenticity of activity data indicating the photographing activity, and photographing data with activity data VC is generated by adding the activity data VC to the photographing data.

[0011] A camera according to a second aspect of the present disclosure acquires user identification information that identifies a user from a device owned by the user, authenticates the user using the user identification information, and when a photographic activity is performed by the authenticated user, generates activity data VC that proves the authenticity of activity data indicating the photographic activity and adds it to the photographic data to generate photographic data with activity data VC.

[0012] In a second aspect of the present disclosure, user identification information that identifies the user is obtained from a device owned by the user, the user is authenticated using the user identification information, and when a photographing activity is performed by the authenticated user, activity data VC that proves the authenticity of the activity data indicating the photographing activity is generated, and photographing data with activity data VC attached to the photographing data is generated.

[0013] The camera and the device may be independent devices or may be internal blocks that make up a single device.

[0014] 7 is a block diagram illustrating an example configuration of an embodiment of an information processing system to which the present technology is applied. FIG. 7 is a diagram illustrating an overall processing flow of a photography activity data utilization service by the information processing system of FIG. 1. FIG. 8 is a sequence diagram illustrating details of DID authentication processing in step S12 of FIG. 2. FIG. 9 is a flowchart illustrating photography data generation processing with activity data VC in step S13 of FIG. 2. FIG. 10 is a flowchart illustrating details of content saving processing in step S15 of FIG. 2. FIG. 11 is a diagram illustrating an overall processing flow of a photography activity data utilization service when switching cameras. FIG. 12 is a diagram illustrating details of activity data synchronization processing. FIG. 13 is a flowchart illustrating details of activity data synchronization processing in step S103 of FIG. 7. FIG. 14 is a diagram illustrating synchronization processing of activity data VC. FIG. 15 is a diagram illustrating an example of recording activity data at the time of photography and the latest activity data as activity data VC. FIG. 16 is a sequence diagram illustrating VC update processing for updating to a new manufacturer VC. FIG. 17 is a sequence diagram illustrating processing for reissuing a manufacturer VC via a pre-registered administrator. FIG. 18 is a diagram illustrating an example of a first business model realized using a photography activity data utilization service. FIG. 19 is a diagram illustrating an example of a mileage redemption rate of the first business model. FIG. 19 is a diagram illustrating an example of a second business model realized using a photography activity data utilization service. FIG. 19 is a block diagram illustrating an example configuration of an embodiment of a computer to which the technology of the present disclosure is applied.

[0015] Hereinafter, a description will be given of a form for implementing the technology of the present disclosure (hereinafter referred to as an embodiment) with reference to the accompanying drawings. Note that in this specification and drawings, components having substantially the same functional configuration are assigned the same reference numerals to avoid redundant description. The description will be given in the following order: 1. Configuration example of the information processing system of the present disclosure 2. Processing flow of the photography activity data utilization service 3. Processing flow of the DID authentication processing 4. Processing flow of the photography data generation processing with activity data VC 5. Processing flow of the content saving processing 6. Processing flow when switching cameras 7. Details of the activity data synchronization processing 8. Recording of activity data at the time of photography and the latest 9. Manufacturer VC update processing 10. Summary 11. First business model of the photography activity data utilization service 12. Second business model of the photography activity data utilization service 13. Computer configuration example

[0016] 1. Configuration Example of Information Processing System of the Present Disclosure FIG. 1 is a block diagram showing a configuration example of an embodiment of an information processing system to which the present technology is applied.

[0017] The information processing system 1 shown in FIG. 1 is a system that provides a photography activity data utilization service that can verify the authenticity of data indicating photography activities (hereinafter referred to as activity data) when a user performs photography activities with a camera as a photographer, and provides the photographer with rewards such as points, miles, and virtual currency based on the activity data. Specifically, a user's photography activities refer to the taking of still images (photographs) or videos using a camera, and activity data includes, for example, data such as the number of still images taken and the recording time of videos. Image data of still images or videos obtained by photography is collectively referred to as photography data or content. To verify the authenticity of the activity data, the information processing system 1 utilizes a mechanism based on the concept of self-sovereign identity (SSI), namely, decentralized identity (DID) and verifiable credentials (VC).

[0018] The information processing system 1 includes a camera 11 and a smartphone 12 owned by a user, a server device 13 of the camera manufacturer that produced the camera 11, a server device 14 that provides a photography activity data utilization service, and a blockchain network 15. The camera 11, the smartphone 12, and the manufacturer server 13 each have a DID, which is a decentralized ID (identification information) managed by the blockchain. The camera 11 has a camera DID as camera identification information that identifies the camera, the smartphone 12 has a photographer DID as user identification information that identifies the user and photographer of the camera 11 and smartphone 12, and the manufacturer server 13 has a manufacturer DID as manufacturer identification information that identifies the manufacturer.

[0019] Hereinafter, to facilitate the distinction between the camera manufacturer's server device 13 and the server device 14 that provides the photography activity data utilization service, the camera manufacturer's server device 13 will be referred to as the manufacturer server 13, and the server device 14 that provides the photography activity data utilization service will be referred to as the service server 14. The camera 11, smartphone 12, manufacturer server 13, service server 14, and blockchain network 15 each have a communication unit (not shown) and can communicate with a desired communication partner via a predetermined network, such as a mobile communication network (e.g., 4G or 5G), a local area network (LAN), a wide area network (WAN), a home network, the Internet, infrared communication, or a wired communication path compliant with standards such as HDMI (registered trademark) (High-Definition Multimedia Interface) or USB (Universal Serial Bus). Hereinafter, communication between each device via a predetermined network will be referred to as network communication, to distinguish it from short-range communication, which will be described later.

[0020] The camera 11 is a digital camera owned by a user, such as a digital single-lens reflex camera or a mirrorless single-lens camera, and is manufactured by a camera manufacturer that owns a manufacturer server 13. The camera 11 can generate, store, and transmit photographed data with activity data VC (hereinafter referred to as activity data VC), which is photographed data with VC indicating the authenticity of the activity data. The camera 11 includes a photographing unit 21, a DID authentication and VC verification unit 22, a VC issuing unit 23, a short-range communication unit 24, a storage unit 25, and a memory card 26. The memory card 26 is detachable from the camera 11.

[0021] The photographing unit 21 performs photographing in response to the operation of a shutter button (not shown) or the like, and generates photographic data of the resulting still image (photo) or video. The generated photographic data is added with activity data VC issued by the VC issuing unit 23, for example, and is stored in the memory card 26 as photographic data with activity data VC.

[0022] The DID authentication / VC verification unit 22 authenticates the photographer DID, which identifies the owner of the smartphone 12 and the user who takes pictures with the camera 11. The DID authentication / VC verification unit 22 also verifies the activity data VC. For example, when a memory card 26 on which activity data VC has been stored by another camera is inserted, the DID authentication / VC verification unit 22 verifies the activity data VC stored on the memory card 26. The VC issuing unit 23 issues the activity data VC to be added to the photographed data. The short-range communication unit 24 is a communication interface that performs short-range wireless communication, such as Bluetooth (registered trademark) or Wi-Fi (trademark). The short-range communication unit 24 transmits the photographed data with the activity data VC to the smartphone 12, for example.

[0023] The storage unit 25 is composed of a semiconductor memory or the like built into the camera 11, and stores data necessary for each process of photography, DID authentication, and VC verification. For example, the storage unit 25 stores a private key linked to the camera DID, a manufacturer VC installed from the manufacturer server 13, activity data VC updated in response to photography, etc. The memory card 26 is composed of a semiconductor memory or the like that is a recording medium that is detachable from the camera 11, and stores photography data, photography data with activity data VC, activity data VC, etc.

[0024] The smartphone 12 includes, for example, a touch panel display, operation buttons, a speaker, a microphone, etc. as an operation unit and an input / output unit, a computing unit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) that executes processing according to a software program, and a storage unit such as a ROM (Read Only Memory) or RAM (Random Access Memory) that stores data and programs. Particularly with regard to the photography activity data utilization service, the smartphone 12 includes application software (hereinafter referred to as an app) 31 that executes the photography activity data utilization service, a short-range communication unit 32, and a storage unit 33.

[0025] The application 31 communicates with the camera 11 via the short-range communication unit 32 and acquires the photographed data with the activity data VC from the camera 11. The application 31 also transmits the acquired photographed data with the activity data VC to the service server 14 via network communication. By transmitting the photographed data with the activity data VC to the service server 14, the application 31 can acquire benefits such as points provided by the photographed activity data utilization service.

[0026] The short-range communication unit 32 is a communication interface that performs short-range wireless communication using the same communication method as the short-range communication unit 24 of the camera 11. The short-range communication unit 32 acquires, for example, photographed data with activity data VC from the camera 11.

[0027] The storage unit 33 is configured by a semiconductor memory built into the smartphone 12, a removable semiconductor memory, etc. The storage unit 33 stores, for example, a private key linked to the photographer DID, photographed data with activity data VC acquired from the camera 11, etc.

[0028] The smartphone 12 is an example of a device owned by the user, and instead of the smartphone 12, other devices that can perform the same functions as the app 31, the short-range communication unit 32, and the memory unit 33, such as a personal computer, a tablet terminal, a PDA (Personal Digital Assistant), or a portable game console, may be used.

[0029] The manufacturer server 13 includes, for example, an operation unit and an input / output unit such as a keyboard, mouse, touch panel display, speaker, and microphone, an arithmetic unit such as a CPU or MPU that executes processing according to a program, and a storage unit such as a ROM or RAM that stores data and programs. The manufacturer server 13 is a server device that manages a manufacturer VC, which is a VC that certifies that a camera (e.g., camera 11) is a genuine camera manufactured by the manufacturer. The manufacturer server 13 includes a VC issuing unit 41 and a storage unit 42. The VC issuing unit 41 issues a manufacturer VC. For example, the VC issuing unit 41 issues a manufacturer VC when the camera 11 is shipped, and issues a new manufacturer VC that becomes necessary when the manufacturer VC is updated. The issued manufacturer VC is stored in the storage unit 25 of the camera 11 before shipping. The storage unit 42 stores a private key linked to the manufacturer DID.

[0030] The service server 14 includes, for example, an operation unit and an input / output unit such as a keyboard, mouse, touch panel display, speaker, and microphone, as well as a computing device such as a CPU or MPU that executes processing according to programs, and a storage device such as a ROM or RAM that stores data and programs. The service server 14 is a server device that provides a photography activity data utilization service to the smartphone 12 as a client device. The service server 14 includes an app management unit 51, a DID authentication / VC verification unit 52, and a storage unit 53.

[0031] The application management unit 51 executes a server-side program that executes the photography activity data utilization service and manages activity data for each photographer. For example, the application management unit 51 grants a reward to the photographer (the application 31) in accordance with the activity data VC-attached photography data transmitted from the smartphone 12 via network communication. The DID authentication / VC verification unit 52 authenticates the photographer DID of the user of the smartphone 12. The DID authentication / VC verification unit 52 also verifies the activity data VC of the activity data VC-attached photography data transmitted from the smartphone 12. The storage unit 53 stores programs and data necessary for executing the photography activity data utilization service. For example, the storage unit 53 stores the activity data VC-attached photography data transmitted from the smartphone 12 and stores rewards (e.g., points) granted to each photographer.

[0032] The blockchain network 15 is a P2P network composed of multiple nodes, such as a consortium-type blockchain network. A node is an information processing device (computer) that executes a computer program that verifies the validity and authenticity of data to be recorded in the blockchain and records the verified validity and authenticity in the blockchain. The blockchain is composed of multiple blocks, each of which stores multiple transactions that request various processes, such as reading and writing data. Each block also stores a nonce value assigned to that block and a hash value generated for the previous block. Therefore, the blockchain can be considered a database in which multiple blocks are linked in a chain by hash values. In a blockchain, tampering with a transaction within a block changes the hash value of that block, preventing local tampering.

[0033] The blockchain network 15 includes a DID document management unit 61 and a storage unit 62. The DID document management unit 61 manages DID documents stored in the storage unit 62. A DID document is information including a public key linked to a DID. For example, the DID document management unit 61 transmits a DID document to a requesting device in response to a request from the camera 11 or the service server 14. The storage unit 62 stores the DID documents of each device or each photographer. The storage unit 62 stores at least a public key linked to the manufacturer DID, a public key linked to the photographer DID, and a public key linked to the camera DID.

[0034] For ease of explanation, the public key associated with the manufacturer DID, the public key associated with the photographer DID, and the public key associated with the camera DID will be referred to as the manufacturer public key, the photographer public key, and the camera public key, respectively. Similarly, the private key associated with the manufacturer DID, the private key associated with the photographer DID, and the private key associated with the camera DID will be referred to as the manufacturer private key, the photographer private key, and the camera private key, respectively.

[0035] The information processing system 1 has the above-described configuration, and when a user performs a photographing activity with the camera 11, the photographing data with activity data VC generated by the camera 11 is transmitted to the service server 14 via the smartphone 12. The service server 14 verifies the activity data VC to verify the authenticity of the user's activity data, and transmits a benefit to the app 31 of the smartphone 12. The information processing system 1 makes it possible to prove the authenticity of the activity data of the user's photographing activity, thereby realizing a system that allows the user to receive a benefit according to the photographing activity.

[0036] The photography activity data utilization service provided by the information processing system 1 will be described in detail below.

[0037] 2. Processing Flow of Photography Activity Data Utilization Service> The overall processing flow of the photography activity data utilization service performed by the information processing system 1 will be described with reference to FIG.

[0038] FIG. 2 is a diagram showing the overall flow of processing in the photography activity data utilization service by the information processing system 1.

[0039] In the photography activity data utilization service, first, in step S11, a manufacturer VC is issued by the camera manufacturer and installed in the shipped camera 11. Specifically, the manufacturer server 13 issues the manufacturer VC using the manufacturer's private key and installs it in the camera 11.

[0040] Next, in step S12, when the user operates the app 31 of the smartphone 12 to connect to the camera 11 at the start of shooting, DID authentication processing is executed between the app 31 of the smartphone 12 and the camera 11. Specifically, the app 31 of the smartphone 12 transmits the photographer DID to the camera 11. The camera 11 acquires a DID document including the photographer public key stored in the blockchain network 15 and authenticates the photographer DID. Details of the DID authentication processing will be described later with reference to the flowchart of FIG. 3. When the DID authentication processing is completed, the user is ready to take photos with the camera 11.

[0041] In step S13, when the user takes a photo with the camera 11, the camera 11 generates photo data and activity data, and also generates activity data VC that certifies the activity data and adds it to the photo data, thereby generating photo data 91 with activity data VC and storing it on the memory card 26. The photo data 91 with activity data VC includes image data 81 of a still image or video, metadata 82, a camera signature 83, and a manufacturer VC 84. The metadata 82 includes the camera DID, the photographer DID, and activity data, and the activity data includes the number of photos taken and the recording time. The camera signature 83 is information obtained by signing the information in the metadata 82 with the camera private key, and the manufacturer VC 84 is the manufacturer VC installed in the camera 11 in step S11. Of these, the metadata 82 and the camera signature 83 constitute the activity data VC 85. Details of the process of generating photo data with activity data VC will be described later with reference to the flowchart of FIG. 4.

[0042] When the user finishes taking pictures, in step S14, an application transfer process is executed to transfer the shooting data 91 with the activity data VC from the camera 11 to the application 31 of the smartphone 12 using short-range communication. The application transfer process may be executed, for example, every time a still image or video is taken, or may be executed when an operation such as "import shooting data" is performed in the application 31 of the smartphone 12. Through the application transfer process, the camera 11 transmits the shooting data 91 with the activity data VC to the smartphone 12, and the smartphone 12 acquires the shooting data 91 with the activity data VC and stores (copies) it in the storage unit 33. The shooting data 91 with the activity data VC is stored in the storage unit 33 of the smartphone 12 and also in the storage unit 25 of the camera 11.

[0043] Next, in step S15, the user performs an operation in the app 31 of the smartphone 12 to upload the photographed data 91 with the activity data VC to the service server 14. The app 31 of the smartphone 12 executes a content upload process to transmit the photographed data 91 with the activity data VC to the service server 14. After authenticating the user's photographer DID, the service server 14 verifies the authenticity of the manufacturer VC and the activity data VC included in the photographed data 91 with the activity data VC, and saves the photographed data as content taken by the user. Details of the content saving process for verifying the authenticity of the activity data VC, etc., and saving the content will be described later with reference to the flowchart of FIG. 5. If the authenticity of the activity data VC is confirmed, a benefit is sent from the service server 14 to the app 31 of the smartphone 12, and the benefit is granted to the user who took the photograph.

[0044] The processing of the photography activity data utilization service is carried out as described above.

[0045] 3. Processing Flow of DID Authentication Processing Next, details of the DID authentication processing executed between the application 31 of the smartphone 12 and the camera 11 in step S12 described above will be described with reference to the sequence diagram of FIG.

[0046] First, in step S31, the application 31 of the smartphone 12 transmits an authentication request together with the photographer DID via short-range communication.

[0047] In step S32, the DID authentication and VC verification unit 22 of the camera 11 receives the authentication request from the application 31, generates a predetermined random number, and transmits it to the application 31 as challenge data.

[0048] In step S33, the application 31 receives the challenge data from the camera 11 and generates a signature by encrypting the hash value of the challenge data with the photographer's private key. In the following step S34, the application 31 transmits the generated signature to the camera 11 as a response.

[0049] In step S35, the DID authentication / VC verification unit 22 of the camera 11 obtains the response from the app 31 and verifies the signature. That is, the camera 11 obtains the DID document of the photographer DID stored in the blockchain network 15 and decrypts the signature obtained as a response with the photographer's public key. The DID authentication / VC verification unit 22 of the camera 11 then compares the hash value of the challenge data obtained by decryption with the hash value of the challenge data it generated itself, and verifies whether they match.

[0050] This completes the DID authentication process.

[0051] 4. Processing Flow of the Activity Data VC-Added Shooting Data Generation Process> Next, the activity data VC-added shooting data generation process executed by the camera 11 in the above-mentioned step S13 will be described in detail with reference to the flowchart in Fig. 4. This process is started, for example, when the shutter button is pressed on the camera 11 and image data of a still image or a video is generated by the shooting unit 21.

[0052] In step S51, the photographing unit 21 of the camera 11 determines whether the generated image data is the result of a legitimate photographic activity. For example, if a photographer simply mechanically presses the shutter multiple times to capture multiple still images of the same composition, counting each of those multiple still images as a single photographic activity would be inappropriate for the purpose of awarding a bonus. Therefore, the photographing unit 21 pre-sets indicators for determining whether a photographic activity has been legitimate, and determines whether the generated image data is the result of a legitimate photographic activity based on the indicators. For example, for still image capture, indicators may be set such as: (1) counting a continuous shot as one shot; (2) not counting a shot in which settings such as zoom, F-stop, shutter speed, ISO sensitivity, and white balance have not changed since the previous shot; (3) calculating the similarity of an image with a predetermined number of previous still images and not counting it if it is determined to be a shot of the same scene (in the case of continuous shooting, the similarity may be calculated using multiple still images before and after); and (4) not counting a shot in which the camera 11's position information is determined to have barely moved within a predetermined range. For video recording, indicators such as (A) if the recording button is simply pressed and the orientation or position information of the camera 11 does not change, this is not counted as recording time. If the photographing unit 21 determines that the generated image data is data resulting from legitimate photographing activity, the process proceeds to step S52.

[0053] In step S52, the photographing unit 21 measures the number of photographs taken or the recording time, and generates activity data. In the following step S53, the photographing unit 21 generates metadata including the camera DID, the photographer DID, and the activity data.

[0054] In step S54, the VC issuing unit 23 generates a camera signature by signing the metadata information with the camera private key, and updates the activity data VC made up of the metadata and the camera signature.

[0055] On the other hand, if it is determined in step S51 that the data is not the result of a valid photographing activity, the process proceeds to step S55, and the camera 11 does not update the activity data VC.

[0056] After step S54 or S55, in step S56, the VC issuing unit 23 adds the activity data VC and the manufacturer VC to the photographic data to generate photographic data with the activity data VC, stores it in the memory card 26, and ends the process.

[0057] The process for generating photographic data with activity data VC is executed as described above. According to the process for generating photographic data with activity data VC, it is determined whether the generated image data is data resulting from legitimate photographic activity, and the number of photographs or recording time is measured as activity data. This makes it possible to measure activity data so that, for example, multiple photographs with the same parameter settings, such as zoom, are not counted, or so that recording time from fixed-point photography is not included in the measurement. This makes it possible to build a system that awards rewards to legitimate photographic activities without counting mechanical operations. By having the camera 11 issue the VC, verifiable activity data can be added to the photographic data.

[0058] 5, details of the content saving process executed in step S15 between the app 31 of the smartphone 12 and the service server 14 will be described. This process is started, for example, when an upload button for uploading content is pressed in the app 31.

[0059] First, in step S71, the app 31 of the smartphone 12 executes DID authentication processing with the service server 14. Details of the DID authentication processing are explained in Fig. 3, and are the same except that the authenticator is changed from the camera 11 to the service server 14, so details are omitted here.

[0060] In step S72, the application 31 transmits the photographed data with the activity data VC stored in the storage unit 33 to the service server 14, and the service server 14 acquires the photographed data with the activity data VC from the application 31.

[0061] In step S73, the DID authentication / VC verification unit 52 of the service server 14 verifies the manufacturer VC and activity data VC included in the shooting data with activity data VC. In verifying the manufacturer VC, the DID authentication / VC verification unit 52 acquires the DID document of the camera DID included in the metadata from the blockchain network 15 and verifies the manufacturer VC using the camera public key. The DID authentication / VC verification unit 52 also acquires the DID document of the photographer DID included in the metadata from the blockchain network 15 and verifies the activity data VC using the photographer public key.

[0062] VC verification is performed, for example, as follows. A VC includes, for example, the issuer DID, owner DID, information to be attested (claims), expiration date, link to revocation status list, and signature. The verifier first obtains the issuer's DID document and verifies the signature included in the VC with the issuer's public key to confirm that the VC was issued by the issuer written in the VC. Next, the verifier checks the expiration date and then references the revocation status list to confirm that the VC has not been revoked. Verification of whether a VC was issued to a user can be performed, for example, by verifying with DID authentication or by verifying a VP (Verifiable Presentation) to which the DID owner's signature has been attached.

[0063] In step S74, the application management unit 51 of the service server 14 determines whether the activity data VC is authentic activity data based on the verification result of the manufacturer VC and the activity data VC by the DID authentication and VC verification unit 52.

[0064] If it is determined in step S74 that the activity data VC is genuine activity data, the process proceeds to step S75, and the application management unit 51 stores the photographed data with the activity data VC in the memory unit 53 as the photographer's content, transmits a bonus according to the acquired photographed data to the photographer's application 31, and ends the process.

[0065] On the other hand, if it is determined in step S74 that the activity data VC is not genuine activity data, the process proceeds to step S76, and the application management unit 51 refuses to save the photographed data with the activity data VC, sends an error message to the photographer's application 31, and ends the process.

[0066] 6. Processing Flow When Switching Cameras Next, referring to FIG. 6, the overall processing flow of the photography activity data utilization service when the user switches cameras 11 to be used, such as when purchasing a new camera 11, is shown.

[0067] Fig. 6 is a diagram showing the overall processing flow of the photography activity data utilization service when switching cameras 11. In Fig. 6, the previously used camera 11 is designated as camera 11X, and the new camera 11 (a different camera from camera 11X) is designated as camera 11Y.

[0068] In issuing the manufacturer VC in step S101, the manufacturer VC is installed in the new camera 11Y. Details of this process are the same as step S11 in FIG.

[0069] Next, in step S102, when the user operates the app 31 of the smartphone 12 to connect to the camera 11Y at the start of shooting with the camera 11Y, DID authentication processing is executed between the app 31 of the smartphone 12 and the camera 11Y. This processing is similar to the processing described in step S12 of Fig. 2 and the flowchart of Fig. 3. The memory card 26 attached to the camera 11Y is the memory card that was used in the camera 11X, and the activity data VC is stored in the memory card 26.

[0070] Next, in step S103, the DID authentication and VC verification unit 22 of the camera 11Y verifies the activity data VC stored on the memory card 26 and synchronizes the activity data. As a result, the activity data of the activity data VC stored on the memory card 26 is copied to the storage unit 25 in the camera 11Y. When the synchronization of the activity data is complete, the user is ready to take pictures with the camera 11Y.

[0071] In step S104, when the user takes a photo with the camera 11Y, the camera 11Y generates photo data and activity data, and also generates activity data VC and adds it to the photo data to generate photo data 91Y with activity data VC, which is stored on the memory card 26. This process is similar to step S13 in Fig. 2 and the process described in the flowchart in Fig. 4. The camera DID included in the activity data VC is the DID of the camera 11Y, and the camera signature 83 is information signed with the private key of the camera 11Y.

[0072] Next, in step S105, an application transfer process is executed (not shown) for reasons of space. As a result, the photographic data 91Y with the activity data VC of the camera 11Y is transferred to the application 31 of the smartphone 12 using short-range communication. The application transfer process in step S105 is the same as step S14 in FIG. 2 .

[0073] Next, in step S106, a content upload process is executed to transmit the photographed data 91Y with the activity data VC from the application 31 of the smartphone 12 to the service server 14. This process is similar to step S15 in FIG. 2 and the process described in the flowchart in FIG. 5.

[0074] The processing of the photography activity data utilization service when the user changes cameras 11 is performed as described above.

[0075] 7. Details of Activity Data Synchronization Processing Details of the activity data synchronization processing will be described with reference to FIG.

[0076] FIG. 7 is a diagram for explaining the processing of steps S102 to S104 described with reference to FIG.

[0077] In step S102, DID authentication processing is executed between the application 31 of the smartphone 12 and the camera 11Y. At this time, it is assumed that the photographer DID of the user stored in the smartphone 12 is "did:web:aaaaa...".

[0078] Next, in step S103, the DID authentication and VC verification unit 22 of the camera 11Y executes an activity data synchronization process for synchronizing the activity data stored in the memory card 26.

[0079] For example, as shown in FIG. 7 , assume that the activity data of user A of the smartphone 12 and two other users, user B and user C, is stored in the memory unit 25 of the camera 11Y. User A's photographer DID is "did:web:aaaaa...", user B's photographer DID is "did:web:bbbbb...", and user C's photographer DID is "did:web:ccccc...". The activity data of user A stored in the memory unit 25 of the camera 11Y is "number of photos taken: 200, recording time: 1 hour", the activity data of user B is "number of photos taken: 10, recording time: 0 hours", and the activity data of user C is "number of photos taken: 10,000, recording time: 20 hours". Meanwhile, the activity data of user A stored in the memory card 26 is "number of photos taken: 333, recording time: 2 hours".

[0080] The activity data VC of user A stored on memory card 26 is verified, and if it is confirmed that the activity data VC stored on memory card 26 is not unauthorized activity data VC, the activity data of user A on memory card 26 "number of shots: 333, recording time: 2 hours" is overwritten and stored on memory unit 25 of camera 11Y "number of shots: 200, recording time: 1 hour." If no activity data of user A exists on memory card 26, the activity data of user A "number of shots: 333, recording time: 2 hours" is newly created in memory unit 25 of camera 11Y.

[0081] After the synchronization of the activity data is completed, when user A takes a still image with camera 11Y, the activity data is updated in response to the capture of the still image, and image data with activity data VC is generated in step S104. The activity data assigned to the still image capture is "number of times captured: 334, recording time: 2 hours," and the number of times captured has been increased by 1.

[0082] In the photography activity data utilization service, it is possible that multiple users may use one camera 11. The camera 11 stores activity data VC for each user (more specifically, for each user DID) in the storage unit 25 of the camera 11 body. Furthermore, by storing the activity data VC not only in the storage unit 25 of the camera 11 body but also on the memory card 26, it can be processed without any problems even if the user replaces the camera 11, for example.

[0083] <Flowchart of Activity Data Synchronization Processing> Details of the activity data synchronization processing executed in step S103 in Fig. 7 will be described with reference to the flowchart of Fig. 8. This processing is executed when the DID authentication processing in step S102 is completed.

[0084] First, in step S121, the DID authentication / VC verification unit 22 of the camera 11Y reads the activity data VC from the memory card 26 attached to the camera 11Y and verifies that the activity data VC is not fraudulent. The DID authentication / VC verification unit 22 acquires the DID document of the camera DID from the blockchain network 15 and verifies the activity data VC using the camera public key.

[0085] Next, in step S122, the DID authentication and VC verification unit 22 determines whether or not activity data VC of the same user as the user of the smartphone 12 exists in the storage unit 25 of the camera 11Y body.

[0086] If it is determined in step S122 that activity data VC of the same user exists, processing proceeds to step S123, and the DID authentication / VC verification unit 22 overwrites and stores the activity data VC of the same user in the memory unit 25 of the camera 11Y main body with the activity data VC read from the memory card 26.

[0087] On the other hand, if it is determined in step S122 that activity data VC for the same user does not exist, processing proceeds to step S124, and the DID authentication / VC verification unit 22 newly stores the activity data VC read from the memory card 26 in the memory unit 25 of the camera 11Y main body.

[0088] According to the above activity data synchronization process, the camera 11Y reads the activity data VC of a DID-authenticated user from the attached memory card 26, verifies that the read activity data VC is not unauthorized activity data VC, and then stores the activity data VC in the internal storage unit 25 of the camera 11Y. By utilizing the mechanisms of DID authentication and VC verification, it becomes possible to transfer and accumulate legitimate activity data VC even when multiple cameras 11 are expected to be used.

[0089] <Synchronization Processing When Multiple Cameras Are Used> Next, a synchronization processing of the activity data VC when photographing is performed using multiple cameras 11 will be described.

[0090] 9 is a diagram illustrating the synchronization process of the activity data VC when taking pictures using two cameras 11, camera 11X and camera 11Y. This process is started, for example, when a setting such as a multi-camera shooting mode is turned on in an operation unit such as a touch panel display.

[0091] First, in step S141, the app 31 of the smartphone 12 executes DID authentication processing with each of the cameras 11X and 11Y. Details of the DID authentication processing have been explained with reference to the flowchart of FIG. 3 and the like, and therefore will not be repeated here.

[0092] For example, if a user takes a picture using camera 11X, in step S142, DID authentication / VC verification unit 22 of camera 11X updates the activity data VC in camera 11X. Specifically, in the case of taking a still image, the number of times the picture was taken is incremented by one, and in the case of taking a video, the recording time is added. Also in step S142, DID authentication / VC verification unit 22 of camera 11X transmits, via short-range communication, an activity data update notification indicating that the activity data VC has been updated to app 31, including the updated activity data VC.

[0093] In step S143, the application 31 acquires the activity data update notification (including the updated activity data VC) from the camera 11X through short-range communication, and transfers (transmits) it to the camera 11Y.

[0094] In step S144, the DID authentication / VC verification unit 22 of the camera 11Y acquires the activity data update notification via short-range communication and verifies the validity of the updated activity data VC included in the activity data update notification. If the DID authentication / VC verification unit 22 of the camera 11Y can confirm the validity of the updated activity data VC included in the activity data update notification, it stores (overwrites) the acquired activity data VC in the storage unit 25 and memory card 26 within the camera 11Y and synchronizes the activity data VC.

[0095] In this way, even when taking pictures using a plurality of cameras 11, the activity data VC can be recorded synchronously by the cameras 11X and 11Y.

[0096] 8. Recording of Activity Data at the Time of Shooting and Latest Activity Data In the above-described example, the camera 11 records the activity data at the time of shooting as activity data VC when shooting of a still image or video is completed. However, in addition to the activity data at the time of shooting, the latest activity data may also be recorded as activity data VC.

[0097] FIG. 10 shows an example of activity data VC in the case where the activity data at the time of photographing and the latest activity data are recorded as the activity data VC.

[0098] The memory card 26 shown on the left side of Fig. 10 stores a large number of pieces of photographed data with activity data VC attached thereto, which were taken with the camera 11. For example, photographed data P100 with activity data VC attached thereto is the oldest photographed data with activity data VC attached thereto in chronological order, and photographed data P160 with activity data VC attached thereto is the newest photographed data with activity data VC attached thereto in chronological order. The photographed data with activity data VC includes the activity data at the time of photographing and the latest activity data. Since the latest activity data is the time of photographing, the activity data at the time of photographing and the latest activity data are the same for photographed data P100 and P160 with activity data VC attached. In other words, the activity data at the time of photographing of photographed data P100 with activity data VC attached thereto is "number of photographs taken: 100, recording time: 2 hours," and the latest activity data is also "number of photographs taken: 100, recording time: 2 hours." The activity data at the time of shooting of the shooting data P160 with activity data VC is "number of shots: 150, recording time: 5 hours", and the latest activity data is also "number of shots: 150, recording time: 5 hours".

[0099] Here, for example, when a user operates the operation buttons of the camera 11 to perform the "reflect activity data" operation, the DID authentication / VC verification unit 22 executes a process to update the latest activity data of the activity data VC-attached photographic data of the same user as the user operating the camera 11 (the DID authenticated user).

[0100] Specifically, the latest activity data VC-attached photographed data of the user operating the camera 11 is the activity data VC-attached photographed data P160, and the latest activity data is "number of photographs: 150, recording time: 5 hours." The DID authentication / VC verification unit 22 verifies, for example, the activity data VC of the activity data VC-attached photographed data P100 to verify that the activity data VC-attached photographed data P100 is the activity data VC-attached photographed data of the same user as the user operating the camera 11 (the DID-authenticated user). The DID authentication / VC verification unit 22 then updates the latest activity data of the activity data VC-attached photographed data P100 from "number of photographs: 100, recording time: 2 hours" to "number of photographs: 150, recording time: 5 hours." The shooting data P160 with activity data VC is also shooting data with activity data VC of the same user as the user operating the camera 11, and the latest activity data "number of shots: 150, recording time: 5 hours" is updated, but since the data is the same, the values ​​do not change.

[0101] On the other hand, the photographed data P122 with activity data VC is photographed data with activity data VC of a user different from the user operating the camera 11. Since the photographed data P122 with activity data VC is of a user different from the DID-authenticated user, the latest activity data of the photographed data P122 with activity data VC, "number of photographs taken: 10 times, recording time: 0 hours," is not updated.

[0102] As described above, both the activity data at the time of shooting and the latest activity data may be recorded as the activity data VC of the photographed data with activity data VC, and the activity data may be updated to the latest activity data at any timing in response to an operation by the user to reflect the latest activity data, etc. This makes it possible to check, for example, the difference between the activity data at the time of shooting and the current activity data, or to check the latest activity data even when checking old photographed data with activity data VC.

[0103] 9. Manufacturer VC Update Processing As described above, the manufacturer VC stored in the storage unit 25 of the camera 11 is pre-installed when the camera 11 is shipped, but in order to deal with a case where the manufacturer VC in the camera 11 is leaked, for example, a mechanism is required to invalidate the existing manufacturer VC and update it to a new manufacturer VC.

[0104] The VC update process for invalidating an existing manufacturer VC and updating it to a new manufacturer VC will be described with reference to the sequence diagram in Figure 11. This process is initiated, for example, when an "Update Manufacturer VC" operation is performed on the setting screen of the camera 11. DIDComm communication, a communication method that enables mutual authentication using DID, is adopted for communication between the camera 11 and the manufacturer server 13 in Figure 11. DIDComm communication is a method in which a message is encrypted with the DID public key of the message receiver, signed with the DID private key of the message sender, and transmitted.

[0105] First, in step S161, the VC issuing unit 23 of the camera 11 transmits a VC Revoke request, which is a message requesting the revocation of the manufacturer VC, to the manufacturer server 13 by DIDComm communication.

[0106] In step S162, the manufacturer server 13 acquires and verifies the VC Revoke request message from the camera 11 through DIDComm communication, and then revokes the issued manufacturer VC.

[0107] In step S163, the VC issuing unit 23 of the camera 11 transmits a VC reissue request, which is a message requesting the reissue of the manufacturer VC, to the manufacturer server 13 by DIDComm communication.

[0108] In step S164, the manufacturer server 13 acquires the VC reissue request from the camera 11 via DIDComm communication and verifies the VC reissue request message. Furthermore, the manufacturer server 13 reissues the manufacturer VC after confirming that the existing manufacturer VC has expired.

[0109] In step S165, the manufacturer server 13 transmits a message including the reissued manufacturer VC to the camera 11 by DIDComm communication. In step S166, the VC issuing unit 23 of the camera 11 acquires and verifies the message including the manufacturer VC transmitted from the manufacturer server 13. After verifying the message, the VC issuing unit 23 stores the acquired manufacturer VC in the storage unit 25 and ends the process.

[0110] As described above, if the manufacturer VC needs to be updated, for example, if the manufacturer VC in the camera 11 is leaked, the camera 11 can request that the manufacturer VC be reissued and update to the new manufacturer VC reissued in response to the request. The manufacturer VC may be updated periodically using the above-mentioned update mechanism. However, if the camera private key is leaked, it becomes difficult to mutually authenticate the camera 11 and the manufacturer server 13, so another method is required.

[0111] Fig. 12 is a sequence diagram showing the manufacturer VC reissue process in response to the case where the camera private key has been leaked. In the manufacturer VC reissue process of Fig. 12, the administrator of the camera 11 is registered in advance on the manufacturer side, and the manufacturer VC is reissued via the pre-registered administrator (user). This manufacturer VC reissue process is executed in two parts: a pre-registration sequence in which the user who will become the administrator registers the administrator when, for example, purchasing the camera 11, and a reissue sequence in case a reissue becomes necessary.

[0112] In the pre-registration sequence, first, the user performs an operation to issue a VC for manufacturer registration in step S181. For example, the user performs an operation to select "issue a VC for pre-registration" on the setting screen of the camera 11.

[0113] In step S182, the VC issuing unit 23 of the camera 11 issues a VC for manufacturer registration in response to the VC issuing operation for manufacturer registration and displays it on the display. The VC issuing unit 23 issues a VC with the serial number of the camera 11 as the VC for manufacturer registration, for example.

[0114] In step S183, the user accesses the manufacturer server 13 and performs an operation to register a manufacturer registration VC. In step S184, the manufacturer server 13 uses the manufacturer registration VC to confirm that the user is the owner of the camera 11, associates the user with the administrator of the camera 11, and stores this in the user management DB of the storage unit 42. In the user management DB, for example, the user's email address and the manufacturer registration VC are associated and stored. This completes the pre-registration sequence.

[0115] In the reissue sequence, the user performs a VC reissue operation in step S201. For example, the user performs an operation to select "reissue manufacturer VC" on the setting screen of the camera 11. In step S202, the VC issuing unit 23 of the camera 11 transmits a VC reissue request to the manufacturer server 13 via network communication in response to the user's VC reissue operation.

[0116] In step S203, the manufacturer server 13 receives the VC reissue request from the camera 11 and sends the password (one-time password) to the email address of the user registered as the administrator of the camera 11 in the user management DB.

[0117] In step S204, the user checks the password sent to the pre-registered email address and enters it into the camera 11. In step S205, the VC issuing unit 23 of the camera 11 sends a VC reissue request with user authentication information, which is a VC reissue request to which the password entered by the user is added as user authentication information, to the manufacturer server 13 via network communication.

[0118] In step S206, the manufacturer server 13 acquires the VC reissue request with user authentication information from the camera 11, verifies that the user is a pre-registered user, invalidates the existing manufacturer VC, and then reissues the manufacturer VC. Then, the manufacturer server 13 transmits the reissued manufacturer VC to the camera 11 via network communication.

[0119] In step S207, the VC issuing unit 23 of the camera 11 acquires the manufacturer VC transmitted from the manufacturer server 13 via network communication, stores it in the storage unit 25, and ends the process.

[0120] According to the above-described manufacturer VC reissue process via a pre-registered administrator, the manufacturer VC can be reissued even if the camera private key is leaked.

[0121] <10. Summary> As described above, the information processing system 1 includes a camera 11 and a smartphone 12 (device) owned by a user, and the smartphone 12 transmits a photographer DID that identifies the user as the photographer to the camera 11. The camera 11 authenticates the user using the photographer DID, and when a photographing activity is performed by the authenticated user, generates activity data VC that proves the authenticity of the activity data indicating the photographing activity and adds the activity data VC to the photographing data to generate photographing data with the activity data VC. This makes it possible to prove the authenticity of the activity data indicating the photographing activity when the user performs a photographing activity with the camera 11, and to realize a service that provides the user with benefits such as points according to the activity data.

[0122] 11. First Business Model of Photography Activity Data Utilization Service FIG. 13 is a diagram showing an example of a first business model realized using the photography activity data utilization service of the information processing system 1 described above.

[0123] The first business model in Figure 13 is a service that provides benefits for users who take photos of tourist spots or facilities for their photography activities, and is an affiliate model that users can use free of charge, similar to the MaaS mileage service.

[0124] The user 111 takes photos using a camera CAM purchased from a camera manufacturer 112 and transmits the photo data, along with activity data VC generated by the camera CAM, to an app 113AP on the user's smartphone 113 via short-range communication, thereby earning miles based on the photo-taking activity. The user 111 can access rewards offered by a reward provider 114 through the app 113AP on the smartphone 113, and can use the miles to exchange for rewards or participate in a lottery. The reward provider 114 may be, for example, a company or public organization that owns a tourist spot or facility that the user wants to photograph, or a company that wants to utilize the photo-taking activity data. The reward provider 114 pays a fee to the app operating company 115 to have the reward posted on the app 113AP. The app operating company 115 creates the app 113AP and earns revenue from the reward provided by the reward provider 114. The app operating company 115 may be the same company as the camera manufacturer 112.

[0125] Users 111 use the app 113AP motivated by the opportunity to exchange miles earned through photography activities for rewards or participate in lotteries. Reward providers 114 can, for example, help users 111 recognize tourist destinations and facilities as brands, or acquire and utilize photography activity data. Because anyone can verify photography activities using the activity data VC, the app operating company 115 does not have to be the same company as the camera manufacturer 112 and can provide services using rewards from the reward provider 114 as a revenue source. When camera manufacturers 112 collaborate with the app operating company 115 or serve as the app operating company 115, they can promote sales of their own camera CAMs by offering a high mileage redemption rate for their own camera CAMs or offering rewards that can be exchanged for their own points.

[0126] FIG. 14 shows an example of a mileage return rate that leads to sales promotion of the company's camera CAM.

[0127] Photographers are assigned a rank based on their photography experience. For example, if they have taken fewer than 100 photos, they are assigned a C rank; if they have taken 100 or more photos but less than 1,000 photos, they are assigned a B rank; if they have taken 1,000 or more photos but less than 10,000 photos, they are assigned an A rank; and if they have taken 10,000 photos or more, they are assigned an S rank. Mile redemption rates vary depending on the rank, with C rank being 0.5, B rank being 1, A rank being 1.5, and S rank being 2. If the camera CAM is a camera from company A, the redemption rate is set to 2, and if the camera is a camera from a company other than company A, the redemption rate is set to 1, with company A's own redemption rate being set higher.

[0128] For example, if a photographer with rank A takes 100 new photos using a camera CAM from company A, the number of miles he or she can earn is 100 * (1.5 + 2) = 350, or 350 miles.

[0129] As described above, the first business model using the photography activity data utilization service is a business model that generates revenue through rewards from the benefit provider 114 and sales promotion of the camera CAM, and also makes it possible to market photography activity data.

[0130] 12. Second Business Model of Photography Activity Data Utilization Service FIG. 15 is a diagram showing an example of a second business model realized using the photography activity data utilization service of the information processing system 1 described above.

[0131] The second business model in Figure 15 is an NFT game in which users can earn virtual currency by taking photos in the metaverse using an NFT camera, which is a virtual camera linked to a real camera.

[0132] When user 141A purchases a real camera CAM-R from camera manufacturer 142, he or she can acquire an NFT camera CAM-NFT that is linked one-to-one with the real camera CAM-R. User 141A takes photos using the NFT camera CAM-NFT and registers the photo data with activity data VC in app 143AP on user 141A's smartphone 143, thereby earning virtual currency according to the photo-taking activity. When user 141A resells the real camera CAM-R to user 141B, ownership of the NFT camera CAM-NFT linked to the real camera CAM-R is also transferred to user 141B. Alternatively, user 141B may purchase the NFT camera CAM-NFT with virtual currency and then acquire the real camera CAM-R linked to the NFT camera CAM-NFT from user 141A. User 141B pays the resale fee for the purchase of the NFT camera CAM-NFT to app 143AP in virtual currency. The app operating company 144 creates the app 133AP and earns revenue from resale fees for the NFT camera CAM-NFT. The app operating company 144 may be the same company as the camera manufacturer 142.

[0133] Users 141 (141A, 141B) can capture the real world using the real camera CAM-R and earn virtual currency by capturing photos in the Metaverse using the NFT camera CAM-NFT. They can also earn virtual currency as a resale profit when reselling the real camera CAM-R and the NFT camera CAM-NFT. Because anyone can verify photography activities using the activity data VC, the app operating company 144 does not have to be the same company as the camera manufacturer 142, and can earn revenue from resale fees for the NFT camera CAM-NFT. If the camera manufacturer 142 collaborates with the app operating company 144 or serves as the app operating company 144, it can promote sales of the real camera CAM-R by offering a higher value of virtual currency as a reward for photography activities using the associated NFT camera CAM-NFT for the new real camera CAM-R than for the older real camera CAM-R. In addition, by allowing users 141 to purchase real cameras CAM-R and NFT cameras CAM-NFT with the virtual currency they have earned, it is possible to encourage users to replace their real cameras CAM-R.

[0134] As described above, the second business model using the photography activity data utilization service is a business model that increases the desire to replace real cameras CAM-R with NFT cameras CAM-NFT, and generates revenue by collecting resale fees and promoting sales of new models of CAM cameras.The value of the NFT camera CAM-NFT can be set to increase the more photos are taken with the NFT camera CAM-NFT.

[0135] 13. Example Computer Configuration The above-described series of processes can be executed by hardware or software. When the series of processes are executed by software, the programs that make up the software are installed on a computer. Here, the term "computer" includes microcomputers built into dedicated hardware, and general-purpose personal computers, for example, that can execute various functions by installing various programs.

[0136] FIG. 16 is a block diagram showing an example of the hardware configuration of the manufacturer server 13, the service server 14, a node of the blockchain network 15, or a computer as a device owned by a user.

[0137] The computer 200 has a CPU 201, a ROM 202, and a RAM 203. The CPU 201, the ROM 202, and the RAM 203 are connected to one another by a bus 204. An input / output interface 205 is also connected to the bus 204. An input unit 206, an output unit 207, a storage unit 208, a communication unit 209, and a drive 210 are connected to the input / output interface 205.

[0138] The input unit 206 includes a keyboard, mouse, microphone, touch panel, input terminal, etc. The output unit 207 includes a display, speaker, output terminal, etc. The storage unit 208 includes a hard disk, SSD, RAM disk, non-volatile memory, etc. The communication unit 209 includes a network interface, etc. The drive 210 drives a removable recording medium 211 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory.

[0139] In the computer 200 configured as above, the CPU 201 performs the above-described series of processes by, for example, loading a program stored in the storage unit 208 into the RAM 203 via the input / output interface 205 and the bus 204 and executing the program. The RAM 203 also stores data necessary for the CPU 201 to execute various processes as appropriate.

[0140] In the computer 200, the program can be installed in the storage unit 208 via the input / output interface 205 by inserting the removable recording medium 211 into the drive 210. The program can also be received by the communication unit 209 via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting, and installed in the storage unit 208. Alternatively, the program can be installed in the ROM 202 or the storage unit 208 in advance.

[0141] The program executed by computer 200 may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.

[0142] In this specification, the steps described in the flowcharts may be performed in chronological order in the order described, but they do not necessarily have to be processed in chronological order, and may be performed in parallel or at any necessary timing, such as when a call is made.

[0143] In this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all of the components are housed in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.

[0144] The embodiments of the present disclosure are not limited to the above-described embodiments, and various modifications are possible within the scope of the gist of the technology of the present disclosure.

[0145] For example, it is possible to adopt a form in which all or part of the above-described embodiments are combined as appropriate.

[0146] For example, the technology of the present disclosure can be configured as a cloud computing system in which a single function is shared and processed collaboratively by multiple devices via a network.

[0147] Furthermore, each step described in the above flowchart can be executed by one device or can be shared and executed by multiple devices. When one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices.

[0148] The effects described in this specification are merely examples and are not limiting, and there may be effects other than those described in this specification.

[0149] The technology disclosed herein may have the following configurations: (1) An information processing system including a camera and a device owned by a user, wherein the device transmits user identification information identifying the user to the camera, and the camera authenticates the user using the user identification information, and when the authenticated user performs a photographic activity, generates activity data VC that proves the authenticity of activity data indicating the photographic activity and adds the activity data VC to the photographic data, thereby generating photographic data with the activity data VC attached. (2) The information processing system described in (1), wherein the camera stores a camera private key associated with camera identification information that identifies the camera, and generates the activity data VC by signing the activity data with the camera private key. (3) The information processing system described in (2), wherein the activity data VC consists of a camera signature obtained by signing the activity data with the camera private key, and metadata. (4) The information processing system described in (3), wherein the metadata includes the camera identification information, the user identification information, and the activity data. (5) The information processing system according to any one of (1) to (4), wherein the camera stores a manufacturer VC that certifies that the camera is an authentic camera manufactured by the manufacturer, and the captured image data with the activity data VC includes the manufacturer VC. (6) The information processing system according to any one of (1) to (5), wherein the camera transmits the captured image data with the activity data VC to the device by short-range communication, and the device acquires and stores the captured image data with the activity data VC by the short-range communication. (7) The information processing system according to any one of (1) to (6), wherein the camera stores the activity data VC on a removable recording medium, and when the recording medium is attached to a different camera from the camera, the different camera verifies the activity data VC on the recording medium and stores it in the camera. (8) The information processing system according to (7), wherein the device transmits the user identification information to the different camera, and the different camera authenticates the user using the user identification information and verifies the activity data VC on the recording medium by the authenticated user and stores it in the camera.(9) The information processing system according to any one of (1) to (8), wherein, when the user takes a photograph using the camera and another camera different from the camera, the activity data VC is synchronized between the camera and the other camera. (10) When a photograph is taken, the camera transmits an activity data update notification indicating that the activity data VC has been updated to the device via short-range communication, and the device transmits the activity data update notification from the camera to the other camera via short-range communication, thereby synchronizing the activity data VC. (11) The information processing system according to any one of (1) to (10), wherein the activity data VC includes the activity data at the time of photographing and the latest activity data. (12) The information processing system according to (11), wherein the camera updates the latest activity data of the photographed data with the activity data VC in response to an operation that reflects the latest activity data. (13) The information processing system according to any one of (1) to (12), wherein, when measuring the activity data, the camera does not count multiple photographs with the same parameter settings at the time of photographing. (14) The information processing system according to any one of (1) to (13), wherein the camera, when measuring the activity data, does not include recording time by fixed-point shooting in the measurement. (15) The information processing system according to any one of (1) to (14), wherein the camera stores a manufacturer VC that certifies that the camera is an authentic product manufactured by a manufacturer, the camera requests a server device managed by the camera manufacturer to reissue the manufacturer VC, and stores the manufacturer VC reissued by the server device in response to the request. (16) The information processing system according to (15), wherein the camera and the server device make the request by communication using a private key and a public key linked to camera identification information that identifies the camera, and a private key and a public key linked to manufacturer identification information that identifies the manufacturer.(17) The information processing system according to any one of (1) to (16), wherein the device transmits the photographed data with the activity data VC to another server device and acquires a benefit corresponding to the photographed data with the activity data VC from the other server device. (18) The information processing system according to (17), wherein the benefit is virtual currency, miles, or points. (19) The information processing system according to any one of (1) to (18), wherein the user identification information is a DID that identifies the user, and wherein user authentication using the user identification information is DID authentication. (20) A camera that acquires user identification information that identifies the user from a device owned by the user, authenticates the user using the user identification information, and, when a photographic activity is performed by the authenticated user, generates activity data VC that proves the authenticity of activity data indicating the photographed activity and adds the activity data VC to the photographed data, thereby generating photographed data with the activity data VC.

[0150] 1 Information processing system, 11, 11X, 11Y Camera, 12 Smartphone, 13 Server device (manufacturer server), 14 Server device (service server), 15 Blockchain network, 21 Photography unit, 22 DID authentication / VC verification unit, 23 VC issuing unit, 24 Near-field communication unit, 25 Memory unit, 26 Memory card, 31 Application software (app), 32 Near-field communication unit, 33 Memory unit, 41 VC issuing unit, 42 Memory unit, 51 App management unit, 52 DID authentication / VC verification unit, 53 Memory unit, 61 DID document management unit, 62 Memory unit, 200 Computer, 202 ROM, 204 Bus, 205 Input / output interface, 206 Input unit, 207 Output unit, 208 Memory unit, 209 Communication unit, 210 Drive, 211 Removable recording medium

Claims

1. An information processing system including a camera and a device owned by a user, wherein the device transmits user identification information for identifying the user to the camera, and the camera authenticates the user using the user identification information, and when a photographing activity is performed by the authenticated user, generates activity data VC that proves the authenticity of activity data indicating the photographing activity and adds the activity data VC to the photographing data to generate photographing data with the activity data VC.

2. The information processing system according to claim 1, wherein the camera stores a camera private key associated with camera identification information that identifies the camera, and generates the activity data VC by signing the activity data with the camera private key.

3. The information processing system according to claim 2, wherein the activity data VC is composed of a camera signature obtained by signing the activity data with the camera private key, and metadata.

4. The information processing system according to claim 3, wherein the metadata includes the camera identification information, the user identification information, and the activity data.

5. The information processing system according to claim 1, wherein the camera stores a manufacturer VC that certifies that the camera is an authentic product manufactured by the manufacturer, and the photographed data with activity data VC includes the manufacturer VC.

6. The information processing system according to claim 1, wherein the camera transmits the photographed data with the activity data VC to the device via short-range communication, and the device acquires and stores the photographed data with the activity data VC via the short-range communication.

7. The information processing system according to claim 1, wherein the camera stores the activity data VC on a removable recording medium, and when the recording medium is attached to a different camera than the camera, the different camera verifies the activity data VC on the recording medium before storing it in the camera.

8. The information processing system of claim 7, wherein the device transmits the user identification information to the other camera, and the other camera authenticates the user using the user identification information, verifies the activity data VC of the authenticated user on the recording medium, and then stores it in the camera.

9. The information processing system according to claim 1, wherein when the user takes pictures using the camera and another camera different from the camera, the activity data VC is synchronized between the camera and the other camera.

10. The information processing system of claim 9, wherein when a photograph is taken, the camera transmits an activity data update notification indicating that the activity data VC has been updated to the device via short-range communication, and the device transmits the activity data update notification from the camera to the other camera via short-range communication, thereby synchronizing the activity data VC.

11. The information processing system according to claim 1, wherein the activity data VC includes the activity data at the time of shooting and the latest activity data.

12. The information processing system according to claim 11, wherein the camera updates the latest activity data of the photographed data with the activity data VC in response to an operation that reflects the latest activity data.

13. The information processing system according to claim 1, wherein the camera, when measuring the activity data, does not count multiple photographs taken with the same parameter settings at the time of photographing.

14. The information processing system according to claim 1, wherein the camera does not include recording time taken at a fixed point in the measurement of the activity data.

15. The information processing system according to claim 1, wherein the camera stores a manufacturer VC that certifies that the camera is an authentic product manufactured by the manufacturer, the camera requests a server device managed by the camera manufacturer to reissue the manufacturer VC, and stores the manufacturer VC reissued by the server device in response to the request.

16. The information processing system of claim 15, wherein the camera and the server device make the request by communication using a private key and a public key linked to camera identification information that identifies the camera, and a private key and a public key linked to manufacturer identification information that identifies the manufacturer.

17. The information processing system according to claim 1, wherein the device transmits the photographed data with the activity data VC to another server device, and obtains a special benefit corresponding to the photographed data with the activity data VC from the other server device.

18. The information processing system according to claim 17, wherein the reward is virtual currency, miles, or points.

19. The information processing system according to claim 1, wherein the user identification information is a DID that identifies the user, and user authentication using the user identification information is DID authentication.

20. A camera that acquires user identification information that identifies a user from a device owned by the user, authenticates the user using the user identification information, and, when a photographing activity is performed by the authenticated user, generates activity data VC that proves the authenticity of activity data indicating the photographing activity and adds the activity data VC to the photographing data to generate photographing data with the activity data VC.

Citation Information

Patent Citations

  • Digital measuring equipment and image measuring equipment

    JP2000215379A

  • Method of proving ownership and ownership transfer history using decentralized id

    US20220309514A1

  • Information processing device, information processing system, information processing method, and non-transient computer-readable medium whereon program has been stored

    WO2019187290A1