Information processing device, control device, and program

Abstract

To provide an information processor, a control device and a program for executing settlement processing without displaying a bar code or a QR code.SOLUTION: The information processing device includes a receiving unit that receives first determination information used for determining a settlement counterpart of a first user from a first control device of the first user 102 whose operation mode is a settlement mode, and receives second determination information used for determining a settlement counterpart of a second user from a second control device of the second user 104 whose operation mode is the settlement mode, an establishing unit that establishes a pair of the first user and the second user when the first determination information and the second determination information satisfy a predetermined pair determination condition, and a control unit that causes at least one of the first control device and the second control device to output information for executing a settlement process between the first user and the second user in response to establishment of the pair of the first user and the second user by the establishing unit.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a control device, and a program. [Background technology]

[0002] Patent Document 1 describes an information processing method that can present information to a user in accordance with the user's purchasing status. [Prior art document] [Patent documents] [Patent Document 1] JP 2024-045395 A Summary of the Invention [Means for solving the problem]

[0003] According to one embodiment of the present invention, there is provided an information processing device. The information processing device may include a receiving unit that receives, from a first control device of a first user operating in a payment mode, first determination information used to determine a payment counterparty for the first user, and receives, from a second control device of a second user operating in a payment mode, second determination information used to determine a payment counterparty for the second user. The information processing device may include an establishing unit that establishes a pair of the first user and the second user when the first determination information and the second determination information satisfy predetermined pair determination conditions. The information processing device may include a control unit that, in response to the establishing unit establishing the pair of the first user and the second user, outputs information for executing a payment process between the first user and the second user to at least one of the first control device and the second control device.

[0004] In the information processing device, the receiving unit may receive the first decision information from the first control device of the first user whose operating mode is a remittance mode among the payment modes, and may receive the second decision information from the second control device of the second user whose operating mode is a receipt mode among the payment modes, and the control unit may output to the first control device information for executing a remittance process in which the first user sends money to the second user as information for executing a payment process between the first user and the second user, and may output to the second control device information for executing a receipt process in which the second user receives money from the first user as information for executing a payment process between the first user and the second user.

[0005] In any of the information processing devices, the establishment unit may establish the pair of the first user and the second user when the receiving unit receives the first determination information and the second determination information within a predetermined pair determination period and the first determination information and the second determination information satisfy the pair determination condition.

[0006] In any of the information processing devices, the receiving unit may receive the first decision information including an image captured by the first control device using a first camera, and the second control device may receive the second decision information including an image captured by the second control device using a second camera, and the establishment unit may establish the pair of the first user and the second user if an object included in the image included in the first decision information is included in the image included in the second decision information.

[0007] In any of the information processing devices, the receiving unit may receive the first decision information including an image captured by the first control device using a first camera, and the second control device may receive the second decision information including an image captured by the second camera, and the establishment unit may establish the pair of the first user and the second user if a gesture identified from the image included in the first decision information is the same as a gesture identified from the image included in the second decision information.

[0008] Any of the information processing devices may further include a storage unit that stores biometric information of the first user and biometric information of the second user, wherein the receiving unit may receive the first decision information including an image captured by the first control device using a first camera, and the second decision information including an image captured by the second control device using a second camera, and the establishment unit may establish the pair of the first user and the second user if the biometric information acquired from the image included in the first decision information matches the biometric information of the second user stored in the storage unit, and if the biometric information acquired from the image included in the second decision information matches the biometric information of the first user stored in the storage unit.

[0009] In any of the information processing devices, the receiving unit may receive the first determination information including location information indicating the location of the first control device and may receive the second determination information including location information indicating the location of the second control device, and the establishment unit may establish the pair of the first user and the second user when the distance between the location of the first control device indicated by the location information included in the first determination information and the location of the second control device indicated by the location information included in the second determination information is shorter than a predetermined distance threshold.

[0010] Any of the information processing devices may further include a storage unit that stores identification information of the first control device and identification information of the second control device, wherein the receiving unit may receive the first determination information including identification information of a device that has established a short-range wireless communication connection with the first control device and receive the second determination information including identification information of a device that has established a short-range wireless communication connection with the second control device, and the establishment unit may establish the pair of the first user and the second user if the identification information of the device included in the first determination information matches the identification information of the second control device stored in the storage unit and the identification information of the device included in the second determination information matches the identification information of the first control device stored in the storage unit.

[0011] In any of the information processing devices, the receiving unit may receive the first decision information from the first control device mounted on a first wearable terminal, and may receive the second decision information from the second control device mounted on a second wearable terminal.

[0012] According to one embodiment of the present invention, there is provided a program that, when executed by a computer, causes the computer to function as any one of the information processing devices.

[0013] According to one embodiment of the present invention, there is provided a control device. The control device may include a setting unit that sets an operation mode to a payment mode. The control device may include an acquisition unit that acquires first determination information used to determine a payment counterparty for a user of the control device. The control device may include a receiving unit that receives, from another control device, second determination information used to determine a payment counterparty for the other user. The control device may include a determination unit that determines, if the first determination information and the second determination information satisfy predetermined payment counterparty determination conditions, that the other user is the payment counterparty for the user. The control device may include an output unit that outputs information for executing a payment process between the user and the other user in response to the determination unit's determination that the other user is the payment counterparty for the user.

[0014] According to one embodiment of the present invention, there is provided a program that, when executed by a computer, causes the computer to function as the control device.

[0015] The above summary of the invention does not list all of the necessary features of the present invention, and subcombinations of these features may also constitute inventions. [Brief explanation of the drawings]

[0016] [Figure 1] An example of a system 10 is shown schematically. [Figure 2] FIG. 2 is an explanatory diagram for explaining an example of a processing flow of the system 10. [Figure 3] 1 shows an example of the configuration of a glasses-type device 100. [Figure 4] FIG. 10 is an explanatory diagram illustrating an example of establishing a user pair. [Figure 5] FIG. 10 is an explanatory diagram illustrating another example of establishing a user pair. [Figure 6] FIG. 10 is an explanatory diagram illustrating another example of establishing a user pair. [Figure 7] FIG. 10 is an explanatory diagram illustrating another example of establishing a user pair. [Figure 8] 2 shows an example of a functional configuration of an information processing device 200. [Figure 9] FIG. 10 is an explanatory diagram for explaining another example of the processing flow of the system 10. [Figure 10] 2 shows an example of a functional configuration of the control device 150. [Figure 11] An example of the hardware configuration of a computer 1200 that functions as the control device 150 or the information processing device 200 is shown in schematic form. DETAILED DESCRIPTION OF THE INVENTION

[0017] In current payment systems, a recipient executes payment processing by scanning a QR code (registered trademark) or similar displayed on the screen of a remittance sender's smartphone or other device. Meanwhile, demand for wearable devices, such as Augmented Reality (AR) glasses whose screens are invisible to others and wearable Artificial Intelligence (AI) devices that do not even have screens, is expected to grow in the future. As a result, current payment systems, which rely on screen scanning, may be unable to execute payment processing. The system according to this embodiment employs a mechanism for executing payment processing by establishing pairing between a recipient's device and a remittance sender's device without a screen scanning step, and outputting information for executing payment processing to both the recipient's device and the remittance sender's device.

[0018] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention as claimed. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention. In the drawings, the same reference numerals are used to designate the same or similar parts, and redundant explanations may be omitted.

[0019] 1 schematically illustrates an example of a system 10. The system 10 may include a plurality of eyeglass-type devices 100. The system 10 may include an information processing device 200.

[0020] The glasses-type device 100 may be any device that has a communication function for accessing the network 20 under control of a control device installed in the device itself. The glasses-type device 100 is, for example, smart glasses. The glasses-type device 100 may be an example of a wearable terminal.

[0021] The network 20 may include a cloud. The network 20 may include a mobile communication network. The mobile communication network may conform to any of the following communication methods: 3G (3rd Generation), LTE (Long Term Evolution), 5G (5th Generation), 6G (6th Generation) and later. The network 20 may conform to a short-range wireless communication method such as Wi-Fi (registered trademark), Bluetooth (registered trademark), or Zigbee (registered trademark). The network 20 may include a wired network.

[0022] The glasses-type device 100 may further have a display function for displaying content on a display unit mounted on the glasses-type device 100. The glasses-type device 100 is, for example, AR glasses.

[0023] The content may be in any data format. For example, the content is text. For example, the content is illustrations. For example, the content is still images. For example, the content is video. For example, the content is 3D CG (Computer Graphics) data. The content may include a combination of these.

[0024] The eyeglasses-type device 100 may be a device that can give the wearer of the eyeglasses-type device 100 the sensation that the content is located in real space by displaying the content on transparent or translucent glasses. That is, the eyeglasses-type device 100 may be a so-called transparent (see-through) device. The eyeglasses-type device 100 may also be a video pass-through device. In this case, the eyeglasses-type device 100 may display, on a non-transparent display, a captured image capturing a range corresponding to the field of view of the wearer of the eyeglasses-type device 100, and superimpose the content.

[0025] The glasses-type device 100 has a setting function for setting an operation mode, for example. The glasses-type device 100 sets the operation mode to a payment mode for executing a payment process, for example. The glasses-type device 100 sets the operation mode to a remittance mode within the payment process, for example. The glasses-type device 100 sets the operation mode to a receipt mode within the payment process, for example.

[0026] The glasses-type device 100 has a positioning function that measures the position of the device itself using a positioning sensor mounted thereon. The positioning sensor includes, for example, a GNSS (Global Navigation Satellite System) sensor. The positioning sensor includes, for example, a GPS (Global Positioning System) sensor. The positioning sensor includes, for example, an RTK (Real Time Kinematic) sensor.

[0027] The settlement process includes, for example, a payment process for goods or services, and may also include a transfer process in which money is transferred from one party to another without the accompanying goods or services.

[0028] The information processing device 200 executes various processes. For example, the information processing device 200 executes an intermediation process that mediates payment processing. Fig. 1 shows an example of a case where the information processing device 200 mediates payment processing between a user 102 wearing the glasses-type device 100 and a user 104 wearing the glasses-type device 100.

[0029] For example, the space to which the user 102 belongs and the space to which the user 104 belongs are the same space. The space to which the user 102 belongs and the space to which the user 104 belongs may be different spaces.

[0030] The user 102 is an example of a first user, and the control device installed in the eyeglasses-type device 100 of the user 102 may be an example of a first control device. In this case, the user 104 is an example of a second user, and the control device installed in the eyeglasses-type device 100 of the user 104 may be an example of a second control device.

[0031] The user 102 may be an example of a second user, and the control device installed in the eyeglasses-type device 100 of the user 102 may be an example of a second control device. In this case, the user 104 may be an example of a first user, and the control device installed in the eyeglasses-type device 100 of the user 104 may be an example of a second control device.

[0032] Fig. 2 is an explanatory diagram illustrating an example of the processing flow of the system 10. In the example of the processing flow of the system 10 shown in Fig. 2, a state in which the operation mode of the eyeglasses-type device 100 of the user 102 and the operation mode of the eyeglasses-type device 100 of the user 104 are in the payment mode is set as a starting state.

[0033] In step (step may be abbreviated as S) 102, the information processing device 200 receives, from the glasses-type device 100 of the user 102, first determination information used to determine a payment partner for the user 102. The information processing device 200 receives the first determination information from the glasses-type device 100 of the user 102 via the network 20, for example.

[0034] In S104, the information processing device 200 receives, from the glasses-type device 100 of the user 104, second determination information used to determine the payment partner of the user 104. The information processing device 200 receives the second determination information from the glasses-type device 100 of the user 104 via the network 20, for example.

[0035] In S106, the information processing device 200 establishes a pair of the user 102 and the user 104 based on the first determination information received in S102 and the second determination information received in S104. For example, if the first determination information and the second determination information satisfy a predetermined pair determination condition, the information processing device 200 establishes a pair of the user 102 and the user 104. Note that a pair may be a combination of a user who sends money and a user who receives the money. Details of the information processing device 200 establishing a pair will be described later. Here, the explanation will continue assuming that the information processing device 200 has established a pair of the user 102 and the user 104.

[0036] In S108, in response to establishing a pair of the user 102 and the user 104 in S106, the information processing device 200 causes the glasses-type device 100 of the user 102 to output information for executing a payment process between the user 102 and the user 104. In S110, in response to establishing a pair of the user 102 and the user 104 in S106, the information processing device 200 causes the glasses-type device 100 of the user 104 to output information for executing a payment process between the user 102 and the user 104.

[0037] The user 102, who has confirmed the information output by the glasses-type device 100 of the user 102 in S108, inputs the information necessary to execute the payment process between the user 102 and the user 104 into the glasses-type device 100 of the user 102. Furthermore, the user 104, who has confirmed the information output by the glasses-type device 100 of the user 104 in S110, inputs the information necessary to execute the payment process between the user 102 and the user 104 into the glasses-type device 100 of the user 104. Thereafter, in S112, the payment process between the user 102 and the user 104 is executed.

[0038] 1 and 2 show an example of a case where a user 102 and a user 104 perform a payment process using the eyeglasses device 100. At least one of the eyeglasses device 100 of the user 102 and the eyeglasses device 100 of the user 104 may be replaced with a wearable terminal that has a communication function for accessing the network 20 under the control of a control device mounted on the device itself and does not have a display unit. At least one of the eyeglasses device 100 of the user 102 and the eyeglasses device 100 of the user 104 may be replaced with any other wearable terminal that has a communication function for accessing the network 20 under the control of a control device mounted on the device itself. At least one of the eyeglasses device 100 of the user 102 and the eyeglasses device 100 of the user 104 may be replaced with a mobile terminal such as a smartphone.

[0039] With the advent of electronic money, smartphone-based payment processing has become widespread. In smartphone-based payment processing, one party (the sender or the receiver) presents information necessary for payment processing by displaying a barcode, QR code, or the like on the smartphone's display, and the other party (the sender or the receiver) reads the information using a camera, barcode reader, or QR code reader. Meanwhile, demand for wearable devices, particularly AR glasses, is expected to grow. As demand for wearable devices grows, the number of wearable device users who do not carry smartphones on a daily basis is expected to increase. However, compared to smartphones, wearable devices often have difficulty displaying information necessary for payment processing to others by displaying a barcode, QR code, or the like on the display. Furthermore, some wearable devices may not even have a display. As a result, payment processing employing a method of displaying information necessary for payment processing by displaying a barcode, QR code, or the like on the display may not be possible. Therefore, it is desirable to be able to perform payment processing without displaying a barcode, QR code, or the like.

[0040] In contrast, in the system 10 according to the present embodiment, the information processing device 200 receives decision information from both a control device installed in a device owned by the remittance sender and a control device installed in a device owned by the remittance receiver, and establishes a pair between the remittance sender and the remittance receiver based on the received decision information. The information processing device 200 then outputs information for executing a payment process between the remittance sender and the remittance receiver to at least one of the devices owned by the remittance sender and the remittance receiver. By establishing a pair between the remittance sender and the remittance receiver, the information processing device 200 mediates the payment process between the remittance sender and the remittance receiver. Therefore, the system 10 according to the present embodiment can execute the payment process without requiring either the remittance sender or the remittance receiver to display a barcode, QR code, or the like. In particular, the system 10 according to the present embodiment can execute the payment process between the remittance sender and the remittance receiver even when both the device owned by the remittance sender and the device owned by the remittance receiver are wearable devices, thereby improving the user experience of wearable devices. As a result, the system 10 according to this embodiment can contribute to the widespread use of wearable devices.

[0041] 3 schematically shows an example of the configuration of the eyeglass-type device 100. The eyeglass-type device 100 may include a frame 110 having rims 112, a bridge 114, and temples 118.

[0042] The glasses-type device 100 includes, for example, a lens 116. The lens 116 may be an example of a display unit of the glasses-type device 100. The lens 116 may also be an example of a user interface of the glasses-type device 100.

[0043] The lens 116 may be a transparent or semi-transparent display. In this case, the eyeglass-type device 100 may be a transparent or semi-transparent display-type device. The eyeglass-type device 100 may also have a projection function for projecting a display onto the lens 116. In this case, the eyeglass-type device 100 may be a projection-type device. The projection function of the eyeglass-type device 100 may be an example of the display function of the eyeglass-type device 100.

[0044] The glasses-type device 100 includes, for example, a camera 170. Fig. 3 shows an example in which the glasses-type device 100 includes one camera 170. The glasses-type device 100 may include multiple cameras 170. The camera 170 may be an example of a user interface for the glasses-type device 100.

[0045] The imaging range of the camera 170 is, for example, a range corresponding to the field of view of the wearer of the eyeglasses-type device 100. The imaging range of the camera 170 may be a range wider than the field of view of the wearer of the eyeglasses-type device 100, or may be substantially the same range as the field of view of the wearer of the eyeglasses-type device 100.

[0046] 3 is an example. The camera 170 may be placed at any other position on the frame 110.

[0047] The glasses-type device 100 includes, for example, a speaker 180. The speaker 180 may be an example of a user interface of the glasses-type device 100.

[0048] 3 is an example. The speaker 180 may be placed at any other position on the frame 110.

[0049] The glasses-type device 100 includes, for example, a microphone 190. The microphone 190 may be an example of a user interface of the glasses-type device 100.

[0050] 3 is an example. The microphone 190 may be placed at any other position on the frame 110.

[0051] The glasses-type device 100 includes, for example, an operation unit. The glasses-type device 100 receives various inputs via the operation unit. The operation unit may be disposed at any position on the glasses-type device 100. The operation unit may be an example of a user interface of the glasses-type device 100.

[0052] The glasses-type device 100 includes an input unit such as a button. The glasses-type device 100 receives various inputs via the input unit. The input unit may be disposed at any position on the frame 110. The input unit may be an example of a user interface for the glasses-type device 100.

[0053] The glasses-type device 100 includes, for example, a projection device that projects a virtual keyboard and a sensing device that senses input to the virtual keyboard. The glasses-type device 100 accepts various inputs via the virtual keyboard. The projection device and the sensing device may be disposed at any position on the glasses-type device 100. The virtual keyboard may be an example of a user interface for the glasses-type device 100.

[0054] The glasses-type device 100 includes, for example, a control device 150. The control device 150 may control various functions of the glasses-type device 100. The glasses-type device 100 may execute various functions in accordance with the control of the control device 150.

[0055] The location of the control device 150 in Figure 3 is one example. The control device 150 may be located in another position on the frame 110. For example, the control device 150 may be located at any position inside the frame 110. For example, the control device 150 may be located inside the temple 118. As a specific example, the control device 150 may be located at the tip of the temple 118, i.e., at the end cap. The control device 150 may also be located at any position outside the frame 110.

[0056] The glasses-type device 100 includes, for example, a battery. The battery may be disposed in any position of the glasses-type device 100.

[0057] The glasses-type device 100 may communicate with an external device. For example, the glasses-type device 100 performs wireless communication with the external device. For example, the glasses-type device 100 performs short-range wireless communication with the external device. For example, the glasses-type device 100 performs mobile communication with the external device. The glasses-type device 100 may also perform wired communication with the external device.

[0058] The glasses-type device 100 communicates with, for example, an information processing device 200. The glasses-type device 100 communicates with, for example, another glasses-type device 100. The glasses-type device 100 communicates with a communication terminal such as a smartphone, a tablet terminal, or a PC. The glasses-type device 100 may accept various inputs by receiving input information from the communication terminal.

[0059] 4 is an explanatory diagram for explaining an example of establishing a pair of users. Here, an example will be mainly explained in which the information processing device 200 establishes a pair of users 102 and 104 based on a captured image captured by a camera mounted on the eyeglass-type device 100. The captured image may be a still image or a moving image.

[0060] The user 102 and the user 104 who wish to execute a payment process between themselves check a poster 300 that describes matters related to the payment process. As shown in FIG. 4 , the poster 300 states, "When executing a payment process, please take an image of your card." Following the instructions on the poster 300, the user 102 and the user 104 pick up a card 350 placed around the poster 300 and start capturing an image using the eyeglass device 100.

[0061] The camera 170 mounted on the glasses-type device 100 of the user 102 captures an image of an imaging range 172 that includes the card 350. The glasses-type device 100 of the user 102 transmits first determination information including the captured image to the information processing device 200.

[0062] The camera 170 mounted on the glasses-type device 100 of the user 104 captures an image of the imaging range 174 that includes the card 350. The glasses-type device 100 of the user 104 transmits second determination information including the captured image to the information processing device 200.

[0063] The camera 170 mounted on the eyeglasses-type device 100 of the user 102 may be an example of the first camera, and the camera 170 mounted on the eyeglasses-type device 100 of the user 104 may be an example of the second camera. Also, the camera 170 mounted on the eyeglasses-type device 100 of the user 102 may be an example of the second camera, and the camera 170 mounted on the eyeglasses-type device 100 of the user 104 may be an example of the first camera.

[0064] For example, when an object included in a captured image included in the first determination information is included in a captured image included in the second determination information, the information processing device 200 establishes a pair of the user 102 and the user 104. The object may be anything as long as it has a feature point. For example, the object is a card. For example, the object is a poster. For example, the object is a POP (Point Of Purchase).

[0065] The captured image included in the first determination information includes a "card 350" as an object. The captured image included in the second determination information includes a "card 350" as an object. Therefore, the information processing device 200 establishes a pair of the user 102 and the user 104, assuming that the object included in the captured image included in the first determination information is included in the captured image included in the second determination information.

[0066] 5 is an explanatory diagram for explaining another example of establishing a user pair. Here, differences from the above-described example of establishing a user pair will be mainly explained.

[0067] The user 102 and the user 104 who wish to perform a payment process between themselves check a poster 400 that describes matters related to the payment process. As shown in FIG. 5, the poster 400 states, "When performing a payment process, please take an image of your hand with your thumb up." The user 102 and the user 104 start taking an image using the glasses-type device 100 in accordance with the contents of the poster 400.

[0068] The camera 170 mounted on the glasses-type device 100 of the user 102 captures an image of an imaging range 172 that includes the hand of the user 102 with the thumb raised. The glasses-type device 100 of the user 102 transmits first determination information including the captured image to the information processing device 200.

[0069] The camera 170 mounted on the glasses-type device 100 of the user 104 captures an image of an imaging range 174 that includes the hand of the user 104 with the thumb raised. The glasses-type device 100 of the user 104 transmits second determination information including the captured image to the information processing device 200.

[0070] For example, when a gesture identified from a captured image included in the first determination information is the same as a gesture identified from a captured image included in the second determination information, the information processing device 200 establishes a pair of the user 102 and the user 104. The gesture is, for example, a static gesture. Examples of static gestures include raising your thumb or shaping your hand into an OK sign. The gesture is, for example, a dynamic gesture. Examples of dynamic gestures include waving your hand or drawing a specific trajectory with your fingers.

[0071] The captured image included in the first determination information includes the hand of the user 102 with the thumb raised. Therefore, the gesture identified from the captured image included in the first determination information is "thumbs up." Furthermore, the captured image included in the second determination information includes the hand of the user 104 with the thumb raised. Therefore, the gesture identified from the captured image included in the second determination information is "thumbs up." Therefore, the information processing device 200 establishes a pair of the user 102 and the user 104, assuming that the gesture identified from the captured image included in the first determination information is the same as the gesture identified from the captured image included in the second determination information.

[0072] 6 is an explanatory diagram for explaining another example of establishing a user pair. Here, differences from the above-described example of establishing a user pair will be mainly described.

[0073] The user 102 and the user 104 who wish to perform a payment process between themselves check a poster 500 that describes matters related to the payment process. As shown in FIG. 6, the poster 500 states, "When performing a payment process, please take an image of the other person's hand with their thumb up." The user 102 and the user 104 cooperate with each other and start taking an image using the eyeglass device 100 in accordance with the contents of the poster 500.

[0074] The camera 170 mounted on the glasses-type device 100 of the user 102 captures an image of an imaging range 172 that includes the hand of the user 104 with the thumb raised. The glasses-type device 100 of the user 102 transmits first determination information including the captured image to the information processing device 200.

[0075] The camera 170 mounted on the glasses-type device 100 of the user 104 captures an image of an imaging range 174 that includes the hand of the user 102 with the thumb raised. The glasses-type device 100 of the user 104 transmits second determination information including the captured image to the information processing device 200.

[0076] The captured image included in the first determination information includes the hand of the user 104 with the thumb raised. Therefore, the gesture identified from the captured image included in the first determination information is "thumbs up." Furthermore, the captured image included in the second determination information includes the hand of the user 102 with the thumb raised. Therefore, the gesture identified from the captured image included in the second determination information is "thumbs up." Therefore, the information processing device 200 establishes a pair of the user 102 and the user 104, assuming that the gesture identified from the captured image included in the first determination information is the same as the gesture identified from the captured image included in the second determination information.

[0077] In the example shown in Fig. 6, the gesture to be imaged by the camera 170 mounted on the glasses-type device 100 is the gesture of the other party making the payment. This differs from the example shown in Fig. 5, in which the gesture to be imaged by the camera 170 mounted on the glasses-type device 100 is the gesture of the user of the glasses-type device 100.

[0078] 7 is an explanatory diagram for explaining another example of establishing a user pair. Here, differences from the above-described example of establishing a user pair will be mainly explained. It is assumed that the information processing device 200 stores face information of the user 102 and face information of the user 104.

[0079] The user 102 and the user 104 who wish to execute a payment process between themselves check a poster 600 that describes matters related to the payment process. As shown in FIG. 7 , the poster 600 states, "When executing the payment process, please take an image of the face of the person you are making the payment with." The user 102 and the user 104 cooperate with each other and start taking an image using the eyeglass-type device 100 in accordance with the contents of the poster 600.

[0080] The camera 170 mounted on the glasses-type device 100 of the user 102 captures an image of an imaging range 172 that includes the face of the user 104. The glasses-type device 100 of the user 102 transmits first determination information including the captured image to the information processing device 200.

[0081] The camera 170 mounted on the glasses-type device 100 of the user 104 captures an image of an imaging range 174 that includes the face of the user 102. The glasses-type device 100 of the user 104 transmits second determination information including the captured image to the information processing device 200.

[0082] For example, if biometric information acquired from the captured image included in the first determination information matches the biometric information of the user 104 stored in the information processing device 200, and biometric information acquired from the captured image included in the second determination information matches the biometric information of the user 102 stored in the information processing device 200, the information processing device 200 establishes a pair of the user 102 and the user 104. The biometric information includes, for example, face information. The biometric information includes, for example, fingerprint information. The biometric information includes, for example, palmprint information. The biometric information includes, for example, ear shape information. The biometric information includes, for example, iris information. The biometric information includes, for example, voiceprint information.

[0083] The captured image included in the first determination information includes the face of the user 104. Therefore, the biometric information acquired from the captured image included in the first determination information is "facial information of the user 104." Furthermore, the captured image included in the second determination information includes the face of the user 102. Therefore, the biometric information acquired from the captured image included in the second determination information is "facial information of the user 102." Therefore, the information processing device 200 establishes a pair of the user 102 and the user 104, for example, by determining that the biometric information acquired from the captured image included in the first determination information matches the facial information of the user 104 stored in the information processing device 200 and that the biometric information acquired from the captured image included in the second determination information matches the facial information of the user 102 stored in the information processing device 200.

[0084] 8 shows an example of the functional configuration of the information processing device 200. The information processing device 200 includes a storage unit 202, a receiving unit 204, an establishing unit 206, a control unit 208, and a payment processing unit 210. Note that it is not essential that the information processing device 200 includes all of these components.

[0085] The storage unit 202 stores various types of information. The storage unit 202 includes, for example, object information indicating an object. The storage unit 202 includes, for example, gesture information indicating a gesture. The storage unit 202 stores, for example, biometric information of a plurality of users, including biometric information of a first user and biometric information of a second user. The storage unit 202 stores, for example, identification information of a control device of each of the plurality of users, including identification information of a first control device of the first user and identification information of a second control device of the second user. The storage unit 202 stores, for example, account information of an electronic money application of each of the plurality of users, including account information of an electronic money application of the first user and account information of an electronic money application of the second user. Note that electronic money may be an example of money. The storage unit 202 may store account information of a bank account of each of the plurality of users, including account information of a bank account of the first user and account information of a bank account of the second user.

[0086] The receiving unit 204 receives various types of information. For example, the receiving unit 204 receives the various types of information via the network 20. The receiving unit 204 may store the received various types of information in the storage unit 202.

[0087] The receiving unit 204 receives, for example, first determination information used to determine a payment counterparty for the first user from the first control device of the first user. The receiving unit 204 receives, for example, the first determination information from the first control device whose operating mode is a payment mode. The receiving unit 204 receives, for example, the first determination information from the first control device whose operating mode is a remittance mode within the payment modes. The receiving unit 204 receives, for example, the first determination information from the first control device whose operating mode is a receive mode within the payment modes.

[0088] The first determination information includes, for example, operation mode information indicating an operation mode of the first control device. The first determination information includes, for example, a captured image captured by the first control device using the first camera. The first determination information includes, for example, location information indicating the location of the first control device. The first determination information includes, for example, identification information of a device that has established a short-range wireless communication connection with the first control device. The first determination information includes, for example, voiceprint information acquired by the first control device using the first microphone.

[0089] The receiving unit 204 receives, for example, second determination information used to determine a payment counterparty for the second user from the second control device of the second user. The receiving unit 204 receives, for example, the second determination information from the second control device whose operating mode is a payment mode. The receiving unit 204 receives, for example, the first determination information from the second control device whose operating mode is a remittance mode within the payment modes. The receiving unit 204 receives, for example, the second determination information from the second control device whose operating mode is a receive mode within the payment modes.

[0090] The second determination information includes, for example, operation mode information indicating an operation mode of the second control device. The second determination information includes, for example, a captured image captured by the second control device using the second camera. The second determination information includes, for example, location information indicating the location of the second control device. The second determination information includes, for example, identification information of a device that has established a short-range wireless communication connection with the second control device. The second determination information includes, for example, voiceprint information acquired by the second control device using the second microphone.

[0091] The establishing unit 206 establishes a pair of the first user and the second user. The establishing unit 206 establishes the pair of the first user and the second user, for example, based on various information stored in the storage unit 202. The establishing unit 206 establishes the pair of the first user and the second user, for example, based on various information received by the receiving unit 204.

[0092] For example, if the first determination information and the second determination information satisfy a predetermined pair determination condition, the establishing unit 206 establishes a pair of the first user and the second user. On the other hand, if the first determination information and the second determination information do not satisfy the pair determination condition, the establishing unit 206 does not establish a pair of the first user and the second user.

[0093] For example, the establishing unit 206 establishes a pair of the first user and the second user when the receiving unit 204 receives the first determination information and the second determination information within a predetermined pair determination period and the first determination information and the second determination information satisfy a pair determination condition. On the other hand, the establishing unit 206 does not establish a pair of the first user and the second user when the receiving unit 204 does not receive at least one of the first determination information and the second determination information within the pair determination period or when the first determination information and the second determination information do not satisfy the pair determination condition.

[0094] The pair determination conditions include, for example, that an object included in the captured image included in the first determination information is included in the captured image included in the second determination information. The pair determination conditions include, for example, that an object included in the captured image included in the first determination information is included in the captured image included in the second determination information, and that the object matches an object indicated by the object information stored in the storage unit 202.

[0095] The pair determination conditions include, for example, that an object included in the captured image included in the first determination information matches an object indicated by the object information stored in the storage unit 202, and that an object included in the captured image included in the second determination information matches an object indicated by the object information stored in the storage unit 202. In this case, an object included in the captured image included in the first determination information does not have to be included in the captured image included in the second determination information.

[0096] The pair determination conditions include, for example, that a gesture identified from a captured image included in the first determination information is the same as a gesture identified from a captured image included in the second determination information. The pair determination conditions include, for example, that a gesture of a first user identified from a captured image included in the first determination information is the same as a gesture of a second user identified from a captured image included in the second determination information. The pair determination conditions include, for example, that a gesture of a second user identified from a captured image included in the first determination information is the same as a gesture of a first user identified from a captured image included in the second determination information.

[0097] The pair determination condition includes, for example, that a gesture identified from a captured image included in the first determination information is the same as a gesture identified from a captured image included in the second determination information, and that the gesture matches a gesture indicated by the gesture information stored in the storage unit 202. The pair determination condition includes, for example, that a gesture of a first user identified from a captured image included in the first determination information is the same as a gesture of a second user identified from a captured image included in the second determination information, and that the gesture matches a gesture indicated by the gesture information stored in the storage unit 202. The pair determination condition includes, for example, that a gesture of a second user identified from a captured image included in the first determination information is the same as a gesture of a first user identified from a captured image included in the second determination information, and that the gesture matches a gesture indicated by the gesture information stored in the storage unit 202.

[0098] The pair determination condition includes, for example, that biometric information acquired from the captured image included in the first determination information matches the biometric information of the second user stored in the information processing device 200, and that biometric information acquired from the captured image included in the second determination information matches the biometric information of the first user stored in the information processing device 200. The pair determination condition includes, for example, that facial information acquired from the captured image included in the first determination information matches the facial information of the second user stored in the information processing device 200, and that facial information acquired from the captured image included in the second determination information matches the facial information of the first user stored in the information processing device 200. The pair determination condition includes, for example, that fingerprint information acquired from the captured image included in the first determination information matches the fingerprint information of the second user stored in the information processing device 200, and that fingerprint information acquired from the captured image included in the second determination information matches the fingerprint information of the first user stored in the information processing device 200. The pair determination condition includes, for example, a condition that palm print information acquired from the captured image included in the first determination information matches the palm print information of the second user stored in the information processing device 200, and that palm print information acquired from the captured image included in the second determination information matches the palm print information of the first user stored in the information processing device 200. The pair determination condition includes, for example, a condition that ear shape information acquired from the captured image included in the first determination information matches the ear shape information of the second user stored in the information processing device 200, and that ear shape information acquired from the captured image included in the second determination information matches the ear shape information of the first user stored in the information processing device 200. The pair determination condition includes, for example, a condition that iris information acquired from the captured image included in the first determination information matches the iris information of the second user stored in the information processing device 200, and that iris information acquired from the captured image included in the second determination information matches the iris information of the first user stored in the information processing device 200. The pair determination conditions include, for example, that the voiceprint information included in the first determination information matches the voiceprint information of the second user stored in the information processing device 200, and that the voiceprint information included in the second determination information matches the voiceprint information of the first user stored in the information processing device 200.

[0099] The pair determination condition may include that a distance between a position of the first control device indicated by position information included in the first determination information and a position of the second control device indicated by position information included in the second determination information is shorter than a predetermined distance threshold. The pair determination condition may include that identification information of a device that has established a short-range wireless communication connection with the first control device, which is included in the first determination information, matches identification information of the second control device stored in the storage unit 202, and that identification information of the device that has established a short-range wireless communication connection with the second control device, which is included in the second determination information, matches identification information of the first control device stored in the storage unit 202.

[0100] The establishing unit 206 may establish a pair of the first user and the second user when the first determination information and the second determination information satisfy two or more pair determination conditions among the plurality of pair determination conditions described above. For example, the establishing unit 206 establishes a pair of the first user and the second user when the first determination information and the second determination information satisfy two pair determination conditions: a pair determination condition that an object included in a captured image included in the first determination information is included in a captured image included in the second determination information, and a pair determination condition that biometric information acquired from the captured image included in the first determination information matches the biometric information of the second user stored in the information processing device 200 and that biometric information acquired from the captured image included in the second determination information matches the biometric information of the first user stored in the information processing device 200. The two or more pair determination conditions may be any combination of the plurality of pair determination conditions described above.

[0101] For example, if the operation mode of the first control device indicated by the operation mode information included in the first determination information and the operation mode of the second control device indicated by the operation mode information included in the second determination information satisfy a predetermined operation mode condition, the establishment unit 206 determines whether the first determination information and the second determination information satisfy a pair determination condition. On the other hand, if the operation mode of the first control device and the operation mode of the second control device do not satisfy the operation mode condition, the establishment unit 206 does not establish a pair of the first user and the second user.

[0102] The operation mode condition includes, for example, that the operation mode of the first control device and the operation mode of the second control device are payment modes. The operation mode condition includes, for example, that one of the operation mode of the first control device and the operation mode of the second control device is a remittance mode within the payment modes, and that the other of the operation mode of the first control device and the operation mode of the second control device is a receipt mode within the payment modes.

[0103] The control unit 208 controls the control device. The control unit 208 controls the control device, for example, by generating a control signal for controlling the control device and transmitting the generated control signal to the control device via the network 20. The control unit 208 may control the control device by generating an instruction for the control device and transmitting the generated instruction to the control device via the network 20. The control device may control various functions in accordance with the control signal or instruction received from the control unit 208.

[0104] The control unit 208 controls, for example, the first control device. The control unit 208 controls, for example, the second control device. The control unit 208 controls, for example, the first control device and the second control device.

[0105] The control unit 208, for example, causes at least one of the first control device and the second control device to output information for executing a payment process between the first user and the second user. For example, in response to the establishing unit 206 establishing a pair of the first user and the second user, the control unit 208 causes at least one of the first control device and the second control device to output information for executing a payment process between the first user and the second user.

[0106] The control unit 208, for example, causes the first control device to output information for executing a remittance process in which a first user sends money to a second user as information for executing a settlement process between a first user and a second user. The control unit 208, for example, causes the first control device to output information for executing a receipt process in which a first user receives money from a second user as information for executing a settlement process between a first user and a second user. The control unit 208, for example, causes the first control device to output information for executing a remittance process in which a first user sends money to a second user as information for executing a settlement process between the first user and a second user, and causes the second control device to output information for executing a receipt process in which the second user receives money from the first user as information for executing a settlement process between the first user and a second user.

[0107] The payment processing unit 210 executes payment processing between a first user and a second user. The payment processing between a first user and a second user includes, for example, a remittance processing in which the first user sends money to the second user. The payment processing between a first user and a second user includes, for example, a receipt processing in which the first user receives money from the second user.

[0108] The payment processing unit 210 executes a payment process between a first user and a second user by transferring electronic money between the account of the first user's electronic money application and the account of the second user's electronic money application, for example, based on the account information of the first user's electronic money application and the account information of the second user's electronic money application stored in the storage unit 202. The payment processing unit 210 executes a payment process between a first user and a second user by transferring money between the bank account of the first user and the bank account of the second user, for example, based on the account information of the first user's bank account stored in the storage unit 202 and the account information of the second user's bank account stored in the storage unit 202.

[0109] For example, when the receiving unit 204 receives remittance amount information indicating the remittance amount from the first control device, the payment processing unit 210 executes the payment processing between the first user and the second user by sending money of the remittance amount from the first user to the second user. For example, when the receiving unit 204 receives remittance amount information indicating the remittance amount from the first control device and receives receipt amount information indicating the receipt amount from the second control device, if the remittance amount and the receipt amount match, the payment processing unit 210 executes the payment processing between the first user and the second user by sending money of the remittance amount from the first user to the second user. On the other hand, when the receiving unit 204 receives remittance amount information from the first control device and receives receipt amount information from the second control device, if the remittance amount and the receipt amount do not match, the payment processing unit 210 does not execute the payment processing between the first user and the second user.

[0110] Fig. 9 is an explanatory diagram for explaining another example of the processing flow of the system 10. In this other example of the processing flow of the system 10 shown in Fig. 9, a state in which the operation mode of the eyeglasses-type device 100 of the user 102 and the operation mode of the eyeglasses-type device 100 of the user 104 are not set to the payment mode is set as the starting state.

[0111] In S202, the glasses-type device 100 of the user 102 sets the operation mode to the payment mode. In S204, the glasses-type device 100 of the user 104 sets the operation mode to the payment mode.

[0112] In S206, the glasses-type device 100 of the user 102 acquires first determination information used to determine a payment counterparty for the user 102. In S208, the glasses-type device 100 of the user 104 acquires second determination information used to determine a payment counterparty for the user 104.

[0113] In S210, the glasses-type device 100 of the user 102 transmits the first decision information acquired in S206 to the glasses-type device 100 of the user 104. The glasses-type device 100 of the user 102 transmits the first decision information to the glasses-type device 100 of the user 104, for example, via the network 20. The glasses-type device 100 of the user 102 transmits the first decision information to the glasses-type device 100 of the user 104, for example, via a short-range wireless communication connection established between the glasses-type device 100 of the user 102 and the glasses-type device 100 of the user 104. In S212, the glasses-type device 100 of the user 104 transmits the second decision information acquired in S208 to the glasses-type device 100 of the user 102.

[0114] In S214, the glasses-type device 100 of the user 102 determines the payment counterparty of the user 102 based on the first determination information acquired in S206 and the second determination information received in S212. For example, if the first determination information and the second determination information satisfy a predetermined payment counterparty determination condition, the glasses-type device 100 of the user 102 determines that the user 104 is the payment counterparty of the user 102. Here, the explanation will continue assuming that the glasses-type device 100 of the user 102 has determined that the user 104 is the payment counterparty of the user 102.

[0115] In S216, the glasses-type device 100 of the user 104 determines the payment counterparty of the user 104 based on the second determination information acquired in S208 and the first determination information received in S210. Here, the explanation will continue assuming that the glasses-type device 100 of the user 104 has determined that the user 102 is the payment counterparty of the user 104.

[0116] In S218, the glasses-type device 100 of the user 102 outputs information for executing a payment process between the user 102 and the user 104 in response to the determination in S214 that the user 104 is the payment counterparty of the user 102. In S220, the glasses-type device 100 of the user 104 outputs information for executing a payment process between the user 102 and the user 104 in response to the determination in S216 that the user 102 is the payment counterparty of the user 104.

[0117] The user 102, having checked the information output by the glasses-type device 100 of the user 102 in S218, inputs the information necessary to execute the payment process between the user 102 and the user 104 into the glasses-type device 100 of the user 102. Also, the user 104, having checked the information output by the glasses-type device 100 of the user 104 in S220, inputs the information necessary to execute the payment process between the user 102 and the user 104 into the glasses-type device 100 of the user 104. Thereafter, in S222, the payment process between the user 102 and the user 104 is executed.

[0118] The system 10 shown in Fig. 9 can execute payment processing by directly exchanging information between a device owned by the remittance sending user and a device owned by the receiving user via a short-range wireless communication connection, etc., without requiring either the remittance sending user or the receiving user to display a barcode, QR code, etc. Furthermore, since the system 10 shown in Fig. 9 directly exchanges information between a device owned by the remittance sending user and a device owned by the receiving user, payment processing can be executed even in a communication environment where external devices cannot be accessed.

[0119] 10 shows an example of the functional configuration of the control device 150. The control device 150 includes a setting unit 152, an acquisition unit 154, a transmission unit 155, a reception unit 156, a determination unit 158, and an output unit 162. Note that it is not essential that the control device 150 includes all of these components.

[0120] The setting unit 152 sets the operation mode. The setting unit 152 sets the operation mode, for example, via a user interface of the control device 150. The setting unit 152 sets the operation mode by accepting input of setting information for setting the operation mode by the user of the control device 150, for example, using the camera 170, microphone 190, operation unit, input unit, virtual keyboard, etc. The setting unit 152 may set the operation mode by receiving setting information from the communication terminal via the network 20.

[0121] For example, the setting unit 152 sets the operation mode to a payment mode. For example, the setting unit 152 sets the operation mode to a remittance mode within the payment mode. For example, the setting unit 152 sets the operation mode to a receipt mode within the payment mode.

[0122] The acquisition unit 154 acquires, for example, various types of information. The acquisition unit 154 acquires, for example, various types of information via a user interface of the control device 150. The acquisition unit 154 acquires, for example, various types of information by accepting input of various types of information by a user of the control device 150 using the camera 170, the microphone 190, an operation unit, an input unit, a virtual keyboard, or the like. The acquisition unit 154 acquires, for example, various types of information by measuring the various types of information using a sensor such as a positioning sensor.

[0123] The acquisition unit 154 acquires, for example, operation mode information of the control device 150. The acquisition unit 154 acquires, for example, a captured image captured using the camera 170. The acquisition unit 154 acquires, for example, location information of the control device 150. The acquisition unit 154 acquires, for example, identification information of a device that has established a short-range wireless communication connection with the control device 150. The acquisition unit 154 acquires, for example, voiceprint information acquired using the microphone 190. The acquisition unit 154 acquires first determination information used to determine the payment counterparty of the user of the control device 150, which includes at least one of the above-mentioned pieces of information.

[0124] The transmitting unit 155 transmits various types of information. The transmitting unit 155 transmits various types of information via a network. For example, the transmitting unit 155 transmits various types of information via a short-range wireless communication connection.

[0125] The transmitting unit 155 transmits, for example, the first determination information to the information processing device 200. The transmitting unit 155 transmits, for example, the first determination information to another control device 150.

[0126] The receiving unit 156 receives various types of information. The receiving unit 156 receives various types of information via a network. For example, the receiving unit 156 receives various types of information via a short-range wireless communication connection.

[0127] The receiving unit 156 receives, for example, a control signal from the information processing device 200. The receiving unit 156 receives, for example, an instruction from the information processing device 200.

[0128] The receiving unit 156 receives, for example, second determination information used to determine the payment counterparty of the other user from the other control device 150. Note that the other user may be a user of the other control device 150.

[0129] The determination unit 158 ​​determines the payment counterparty of the user of the control device 150. The determination unit 158 ​​determines the payment counterparty of the user of the control device 150, for example, based on various information acquired by the acquisition unit 154. The determination unit 158 ​​determines the payment counterparty of the user of the control device 150, based on various information received by the reception unit 156.

[0130] For example, if the first determination information and the second determination information satisfy a predetermined payment counterparty determination condition, the determination unit 158 ​​determines that the user of the other control device 150 is the payment counterparty of the user of the control device 150. On the other hand, if the first determination information and the second determination information do not satisfy the payment counterparty determination condition, the determination unit 158 ​​determines that the user of the other control device 150 is not the payment counterparty of the user of the control device 150.

[0131] For example, if the receiving unit 156 receives the second determination information within a predetermined payment counterparty determination period from the time the acquiring unit 154 acquires the first determination information, and the first determination information and the second determination information satisfy predetermined payment counterparty determination conditions, the determining unit 158 ​​determines that the user of the other control device 150 is the payment counterparty of the user of the control device 150. On the other hand, if the receiving unit 156 does not receive the second determination information within a predetermined payment counterparty determination period from the time the acquiring unit 154 acquires the first determination information, or if the first determination information and the second determination information do not satisfy the predetermined payment counterparty determination conditions, the determining unit 158 ​​determines that the user of the other control device 150 is not the payment counterparty of the user of the control device 150.

[0132] The payment counterparty determination condition includes, for example, that an object included in the captured image included in the first determination information is included in the captured image included in the second determination information. The payment counterparty determination condition includes, for example, that a gesture identified from the captured image included in the first determination information is the same as a gesture identified from the captured image included in the second determination information. The payment counterparty determination condition includes, for example, that a gesture of a user of the control device 150 identified from the captured image included in the first determination information is the same as a gesture of a user of another control device 150 identified from the captured image included in the second determination information. The payment counterparty determination condition includes, for example, that a gesture of a user of another control device 150 identified from the captured image included in the first determination information is the same as a gesture of a user of the control device 150 identified from the captured image included in the second determination information. The payment counterparty determination condition may include, for example, that a distance between the position of the first control device indicated by the position information included in the first determination information and the position of the second control device indicated by the position information included in the second determination information is shorter than a predetermined distance threshold.

[0133] When the first determination information and the second determination information satisfy two or more payment counterpart determination conditions among the above-mentioned multiple payment counterpart determination conditions, the determination unit 158 ​​may determine that the user of another control device 150 is the payment counterpart of the user of the control device 150. The two or more payment counterpart determination conditions may be any combination from the above-mentioned multiple payment counterpart determination conditions.

[0134] For example, if the operation mode of the control device 150 indicated by the operation mode information included in the first determination information and the operation mode of the other control device 150 indicated by the operation mode information included in the second determination information satisfy a predetermined operation mode condition, the determination unit 158 ​​determines whether the first determination information and the second determination information satisfy a payment counterparty determination condition. On the other hand, if the operation mode of the control device 150 and the operation mode of the other control device 150 do not satisfy the operation mode condition, the establishment unit 206 determines that the user of the other control device 150 is not the payment counterparty of the user of the control device 150.

[0135] The output unit 162 outputs various types of information. The output unit 162 outputs the various types of information, for example, via a user interface of the control device 150. The output unit 162 displays and outputs the various types of information, for example, using the lens 116. The output unit 162 outputs the various types of information audibly, for example, using the speaker 180.

[0136] The output unit 162 outputs various information in response to, for example, the receiving unit 156 receiving a control signal or an instruction from the information processing device 200. The output unit 162 outputs various information in response to, for example, the determining unit 158 ​​determining that a user of another control device 150 is the payment counterparty of the user of the control device 150.

[0137] The output unit 162 outputs, for example, information for executing a settlement process between a user of the control device 150 and a user of another control device 150. The information for executing a settlement process between a user of the control device 150 and a user of another control device 150 is, for example, information notifying that the settlement counterparty of the user of the control device 150 has been determined. The information for executing a settlement process between a user of the control device 150 and a user of another control device 150 is, for example, information prompting the user of the control device 150 to input remittance amount information or receipt amount information.

[0138] The output unit 162 outputs, for example, information for executing a payment process between a user of the control device 150 and a user of another control device 150, information for executing a remittance process in which a user of the control device 150 sends money to a user of another control device 150. The output unit 162 outputs, for example, information for executing a receipt process in which a user of the control device 150 receives money from a user of another control device 150, as information for executing a payment process between a user of the control device 150 and a user of another control device 150.

[0139] The acquisition unit 154 acquires, for example, remittance amount information. The acquisition unit 154 acquires the remittance amount information by accepting input of the remittance amount information by the user of the control device 150 who has confirmed the information for executing a settlement process between the user of the control device 150 and another user of the control device 150, output by the output unit 162, using, for example, an operation unit, an input unit, a virtual keyboard, or the like. The acquisition unit 154 acquires the remittance amount information by, for example, using the camera 170 to capture an image of the remittance amount output on a cash register screen or the like. The acquisition unit 154 may also acquire the remittance amount information by, for example, using the microphone 190 to pick up the sound of the user of the control device 150 or the settlement partner of the user of the control device 150 uttering the remittance amount.

[0140] The acquisition unit 154 acquires, for example, the amount received information. The acquisition unit 154 may acquire the amount received information in the same manner as when acquiring the remittance amount information.

[0141] The receiving unit 156 receives, for example, remittance amount information from another control device 150. The receiving unit 156 receives, for example, receipt amount information from another control device 150.

[0142] The receiving unit 156 receives, for example, from the other control device 150, account information of an electronic money application of a user of the other control device 150. The receiving unit 156 receives, for example, from the other control device 150, account information of a bank account of a user of the other control device 150.

[0143] The sending unit 155 sends the remittance amount information acquired by the acquiring unit 154. For example, if the remittance amount indicated by the remittance amount information acquired by the acquiring unit 154 matches the receipt amount indicated by the receipt amount information received by the receiving unit 156, the sending unit 155 sends the remittance amount information acquired by the acquiring unit 154. On the other hand, if the remittance amount indicated by the remittance amount information acquired by the acquiring unit 154 does not match the receipt amount indicated by the receipt amount information received by the receiving unit 156, the sending unit 155 does not send the remittance amount information acquired by the acquiring unit 154.

[0144] The transmitting unit 155 transmits, for example, the remittance amount information to the information processing device 200. The transmitting unit 155 transmits, for example, the remittance amount information to another control device 150.

[0145] The transmitting unit 155 transmits, for example, the remittance amount information to an electronic money server that manages the account of the electronic money application of the user of the control device 150. In this case, the remittance amount information may further include account information of the electronic money application of the user of the other control device 150.

[0146] The transmitting unit 155 transmits, for example, the remittance amount information to an account management server that manages the bank account of the user of the control device 150. In this case, the remittance amount information may further include account information of the bank account of the user of the other control device 150.

[0147] The transmitting unit 155 transmits, for example, the amount received information. The transmitting unit 155 transmits, for example, the amount received information to the information processing device 200. The transmitting unit 155 transmits, for example, the amount received information to another control device 150.

[0148] 11 schematically illustrates an example of the hardware configuration of a computer 1200 functioning as the control device 150 or the information processing device 200. A program installed on the computer 1200 can cause the computer 1200 to function as one or more "units" of the device according to the present embodiment, or can cause the computer 1200 to execute operations associated with the device according to the present embodiment or one or more "units," and / or can cause the computer 1200 to execute a process according to the present embodiment or steps of the process. Such a program can be executed by the CPU 1212 to cause the computer 1200 to perform specific operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

[0149] The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphics controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communications interface 1222, a storage device 1224, a DVD drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive 1226 may be a DVD-ROM drive, a DVD-RAM drive, or the like. The storage device 1224 may be a hard disk drive, a solid-state drive, or the like. The computer 1200 also includes a ROM 1230 and legacy input / output units such as a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0150] The CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into the graphics controller itself, and causes the image data to be displayed on the display device 1218.

[0151] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive 1226 reads programs or data from a DVD-ROM 1227 or the like and provides them to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0152] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or programs that depend on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, etc.

[0153] The programs are provided by a computer-readable storage medium such as a DVD-ROM 1227 or an IC card. The programs are read from the computer-readable storage medium, installed in the storage device 1224, RAM 1214, or ROM 1230, which are also examples of computer-readable storage media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and causes cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be configured by implementing operations or processing of information in accordance with the use of the computer 1200.

[0154] For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded into the RAM 1214 and instruct the communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in the RAM 1214, the storage device 1224, the DVD-ROM 1227, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes reception data received from the network to a reception buffer area or the like provided on the recording medium.

[0155] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, the DVD drive 1226 (DVD-ROM 1227), an IC card, etc. to be read into the RAM 1214, and may perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.

[0156] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and may undergo information processing. The CPU 1212 may perform various types of processing on data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequences of the programs, and write the results back to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. on the recording medium. For example, if multiple entries, each having an attribute value of a first attribute associated with an attribute value of a second attribute, are stored on the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the multiple entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0157] The above-described programs or software modules may be stored in a computer-readable storage medium on or near the computer 1200. A recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can also be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.

[0158] The blocks in the flowcharts and block diagrams in the present embodiments may represent stages of a process in which an operation is performed or "parts" of an apparatus responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and / or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuits, including integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuits, such as field programmable gate arrays (FPGAs) and programmable logic arrays (PLAs), including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements.

[0159] A computer-readable medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that the computer-readable medium having instructions stored thereon comprises an article of manufacture containing instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable media may include electronic, magnetic, optical, electromagnetic, and semiconductor storage media. More specific examples of computer-readable media may include floppy disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick, integrated circuit card, and the like.

[0160] The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0161] The computer-readable instructions may be provided to a processor or programmable circuit of a programmable data processing device, such as a computer, locally or via a wide area network (WAN) such as a local area network (LAN) or the Internet, and the computer-readable instructions may be executed to create means for performing the operations specified in the flowcharts or block diagrams. Here, the computer may be a personal computer (PC), a tablet computer, a smartphone, a workstation, a server computer, a general-purpose computer, a special-purpose computer, or the like, or may be a computer system in which multiple computers are connected. Such a computer system in which multiple computers are connected is also called a distributed computing system, and is a broad definition of computer. In a distributed computing system, the multiple computers collectively execute a program by each executing a portion of the program and passing data between the computers as needed during program execution.

[0162] Examples of processors include a computer processor, a central processing unit (CPU), a processing unit, a microprocessor, a digital signal processor, a controller, a microcontroller, etc. A computer may have one or more processors. In a multiprocessor system with multiple processors, each processor executes a portion of a program and passes data between processors as needed during program execution, allowing the multiple processors to collectively execute the program. For example, in multitasking, each of the multiple processors may execute a portion of each task in small chunks by switching tasks at time slice intervals. In this case, which portion of a program each processor executes changes dynamically. Which portion of a program each of the multiple processors executes may also be statically determined by multiprocessor-aware programming.

[0163] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included within the technical scope of the present invention.

[0164] It should be noted that the execution order of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and that the processes can be performed in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, this does not mean that the processes must be performed in this order. [Explanation of symbols]

[0165] 10 system, 20 network, 100 eyeglass device, 102 user, 104 user, 110 frame, 112 rim, 114 bridge, 116 lens, 118 temple, 150 control device, 152 setting unit, 154 acquisition unit, 155 transmission unit, 156 reception unit, 158 determination unit, 162 output unit, 170 camera, 172 imaging range, 174 imaging range, 180 speaker, 190 microphone, 200 information processing device, 202 storage unit, 204 reception unit, 206 establishment unit, 208 control unit, 210 payment processing unit, 300 poster, 350 card, 400 poster, 500 poster, 600 poster, 1200 computer, 1210 host controller, 1212 CPU, 1214 RAM, 1216 Graphics controller, 1218 display device, 1220 input / output controller, 1222 communication interface, 1224 storage device, 1230 ROM, 1240 input / output chip

Claims

1. a receiving unit that receives, from a first control device of a first user whose operation mode is a payment mode, first determination information used to determine a payment counterparty of the first user, and receives, from a second control device of a second user whose operation mode is a payment mode, second determination information used to determine a payment counterparty of the second user; an establishment unit that establishes a pair of the first user and the second user when the first determination information and the second determination information satisfy a predetermined pair determination condition; a control unit that outputs, to at least one of the first control device and the second control device, information for executing a settlement process between the first user and the second user in response to the establishment unit establishing the pair of the first user and the second user; An information processing device comprising:

2. the receiving unit receives the first determination information from the first control device of the first user whose operation mode is a remittance mode among the payment modes, and receives the second determination information from the second control device of the second user whose operation mode is a receipt mode among the payment modes; the control unit causes the first control device to output information for executing a remittance process in which the first user sends money to the second user as information for executing a settlement process between the first user and the second user, and causes the second control device to output information for executing a receiving process in which the second user receives money from the first user as information for executing a settlement process between the first user and the second user. The information processing device according to claim 1 .

3. 3. The information processing device according to claim 1, wherein the establishment unit establishes the pair of the first user and the second user when the receiving unit receives the first determination information and the second determination information within a predetermined pair determination period and the first determination information and the second determination information satisfy the pair determination condition.

4. the receiving unit receives the first determination information including an image captured by the first control device using a first camera, and receives the second determination information including an image captured by the second control device using a second camera; the establishment unit establishes the pair of the first user and the second user when an object included in the captured image included in the first determination information is included in the captured image included in the second determination information.

3. The information processing device according to claim 1 or 2.

5. the receiving unit receives the first determination information including an image captured by the first control device using a first camera, and receives the second determination information including an image captured by the second control device using a second camera; the establishment unit establishes the pair of the first user and the second user when a gesture identified from the captured image included in the first determination information is the same as a gesture identified from the captured image included in the second determination information.

3. The information processing device according to claim 1 or 2.

6. a storage unit for storing biometric information of the first user and biometric information of the second user; Furthermore, the receiving unit receives the first determination information including an image captured by the first control device using a first camera, and receives the second determination information including an image captured by the second control device using a second camera; the establishment unit establishes the pair of the first user and the second user when biometric information acquired from the captured image included in the first determination information matches the biometric information of the second user stored in the storage unit and when biometric information acquired from the captured image included in the second determination information matches the biometric information of the first user stored in the storage unit.

3. The information processing device according to claim 1 or 2.

7. the receiving unit receives the first determination information including position information indicating a position of the first control device, and receives the second determination information including position information indicating a position of the second control device; the establishment unit establishes the pair of the first user and the second user when a distance between a position of the first control device indicated by the position information included in the first determination information and a position of the second control device indicated by the position information included in the second determination information is shorter than a predetermined distance threshold.

3. The information processing device according to claim 1 or 2.

8. a storage unit for storing identification information of the first control device and identification information of the second control device; Furthermore, the receiving unit receives the first determination information including identification information of a device that has established a short-range wireless communication connection with the first control device, and receives the second determination information including identification information of a device that has established a short-range wireless communication connection with the second control device; the establishment unit establishes the pair of the first user and the second user when the identification information of the device included in the first determination information matches the identification information of the second control device stored in the storage unit and the identification information of the device included in the second determination information matches the identification information of the first control device stored in the storage unit.

3. The information processing device according to claim 1 or 2.

9. The information processing device according to claim 1 or 2, wherein the receiving unit receives the first decision information from the first control device mounted on a first wearable terminal and receives the second decision information from the second control device mounted on a second wearable terminal.

10. 3. A program for causing a computer to function as the information processing device according to claim 1 when executed by the computer.

11. A control device, a setting unit that sets the operation mode to a payment mode; an acquisition unit that acquires first determination information used to determine a payment counterparty of a user of the control device; a receiving unit that receives second determination information used to determine a payment partner of the other user from the other control device; a determination unit that determines that the other user is the payment counterparty of the user when the first determination information and the second determination information satisfy a predetermined payment counterparty determination condition; an output unit that outputs information for executing a settlement process between the user and the other user in response to the determination by the determination unit that the other user is the settlement partner of the user; A control device comprising:

12. A program that, when executed by a computer, causes the computer to function as the control device according to claim 11.

Images