Information processing device, control device, and program

The information processing system facilitates payment processing between wearable devices by establishing pairs based on image, gesture, or biometric data, addressing the limitations of screenless devices and improving user experience.

JP7855649B2Active Publication Date: 2026-05-08SOFTBANK CORPORATION
View PDF 4 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
SOFTBANK CORPORATION
Filing Date
2024-08-09
Publication Date
2026-05-08

AI Technical Summary

Technical Problem

Current payment systems relying on screen displays, such as QR codes, are inadequate for wearable devices like AR glasses that lack screens, making it difficult to execute payment processing.

Method used

An information processing system that establishes a pair between sending and receiving wearable devices based on captured images, gestures, or biometric information, enabling payment processing without requiring screen displays.

Benefits of technology

Enables seamless payment processing between wearable devices, enhancing user experience and facilitating the widespread adoption of devices without traditional screen-based payment methods.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007855649000001
    Figure 0007855649000001
  • Figure 0007855649000002
    Figure 0007855649000002
  • Figure 0007855649000003
    Figure 0007855649000003
Patent Text Reader

Abstract

To provide an information processor, a control device and a program for executing settlement processing without displaying a bar code or a QR code.SOLUTION: The information processing device includes a receiving unit that receives first determination information used for determining a settlement counterpart of a first user from a first control device of the first user 102 whose operation mode is a settlement mode, and receives second determination information used for determining a settlement counterpart of a second user from a second control device of the second user 104 whose operation mode is the settlement mode, an establishing unit that establishes a pair of the first user and the second user when the first determination information and the second determination information satisfy a predetermined pair determination condition, and a control unit that causes at least one of the first control device and the second control device to output information for executing a settlement process between the first user and the second user in response to establishment of the pair of the first user and the second user by the establishing unit.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a control apparatus, and a program.

Background Art

[0002] Patent Document 1 describes an information processing method capable of presenting information to a user according to the user's purchase situation. [Prior Art Document] [Patent Document] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2024-045395

Summary of the Invention

Means for Solving the Problems

[0003] According to an embodiment of the present invention, an information processing apparatus is provided. The information processing apparatus may include a receiving unit that receives first determination information used to determine a settlement partner of a first user from a first control apparatus of the first user whose operation mode is a settlement mode, and second determination information used to determine a settlement partner of a second user from a second control apparatus of the second user whose operation mode is a settlement mode. The information processing apparatus may include an establishing unit that establishes a pair of the first user and the second user when the first determination information and the second determination information satisfy a predetermined pair determination condition. The information processing apparatus may include a control unit that outputs information for executing settlement processing between the first user and the second user to at least one of the first control apparatus and the second control apparatus in response to the establishing unit establishing the pair of the first user and the second user.

[0004] In the information processing apparatus, the receiving unit may receive first decision information from the first control device of the first user whose operating mode is the remittance mode of the settlement mode, and receive second decision information from the second control device of the second user whose operating mode is the receiving mode of the settlement mode. The control unit may cause the first control device to output information for the first user to perform a remittance process in which the first user sends money to the second user, as information for performing a settlement process between the first user and the second user, and may cause the second control device to output information for the second user to perform a receiving process in which the second user receives money from the first user, as information for performing a settlement process between the first user and the second user.

[0005] In any of the above-mentioned information processing devices, the establishment unit may establish the pair of the first user and the second user if the receiving unit receives the first decision information and the second decision information within a predetermined pair determination period, and the first decision information and the second decision information satisfy the pair determination conditions.

[0006] In any of the above-mentioned information processing devices, the receiving unit may receive first decision information including an image captured by the first control device using the first camera, and second decision information including an image captured by the second control device using the second camera, and the establishment unit may establish the pair of the first user and the second user if an object included in the image included in the first decision information is also included in the image included in the second decision information.

[0007] In either of the above-mentioned information processing devices, the receiving unit may receive first decision information including an image captured by the first control device using the first camera, and second decision information including an image captured by the second control device using the second camera, and the establishment unit may establish the pair of the first user and the second user if the gesture identified from the image included in the first decision information is the same gesture as the gesture identified from the image included in the second decision information.

[0008] Any of the above-mentioned information processing devices may further include a storage unit for storing the biometric information of the first user and the biometric information of the second user, the receiving unit may receive the first decision information including an image captured by the first control device using the first camera, and the second decision information including an image captured by the second control device using the second camera, and the establishment unit may establish the pair of the first user and the second user if the biometric information obtained from the image included in the first decision information matches the biometric information of the second user stored in the storage unit, and the biometric information obtained from the image included in the second decision information matches the biometric information of the first user stored in the storage unit.

[0009] In any of the above-mentioned information processing devices, the receiving unit may receive the first determination information including location information indicating the location of the first control device, and the second determination information including location information indicating the location of the second control device, and the establishment unit may establish the pair of the first user and the second user if the distance between the location of the first control device indicated by the location information included in the first determination information and the location of the second control device indicated by the location information included in the second determination information is shorter than a predetermined distance threshold.

[0010] Any of the above information processing devices may further include a storage unit for storing identification information of the first control device and identification information of the second control device, the receiving unit may receive the first determination information including identification information of a device that has established a short-range wireless communication connection with the first control device, and the receiving unit may receive the second determination information including identification information of a device that has established a short-range wireless communication connection with the second control device, and the establishment unit may establish the pair of the first user and the second user if the identification information of the device included in the first determination information matches the identification information of the second control device stored in the storage unit, and the identification information of the device included in the second determination information matches the identification information of the first control device stored in the storage unit.

[0011] In any of the above-mentioned information processing devices, the receiving unit may receive the first decision information from the first control device mounted on the first wearable terminal, and receive the second decision information from the second control device mounted on the second wearable terminal.

[0012] According to one embodiment of the present invention, a program is provided that, when executed by a computer, causes the computer to function as one of the aforementioned information processing devices.

[0013] According to one embodiment of the present invention, a control device is provided. The control device may include a setting unit for setting the operating mode to a payment mode. The control device may include an acquisition unit for acquiring first decision information used to determine the payment partner of the user of the control device. The control device may include a receiving unit for receiving second decision information from another control device used to determine the payment partner of another user. The control device may include a determination unit for determining that the other user is the payment partner of the user if the first decision information and the second decision information satisfy predetermined payment partner determination conditions. The control device may include an output unit for outputting information for executing a payment process between the user and the other user in response to the determination unit determining that the other user is the payment partner of the user.

[0014] According to one embodiment of the present invention, a program is provided that, when executed by a computer, causes the computer to function as the control device.

[0015] Furthermore, the above summary of the invention does not enumerate all the necessary features of the present invention. Subcombinations of these features may also constitute an invention. [Brief explanation of the drawing]

[0016] [Figure 1] An example of System 10 is shown in general terms. [Figure 2] This is an explanatory diagram illustrating an example of the processing flow of System 10. [Figure 3] A schematic example of the configuration of the glasses-type device 100 is shown below. [Figure 4] This is an explanatory diagram illustrating an example of establishing a user pair. [Figure 5] This is an explanatory diagram illustrating another example of establishing a user pair. [Figure 6] This is an explanatory diagram illustrating another example of establishing a user pair. [Figure 7] This is an explanatory diagram illustrating another example of establishing a user pair. [Figure 8] An example of the functional configuration of the information processing device 200 is shown in a schematic manner. [Figure 9] This is an explanatory diagram illustrating another example of the processing flow of System 10. [Figure 10] An example of the functional configuration of the control device 150 is shown in schematic form. [Figure 11] A schematic example of the hardware configuration of a computer 1200 that functions as a control device 150 or an information processing device 200 is shown. [Modes for carrying out the invention]

[0017] In the current payment system, the receiving party that receives money executes payment processing by reading a QR code (registered trademark) or the like displayed on the screen of a smartphone or the like of the sending party that sends money. On the other hand, in the future, there is an expected increase in the need for wearable terminals such as AR (Augmented Reality) glasses where the screen cannot be seen by others, or wearable AI (Artificial Intelligence) devices that do not have a screen at all. Along with this, in the current payment system premised on reading a screen, a situation may occur where payment processing cannot be executed. The system according to the present embodiment, for example, establishes pairing between the receiving device and the sending device in a mode that does not include the step of reading a screen, and outputs information for executing payment processing to both the receiving device and the sending device, thereby adopting a mechanism for executing payment processing.

[0018] Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential for the solution means of the invention. In the drawings, the same or similar parts may be given the same reference numerals, and redundant descriptions may be omitted.

[0019] FIG. 1 schematically shows an example of the system 10. The system 10 may include a plurality of glasses-type devices 100. The system 10 may include an information processing apparatus 200.

[0020] The glasses-type device 100 may be any device as long as it has a communication function for accessing the network 20 according to the control by a control device mounted on the own device. The glasses-type device 100 is, for example, smart glasses. The glasses-type device 100 may be an example of a wearable terminal.

[0021] Network 20 may include a cloud. Network 20 may include a mobile communication network. The mobile communication network may comply with any of the following communication methods: 3G (3rd Generation), LTE (Long Term Evolution), 5G (5th Generation), 6G (6th Generation), or later. Network 20 may comply with short-range wireless communication methods such as Wi-Fi®, Bluetooth®, and Zigbee®. Network 20 may also include wired connections.

[0022] The glasses-type device 100 may further have a display function that displays content on a display unit mounted on the device. The glasses-type device 100 is, for example, AR glasses.

[0023] The content may be in any data format. For example, the content may be text. For example, the content may be illustrations. For example, the content may be still images. For example, the content may be videos. For example, the content may be 3D computer graphics (CG) data. The content may also include a combination of these.

[0024] The glasses-type device 100 may be a device capable of giving the wearer of the glasses-type device 100 the sensation that the content is placed in real space by displaying the content on transparent or semi-transparent glasses. In other words, the glasses-type device 100 may be a so-called see-through device. The glasses-type device 100 may also be a video pass-through device. In this case, the glasses-type device 100 may display captured images that capture the range corresponding to the wearer's field of view on an opaque display and superimpose the content.

[0025] The glasses-type device 100 has a setting function for setting the operating mode, for example. The glasses-type device 100 can set the operating mode to a payment mode for executing payment processing. The glasses-type device 100 can set the operating mode to a remittance mode within the payment processing. The glasses-type device 100 can set the operating mode to a receipt mode within the payment processing.

[0026] The glasses-type device 100 has a positioning function that measures its own position using a positioning sensor mounted on the device. The positioning sensor includes, for example, a GNSS (Global Navigation Satellite System) sensor. The positioning sensor includes, for example, a GPS (Global Positioning System) sensor. The positioning sensor includes, for example, an RTK (Real Time Kinematic) sensor.

[0027] Payment processing includes, for example, the processing of payments for goods or services. Payment processing may also include the processing of money moving from one party to another without the accompanying goods or services.

[0028] The information processing device 200 performs various processes. For example, the information processing device 200 performs an intermediary process to mediate payment processing. Figure 1 shows an example in which the information processing device 200 mediates payment processing between user 102 wearing the glasses-type device 100 and user 104 wearing the glasses-type device 100.

[0029] For example, the space to which user 102 belongs and the space to which user 104 belongs are the same space. However, the space to which user 102 belongs and the space to which user 104 belongs may be different spaces.

[0030] User 102 may be an example of the first user, and the control device mounted on User 102's glasses-type device 100 may be an example of the first control device. In this case, User 104 may be an example of the second user, and the control device mounted on User 104's glasses-type device 100 may be an example of the second control device.

[0031] User 102 may be an example of a second user, and the control device mounted on User 102's glasses-type device 100 may be an example of a second control device. In this case, User 104 may be an example of a first user, and the control device mounted on User 104's glasses-type device 100 may be an example of a second control device.

[0032] Figure 2 is an explanatory diagram illustrating an example of the processing flow of system 10. In the example of the processing flow of system 10 shown in Figure 2, the starting state is when the operating mode of user 102's glasses-type device 100 and the operating mode of user 104's glasses-type device 100 are both in payment mode.

[0033] In step 102 (sometimes abbreviated as S), the information processing device 200 receives first decision information from the user 102's glasses-type device 100, which is used to determine the payment partner of user 102. The information processing device 200 receives the first decision information from the user 102's glasses-type device 100, for example, via the network 20.

[0034] In S104, the information processing device 200 receives second decision information from the user 104's glasses-type device 100, which is used to determine the payment partner of user 104. The information processing device 200 receives the second decision information from the user 104's glasses-type device 100, for example, via the network 20.

[0035] In S106, the information processing device 200 establishes a pair of user 102 and user 104 based on the first decision information received in S102 and the second decision information received in S104. For example, the information processing device 200 establishes a pair of user 102 and user 104 if the first decision information and the second decision information satisfy predetermined pair determination conditions. Note that a pair may be a combination of a user who sends money and a user who receives said money. Details of how the information processing device 200 establishes a pair will be described later. Here, we will continue the explanation assuming that the information processing device 200 has established a pair of user 102 and user 104.

[0036] In S108, the information processing device 200, in response to establishing the pair of user 102 and user 104 in S106, causes user 102's glasses-type device 100 to output information for executing a settlement process between user 102 and user 104. In S110, the information processing device 200, in response to establishing the pair of user 102 and user 104 in S106, causes user 104's glasses-type device 100 to output information for executing a settlement process between user 102 and user 104.

[0037] In S108, user 102, having confirmed the information output by user 102's glasses-type device 100, inputs the information necessary to execute the settlement process between user 102 and user 104 into user 102's glasses-type device 100. Similarly, in S110, user 104, having confirmed the information output by user 104's glasses-type device 100, inputs the information necessary to execute the settlement process between user 102 and user 104 into user 104's glasses-type device 100. Subsequently, in S112, the settlement process between user 102 and user 104 is executed.

[0038] Figures 1 and 2 show an example in which users 102 and 104 perform payment processing using the glasses-type device 100. At least one of user 102's glasses-type device 100 and user 104's glasses-type device 100 may be replaced with a wearable terminal that has a communication function to access the network 20 according to the control of a control device mounted on the device and does not have a display unit. At least one of user 102's glasses-type device 100 and user 104's glasses-type device 100 may be replaced with any other wearable terminal that has a communication function to access the network 20 according to the control of a control device mounted on the device. At least one of user 102's glasses-type device 100 and user 104's glasses-type device 100 may be replaced with a mobile terminal such as a smartphone.

[0039] Currently, with the advent of electronic money, payment processing using smartphones has become widespread. In smartphone-based payment processing, the main method involves one party—the sender or recipient—displaying a barcode or QR code on their smartphone screen to present the necessary payment information, while the other party reads the displayed information using a camera, barcode reader, or QR code reader. On the other hand, the demand for wearable devices, particularly AR glasses, is expected to increase in the future. As the demand for wearable devices increases, the number of wearable device users who do not carry smartphones on a daily basis is expected to rise. However, compared to smartphones, wearable devices often make it difficult to present the necessary payment information to others by displaying barcodes or QR codes on their screens. Furthermore, some types of wearable devices may not even have a display. As a result, it may become impossible to perform payment processing using methods that require displaying barcodes or QR codes on a screen. Therefore, it is desirable to be able to perform payment processing without displaying barcodes or QR codes.

[0040] In contrast, according to the system 10 of this embodiment, the information processing device 200 receives decision information from both the control device installed on the device owned by the sending user and the control device installed on the device owned by the receiving user, and establishes a pair of the sending user and the receiving user based on the received decision information. Subsequently, the information processing device 200 causes at least one of the devices owned by the sending user and the receiving user to output information for executing settlement processing between the sending user and the receiving user. By establishing a pair of the sending user and the receiving user, the information processing device 200 mediates the settlement processing between the sending user and the receiving user, enabling the system 10 of this embodiment to execute settlement processing without requiring either the sending user or the receiving user to display barcodes, QR codes, etc. In particular, the system 10 of this embodiment can execute settlement processing between the sending user and the receiving user even when both the device owned by the sending user and the device owned by the receiving user are wearable terminals, thus improving the user experience of wearable terminals. As a result, the system 10 according to this embodiment can contribute to the widespread adoption of wearable devices.

[0041] Figure 3 schematically shows an example of the configuration of the eyeglass-type device 100. The eyeglass-type device 100 may include a frame 110 having a rim 112, a bridge 114, and temples 118.

[0042] The eyeglass-type device 100 includes, for example, a lens 116. The lens 116 may be an example of a display unit for the eyeglass-type device 100. The lens 116 may also be an example of a user interface for the eyeglass-type device 100.

[0043] The lens 116 may be a transparent or translucent display. In this case, the eyeglass-type device 100 may be a transparent or translucent display-type device. The eyeglass-type device 100 may also have a projection function that projects a display onto the lens 116. In this case, the eyeglass-type device 100 may be a projection-type device. The projection function of the eyeglass-type device 100 may be an example of the display function of the eyeglass-type device 100.

[0044] The glasses-type device 100 includes, for example, a camera 170. Figure 3 shows an example where the glasses-type device 100 has one camera 170. The glasses-type device 100 may have multiple cameras 170. The camera 170 may be an example of the user interface of the glasses-type device 100.

[0045] The imaging range of camera 170 is, for example, the range corresponding to the field of view of the wearer of the glasses-type device 100. The imaging range of camera 170 may be wider than the field of view of the wearer of the glasses-type device 100, or it may be substantially the same as the field of view of the wearer of the glasses-type device 100.

[0046] The placement of camera 170 in Figure 3 is an example. Camera 170 may be placed at any other location in frame 110.

[0047] The glasses-type device 100 includes, for example, a speaker 180. The speaker 180 may be an example of a user interface for the glasses-type device 100.

[0048] The arrangement of speaker 180 in Figure 3 is just one example. Speaker 180 may be placed at any other location on the frame 110.

[0049] The glasses-type device 100 includes, for example, a microphone 190. The microphone 190 may be an example of the user interface of the glasses-type device 100.

[0050] The placement of microphone 190 in Figure 3 is just one example. Microphone 190 may be placed at any other location in frame 110.

[0051] The glasses-type device 100 includes, for example, an operating unit. The glasses-type device 100 receives various inputs via the operating unit. The operating unit may be located at any position on the glasses-type device 100. The operating unit may be an example of the user interface of the glasses-type device 100.

[0052] The glasses-type device 100 includes, for example, an input section such as a button. The glasses-type device 100 receives various inputs via the input section. The input section may be located at any position on the frame 110. The input section may be an example of the user interface of the glasses-type device 100.

[0053] The glasses-type device 100 includes, for example, a projection device that projects a virtual keyboard and a sensing device that senses input to the virtual keyboard. The glasses-type device 100 accepts various inputs via the virtual keyboard. The projection device and the sensing device may be placed at any position on the glasses-type device 100. The virtual keyboard may be an example of the user interface of the glasses-type device 100.

[0054] The eyeglass-type device 100 includes, for example, a control device 150. The control device 150 may control various functions of the eyeglass-type device 100. The eyeglass-type device 100 may perform various functions in accordance with the control by the control device 150.

[0055] The arrangement of the control device 150 in Figure 3 is an example. The control device 150 may be placed in other locations on the frame 110. The control device 150 may be placed in any location inside the frame 110, for example. For example, the control device 150 may be placed inside the temple 118. Specifically, the control device 150 may be placed at the tip of the temple 118, i.e., the temple tip. The control device 150 may also be placed in any location outside the frame 110.

[0056] The glasses-type device 100 includes, for example, a battery. The battery may be located at any position on the glasses-type device 100.

[0057] The glasses-type device 100 may communicate with an external device. For example, the glasses-type device 100 may communicate wirelessly with an external device. For example, the glasses-type device 100 may communicate wirelessly with an external device. For example, the glasses-type device 100 may communicate with an external device via mobile communication. The glasses-type device 100 may also communicate with an external device via wired communication.

[0058] The glasses-type device 100 communicates with, for example, an information processing device 200. The glasses-type device 100 communicates with, for example, other glasses-type devices 100. The glasses-type device 100 communicates with a communication terminal such as a smartphone, tablet, or PC. The glasses-type device 100 may accept various inputs by receiving input information from a communication terminal.

[0059] Figure 4 is an explanatory diagram illustrating an example of establishing a user pair. Here, we mainly describe an example in which the information processing device 200 establishes a user pair 102 and user 104 based on images captured by a camera mounted on the glasses-type device 100. The captured images may be still images or moving images.

[0060] Users 102 and 104, who wish to perform a payment transaction between themselves, check poster 300 which contains information about the payment transaction. As shown in Figure 4, poster 300 states, "When performing a payment transaction, please scan the card." Users 102 and 104, following the instructions on poster 300, pick up a card 350 placed around poster 300 and begin scanning it using the glasses-type device 100.

[0061] The camera 170 mounted on the user 102's glasses-type device 100 captures an image of the imaging range 172 that includes the card 350. The user 102's glasses-type device 100 transmits the first decision information, including the captured image, to the information processing device 200.

[0062] The camera 170 mounted on the user 104's glasses-type device 100 captures an image of the imaging range 174 that includes the card 350. The user 104's glasses-type device 100 transmits the second decision information, including the captured image, to the information processing device 200.

[0063] A camera 170 mounted on user 102's glasses-type device 100 may be an example of a first camera, and a camera 170 mounted on user 104's glasses-type device 100 may be an example of a second camera. Similarly, a camera 170 mounted on user 102's glasses-type device 100 may be an example of a second camera, and a camera 170 mounted on user 104's glasses-type device 100 may be an example of a first camera.

[0064] The information processing device 200 establishes a pair of users 102 and 104, for example, if an object included in the captured image included in the first decision information is also included in the captured image included in the second decision information. The object can be anything as long as it has feature points. The object can be, for example, a card. The object can be, for example, a poster. The object can be, for example, a POP (Point of Purchase).

[0065] The captured image included in the first decision information includes "card 350" as an object. The captured image included in the second decision information also includes "card 350" as an object. Therefore, the information processing device 200 establishes a pair of users 102 and 104, assuming that the object included in the captured image included in the first decision information is also included in the captured image included in the second decision information.

[0066] Figure 5 is an explanatory diagram illustrating another example of establishing user pairs. Here, we will mainly explain the differences from the previous example of establishing user pairs.

[0067] Users 102 and 104, who wish to perform a payment transaction between themselves, check poster 400, which contains information regarding the payment transaction. As shown in Figure 5, poster 400 states, "When performing the payment transaction, please take an image of your hand with your thumb extended." Users 102 and 104 begin taking images using the glasses-type device 100 in accordance with the instructions on poster 400.

[0068] The camera 170 mounted on the user 102's glasses-type device 100 captures an image of the imaging range 172 that includes the user 102's hand with its thumb extended. The user 102's glasses-type device 100 transmits the first decision information, including the captured image, to the information processing device 200.

[0069] The camera 170 mounted on the user 104's glasses-type device 100 captures an image of the imaging range 174 that includes the user 104's hand with its thumb extended. The user 104's glasses-type device 100 transmits the second decision information, including the captured image, to the information processing device 200.

[0070] The information processing device 200 establishes a pair of users 102 and 104, for example, if the gesture identified from the captured image included in the first decision information is the same gesture as the gesture identified from the captured image included in the second decision information. Gestures can be static gestures, for example. Examples of static gestures include raising a thumbs-up or making an OK sign with the hand. Gestures can also be dynamic gestures, for example. Examples of dynamic gestures include waving the hand or drawing a specific trajectory with the fingers.

[0071] The captured image included in the first decision information includes the hand of user 102 with a thumbs-up. Therefore, the gesture identified from the captured image included in the first decision information is "thumbs-up". Also, the captured image included in the second decision information includes the hand of user 104 with a thumbs-up. Therefore, the gesture identified from the captured image included in the second decision information is "thumbs-up". Accordingly, the information processing device 200 establishes a pair of users 102 and 104 by determining that the gesture identified from the captured image included in the first decision information is the same gesture as the gesture identified from the captured image included in the second decision information.

[0072] Figure 6 is an explanatory diagram illustrating another example of establishing user pairs. Here, we will mainly explain the differences from the previous example of establishing user pairs.

[0073] Users 102 and 104, who wish to perform a payment transaction between them, check poster 500 which contains information regarding the payment transaction. As shown in Figure 6, poster 500 states, "When performing a payment transaction, please image the hand of the payment recipient with their thumb extended." Users 102 and 104 then cooperate to begin imaging using the glasses-type device 100, following the instructions on poster 500.

[0074] The camera 170 mounted on the glasses-type device 100 of user 102 captures an image of the imaging range 172 that includes the hand of user 104 with a thumb extended. The glasses-type device 100 of user 102 transmits the first decision information, including the captured image, to the information processing device 200.

[0075] The camera 170 mounted on the user 104's glasses-type device 100 captures an image of the imaging range 174 that includes the user 102's hand with its thumb extended. The user 104's glasses-type device 100 transmits the second decision information, including the captured image, to the information processing device 200.

[0076] The captured image included in the first decision information includes the hand of user 104 with a thumbs-up. Therefore, the gesture identified from the captured image included in the first decision information is "thumbs-up". Also, the captured image included in the second decision information includes the hand of user 102 with a thumbs-up. Therefore, the gesture identified from the captured image included in the second decision information is "thumbs-up". Accordingly, the information processing device 200 establishes the pair of user 102 and user 104 by determining that the gesture identified from the captured image included in the first decision information is the same gesture as the gesture identified from the captured image included in the second decision information.

[0077] In the example shown in Figure 6, the gesture captured by the camera 170 mounted on the glasses-type device 100 is the gesture of the payment recipient. This differs from the example shown in Figure 5, where the gesture captured by the camera 170 mounted on the glasses-type device 100 is the gesture of the user of the glasses-type device 100.

[0078] Figure 7 is an explanatory diagram illustrating another example of establishing a user pair. Here, the main points that differ from the aforementioned example of establishing a user pair will be explained. It is assumed that the information processing device 200 stores the facial information of user 102 and user 104.

[0079] Users 102 and 104, who wish to perform a payment transaction between themselves, check poster 600, which contains information regarding the payment transaction. As shown in Figure 7, poster 600 states, "When performing a payment transaction, please capture an image of the other party's face." Users 102 and 104 cooperate with each other and begin capturing images using the glasses-type device 100, following the instructions on poster 600.

[0080] The camera 170 mounted on the glasses-type device 100 of user 102 captures an image of the imaging range 172 that includes the face of user 104. The glasses-type device 100 of user 102 transmits the first decision information, including the captured image, to the information processing device 200.

[0081] The camera 170 mounted on the user 104's glasses-type device 100 captures an image of the imaging range 174 that includes the user 102's face. The user 104's glasses-type device 100 transmits the second decision information, including the captured image, to the information processing device 200.

[0082] The information processing device 200 establishes a pair of user 102 and user 104 if, for example, the biometric information obtained from the captured image included in the first decision information matches the biometric information of user 104 stored in the information processing device 200, and the biometric information obtained from the captured image included in the second decision information matches the biometric information of user 102 stored in the information processing device 200. The biometric information includes, for example, facial information. The biometric information includes, for example, fingerprint information. The biometric information includes, for example, palm print information. The biometric information includes, for example, ear shape information. The biometric information includes, for example, iris information. The biometric information includes, for example, voiceprint information.

[0083] The captured image included in the first decision information includes the face of user 104. Therefore, the biometric information obtained from the captured image included in the first decision information is "user 104's face information". Also, the captured image included in the second decision information includes the face of user 102. Therefore, the biometric information obtained from the captured image included in the second decision information is "user 102's face information". Accordingly, the information processing device 200 establishes a pair of user 102 and user 104, for example, by assuming that the biometric information obtained from the captured image included in the first decision information matches the face information of user 104 stored in the information processing device 200, and the biometric information obtained from the captured image included in the second decision information matches the face information of user 102 stored in the information processing device 200.

[0084] Figure 8 schematically shows an example of the functional configuration of the information processing device 200. The information processing device 200 comprises a storage unit 202, a receiving unit 204, an establishment unit 206, a control unit 208, and a settlement processing unit 210. However, it is not necessarily required that the information processing device 200 have all of these components.

[0085] The storage unit 202 stores various types of information. The storage unit 202 may include, for example, object information indicating an object. The storage unit 202 may include, for example, gesture information indicating a gesture. The storage unit 202 stores biometric information of multiple users, for example, including biometric information of a first user and biometric information of a second user. The storage unit 202 stores identification information of each user's control device for multiple users, for example, including identification information of the first user's first control device and identification information of the second user's second control device. The storage unit 202 stores account information for each user's electronic money application for multiple users, for example, including account information for the first user's electronic money application and account information for the second user's electronic money application. Note that electronic money may be an example of cash. The storage unit 202 may also store account information for each user's bank account for multiple users, for example, including account information for the first user's bank account and account information for the second user's bank account.

[0086] The receiving unit 204 receives various types of information. The receiving unit 204 receives various types of information, for example, via the network 20. The receiving unit 204 may store the received information in the storage unit 202.

[0087] The receiving unit 204 receives, for example, first decision information used to determine the payment partner of the first user from the first control device of the first user. The receiving unit 204 receives, for example, first decision information from the first control device whose operating mode is payment mode. The receiving unit 204 receives, for example, first decision information from the first control device whose operating mode is the remittance mode within the payment mode. The receiving unit 204 receives, for example, first decision information from the first control device whose operating mode is the receiving mode within the payment mode.

[0088] The first determination information includes, for example, operating mode information indicating the operating mode of the first control device. The first determination information includes, for example, an image captured by the first control device using the first camera. The first determination information includes, for example, location information indicating the position of the first control device. The first determination information includes, for example, identification information of a device that has established a short-range wireless communication connection with the first control device. The first determination information includes, for example, voiceprint information acquired by the first control device using the first microphone.

[0089] The receiving unit 204 receives, for example, second decision information used to determine the payment partner of the second user from the second control device of the second user. The receiving unit 204 receives, for example, second decision information from the second control device whose operating mode is payment mode. The receiving unit 204 receives, for example, first decision information from the second control device whose operating mode is the remittance mode within the payment mode. The receiving unit 204 receives, for example, second decision information from the second control device whose operating mode is the receiving mode within the payment mode.

[0090] The second determination information includes, for example, operating mode information indicating the operating mode of the second control device. The second determination information includes, for example, captured images taken by the second control device using the second camera. The second determination information includes, for example, location information indicating the location of the second control device. The second determination information includes, for example, identification information of a device that has established a short-range wireless communication connection with the second control device. The second determination information includes, for example, voiceprint information acquired by the second control device using the second microphone.

[0091] The establishment unit 206 establishes a pair of first and second users. The establishment unit 206 establishes a pair of first and second users based, for example, on various information stored in the storage unit 202. The establishment unit 206 establishes a pair of first and second users based, for example, on various information received by the receiving unit 204.

[0092] For example, the establishment unit 206 establishes a pair of first and second users if the first and second decision information satisfies predetermined pair determination conditions. On the other hand, the establishment unit 206 does not establish a pair of first and second users if the first and second decision information does not satisfy the pair determination conditions.

[0093] For example, the establishment unit 206 establishes a pair of first and second users if the receiving unit 204 receives first and second decision information within a predetermined pair determination period, and the first and second decision information satisfies the pair determination conditions. On the other hand, the establishment unit 206 does not establish a pair of first and second users if the receiving unit 204 does not receive at least one of the first and second decision information within the pair determination period, or if the first and second decision information does not satisfy the pair determination conditions.

[0094] The pair determination conditions include, for example, that an object included in the captured image included in the first determination information is also included in the captured image included in the second determination information. The pair determination conditions also include, for example, that an object included in the captured image included in the first determination information is also included in the captured image included in the second determination information, and that the object matches an object indicated by the object information stored in the storage unit 202.

[0095] The pair determination condition includes, for example, that an object included in the captured image contained in the first determination information matches an object indicated by the object information stored in the storage unit 202, and an object included in the captured image contained in the second determination information matches an object indicated by the object information stored in the storage unit 202. In this case, an object included in the captured image contained in the first determination information does not have to be included in the captured image contained in the second determination information.

[0096] The pair determination conditions include, for example, that the gesture identified from the captured image included in the first determination information is the same gesture as the gesture identified from the captured image included in the second determination information. The pair determination conditions include, for example, that the gesture of the first user identified from the captured image included in the first determination information is the same gesture as the gesture of the second user identified from the captured image included in the second determination information. The pair determination conditions include, for example, that the gesture of the second user identified from the captured image included in the first determination information is the same gesture as the gesture of the first user identified from the captured image included in the second determination information.

[0097] The pair determination conditions include, for example, that a gesture identified from an image captured in the first determination information is the same gesture as a gesture identified from an image captured in the second determination information, and that the gesture matches a gesture indicated by the gesture information stored in the storage unit 202. The pair determination conditions include, for example, that a gesture of a first user identified from an image captured in the first determination information is the same gesture as a gesture of a second user identified from an image captured in the second determination information, and that the gesture matches a gesture indicated by the gesture information stored in the storage unit 202. The pair determination conditions include, for example, that a gesture of a second user identified from an image captured in the first determination information is the same gesture as a gesture of a first user identified from an image captured in the second determination information, and that the gesture matches a gesture indicated by the gesture information stored in the storage unit 202.

[0098] The pair determination conditions include, for example, that the biometric information obtained from the captured image included in the first determination information matches the biometric information of the second user stored in the information processing device 200, and that the biometric information obtained from the captured image included in the second determination information matches the biometric information of the first user stored in the information processing device 200. The pair determination conditions include, for example, that the face information obtained from the captured image included in the first determination information matches the face information of the second user stored in the information processing device 200, and that the face information obtained from the captured image included in the second determination information matches the face information of the first user stored in the information processing device 200. The pair determination conditions include, for example, that the fingerprint information obtained from the captured image included in the first determination information matches the fingerprint information of the second user stored in the information processing device 200, and that the fingerprint information obtained from the captured image included in the second determination information matches the fingerprint information of the first user stored in the information processing device 200. The pair determination conditions include, for example, that palm print information obtained from the captured image included in the first determination information matches the palm print information of the second user stored in the information processing device 200, and that palm print information obtained from the captured image included in the second determination information matches the palm print information of the first user stored in the information processing device 200. The pair determination conditions include, for example, that ear shape information obtained from the captured image included in the first determination information matches the ear shape information of the second user stored in the information processing device 200, and that ear shape information obtained from the captured image included in the second determination information matches the ear shape information of the first user stored in the information processing device 200. The pair determination conditions include, for example, that iris information obtained from the captured image included in the first determination information matches the iris information of the second user stored in the information processing device 200, and that iris information obtained from the captured image included in the second determination information matches the iris information of the first user stored in the information processing device 200. The pair determination conditions include, for example, that the voiceprint information contained in the first determination information matches the voiceprint information of the second user stored in the information processing device 200, and that the voiceprint information contained in the second determination information matches the voiceprint information of the first user stored in the information processing device 200.

[0099] The pair determination condition may include that the distance between the position of the first control device, indicated by the position information contained in the first determination information, and the position of the second control device, indicated by the position information contained in the second determination information, is shorter than a predetermined distance threshold. The pair determination condition may also include that the identification information of the device that has established a short-range wireless communication connection with the first control device, contained in the first determination information, matches the identification information of the second control device stored in the storage unit 202, and that the identification information of the device that has established a short-range wireless communication connection with the second control device, contained in the second determination information, matches the identification information of the first control device stored in the storage unit 202.

[0100] The establishment unit 206 may establish a pair of first and second users if the first decision information and the second decision information satisfy two or more of the aforementioned pair decision conditions. For example, the establishment unit 206 establishes a pair of first and second users if the first decision information and the second decision information satisfy two pair decision conditions: a pair decision condition in which an object contained in the captured image contained in the first decision information is contained in the captured image contained in the second decision information, and a pair decision condition in which the biometric information obtained from the captured image contained in the first decision information matches the biometric information of the second user stored in the information processing device 200, and the biometric information obtained from the captured image contained in the second decision information matches the biometric information of the first user stored in the information processing device 200. The two or more pair decision conditions may be arbitrarily combined from the aforementioned multiple pair decision conditions.

[0101] For example, the establishment unit 206 determines whether the first and second decision information satisfy the pair determination conditions if the operating mode of the first control device, indicated by the operating mode information included in the first decision information, and the operating mode of the second control device, indicated by the operating mode information included in the second decision information, satisfy predetermined operating mode conditions. On the other hand, if the operating mode of the first control device and the operating mode of the second control device do not satisfy the operating mode conditions, the establishment unit 206 does not establish a pair of the first and second users.

[0102] The operating mode conditions include, for example, that the operating mode of the first control unit and the operating mode of the second control unit are settlement modes. The operating mode conditions also include, for example, that one of the operating modes of the first control unit and the operating mode of the second control unit is a remittance mode within the settlement modes, and the other of the operating modes of the first control unit and the operating mode of the second control unit is a receiving mode within the settlement modes.

[0103] The control unit 208 controls the control device. For example, the control unit 208 controls the control device by generating a control signal to control the control device and transmitting the generated control signal to the control device via the network 20. The control unit 208 may also control the control device by generating an instruction to the control device and transmitting the generated instruction to the control device via the network 20. The control device may control various functions according to the control signals and instructions received from the control unit 208.

[0104] The control unit 208 controls, for example, the first control unit. The control unit 208 controls, for example, the second control unit. The control unit 208 controls, for example, the first control unit and the second control unit.

[0105] The control unit 208 causes at least one of the first control unit and the second control unit to output information for executing a settlement process between the first user and the second user, for example. The control unit 208 causes at least one of the first control unit and the second control unit to output information for executing a settlement process between the first user and the second user, for example, in response to the establishment unit 206 establishing a pair of the first user and the second user.

[0106] The control unit 208 causes the first control device to output information for executing a remittance process in which the first user sends money to the second user, as information for executing a settlement process between the first user and the second user. The control unit 208 causes the first control device to output information for executing a receipt process in which the first user receives money from the second user, as information for executing a settlement process between the first user and the second user. The control unit 208 causes the first control device to output information for executing a remittance process in which the first user sends money to the second user, as information for executing a settlement process between the first user and the second user, and causes the second control device to output information for executing a receipt process in which the second user receives money from the first user, as information for executing a settlement process between the first user and the second user.

[0107] The settlement processing unit 210 performs settlement processing between the first user and the second user. Settlement processing between the first user and the second user includes, for example, a remittance process in which the first user sends money to the second user. Settlement processing between the first user and the second user also includes, for example, a receipt process in which the first user receives money from the second user.

[0108] The settlement processing unit 210 performs settlement processing between the first user and the second user by, for example, moving electronic money between the first user's electronic money application account and the second user's electronic money application account based on the first user's electronic money application account information and the second user's electronic money application account information stored in the storage unit 202. The settlement processing unit 210 also performs settlement processing between the first user and the second user by, for example, moving money between the first user's bank account and the second user's bank account based on the first user's bank account information and the second user's bank account information stored in the storage unit 202.

[0109] For example, when the receiving unit 204 receives remittance amount information indicating the remittance amount from the first control device, the settlement processing unit 210 executes settlement processing between the first user and the second user by sending the remittance amount from the first user to the second user. For example, when the receiving unit 204 receives remittance amount information indicating the remittance amount from the first control device and receives receipt amount information indicating the receipt amount from the second control device, and the remittance amount and the receipt amount match, the settlement processing unit 210 executes settlement processing between the first user and the second user by sending the remittance amount from the first user to the second user. On the other hand, when the receiving unit 204 receives remittance amount information from the first control device and receives receipt amount information from the second control device, and the remittance amount and the receipt amount do not match, the settlement processing unit 210 does not execute settlement processing between the first user and the second user.

[0110] Figure 9 is an explanatory diagram illustrating another example of the processing flow of system 10. In this other example of the processing flow of system 10 shown in Figure 9, the starting state is when the operating mode of user 102's glasses-type device 100 and the operating mode of user 104's glasses-type device 100 are not set to payment mode.

[0111] In S202, user 102's glasses-type device 100 is set to payment mode. In S204, user 104's glasses-type device 100 is set to payment mode.

[0112] In S206, user 102's glasses-type device 100 obtains first decision information used to determine user 102's payment partner. In S208, user 104's glasses-type device 100 obtains second decision information used to determine user 104's payment partner.

[0113] In S210, user 102's glasses-type device 100 transmits the first decision information acquired in S206 to user 104's glasses-type device 100. User 102's glasses-type device 100 transmits the first decision information to user 104's glasses-type device 100, for example, via network 20. User 102's glasses-type device 100 transmits the first decision information to user 104's glasses-type device 100, for example, via a short-range wireless communication connection established between user 102's glasses-type device 100 and user 104's glasses-type device 100. In S212, user 104's glasses-type device 100 transmits the second decision information acquired in S208 to user 102's glasses-type device 100.

[0114] In S214, the glasses-type device 100 of user 102 determines the payment partner of user 102 based on the first decision information obtained in S206 and the second decision information received in S212. For example, if the first decision information and the second decision information satisfy predetermined payment partner determination conditions, the glasses-type device 100 of user 102 determines that user 104 is the payment partner of user 102. Here, we will continue the explanation assuming that the glasses-type device 100 of user 102 has determined that user 104 is the payment partner of user 102.

[0115] In S216, the glasses-type device 100 of user 104 determines the payment partner of user 104 based on the second decision information acquired in S208 and the first decision information received in S210. Here, we will continue the explanation assuming that the glasses-type device 100 of user 104 has determined that user 102 is the payment partner of user 104.

[0116] In S218, User 102's glasses-type device 100 outputs information for executing a settlement process between User 102 and User 104, in response to the determination in S214 that User 104 is User 102's payment partner. In S220, User 104's glasses-type device 100 outputs information for executing a settlement process between User 102 and User 104, in response to the determination in S216 that User 102 is User 104's payment partner.

[0117] In S218, user 102, having confirmed the information output by user 102's glasses-type device 100, inputs the information necessary to execute the settlement process between user 102 and user 104 into user 102's glasses-type device 100. Similarly, in S220, user 104, having confirmed the information output by user 104's glasses-type device 100, inputs the information necessary to execute the settlement process between user 102 and user 104 into user 104's glasses-type device 100. Subsequently, in S222, the settlement process between user 102 and user 104 is executed.

[0118] The system 10 shown in Figure 9 can perform payment processing by having the device owned by the sending user and the device owned by the receiving user directly exchange information via short-range wireless communication, etc., without the sending user or the receiving user displaying barcodes, QR codes, etc. Furthermore, because the system 10 shown in Figure 9 has the sending user's device and the receiving user's device directly exchange information, it can perform payment processing even in communication environments where external devices cannot be accessed.

[0119] Figure 10 schematically shows an example of the functional configuration of the control device 150. The control device 150 comprises a setting unit 152, an acquisition unit 154, a transmission unit 155, a reception unit 156, a determination unit 158, and an output unit 162. However, it is not necessarily required that the control device 150 have all of these components.

[0120] The setting unit 152 sets the operating mode. The setting unit 152 sets the operating mode, for example, via the user interface of the control device 150. The setting unit 152 sets the operating mode by receiving setting information input from the user of the control device 150, for example, using a camera 170, microphone 190, operation unit, input unit, virtual keyboard, etc. The setting unit 152 may also set the operating mode by receiving setting information from a communication terminal via the network 20.

[0121] The setting unit 152, for example, sets the operation mode to payment mode. The setting unit 152, for example, sets the operation mode to the remittance mode within the payment mode. The setting unit 152, for example, sets the operation mode to the receiving mode within the payment mode.

[0122] The acquisition unit 154 acquires various types of information, for example. The acquisition unit 154 acquires various types of information, for example, through the user interface of the control device 150. The acquisition unit 154 acquires various types of information by accepting input of various types of information from the user of the control device 150 using, for example, a camera 170, a microphone 190, an operation unit, an input unit, a virtual keyboard, etc. The acquisition unit 154 acquires various types of information by measuring various types of information using, for example, a positioning sensor.

[0123] The acquisition unit 154 acquires, for example, operating mode information of the control device 150. The acquisition unit 154 acquires, for example, captured images taken using the camera 170. The acquisition unit 154 acquires, for example, location information of the control device 150. The acquisition unit 154 acquires, for example, identification information of a device that has established a short-range wireless communication connection with the control device 150. The acquisition unit 154 acquires, for example, voiceprint information acquired using the microphone 190. The acquisition unit 154 acquires first determination information used to determine the payment partner of the user of the control device 150, which includes at least one of the examples of information described above.

[0124] The transmitting unit 155 transmits various information. The transmitting unit 155 transmits various information via a network. The transmitting unit 155 transmits various information, for example, via a short-range wireless communication connection.

[0125] The transmitting unit 155 transmits, for example, the first decision information to the information processing device 200. The transmitting unit 155 also transmits, for example, the first decision information to another control device 150.

[0126] The receiving unit 156 receives various types of information. The receiving unit 156 receives various types of information via a network. The receiving unit 156 receives various types of information, for example, via a short-range wireless communication connection.

[0127] The receiving unit 156 receives, for example, a control signal from the information processing device 200. The receiving unit 156 also receives, for example, an instruction from the information processing device 200.

[0128] The receiving unit 156 receives, for example, second decision information from another control device 150, which is used to determine the payment partner of another user. Note that the other user may be a user of another control device 150.

[0129] The determination unit 158 ​​determines the payment partner for the user of the control device 150. The determination unit 158 ​​determines the payment partner for the user of the control device 150 based on various information acquired by the acquisition unit 154, for example. The determination unit 158 ​​determines the payment partner for the user of the control device 150 based on various information received by the receiving unit 156.

[0130] For example, if the first and second decision information satisfies predetermined payment partner determination conditions, the decision unit 158 ​​determines that a user of another control device 150 is the payment partner of the user of control device 150. On the other hand, if the first and second decision information does not satisfy the payment partner determination conditions, the decision unit 158 ​​determines that a user of another control device 150 is not the payment partner of the user of control device 150.

[0131] For example, the determination unit 158 ​​determines that a user of another control device 150 is the payment partner of the user of control device 150 if the receiving unit 156 receives the second determination information within a predetermined payment partner determination period from the time the acquisition unit 154 acquires the first determination information, and both the first and second determination information satisfy the predetermined payment partner determination conditions. On the other hand, the determination unit 158 ​​determines that a user of another control device 150 is not the payment partner of the user of control device 150 if the receiving unit 156 does not receive the second determination information within a predetermined payment partner determination period from the time the acquisition unit 154 acquires the first determination information, or if both the first and second determination information do not satisfy the predetermined payment partner determination conditions.

[0132] The payment partner determination conditions include, for example, that an object included in the captured image included in the first determination information is included in the captured image included in the second determination information. The payment partner determination conditions include, for example, that a gesture identified from the captured image included in the first determination information is the same gesture as a gesture identified from the captured image included in the second determination information. The payment partner determination conditions include, for example, that a gesture of a user of control device 150 identified from the captured image included in the first determination information is the same gesture as a gesture of a user of another control device 150 identified from the captured image included in the second determination information. The payment partner determination conditions may also include that the distance between the position of the first control device indicated by the position information included in the first determination information and the position of the second control device indicated by the position information included in the second determination information is shorter than a predetermined distance threshold.

[0133] The determination unit 158 ​​may determine that a user of another control device 150 is a payment partner of the user of control device 150 if the first determination information and the second determination information satisfy two or more of the payment partner determination conditions described above. These two or more payment partner determination conditions may be arbitrarily combined from the aforementioned multiple payment partner determination conditions.

[0134] For example, the determination unit 158 ​​determines whether the first and second determination information satisfies the settlement partner determination conditions if the operating mode of the control device 150, indicated by the operating mode information included in the first determination information, and the operating mode of the other control device 150, indicated by the operating mode information included in the second determination information, satisfy predetermined operating mode conditions. On the other hand, the establishment unit 206 determines that the user of the other control device 150 is not the settlement partner of the user of the control device 150 if the operating mode of the control device 150 and the operating mode of the other control device 150 do not satisfy the operating mode conditions.

[0135] The output unit 162 outputs various information. The output unit 162 outputs various information, for example, via the user interface of the control device 150. The output unit 162 displays and outputs various information, for example, using the lens 116. The output unit 162 outputs various information as sound, for example, using the speaker 180.

[0136] The output unit 162 outputs various information, for example, in response to the receiving unit 156 receiving a control signal or instruction from the information processing device 200. The output unit 162 also outputs various information, for example, in response to the determination unit 158 ​​determining that a user of another control device 150 is the payment partner of the user of control device 150.

[0137] The output unit 162 outputs information for executing a settlement process between a user of control device 150 and a user of another control device 150. The information for executing a settlement process between a user of control device 150 and a user of another control device 150 is, for example, information notifying that the settlement partner of the user of control device 150 has been determined. The information for executing a settlement process between a user of control device 150 and a user of another control device 150 is, for example, information prompting the user of control device 150 to input information on the amount to be sent or the amount to be received.

[0138] The output unit 162 outputs information for executing a remittance process where a user of control device 150 sends money to a user of another control device 150, for example, as information for executing a settlement process between a user of control device 150 and a user of another control device 150. The output unit 162 also outputs information for executing a receipt process where a user of control device 150 receives money from a user of another control device 150, for example, as information for executing a settlement process between a user of control device 150 and a user of another control device 150.

[0139] The acquisition unit 154 acquires, for example, remittance amount information. The acquisition unit 154 acquires remittance amount information by receiving input of remittance amount information from a user of the control device 150 who has confirmed the information for executing settlement processing between the user of the control device 150 and other users of the control device 150, output by the output unit 162, using, for example, an operation unit, input unit, virtual keyboard, etc. The acquisition unit 154 acquires remittance amount information by, for example, using a camera 170 to capture an image of the remittance amount output on the screen of a cash register, etc. The acquisition unit 154 may also acquire remittance amount information by, for example, using a microphone 190 to capture the voice of the user of the control device 150 or the settlement partner of the user of the control device 150 stating the remittance amount.

[0140] The acquisition unit 154 acquires, for example, information on the amount received. The acquisition unit 154 may acquire the information on the amount received in the same manner as when acquiring information on the amount sent.

[0141] The receiving unit 156 receives, for example, remittance amount information from another control device 150. The receiving unit 156 also receives, for example, receipt amount information from another control device 150.

[0142] The receiving unit 156 receives, for example, account information of an electronic money application of a user of another control device 150 from another control device 150. The receiving unit 156 also receives, for example, account information of a bank account of a user of another control device 150 from another control device 150.

[0143] The transmitting unit 155 transmits the remittance amount information obtained by the acquiring unit 154. For example, if the remittance amount indicated by the remittance amount information obtained by the acquiring unit 154 matches the received amount indicated by the received amount information received by the receiving unit 156, the transmitting unit 155 transmits the remittance amount information obtained by the acquiring unit 154. On the other hand, if the remittance amount indicated by the remittance amount information obtained by the acquiring unit 154 does not match the received amount indicated by the received amount information received by the receiving unit 156, the transmitting unit 155 does not transmit the remittance amount information obtained by the acquiring unit 154.

[0144] The transmitting unit 155 transmits, for example, the remittance amount information to the information processing device 200. The transmitting unit 155 also transmits, for example, the remittance amount information to another control device 150.

[0145] The transmission unit 155 transmits, for example, the remittance amount information to an electronic money server that manages the electronic money application accounts of users of the control device 150. In this case, the remittance amount information may further include account information for other users of the control device 150's electronic money application.

[0146] The transmission unit 155 transmits, for example, the remittance amount information to the account management server that manages the bank accounts of the users of the control device 150. In this case, the remittance amount information may further include account information for the bank accounts of other users of the control device 150.

[0147] The transmitting unit 155 transmits, for example, the amount received information. The transmitting unit 155 transmits, for example, the amount received information to the information processing device 200. The transmitting unit 155 transmits, for example, the amount received information to another control device 150.

[0148] Figure 11 schematically shows an example of the hardware configuration of a computer 1200 that functions as a control device 150 or an information processing device 200. A program installed on the computer 1200 can cause the computer 1200 to function as one or more "parts" of the apparatus according to this embodiment, or to cause the computer 1200 to execute operations associated with the apparatus according to this embodiment or such one or more "parts", and / or to cause the computer 1200 to execute a process or a stage of such process according to this embodiment. Such a program may be executed by the CPU 1212 to cause the computer 1200 to execute specific operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

[0149] The computer 1200 according to this embodiment includes a CPU 1212, RAM 1214, and a graphics controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive 1226 may be a DVD-ROM drive and a DVD-RAM drive, etc. The storage device 1224 may be a hard disk drive and a solid-state drive, etc. The computer 1200 also includes legacy input / output units such as a ROM 1230 and a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0150] The CPU 1212 operates according to the programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires the image data generated by the CPU 1212 and stores it in the frame buffer provided in RAM 1214 or within itself, so that the image data is displayed on the display device 1218.

[0151] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive 1226 reads programs or data from a DVD-ROM 1227, etc., and provides them to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0152] The ROM 1230 stores boot programs and / or hardware-dependent programs of the computer 1200, which are executed by the computer 1200 upon activation. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, etc.

[0153] The program is provided on a computer-readable storage medium such as a DVD-ROM 1227 or an IC card. The program is read from the computer-readable storage medium and installed on a storage device 1224, RAM 1214, or ROM 1230, which are examples of computer-readable storage media, and executed by the CPU 1212. The information processing described within these programs is read by the computer 1200, resulting in coordination between the program and the various types of hardware resources described above. The apparatus or method may be configured to realize the operation or processing of information in accordance with the use of the computer 1200.

[0154] For example, when communication is performed between a computer 1200 and an external device, the CPU 1212 may execute a communication program loaded into RAM 1214 and, based on the processing described in the communication program, instruct the communication interface 1222 to perform communication processing. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in a recording medium such as RAM 1214, storage device 1224, DVD-ROM 1227, or IC card, transmits the read transmission data to the network, or writes received data received from the network to a reception buffer area or the like provided on the recording medium.

[0155] Furthermore, the CPU 1212 may read all or necessary parts of files or databases stored on external recording media such as the storage device 1224, DVD drive 1226 (DVD-ROM 1227), or IC card into the RAM 1214, and perform various types of processing on the data in the RAM 1214. The CPU 1212 may then write the processed data back to the external recording media.

[0156] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and subjected to information processing. The CPU 1212 may perform various types of processing on the data read from RAM 1214, including various types of operations, information processing, conditional judgments, conditional branching, unconditional branching, information retrieval / replacement, etc., as described throughout this disclosure and specified by the program instruction sequence, and write the results back to RAM 1214. The CPU 1212 may also retrieve information in files, databases, etc., within the recording medium. For example, if multiple entries are stored in the recording medium, each having an attribute value of a first attribute associated with an attribute value of a second attribute, the CPU 1212 may search among the multiple entries for an entry that matches the specified condition for the attribute value of the first attribute, read the attribute value of the second attribute stored in that entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies the predetermined condition.

[0157] The program or software module described above may be stored on or near the computer 1200 in a computer-readable storage medium. Alternatively, a recording medium such as a hard disk or RAM provided within a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the program to the computer 1200 via the network.

[0158] In this embodiment, blocks in the flowchart and block diagram may represent a stage in a process in which an operation is performed or a "part" of a device that has the role of performing an operation. A particular stage and "part" may be implemented by a dedicated circuit, a programmable circuit supplied with computer-readable instructions stored on a computer-readable storage medium, and / or a processor supplied with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuit may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuit may include reconfigurable hardware circuits, such as field-programmable gate arrays (FPGAs) and programmable logic arrays (PLAs), which include logical AND, logical OR, exclusive OR, negated AND, negated OR, and other logical operations, flip-flops, registers, and memory elements.

[0159] Computer-readable media may include any tangible device capable of storing instructions to be executed by a suitable device, and as a result, computer-readable media having instructions stored therein will comprise a product containing instructions that can be executed to create means for performing operations specified in a flowchart or block diagram. Examples of computer-readable media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable media may include floppy disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disk read-only memory (CD-ROM), digital multipurpose disc (DVD), Blu-ray® disc, memory stick, integrated circuit card, etc.

[0160] Computer-readable instructions may include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, Java®, C++, and traditional procedural programming languages ​​such as the C programming language or similar programming languages.

[0161] Computer-readable instructions are provided locally or via a wide area network (WAN) such as a local area network (LAN) or the internet to the processor or programmable circuit of a programmable data processing device such as a computer, and may be executed to create means for performing operations specified in a flowchart or block diagram. Here, the computer may be a PC (personal computer), tablet computer, smartphone, workstation, server computer, general-purpose computer, or special-purpose computer, and may also be a computer system in which multiple computers are connected. Such a computer system in which multiple computers are connected is also called a distributed computing system and is a computer in a broad sense. In a distributed computing system, multiple computers execute a program collectively by having each computer execute a part of the program and passing data during program execution between computers as needed.

[0162] Examples of processors include computer processors, central processing units (CPUs), processing units, microprocessors, digital signal processors, controllers, and microcontrollers. A computer may have one or more processors. In a multiprocessor system with multiple processors, each processor executes a portion of the program, and the processors collectively execute the program by passing program execution data between them as needed. For example, in the execution of multitasking, each of the multiple processors may execute a portion of each task in small chunks by switching tasks at each time slice. In this case, which part of a program each processor executes changes dynamically. Which part of a program each of the multiple processors executes may also be statically determined by multiprocessor-aware programming.

[0163] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications or improvements can be made to the above embodiments. It will be clear from the claims that such modified or improved forms may also be included in the technical scope of the present invention.

[0164] It should be noted that the execution order of operations, procedures, steps, and stages in the apparatus, systems, programs, and methods shown in the claims, specifications, and drawings is not explicitly stated as "before" or "prior to," and that these can be implemented in any order unless the output of a previous process is used in a later process. Even if the operation flow in the claims, specifications, and drawings is described using phrases such as "first," and "next," for convenience, this does not mean that it is essential to perform the operations in that order. [Explanation of symbols]

[0165] 10 System, 20 Network, 100 Glasses-type device, 102 User, 104 User, 110 Frame, 112 Rim, 114 Bridge, 116 Lens, 118 Temple, 150 Control device, 152 Setting unit, 154 Acquisition unit, 155 Transmitting unit, 156 Receiving unit, 158 Determination unit, 162 Output unit, 170 Camera, 172 Imaging range, 174 Imaging range, 180 Speaker, 190 Microphone, 200 Information processing device, 202 Storage unit, 204 Receiving unit, 206 Establishment unit, 208 Control unit, 210 Payment processing unit, 300 Poster, 350 Card, 400 Poster, 500 Poster, 600 Poster, 1200 Computer, 1210 Host controller, 1212 CPU, 1214 RAM, 1216 Graphics controller, 1218 display device, 1220 input / output controller, 1222 communication interface, 1224 storage device, 1230 ROM, 1240 input / output chip

Claims

1. A receiving unit that receives first decision information used to determine the payment partner of a first user from a first control unit of a first user whose operating mode is payment mode, and receives second decision information used to determine the payment partner of a second user from a second control unit of a second user whose operating mode is payment mode, If the first decision information and the second decision information satisfy predetermined pair determination conditions, the establishment unit establishes a pair of the first user and the second user, In response to the establishment unit establishing the pair of the first user and the second user, the control unit causes at least one of the first control device and the second control device to output information for executing a settlement process between the first user and the second user. Equipped with, The receiving unit receives the first decision information, which includes an image captured by the first control device using the first camera, and the second decision information, which includes an image captured by the second control device using the second camera. The establishment unit establishes the pair of the first user and the second user if the gesture identified from the captured image included in the first decision information is the same gesture as the gesture identified from the captured image included in the second decision information. Information processing device.

2. A storage unit for storing the biometric information of a first user and the biometric information of a second user, A receiving unit that receives first decision information used to determine the payment partner of the first user from the first control unit of the first user, whose operating mode is payment mode, and second decision information used to determine the payment partner of the second user from the second control unit of the second user, whose operating mode is payment mode, If the first decision information and the second decision information satisfy predetermined pair determination conditions, the establishment unit establishes a pair of the first user and the second user, In response to the establishment unit establishing the pair of the first user and the second user, the control unit causes at least one of the first control device and the second control device to output information for executing a settlement process between the first user and the second user. Equipped with, The receiving unit receives the first decision information, which includes an image captured by the first control device using the first camera, and the second decision information, which includes an image captured by the second control device using the second camera. The establishment unit establishes the pair of the first user and the second user if the biometric information obtained from the captured image included in the first determination information matches the biometric information of the second user stored in the storage unit, and the biometric information obtained from the captured image included in the second determination information matches the biometric information of the first user stored in the storage unit. Information processing device.

3. A storage unit for storing identification information of the first control device and identification information of the second control device, A receiving unit that receives first decision information used to determine the payment partner of a first user from the first control device of a first user whose operating mode is payment mode, and receives second decision information used to determine the payment partner of a second user from the second control device of a second user whose operating mode is payment mode, If the first decision information and the second decision information satisfy predetermined pair determination conditions, the establishment unit establishes a pair of the first user and the second user, In response to the establishment unit establishing the pair of the first user and the second user, the control unit causes at least one of the first control device and the second control device to output information for executing a settlement process between the first user and the second user. Equipped with, The receiving unit receives the first determination information, which includes identification information of a device that has established a short-range wireless communication connection with the first control device, and receives the second determination information, which includes identification information of a device that has established a short-range wireless communication connection with the second control device. The establishment unit establishes the pair of the first user and the second user if the identification information of the device included in the first determination information matches the identification information of the second control device stored in the storage unit, and the identification information of the device included in the second determination information matches the identification information of the first control device stored in the storage unit. Information processing device.

4. The receiving unit receives the first decision information from the first control device of the first user whose operating mode is the remittance mode among the payment modes, and receives the second decision information from the second control device of the second user whose operating mode is the receiving mode among the payment modes. The control unit causes the first control device to output information for executing a remittance process in which the first user sends money to the second user, as information for executing a settlement process between the first user and the second user, and causes the second control device to output information for executing a receipt process in which the second user receives money from the first user, as information for executing a settlement process between the first user and the second user. The information processing apparatus according to any one of claims 1 to 3.

5. The information processing apparatus according to any one of claims 1 to 3, wherein the establishment unit establishes the pair of the first user and the second user when the receiving unit receives the first decision information and the second decision information within a predetermined pair determination period, and the first decision information and the second decision information satisfy the pair determination conditions.

6. The receiving unit receives the first decision information, which includes an image captured by the first control device using the first camera, and the second decision information, which includes an image captured by the second control device using the second camera. The establishment unit establishes the pair of the first user and the second user if an object included in the captured image included in the first decision information is also included in the captured image included in the second decision information. The information processing apparatus according to any one of claims 1 to 3.

7. The receiving unit receives the first determination information which includes location information indicating the location of the first control device, and receives the second determination information which includes location information indicating the location of the second control device. The establishment unit establishes the pair of the first user and the second user if the distance between the position of the first control device, indicated by the position information included in the first determination information, and the position of the second control device, indicated by the position information included in the second determination information, is shorter than a predetermined distance threshold. The information processing apparatus according to any one of claims 1 to 3.

8. The information processing apparatus according to any one of claims 1 to 3, wherein the receiving unit receives the first decision information from the first control device mounted on the first wearable terminal and receives the second decision information from the second control device mounted on the second wearable terminal.

9. A program that, when executed by a computer, causes the computer to function as an information processing device according to any one of claims 1 to 3.

10. A control device, A setting unit for setting the operating mode to payment mode, An acquisition unit that acquires first decision information used to determine the payment partner of the user of the control device, A receiving unit that receives second decision information used to determine the payment partner of another user from another control device, A determination unit that determines that the other user is the user's payment partner when the first determination information and the second determination information satisfy predetermined payment partner determination conditions, In response to the determination unit determining that the other user is the payment partner of the user, an output unit outputs information for executing a payment process between the user and the other user. Equipped with, The acquisition unit acquires the first decision information, which includes the captured image captured by the control device using the first camera. The receiving unit receives the second decision information, which includes the captured image captured by the other control device using the second camera. The determination unit determines that the other user is the payment partner of the user if the gesture identified from the captured image included in the first determination information is the same gesture as the gesture identified from the captured image included in the second determination information. Control device.

11. A program, when executed by a computer, that causes the computer to function as the control device described in claim 10.

Citation Information

Patent Citations

  • Electronic money settlement system, management server of this system, and information terminal applicable to this system

    JP2009116628A

  • Information processing method, information processing device, and program

    JP2020129210A

  • Program, information processing device, information processing system and information processing method

    JP2023145202A

  • Information processing apparatus, information processing method, and information processing program

    JP2023152667A