Network robot device

Abstract

To create high-performance robots at a low cost and to widely distribute them to consumers. [Solution] A network robot device 100 equipped with a control unit 101 that realizes various functions includes a communication unit 102 that communicates with an external function 201 on the internet, and a storage unit 103 that stores information for internal processing of the network robot device 100 and information for external processing to be passed to the external function 201. The control unit 101 realizes the functions of the device body 100 by reading and processing the information for internal processing from the storage unit 103, and enables the external function 201 to function by reading the information for external processing from the storage unit 103 and transmitting it to the external function 201 through the communication unit 102.

Description

Technical Field

[0001] The present invention relates to a network robot device, and more particularly to a network robot device capable of communicating with an external device through a computer network.

Background Art

[0002] Although the definition of "robot" has not been established uniquely, in the present application, it refers to a device equipped with some kind of character and a processor that realizes various functions.

[0003] In order to enhance the performance of such a robot, it is necessary to install a high-performance processor, a storage device, etc. However, with the improvement of the performance of the built-in hardware, the manufacturing cost of the robot itself also increases, which becomes an obstacle to mass production and wide penetration to consumers.

[0004] Currently, it is widely practiced to access an Internet site and purchase goods through telemarketing. A user who wants to purchase a product generally operates a browser to access a shopping site, searches for the product to be purchased on the site, adds the searched product to the shopping cart, and repeats the above steps. When all the products to be purchased are ready, the user performs the input necessary for settlement (for example, Non-Patent Document 1). Thus, a user who wants to purchase a product on a shopping site is required to perform complex input operations on a computer. However, users who are not familiar with computer operations have difficulty using telemarketing via the Internet. It is expected that a society in which robots that assist consumers with some kind of inconvenience are widely accepted and utilized by them will emerge.

Prior Art Documents

Patent Documents

[0005]

Non-Patent Document 1

[0006] The present invention aims to address some of the shortcomings of the above-mentioned conventional examples, particularly by enabling the widespread adoption of high-performance robots among consumers. [Means for solving the problem]

[0007] To solve the above problems, the present invention adopts the following configuration. Specifically, a network robot device equipped with a control unit that realizes various functions includes a communication unit that communicates with external functions on the internet, and a storage unit that stores information for internal processing of the network robot device and information for external processing to be passed to the external functions. The control unit realizes the functions of the device body by reading and processing the information for internal processing from the storage unit, and enables the external functions to function by reading the information for external processing from the storage unit and transmitting it to the external functions through the communication unit.

[0008] In this way, even if the network robot itself has limited functionality, it is possible to create a highly functional robot overall by placing service functions on the outside and connecting them. This makes it possible to reduce the cost of the robot itself. [Effects of the Invention]

[0009] Therefore, according to the present invention, high-performance robots can be widely distributed to consumers. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 is an external configuration diagram showing an embodiment of the present invention. [Figure 2] Figure 2 is a block diagram of the main body of the shopping assistance device shown in Figure 1. [Figure 3] Figure 3 is a structural diagram of data stored in the storage unit in Figure 2. [Figure 4] Figure 4 is a structural diagram with a part of the flyer (product catalog) omitted. [Figure 5] Figure 5 is a flowchart of the shopping process executed by the device main body in Figure 2. [Figure 6] Figure 6 is a flowchart of the taxi dispatching process executed by the device main body in Figure 2. [Figure 7] Figure 7 is a flowchart of the hometown tax payment process executed by the device main body in Figure 2. [Figure 8] Figure 8 is a flowchart of the tactile switch response process executed by the device main body in Figure 2. [Figure 9] Figure 9 is an overall configuration diagram of a shopping support system including the shopping support device in Figure 1. [Figure 10] Figure 10 is a block configuration diagram of a transaction support system included in the shopping support system in Figure 9. [Figure 11] Figure 11 is a structural diagram of data stored in the storage unit of the transaction support system shown in Figure 10. [Figure 12] Figure 12 is a block configuration diagram of a catalog generation device that uses the data shown in Figure 11. [Figure 13] Figure 13 is an operation explanatory diagram of the generation device shown in Figure 12. [Figure 14] Figure 14 is a block configuration diagram of an audio data generation device that uses the data shown in Figure 11. [Figure 15] Figure 15 is an operation explanatory diagram of the generation device shown in Figure 14. [Figure 16] Figure 16 is an overall configuration diagram of an information processing system including the network robot device of the present invention. [Figure 17] Figure 17 is an overall configuration diagram of the entire system including the system in Figure 16.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0012] [Hardware Configuration of the Main Body] FIG. 1 shows an embodiment of a shopping support device as a network robot device. The shopping support device of this embodiment is wrapped in a character exterior 1 and includes a connection part for a numeric keypad 2 and a connection part for a card reader 3. In addition, tactile switches 11 are built into both hands and the nose of the character exterior 1, respectively.

[0013] The character exterior 1 is an exterior presenting the appearance of a character such as a person or an animal. In this embodiment, it presents the appearance of an ape, but it can have the appearances of various characters. It is desirable that the appearance gives a sense of familiarity to the user, but it is not limited thereto. As the material, for example, a material used for stuffed toys can be adopted.

[0014] The numeric keypad 2 does not necessarily only consist of numeric keys and includes function keys capable of inputting special instructions with one key. Since a small keyboard with the minimum necessary number of keys is preferable, it is referred to as a numeric keypad in this application.

[0015] The card reader 3 is a device that reads information from a card or the like held by the user, and it may read information from an IC chip or from a magnetic stripe. The user can shop by operating the numeric keypad 2 according to the voice emitted from the character exterior 1 and by having the card reader 3 read a card or the like. As the card, a credit card, an electronic money card, a point card of a supermarket or a shopping street, or a my number card, etc., or a mobile terminal equipped with an IC chip having the same function as these cards can be used.

[0016] The tactile switch 11 is a switch for reproducing a voice corresponding to the pressurized part when the user pressurizes the hand, nose, etc. of the character exterior 1.

[0017] FIG. 2 is a block configuration diagram of the device main body built into the character exterior 1.

[0018] The character exterior 1 contains the tactile switch 11, keypad connection section 12, card reader connection section 13, control section 14, memory section 15, audio output section 16, and communication section 17.

[0019] The numeric keypad connection section 12 is an interface such as USB (Universal Serial Bus) for connecting the numeric keypad 2. The card reader connection section 13 is an interface such as USB for connecting the card reader 3. The control unit 14 is equipped with a processor and realizes various functions by executing programs. The storage unit 15 is provided in a storage device such as flash memory and includes an audio storage unit, a catalog storage unit, and a user storage unit. The audio output unit 16 is a speaker that emits sound for the user and is preferably located near the mouth of the character casing 1. The communication unit 17 is equipped with a wireless LAN (Local Area Network) adapter and is used for transmitting order forms generated by the shopping support device. If the shopping support device is powered by a battery, it becomes easier to carry the device body together with the character casing 1.

[0020] [Data structure within the device] Figure 3 shows the structure of the data stored in the memory unit 15.

[0021] Figure 3(a) shows the structure of the data stored in the voice memory unit. The voice memory unit stores the user identifier, voice set identifier, voice identifier, and voice data in association with each other.

[0022] The "user identifier" is equal to the value of the card-specific identifier, such as the card number, read by card reader 3. In other words, the user identifier will have a different value for each card read, and even for the same person, the voice data used may differ depending on the card read.

[0023] A "voice set identifier" is an identifier that indicates a set of voices used in conjunction with a given user identifier. The voice set used may differ for each user identifier. For example, one user might be assigned a polite voice set, while another might be assigned a more casual voice set. In addition, various voice sets such as standard Japanese, dialects, male voices, female voices, Japanese, and English can be used depending on the user.

[0024] A "voice identifier" is an identifier used to distinguish between multiple voices included in a voice set. Each voice data is assigned a unique value as a voice identifier, but each voice set has a set of voice identifiers with the same value. For example, when a program plays a greeting voice corresponding to voice identifier s at the beginning, it may read and play a greeting voice (e.g., standard Japanese) corresponding to voice identifier s from voice set A, or it may read and play a greeting voice (e.g., dialect) corresponding to voice identifier s from voice set B, depending on the user. In this case, each voice set has the same voice identifier for the voices in the same scene, which allows for processing by a common program.

[0025] "Audio data" refers to audio data such as words or songs corresponding to a given audio identifier, and includes guidance voices to help users navigate the shopping process. In some cases, multiple audio data sets are combined to play meaningful words.

[0026] Figure 3(b) shows the structure of the data stored in the catalog storage unit. The catalog storage unit stores user identifiers, catalog identifiers, listing identifiers, product identifiers, voice identifiers, and product information in association with each other.

[0027] The "user identifier" is as described above. The "catalog identifier" is the identifier of the product catalog that is available in correspondence with the user identifier. Users order products while looking at product catalogs in paper format or similar. In this application, the term "product" is used as a concept that includes "services".

[0028] A "product identifier" is a unique identifier for each product. Even for the same product, different providers or intermediaries will assign different product identifiers.

[0029] The "listing identifier" is an identifier used to distinguish products listed in that product catalog. Users can select the product they want to order from the catalog by entering the listing identifier.

[0030] A "voice identifier" is an identifier for the voice data that pronounces the product name of that product.

[0031] "Product information" refers to information about the product, including the product name, product image, price, and description.

[0032] Figure 3(c) shows the structure of the data stored in the user memory. The user memory stores the user identifier, nickname, and personal information in association with each other.

[0033] The "User Identifier" is as described above. The "Nickname" is audio data that pronounces the user's nickname. The "Personal Information" is the user's personal information, including address, name, and telephone number. The "Personal Information" may be used if personal information cannot be read from the card via card reader 3.

[0034] [Catalog (flyer) structure] Figure 4 shows an example of a product catalog that a user would see. In this embodiment, it is a paper product catalog, a so-called flyer. This product catalog corresponds to a card that the user possesses, and lists the products that become available for purchase when that card is read by the card reader 3. Each product is assigned a serial number from 1 to 6, and these serial numbers from 1 to 6 represent the listing identifiers shown in Figure 3(b).

[0035] [Ordering products] Figure 5 is a flowchart showing the procedure for a user to order products. Following this flowchart, we will explain the user's actions in ordering products listed in the product catalog in Figure 4. The shopping support device in Figure 2 is set to operating mode, and the user has the card reader 3 read a card or the like corresponding to the product catalog in Figure 4. The control unit 14 reads the card's unique number, which serves as the user identifier U, from the card reader 3. In addition, if possible, the control unit 14 reads the user's address, name, and telephone number from the card or the like (S1).

[0036] Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, specifically the voice data associated with the voice identifier corresponding to the opening voice. The control unit 14 also reads from the user storage unit the voice data of the name associated with the user identifier U. Then, the control unit 14 combines the read opening voice data and the name voice data to cause the voice output unit 16 to pronounce, for example, the following words (S2): "Hello, Mr. / Ms. ○○. It's □□ Monkey!". The character exterior 1 pronounces this. If a card with a user identifier not registered in the storage unit 15 is used, it is advisable to control the device by making a sound such as "This card cannot be used!" to prevent it from being used. This can prevent situations such as children ordering items as a joke.

[0037] Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the product selection guidance voice, and causes the voice output unit 16 to pronounce, for example, the following words (S3): "Press the number of the item you want from the flyer for [month]!" The user looks at the product catalog in Figure 4 and enters one of the listing identifiers 1 to 6 of the desired product using the numeric keypad 2.

[0038] The control unit 14 obtains the listing identifier K entered by the user from the numeric keypad 2 (S4). Next, the control unit 14 obtains voice data from the voice storage unit that pronounces the name of the product selected by the user. In other words, the control unit 14 reads the voice identifier V associated with the user identifier U and listing identifier K from the catalog storage unit, and then reads the voice data of the product name associated with the user identifier U and voice identifier V from the voice storage unit. The control unit 14 also reads the voice data associated with the user identifier U that corresponds to the voice identifier of the product confirmation voice from the voice storage unit. Then, the control unit 14 combines the retrieved product confirmation voice data and the voice data of the product name and pronounces, for example, the following words from the voice output unit 16 (S5): "It's number K, ○○ (product name)! If this is correct, press 'yes', otherwise press 'no'!"

[0039] The user enters "yes" or "no" using the numeric keypad 2. If "no" is entered, the control unit 14 returns to the product selection guidance in S3. On the other hand, if "yes" is entered, the process proceeds to the following (S5).

[0040] The control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the quantity input guidance voice, and causes the voice output unit 16 to pronounce, for example, the following words (S6): "How many do you want? Press the number!" The user then enters the order quantity of the previously selected product using the numeric keypad 2.

[0041] The control unit 14 obtains the order quantity entered by the user from the numeric keypad 2 (S7). Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the quantity entered by the user. The control unit 14 also reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the quantity confirmation voice. Then, the control unit 14 combines the read quantity confirmation voice data and the quantity voice data and causes the voice output unit 16 to pronounce, for example, the following words (S8): "How many is it? If this is correct, press 'yes', otherwise press 'no'!"

[0042] The user enters "yes" or "no" using keypad 2. If "no" is entered, the control unit 14 returns to the quantity input prompt in S6. On the other hand, if "yes" is entered, the process proceeds to the following steps.

[0043] The control unit 14 stores the product identifier of the product selected by the user and the order quantity of that product in the storage unit 15. The control unit 14 also reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the additional confirmation voice, and causes the voice output unit 16 to pronounce, for example, the following words (S9): "Press 'yes' if there is anything else you want, or 'no' if there is nothing else!"

[0044] The user enters "yes" or "no" using the numeric keypad 2. If "yes" is entered, the control unit 14 returns to the product selection guidance in S3. On the other hand, if "no" is entered, the process proceeds to the following steps.

[0045] The control unit 14 reads the product identifier and order quantity for each product selected by the user from the storage unit 15. The control unit 14 reads the price of the product corresponding to each read product identifier from the product information in the catalog storage unit. The control unit 14 calculates the total order amount based on the read price and order quantity of each product. The control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the calculated amount, the voice identifier of each product name, and the voice identifier of each product quantity. The control unit 14 also reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the order details confirmation voice. Then, the control unit 14 combines the read voice data and, for example, has the voice output unit 16 pronounce the following words (S11). "Okay, let me check your order!" "Three leeks, two large peaches, and three radishes, right?" "The amount is XXX yen!" "If this is okay, press 'Yes,' otherwise press 'No'!"

[0046] The user enters "yes" or "no" using the numeric keypad 2. If "no" is entered, the control unit 14 returns to the additional confirmation in S9. On the other hand, if "yes" is entered, it proceeds to the next process. The user can cancel any input at any time. If the user presses the "cancel" button on the numeric keypad 2, the control unit 14 resets the product identifier and order quantity stored in the memory unit 15 and returns to the card reading in S1.

[0047] The control unit 14 reads from the voice storage unit voice data associated with the user identifier U, which corresponds to the voice identifier of the delivery date confirmation voice. The control unit 14 also refers to the calendar and determines the first candidate delivery date, which is a few days from today. The control unit 14 also reads from the voice storage unit voice data associated with the user identifier U, which corresponds to the voice identifier of the determined date. Then, the control unit 14 combines the read voice data and causes the voice output unit 16 to pronounce, for example, the following words (S12). "Is it okay to deliver on [Month] [Day]?" "If this is okay, press 'Yes,' otherwise press 'No'!"

[0048] The user enters "yes" or "no" using the numeric keypad 2. If "no" is entered, the control unit 14 repeats the delivery date confirmation in S12 while changing the candidate delivery dates. On the other hand, if "yes" is entered, the process proceeds to the following steps.

[0049] The control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the delivery date announcement voice. Then, the control unit 14 combines the voice data of the delivery date announcement voice that it has read with the voice data of the delivery candidate date that it read immediately before, and has the voice output unit 16 pronounce the following words, for example: "Okay, we'll deliver it on [Month] [Day]!" The control unit 14 stores the determined delivery date in the storage unit 15.

[0050] Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the payment method confirmation voice, and causes the voice output unit 16 to pronounce, for example, the following words (S13). "Is cash on delivery okay for payment?" "If this is okay, press 'Yes,' otherwise press 'No'!"

[0051] The user enters "yes" or "no" using the numeric keypad 2. If "no" is entered, the control unit 14 repeats the payment method confirmation in S13, changing the payment method to "electronic money payment" or "credit card payment". Alternatively, buttons corresponding to each payment method may be provided on the numeric keypad 2, allowing the user to select the payment method by pressing a button. For example, electronic money could be selected by pressing button 1, and credit card payment by pressing button 2. On the other hand, if "yes" is entered, the process proceeds to the following: The control unit 14 stores the selected payment method in the storage unit 15.

[0052] The control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the determined payment method, and causes the voice output unit 16 to pronounce, for example, the following words (in the case of cash on delivery). "Thank you for your order!" "We'll collect the payment when we deliver it, so please have it ready!"

[0053] Next, the control unit 14 reads the product identifier, product name, price, order quantity, delivery date, and payment method for each item ordered by the user from the storage unit 15. The control unit 14 also reads the user's address, name, and telephone number from a card or the like via the card reader 3. Alternatively, the control unit 14 reads the user's address, name, and telephone number from the user storage unit. Alternatively, the control unit 14 may obtain the user's address, name, and telephone number from the internet via the communication unit 17. The control unit 14 then generates order data including the product identifier, product name, price, order quantity, total order amount, delivery date, payment method, user's address, name, telephone number, and order date for each item ordered by the user. The control unit 14 then transmits the generated order data to the transaction support system on the internet via the communication unit 17 (S14).

[0054] Furthermore, if the payment method is electronic money payment or credit card payment, the control unit 14 executes the electronic money payment or credit card payment process to the internet payment service via the communication unit 17 based on the information read from the card, etc., through the card reader 3 (S15).

[0055] Furthermore, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the ending voice, and causes the voice output unit 16 to pronounce, for example, the following words (S16): "See you later, bye-bye!".

[0056] The transaction support system, upon receiving the order data, sends the order data to the provider of each ordered product and arranges for the ordered products to be delivered to the user. In this process, the product provider may procure the ordered products and hold them in the store as reserved items.

[0057] According to the above embodiment, by simply having the card reader 3 read the card and operating the keypad 2 according to the voice guidance, users can order products, making it easier for even those unfamiliar with computer operation to use online shopping compared to conventional methods. Furthermore, the friendly character exterior 1 is expected to have a calming effect. Moreover, by using the keypad 2, which has limited input capacity, rather than a voice recognition method for user responses, the device can be designed inexpensively without having to consider unexpected user responses. In addition, by ordering based on flyers or other materials listing products, a screen can be eliminated, making it possible to provide a shopping support device at a lower cost. Furthermore, it is possible to create a specification that users will find endearing, for example, by having a mobile phone carrier use its own CM character on the character exterior 1, or by having the CM song play when the tactile switch 11 is operated. In addition, it is possible to read personal information such as address and name from the IC card, eliminating the need for the user to enter their address, etc.

[0058] [Taxi dispatch instructions] Next, Figure 6 is a flowchart showing the procedure for requesting a taxi dispatch using the shopping support device. The shopping support device shown in Figure 2 is set to the operating state, and the user has a designated card or the like read by the card reader 3. The control unit 14 reads the card's unique number as the user identifier U from the card or the like through the card reader 3 (S21). Subsequently, the control unit 14 reads from the voice storage unit the voice data associated with the voice identifier corresponding to the opening voice, which is the voice data associated with the user identifier U. The control unit 14 also reads from the user storage unit the voice data of the name associated with the user identifier U. Then, the control unit 14 combines the read opening voice data and the name voice data and has the voice output unit 16 pronounce, for example, the following words (S22): "Hello, Mr. / Ms. ○○. It's □□ Monkey!". The character exterior 1 pronounces it.

[0059] Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the product selection guidance voice, and causes the voice output unit 16 to pronounce, for example, the following words (S231): "Press the button you want!" At this point, the user presses the key on the numeric keypad 2 that indicates "Dispatch a taxi".

[0060] The control unit 14 receives the user's "taxi dispatch" request from the numeric keypad 2 (S232). Next, the control unit 14 reads the voice data associated with the user identifier U, which corresponds to the voice identifier of the product confirmation voice, from the voice storage unit and causes the voice output unit 16 to pronounce, for example, the following words (S233): "I'll call a taxi! If this is OK, press 'yes', otherwise press 'no'!"

[0061] The user enters "yes" or "no" using the numeric keypad 2. If "no" is entered, the control unit 14 returns to the product selection guidance in S23. On the other hand, if "yes" is entered, the process proceeds to the following (S233).

[0062] Next, the control unit 14 receives a request for the time to dispatch a taxi (S24). The control unit 14 reads predetermined voice data corresponding to the user identifier from the voice storage unit and has the voice output unit 16 pronounce, for example, "Call now? Call later? Press 'yes' to call now, and 'no' to call later." Next, it receives input of "yes" or "no" from the keypad 2. If "yes" is entered, it stores "Call now" as the dispatch time in the storage unit 15. On the other hand, if "no" is entered, it reads predetermined voice data corresponding to the user identifier from the voice storage unit and has the voice output unit 16 pronounce, for example, "Press the time you want the taxi to come." Then, it receives the desired time from the keypad 2 and stores the entered time as the dispatch time in the storage unit 15.

[0063] Next, the control unit 14 receives the specification of the location where the taxi will be dispatched (S25). The memory unit 15 is assumed to have pre-registered information representing multiple locations associated with the user identifier. The information representing a location is configured by associating the name of the location (such as home or hospital) with the address or location information of that location. The control unit 14 reads predetermined voice data associated with the user identifier from the voice memory unit and has the voice output unit 16 pronounce, for example, "Is home okay as the location? Or is it the hospital?" Next, it receives the location specification from the keypad 2 and stores the specified location in the memory unit 15 as the dispatch location. If the location does not have address or location information pre-registered, the user may be prompted to input or select information that identifies the address (such as postal code, city / town name, and street number) from the keypad 2 according to the voice guidance.

[0064] Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the quantity input guidance voice, and causes the voice output unit 16 to pronounce, for example, the following words (S26): "Press the number to call!" The user enters the number of taxis they wish to dispatch using the numeric keypad 2.

[0065] The control unit 14 obtains the number of units entered by the user from the numeric keypad 2 (S27). Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the number of units entered by the user. The control unit 14 also reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the quantity confirmation voice. Then, the control unit 14 combines the read quantity confirmation voice data and the voice data of the number of units, and for example, has the voice output unit 16 pronounce the following words (S28): "That's ○ units! If this is correct, press 'yes', or if not, press 'no'!"

[0066] The user enters "yes" or "no" using keypad 2. If "no" is entered, the control unit 14 returns to the quantity input prompt in S26. On the other hand, if "yes" is entered, the process proceeds to the following. The user can cancel any input at any time. If the user presses the "cancel" button on keypad 2, the control unit 14 returns to the card reading in S21.

[0067] The control unit 14 reads the user's address, name, and telephone number from a card or the like via the card reader 3. Alternatively, the control unit 14 reads the user's address, name, and telephone number from the user storage unit. Alternatively, the control unit 14 may obtain the user's address, name, and telephone number from the internet via the communication unit 17. Then, based on the information stored in the storage unit 15, the control unit 14 generates dispatch request data for the number of taxis requested by the user and transmits it to the transaction support system or the computer of a designated taxi company (S29). The dispatch request data includes a product identifier corresponding to the taxi dispatch, the destination address, name, dispatch time, and telephone number.

[0068] Furthermore, the control unit 14 reads from the voice storage unit voice data associated with the user identifier U, which corresponds to the voice identifier of the ending voice, and causes the voice output unit 16 to pronounce, for example, the following words (S30): "I've called a taxi. Please wait until it arrives!"

[0069] According to the above embodiment, the user can arrange for a taxi simply by having a card or the like read and by entering information into the shopping support device's keypad.

[0070] [Application for Furusato Tax Donation] Figure 7 is a flowchart showing the procedure for applying for hometown tax donation using the shopping support device. The shopping support device shown in Figure 2 is set to the operating state, and the user has the designated card or other item read by the card reader 3. The control unit 14 reads the card's unique number as the user identifier U from the card or other item through the card reader 3 (S31). Next, the control unit 14 reads from the voice storage unit the voice data associated with the voice identifier corresponding to the opening voice, which is the voice data associated with the user identifier U. The control unit 14 also reads from the user storage unit the voice data of the name associated with the user identifier U. Then, the control unit 14 combines the read opening voice data and the name voice data and has the voice output unit 16 pronounce, for example, the following words (S32): "Hello, Mr. / Ms. ○○. It's □□ Monkey!". The character exterior 1 pronounces it.

[0071] Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the product selection guidance voice, and causes the voice output unit 16 to pronounce, for example, the following words (S33): "Press the button you want!" At this point, the user presses the key on the numeric keypad 2 that indicates "hometown tax donation".

[0072] The control unit 14 receives the user's "hometown tax donation" request from the numeric keypad 2 (S34). Next, the control unit 14 obtains voice data from the voice storage unit that pronounces the name of the municipality to which the hometown tax donation will be made. In other words, the control unit 14 reads the voice identifier associated with the user identifier U and the product identifier corresponding to the hometown tax donation from the catalog storage unit, and then reads the voice data of the municipality name as a product name that is pre-associated with the user identifier U and the voice identifier from the voice storage unit. The control unit 14 also reads the voice data associated with the user identifier U that corresponds to the voice identifier of the product confirmation voice from the voice storage unit. Then, the control unit 14 combines the retrieved product confirmation voice data and the voice data of the municipality name and makes the voice output unit 16 pronounce, for example, the following words (S35): "I'm going to make a hometown tax donation to XX prefecture □□ city! If this is OK, press 'yes', otherwise press 'no'!"

[0073] The user enters "yes" or "no" using the numeric keypad 2. If "no" is entered, the control unit 14 returns to the product selection guidance in S33. On the other hand, if "yes" is entered, the process proceeds to the following (S35).

[0074] The control unit 14 reads from the voice storage unit voice data associated with the user identifier U, which corresponds to the voice identifier of the quantity input guidance voice, and causes the voice output unit 16 to pronounce, for example, the following words (S36): "Please press the amount you would like to donate!" The user enters the amount to be donated as a hometown tax donation using the numeric keypad 2.

[0075] The control unit 14 obtains the amount entered by the user from the numeric keypad 2 (S37). Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the amount entered by the user. The control unit 14 also reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the quantity confirmation voice. Then, the control unit 14 combines the read quantity confirmation voice data and the amount voice data and causes the voice output unit 16 to pronounce, for example, the following words (S38): "That's ○ million yen! If this is correct, press 'yes', or if not, press 'no'!"

[0076] The user enters "yes" or "no" using keypad 2. If "no" is entered, the control unit 14 returns to the quantity input prompt in S36. On the other hand, if "yes" is entered, the process proceeds as follows. The user can cancel any input at any time. If the user presses the "cancel" button on keypad 2, the control unit 14 returns to the card reading in S31.

[0077] Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the payment method confirmation voice, and causes the voice output unit 16 to pronounce, for example, the following words (S39). "Can I pay by credit card?" "If this is okay, press 'Yes,' otherwise press 'No'!"

[0078] The user enters "yes" or "no" using keypad 2. If "no" is entered, the control unit 14 repeats the payment method confirmation in S39 while changing the payment method to another payment method. On the other hand, if "yes" is entered, the process proceeds to the following: The control unit 14 stores the decided payment method in the storage unit 15.

[0079] Next, the control unit 14 executes the process of selecting a thank-you gift for the hometown tax donation (S40). Here, the control unit 14 executes the process of allowing the user to select a thank-you gift, similar to the processes from S3 to S5 in Figure 5, and stores the product identifier of the selected thank-you gift in the storage unit 15.

[0080] Next, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the determined payment method, and causes the voice output unit 16 to pronounce, for example, the following words. "Thank you for your application!" "Please look forward to receiving your thank-you gift!"

[0081] The control unit 14 reads the user's address, name, and telephone number from a card or the like via the card reader 3. Alternatively, the control unit 14 reads the user's address, name, and telephone number from the user storage unit. Alternatively, the control unit 14 may obtain the user's address, name, and telephone number from the internet via the communication unit 17. The control unit 14 then generates application form data for the hometown tax donation amount requested by the user and transmits it to the transaction support system via the communication unit 17 (S41). The application form data includes a product identifier corresponding to the hometown tax donation, the donation amount, the payment method, the product identifier of the thank-you gift, and the user's address, name, and telephone number. The transaction support system, upon receiving the application form data, acts as an agent for the hometown tax donation.

[0082] Furthermore, if the payment method is credit card payment, the control unit 14 executes the credit card payment process via the communication unit 17 to the online payment service based on the information read from the card, etc., through the card reader 3 (S42). Here, the payment process in S42 may be executed after payment method confirmation (S39) and before the gift selection process (S40).

[0083] Then, the control unit 14 reads from the voice storage unit the voice data associated with the user identifier U, which corresponds to the voice identifier of the ending voice, and causes the voice output unit 16 to pronounce, for example, the following words (S43): "See you later, bye-bye!".

[0084] According to the above embodiment, users can easily make hometown tax donations to a specific municipality through the shopping support device. By providing users with shopping support devices featuring local characters (for example, Okayama Prefecture uses Momotaro), municipalities can more easily obtain hometown tax donations from users and reduce the likelihood of users switching to other municipalities. It is also possible to pre-link the unique device number of the shopping support device with the recipient municipality, and the transaction support system can determine the recipient municipality based on the unique device number of the shopping support device.

[0085] [Function of tactile switches] Figure 8 shows the operation of the shopping assistance device when a user presses a tactile switch 11. When a user presses a tactile switch 11 embedded in the hand or nose of the character's exterior 1, and the tactile switch 11 turns on, the control unit 14 detects that the tactile switch 11 is on (S51), reads the audio data corresponding to the turned-on tactile switch 11 from the audio storage unit (S52), and plays the read audio data from the audio output unit 16 (S53). Each tactile switch 11 is associated with a different audio identifier, and the control unit 14 reads the audio data associated with the audio identifier linked to the turned-on tactile switch 11 from the audio storage unit. The content of the audio data varies depending on the location; for example, a greeting is given when the right hand is grasped, a different greeting when the left hand is grasped, and a song is sung when the nose is pinched. This allows for communication between the user and the shopping assistance device, making the shopping assistance device an increasingly cherished presence for the user.

[0086] [How to obtain audio data] In the shopping support device described above, voice data is stored in the voice memory unit, and when pronunciation is required, the voice data is read out and played back. However, instead of voice data, text data may be stored, and the control unit 14 may convert the text data into voice data that pronounces the words corresponding to the text data each time pronunciation is required, and use this for pronunciation.

[0087] Furthermore, the control unit 14 may transmit text data to a speech synthesis system on the internet each time a sound is produced, and receive speech data from the speech synthesis system that pronounces the words corresponding to the text data, and use this data for pronunciation.

[0088] Furthermore, the control unit 14 may transmit a voice identifier to a server system on the Internet each time it produces sound, and receive voice data corresponding to the voice identifier from the server system to use for production.

[0089] Furthermore, the control unit 14 may transmit a speech identifier to a server system on the Internet each time a sound is produced, receive text data corresponding to the speech identifier from the server system, and convert the received text data into speech data that pronounces the words corresponding to the text data for use in pronunciation. In the above, any electronic data can be used instead of the above text data, as long as it can ultimately be converted into speech data.

[0090] [Inclusion of a touch panel on the main unit] Furthermore, although the shopping support device of this embodiment does not have a display, the shopping support device 10 may be equipped with a touch panel such as a tablet terminal on the abdomen of the character exterior 1, and the control unit 14 may receive user input from the touch panel and display the content that was previously output by voice on the touch panel. The control unit 14 may also display predetermined content on the built-in touch panel in accordance with the progress of the order processing. The control unit 14 may also display a product catalog screen on the built-in touch panel based on data from the catalog storage unit.

[0091] [Use of smartphone and other interfaces] Furthermore, the shopping support device 10 may utilize the input and display devices of an external device by communicating with it via wired or wireless means. The external device can be a tablet, smartphone, or television. The control unit 14 may transmit content to the external device via the communication unit 17 based on input from the external device's input device or keypad 2, and display predetermined content on the external device in accordance with the progress of the order processing. The control unit 14 may also display a product catalog screen on the external device based on data from the catalog storage unit.

[0092] [Print receipt] Alternatively, a receipt printer may be built into the abdomen or back of the character's exterior 1, and the control unit 14 may print a receipt of the order details for the user.

[0093] [Obtaining an address] The user's address can be obtained using the method described above, or it can be entered using the numeric keypad 2. In this case, the address information other than the street number corresponding to the postal code entered using the numeric keypad 2 can be obtained from the address database, and in addition, the user's complete address can be obtained by having the user enter the street number using the numeric keypad 2. In this case, an address database stored on an external computer can be used via the network. This address acquisition process may be performed by the control unit 14 of the shopping support device 10, or the server-side computer may execute and obtain the address information and provide it to the shopping support device 10.

[0094] [Select payment method] Payment methods can be selected using the methods described above, or by pressing the buttons on keypad 2. Alternatively, payment methods such as "cash on delivery" can be pre-displayed on the buttons on keypad 2, and the user can press the button corresponding to their chosen payment method. Furthermore, voice guidance can be provided, such as "Press 1 for cash on delivery, 2 for credit card, and 3 for electronic money," and the user can press the corresponding numbered button for their chosen payment method.

[0095] [Select audio data] In the above embodiment, the card reader 3 reads a unique card number as a user identifier U, and the system plays voice data corresponding to the read user identifier U, thereby enabling different voices for each user. Alternatively, the card reader 3 may read a vendor identifier that uniquely identifies the trader of goods or the provider of services, and the system may play voice data corresponding to the read vendor identifier, thereby enabling different voices and wording for each trader of goods or the provider of services. This can be achieved by replacing the "user identifier" in Figure 3(a) with the "vendor identifier".

[0096] According to this, when a user scans a card for a transaction with vendor A, the system will then provide guidance in a voice corresponding to vendor A. When a user scans a card for a transaction with vendor B, the system will then provide guidance in a voice corresponding to vendor B. Alternatively, instead of using this method, the system may identify the corresponding vendor identifier (intermediary identifier or provider identifier) ​​based on the product number (product identifier) ​​and pronounce each vendor identifier with a different voice and wording. In this case, it is advisable to pre-associate and store the vendor identifier with the voice set identifier, as well as the product identifier with the vendor identifier.

[0097] [Point rewards at stores and shopping streets] A shopping support device 10, as shown in Figure 1, can be installed next to the cash register in a store and used for adding points to point cards. In this case, a character associated with the store or its location can be used as the exterior design. The card reader 3 is installed where shoppers can hold their cards over it, and the keypad 2 is installed where the cashier operates it. In Figure 2, the control unit 14 reads the user identifier or vendor identifier from the card held over the card reader 3 via the card reader connection unit 13. Then, as in the embodiment described above, the control unit 14 outputs voice guidance corresponding to the user identifier or vendor identifier from the voice output unit 16. The store clerk enters the number of points to be awarded (points added) based on the items purchased by the customer using keypad 2.

[0098] When adding points to the memory in the card, the control unit 14 obtains the current number of points stored in the card via the card reader connection unit 13. The control unit 14 also obtains the number of points to be added, entered from the numeric keypad 2, via the numeric keypad connection unit 12. Then, the control unit 14 updates the memory in the card held over the card reader with the total number of points (current points plus added points) via the card reader connection unit 13. Furthermore, when points are added to an external point management system, the control unit 14 links the card-specific identifier read from the card with the number of points added or the total number of points after the addition, and transmits it to the point management system via the communication unit 17. This allows us to offer a new loyalty card service to our customers.

[0099] [Advantages of numeric keypad input] In each of the embodiments described above, user input is performed by operating a numeric keypad. On the other hand, it is also known that various processes are performed by recognizing voice input from the user. For example, there are reception robots that respond to voice input and engage in dialogue, and voice-activated remote controls that respond to voice input and operate electrical equipment. However, when these systems are actually used, users may be dissatisfied because the voice is not recognized correctly. In contrast, the numeric keypad input adopted in the present invention has the advantage of being more reliable than voice input at present.

[0100] [Server-side hardware configuration] Next, as shown in Figure 9, the shopping support device 10 placed in the user's possession is connected to the internet in multiple ways, and each is configured to communicate with the transaction support system 20. Furthermore, the transaction support system 20 is able to communicate via the internet with the computers of the product producers, providers, intermediaries for product sales, and product delivery personnel.

[0101] Figure 10 shows the configuration of the transaction support system 20. The transaction support system 20 comprises a processing unit 21, a storage unit 22, and a communication unit 23. The processing unit 21 is equipped with a processor and realizes various functions by executing programs. The storage unit 22 is provided in a storage device such as an HDD (hard disk drive). The communication unit 23 is a communication device that communicates with the shopping support device 10 and computers on the internet.

[0102] [Server-side data structure] The memory unit 22 includes a distribution memory unit, a catalog memory unit, a product memory unit, a voice memory unit, and a trader memory unit. The structure of the data stored in each memory unit is shown in Figure 11.

[0103] Figure 11(a) shows the data structure of the distribution storage unit. The distribution storage unit stores a catalog identifier and an audio set identifier associated with each user identifier. The user identifier is the user identifier handled by the shopping support device 10. The catalog identifier is the identifier of the product catalog stored by the shopping support device 10 corresponding to that user identifier. The audio set identifier is the identifier of the audio set stored by the shopping support device 10 corresponding to that user identifier.

[0104] Figure 11(b) shows the data structure of the catalog storage unit. The catalog storage unit stores a listing identifier, product identifier, and audio identifier associated with each catalog identifier. The catalog identifier is a unique value for each medium, such as a mail-order catalog or flyer. The listing identifier is a unique value for each product listed in that medium. The product identifier is a unique value for each product. Even for the same product, the product identifier will differ if the provider or intermediary is different. The audio identifier is the identifier of the audio data that pronounces the product name of that product. Here, the mail-order catalog or flyer may also be something displayed on a television or computer screen.

[0105] Figure 11(c) shows the data structure of the product storage unit. The product storage unit stores product information, a voice identifier, an intermediary identifier, and a provider identifier associated with each product identifier. The product identifier is as described above. Product information includes the product name, product image, price, and description. The voice identifier is the identifier of the voice data corresponding to the voice of the product name. The intermediary identifier is the identifier of the person who intermediaries the sale of the product, for example, the identifier of a mail-order business operator. If there is no intermediary for the product, the intermediary identifier takes an invalid value. The provider identifier is the identifier of the retailer, wholesaler, or producer who directly provides the product to the user.

[0106] Figure 11(d) shows the data structure of the voice storage unit. The voice storage unit stores voice identifiers and voice data associated with each voice set identifier. The voice set identifier identifies the group of voice data associated with each user identifier. The voice identifier is the identifier of the voice data included in that voice set. The voice data includes voices used by the shopping support device 10 to guide the user through shopping and other procedures.

[0107] Figure 11(e) shows the data structure of the trader memory unit. The trader memory unit stores trader information for each trader identifier. The trader identifier includes the intermediary identifier and the provider identifier. The trader information is information about the intermediary or provider (retailer, wholesaler, or producer) and includes the company name, address, internet contact information (such as email address or session ID to the trading support system), and other contact information (such as telephone number or fax number).

[0108] [Server-side processing upon receiving the order] The processing unit 21 of the transaction support system 20 performs the following operations in response to a communication from the shopping support device 10. When it receives cash-on-delivery order data or completed payment order data from the shopping support device 10, it reads the provider identifier corresponding to the product identifier of the ordered product from the product storage unit, and reads the trader information corresponding to the read provider identifier (trader identifier) ​​from the trader storage unit. Then, based on the read trader information, it notifies the trader of the ordered product and its quantity, as well as the orderer's address, name, and telephone number. The notification is made to a computer on the internet via the communication unit 23, or by fax transmission, etc. The ordered product is then delivered from the trader to the user of the shopping support device 10, who is the orderer, via the delivery company.

[0109] [Distribution of performance-based compensation to intermediaries] Furthermore, in the product storage unit, if an intermediary identifier is associated with the product identifier of an ordered product, the processing unit 21 adds the commission (margin) for the sale of the product to the trader information corresponding to that intermediary identifier (trader identifier).

[0110] According to the above embodiment, it is possible to implement a process of paying a performance-based fee to the intermediary.

[0111] [Server-side processing upon receiving a vehicle dispatch request] Furthermore, when the transaction support system 20 receives taxi dispatch request data from the shopping support device 10, the processing unit 21 reads the product identifier from the dispatch request data. It then reads the provider identifier of the taxi company corresponding to that product identifier from the product storage unit, and reads the trader information corresponding to that provider identifier (trader identifier) ​​from the trader storage unit. Based on the retrieved trader information, it then notifies the trader of the number of taxis requested, the destination address or location information, name, dispatch time, and telephone number. The notification is made to a computer on the internet via the communication unit 23, or by telephone, etc. The requested number of taxis are then dispatched by the taxi company, which is the trader, to the user of the shopping support device 10, which is the requester.

[0112] [Server-side processing upon receiving a Furusato Nozei (hometown tax donation) application] Furthermore, when the transaction support system 20 receives application data for hometown tax donations from the shopping support device 10, the processing unit 21 reads the hometown tax donation product identifier from the received application data. It then reads the provider identifier of the local government corresponding to that product identifier from the product storage unit, and reads the trader information corresponding to that provider identifier (trader identifier) ​​from the trader storage unit. Based on the trader information read, it then notifies the local government of the hometown tax donation amount, payment method, thank-you gift identifier, donor's address, name, and telephone number. The notification is made to a computer on the internet via the communication unit 23, or by fax, etc. The local government that receives the notification then proceeds with arranging the thank-you gift and donation certificate for the donor. If the application data includes the device-specific identifier (MAC address, etc.) of the sending shopping support device 10 as the identifier of the recipient local government, the processing unit 21 may read and use the provider identifier of the local government associated with that device-specific identifier from the storage unit.

[0113] [Product catalog / audio set update] The transaction support system 20 has a function to update the product catalogs and voice sets stored in each shopping support device 10. The processing unit 21 periodically receives product catalog update requests from each shopping support device 10 via the communication unit 23. The update request includes a user identifier. Upon receiving an update request, the processing unit 21 reads the catalog identifier and voice set identifier corresponding to the received user identifier from the distribution storage unit, and determines whether the contents of the catalog storage unit corresponding to that catalog identifier have been updated since the last distribution, and whether the contents of the voice storage unit corresponding to that voice set identifier have been updated since the last distribution. In making this determination, the processing unit stores the date and time when the contents of the catalog storage unit and voice storage unit corresponding to each user identifier were distributed in the storage unit. In addition, the date and time when the contents of the catalog storage unit were updated for each catalog identifier is stored in the storage unit, and the date and time when the contents of the voice storage unit were updated for each voice identifier is stored in the storage unit. Then, the distribution date and time and the update date and time are compared. If the result of this determination indicates that the data has been updated, the updated catalog storage data and the updated voice storage data are read from the storage unit 22 and transmitted to the requesting shopping support device 10 via the communication unit 23. The processing unit 21 also reads product information corresponding to the product identifier associated with the catalog identifier from the product storage unit, associates the read product information with the corresponding product identifier, and transmits it to the requesting shopping support device 10 via the communication unit 23.

[0114] Upon receiving the update data, the shopping support device 10's control unit 14 updates the catalog storage unit 15 with the received update data from the catalog storage unit. The control unit 14 also updates the voice storage unit with the received update data from the voice storage unit. Furthermore, it updates the product information data by associating it with the corresponding product identifier in the product storage unit.

[0115] According to the above embodiment, orders can be placed using updated catalogs, audio, and product information.

[0116] [Generating a product catalog] Figure 12 shows the configuration of a catalog generation device that generates an image of a product catalog for the user to refer to. The catalog generation device comprises a catalog image generation unit 31, a catalog image storage unit 32, an input unit 33, a display unit 34, and an output unit 35. The product storage unit 36 ​​is the product storage unit of the transaction support system 20 shown as storage unit 22 in Figure 10, or a copy thereof. The catalog storage unit 37 is also the catalog storage unit of the transaction support system 20 shown as storage unit 22 in Figure 10, or a copy thereof. The catalog image generation unit 31 is equipped with a processor and realizes various functions by executing a program. The catalog image storage unit 32, the product storage unit 36, and the catalog storage unit 37 are provided on a storage device such as an HDD. The input unit 33 is an input device such as a keyboard or a pointing device. The display unit 34 is a display that shows information. The output unit 35 is an interface that outputs data for printing.

[0117] As shown in Figure 13, the catalog image generation unit 31 (hereinafter referred to as "generation unit 31") displays product advertisement parts 41 associated with a product identifier on the display unit 34. The product advertisement parts 41 are generated using product information stored in the product storage unit 36. The product advertisement parts 41 include the product name and price, or a combination of these and a product image. The generation unit 31 also displays a flyer image 42 (product catalog image) associated with a catalog identifier on the display unit 34. The flyer image 42 is provided with a product listing area 43 associated with a listing identifier.

[0118] Then, when the generation unit 31 detects an operation (such as dragging and dropping) in the input unit 33 to link the product advertisement part 41 to the product listing area 43, it associates the catalog identifier associated with the flyer image 42, the listing identifier of the product listing area 43 where the product advertisement part 41 was dropped, the product identifier associated with the dropped product advertisement part 41, and the audio identifier associated with that product identifier in the product storage unit 36, and registers them in the catalog storage unit 37.

[0119] Furthermore, the generation unit 31 generates an image of the flyer by embedding the images of the dropped product advertisement parts 41 into the product placement area 43 of the flyer image 42, and stores it in the catalog image storage unit 32. Then, in order to print the completed flyer image, the generation unit 31 reads the flyer image data from the catalog image storage unit 32 and sends it to a printer or the like from the output unit 35.

[0120] According to this, flyers can be created using product information registered in the product storage unit 36, eliminating the need to separately input product information for flyers. Furthermore, the creation of flyers for distribution to users and the registration of data in the catalog storage unit 37 can be performed simultaneously.

[0121] [Generating audio data] Next, Figure 14 is a diagram of the configuration of a voice data generation device that generates voices to be registered in the voice memory unit. The voice data generation device comprises a text-to-speech conversion unit 51, a voice memory unit 52, a product information storage unit 53, an input unit 54, and a display unit 55. The text-to-speech conversion unit 51 is equipped with a processor and realizes various functions by executing a program. The voice memory unit 52 is the voice memory unit of the transaction support system 20 shown as storage unit 22 in Figure 10 or a copy thereof. The product information storage unit 53 is the product memory unit of the transaction support system 20 shown as storage unit 22 in Figure 10 or a copy thereof. The input unit 54 is an input device such as a keyboard or a pointing device. The display unit 55 is a display that shows information.

[0122] As shown in Figure 15, the text-to-speech conversion unit 51 displays an editing area 61 of product information associated with a product identifier on the display unit 55. The editing area 61 of product information displays product information read from the product storage unit 53 in an editable state. Alternatively, the editing area 61 of product information displays newly entered product information from the input unit 54. The text-to-speech conversion unit 51 also displays an editing area 62 of the voice set identifier and the voice text associated with the voice identifier on the display unit 55. The voice text editing area 62 receives the voice set identifier and the voice text to be registered in association with the voice identifier from the input unit 54.

[0123] When the text-to-speech conversion unit 51 detects an operation (such as dragging and dropping) to insert product information displayed in the product information editing area 61 into the audio text in the editing area 62, it inserts the dropped product information into the text at the dropped position and displays it on the display unit 55. Then, when the input unit 54 instructs the input unit 51 to perform audio conversion on the input text, the text-to-speech conversion unit 51 converts the text entered in the audio text editing area 62 into audio data and registers it in the audio storage unit 52 in association with the audio set identifier and audio identifier linked to the audio text editing area 62.

[0124] According to this, voice data can be generated and registered using product information stored in the product storage unit 53.

[0125] [Externalization of some robot functions] In the embodiments described above, it is preferable that user-supporting robots, such as the shopping assistance device 10, be supplied to as many users as possible. To achieve this, it is necessary to configure the device at the lowest possible cost while maintaining the performance required of the robot.

[0126] From that perspective, the present invention is configured as follows. That is, as shown in Figure 16, a robot 100 equipped with a processor 101 that realizes various functions includes a communication unit 102 that communicates with an external function 201 on the internet and an information storage unit 103. The processor 101 transmits the raw information stored in the storage unit 103 to the external function 201 on the internet via the communication unit 102, and receives result information obtained by the external function 201 based on the raw information from the external function 201 via the communication unit 102, and executes the program using the result information to realize the function.

[0127] In this way, even if the robot's own functions are limited, it is possible to create a highly functional robot as a whole by placing service functions on the outside and linking them together. This makes it possible to reduce the cost of the robot itself.

[0128] [Supplementary explanation and examples] Here, the "robot" in this application is defined as having some kind of character and a processor that realizes various functions. The "communication unit" is a network communication device such as a wireless LAN adapter. The "storage unit" is provided in a storage device such as flash memory. The "original information" is information acquired based on human input from the input device 104, input from various sensors 105, or calculations performed within the main unit. The "external function" is provided by an external device 200 on the internet.

[0129] In the shopping support device described above, information was received from the numeric keypad 2 corresponding to the input device 104 and the device operated accordingly. However, the robot 100 or the shopping support device may be configured to operate based on voice input from the input device 104 or the sensor 105. In this case, for example, the control unit 14 of the shopping support device may identify the selected product by voice recognition of the product name entered by voice in the product selection reception (S4, S232, S34, S40). Also, in the quantity input reception (S7, S27, S36), the quantity may be identified by voice recognition of the number entered by voice. Furthermore, in situations where confirmation is requested, the branch may be determined by voice recognition of the voice-inputted words "yes" or "no". Similarly, in the time specification process (S24) and location specification process (S25), time and location information may be acquired by voice recognition.

[0130] [Voice notification system for users] In Figures 16 and 17, the external device 200 receives information from the terminal of a medical professional or a relative, including the content to be notified to the user of the robot 100, the timing of the notification (date and time, robot 100 behavior, etc.), and the identifier of the robot 100 to which the notification will be sent, and registers this information in its storage device. The medical professional or relative can register the notification content (such as text) and the notification timing through a management screen provided by the external device 200 to their terminal. The terminal may be a smartphone or other device. When the external device 200 detects the arrival of a timing registered in the storage device, it sends a notification message associated with that timing to the robot 100 corresponding to the robot 100 identifier associated with that timing. Upon receiving the notification content via the communication unit 102, the processor 101 of the robot 100 converts the received notification content into words and pronounces it through the voice output unit.

[0131] According to this, for example, instructions and advice set by hospitals, caregivers, or family members can be spoken aloud by the robot 100 in a timely manner to convey to elderly users. For example, at a set time in the morning, messages such as "Good morning," "Your appointment today is at 10 o'clock," "Please don't eat breakfast," and "I will visit you at [time] today" can be conveyed to the user. In addition, if the user inputs content using the keypad 2 and sends it to an external device 200, multiple terminals communicating with the external device 200 can also share the user's input. For example, content entered by an elderly person can be shared among authorized parties such as hospitals and nursing homes. The elderly user themselves can use these functions even if they are unable to perform complex settings. Furthermore, it can provide wake-up calls not only to the elderly but also to general users. It can also be used by mothers to tell their children things like, "It's 6 PM now, it's time to study."

[0132] [Use of speech synthesis] The robot 100's processor 101 is equipped with a speech synthesizer function, and the words it outputs from its voice output unit may be pronounced in the voice of a famous anime character or the like. For example, by having the mother deliver the message to her child in the voice of a famous anime character, it is expected that the child will be more likely to obey. Alternatively, an external device 200 may be equipped with a speech synthesizer, and the voice synthesized by the external device 200 may be sent to the robot 100 for pronunciation.

[0133] [User-to-user communication system] In Figures 16 and 17, voice interaction may be implemented between the robot 100 and any terminal on the internet. The terminal may be a smartphone or the like. The content of the interaction could be studying English conversation or playing games. For example, this can be achieved by connecting a voice chat between any terminal and the robot 100. Alternatively, the robot 100 may be equipped with a camera as its sensor 105, and the robot 100's video feed of the user may be transmitted to the other party's terminal to perform a video chat. In this case, the speech synthesizer described above may be executed in the robot 100 or the external device 200 that transmits sound to the robot 100, so that the words spoken by the robot 100 are pronounced in the voice of a famous anime character or the like. This can give children the feeling of having a conversation in English with a famous anime character, for example, and is expected to improve the effectiveness of their learning.

[0134] Alternatively, the above voice notification system for users may be used to have users submit data to the external device 200. For example, the above voice notification system may cause robot 100 to say things like "Good morning," "How are you feeling today?", or "Please take your temperature" to users of a medical institution (users of robot 100). In response, the user measures their body temperature using a thermometer (sensor 105), and the processor 101 associates the body temperature data received from the thermometer with the user's identifier and transmits it to an external device 200. The external device 200 provides the body temperature data received from the robot 100 to a terminal, such as a medical professional, who is the recipient of the voice notification. Similarly, blood pressure data and other biometric data are acquired from the sensor 105 and transferred to the external device 200, and provided to the terminal of the medical professional. The user's visual state may also be acquired from the camera (sensor 105) and provided to the terminal of the medical professional via the external device 200.

[0135] Medical professionals may arrange for medications, supplements, or meals for users to be delivered to their homes automatically by ordering them from stores based on biometric data obtained from users. Furthermore, medical professionals can use the above-mentioned voice notification system to set up voice notifications for the next user, taking biometric data into consideration.

[0136] [Download the app for robots] The robot 100 may be equipped with application software (apps) to run on an external device 200, and the robot 100 may use the corresponding app in an ASP (Application Service Provider) manner in response to operations such as the operation of a keypad connected to the robot 100. Examples include English conversation apps, learning apps such as mathematics, and apps for entertainment and games. Alternatively, the desired app may be downloaded, installed, and executed on the robot 100. With these methods, many functions can be freely used on a single robot terminal, and the functions can also be upgraded.

[0137] [Monitoring function] In Figures 16 and 17, when the robot 100 is operated by a user, the processor 101 may detect the operation and transmit information indicating that the operation has occurred to the external device 200. An operation could be, for example, starting the robot 100 or operating the tactile switch mentioned above. Upon receiving this information, the external device 200 can understand that a user is taking action, and thus a user monitoring system can be constructed.

[0138] Herein, the invention also encompasses other embodiments that do not depart from the spirit of the invention, in addition to those described in the embodiments. The embodiments are for illustrative purposes only and do not limit the scope of the invention. The scope of the invention is indicated by the claims and not by the description in the specification. Accordingly, the invention encompasses all forms, including the meaning and scope within the scope of equivalents of the claims. [Explanation of Symbols]

[0139] 1. Character exterior 2. Numeric keypad 3 Card readers 10 Shopping support device 11. Tactile switches 12. Numeric keypad connection section 13. Card reader connection section 14 Control Unit 15 Storage section 20 Transaction Support System 21 Processing Unit 22 Memory section 23 Communications Department 31 Catalog Image Generation Unit 32 Catalog Image Storage Unit 33 Input section 34 Display section 35 Output section 36 Product storage section 37 Catalog Storage Unit 41 Product advertising parts 42 Flyer image (product catalog image) 43 Product Listing Areas 51 Text-to-Speech Conversion Unit 52 Voice Memory Unit 53 Product storage section 54 Input section 55 Display section 61 Editing area for product information 62. Editing area for speech-to-text 100 robots (network robot devices) 101 Processors 102 Communications Department 103 Storage section 104 Input device 105 Sensor 200 External device 201 External Functions

Claims

[Claim 1] In a network robot device equipped with a control unit that performs various functions, It comprises a communication unit that communicates with external functions on the internet, and a storage unit that stores information for internal processing of the network robot device and information for external processing to be passed to the external functions, The control unit enables the functions of the main body of the device by reading and processing the internal processing information from the storage unit, and enables the external functions by reading the external processing information from the storage unit and transmitting it to the external functions through the communication unit, in a network robot device.

Images