Information processing device and program

Abstract

To provide an information processing device and a program that allow a customer's request about a commodity to be easily obtained with words of the customer itself.SOLUTION: In a store server 12 (information processing device), an input information acquisition unit 43 (acquisition unit) obtains a customer's request about a commodity in association with information that identifies the commodity as a target of the request (e.g., an image of the commodity, a commodity code, or a commodity name). A request analysis unit 49 (analysis unit) analyzes, for each commodity, the request obtained by the input information acquisition unit 43, based on whether a predetermined keyword is included in the request. A request transmission unit 50 (transmission unit) transmits a result of the analysis by the request analysis unit 49, to a transmission destination associated with the commodity (e.g., a manufacturer of the commodity).SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing device and a program. [Background technology]

[0002] Stores use the information to find out what products will sell better in the future, and producers use the information to develop products that will sell better than the products they are currently producing.

[0003] However, such opinions are generally collected based on questionnaires prepared by stores or manufacturers (for example, Patent Document 1).

[0004] On the other hand, when consumers are dissatisfied with a purchased product, they may express their requests for the product via WEB (World Wide Web) sites or SNS (Social Networking Service) in order to purchase a better product.

[0005] In order for stores and producers to gather such consumer feedback and requests, they must access the websites and social media sites to which consumers have registered to gather the information they want. However, sifting through a huge amount of information to select only the information they need is a time-consuming task. Summary of the Invention [Problem to be solved by the invention]

[0006] An object of the present invention is to provide an information processing device and a program that can easily obtain a customer's desire for a product in the customer's own words. [Means for solving the problem]

[0007] The information processing device according to the embodiment includes an acquisition unit, an analysis unit, and a transmission unit. The acquisition unit acquires a customer's request for a product in association with information identifying the product that is the subject of the request. The analysis unit A first table that defines an association between a product and an attribute of the product, and a second table that defines an association between the attribute and a keyword included in a customer's request, Acquired by the Acquisition Department , for the product The keywords included in the request From the second table Extract the keywords, Identify which attribute of the product it belongs to by referring to the first table. The transmission unit transmits the analysis result by the analysis unit to a destination associated with the product. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a system configuration diagram showing an example of the configuration of a request analysis system according to an embodiment. [Diagram 2] FIG. 2 is a hardware block diagram illustrating an example of a hardware configuration of the store server according to the embodiment. [Diagram 3] FIG. 3 is a hardware block diagram illustrating an example of a hardware configuration of the mobile terminal according to the embodiment. [Figure 4] FIG. 4 is a functional block diagram illustrating an example of a functional configuration of the store server according to the embodiment. [Diagram 5] FIG. 5 is a functional block diagram illustrating an example of a functional configuration of the mobile terminal according to the embodiment. [Figure 6] FIG. 6 is a diagram showing an example of a screen showing a result of object recognition, which is displayed on the mobile terminal. [Figure 7] FIG. 7 is a diagram showing an example of a screen showing product information of a recognized product. [Figure 8] FIG. 8 is a diagram showing an example of a screen showing a request input by voice. [Figure 9] FIG. 9 is a diagram showing an example of words to be registered for analyzing requests. [Figure 10] FIG. 10 is a diagram showing an example of a result of analyzing requests. [Figure 11] FIG. 11 is a diagram showing an example of a list of producers to which requests are to be sent. [Figure 12]FIG. 12 is a flowchart illustrating an example of a flow of processing performed by the mobile terminal according to the embodiment. [Figure 13] FIG. 13 is a flowchart showing an example of the flow of a request input process performed by the mobile terminal. [Figure 14] FIG. 14 is a flowchart showing an example of the flow of the product registration process and the payment process performed by the mobile terminal. [Figure 15] FIG. 15 is a flowchart illustrating an example of the flow of processing performed by the store server according to the embodiment. [Figure 16] FIG. 16 is a flowchart showing an example of the flow of the need recognition process performed by the store server. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] (Embodiment) A need analysis system 10 according to an embodiment of the present invention will be described.

[0010] (Overall configuration of the request analysis system) First, the overall configuration of a request analysis system 10 will be described with reference to Fig. 1. Fig. 1 is a system configuration diagram showing an example of the configuration of a request analysis system according to a first embodiment.

[0011] The need analysis system 10 includes a store server 12, a mobile terminal 14, and a producer server 16.

[0012] The store server 12 is connected to the mobile terminal 14 via wireless communication. The store server 12 acquires payment information indicating the details of the payment made on the mobile terminal 14 from the mobile terminal 14. The store server 12 also acquires the request for the product input by the customer on the mobile terminal 14. The store server 12 then analyzes the content of the request for the product input by the customer. The store server 12 also transmits the analysis result of the request to a destination associated with the manufacturer of the corresponding product. The store server 12 is an example of an information processing device in the present disclosure.

[0013] The mobile terminal 14 is carried by a customer who is a registered member of the store, and when the customer purchases a product at the store, the mobile terminal 14 functions as a so-called smartphone POS (Point Of Sales) to make a payment for the purchased product. The mobile terminal 14 also accepts input of requests for the product selected by the customer based on the customer's operation. The product may be selected by taking an image of the product for which a request is to be input using a camera provided in the mobile terminal 14, or by connecting the mobile terminal 14 to the Internet and searching for information by entering keywords, etc.

[0014] The customer may then speak his / her request for the selected product into the mobile terminal 14 or input the request as text using the touch panel of the mobile terminal 14.

[0015] The producer server 16 is communicatively connected to the store server 12 and acquires from the store server 12 the demand for a product analyzed by the store server 12 in association with the product.

[0016] (Store server hardware configuration) Next, the hardware configuration of the store server 12 will be described with reference to Fig. 2. Fig. 2 is a hardware block diagram showing an example of the hardware configuration of the store server according to the embodiment.

[0017] The store server 12 includes a control unit 21, a storage unit 22, an input / output controller 24, and a communication interface 25.

[0018] The control unit 21 has a typical computer configuration including a CPU (Central Processing Unit) 21a, a ROM (Read Only Memory) 21b, and a RAM (Random Access Memory) 21c. The CPU 21a reads out various programs, data files, etc. stored in the ROM 21b and a storage unit 22 (described later) and loads them in the RAM 21c. The CPU 21a operates according to the various programs, data files, etc. loaded in the RAM 21c, and controls the entire store server 12.

[0019] The control unit 21 is connected to a storage unit 22, an input / output controller 24, and a communication interface 25 via an internal bus 23.

[0020] The storage unit 22 retains stored information even when the power is turned off. The storage unit 22 is, for example, a hard disk drive (HDD). Instead of the HDD, a non-volatile memory such as a flash memory may be provided. The storage unit 22 stores programs including a control program P1. The control program P1 is a program for implementing the functions of the store server 12.

[0021] The control program P1 may be provided by being pre-installed in the ROM 21b. The control program P1 may be provided by being recorded in a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD) in a format that can be installed in the control unit 21 or in a format that can be executed. The control program P1 may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. The control program P1 may be provided or distributed via a network such as the Internet.

[0022] The storage unit 22 further stores a product master M, a sales file F, an object recognition dictionary D1, a voice recognition dictionary D2, a syntax analysis dictionary D3, a keyword file K, a request analysis file T, and a destination file U.

[0023] The product master M is a master file that stores product information such as product names and unit prices in association with product codes. The product master M is updated as needed according to the products arriving at the store by communicating with a higher-level server (not shown) connected to the store server 12.

[0024] Sales file F is a file that stores detailed information on sales for each payment. Sales file F includes at least identification information for identifying the customer, the purchase date of the product, product identification information for uniquely identifying the product, the number of purchases, the unit price, the total amount excluding tax, the total amount including tax, and the payment method. The payment method refers to the payment method such as electronic money payment, credit card payment, etc.

[0025] The object recognition dictionary D1 is a dictionary in which external appearance features of products are registered, and which are used to uniquely identify a product shown in a product image transmitted from the mobile terminal 14.

[0026] The voice recognition dictionary D2 is a variety of dictionaries used to recognize voice input by a customer and transmitted from the mobile terminal 14. In order to perform voice recognition, an acoustic model, a word model, and a language model are generally used. The acoustic model is a model for extracting phonemes from the input voice signal. The word model is a model for identifying words from combinations of phonemes extracted using the acoustic model. The language model is a model for completing sentences by analyzing connections between identified words.

[0027] The syntactic analysis dictionary D3 is a dictionary used to analyze the structure of a sentence that has been speech-recognized. Grammar rules are generally used to perform syntactic analysis.

[0028] The keyword file K is a file that stores various words that are expected to be included in the customer's requests. Details will be described later.

[0029] The request analysis file T is a file that stores the results of an analysis of the types of words contained in the customer's request and their frequency of appearance, etc. The details will be described later.

[0030] The destination file U is a file that stores the destination of the request analysis file T in association with the product. Details will be described later.

[0031] The input / output controller 24 connects the control unit 21 to a monitor 26, a touch panel 27, and a keyboard 28, which are input / output devices.

[0032] The monitor 26 displays various types of image information output by the store server 12 .

[0033] The touch panel 27 and the keyboard 28 are used to input various types of operation information to the store server 12 .

[0034] The communication interface 25 establishes a wireless connection with the mobile terminal 14. The store server 12 receives customer authentication information and payment information from the mobile terminal 14. The store server 12 also acquires product requests input by the customer from the mobile terminal 14. The communication interface 25 also establishes a wireless connection with the producer server 16. The store server 12 transmits the request analysis file T to the producer server 16 associated with the product included in the request analysis file T.

[0035] (Mobile device hardware configuration) Next, the hardware configuration of the mobile terminal 14 will be described with reference to Fig. 3. Fig. 3 is a hardware block diagram showing an example of the hardware configuration of the mobile terminal of the embodiment.

[0036] The mobile terminal 14 includes a control unit 31, a storage unit 32, an input / output controller 34, and a communication interface 35.

[0037] The control unit 31 has a typical computer configuration including a CPU 31a, a ROM 31b, and a RAM 31c. The CPU 31a reads out various programs, data files, and the like stored in the ROM 31b and a storage unit 32 (described later), and loads them in the RAM 31c. The CPU 31a operates according to the various programs, data files, and the like loaded in the RAM 31c, and controls the entire mobile terminal 14.

[0038] The control unit 31 is connected to a storage unit 32 , an input / output controller 34 , and a communication interface 35 via an internal bus 33 .

[0039] The storage unit 32 retains stored information even when the power is turned off. The storage unit 32 is, for example, a HDD. Instead of the HDD, a non-volatile memory such as a flash memory may be provided. The storage unit 32 stores programs including the control program P2. The control program P2 is a program for implementing functions provided in the mobile terminal 14.

[0040] The storage unit 32 further stores a product registration file R and a payment file S.

[0041] The product registration file R is a file in which products purchased by customers are registered. The product registration file R includes at least product identification information that uniquely identifies the product, the number of products purchased, the unit price, and the total price excluding tax.

[0042] The payment file S is a file that registers payment details related to products purchased by customers. The payment file S includes at least identification information for identifying the customer, the purchase date of the product, product identification information for uniquely identifying the product, the number of purchases, the unit price, the total amount excluding tax, the total amount including tax, and the payment method.

[0043] The input / output controller 34 connects the control unit 31 to input / output devices, such as a monitor 36, a touch panel 37, a camera 38, and a microphone 39.

[0044] The monitor 36 displays various types of image information output by the mobile terminal 14 .

[0045] The touch panel 37 inputs various types of operation information to the mobile terminal 14. The touch panel 37 is assigned with a number of buttons, such as a closing button for instructing the start of a settlement process when, for example, the registration of all products to be purchased by a customer is completed.

[0046] The camera 38 reads a code symbol such as a barcode attached to a product when a customer registers the product to be purchased. The camera 38 is a sensor built into the mobile terminal 14 and using an imaging element such as a CCD or CMOS.

[0047] The microphone 39 detects the speech of the customer and converts it into a voice signal. The converted voice signal is temporarily stored in the mobile terminal 14.

[0048] The communication interface 35 establishes wireless communication between the mobile terminal 14 and the store server 12. The communication interface 35 also connects the mobile terminal 14 to the Internet.

[0049] (Store server functional configuration) Next, the functional configuration of the store server 12 will be described with reference to Fig. 4. Fig. 4 is a functional block diagram showing an example of the functional configuration of the store server according to the embodiment.

[0050] The control unit 21 of the store server 12 deploys the control program P1 in RAM 21c and runs it to realize, as functional units, a communication connection unit 41, a customer information acquisition unit 42, an input information acquisition unit 43, an object recognition unit 44, a voice recognition unit 45, a text analysis unit 46, a recognition result transmission unit 47, a recognition confirmation result acquisition unit 48, a request analysis unit 49, a request transmission unit 50, and a purchase information acquisition unit 51 shown in FIG. 4.

[0051] The communication connection unit 41 establishes wireless communication with the mobile terminal 14 .

[0052] The customer information acquisition unit 42 performs an authentication process to authenticate that the customer is a member of the store by reading the customer information transmitted from the mobile terminal 14. Specifically, when a customer enters the store, the camera 38 of the mobile terminal 14 reads a code symbol such as a QR code (registered trademark) installed at the entrance of the store. If the authentication process is successful, the store server 12 and the mobile terminal 14 are wirelessly connected. Then, the customer information reading unit 52 reads the customer information (e.g., a customer ID) stored in the mobile terminal 14.

[0053] The input information acquisition unit 43 acquires a customer's request for a product in association with information identifying the product that is the subject of the request. Specifically, the input information acquisition unit 43 acquires from the mobile terminal 14 an image of the product that is the subject of the request and the customer's request for the product acquired by the mobile terminal 14. The customer's request may be a voice signal uttered by the customer, or may be text information input by the customer to the mobile terminal 14. The product image may be text information including a product name, etc., that can uniquely identify the product. The input information acquisition unit 43 is an example of an acquisition unit in the present disclosure.

[0054] The object recognition unit 44 uses the object recognition dictionary D1 to uniquely identify a product shown in an image transmitted from the mobile terminal 14. The identified result is output as, for example, a product code or a product name.

[0055] The voice recognition unit 45 recognizes the customer's voice transmitted from the mobile terminal 14 by using the voice recognition dictionary D2.

[0056] The text analysis unit 46 performs so-called dictation, which is to transcribe the customer's request recognized by the voice recognition unit 45 into a sentence by syntactic analysis.

[0057] The recognition result transmission unit 47 transmits the recognition results of the object recognition unit 44 and the voice recognition unit 45 to the mobile terminal 14 .

[0058] The recognition confirmation result acquisition unit 48 acquires the customer's confirmation result in response to the recognition result transmitted by the recognition result transmission unit 47 to the mobile terminal 14 .

[0059] The request analysis unit 49 analyzes the frequency of occurrence of preset words included in the customer's request for each product. Note that the request analysis unit 49 is an example of the analysis unit in this disclosure.

[0060] The request sending unit 50 sends the analysis result by the request analysis unit 49 to a destination associated with the product. Note that the request sending unit 50 is an example of a sending unit in the present disclosure.

[0061] The purchase information acquisition unit 51 acquires the results of the customer's registration of the product to be purchased and the payment performed by the mobile terminal 14. More specifically, the purchase information acquisition unit 51 acquires the product registration file R and the payment file S from the mobile terminal 14 when the payment is completed.

[0062] (Functional configuration of mobile terminal) Next, the functional configuration of the mobile terminal 14 will be described with reference to Fig. 5. Fig. 5 is a functional block diagram showing an example of the functional configuration of the mobile terminal according to the embodiment.

[0063] The control unit 31 of the mobile terminal 14 deploys the control program P2 in RAM 21c and operates it to realize, as functional units, a communication connection unit 61, a customer information transmission unit 62, an image acquisition unit 63, an information search unit 64, a voice acquisition unit 65, a text information acquisition unit 66, an input information transmission unit 67, a recognition result acquisition unit 68, a recognition result confirmation unit 69, a recognition confirmation result transmission unit 70, a code symbol reading unit 71, a product registration processing unit 72, a payment processing unit 73, a purchase information transmission unit 74, a display control unit 75, and an operation control unit 76 shown in FIG. 5.

[0064] The communication connection unit 61 establishes wireless communication with the store server 12 .

[0065] The customer information transmitting unit 62 transmits customer information (for example, a customer ID) to the store server 12 for authentication.

[0066] The image acquisition unit 63 acquires an image of the requested product by the camera 38.

[0067] The information search unit 64 searches the Internet or the like for the desired product.

[0068] The voice acquisition unit 65 acquires the customer's request for the product as a voice signal by the microphone 39.

[0069] The text information acquiring unit 66 acquires the customer's request for the product, which is input via the touch panel 37, as text information.

[0070] The input information transmitting unit 67 transmits the product image and the voice signal or text information acquired by the mobile terminal 14 to the store server 12 .

[0071] The recognition result acquisition unit 68 acquires, from the store server 12, the recognition results of the product images obtained by the object recognition unit 44 and the recognition results of the customer's speech obtained by the voice recognition unit 45 and the text analysis unit 46.

[0072] The recognition result confirmation unit 69 displays the recognition result acquired by the recognition result acquisition unit 68 on the monitor 36. Then, the recognition result confirmation unit 69 requests the customer to confirm the recognition result. Then, the recognition result confirmation unit 69 acquires the confirmation result of the customer.

[0073] The recognition confirmation result transmission unit 70 transmits the recognition result confirmed by the recognition result confirmation unit 69 to the store server 12 .

[0074] The code symbol reading unit 71 uses the camera 38 to read a code symbol such as a barcode attached to an item purchased by a customer.

[0075] The product registration processing unit 72 uniquely identifies the product purchased by the customer by comparing the product code recorded in the code symbol read by the code symbol reading unit 71 with the product master M. Then, the product registration processing unit 72 registers the uniquely identified product as a purchased product and generates a product registration file R. The product registration processing unit 72 transmits the product code to the store server 12, and the store server 12 compares the product code with the product master M. Then, the mobile terminal 14 obtains the comparison result from the store server 12.

[0076] The payment processing unit 73 performs payment for the products registered at that time when, for example, it detects that the closing button on the touch panel 37 has been pressed. Then, the payment processing unit 73 generates a payment file S.

[0077] The purchase information transmission unit 74 transmits the product registration file R generated by the product registration processing unit 72 and the payment file S generated by the payment processing unit 73 to the store server 12.

[0078] The display control unit 75 outputs to the monitor 36 image information corresponding to the processes performed by the above-mentioned units.

[0079] The operation control unit 76 detects an operation performed on the touch panel 37 and causes the mobile terminal 14 to perform control in accordance with the operation.

[0080] (How to enter your product requirements) Next, a method for inputting a request for a product will be described with reference to Fig. 6 to Fig. 8. Fig. 6 is an example of a screen showing the result of object recognition displayed on a mobile terminal. Fig. 7 is an example of a screen showing product information of a recognized product. Fig. 8 is an example of a screen showing a request input by voice.

[0081] The customer searches for a product for which he / she wishes to input a request in the store, and takes an image of the product with the camera 38 of the mobile terminal 14. The image acquisition unit 63 of the mobile terminal 14 acquires the captured image. Then, the input information transmission unit 67 transmits the product image acquired by the mobile terminal 14 to the store server 12.

[0082] The input information acquisition unit 43 of the store server 12 acquires an image of a product transmitted from the mobile terminal 14. Then, the object recognition unit 44 performs object recognition on the image acquired by the input information acquisition unit 43 to uniquely identify the product. Then, the recognition result transmission unit 47 transmits the recognition result by the object recognition unit 44 to the mobile terminal 14.

[0083] The recognition result acquisition unit 68 of the mobile terminal 14 acquires the recognition result of the product image by the object recognition unit 44 from the store server 12. Then, the recognition result confirmation unit 69 causes the display control unit 75 to display the product selection screen 36a shown in FIG. 6 on the monitor 36 of the mobile terminal 14.

[0084] On the product selection screen 36a, a product image 80, a product candidate list 81, a confirm button 82, and an end button 83 are displayed.

[0085] The customer selects the correct candidate from among the product candidates displayed in the product candidate list 81. The operation control unit 76 detects the selected product by detecting the customer's operation on the touch panel 37. The operation control unit 76 then uniquely determines the product by detecting that the decision button 82 has been pressed. Thereafter, when the display control unit 75 detects that the end button 83 has been pressed, it erases the product selection screen 36a. The recognition confirmation result transmission unit 70 then transmits the uniquely determined product name to the store server 12.

[0086] The customer can obtain various information related to the uniquely determined product by connecting the mobile terminal 14 to the Internet. Fig. 7 shows an example of a product information screen 36b thus displayed on the monitor 36 of the mobile terminal 14.

[0087] The product information screen 36b displays a product image 80, product information 84, a request input button 85, and an end button 83. Note that above the product image 80, a uniquely determined product name is displayed.

[0088] The customer can view various information displayed in the product information 84. If the customer wishes to input a request for the uniquely determined product, the customer presses the request input button 85. When the operation control unit 76 detects that the request input button 85 has been pressed, the display control unit 75 displays the request input screen 36c shown in Fig. 8 on the monitor 36. When the end button 83 is pressed on the product information screen 36b, it is determined that there is no intention to input a request, and the mobile terminal 14 ends the process.

[0089] On the request input screen 36c, a product image 80, a start button 86, an end button 83, a request display window 87, a complete button 88, and a re-input button 89 are displayed.

[0090] When the start button 86 is pressed, the voice acquisition unit 65 acquires the customer's request for the product as a voice signal via the microphone 39. The voice acquisition unit 65 continues acquiring the voice signal until the end button 83 is pressed.

[0091] When the end button 83 is pressed, the input information transmitting unit 67 transmits the acquired voice signal to the store server 12.

[0092] The input information acquisition unit 43 of the store server 12 acquires a voice signal transmitted from the mobile terminal 14. Then, the voice recognition unit 45 performs voice recognition on the voice signal acquired by the input information acquisition unit 43. Then, the text analysis unit 46 transcribes the result of recognition by the voice recognition unit 45 into a sentence by syntactic analysis. Thereafter, the recognition result transmission unit 47 transmits the recognition result by the voice recognition unit 45 and the text analysis unit 46 to the mobile terminal 14.

[0093] The recognition result acquisition unit 68 of the mobile terminal 14 acquires the recognition result of the voice signal by the voice recognition unit 45 and the text analysis unit 46 from the store server 12. Then, the recognition result confirmation unit 69 causes the display control unit 75 to display the recognition result in the request display window 87.

[0094] If the recognition result displayed in the request display window 87 is correct, the customer presses the Complete button 88. When the operation control unit 76 detects that the Complete button 88 has been pressed, the display control unit 75 erases the request input screen 36c. Then, the recognition confirmation result transmission unit 70 transmits to the store server 12 a message indicating that the recognition result of the voice signal is correct.

[0095] If the recognition result displayed in the request display window 87 is incorrect, the customer presses the re-input button 89. When the re-input button 89 is pressed, the recognition result displayed in the request display window 87 is erased, and voice input becomes possible again. The customer then presses the start button 86 again to speak the request for the product. The above-mentioned process is then repeated.

[0096] Although not shown in the figure, the customer's request may be entered by text input. Also, if an error occurs in the voice recognition, the customer may correct the recognition result displayed in the request display window 87 by editing the text.

[0097] (Method of analyzing product demand) Next, a method for analyzing product demand will be described with reference to Figures 9 and 10. Figure 9 is a diagram showing an example of words to be registered for demand analysis. Figure 10 is a diagram showing an example of the demand analysis result.

[0098] The words registered for analyzing customer requests are registered in the above-mentioned keyword file K. The keyword file K includes an attribute file Ka shown in Fig. 9(a) and a word file Kb shown in Fig. 9(b).

[0099] The attribute file Ka is a file in which word attributes are registered for each product. In the attribute file Ka, a product code 90, a product name 91, and a keyword attribute 92 are registered in association with each other.

[0100] The word file Kb is a file in which specific words 93 corresponding to each attribute of a word are registered. In the word file Kb, keyword attributes 92 and specific words 93 are registered in association with each other. Note that the words 93 are an example of keywords in the present disclosure. Positive words and negative words are registered for each attribute 92 of the words 93. Note that a flag indicating a positive word and a flag indicating a negative word may be assigned to each word 93 registered in the word file Kb.

[0101] The request analysis unit 49 of the store server 12 extracts the words 93 registered in the word file Kb from the input customer requests. Furthermore, the request analysis unit 49 calculates the frequency of appearance of the words 93 by analyzing requests from multiple customers for the same product.

[0102] 10 shows an example of the analysis result by the request analysis unit 49. In the request analysis file T, as shown in FIG. 10, the results of analyzing a plurality of requests regarding the product 1 are stored.

[0103] In the demand analysis file T, product names 95 and analysis results 96 of demand for each product are stored in association with each other. The product names 95 store the product names that are the subject of demand. In order to facilitate data management, the product names are generally stored in the form of product codes.

[0104] The analysis result 96 stores the frequency of occurrence of a plurality of words 93 associated with each attribute, such as taste and price. Although not shown in Fig. 10, the number of customers who have made a request for each product may also be stored. Furthermore, the frequency of occurrence of positive words 93 and the frequency of occurrence of negative words 93 may be quantified.

[0105] (How to send product requests) Next, a method for sending a request for a product will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of a list of producers to which the request is to be sent.

[0106] The producer list is managed in a destination file U. In the destination file U, a producer code 97, a producer name 98, an email address 99, a telephone number 100, and a product name 101 are stored in association with each other.

[0107] The producer code 97 is an identification number that uniquely identifies each producer.

[0108] The producer name 98 is the name of the manufacturer of each producer.

[0109] Email address 99 is the email address to use when sending requests to each producer.

[0110] The telephone number 100 is the telephone number of each producer.

[0111] Product name 101 is the name of the product produced by each manufacturer. The product name is generally stored in the form of a product code.

[0112] The request sending unit 50 of the store server 12 periodically accesses the request analysis results stored in the request analysis file T, for example, once a month. The request sending unit 50 then compares and refers to the request analysis file T and the destination file U to identify the manufacturer of the product that is the subject of each request stored in the request analysis file T.

[0113] Then, the request sending unit 50 sends the analysis result 96 stored in the request analysis file T to the email address of the identified producer. Then, the request sending unit 50 resets the analysis result 96 that has been emailed to the producer, among the analysis results 96 in the request analysis file T.

[0114] (Processing flow of the request analysis system) Next, the flow of processing performed by the request analysis system 10 will be described with reference to FIGS.

[0115] (Processing flow performed by mobile devices) First, the flow of processing performed by the mobile terminal 14 will be described with reference to Fig. 12 to Fig. 14. Fig. 12 is a flowchart showing an example of the flow of processing performed by the mobile terminal of the embodiment. Fig. 13 is a flowchart showing an example of the flow of request input processing performed by the mobile terminal. Fig. 14 is a flowchart showing an example of the flow of product registration processing and payment processing performed by the mobile terminal.

[0116] First, the overall flow of the processing performed by the mobile terminal 14 will be described with reference to FIG.

[0117] The customer information transmitting unit 62 transmits customer information to the store server 12 that is wirelessly connected to the mobile terminal 14 (step S11).

[0118] When the customer information is authenticated, the communication connection unit 61 establishes a wireless connection between the mobile terminal 14 and the store server 12 (step S12).

[0119] Thereafter, the mobile terminal 14 performs a request input process to acquire a request from the customer (step S13). The request input process will be described in detail later (see FIG. 13).

[0120] Then, the mobile terminal 14 performs product registration processing and payment processing when the customer makes a purchase (step S14). The product registration processing and payment processing will be described in detail later (see FIG. 14).

[0121] The communication connection unit 61 determines whether the wireless connection between the mobile terminal 14 and the store server 12 can be maintained (step S15). If it is determined that the wireless connection between the mobile terminal 14 and the store server 12 can be maintained (step S15: Yes), the process returns to step S13. On the other hand, if it is not determined that the wireless connection between the mobile terminal 14 and the store server 12 can be maintained (step S15: No), the process proceeds to step S16.

[0122] If it is determined in step S15 that the wireless connection between the mobile terminal 14 and the store server 12 cannot be maintained, the communication connection unit 61 disconnects the wireless connection between the mobile terminal 14 and the store server 12 (step S16). After that, the mobile terminal 14 ends the process of FIG.

[0123] (Flow of request input processing on a mobile device) Next, the flow of a request input process performed by the mobile terminal 14 will be described with reference to FIG.

[0124] The image acquisition unit 63 captures an image of the requested product using the camera 38 of the mobile terminal 14 (step S21).

[0125] The input information transmitting unit 67 transmits the image of the product acquired by the mobile terminal 14 to the store server 12 (step S22).

[0126] The recognition result acquisition unit 68 acquires from the store server 12 the recognition result of the product image by the object recognition unit 44 of the store server 12 (step S23).

[0127] The recognition result confirmation unit 69 judges whether the product recognition result is correct (step S24). Specifically, the recognition result confirmation unit 69 displays the product recognition result acquired by the recognition result acquisition unit 68 on the monitor 36, and requests the customer to confirm the recognition result (see FIG. 6). Then, the recognition result confirmation unit 69 acquires the customer's confirmation result. If it is judged in step S24 that the product recognition result is correct (step S24: Yes), the process proceeds to step S25. On the other hand, if it is not judged that the product recognition result is correct (step S24: No), the process proceeds to step S26.

[0128] If it is determined in step S24 that the recognition result of the commodity is not correct, the operation control unit 76 prompts the customer to select from the commodity candidate list 81 (see FIG. 6) (step S26), and then proceeds to step S25.

[0129] If it is determined in step S24 that the product recognition result is correct, or if a product is selected from the product candidate list 81 in step S26, the recognition confirmation result transmission unit 70 transmits the confirmation result to the store server 12 (step S25).

[0130] Next, the voice acquisition unit 65 acquires the customer's request for the product as a voice signal through the microphone 39 of the mobile terminal 14 (step S27).

[0131] The input information transmitting unit 67 transmits the acquired voice signal to the store server 12 (step S28).

[0132] The recognition result acquisition unit 68 acquires the recognition results of the customer's speech by the voice recognition unit 45 and the text analysis unit 46 from the store server 12 (step S29).

[0133] The recognition result confirmation unit 69 judges whether the recognition result of the customer's request is correct (step S30). Specifically, the recognition result confirmation unit 69 displays the recognition result of the customer's request acquired by the recognition result acquisition unit 68 on the monitor 36, and requests the customer to confirm the recognition result (see FIG. 8). Then, the recognition result confirmation unit 69 acquires the customer's confirmation result. If it is judged in step S30 that the recognition result of the customer's request is correct (step S30: Yes), the process proceeds to step S31. On the other hand, if it is not judged that the recognition result of the customer's request is correct (step S30: No), the process returns to step S27 to have the customer re-enter the request. The recognition result of the customer's request being correct is judged, for example, by pressing the Complete button 88 shown in FIG. 8.

[0134] If it is determined in step S30 that the recognition result of the customer's request is correct, the recognition confirmation result transmission unit 70 transmits to the store server 12 a message indicating that the recognition result of the customer's request is correct (step S31). Then, the process returns to step S14 in FIG.

[0135] (Flow of product registration and payment processing on mobile devices) Next, the flow of the product registration process and the payment process performed by the mobile terminal 14 will be described with reference to FIG.

[0136] The code symbol reading unit 71 reads a code symbol such as a barcode attached to a product to be purchased by a customer (step S41).

[0137] The product registration processing unit 72 uniquely identifies the product purchased by the customer by comparing the product code recorded in the code symbol read by the code symbol reading unit 71 with the product master M. Then, the product registration processing unit 72 registers the uniquely identified product as a purchased product (step S42). More specifically, the product registration processing unit 72 transmits the code symbol read by the code symbol reading unit 71 to the store server 12. Then, the store server 12 compares the product code with the product master M to uniquely identify the product. Then, the product registration processing unit 72 performs product registration by receiving the uniquely identified product information from the store server 12. The registered product information is stored in the product registration file R. The mobile terminal 14 may obtain the product master M from the store server 12 and identify the product within the mobile terminal 14.

[0138] The operation control unit 76 determines whether the tightening button assigned to the touch panel 37 has been pressed (step S43). If it is determined that the tightening button has been pressed (step S43: Yes), the process proceeds to step S44. On the other hand, if it is determined that the tightening button has not been pressed (step S43: No), the process returns to step S41.

[0139] When it is determined in step S43 that the closing button has been pressed, the payment processing unit 73 performs a payment process for the product registered by the product registration processing unit 72 (step S44). The result of the payment process is recorded in the payment file S.

[0140] The purchase information transmission unit 74 transmits the product registration file R and the settlement file S to the store server 12 (step S45). After that, the process returns to step S15 in FIG.

[0141] (Processing flow performed by the store server) Next, the flow of processing performed by the store server 12 will be described with reference to Fig. 15. Fig. 15 is a flow chart showing an example of the flow of processing performed by the store server of the embodiment.

[0142] The customer information acquisition unit 42 acquires the customer information transmitted from the mobile terminal 14 (step S51).

[0143] The customer information acquisition unit 42 determines whether the customer is a member of the store based on the acquired customer information (step S52). If it is determined that the customer is a member of the store, that is, the authentication is OK (step S52: Yes), the process proceeds to step S53. On the other hand, if the customer is not determined to be a member of the store, that is, the authentication is not OK (step S52: No), the process returns to step S51.

[0144] If it is determined in step S52 that the user is a member of the store, the communication connection unit 41 establishes a wireless connection between the store server 12 and the mobile terminal 14 (step S53).

[0145] Next, the store server 12 performs a request recognition process to recognize the request of the customer inputted via the mobile terminal 14 (step S54). The request recognition process will be described in detail later (see FIG. 16).

[0146] The request analysis unit 49 analyzes the frequency of occurrence of preset words included in the customer's request for each product (step S55).

[0147] The request sending unit 50 sets a destination to which the analysis result of the request by the request analyzing unit 49 is sent (step S56).

[0148] The request transmission unit 50 transmits the analysis result of the request to the destination set in step S56 (step S57).

[0149] The purchase information acquisition unit 51 determines whether the product registration file R and the payment file S have been acquired from the mobile terminal 14 (step S58). If it is determined that the product registration file R and the payment file S have been acquired (step S58: Yes), the process proceeds to step S59. On the other hand, if it is determined that the product registration file R and the payment file S have not been acquired (step S58: No), the process proceeds to step S60.

[0150] When it is determined in step S58 that the product registration file R and the settlement file S have been acquired, the purchase information acquisition unit 51 generates a sales file F (step S59).

[0151] The communication connection unit 41 determines whether the wireless connection between the store server 12 and the mobile terminal 14 can be maintained (step S60). If it is determined that the wireless connection between the store server 12 and the mobile terminal 14 can be maintained (step S60: Yes), the process returns to step S54. On the other hand, if it is not determined that the wireless connection between the store server 12 and the mobile terminal 14 can be maintained (step S60: No), the process proceeds to step S61.

[0152] If it is determined in step S60 that the wireless connection between the store server 12 and the mobile terminal 14 cannot be maintained, the communication connection unit 41 disconnects the wireless connection between the store server 12 and the mobile terminal 14 (step S61). Then, the store server 12 ends the process of FIG.

[0153] (Flow of request recognition process performed by store server) Next, the flow of the need recognition process performed by the store server 12 will be described with reference to FIG.

[0154] The input information acquisition unit 43 receives an image of a product photographed by the mobile terminal 14 (step S71).

[0155] The object recognition unit 44 performs object recognition on the product image received in step S71 (step S72).

[0156] The recognition result transmission unit 47 transmits the result of the object recognition to the mobile terminal 14 (step S73).

[0157] The recognition confirmation result acquisition unit 48 receives the customer's confirmation result regarding the product recognition result from the mobile terminal 14 (step S74).

[0158] Next, the input information acquiring unit 43 receives the customer's voice signal acquired by the mobile terminal 14 (step S75).

[0159] The voice recognition unit 45 performs voice recognition on the acquired voice signal (step S76).

[0160] The text analysis unit 46 executes text analysis to transcribe the customer's request recognized by the voice recognition unit 45 into a sentence (step S77).

[0161] The recognition result transmission unit 47 transmits the results of the processing performed by the voice recognition unit 45 and the text analysis unit 46 to the mobile terminal 14 (step S78).

[0162] The recognition confirmation result acquisition unit 48 receives the requested confirmation result from the mobile terminal 14 (step S79). After that, the process returns to step S55 in FIG.

[0163] Here, the configuration has been described in which the image and voice signals acquired by the mobile terminal 14 are transmitted to the store server 12, and the store server 12 performs object recognition, voice recognition, and text analysis. However, by configuring the engines that perform various recognition processes, the object recognition dictionary D1, the voice recognition dictionary D2, and the syntax analysis dictionary D3 in a compact manner, these engines and dictionaries may be implemented in the mobile terminal 14. By adopting such a configuration, it may be possible to configure the mobile terminal 14 to recognize the customer's request.

[0164] As described above, in the store server 12 (information processing device) of the embodiment, the input information acquisition unit 43 (acquisition unit) acquires customer requests for products in association with information specifying the product that is the subject of the request (for example, an image, product code, or product name of the product). Then, the request analysis unit 49 (analysis unit) analyzes the requests acquired by the input information acquisition unit 43 for each product based on whether or not a preset keyword is included in the request. The request transmission unit 50 (transmission unit) transmits the analysis results by the request analysis unit 49 to a destination associated with the product (for example, the manufacturer of the product). Therefore, the product and the customer request for the product can be associated and easily acquired in a format desired by the manufacturer.

[0165] In the store server 12 (information processing device) according to the embodiment, the input information acquisition unit 43 (acquisition unit) acquires a customer's request for a product in association with an image of the requested product taken by the customer's mobile terminal 14. Therefore, the store server 12 can recognize the product by performing object recognition, for example, and can easily and reliably uniquely identify the requested product.

[0166] In addition, in the store server 12 (information processing device) of the embodiment, the request analysis unit 49 (analysis unit) calculates the number of occurrences of words 93 (keywords) included in the request for the product. Therefore, the approximate content of the customer's request can be detected by simple processing.

[0167] In addition, in the store server 12 (information processing device) of the embodiment, the request analysis unit 49 (analysis unit) calculates the occurrence number of each positive keyword and negative keyword included in the request for the product. Therefore, it is possible to easily determine whether the request is a positive one or a negative one based on the calculated occurrence number of the keywords. This can improve the efficiency of sorting out a large number of requests.

[0168] In addition, in the store server 12 (information processing device) according to the embodiment, the input information acquisition unit 43 (acquisition unit) acquires the customer's request by voice. Therefore, even if the customer is unfamiliar with information devices, he or she can easily convey the customer's request regarding the product.

[0169] Although the embodiment of the present invention has been described above, this embodiment is merely an example and is not intended to limit the scope of the invention. This novel embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0170] 10...request analysis system, 12...store server (information processing device), 14...mobile terminal, 16...producer server, 21,31...control unit, 22,32...memory unit, 24,34...input / output controller, 25,35...communication interface, 36...monitor, 36a...product selection screen, 36b...product information screen, 36c...request input screen, 38...camera, 39...microphone, 41,61...communication connection unit, 42...customer information acquisition unit, 43...input information acquisition unit (acquisition unit), 44...object recognition unit, 45...voice recognition unit, 46...text analysis unit, 47...recognition result transmission unit, 48...recognition confirmation result acquisition unit, 49...request analysis unit (analysis unit), 50...request transmission unit (transmission unit), 51...purchase information acquisition unit, 62...customer information transmission unit, 63...image acquisition unit, 64...information search unit, 65...voice acquisition unit, 66...text information acquisition unit, 67...input information transmission unit, 68...recognition result acquisition unit, 69...recognition result confirmation unit, 70...recognition confirmation result transmission unit, 71...code symbol reading unit, 72...product registration processing unit, 73...payment processing unit, 74...purchase information transmission unit, 75...display control unit, 76...operation control unit, 92...attributes, 93...words (keywords), D1...object recognition dictionary, D2...voice recognition dictionary, D3...syntax analysis dictionary, F...sales file, K...keyword file, Ka...attribute file, Kb...word file, P1, P2...control program, R...product registration file, S...payment file, T...request analysis file, U...destination file [Prior art documents] [Patent documents]

[0171] [Patent Document 1] JP 2017-62672 A

Claims

1. an acquisition unit that acquires a customer's request for a product in association with information that identifies the product that is the subject of the request; an analysis unit having a first table that defines the association between a product and an attribute of the product, and a second table that defines the association between the attribute and a keyword included in a customer's request, the analysis unit extracting from the second table the keyword included in the request for the product acquired by the acquisition unit, specifying to which attribute of the product the extracted keyword belongs by referring to the first table, and analyzing the customer's request related to the attribute of the product; a transmission unit that transmits an analysis result by the analysis unit to a destination associated with the product; An information processing device comprising:

2. The acquisition unit is Acquire the customer's request for a product in association with an image of the product that is the subject of the request and that is photographed by the customer using a mobile terminal carried by the customer; The information processing device according to claim 1 .

3. The analysis unit includes: Calculating the number of occurrences of the keyword included in the request for the product; 3. The information processing device according to claim 1 or 2.

4. The analysis unit includes: Calculating the number of occurrences of each of positive keywords and negative keywords included in the request for the product; The information processing device according to claim 3 .

5. The acquisition unit acquires the customer's request by voice. The information processing device according to claim 1 .

6. Computer, an acquisition unit that acquires a customer's request for a product in association with information that identifies the product that is the subject of the request; an analysis unit having a first table that defines the association between a product and an attribute of the product, and a second table that defines the association between the attribute and a keyword included in a customer's request, the analysis unit extracting from the second table the keyword included in the request for the product acquired by the acquisition unit, specifying to which attribute of the product the extracted keyword belongs by referring to the first table, and analyzing the customer's request related to the attribute of the product; a transmission unit that transmits an analysis result by the analysis unit to a destination associated with the product; A program that makes it work.

Images