Information processing device, information processing system, and information processing program

Abstract

To enable intuitive recognition of the properties of a garment when a garment is introduced via a communication network.SOLUTION: An information processing device according to an embodiment comprises decision means, acquisition means, determination means, generation means and output means. The decision means determines one of a plurality of garments with known properties as a candidate garment in accordance with designation of a user. The acquisition means acquires an image containing a garment to be compared with the candidate garment determined by the decision means. The determination means determines the properties of the garment contained in the image on the basis of the image acquired by the acquisition means. The generation means generates comparison information that represents the known properties of the candidate garment determined by the decision means and the properties determined by the determination means in comparison with each other. The output means outputs the comparison information generated by the generation means for checking by the user.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] Embodiments of the present invention relate to an information processing apparatus, an information processing system, and an information processing program.

Background Art

[0002] When selling clothes through online shopping, the clothes being sold are introduced to users by presenting image information of the appearance of the clothes and character information guiding the properties of the clothes. Therefore, it has been difficult for users to intuitively recognize the properties of clothes. Under such circumstances, when introducing clothes via a communication network, it has been desired to enable users to intuitively recognize the properties of the clothes.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the present invention is to provide an information processing apparatus, an information processing system, and an information processing program that can enable users to intuitively recognize the properties of clothes when introducing clothes via a communication network.

Means for Solving the Problems

[0005] The information processing device of this embodiment comprises a determination means, an acquisition means, a judgment means, a generation means, and an output means. The determination means determines one of several garments whose properties are known as a candidate garment according to the user's specification. The acquisition means acquires an image in which the garment to be compared with the candidate garment determined by the determination means is reflected. The judgment means determines the properties of the garment reflected in the image based on the image acquired by the acquisition means. The generation means generates comparison information that compares the known properties of the candidate garment determined by the determination means with the properties determined by the judgment means. The output means outputs the comparison information generated by the generation means for the user to confirm. [Brief explanation of the drawing]

[0006] [Figure 1] A block diagram showing the schematic configuration of a sales processing system according to an embodiment, and the main circuit configurations of the sales processing device and user terminal included in this sales processing system. [Figure 2] A sequence diagram illustrating the data exchange flow between the sales processing device and the user terminal, the processing steps of the processor in the sales processing device, and the processing steps of the processor in the user terminal. [Figure 3] A diagram showing an example of the shooting screen for the first step. [Figure 4] A diagram showing an example of the shooting screen for the second step. [Figure 5] A diagram showing an example of the shooting screen for the third step. [Figure 6] A diagram showing an example of the shooting screen for the fourth step. [Figure 7] A diagram showing an example of the shooting screen for the fifth step. [Figure 8] A diagram illustrating an example of a comparison screen. [Figure 9] An example of an enlarged window. [Figure 10] A sequence diagram illustrating the data exchange flow between the sales processing device and the user terminal, the processing steps of the processor in the sales processing device, and the processing steps of the processor in the user terminal. [Modes for carrying out the invention]

[0007] The embodiments will be described below with reference to the drawings. In this embodiment, an example will be described in which the information processing system of the present invention is applied to a sales processing system that realizes online shopping for clothing. Figure 1 is a block diagram showing the schematic configuration of the sales processing system 100 according to this embodiment, and the main circuit configurations of the sales processing device 1 and user terminal 2 included in the sales processing system 100.

[0008] The sales processing system 100 is configured to enable communication between the sales processing device 1 and the user terminal 2 via a communication network 200. While any number of sales processing devices 1 and user terminals 2 can be included in the sales processing system 100, only one of each is shown in Figure 1. The communication network 200 can utilize the internet, VPN (virtual private network), LAN, public communication network, mobile communication network, etc., either individually or in appropriate combinations. As an example, the communication network 200 may be a combination of the internet and a mobile communication network.

[0009] The sales processing device 1 is an information processing device that uses the user terminal 2 as a user interface terminal and performs information processing to provide online shopping services to users operating the user terminal 2. The sales processing device 1 is implemented, for example, as a web server or a cloud server. User terminal 2 is an information processing terminal owned by the user mentioned above.

[0010] The sales processing device 1 includes a processor 11, a main storage unit 12, an auxiliary storage unit 13, a communication unit 14, and a transmission line 15, etc. The processor 11, the main storage unit 12, the auxiliary storage unit 13, and the communication unit 14 are able to communicate with each other via the transmission line 15.

[0011] By connecting the processor 11, the main memory unit 12, and the auxiliary memory unit 13 via a transmission line 15, a computer is configured to perform information processing to realize the functions of a sales processing device 1. The processor 11 corresponds to the central part of the computer described above. The processor 11 performs information processing to control each part in order to realize various functions as a sales processing device 1, in accordance with information processing programs such as the operating system and application programs.

[0012] The main memory unit 12 corresponds to the main memory portion of the computer described above. The main memory unit 12 includes a read-only memory area and a rewritable memory area. The main memory unit 12 stores a portion of the information processing program described above in the read-only memory area. The main memory unit 12 may also store data necessary for the processor 11 to perform processing to control each part in the read-only memory area or the rewritable memory area. The main memory unit 12 uses the rewritable memory area as a work area for the processor 11.

[0013] The auxiliary storage unit 13 corresponds to the auxiliary storage portion of the computer described above. The auxiliary storage unit 13 can utilize, for example, an EEPROM (electric erasable programmable read-only memory), an HDD (hard disk drive), an SSD (solid state drive), or various other well-known storage devices. The auxiliary storage unit 13 stores data used by the processor 11 in performing various processes and data generated by the processing performed by the processor 11. The auxiliary storage unit 13 may also store the above-mentioned information processing program. In this embodiment, the auxiliary storage unit 13 stores the sales processing program PRA, which is one of the information processing programs. The sales processing program PRA is an application program that describes the procedures for information processing to provide an online shopping service. A portion of the storage area of ​​the auxiliary storage unit 13 is used as an area for storing the page database DBA, the element database DBB, and the property database DBC. The page database DBA contains multiple page data that define each of multiple web pages. The element database DBB contains data on various objects such as images that make up the web pages. The properties database DBC contains properties data generated by pre-evaluating various properties of each garment that is a target product of the online shopping service. In this embodiment, the properties data represents evaluation values ​​for each of the following items: durability, heat retention, breathability, water absorption, elasticity, and stain resistance. These page database DBA, element database DBB, and properties database DBC are basically pre-generated according to the target products of the online shopping service and written to the auxiliary storage unit 13. The page database DBA, element database DBB, and properties database DBC may be updated in accordance with changes in the specifications of the online shopping service or changes in the products being sold.

[0014] The communication unit 14 executes communication processing for data communication via the communication network 200. The communication unit 14 can use, for example, an existing communication device for the Internet. Note that the access by the communication unit 14 to the communication network 200 may be either a wired access method or a wireless access method. The transmission path 15 includes an address bus, a data bus, control signal lines, etc., and transmits data and control signals exchanged between the connected components.

[0015] Now, as the basic hardware of the sales processing device 1, for example, a general-purpose server device can be used. And the transfer of the sales processing device 1 is generally carried out with the sales processing program PRA stored in the auxiliary storage unit 13. However, the hardware in a state where the sales processing program PRA is not stored in the auxiliary storage unit 13 or in a state where an application program of the same kind but different version is stored in the auxiliary storage unit 13, and the sales processing program PRA may be transferred individually. And, according to the operation of any operator, the sales processing device 1 may be configured by writing the sales processing program PRA into the auxiliary storage unit 13. The transfer of the sales processing program PRA can be carried out by recording it on a removable recording medium such as a magnetic disk, a magneto-optical disk, an optical disk, a semiconductor memory, etc., or by communication via a network.

[0016] The user terminal 2 includes a processor 21, a main storage unit 22, an auxiliary storage unit 23, a touch panel 24, a camera 25, a communication unit 26, a transmission path 27, etc. The processor 21 and the main storage unit 22, the auxiliary storage unit 23, the touch panel 24, the camera 25, and the communication unit 26 are communicable via the transmission path 27. And, by connecting the processor 21, the main storage unit 22, and the auxiliary storage unit 23 by the transmission path 27, a computer for performing information processing for realizing the function as the user terminal 2 is configured.

[0017] The functions of the processor 21, the main memory unit 22, the auxiliary memory unit 23, and the transmission path 27 are similar to those of the processor 11, the main memory unit 12, the auxiliary memory unit 13, and the transmission path 15, so their descriptions are omitted. However, the auxiliary memory unit 23 stores the shopping app PRB instead of the sales processing program PRA. The shopping app PRB is an application program that describes the information processing procedure for enabling the user to perform online shopping in cooperation with the sales processing device 1.

[0018] The touch panel 24 receives operations by the user in order to input various specifications by the user. The touch panel 24 displays various screens representing the information to be presented to the user. The camera 25 includes an optical system and an image sensor, and generates image data representing an image within the visual field formed by the optical system by the image sensor.

[0019] The communication unit 26 is an interface for data communication via the communication network 200. As the communication unit 26, for example, a well-known communication device for performing data communication via a mobile communication network can be used. Note that the access to the communication network 200 by the communication unit 26 may be either a wired access method or a wireless access method.

[0020] The basic hardware of user terminal 2 can be a handheld information and communication terminal such as a smartphone or tablet. Generally, user terminal 2 is transferred in a state where the shopping application PRB is not stored in the auxiliary storage unit 23. Then, the user terminal 2 is configured when the separately transferred shopping application PRB is written to the auxiliary storage unit 23 in response to an operation by any operator. The transfer of the shopping application PRB is typically performed via network communication. However, the transfer of the shopping application PRB may also be performed by recording it on a removable recording medium such as a magnetic disk, magneto-optical disk, optical disk, or semiconductor memory. Furthermore, the basic hardware of user terminal 2 may be an information processing device such as a desktop or notebook type.

[0021] [First Embodiment] Next, the operation of the first embodiment of the sales processing system 100 configured as described above will be explained. Note that the content of the various processes described below is merely an example, and it is possible to change the order of some processes, omit some processes, or add other processes as appropriate. For example, in the following explanation, some processes have been omitted in order to clearly illustrate the characteristic operation of this embodiment. For example, if an error occurs, processing to deal with that error may be performed, but such processing has been omitted from the description.

[0022] The operation of the sales processing device 1 and user terminal 2 for enabling users to conduct online shopping may be the same as, for example, the processing performed for existing online shopping. What is distinctive about the sales processing system 100 is its operation to introduce the products that the user is considering purchasing in an easy-to-understand manner. Therefore, the following explanation will focus on this distinctive operation.

[0023] Figure 2 is a sequence diagram illustrating the data exchange flow between the sales processing device 1 and the user terminal 2, the processing procedure of the processor 11 in the sales processing device 1, and the processing procedure of the processor 21 in the user terminal 2. Note that Figure 2 shows an overview of the processing, and some processing steps are omitted from the diagram. Furthermore, the processing procedure may differ depending on the user operation, but Figure 2 is an example corresponding to the operation described later.

[0024] On the user terminal 2, when the user specifies, for example, to launch the shopping application PRB through a predetermined operation on the touch panel 24, the processor 21 starts processing information based on the shopping application PRB. In ACT201, processor 21 accesses the online shopping site provided by sales processing device 1 via communication network 200.

[0025] In the sales processing device 1, the processor 11 awaits access from the user terminal 2 while processing information based on the sales processing program PRA. Upon receiving the access, it proceeds to ACT 101. As ACT101, processor 11 instructs user terminal 2 to display a predetermined top page. For example, processor 11 reads page data representing the form on the top page screen and the actions on user terminal 2 within the site from page database DBA, and sends it from communication unit 14 to user terminal 2 via communication network 200. Once this page data is transmitted to user terminal 2 via communication network 200, it is received by communication unit 26. Then, on user terminal 2, processor 21 proceeds to ACT202 after receiving the page data from communication unit 26.

[0026] As ACT202, the processor 21 generates a top screen based on the page data received by the communication unit 26 and displays it on the touch panel 24. When generating the top screen, the processor 21 retrieves element data contained in the element database DBB from the sales processing device 1 as needed and places it on the top screen. The generation and display of screens based on various page data, which will be described later, are performed in the same manner as the top screen described above.

[0027] The user specifies the product they are considering purchasing by performing predetermined operations on the top screen. Alternatively, the user may specify the product by performing predetermined operations on a separate screen displayed on the touch panel 24 by the processor 21 in response to the operations on the top screen. Once the product is specified by the user, the processor 21 proceeds to ACT203.

[0028] As ACT203, processor 21 notifies sales processing device 1 of the specified product. Processor 21 then, for example, performs a web access based on the URL (uniform resource locator) associated with the specified product, as is commonly known. More specifically, processor 21 makes a request to sales processing device 1 to display the product page information of the specified product on user terminal 2. Upon receiving such a web access, processor 11 proceeds to ACT102.

[0029] As ACT102, processor 11 determines that the product notified by user terminal 2 is a product the user is considering purchasing (hereinafter referred to as the "product under consideration"). This product under consideration is an example of clothing to be introduced. Thus, processor 11 determines the product under consideration as a candidate clothing item according to the user's specifications. In other words, by having processor 11 execute information processing based on the sales processing program PRA, the computer with processor 11 as its central component functions as a decision-making means.

[0030] As ACT103, processor 11 responds to the notification from user terminal 2 by making the product page information for the product under consideration available to user terminal 2. In other words, processor 11 instructs user terminal 2 to display the product page for the product under consideration. As ACT204, processor 21 displays a screen (hereinafter referred to as the product screen) to guide users through the product under consideration, based on the page data of the product page. The user considers whether or not to purchase the product under consideration based on the product screen. If the user wishes to compare the product under consideration with clothing they already own (hereinafter referred to as the comparison item), they specify the start of the handheld comparison function, for example, by performing a predetermined operation on the touch panel 24. In response to such a specification, processor 21 proceeds to ACT205.

[0031] As ACT205, processor 21 requests sales processing device 1 to start the handheld comparison function. In response to this request, processor 11 starts the processing for the handheld comparison function as described below. First, processor 11 starts the shooting process to acquire image data of the comparison products. The shooting process may consist of a single step to acquire image data obtained by shooting the comparison products under a single condition, or it may consist of multiple steps to acquire multiple image data obtained by shooting the comparison products under multiple conditions. Figure 2 shows an example consisting of multiple steps. As ACT104, processor 11 determines the type of product under consideration. The type determined here is expected to be a general category of clothing such as T-shirts, sweaters, jeans, sports pants, sweatpants, etc. However, the specific type of product to be determined may be appropriately decided by, for example, the creator of the sales processing program PRA or the operator of the online shopping site, such as dividing "T-shirts" into several categories.

[0032] As ACT105, processor 11 instructs user terminal 2 to display the first step's shooting screen according to the determined type (hereinafter referred to as the "examination type"). For example, page data representing at least one, preferably multiple, shooting screens for each step is included in the page database DBA, corresponding to each of the types that are the subject of determination in ACT104. Then, processor 11 sends page data relating to the shooting screen predetermined as the first step's shooting screen among the shooting screens associated with the examination type determined in ACT104 to user terminal 2. Once the display of the shooting screen is instructed in this way, processor 21 proceeds to ACT206. As ACT206, processor 21 displays a shooting screen in response to instructions. The shooting screen is a screen that allows the user to take a photograph of a comparison product.

[0033] Figure 3 shows an example of the shooting screen in the first step. The shooting screens shown in Figure 3 and subsequent figures are examples when the item being examined is "T-shirt". Figure 3 is an example of photographing the comparison items in a flat lay position in the first step. The shooting screen shown in Figure 3 includes areas ARAA, ARBA, and line LIAA. Area ARAA is the area that displays the image obtained by camera 25 in real time. Processor 11 includes the image output from camera 25 within area ARAA. Area ARBA is the area that represents text messages and other information for guidance regarding the shooting of the comparison product in the shooting screen. Text messages displayed in area ARBA may include instructions regarding shooting, such as, "Spread the clothing out neatly and place it on a flat surface, such as a table or floor, so that there are no wrinkles or creases," or "Shoot from the front so that the color and design are clearly visible." Alternatively, text messages displayed in area ARBA may include cautionary notes, such as, "The clothing can be photographed more effectively if the background is a single color or plain background (this reduces interference to the captured image)," or "Shooting with an appropriate background and color will reduce reflections, etc." Line LIAA represents the outline of the T-shirt when it is laid flat in the recommended state. Line LIAA guides the user on how to include the comparison product in the image obtained by camera 25 so that an image of the comparison product useful for the analysis process described later can be obtained. Note that the area outside the line LIAA in the shooting screen shown in Figure 3 may be highlighted as an invalid area by, for example, masking the image obtained by camera 25, or by using a different display method such as graying out or hatching.

[0034] The user places the comparison product flat according to the instructions shown in area ARBA, includes it in the image obtained by camera 25, and adjusts the image of the comparison product so that it roughly aligns with line LIAA before performing the operation for shooting. In other words, the user specifies saving the image of the comparison product with this operation. In response, processor 21 proceeds to ACT207. As ACT207, processor 21 sends image data output by camera 25 and instructs sales processing device 1 to save it. In this step and in each of the other steps, processor 21 may first receive a shooting instruction from the user, save the image data output by camera 25 to the auxiliary storage unit 23, and then receive a specification to save it as an image of a comparison product and instruct sales processing device 1 to save it. Upon receiving the save instruction, processor 11 proceeds to ACT106. Processor 21 sends image data representing one or more predetermined still images obtained when camera 25 takes still images. Processor 21 also sends image data representing a predetermined length of video obtained when camera 25 takes video. As ACT106, the processor 11 stores the image data sent from the user terminal 2 as described above as the first image data in the auxiliary storage unit 13.

[0035] If there are images taken from the second step onwards for each type of examination, processors 11 and 21 will repeatedly acquire and save image data for each step from the second step onwards, in the same manner as ACT105, ACT206, ACT207, and ACT106.

[0036] Figure 4 shows an example of the shooting screen in the second step. Figure 4 shows an example of photographing the comparison product in its folded state during the second step. The shooting screen shown in Figure 4 includes the image IMAA and areas ARAB and ARBB. Image IMAA is an image used to guide the user on how to fold the comparison product. Area ARAB is an area that displays images obtained by camera 25 in real time. Processor 11 includes the images output from camera 25 within area ARAB. Area ARBB is an area that displays text messages and other information for guidance regarding the shooting of the comparison product in the shooting screen. Text messages displayed in area ARBB are expected to include, for example, "Please straighten the clothes and fold them in the center or in the designated position," and "When folding, please be careful not to create wrinkles or creases." The user folds the comparison product in accordance with the instructions shown in the image IMAA and area ARBB, places it in the image obtained by camera 25, and then specifies saving.

[0037] Figure 5 shows an example of the shooting screen in the third step. Figure 5 shows an example of photographing the comparison product while it is suspended in the third step. The shooting screen shown in Figure 5 includes the image IMAB and areas ARAC and ARBC. Image IMAB is an image used to guide how to hang the comparison item. Area ARAC is an area that displays images obtained by camera 25 in real time. Processor 11 includes the images output from camera 25 in area ARAC. Area ARBC is an area that represents text messages and other information for guidance regarding the shooting of the comparison item in the shooting screen. Text messages displayed in area ARBC are expected to include, for example, "To maintain the shape of the garment, put the hanger through the neck and both arms," ​​and "Choose a hanger made of wood or plastic, appropriate for the material and weight of the garment." The user suspends the comparison product in accordance with the instructions shown in the image IMAB and area ARBC, incorporates it into the image obtained by camera 25, and then specifies saving.

[0038] Figure 6 shows an example of the shooting screen in the fourth step. Figure 6 shows an example of taking close-up photographs of the fabric of the comparison product in the fourth step. The shooting screen shown in Figure 6 includes the image IMAC and areas ARAD and ARBD. The image IMAC is a sample image obtained by taking a close-up photograph of any fabric. As the image IMAC, an image prepared in advance as a sample image related to the product under consideration by the seller or manufacturer of the product under consideration is used. For example, the image IMAC is expected to be an image obtained by taking a close-up photograph of the fabric of the product under consideration. However, the image IMAC does not have to be of a fabric other than the fabric of the product under consideration, as long as it allows the user to imagine what kind of image to take. Area ARAD is an area that displays the image obtained by the camera 25 in real time. The processor 11 includes the image output from the camera 25 in area ARAD. Area ARBD is an area that displays text messages for guidance regarding the shooting of comparison products in the shooting screen. For example, the text messages displayed in area ARBD are expected to be such as, "Use a macro lens to take close-up photographs of the details and texture of the clothing," or "In particular, it is effective to identify if you can check the material characteristics and weave." The user, following the instructions displayed in the image IMAC and area ARBD, captures the fabric of the comparison product in the image obtained by camera 25 and then specifies saving.

[0039] Figure 7 shows an example of the shooting screen in the fifth step. Figure 7 shows an example of photographing the seams and edges of the comparison product in the fifth step. The shooting screen shown in Figure 7 includes the image IMAD and areas ARAE and ARBE. The image IMAD is an image that mimics the clothing to be photographed, with annotations indicating the parts to be photographed. Area ARAE is the area that displays the image obtained by the camera 25 in real time. The processor 11 includes the image output from the camera 25 within area ARAE. Area ARBE is the area that displays text messages and other information for guidance regarding the photography of the comparison item in the shooting screen. For example, the text messages displayed in area ARBE are expected to be such as, "Seams and edges of clothing are important parts that indicate the quality and manufacturing technology of the clothing," and "Photograph the circled area with bright lighting or at close range." The user, following the instructions shown in image IMAD and area ARBE, captures the relevant part of the comparison product in the image obtained by camera 25, and then specifies saving.

[0040] Then, after processors 11 and 21 have acquired and saved image data for the final Nth step as ACT107, ACT208, ACT209, and ACT108, processor 11 proceeds to ACT109. The processor 21 may also accept user instructions to skip at least some steps. The processor 21 then instructs the user to skip the step in ACT207 or ACT209, instead of instructing the user to save the image data. In response to this instruction, the processor 11 skips saving the image data in ACT106 or ACT108 and proceeds to the next step. Specifically, since the user terminal 2 may not have macro photography capabilities, it is assumed that the fourth step in the above example can be skipped. As described above, the display of each shooting screen is an example of guidance actions for taking a picture. Thus, by having the processor 11 perform information processing based on the sales processing program, the computer with the processor 11 as its central component functions as a guidance means that causes the user terminal 2 to perform such guidance actions.

[0041] Furthermore, processor 11 acquires images that include comparison items, which are garments used for comparison with the candidate garments under consideration. Thus, by having processor 11 perform information processing based on the sales processing program PRA, the computer with processor 11 as its central component functions as an acquisition means.

[0042] As ACT109, processor 11 analyzes the images represented by the image data stored as the first to the nth image data, and performs analysis processing to determine the properties of the comparison product. Through this analysis processing, processor 11 determines evaluation values ​​for each of the comparison product's properties, such as durability, heat retention, breathability, water absorption, elasticity, and stain resistance. Processor 11 determines the evaluation value for each item on a scale of, for example, five levels. However, the number of levels for these evaluation values ​​may be determined as appropriate by, for example, the creator of the sales processing program PRA or the operator of the online shopping site. Furthermore, evaluation may be performed using expressions other than numerical values, such as ranks. Thus, by processor 11 executing information processing based on the sales processing program PRA, the computer with processor 11 as its central component functions as a determination means.

[0043] As ACT110, processor 11 generates page data for the comparison page and instructs user terminal 2 to display it. Once the display of the comparison page is instructed, processor 21 proceeds to ACT210. As ACT210, the processor 21 generates a comparison screen based on the received page data and displays it on the touch panel 24. The comparison screen is designed to inform the user of the differences in properties between the product under consideration and the comparison product.

[0044] Figure 8 shows an example of a comparison screen. The comparison screen shown in Figure 8 includes image IMBA and area ARCA. Image IMBA is a radar chart that shows the evaluation values ​​for the product under consideration as represented in the properties database DBC, and the evaluation values ​​for the comparative product obtained through the above analysis process. Area ARCA is an area that represents textual messages regarding the differences in properties between the product under consideration and the comparative product. Examples of textual messages represented in Area ARCA are: Products under consideration: Knitting method: Fine plain weave Thickness: Thin Features: This T-shirt is relatively thin, breathable, and suitable for summer and hot weather. However, it may not be durable enough and may not be suitable for autumn or winter. Items photographed: Knitting method: Coarse diagonal weave Thickness: Thick Features: This T-shirt is relatively thick and suitable for cool or cold weather. It may be more durable, but it may not be as comfortable or breathable as the T-shirts being considered. It is assumed that it will be something like this.

[0045] Page data representing such a comparison screen is an example of comparative information that compares the known properties of the garments under consideration as candidate clothing with the properties determined for the comparison items. The processor 11 then performs information processing based on the sales processing program PRA, and the computer with the processor 11 as its central component functions as a generation means for generating page data as comparative information. Furthermore, the processor 11 sends the page data as comparative information to the user terminal 2 for the user to confirm, and the computer with the processor 11 as its central component functions as an output means by the processor 11 performing information processing based on the sales processing program PRA.

[0046] The user can specify which radar chart to enlarge on the comparison screen. For example, the user can specify which item to enlarge by performing a predetermined operation, such as tapping the item name. Once enlargement is specified in this way, the processor 21 proceeds to ACT211. As ACT211, processor 21 displays an enlarged window on touch panel 24.

[0047] Figure 9 shows an example of an enlarged window. The enlarged window shown in Figure 9 is an example of when "water absorption" is enlarged in the comparison screen shown in Figure 8. The enlarged window shown in Figure 9 represents images IMCA, IMDA, and IMDB. Image IMCA is an enlarged image of a part of image IMBA. Image IMDA is a close-up photograph of the fabric of the product under consideration. Processor 21 includes, for example, an image related to the product under consideration from among the close-up photographs pre-included in the element database DBB as image IMDA in the enlarged window. Image IMDB is a close-up photograph of the fabric of the comparison product. Processor 21 includes, for example, the image represented by the fourth image data in the above specific example as image IMDB in the enlarged window. These images IMDA and IMDB show evidence of the analysis results.

[0048] As described above, according to the sales processing system 100, when a user takes a picture of clothing they already own using the user terminal 2 and sends it to the sales processing device 1, the sales processing device 1 analyzes the properties of the clothing the user already owns based on the image and displays a comparison screen on the user terminal 2 that shows the analysis results compared with the known properties of the product the user is considering. Thus, according to the sales processing system 100, based on the comparison screen, the user can intuitively recognize the properties of the product they are considering by comparing it with the clothing they already own. This allows the user to consider purchasing the product after taking its properties into account.

[0049] [Second Embodiment] The operation of the second embodiment of the sales processing system 100 will be described below. Figure 10 is a sequence diagram illustrating the data exchange flow between the sales processing device 1 and the user terminal 2, the processing procedure of the processor 11 in the sales processing device 1, and the processing procedure of the processor 21 in the user terminal 2. However, Figure 10 only shows the differences from Figure 2.

[0050] At user terminal 2, processor 21 processes in the same manner as in the first embodiment until the user specifies that the handheld comparison function should be started. Once the user specifies that the handheld comparison function should be started, processor 21 requests the sales processing device 1 to start the handheld comparison function via ACT205, in the same manner as in the first embodiment.

[0051] In the sales processing device 1, the processor 11 processes in the same manner as in the first embodiment until a request to start the hand-held comparison function is received. Then, in the second embodiment, when a request to start the hand-held comparison function is received, the processor 11 proceeds to ACT 121. As ACT121, processor 11 instructs user terminal 2 to display the type selection screen. Once the display of the type selection screen is instructed, processor 21 proceeds to ACT221.

[0052] As ACT221, the processor 21 displays a product category selection screen on the touch panel 24 in response to instructions. The processor 21 generates and displays the product category selection screen based on page data sent from the sales processing device 1 along with the display instruction, or it displays the screen represented by the screen data sent from the sales processing device 1 along with the display instruction. However, the processor 21 may also display a product category selection screen represented by screen data pre-stored in the auxiliary storage unit 23. The product category selection screen may be the same screen regardless of the product under consideration, or it may be different screens with different product category options depending on the product under consideration.

[0053] The user selects the type of clothing to be compared from the options displayed on the type selection screen and specifies that type. Once the type is specified in this way, the processor 21 proceeds to ACT222. As ACT222, processor 21 notifies sales processing device 1 of the type specified by the user. Upon receiving this notification in sales processing device 1, processor 11 uses the notified type in place of the type determined as ACT104 in the first embodiment, and performs the processing from ACT105 onward in the same manner as in the first embodiment. Thus, according to the sales processing system 100 of the second embodiment, the user can determine the type of comparison product independently of the type of product under consideration, and can also compare the product under consideration with comparison products of a different type.

[0054] This embodiment can be modified in various ways as follows: The clothing items used for comparison are not limited to those sold through online shopping; they can be any clothing items that are promoted through networks, regardless of the purpose.

[0055] Some of the functions of the decision-making means, acquisition means, judgment means, generation means, input means, and guidance means may be realized by the processor 21 on the user terminal 2 through information processing based on the shopping application PRB. For example, the function of the guidance means, that is, the display of the shooting screen for each step, may be performed autonomously by the processor 21. In this case, for example, data of various shooting screens is stored in advance in the auxiliary storage unit 23. Then, for example, the processor 11 notifies the user terminal 2 of the type determined by ACT 104 instead of ACT 105. When the user terminal 2 receives this notification, the processor 21 sequentially displays the shooting screen for each step corresponding to the notified type on the touch panel 204 based on the data stored in the auxiliary storage unit 23 as described above, and sequentially acquires image data corresponding to each step. In this case, the processor 21 may, as in the first embodiment, send the image data corresponding to each step to the sales processing device 1 each time it is acquired, or it may send the image data for multiple steps to the sales processing device 1 all at once. Alternatively, the processor 21 may receive a type specification from the user, as in the second embodiment, and start displaying the shooting screen for each step according to the specified type.

[0056] Some of the functions of the decision-making means, acquisition means, determination means, generation means, output means, and guidance means may be realized by information processing by a processor in an information processing device different from either the sales processing device 1 or the user terminal 2. For example, the functions of the determination means and generation means may be realized by information processing by a processor in a cloud server or the like, which is not shown in Figure 1.

[0057] As a guidance function, instead of displaying the shooting screen, or in addition to it, other actions such as playing an audio message may be performed.

[0058] The output of comparison information may be performed by displaying a comparison screen, or by other methods such as playing an audio message, in addition to displaying the comparison screen. Furthermore, the output of comparison information may be performed on a terminal device separate from user terminal 2.

[0059] As described above, the image data captured and saved by the user can be kept as is and used later as image data for comparisons of other products under consideration.

[0060] The processes of ACT104-ACT108 and ACT206-ACT209 in Figure 2, and even the process of ACT109, can be performed at any time separate from when the user is considering the product under consideration. The image data, or even the analysis results, can be saved and used later at any time as image data or analysis results for the comparative product.

[0061] In the sales processing device 1, the processor 11 may select products with similar properties to the comparison product based on the properties database DBC, and introduce those products to the user, for example, by instructing the user terminal 2 to display the product page for those products.

[0062] Each of the functions realized by processors 11 and 21 through information processing can also be partially or entirely realized by hardware that performs non-program-based information processing, such as logic circuits. Furthermore, each of the above functions can also be realized by combining the above-mentioned hardware, such as logic circuits, with software control.

[0063] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of symbols]

[0064] 1...Sales processing unit, 2...User terminal, 11,21...Processor, 12,22...Main memory unit, 13,23...Auxiliary memory unit, 14,26...Communication unit, 15,27...Transmission line, 24...Touch panel, 25...Camera, 100...Sales processing system, 200...Communication network.

Claims

1. A decision means for selecting one of several garments with known properties as a candidate garment according to the user's specification, An acquisition means for acquiring an image in which the clothing to be compared with the candidate clothing determined by the aforementioned determination means is visible, A determination means that determines the properties of clothing captured in an image based on an image acquired by the acquisition means, A generation means that generates comparison information representing a comparison between the known properties of the candidate garment determined by the determination means and the properties determined by the judgment means, An output means for outputting the comparison information generated by the generation means to allow the user to confirm it, An information processing device characterized by being equipped with the following.

2. The determination means obtains the user's specifications, which are entered through operations on the user terminal, from the user terminal and determines the candidate clothing items. The acquisition means acquires the image from the user terminal. The information processing apparatus according to claim 1.

3. A guidance means that causes the user terminal to perform a guidance operation to take an image suitable for determination by the determination means, The information processing apparatus according to claim 2, further comprising:

4. A decision means for selecting one of several garments with known properties as a candidate garment according to the user's specification, An acquisition means for acquiring an image in which the clothing to be compared with the candidate clothing determined by the aforementioned determination means is visible, A determination means that determines the properties of clothing captured in an image based on an image acquired by the acquisition means, A generation means that generates comparison information representing a comparison between the known properties of the candidate garment determined by the determination means and the properties determined by the judgment means, An output means for outputting the comparison information generated by the generation means to allow the user to confirm it, A user terminal that includes a part of the above and is operated by the user, An information processing apparatus comprising a part of the determination means, acquisition means, judgment means, and output means that is not provided in the user terminal, An information processing system equipped with the following features.

5. The computer that is installed in the information processing device A decision means for selecting one of several garments with known properties as a candidate garment according to the user's specification, An acquisition means for acquiring an image in which the clothing to be compared with the candidate clothing determined by the aforementioned determination means is visible, A determination means that determines the properties of clothing captured in an image based on an image acquired by the acquisition means, A generation means that generates comparison information representing a comparison between the known properties of the candidate garment determined by the determination means and the properties determined by the judgment means, An output means for outputting the comparison information generated by the generation means to allow the user to confirm it, An information processing program that enables a function to work.

Images