Information processing device, information processing system, and information processing program

Abstract

To enable intuitive recognition of the properties of a garment when a garment is introduced via a communication network.SOLUTION: An information processing device according to an embodiment comprises decision means, acquisition means, determination means, generation means and output means. The decision means determines one of a plurality of garments with known properties as a candidate garment in accordance with designation of a user. The acquisition means acquires an image containing a garment to be compared with the candidate garment determined by the decision means. The determination means determines the properties of the garment contained in the image on the basis of the image acquired by the acquisition means. The generation means generates comparison information that represents the known properties of the candidate garment determined by the decision means and the properties determined by the determination means in comparison with each other. The output means outputs the comparison information generated by the generation means for checking by the user.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] Embodiments of the present invention relate to an information processing apparatus, an information processing system, and an information processing program.

Background Art

[0002] When selling clothes through online shopping, the clothes being sold are introduced to users by presenting image information of the appearance of the clothes and character information guiding the properties of the clothes. For this reason, it has been difficult for users to intuitively recognize the properties of clothes. Under such circumstances, when introducing clothes via a communication network, it has been desired to enable users to intuitively recognize the properties of the clothes.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the present invention is to provide an information processing apparatus, an information processing system, and an information processing program that can enable users to intuitively recognize the properties of clothes when introducing the clothes via a communication network.

Means for Solving the Problems

[0005] The information processing apparatus according to the embodiment includes a determination means, an acquisition means, a determination means, a generation means, and an output means. The determination means determines, in response to a user's designation, one of a plurality of clothing items with known properties as a candidate clothing item. The acquisition means acquires an image in which the clothing item to be compared with the candidate clothing item determined by the determination means is reflected. The determination means determines the property of the clothing item reflected in the image acquired by the acquisition means based on the image. The generation means generates comparison information representing a comparison between the known property of the candidate clothing item determined by the determination means and the property determined by the determination means. The output means outputs the comparison information generated by the generation means for the user to confirm.

Brief Description of Drawings

[0006]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Best Mode for Carrying Out the Invention

[0007] Hereinafter, embodiments will be described with reference to the drawings. In this embodiment, an example in which the information processing system of the present application is applied to a sales processing system that realizes online shopping for clothing will be described. FIG. 1 is a block diagram showing the schematic configuration of a sales processing system 100 according to this embodiment and the main circuit configurations of a sales processing apparatus 1 and a user terminal 2 included in the sales processing system 100.

[0008] The sales processing system 100 is configured such that the sales processing apparatus 1 and the user terminal 2 can communicate via a communication network 200. Note that any number of the sales processing apparatus 1 and the user terminal 2 may be included in the sales processing system 100, but only one of each is shown in FIG. 1. The communication network 200 can be used alone or in an appropriate combination, such as the Internet, a VPN (virtual private network), a LAN, a public communication network, a mobile communication network, etc. As an example, the Internet and a mobile communication network are used in combination as the communication network 200.

[0009] The sales processing apparatus 1 is an information processing apparatus that uses the user terminal 2 as a user interface terminal and executes information processing for providing an online shopping service to a user who operates the user terminal 2. The sales processing apparatus 1 is realized, for example, as a web server or a cloud server. The user terminal 2 is an information processing terminal possessed by the above user.

[0010] The sales processing apparatus 1 includes a processor 11, a main storage unit 12, an auxiliary storage unit 13, a communication unit 14, a transmission path 15, and the like. The processor 11 can communicate with the main storage unit 12, the auxiliary storage unit 13, and the communication unit 14 via the transmission path 15.

[0011] A computer that performs information processing to realize the functions of the sales processing device 1 is configured by connecting a processor 11, a main memory unit 12, and an auxiliary memory unit 13 via a transmission path 15. The processor 11 corresponds to the central part of the computer. The processor 11 executes information processing for controlling each part in order to realize various functions of the sales processing device 1 according to information processing programs such as an operating system and application programs.

[0012] The main memory unit 12 corresponds to the main memory part of the computer. The main memory unit 12 includes a read-only memory area and a rewritable memory area. The main memory unit 12 stores a part of the above information processing program in the read-only memory area. Also, the main memory unit 12 may store data necessary for the processor 11 to execute processing for controlling each part in the read-only memory area or the rewritable memory area. The main memory unit 12 uses the rewritable memory area as a work area by the processor 11.

[0013] The auxiliary storage unit 13 corresponds to the auxiliary storage part of the above computer. The auxiliary storage unit 13 can use, for example, EEPROM (electric erasable programmable read-only memory), HDD (hard disc drive), SSD (solid state drive), or other various well-known storage devices. The auxiliary storage unit 13 stores the data used by the processor 11 to perform various processes and the data generated by the processes in the processor 11. The auxiliary storage unit 13 may also store the above information processing program. In this embodiment, the auxiliary storage unit 13 stores a sales processing program PRA, which is one of the information processing programs. The sales processing program PRA is an application program that describes the information processing procedure for providing an online shopping service. A part of the storage area of the auxiliary storage unit 13 is used as an area for storing a page database DBA, an element database DBB, and a property database DBC. The page database DBA includes a plurality of page data that define each of the plurality of web pages. The element database DBB includes data of various objects such as images that make up the web page. The property database DBC includes property data generated by previously evaluating various properties of each piece of clothing, which is the target product of the online shopping service. In this embodiment, the property data is data representing evaluation values for each item of durability, heat retention, breathability, water absorbency, stretchability, and stain resistance. These page database DBA, element database DBB, and property database DBC are basically generated in advance according to the target products of online shopping, etc., and written into the auxiliary storage unit 13. The page database DBA, element database DBB, and property database DBC may be updated as the specifications of online shopping are changed or the products for sale are changed, etc.

[0014] The communication unit 14 executes communication processing for performing data communication via the communication network 200. The communication unit 14 can use, for example, an existing communication device for the Internet. Note that the access by the communication unit 14 to the communication network 200 may be either a wired access method or a wireless access method. The transmission path 15 includes an address bus, a data bus, control signal lines, etc., and transmits data and control signals exchanged between the connected components.

[0015] Now, as the basic hardware of the sales processing device 1, for example, a general-purpose server device can be used. And the transfer of the sales processing device 1 is generally performed with the sales processing program PRA stored in the auxiliary storage unit 13. However, the hardware in a state where the sales processing program PRA is not stored in the auxiliary storage unit 13, or a state where an application program of the same type but different version is stored in the auxiliary storage unit 13, and the sales processing program PRA may be transferred individually. And the sales processing device 1 may be configured by writing the sales processing program PRA into the auxiliary storage unit 13 according to the operation of an arbitrary operator. The transfer of the sales processing program PRA can be performed by recording it on a removable recording medium such as a magnetic disk, a magneto-optical disk, an optical disk, a semiconductor memory, etc., or by communication via a network.

[0016] The user terminal 2 includes a processor 21, a main storage unit 22, an auxiliary storage unit 23, a touch panel 24, a camera 25, a communication unit 26, a transmission path 27, etc. The processor 21 and the main storage unit 22, the auxiliary storage unit 23, the touch panel 24, the camera 25, and the communication unit 26 are communicable via the transmission path 27. And by connecting the processor 21, the main storage unit 22, and the auxiliary storage unit 23 by the transmission path 27, a computer that performs information processing for realizing the function as the user terminal 2 is configured.

[0017] The general functions of the processor 21, the main memory unit 22, the auxiliary memory unit 23, and the transmission path 27 are equivalent to those of the processor 11, the main memory unit 12, the auxiliary memory unit 13, and the transmission path 15, so the description thereof will be omitted. However, the auxiliary memory unit 23 stores the shopping app PRB instead of the sales processing program PRA. The shopping app PRB is an application program that describes the information processing procedure for enabling the user to perform online shopping in cooperation with the sales processing device 1.

[0018] The touch panel 24 receives operations by the user in order to input various specifications by the user. The touch panel 24 displays various screens representing information to be presented to the user. The camera 25 includes an optical system and an image sensor, and generates image data representing an image within the field of view formed by the optical system by the image sensor.

[0019] The communication unit 26 is an interface for data communication via the communication network 200. As the communication unit 26, for example, a well-known communication device for performing data communication via a mobile communication network can be used. Note that the access to the communication network 200 by the communication unit 26 may be either a wired access method or a wireless access method.

[0020] As the basic hardware of the user terminal 2, a handy type of information communication terminal such as a smartphone or a tablet terminal can be used, for example. And the transfer of the user terminal 2 is generally performed in a state where the shopping app PRB is not stored in the auxiliary storage unit 23. Then, the separately transferred shopping app PRB is written into the auxiliary storage unit 23 according to the operation of an arbitrary operator, whereby the user terminal 2 is configured. The transfer of the shopping app PRB is typically performed by communication via a network. However, the transfer of the shopping app PRB may be performed by recording it on a removable recording medium such as a magnetic disk, a magneto-optical disk, an optical disk, or a semiconductor memory. Also, as the basic hardware of the user terminal 2, an information processing device such as a desktop type or a notebook type may be used.

[0021] [First Embodiment] Next, the operation in the first embodiment of the sales processing system 100 configured as described above will be described. Note that the contents of various processes described below are examples, and it is possible to appropriately change the order of some processes, omit some processes, or add other processes. For example, in the following description, in order to explain the characteristic operation of this embodiment in an easy-to-understand manner, the description of some processes is omitted. For example, when some error occurs, a process for dealing with the error may be performed, but the description of such a process is omitted.

[0022] Note that the operations of the sales processing device 1 and the user terminal 2 for causing the user to perform online shopping may be the same as the processes performed for existing online shopping, for example. And what is characteristic in the sales processing system 100 is the operation for introducing the products that the user is considering purchasing in an easy-to-understand manner. Therefore, in the following, the description will focus on this characteristic operation.

[0023] FIG. 2 is a sequence diagram showing the data transfer flow between the sales processing device 1 and the user terminal 2, the processing procedure of the processor 11 in the sales processing device 1, and the processing procedure of the processor 21 in the user terminal 2. Note that FIG. 2 shows an outline of the processing and omits the illustration of some processing. Also, although the processing procedure may differ depending on the user operation, FIG. 2 is an example according to the operation described later.

[0024] When the processor 21 in the user terminal 2 is specified by the user to start the shopping app PRB by a predetermined operation on the touch panel 24, for example, the processor 21 starts information processing based on the shopping app PRB. In ACT201, the processor 21 accesses the online shopping site provided by the sales processing device 1 via the communication network 200.

[0025] In the sales processing device 1, the processor 11 waits for access from the user terminal 2 during information processing based on the sales processing program PRA. When the corresponding access is received, it proceeds to ACT101. As ACT101, the processor 11 instructs the user terminal 2 to display a predetermined top page. For example, the processor 11 reads form data of the top page screen and page data representing the operation on the user terminal 2 within the site from the page database DBA, and sends it to the user terminal 2 from the communication unit 14 to the communication network 200. When this page data is transmitted to the user terminal 2 by the communication network 200, it is received by the communication unit 26. Then, when the processor 21 in the user terminal 2 receives the page data by the communication unit 26, it proceeds to ACT202.

[0026] As ACT202, the processor 21 generates a top screen based on the page data received by the communication unit 26 and causes it to be displayed on the touch panel 24. When generating the top screen, the processor 21 acquires, as necessary, the element data included in the element database DBB from the sales processing device 1 and arranges it within the top screen. Note that the generation and display of screens based on various page data described hereinafter are performed in the same manner as in the case of the above-described top screen.

[0027] The user performs a predetermined operation on the top screen to specify a product under consideration for purchase. Alternatively, the user may specify the product by performing a predetermined operation on another screen displayed on the touch panel 24 by the processor 21 in response to an operation on the top screen. When the product is specified by the user, the processor 21 proceeds to ACT203.

[0028] As ACT203, the processor 21 notifies the sales processing device 1 of the specified product. For example, the processor 21 performs a web access based on the URL (uniform resource locator) associated with the specified product in a well-known manner. More specifically, for example, the processor 21 makes a request to the sales processing device 1 to display the information of the product page of the specified product on the user terminal 2. When receiving such a web access, the processor 11 proceeds to ACT102.

[0029] As ACT102, the processor 11 determines the product notified from the user terminal 2 as a product that the user is considering purchasing (hereinafter referred to as the consideration product). This consideration product is an example of clothing to be introduced. Thus, the processor 11 determines the consideration product as a candidate clothing item in response to the user's specification. That is, by the processor 11 executing information processing based on the sales processing program PRA, the computer having the processor 11 as the central part functions as a determination means.

[0030] In response to the above notification from the user terminal 2, as ACT103, the processor 11 responds by making it possible to display information on the product page regarding the product under consideration on the user terminal 2. In other words, the processor 11 instructs the user terminal 2 to display the product page regarding the product under consideration. As ACT204, the processor 21 displays a screen for guiding the product under consideration (hereinafter referred to as the product screen) based on the page data of the product page. The user considers whether to purchase the product under consideration based on the product screen. And when the user wants to compare the product under consideration with the clothing the user already owns (hereinafter referred to as the comparison product), for example, the user specifies the start of the handheld comparison function by a predetermined operation on the touch panel 24. In response to such a specification, the processor 21 proceeds to ACT205.

[0031] As ACT205, the processor 21 requests the sales processing device 1 to start the handheld comparison function. In response to this request, the processor 11 starts the following-described processing for the handheld comparison function. And the processor 11 first starts the photographing process for acquiring the image data of the comparison product. The photographing process may be composed of a single step of acquiring the image data obtained by photographing the comparison product under a single condition, or may be composed of a plurality of steps for respectively acquiring a plurality of image data obtained by photographing the comparison product under a plurality of conditions. FIG. 2 shows an example composed of a plurality of steps. As ACT104, the processor 11 determines the type of the product under consideration. The type to be determined here is assumed to be a general type of clothing such as T-shirts, sweaters, jeans, sports pants, sweatpants, etc. However, how to determine the type, for example, by classifying "T-shirts" into several types, may be appropriately determined by, for example, the creator of the sales processing program PRA or the operator of the online shopping site.

[0032] As ACT105, the processor 11 instructs the user terminal 2 to display the shooting screen of the first step according to the determined type (hereinafter referred to as the type under consideration) above. For example, at least one, preferably a plurality of pages of page data representing the shooting screens of each step are included in the page database DBA in association with each type to be determined in ACT104. Then, the processor 11 transmits the page data related to the shooting screen predetermined as the shooting screen of the first step among the shooting screens associated with the type under consideration determined in ACT104 to the user terminal 2. When the display of the shooting screen is instructed in this way, the processor 21 proceeds to ACT206. As ACT206, the processor 21 displays the shooting screen according to the instruction. The shooting screen is a screen for allowing the user to shoot the comparative product.

[0033] FIG. 3 is a diagram showing an example of the shooting screen of the first step. The shooting screens shown in FIG. 3 and each subsequent figure are examples when the type under consideration is "T-shirt". And FIG. 3 is an example when shooting the comparative product in a flat state in the first step. The captured image shown in FIG. 3 includes areas ARAA, ARBA, and line LIAA. Area ARAA is an area for displaying in real time the image obtained by camera 25. Processor 11 includes the image output from camera 25 within area ARAA. Area ARBA is an area representing character messages and the like for guiding the shooting of the comparison product in the captured image. The character message represented in area ARBA includes instructions regarding shooting such as, for example, "Spread the clothes neatly and place them on a flat surface such as a table or the floor so that there are no wrinkles or folds." "Please take the photo from the front so that the color and design can be seen clearly." Alternatively, the character message represented in area ARBA may include cautions such as, for example, "It is more appropriate to take the photo with a solid color or plain background for the clothes (this reduces interference with the captured image)." "Reflections and the like can be suppressed by taking the photo with an appropriate background and color." Line LIAA represents the outline of the outer shape when the T-shirt is laid flat in the recommended state. Line LIAA guides the user to a state where the comparison product should be reflected in the image obtained by camera 25 so as to obtain an image of the comparison product that is beneficial for the analysis process described later. Regarding the area outside line LIAA in the captured image shown in FIG. 3, it may be emphasized that it is an invalid area, for example, by masking the image obtained by camera 25 or by changing the display form by grayscale display, hatching display, etc.

[0034] The user places the comparison product laid flat according to the guidance represented in area ARBA so that it is reflected in the image obtained by camera 25, adjusts the image of the comparison product so that it generally follows line LIAA, and then performs an operation for shooting. That is, through this operation, the user designates the saving of the image of the comparison product. In response to this, processor 21 proceeds to ACT207. As ACT207, the processor 21 sends the image data output by the camera 25 and instructs the sales processing device 1 to save it. In this step and each other step, the processor 21 may first receive a shooting instruction from the user, save the image data output by the camera 25 in the auxiliary storage unit 23, and then receive an instruction to save it as an image of the comparison product and instruct the sales processing device 1 to save it. Upon receiving the save instruction, the processor 11 proceeds to ACT106. The processor 21 sends image data representing one or more still images determined in advance obtained by the camera 25 performing still image shooting. The processor 21 also sends image data representing a video of a predetermined length obtained by the camera 25 performing video shooting. As ACT106, the processor 11 saves the image data sent from the user terminal 2 as described above in the auxiliary storage unit 13 as the first image data.

[0035] If there is a shooting screen after the second step regarding the type under consideration, the processors 11 and 21 repeat the acquisition and storage of image data for each step in the same manner as ACT105, ACT206, ACT207, and ACT106 for each step after the second step.

[0036] Figure 4 is a diagram showing an example of the shooting screen in the second step. Figure 4 is an example of the case of shooting a comparison product in a folded state in the second step. The shooting screen shown in FIG. 4 includes an image IMAA and areas ARAB, ARBB. The image IMAA is an image for guiding how to fold the comparison product. The area ARAB is an area for displaying in real time the image obtained by the camera 25. The processor 11 includes the image output from the camera 25 within the area ARAB. The area ARBB is an area representing a character message or the like for guiding the shooting of the comparison product in the shooting screen. The character message represented in the area ARBB is assumed to be, for example, "Arrange the clothes and fold them at the center or a predetermined position." "When folding, be careful not to get wrinkles or folding creases." The user arranges the comparison product according to the guidance represented in the image IMAA and the area ARBB, makes it appear in the image obtained by the camera 25 in the folded state, and then designates saving.

[0037] FIG. 5 is a diagram showing an example of the shooting screen in the third step. FIG. 5 is an example of the case of shooting the comparison product in a suspended state in the third step. The shooting screen shown in FIG. 5 includes an image IMAB and areas ARAC, ARBC. The image IMAB is an image for guiding how to hang the comparison product. The area ARAC is an area for displaying in real time the image obtained by the camera 25. The processor 11 includes the image output from the camera 25 within the area ARAC. The area ARBC is an area representing a character message or the like for guiding the shooting of the comparison product in the shooting screen. The character message represented in the area ARBC is assumed to be, for example, "To maintain the shape of the clothes, pass the hanger through the neck and both arm parts." "Select a hanger made of wood, plastic, etc. according to the material and weight of the clothes." The user arranges the comparison product according to the guidance represented in the image IMAB and the area ARBC, makes it appear in the image obtained by the camera 25 in the suspended state, and then designates saving.

[0038] FIG. 6 is a diagram showing an example of the shooting screen in the fourth step. FIG. 6 is an example of a case where the fabric of the comparative product is photographed closely in the fourth step. The photographed screen shown in FIG. 6 includes the image IMAC and the areas ARAD and ARBD. The image IMAC is a sample image obtained by closely photographing an arbitrary fabric. As the image IMAC, an image prepared in advance as a sample image regarding the product under consideration by the seller or manufacturer of the product under consideration or the like is used. As the image IMAC, for example, an image obtained by closely photographing the fabric of the product under consideration is assumed. However, as long as the image IMAC can allow the user to imagine what kind of image is to be photographed, an image of a fabric different from the fabric of the product under consideration may be photographed. The area ARAD is an area for displaying the image obtained by the camera 25 in real time. The processor 11 includes the image output from the camera 25 within the area ARAD. The area ARBD is an area representing a character message or the like for guiding the photographing of the comparative product in the photographed screen. The character message represented in the area ARBD is assumed to be, for example, "Use a macro lens to photograph the details and texture of the clothing in close-up." "It can be effectively identified especially if the characteristics of the material and the weaving method are confirmed." The user follows the guidance represented in the image IMAC and the area ARBD, causes the fabric of the comparative product to be reflected in the image obtained by the camera 25, and then designates saving.

[0039] FIG. 7 is a diagram showing an example of the photographed screen in the fifth step. FIG. 7 is an example of a case where the seams and ends of the comparative product are photographed in the fifth step. The shooting screen shown in FIG. 7 includes an image IMAD and areas ARAE and ARBE. The image IMAD is an image that imitates the clothing to be photographed and has an attached image representing the part to be photographed. The area ARAE is an area for displaying in real time the image obtained by the camera 25. The processor 11 includes the image output from the camera 25 within the area ARAE. The area ARBE is an area representing, for example, a character message for guiding the shooting of a comparison product on the shooting screen. The character message represented in the area ARBE is assumed to be, for example, "Seams and the edges of the clothes are important parts indicating the quality and manufacturing technique of the clothes." "Take a photo of the part within the round frame with bright lighting and from close up." The user follows the guidance represented in the image IMAD and the area ARBE, causes the corresponding part of the comparison product to be reflected in the image obtained by the camera 25, and then designates saving.

[0040] After the processor 11 and the processor 21 perform acquisition and saving of the image data regarding the final Nth step as ACT107, ACT208, ACT209, and ACT108, the processor 11 proceeds to ACT109. Note that the processor 21 may be configured to accept a designation by the user to skip the corresponding step for at least some of the steps. Then, according to the corresponding designation, the processor 21 instructs to skip instead of instructing to save the image data in ACT207 or ACT209. In response to this instruction, the processor 11 skips saving the image data in ACT106 or ACT108 and proceeds to the next process. Specifically, since the user terminal 2 may not have the function of macro shooting, it is assumed that the fourth step in the above specific example can be skipped. As described above, the display of each shooting screen is an example of a guiding operation for shooting. Thus, by the processor 11 executing information processing based on the sales processing program, the computer with the processor 11 as the central part functions as a guiding means for causing the user terminal 2 to perform such a guiding operation.

[0041] The processor 11 also acquires an image in which a comparison item, which is an item of clothing to be compared with the item under consideration that is a candidate item of clothing, is reflected. Thus, by the processor 11 executing information processing based on the sales processing program PRA, the computer with the processor 11 as the central part functions as an acquisition means.

[0042] As ACT109, the processor 11 analyzes the images represented by the image data stored as the first to Nth image data, respectively, and executes an analysis process for determining the properties of the comparison item. For example, by the analysis process, the processor 11 obtains respective evaluation values regarding durability, heat retention, breathability, water absorbency, stretchability, and stain resistance for the comparison item. The processor 11 obtains the evaluation values for each item in, for example, five levels. However, the number of levels of this evaluation value may be appropriately determined by, for example, the creator of the sales processing program PRA or the operator of the online shopping site. Also, the evaluation may be performed using an expression different from a numerical value such as a rank. Thus, by the processor 11 executing information processing based on the sales processing program PRA, the computer with the processor 11 as the central part functions as a determination means.

[0043] As ACT110, the processor 11 generates page data for a comparison page and instructs the user terminal 2 to display it. When the display of the comparison page is thus instructed, the processor 21 proceeds to ACT210. As ACT210, the processor 21 generates a comparison screen based on the received page data and displays it on the touch panel 24. The comparison screen is a screen for notifying the user of the differences in properties between the item under consideration and the comparison item.

[0044] FIG. 8 is a diagram showing an example of the comparison screen. The comparison screen shown in FIG. 8 includes an image IMBA and an area ARCA. The image IMBA is a radar chart that represents the evaluation values shown in the property database DBC for the product under consideration and the evaluation values obtained for the comparison product through the above analysis process. The area ARCA is an area that represents a text message regarding the difference in properties between the product under consideration and the comparison product. The text message represented in the area ARCA is, for example, Product under consideration: Weave: Fine plain weave Thickness: Thin Features: This T-shirt is relatively thin, has good breathability, and is suitable for summer and hot weather. However, it may not be durable enough and may not be suitable for autumn and winter. Product photographed: Weave: Coarse twill weave Thickness: Thick Features: This T-shirt is relatively thick and is suitable for cool or cold weather. It may be more durable, but it may not be as comfortable or breathable as the T-shirt under consideration. It is assumed to be something like this.

[0045] The page data representing such a comparison screen is an example of comparison information that compares the known properties of the product under consideration as a candidate clothing item with the properties determined for the comparison product. And by the processor 11 executing the information processing based on the sales processing program PRA, the computer with the processor 11 as the central part functions as a generation means for generating the page data as comparison information. Furthermore, since the processor 11 causes the page data as comparison information to be sent to the user terminal 2 for the user to confirm, by the processor 11 executing the information processing based on the sales processing program PRA, the computer with the processor 11 as the central part functions as an output means.

[0046] The user can specify the enlargement of the radar chart shown on the comparison screen. For example, the user specifies the item to be enlarged by a predetermined operation such as tapping the item name. When the enlargement is specified in this way, the processor 21 proceeds to ACT211. As ACT211, the processor 21 causes an enlargement window to be displayed on the touch panel 24.

[0047] FIG. 9 is a diagram showing an example of the enlargement window. The enlargement window shown in FIG. 9 is an example when the enlargement of "water absorption" is specified on the comparison screen shown in FIG. 8. The enlargement window shown in FIG. 9 represents images IMCA, IMDA, and IMDB. Image IMCA is an image obtained by enlarging a part of image IMBA. Image IMDA is a close-up image of the fabric of the product under consideration. The processor 21 includes, for example, an image related to the product under consideration among the close-up images previously included in the element database DBB as image IMDA in the enlargement window. Image IMDB is a close-up image of the fabric of the comparison product. The processor 21 includes, for example, the image represented by the fourth image data in the above specific example as image IMDB in the enlargement window. These images IMDA and IMDB show the evidence of the analysis results.

[0048] As described above, according to the sales processing system 100, when the user terminal 2 is caused to photograph an image of the clothing already possessed by the user and send it to the sales processing device 1, the sales processing device 1 analyzes the properties of the clothing already possessed by the user based on the image, and compares the analysis result with the known properties regarding the product under consideration by the user, and displays a comparison screen representing the comparison on the user terminal 2. Thus, according to the sales processing system 100, based on the comparison screen, the user can intuitively recognize the properties of the product under consideration by comparing it with the clothing already possessed by himself / herself. And thereby, the user can consider purchasing the product after considering the properties of the product.

[0049] [Second Embodiment] Hereinafter, the operation in the second embodiment of the sales processing system 100 will be described. FIG. 10 is a sequence diagram showing the data transfer flow between the sales processing device 1 and the user terminal 2, the processing procedure of the processor 11 in the sales processing device 1, and the processing procedure of the processor 21 in the user terminal 2. However, FIG. 10 shows an extract of the differences from FIG. 2.

[0050] In the user terminal 2, the processor 21 processes in the same manner as in the first embodiment until the start of the hand-held comparison function is specified by the user. Then, if the start of the hand-held comparison function is specified by the user, the processor 21 requests the start of the hand-held comparison function from the sales processing device 1 at ACT205, in the same manner as in the first embodiment.

[0051] In the sales processing device 1, the processor 11 processes in the same manner as in the first embodiment until the start of the hand-held comparison function is requested. Then, in the second embodiment, if the start of the hand-held comparison function is requested, the processor 11 proceeds to ACT121. As ACT121, the processor 11 instructs the user terminal 2 to display the type selection screen. When the display of the type selection screen is instructed in this way, the processor 21 proceeds to ACT221.

[0052] As ACT221, the processor 21 causes the type selection screen to be displayed on the touch panel 24 in response to the instruction. Note that the processor 21 generates and displays the type selection screen based on the page data sent from the sales processing device 1 together with the display instruction, and displays the screen represented by the screen data sent from the sales processing device 1 together with the display instruction. However, the processor 21 may display the type selection screen represented by the screen data pre-stored in the auxiliary storage unit 23. Note that the type selection screen may be the same screen regardless of the product under consideration, or may be separate screens with different type options depending on the product under consideration.

[0053] The user selects the type of clothing to be used as the comparison product from the options presented on the type selection screen and specifies the type. When the type is specified in this way, the processor 21 proceeds to ACT222. As the ACT222, the processor 21 notifies the sales processing device 1 of the type specified by the user. When this notification is received by the sales processing device 1, the processor 11 uses the notified type in place of the type determined as ACT104 in the first embodiment, and performs the processing after ACT105 in the same manner as in the first embodiment. Thus, according to the sales processing system 100 of the second embodiment, the user can determine the type of the comparison product regardless of the type of the product under consideration, and can also compare the product under consideration with a comparison product of a different type.

[0054] This embodiment can be variously modified as follows. The clothing to be compared with the comparison product is not limited to the clothing sold through online shopping, and may be any clothing introduced via the network regardless of the purpose.

[0055] Some of the functions as the determination means, acquisition means, determination means, generation means, input means, and guidance means may be realized by the processor 21 in the user terminal 2 through information processing based on the shopping application PRB. For example, the function as the guidance means, that is, the display of the shooting screen for each step, etc., may be autonomously performed by the processor 21. In this case, for example, the data of various shooting screens are stored in advance in the auxiliary storage unit 23. Then, for example, instead of ACT105, the processor 11 notifies the user terminal 2 of the type determined in ACT104. When this notification is received by the user terminal 2, the processor 21 sequentially displays on the touch panel 204 the shooting screens for each step corresponding to the notified type based on the data stored in the auxiliary storage unit 23 as described above, and sequentially acquires the image data corresponding to each step. In this case, the processor 21 may transmit the image data corresponding to each step to the sales processing device 1 every time it is acquired, in the same manner as in the first embodiment, or may transmit the image data for a plurality of steps to the sales processing device 1 in a lump. Also, the processor 21 may receive the type specified by the user as in the second embodiment and start displaying the shooting screens for each step corresponding to the specified type.

[0056] Some of the functions as the determination means, acquisition means, determination means, generation means, output means, and guidance means may be realized by information processing performed by a processor provided in an information processing apparatus different from both the sales processing apparatus 1 and the user terminal 2. For example, the functions as the determination means and the generation means may be realized by information processing performed by a processor provided in a cloud server or the like that is not shown in FIG. 1.

[0057] As the guidance operation, instead of or in addition to the display of the shooting screen, an operation of another method such as the reproduction of an audio message may be performed.

[0058] The output of the comparison information may be performed by another method such as the reproduction of an audio message instead of or in addition to the display of the comparison screen. Also, the output of the comparison information may be performed by a terminal device different from the user terminal 2.

[0059] As described above, the image data taken and saved by the user may be left as it is and used as image data regarding a comparison product of another product to be considered later.

[0060] The processes of ACT104 to ACT108 and ACT206 to ACT209 in FIG. 2, and further the process of ACT109, may be performed at an arbitrary timing different from when the user considers the product to be considered, and the image data, or further the data of the analysis result, may be saved, and then used as image data regarding the comparison product, or the data of the analysis result, at an arbitrary timing.

[0061] In the sales processing apparatus 1, the processor 11 may select a product whose properties are similar to those of the comparison product based on the property database DBC, and introduce the product to the user, for example, by instructing the user terminal 2 to display the product page of the product.

[0062] Each function realized by processors 11 and 21 through information processing can also be realized, in part or in whole, by hardware that executes information processing not based on a program, such as a logic circuit. Further, each of the above functions can also be realized by combining software control with hardware such as the above logic circuit.

[0063] Although some embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalent scope thereof.

Explanation of Reference Numerals

[0064] 1... Sales processing device, 2... User terminal, 11, 21... Processors, 12, 22... Main storage units, 13, 23... Auxiliary storage units, 14, 26... Communication units, 15, 27... Transmission paths, 24... Touch panel, 25... Camera, 100... Sales processing system, 200... Communication network.

Claims

1. Determination means for determining, according to a user's designation, one of a plurality of pieces of clothing with known properties as candidate clothing; Acquisition means for acquiring an image in which the clothing to be compared with the candidate clothing determined by the determination means is reflected; Determination means for determining the properties of the clothing reflected in the image based on the image acquired by the acquisition means; Generation means for generating comparison information representing a comparison between the known properties of the candidate clothing determined by the determination means and the properties determined by the determination means; Output means for outputting the comparison information generated by the generation means for the user to confirm; An information processing apparatus, characterized by comprising the above.

2. The determination means acquires the user's designation input by an operation on the user terminal from the user terminal and determines the candidate clothing, The acquisition means acquires the image from the user terminal. The information processing apparatus according to claim 1.

3. Guide means for causing the user terminal to perform a guiding operation for photographing an image suitable for determination by the determination means; The information processing apparatus according to claim 2, further comprising the above.

4. Determination means for determining, according to a user's designation, one of a plurality of pieces of clothing with known properties as candidate clothing; Acquisition means for acquiring an image in which the clothing to be compared with the candidate clothing determined by the determination means is reflected; Determination means for determining the properties of the clothing reflected in the image based on the image acquired by the acquisition means; Generation means for generating comparison information representing a comparison between the known properties of the candidate clothing determined by the determination means and the properties determined by the determination means; Output means for outputting the comparison information generated by the generation means for the user to confirm; A user terminal operated by the user, comprising a part of the above; An information processing apparatus comprising a part of the determination means, the acquisition means, the determination means, the generation means, and the output means that is not provided in the user terminal; An information processing system comprising the above.

5. A computer comprised in an information processing apparatus, Determination means for determining, according to a user's designation, one of a plurality of pieces of clothing with known properties as candidate clothing; Acquisition means for acquiring an image in which the clothing to be compared with the candidate clothing determined by the determination means is reflected; Determination means for determining the properties of the clothing reflected in the image based on the image acquired by the acquisition means; Generation means for generating comparison information representing a comparison between the known properties of the candidate clothing determined by the determination means and the properties determined by the determination means; Output means for outputting the comparison information generated by the generation means for the user to confirm; An information processing program for causing it to function.

Images