Information processing apparatus, information processing system, information processing method, print medium, and program

Abstract

To provide an evaluation result obtained by evaluating a space in which a plurality of clothing accessories are present.SOLUTION: An information processing apparatus comprises: a detection unit for detecting each of a plurality of clothing accessories from a captured image of a space in which the plurality of clothing accessories are present; a clothing accessory information generating unit for generating, for each of the detected clothing accessories, clothing accessory information regarding each of the clothing accessories; and an output unit for outputting an evaluation result evaluated based on each of the clothing accessory information and the information for evaluating the clothing accessories.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing system, an information processing method, a printed medium, and a program.

Background Art

[0002] Recently, a sales method of proposing a coordination such as clothing according to a user's desire and promoting the purchase of products has been widely practiced, and a technology for proposing a coordination has been developed. For example, Patent Document 1 discloses a technology for registering clothing and the like owned by a user and providing information on coordinated items suitable for the user.

Summary of the Invention

Problems to be Solved by the Invention

[0003] It would be convenient if a space such as a closet or a store where a plurality of clothing items exist could be evaluated including the plurality of clothing items existing in the space. However, no evaluation results based on the plurality of clothing items existing in the space have been provided.

[0004] An object of the present disclosure is to provide an evaluation result evaluated based on a plurality of clothing items existing in a space in a space where a plurality of clothing items exist.

Means for Solving the Problems

[0005] One embodiment of the present invention is an information processing apparatus including a detection unit that detects each clothing item from a photographed image of a space where a plurality of clothing items exist, a clothing item information generation unit that generates clothing item information regarding each detected clothing item, and an output unit that outputs an evaluation result evaluated based on each of the clothing item information and information for evaluating the clothing item.

Effects of the Invention

[0006] According to an embodiment of the present invention, in a space where a plurality of clothing items exist, an evaluation result can be provided based on the plurality of clothing items existing in the space.

Brief Description of Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Mode for Carrying Out the Invention

[0008] Hereinafter, each embodiment of the present invention will be described with reference to the accompanying drawings. In the present embodiment, fashion items include clothing and ornaments. Clothing includes clothes worn on the body, covering items such as hats, and footwear such as shoes. Ornaments include accessories and items used for decoration such as bags.

[0009] [First Embodiment] In the first embodiment, an example of a closet where there is a space with a plurality of fashion items will be described. A closet is an example of a storage place where a plurality of fashion items are stored.

[0010] <System Configuration> FIG. 1 is a configuration diagram of an example of an information processing system 1 according to the first embodiment. The information processing system 1 shown in FIG. 1 includes an information processing device 10, information processing terminals 12, and cameras 14a to 14c. The network 18 is the Internet, a LAN (Local Area Network), or the like.

[0011] Cameras 14a to 14c are an example of a photographing device that photographs a closet. Camera 14a shows a photographing device having a communication function with network 18. Camera 14b shows a photographing device that utilizes the communication function of information processing terminal 12. Camera 14c shows a photographing device built into information processing terminal 12. Note that cameras 14a to 14c may be collectively referred to as camera 14.

[0012] The user operates camera 14 to photograph the closet. The photographed image of the closet taken by the user is transmitted to information processing device 10. Information processing device 10 performs evaluation as described below by image-processing the received photographed image of the closet. Information processing terminal 12 displays the evaluation result obtained by information processing device 10 as described below. The user can confirm the evaluation result displayed on information processing terminal 12.

[0013] Information processing terminal 12 is a mobile phone, smartphone, tablet terminal, or the like that the user operates. Further, information processing terminal 12 may be a PC (Personal Computer), game machine, PDA (Personal Digital Assistant), or the like. Further, information processing terminal 12 may realize the processing described below by an application (hereinafter simply referred to as an app) downloaded from information processing device 10.

[0014] Camera 14 may be a wide-angle camera such as an omnidirectional video recording device, or may not be a wide-angle camera. As the omnidirectional video recording device, a digital camera or the like that photographs a 360-degree image in a single shot can be used. Camera 14 photographs a photographed image of the closet. When camera 14 is an omnidirectional video recording device, it photographs a 360-degree image of the closet. Further, camera 14 may be a fixed-point camera.

[0015] The information processing device 10 receives a photographed image of the closet taken by the camera 14. The information processing device 10 estimates what kind of accessories are stored in the closet or how the accessories are stored in the closet by performing image processing on the received photographed image of the closet, and generates accessory information. The information processing device 10 generates evaluation information using the generated accessory information and outputs an evaluation result.

[0016] The evaluation result is information indicating, for example, the degree of match with the trend of a plurality of accessories stored in the closet, the degree of match with the seasonal feeling, or the degree of match with an appropriate storage method. The evaluation result output by the information processing device 10 is displayed by the information processing terminal 12.

[0017] The information processing device 10 is a PC, a workstation, or the like. Note that the information processing device 10 may be realized by a server, an ASP (Application Service Provider), or cloud computing.

[0018] According to the information processing system 1 according to the first embodiment, by the user photographing the closet, an evaluation result evaluated as described below from the photographed image of the closet can be provided to the user.

[0019] The configuration of the information processing system 1 shown in FIG. 1 is an example. For example, at least a part of the functions of the information processing device 10 may be provided in the information processing terminal 12. Also, at least a part of the functions of the information processing device 10 may be provided in the camera 14. Furthermore, at least a part of the functions of the information processing device 10 may be provided in a device other than the information processing terminal 12 and the camera 14.

[0020] The information processing apparatus 10 may be, for example, an MFP (Multifunction Peripheral) which is an example of an image forming apparatus. The information processing apparatus 10 may also be a PJ (Projector), an IWB (Interactive White Board: an electronic whiteboard with an electronic blackboard function enabling two-way communication), an output device such as a digital signage, an industrial machine, an imaging device, a sound collection device, a medical device, a network home appliance, or a vehicle (Connected Car), etc.

[0021] <Hardware Configuration> 《Smartphone》 The information processing terminal 12 is realized by, for example, a smartphone 400 having the hardware configuration shown in FIG. 2. FIG. 2 is a hardware configuration diagram of an example of the smartphone 400 according to the first embodiment.

[0022] The smartphone 400 includes a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, an EEPROM 404, a CMOS (Complementary Metal Oxide Semiconductor) sensor 405, an imaging element I / F (Interface) 406, an acceleration / azimuth sensor 407, a media I / F 409, and a GPS receiver 411.

[0023] The CPU 401 controls the operation of the entire smartphone 400. The ROM 402 stores programs used for driving the CPU 401 such as the CPU 401 and the IPL. The RAM 403 is used as a work area for the CPU 401. The EEPROM 404 reads or writes various data such as smartphone programs according to the control of the CPU 401.

[0024] The CMOS sensor 405 is a type of built-in imaging means that captures a subject (mainly a self-portrait) according to the control of the CPU 401 to obtain image data. Note that an imaging means such as a CCD (Charge Coupled Device) sensor may be used instead of the CMOS sensor. The imaging device I / F 406 is a circuit that controls the driving of the CMOS sensor 405. The acceleration and azimuth sensor 407 is various sensors such as an electronic magnetic compass that detects geomagnetism, a gyrocompass, and an acceleration sensor. The media I / F 409 controls the reading or writing (storage) of data to the recording medium 408 such as a flash memory. The GPS receiver 411 receives GPS signals from GPS satellites.

[0025] Also, the smartphone 400 includes a long-distance communication circuit 412, a CMOS sensor 413, an imaging device I / F 414, a microphone 415, a speaker 416, an audio input / output I / F 417, a display 418, an external device connection I / F 419, a short-distance communication circuit 420, an antenna 420a of the short-distance communication circuit 420, and a touch panel 421. The long-distance communication circuit 412 is a circuit that communicates with other devices via the network 18. The CMOS sensor 413 is a type of built-in imaging means that captures a subject according to the control of the CPU 401 to obtain image data. The imaging device I / F 414 is a circuit that controls the driving of the CMOS sensor 413. The microphone 415 is a built-in circuit that converts sound into an electrical signal. The speaker 416 is a built-in circuit that converts an electrical signal into physical vibrations to produce sounds such as music and voices.

[0026] The audio input / output I / F 417 is a circuit that processes the input / output of audio signals between the microphone 415 and the speaker 416 according to the control of the CPU 401. The display 418 is a type of display means such as a liquid crystal or an organic EL (Electro Luminescence) that displays an image of a subject, various icons, etc. Also, the external device connection I / F 419 is an interface for connecting various external devices.

[0027] The short - distance communication circuit 420 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 421 is a kind of input means for the user to operate the smartphone 400 by pressing the display 418. Also, the smartphone 400 includes a bus line 410. The bus line 410 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 401 shown in FIG. 2.

[0028] 《Computer》 The information processing apparatus 10 is realized by, for example, a computer 500 having the hardware configuration shown in FIG. 3. Also, the information processing terminal 12 may be realized by the computer 500 having the hardware configuration shown in FIG. 3. FIG. 3 is a hardware configuration diagram of an example of the computer 500 according to the first embodiment.

[0029] The computer 500 includes a CPU 501, a ROM 502, a RAM 503, an HD 504, an HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I / F 508, a network I / F 509, a data bus 510, a keyboard 511, a pointing device 512, a DVD - RW (Digital Versatile Disk Rewritable) drive 514, and a media I / F 516.

[0030] The CPU 501 controls the operation of the entire computer 500 according to a program. The ROM 502 stores programs used for driving the CPU 501 such as IPL. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls the reading or writing of various data to and from the HD 504 according to the control of the CPU 501.

[0031] The display 506 displays various types of information such as a cursor, menu, window, characters, or images. The display 506 may be, for example, an HMD or a HUD (Head Up Display) device. The external device connection I / F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory or the like.

[0032] The network I / F 509 is an interface for performing data communication using the network 18. The data bus 510 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 501.

[0033] The keyboard 511 is a type of input means having a plurality of keys for inputting characters, numerical values, various instructions, etc. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 514 controls reading or writing of various data with respect to the DVD-RW 513 as an example of a removable recording medium. Note that it is not limited to DVD-RW, and it may be DVD-R or the like. The media I / F 516 controls reading or writing (storage) of data with respect to a recording medium 515 such as a flash memory.

[0034] Note that the hardware configuration shown in FIG. 3 is an example, and a configuration without some of the components shown in FIG. 3 may be used, or a configuration including components other than those shown in FIG. 3 may be used.

[0035] 《Omnidirectional Imaging Device》 The camera 14 is realized by, for example, an omnidirectional imaging device 600 having the hardware configuration shown in FIG. 4. FIG. 4 is a hardware configuration diagram of an example of the omnidirectional imaging device 600 according to the first embodiment. The omnidirectional imaging device 600 shown in FIG. 4 is an example of an omnidirectional (360-degree) imaging device using two imaging elements, but an omnidirectional imaging device using two or more imaging elements may also be used.

[0036] In addition, the omnidirectional imaging device 600 does not necessarily have to be a dedicated device for omnidirectional imaging. A normal digital camera, smartphone, or the like may be equipped with an add-on omnidirectional imaging unit to substantially have the same functions as the omnidirectional imaging device 600.

[0037] The omnidirectional imaging device 600 shown in FIG. 4 includes an imaging unit 601, an image processing unit 604, an imaging control unit 605, a microphone 608, a sound processing unit 609, a CPU 611, a ROM 612, an SRAM (Static RAM) 613, a DRAM (Dynamic RAM) 614, an operation unit 615, an external device connection I / F 616, a communication unit 617, an antenna 617a, and an acceleration / azimuth sensor 618.

[0038] The imaging unit 601 includes wide-angle lenses 602a and 602b each having an angle of view of 180 degrees or more for forming a hemispherical image (so-called fisheye lenses), and two image sensors 603a and 603b provided corresponding to the wide-angle lenses. The image sensors 603a and 603b are image sensors such as CMOS sensors or CCD sensors that convert the optical images formed by the wide-angle lenses 602a and 602b into image data of electrical signals and output them, a timing generation circuit that generates horizontal or vertical synchronization signals and pixel clocks of the image sensors, a register group in which various commands or parameters necessary for the operation of the image sensors 603a and 603b are set, and the like.

[0039] The image sensors 603a and 603b of the imaging unit 601 are each connected to the image processing unit 604 via a parallel I / F bus. The image sensors 603a and 603b are also connected to the imaging control unit 605 via a serial I / F bus (such as an I2C bus). The image processing unit 604, the imaging control unit 605, and the sound processing unit 609 are connected to the CPU 611 via a bus 610. Further, the ROM 612, the SRAM 613, the DRAM 614, the operation unit 615, the external device connection I / F 616, the communication unit 617, and the acceleration / azimuth sensor 618 are also connected to the bus 610.

[0040] The image processing unit 604 captures the image data output from the imaging devices 603a and 603b through the parallel I / F bus, performs predetermined processing on each piece of image data, and then synthesizes these pieces of image data to create data for an orthographic cylindrical projection image.

[0041] The imaging control unit 605 generally uses the I2C bus to set commands and the like in the register groups of the imaging devices 603a and 603b, with the imaging control unit 605 as the master device and the imaging devices 603a and 603b as slave devices. The necessary commands and the like are received from the CPU 611. Also, the imaging control unit 605 similarly uses the I2C bus to capture status data and the like of the register groups of the imaging devices 603a and 603b and send them to the CPU 611.

[0042] Also, when the shutter button of the operation unit 615 is pressed, the imaging control unit 605 instructs the imaging devices 603a and 603b to output image data. The omnidirectional imaging device 600 may also have a preview display function or a function corresponding to video display using a display (for example, a smartphone display). In this case, the output of image data from the imaging devices 603a and 603b is continuously performed at a predetermined frame rate (frames / minute).

[0043] Also, as will be described later, the imaging control unit 605 also functions as synchronization control means for synchronizing the output of image data of the imaging devices 603a and 603b in cooperation with the CPU 611. Note that in FIG. 4, the omnidirectional imaging device 600 is not provided with a display, but a display unit may be provided.

[0044] The microphone 608 converts sound into sound (signal) data. The sound processing unit 609 captures the sound data output from the microphone 608 through the I / F bus and performs predetermined processing on the sound data.

[0045] The CPU 611 controls the overall operation of the omnidirectional imaging device 600 and executes necessary processing. The ROM 612 stores various programs for the CPU 611. The SRAM 613 and the DRAM 614 are work memories that store programs to be executed by the CPU 611 and data during processing. In particular, the DRAM 614 stores image data during processing in the image processing unit 604 and data of the processed orthographic cylindrical projection images.

[0046] The operation unit 615 is a general term for operation buttons such as a shutter button. The user inputs various shooting modes, shooting conditions, etc. by operating the operation unit 615. The external device connection I / F 616 is an interface for connecting various external devices. The various external devices are, for example, a USB memory or a PC. The data of the orthographic cylindrical projection images stored in the DRAM 614 is recorded on an external device such as an external medium via the external device connection I / F 616, or transmitted to an external device such as a smartphone via the external device connection I / F 616 as needed.

[0047] The communication unit 617 communicates with the information processing terminal 12 such as the smartphone 400 by short-range wireless communication technologies such as Wi-Fi, NFC, and Bluetooth (registered trademark) via the antenna 617a provided in the omnidirectional imaging device 600. The omnidirectional imaging device 600 can transmit the data of the orthographic cylindrical projection images to the information processing terminal 12 such as a smartphone by using the communication unit 617.

[0048] The acceleration and azimuth sensor 618 calculates the azimuth of the omnidirectional imaging device 600 from the earth's magnetism and outputs azimuth information. The azimuth information is an example of related information (metadata) conforming to Exif and is used for image processing such as image correction of the captured image. Note that the related information also includes each data such as the shooting date and time of the image and the data capacity of the image data. Further, the acceleration and azimuth sensor 618 is a sensor that detects changes in angles (Roll angle, Pitch angle, Yaw angle) accompanying the movement of the omnidirectional imaging device 600. The change in angle is an example of related information (metadata) conforming to Exif and is used for image processing such as image correction of the captured image. Furthermore, the acceleration and azimuth sensor 618 is a sensor that detects acceleration in three axial directions.

[0049] Based on the acceleration detected by the acceleration and azimuth sensor 618, the omnidirectional imaging device 600 calculates the attitude (angle with respect to the gravity direction) of its own device (omnidirectional imaging device 600). By providing the omnidirectional imaging device 600 with the acceleration and azimuth sensor 618, the accuracy of image correction is improved.

[0050] <Functional configuration> The information processing system 1 according to the first embodiment is realized by, for example, the functional configuration shown in FIG. 5. FIG. 5 is a functional configuration diagram of an example of the information processing system 1 according to the first embodiment. The functional configuration diagram shown in FIG. 5 appropriately omits configurations unnecessary for the description of the first embodiment. The information processing device 10, the information processing terminal 12, and the camera 14 realize the functional configuration of FIG. 5, for example, by executing programs such as an OS and an application. FIG. 5 shows an example of the camera 14b that uses the communication function of the information processing terminal 12.

[0051] The information processing device 10 shown in FIG. 5 includes a reception unit 30, a detection unit 32, an accessory information generation unit 34, a season estimation unit 36, an evaluation information generation unit 38, an output unit 40, an information registration reception unit 42, a captured image storage unit 50, an information storage unit 52, and an evaluation information storage unit 54. The information processing terminal 12 shown in FIG. 5 includes an operation reception unit 60, a display unit 62, and a communication control unit 64. The camera 14b shown in FIG. 5 includes a shooting unit 80 and a transfer unit 82.

[0052] The photographing unit 80 of the camera 14b photographs a closet in which a plurality of clothing items are stored according to a user's operation. The transfer unit 82 transfers the photographed image of the closet photographed by the photographing unit 80 to the information processing terminal 12. The operation reception unit 60 of the information processing terminal 12 receives an operation from the user. The display unit 62 performs display for the user. The communication control unit 64 communicates with the information processing device 10 and the camera 14b. For example, the communication control unit 64 transmits the photographed image of the closet transferred from the camera 14b to the information processing device 10. Further, the communication control unit 64 receives the evaluation result evaluated by the information processing device 10 using the photographed image of the closet from the information processing device 10. The display unit 62 displays the evaluation result received from the information processing device 10.

[0053] Note that the method for acquiring the photographed image of the closet may be selectable, for example, from the acquisition method selection screen 900 shown in FIG. 6. FIG. 6 is an image diagram of an example of the acquisition method selection screen 900. The user may select the photographed image of the closet from the images photographed so far by pressing "Select photographed image" 902 on the acquisition method selection screen 900. Further, the user may select the image to be photographed by the camera 14b by pressing "Photograph with another camera" 904 on the acquisition method selection screen 900. Further, the user may select the image to be photographed by activating the camera 14c by pressing "Activate the camera and photograph" 906 on the acquisition method selection screen 900. When provided by an app or the like in the information processing terminal 12, when the app is activated, the image photographed by the camera 14b may be automatically captured. Further, the image photographed by activating the camera 14c may be automatically captured. When photographing with the camera 14c, photographing from a plurality of directions may be encouraged.

[0054] The receiving unit 30 of the information processing apparatus 10 receives the photographed image of the closet from the information processing terminal 12 and stores it in the photographed image storage unit 50. The detection unit 32 detects a plurality of accessory images shown in the photographed image from the photographed image of the closet received by the receiving unit 30 and stored in the photographed image storage unit 50. The process of detecting a plurality of accessory images from the photographed image uses, for example, a learned machine learning model to detect the accessory images shown in the photographed image and estimate a plurality of accessories in the closet.

[0055] Machine learning is a technology for enabling a computer to acquire learning capabilities similar to those of humans. Machine learning refers to a technology in which a computer autonomously generates an algorithm necessary for judgments such as data identification from learning data that has been pre-loaded, and applies this to new data to make predictions. The learning method for machine learning may be any one of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, and furthermore, a learning method that combines these learning methods may also be used, and the learning method for machine learning is not limited.

[0056] The accessory information generation unit 34 generates accessory information for each of the plurality of accessories in the closet from the plurality of accessory images detected by the detection unit 32 and stores it in the information storage unit 52. The accessories for which the accessory information is stored in the information storage unit 52 are at least partially the accessories shown in the photographed image of the closet. Accessories include, in addition to clothes, ornaments such as hats, bags, shoes, and accessories. Also, the ornaments may include miscellaneous goods in the closet. The season estimation unit 36 estimates the season in which the closet was photographed using the information on the photographing date and time when the camera 14b photographed the closet.

[0057] The evaluation information generation unit 38 generates evaluation information using the generated accessory information and information for evaluating a plurality of accessories in the closet, and stores it in the evaluation information storage unit 54. The information for evaluating accessories is the information used as a standard when evaluating accessories. Also, the evaluation information is an evaluation result obtained by comparing the generated accessory information with the information for evaluating accessories. The evaluation information is, for example, information indicating the ratio of a plurality of accessories in the closet that match the trend, the ratio of a plurality of accessories in the closet that match the seasonal feeling, or the ratio of the storage of a plurality of accessories in the closet that matches the appropriate storage method.

[0058] The output unit 40 outputs an evaluation result using the evaluation information generated by the evaluation information generation unit 38. The evaluation result output by the output unit 40 is transmitted to the information processing terminal 12.

[0059] The information registration reception unit 42 receives the registration of information for evaluating a plurality of accessories stored in the closet, and stores the received information in the information storage unit 52. For example, the information for evaluating a plurality of accessories stored in the closet is fashion trend information, storage method information, information for estimating the season suitable for the accessories, and season estimation information, etc.

[0060] The photographed image storage unit 50 stores the photographed image of the closet photographed by the camera 14 such as the camera 14b. The information storage unit 52 stores information for evaluating a plurality of accessories in the closet. Also, the evaluation information storage unit 54 stores the evaluation information generated by the evaluation information generation unit 38.

[0061] Note that the functional configuration in FIG. 5 is an example, and a part of the functions of the information processing device 10 may be provided in the information processing terminal 12 or the camera 14b. Also, an information processing device 10 in which the functions of the information processing device 10 and the information processing terminal 12 are integrated may be used. Furthermore, the classification of the information processing device 10 in FIG. 5 is an example, and it may be realized by classifying it into two or more devices.

[0062] <Processing> The processing procedure of the information processing system 1 according to the first embodiment will be described. FIG. 7 is a flowchart showing an example of the processing of the information processing system 1 according to the first embodiment.

[0063] In step S10, the imaging unit 80 of the camera 14 inputs a captured image obtained by capturing a closet in which a plurality of accessories are stored according to a user operation. The transfer unit 82 transfers data of the captured image 1000 of the closet shown in, for example, FIG. 8 captured by the imaging unit 80 (hereinafter simply referred to as the captured image 1000) to the information processing terminal 12.

[0064] FIG. 8 is an image diagram of an example of the captured image 1000 of the closet. The captured image 1000 of the closet shown in FIG. 8 shows, as an example of a plurality of accessories stored in the closet, clothes hanging on a hanger, clothes folded and placed on a shelf, a bag, and shoes. Note that the captured image 1000 may be a composite of captured images taken in multiple times.

[0065] In step S12, the receiving unit 30 of the information processing apparatus 1 receives the captured image 1000 of the closet from the information processing terminal 12 and stores it in the captured image storage unit 50. The detection unit 32 detects a plurality of accessory images shown in the captured image 1000 from the captured image 1000 of the closet. The process of detecting a plurality of accessory images from the captured image 1000 is a process of detecting accessory images shown in the captured image 1000 by image recognition using a learned machine learning model and estimating a plurality of accessories in the closet.

[0066] In addition, the detection unit 32 detects information such as the type of the accessory and the characteristics of the accessory from the accessory image shown in the captured image 1000 by image recognition using a learned machine learning model. The characteristics of the accessory are represented by a plurality of items representing characteristics such as the appearance of the accessory. The plurality of items representing characteristics such as the appearance of the accessory are, for example, the shape such as short sleeves and long sleeves, the material such as cotton and silk, the color, the pattern, and the like. In addition, the shape of the accessory is, for example, the sleeves, the length, the characteristic design, and the form. The length of the sleeves and the length may be represented by a rough length such as knee length, midi length, long length, etc., or may be represented by a numerical value estimated by image recognition. The material of the accessory is, for example, the fabric used for the accessory. When a plurality of fabrics are used for the accessory, only the most used fabric may be detected, or all the used fabrics may be detected. The type of the accessory is the classification of the accessory, and is, for example, a shirt, a T-shirt, a sweater, a coat, trousers, a muffler, and the like. The types of accessories may be roughly classified into outerwear, tops, bottoms, accessories, and the like.

[0067] In step S14, the accessory information generation unit 34 generates accessory information shown in, for example, FIG. 9 using the accessory information detected by the detection unit 32 in step S12, and stores it in the information storage unit 52.

[0068] FIG. 9 is a configuration diagram of an example of accessory information. Accessory information is data in which identification information for identifying each accessory included in a plurality of accessory images detected by the detection unit 32 is associated with information regarding the appearance such as the characteristics of each accessory. The accessory information in FIG. 9 has, as items, an item ID, a type, characteristics, and a suitable season. Note that, although the accessory information has been described using FIG. 9 as an example, the items of the accessory information are not limited to this, and other items representing characteristics may be included. The item ID is an example of identification information for identifying the accessory detected from the captured image 1000. The characteristics indicate the characteristics of the accessory detected from the captured image 1000, and include the shape, the material, the color, the pattern, and the like. The suitable season indicates the suitable season for the accessory detected from the captured image 1000.

[0069] The suitable season of the accessories detected from the captured image 1000 can be detected by using, for example, the information for estimating the suitable season of the accessories shown in FIG. 10. FIG. 10 is a configuration diagram of an example of the information for estimating the suitable season of the accessories. The information for estimating the suitable season of the accessories in FIG. 10 has, as items, features, colors, and suitable seasons. In the information for estimating the suitable season of the accessories in FIG. 10, the features and colors of the accessories are associated with the suitable seasons. Therefore, the suitable season of the accessories detected from the captured image 1000 can detect the suitable season corresponding to the features of the accessories shown in FIG. 9 by using the information for estimating the suitable season of the accessories in FIG. 10. Although an example of representing the suitable season as spring, summer, autumn, and winter has been shown, for example, if it is a short-sleeved T-shirt, it may be expressed in calendar months such as May to September, and if it is a long-sleeved shirt, it may be expressed in calendar months such as March to May, September to October, etc.

[0070] In step S16, the evaluation information generation unit 38 generates evaluation information by using, for example, the accessory information shown in FIG. 9 that has been generated and the information for evaluating a plurality of accessories in the closet, in the procedure of the flowchart in FIG. 11, for example, and stores it in the evaluation information storage unit 54.

[0071] FIG. 11 is a flowchart showing an example of the process of step S16.

[0072] In step S30, the evaluation information generation unit 38 uses the fashion trend information, which is an example of the information for evaluating a plurality of accessories stored in the closet, and the accessory information shown in FIG. 9 to calculate the ratio of the features of the accessories in the closet that match the features of the trendy accessories.

[0073] FIG. 12 is a configuration diagram of an example of fashion trend information. Trend information is information indicating currently popular colors and characteristics of fashion items. It may include not only the present but also future predictions. For example, as shown in FIG. 12, trend information is information that correlates evaluation items related to fashion items, such as characteristics of fashion items, with trends for each type of fashion item. The evaluation information generation unit 38 may calculate the number of fashion items in the closet whose characteristics match those of the trendy fashion items. The ratio or number of fashion items in the closet that match the trendy fashion items is an example of information indicating the degree of match between the fashion items in the closet and the trendy fashion items. Trend information may be obtained from SNS (Social Networking Service) or WEB information. Note that trends change according to seasons, social situations, etc. Therefore, it is preferable that trend information be updated regularly. Trend information may be updated regularly by an administrator, or may be updated triggered by the start of evaluation in the flowchart of FIG. 11. Also, trend information may be extracted or generated by AI.

[0074] In step S32, the evaluation information generation unit 38 uses the seasonal estimation information shown in FIG. 13, which is an example of information for evaluating a plurality of fashion items stored in the closet, and the fashion item information of FIG. 9 to calculate the ratio of the fashion items in the closet that match the seasonal feeling. The evaluation information generation unit 38 may calculate the number of fashion items in the closet that match the seasonal feeling. The ratio or number of fashion items in the closet that match the seasonal feeling is an example of information indicating the degree of match between the fashion items in the closet and the seasonal feeling.

[0075] FIG. 13 is a configuration diagram of an example of seasonal estimation information. The seasonal estimation information shown in FIG. 13 has, as items, the shooting time and the estimated season. The seasonal estimation information in FIG. 13 has the shooting time and the estimated season associated with each other. The shooting time can be selected from the shooting date and time when the shooting image of the closet is taken. Also, the shooting date and time when the shooting image of the closet is taken may be obtained, for example, from the related information (metadata) of the shooting image, or may be obtained as shooting time information from the information processing terminal 12. Therefore, the season estimation unit 36 can estimate the season when the shooting image of the closet is taken using the information on the shooting date and time when the camera 14b takes the picture of the closet. Although an example of calculating the match with the seasonal feeling by estimating the season has been shown, the degree of match with the shooting month instead of the season may be calculated, or the degree of match with the climate for a certain period near the shooting date may be calculated by obtaining information on the temperature and humidity near the shooting date from the Web or the like. Note that the seasonal estimation information may be generated by AI.

[0076] In step S34, the evaluation information generation unit 38 generates evaluation information including information indicating the ratio of the clothing items in the closet that match the trendy clothing items calculated, and information indicating the ratio of the clothing items in the closet that match the seasonal feeling.

[0077] Returning to step S18 in FIG. 7, the output unit 40 outputs, for example, the evaluation result 1100 shown in FIG. 14 using the evaluation information generated in step S16. FIG. 14 is an image diagram of an example of the evaluation result 1100 regarding the closet. The evaluation result regarding the closet shown in FIG. 14 includes the evaluation information 1102 generated in step S16 and the advice 1104 based on the fashion trend information.

[0078] The evaluation information 1102 in FIG. 14 shows an example of quantifying and representing the ratios of matching with the seasonal feeling and matching with the trend, but it may also be qualitative evaluation comments, etc. according to the ratios. Also, the advice 1104 may be recommendations such as recommended outfit combinations / items, etc. according to the ratios of matching with the seasonal feeling and matching with the trend. The content of the advice 1104 may be generated by the generation AI according to the ratios of matching with the seasonal feeling and matching with the trend. The evaluation result 1100 shown in FIG. 14, for example, output by the output unit 40, is transmitted to the information processing terminal 12 and displayed on the display unit 62 of the information processing terminal 12.

[0079] Also, the process of step S16 may be performed according to the procedure of the flowchart in FIG. 15. FIG. 15 is a flowchart showing an example of the process of step S16.

[0080] In step S50, the evaluation information generation unit 38 uses the fashion trend information, which is an example of information for evaluating a plurality of clothing items stored in the closet, and the clothing item information shown in FIG. 9 to calculate the ratio of the clothing items in the closet matching the trendy clothing items. The evaluation information generation unit 38 may calculate the number of clothing items in the closet that match the trendy clothing items.

[0081] In addition, as an example of a case determined to match, for example, among the features such as the shape, material, and color of the clothing accessories in the closet, if any one or more of them match or are approximated to the features of the trendy clothing accessories, it may be determined that they match. The match of the features of the clothing accessories means that all of the plurality of features match. Also, the approximation of the features of the clothing accessories means that the ratio of the matching features among the plurality of features is equal to or greater than a threshold value. The threshold value may be predetermined such that 80% of the plurality of features match, etc., or may be set from the information processing terminal 12 for each user. Further, the evaluation information generation unit 38 may calculate the ratio of the features that match the trendy clothing accessories for each clothing accessory, and calculate the average value among the plurality of clothing accessories. In each item included in the features of the clothing accessories, when a plurality of features are included, the ratio of the number of features that match the information included in the trend information may be calculated. As an example of the calculation of the ratio of the matching features, for example, if the closet contains a shirt (shape: long sleeves, long length, balloon sleeves, material: cotton, color: white), and the trend information (in the case of a shirt) includes (shape: long sleeves, waist length, balloon sleeves, material: cotton, color: white), it may be calculated that the shape is 70%, the color is 100%, and the material is 100% match. Also, the ratio (overall evaluation) of this shirt matching the trend information may be calculated to be 90% (the average value of the plurality of items included in the features of the clothing accessories) match. Note that the above describes the calculation method when having information as shown in FIG. 12 as the trend information, but the similarity may be calculated by AI and it may be determined whether they match.

[0082] In step S52, the evaluation information generation unit 38 uses the season estimation information shown in FIG. 13, which is an example of information for evaluating a plurality of clothing accessories stored in the closet, and the clothing accessory information in FIG. 9, to calculate the ratio of the clothing accessories in the closet that match the seasonal feeling. The evaluation information generation unit 38 may calculate the number of clothing accessories in the closet that match the seasonal feeling.

[0083] In step S54, the evaluation information generation unit 38 uses the storage technique information, which is an example of information for evaluating a plurality of clothing items stored in the closet, the clothing item information shown in FIG. 9, and the photographed image 1000 of the closet shown in FIG. 8 to calculate the ratio of the clothing items stored in the closet using a suitable storage technique. The storage technique is, for example, the way of hanging, folding, or arranging clothing items. The storage technique information is, for example, the storage technique information corresponding to the type of clothing item. It may also be the storage technique information corresponding to the characteristics (e.g., shape and material) of the clothing item. Note that the storage technique information may be generated by AI. The evaluation information generation unit 38 may calculate the number of clothing items stored in the closet using a suitable storage technique. The ratio or number of clothing items stored in the closet using a suitable storage technique is an example of information indicating the degree of match of the clothing items in the closet with a suitable storage technique.

[0084] In step S56, the evaluation information generation unit 38 generates evaluation information including information indicating the ratio of the clothing items in the closet that match the trendy clothing items, information indicating the ratio of the clothing items in the closet that match the seasonal feeling, and the ratio of the clothing items stored in the closet using a suitable storage technique.

[0085] Returning to step S18 in FIG. 7, the output unit 40 outputs, for example, the evaluation result 1100 shown in FIG. 16 using the evaluation information generated in step S16. FIG. 16 is an image diagram of an example of the evaluation result 1100 regarding the closet. The evaluation result regarding the closet shown in FIG. 16 includes the evaluation information 1102 generated in step S16 and the advice 1104 based on the fashion trend information and the information on a suitable storage technique. Note that the output result of the evaluation information in FIGS. 14 and 16 may be displayed on the display unit 62 of the information processing terminal 12 or printed on a printed medium.

[0086] The evaluation information 1102 in FIG. 16 shows an example of quantifying and representing the ratios of match with the sense of season, match with the trend, and match with the storage method, but it may also be qualitative evaluation comments, etc. according to the ratios. The advice 1104 may be recommendations such as recommended outfit changes / items, etc. according to the ratios of match with the sense of season and match with the trend. The advice 1104 may also be storage advice, etc. according to the ratio of match with the storage method.

[0087] The content of the advice 1104 may be generated by the generative AI according to the ratios of match with the sense of season, match with the trend, and match with the storage method. For example, the evaluation result 1100 shown in FIG. 16 output by the output unit 40 is transmitted to the information processing terminal 12 and displayed on the display unit 62 of the information processing terminal 12.

[0088] The processing of the information processing system 1 shown in FIG. 7 may be performed as shown in FIG. 17. FIG. 17 is a flowchart showing an example of the processing of the information processing system 1 according to the first embodiment.

[0089] In step S100, the information processing terminal 12 displays, for example, a selection screen 950 of items to be evaluated shown in FIG. 18, and allows the user to select the items to be evaluated and the objects to be evaluated. In FIG. 18, as examples of the items to be evaluated, the degree of match with the trend, the degree of match with the storage method, the degree of match with the sense of season, and the degree of overall match are shown. Also, in FIG. 18, as examples of the objects to be evaluated, evaluation regarding the closet, evaluation regarding accessories, and overall evaluation are shown.

[0090] Since the processing in steps S102 to S106 is the same as the processing in steps S10 to S14 in FIG. 7, the description is omitted. In step S108, when the information processing terminal 12 receives the selection of the item to be evaluated from the user from the selection screen 950 of the item to be evaluated shown in FIG. 18 in step S100, the process proceeds to step S110.

[0091] In step S110, the information processing terminal 12 generates evaluation information for the item to be evaluated selected in step S100. Subsequently, proceeding to step S112 after step S110, the information processing terminal 12 outputs an evaluation result 1100 using the evaluation information generated in step S110. As for the content of the advice 1104, when an item to be evaluated is selected, advice 1104 corresponding to the user's selection may be displayed.

[0092] In step S108, when the information processing terminal 12 has not received from the user a selection of an item to be evaluated from the selection screen 950 of the item to be evaluated shown in, for example, FIG. 18 in step S100, the process proceeds to the process of step S114. Since the processes of steps S114 and S116 are the same as the processes of steps S16 and S18 in FIG. 7, the description thereof is omitted.

[0093] Note that the evaluation result 1100 shown in FIGS. 14 and 16 is an example. For example, the evaluation information 1102 may represent the percentage of match with, for example, a suitable outfit, a suitable way of matching materials, or a suitable way of combining accessories, etc., in terms of points. Also, for example, the advice 1104 may propose accessories that do not match the seasonal feeling or trend as unnecessary accessories.

[0094] In this way, by providing the user with the evaluation result 1100 that proposes unnecessary accessories from the accessories stored in the closet, the user can make more efficient use of the inside of the closet, for example, by removing the accessories proposed as unnecessary from the closet.

[0095] In the first embodiment, an example of a closet in which a plurality of accessories are stored has been described. However, as long as it is a space in which a plurality of accessories exist and it is a space where the plurality of accessories existing in that space can be photographed, it is not limited to a closet.

[0096] As described above, according to the information processing system 1 according to the first embodiment, an evaluation result obtained by evaluating a space in which a plurality of accessories exist can be provided to the user by using a photographed image of the space in which the plurality of accessories exist.

[0097] [Second Embodiment] In the second embodiment, an example of a store is described where there is a space with a plurality of fashion items. The store is an example of a space where a plurality of fashion items are displayed. Note that since the second embodiment is the same as the first embodiment except for some parts, the description will be omitted as appropriate.

[0098] <System Configuration> The configuration of the information processing system 1 according to the second embodiment will be described with reference to FIG. 1. Cameras 14a to 14c are examples of photographing devices that photograph the store. The user operates the camera 14 to photograph the store. The photographed image of the store taken by the user is transmitted to the information processing device 10. The information processing device 10 performs image processing on the received photographed image of the store and conducts an evaluation as described later. The information processing terminal 12 displays the evaluation result of the store performed by the information processing device 10 as described later. The user can check the evaluation result of the store displayed on the information processing terminal 12.

[0099] The information processing device 10 receives the photographed image of the store photographed by the camera 14. The information processing device 10 performs image processing on the received photographed image of the store to estimate what fashion items are displayed in the store or how the fashion items are displayed in the store, and generates fashion item information. The information processing device 10 generates evaluation information using the generated fashion item information and outputs an evaluation result.

[0100] The evaluation result is information indicating, for example, the degree of match with the trends of a plurality of fashion items displayed in the store, the degree of match with the seasonal feeling, or the degree of match with appropriate display techniques. The evaluation result output by the information processing device 10 is displayed by the information processing terminal 12.

[0101] According to the information processing system 1 according to the second embodiment, a user such as a store employee can photograph the store, and the evaluation result evaluated as described later can be provided to the user from the photographed image of the store.

[0102] <Functional Configuration> The configuration of the information processing system 1 according to the second embodiment will be described with reference to FIG. 5. The photographing unit 80 of the camera 14b photographs a store in which a plurality of clothing items are displayed according to a user operation. The transfer unit 82 transfers the photographed image of the store photographed by the photographing unit 80 to the information processing terminal 12. For example, the communication control unit 64 transmits the photographed image of the store transferred from the camera 14b to the information processing device 10. Further, the communication control unit 64 receives the evaluation result evaluated by the information processing device 10 using the photographed image of the store from the information processing device 10. The display unit 62 displays the evaluation result received from the information processing device 10.

[0103] The receiving unit 30 of the information processing device 10 receives the photographed image of the store from the information processing terminal 12 and stores it in the photographed image storage unit 50. The detection unit 32 detects a plurality of clothing item images shown in the photographed image of the store received by the receiving unit 30 and stored in the photographed image storage unit 50. The process of detecting a plurality of clothing item images from the photographed image detects, for example, clothing item images shown in the photographed image using a learned machine learning model, and estimates a plurality of clothing items displayed in the store.

[0104] The clothing item information generation unit 34 generates clothing item information of a plurality of clothing items in the store from the plurality of clothing item images detected by the detection unit 32 and stores it in the information storage unit 52. The clothing items for which the clothing item information is stored in the information storage unit 52 are at least some of the clothing items shown in the photographed image of the store. The season estimation unit 36 estimates the season in which the store was photographed using the information on the photographing date and time when the camera 14b photographed the store.

[0105] The evaluation information generation unit 38 generates evaluation information using the generated clothing item information and information for evaluating a plurality of clothing items in the store, and stores it in the evaluation information storage unit 54. The evaluation information is information indicating the ratio of a plurality of clothing items in the store that match the trend, the ratio of a plurality of clothing items in the store that match the seasonal feeling, or the ratio of the display of a plurality of clothing items in the store that matches the appropriate display technique.

[0106] The output unit 40 uses the evaluation information generated by the evaluation information generation unit 38 to output an evaluation result regarding a store in which a plurality of clothing items are displayed, and transmits it to the information processing terminal 12. The information registration reception unit 42 receives registration of information for evaluating a plurality of clothing items in the store, and stores it in the information storage unit 52. For example, the information for evaluating a plurality of clothing items in the store includes fashion trend information, suitable display technique information, information for estimating the season suitable for the clothing items, and season estimation information, and the like. The photographed image storage unit 50 stores the photographed image of the store photographed by the camera 14 such as the camera 14b. The information storage unit 52 stores information for evaluating a plurality of clothing items in the store.

[0107] <Process> The processing procedure of the information processing system 1 according to the second embodiment will be described. FIG. 19 is a flowchart showing an example of the processing of the information processing system 1 according to the second embodiment.

[0108] In step S70, the photographing unit 80 of the camera 14 inputs a photographed image of a store in which a plurality of clothing items are displayed according to the user's operation. The transfer unit 82 transfers the data of the photographed image 1300 of the store shown in FIG. 20, for example, photographed by the photographing unit 80 (hereinafter simply referred to as the photographed image 1300) to the information processing terminal 12.

[0109] FIG. 20 is an image diagram of an example of the photographed image 1300 of the store. The photographed image 1300 of the store shown in FIG. 20 shows, as an example of a plurality of clothing items displayed in the store, clothes hung on a hanger, clothes folded and placed on a shelf, a bag, and shoes. Note that the photographed image 1300 may be a photographed image taken by a fixed-point camera.

[0110] In step S72, the receiving unit 30 of the information processing apparatus 10 receives the captured image 1300 of the store from the information processing terminal 12 and stores it in the captured image storage unit 50. The detection unit 32 detects a plurality of accessory images shown in the captured image 1300 from the captured image 1300 of the store. The process of detecting a plurality of accessory images from the captured image 1300 is a process of detecting the accessory images shown in the captured image 1300 by image recognition using a learned machine learning model and estimating a plurality of accessories displayed in the store.

[0111] Also, the detection unit 32 detects information such as the type of the accessory and the features of the accessory from the accessory image shown in the captured image 1300 by image recognition using a learned machine learning model.

[0112] In step S74, the accessory information generation unit 34 uses the information of the accessories detected by the detection unit 32 in step S72 to generate, for example, the accessory information shown in FIG. 9 and stores it in the information storage unit 52. Note that the item ID may be managed in association with, for example, identification information for each product used when the store manages the inventory information of the products when selling accessories.

[0113] In step S76, the evaluation information generation unit 38 uses the generated accessory information shown in FIG. 9, for example, and information for evaluating a plurality of accessories in the store to generate evaluation information according to the procedure of the flowchart shown in FIG. 21, for example, and stores it in the evaluation information storage unit 54. The information for evaluating a plurality of accessories in the store is information that serves as a standard when evaluating a plurality of accessories displayed in the store.

[0114] FIG. 21 is a flowchart showing an example of the process in step S76.

[0115] In step S90, the evaluation information generation unit 38 calculates the ratio of the clothing items in the store that match the trendy clothing items, using the fashion trend information, which is an example of information for evaluating a plurality of clothing items displayed in the store, and the clothing item information shown in FIG. 9. The evaluation information generation unit 38 may calculate the number of clothing items in the store that match the trendy clothing items. The ratio or number of clothing items in the store that match the trendy clothing items is an example of information indicating the degree of match between the clothing items in the store and the trendy clothing items.

[0116] In step S92, the evaluation information generation unit 38 calculates the ratio of the clothing items in the store that match the seasonal feeling, using the seasonal estimation information, which is an example of information for evaluating a plurality of clothing items displayed in the store, and the clothing item information shown in FIG. 9. The evaluation information generation unit 38 may calculate the number of clothing items in the store that match the seasonal feeling. The ratio or number of clothing items in the store that match the seasonal feeling is an example of information indicating the degree of match between the clothing items in the store and the seasonal feeling.

[0117] In step S94, the evaluation information generation unit 38 calculates the ratio of the clothing items displayed in the store using a suitable display technique, using the information on a suitable display technique, which is an example of information for evaluating a plurality of clothing items displayed in the store, the clothing item information shown in FIG. 9, and the photographed image 1300 of the store shown in FIG. 20. The evaluation information generation unit 38 may calculate the number of clothing items displayed in the store using a suitable display technique. Note that the ratio or number of clothing items displayed in the store using a suitable display technique is an example of information indicating the degree of match between the clothing items in the store and the suitable display technique.

[0118] Visual merchandising is a method for efficiently arranging fashion items for sales promotion and attractively presenting them to customers. Suitable visual merchandising techniques include, for example, arranging items in places where customers tend to gather, arranging items with awareness of customer flow, arranging items to disperse customers within the store, and arranging items to guide customers to the back of the store. Visual merchandising techniques corresponding to the types of fashion items and the sales performance of each fashion item may also be used. Information on suitable visual merchandising techniques may be information analyzed from general information such as the general tendency of customer movement patterns within the store and the places where popular items are generally easy to sell, or may be information obtained by analyzing a video taken by, for example, a camera 14 installed in the store to determine the visual merchandising techniques suitable for the store. Note that the information on visual merchandising techniques may be generated by AI.

[0119] In step S96, the evaluation information generation unit 38 generates evaluation information including information indicating the ratio of fashion items in the store that match trendy fashion items, information indicating the ratio of fashion items in the store that match the seasonal feeling, and the ratio of fashion items displayed in the store using suitable visual merchandising techniques.

[0120] Returning to step S78 in FIG. 19, the output unit 40 outputs an evaluation result regarding the store using the evaluation information generated in step S76. For example, the evaluation result regarding the store may include the evaluation information generated in step S76 and advice based on fashion trend information and information on suitable visual merchandising techniques. Note that the evaluation information may be generated by AI.

[0121] In the second embodiment, an example of a store in which a plurality of fashion items are displayed has been described. However, the present invention is not limited to a store as long as it is a space in which a plurality of fashion items are displayed and is a space in which the plurality of fashion items displayed in the space can be photographed.

[0122] As described above, according to the information processing system 1 according to the second embodiment, it is possible to provide a user with an evaluation result of evaluating a space in which a plurality of fashion items are displayed using a captured image of the space in which the plurality of fashion items are displayed.

[0123] Each function of the embodiments described above can be realized by one or more processing circuits. Here, the "processing circuit" in this specification means a processor programmed to execute each function by software like a processor implemented by an electronic circuit, an ASIC (Application Specific Integrated Circuit) designed to execute each function described above, a DSP (digital signal processor), an FPGA (field programmable gate array), and devices such as conventional circuit modules.

[0124] The device group described in the examples only shows one of a plurality of computing environments for implementing the embodiments disclosed in this specification. The present invention is not limited by this embodiment, and the components in this embodiment include those that can be easily conceived by those skilled in the art, substantially the same ones, and those within the so-called equivalent range. Furthermore, various omissions, substitutions, changes, and combinations of components can be made without departing from the gist of this embodiment.

Explanation of Signs

[0125] 1 Information processing system 10 Information processing device 12 Information processing terminal 14, 14a~14c Camera 18 Network 32 Detection unit 34 Ornament information generation unit 38 Evaluation information generation unit 40 Output unit 62 Display unit

Prior Art Documents

Patent Documents

[0126]

Patent Document 1

Claims

1. A detection unit that detects each piece of clothing from a photographed image of a space in which a plurality of clothing items are present; A clothing information generation unit that generates clothing information regarding each of the detected clothing items; An output unit that outputs an evaluation result evaluated based on each of the clothing information and information for evaluating the clothing; An information processing apparatus having the above.

2. The evaluation result is an evaluation result regarding the plurality of clothing items or each of the clothing items, or a space including the plurality of clothing items or each of the clothing items The information processing apparatus according to Claim 1.

3. An evaluation information generation unit that generates evaluation information indicating whether each of the clothing information is the same as or similar to information regarding clothing items included in trend information; The information processing apparatus according to Claim 1, further comprising the above.

4. The evaluation information generation unit generates the evaluation information according to the ratio of the clothing items among the plurality of clothing items present in the space, in which information that is the same as or similar to information regarding clothing items included in the trend information is included in each of the clothing information. The information processing apparatus according to Claim 3.

5. The trend information is information extracted by AI, and the evaluation information generation unit generates the evaluation information based on the result of calculating the similarity between each of the clothing information and the trend information by the AI. The information processing apparatus according to Claim 3.

6. The evaluation information generation unit calculates the ratio of the clothing information that includes information that is the same as or similar to information regarding clothing items included in the trend information among each of the clothing information, and generates the evaluation information based on the result of averaging the calculated values for the plurality of clothing items present in the space. The information processing apparatus according to Claim 3.

7. An evaluation information generation unit that generates evaluation information regarding the storage of the plurality of clothing items present in the space based on the detected plurality of clothing items, each of the clothing information, and information regarding the storage of the plurality of clothing items; The information processing apparatus according to Claim 1, further comprising the above.

8. The evaluation result includes information indicating the degree of conformity with the trend of the plurality of clothing items present in the space, the degree of conformity with the seasonal feeling, or the degree of conformity with an appropriate storage method. The information processing apparatus according to any one of Claims 1 to 7.

9. The space is a storage location where the plurality of clothing items are stored. The output unit outputs an evaluation result regarding the storage of the plurality of fashion items at the storage location. The information processing apparatus according to any one of claims 1 to 7.

10. The output unit outputs the evaluation result including information on the unnecessary fashion items from the plurality of fashion items existing in the space based on the evaluation information. The information processing apparatus according to any one of claims 3 to 7.

11. The space is a store in which the plurality of fashion items are stored, The output unit outputs an evaluation result regarding the store in which the plurality of fashion items are displayed, which is evaluated based on the fashion item information of each of the plurality of fashion items and information for evaluating the fashion items displayed in the store. The information processing apparatus according to any one of claims 1 to 7.

12. The photographed image is a 360-degree image photographed by a camera. The information processing apparatus according to any one of claims 1 to 7.

13. An information processing system having an information processing terminal operated by a user and an information processing apparatus communicably connected to the information processing terminal, The information processing apparatus, A detection unit that detects each fashion item from a photographed image of a space in which a plurality of fashion items exist, A fashion item information generation unit that generates fashion item information regarding each of the detected fashion items, An output unit that outputs an evaluation result evaluated based on the respective fashion item information and information for evaluating the fashion items, having, The information processing terminal, A display unit that displays the evaluation result, An information processing system.

14. The information processing apparatus, A detection step of detecting each fashion item from a photographed image of a space in which a plurality of fashion items exist, A fashion item information generation step of generating fashion item information regarding each of the detected fashion items, An output step of outputting an evaluation result evaluated based on the respective fashion item information and information for evaluating the fashion items, An information processing method.

15. Performed by an information processing apparatus, A detection step of detecting a plurality of fashion item images from a photographed image of a space in which a plurality of fashion items exist, A fashion item information generation step of generating fashion item information of each of the plurality of fashion items existing in the space from the detected plurality of fashion item images, An output step of outputting an evaluation result regarding the space, which is evaluated based on the fashion item information of each of the plurality of fashion items and information for evaluating the fashion items existing in the space, to a print medium The printed medium output by [

16. ] An information processing apparatus or an information processing terminal, A detection procedure for detecting each piece of clothing accessory image from a photographed image of a space where a plurality of clothing accessories are present, For each detected piece of clothing accessory, a clothing accessory information generation procedure for generating clothing accessory information regarding each piece of clothing accessory, An output procedure for outputting an evaluation result evaluated based on each of the clothing accessory information and information for evaluating the clothing accessory, A program for causing the above to be executed.

Images