Image data processing method, image data processing device, and image data processing system

Abstract

An image data processing method according to one embodiment of the present disclosure includes: acquiring first image data indicating a hyperspectral image of a subject captured under a first background light; generating first spectral data indicating an estimated spectrum of the first background light, on the basis of the first image data; and using the first spectral data and at least one type of second spectral data indicating the spectrum of at least one second background light different from the first background light to generate, from the first image data, second image data indicating an image of the subject illuminated by the second background light.

Description

[Technical field]

[0001] The present disclosure relates to an image data processing method, an image data processing device, and an image data processing system. [Background technology]

[0002] A multi-wavelength camera system, such as a hyperspectral camera or a multispectral camera, makes it possible to perform detailed analysis of the spectral information of captured images.

[0003] In an image captured by a camera, the reflection spectrum information of an object and the spectrum information of the background light irradiated on the object are superimposed. For example, if the spectrum of the background light when an object is photographed differs from the spectrum of the background light in the environment when a human visually recognizes the object, the information perceived by a human visually recognizing the object in the image and the actual object may differ.

[0004] Patent Document 1 discloses a color reproduction system that displays an image that has undergone color conversion processing in a server-side system on a monitor device of a user-side system. This system provides a web page that allows a user to select the type of lighting to be applied to the displayed product image and has a function of changing the appearance of the image according to the selected type of lighting. Patent Document 2 discloses a system that corrects the illuminance of a composite image that includes try-on clothing information, using illuminance information that indicates the illuminance in a specific building or the illuminance based on at least the weather in a specific region or location. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2009-124647 A [Patent Document 2] JP 2005-248393 A Summary of the Invention [Problem to be solved by the invention]

[0006] The present disclosure provides a method for improving the color fidelity of an image provided to a user. [Means for solving the problem]

[0007] An image data processing method according to one aspect of the present disclosure includes acquiring first image data indicating a hyperspectral image of an object photographed under a first background light, generating first spectral data indicating an estimated spectrum of the first background light based on the first image data, and generating at least one type of second spectral data indicating a spectrum of at least one second background light different from the first background light and using the first spectral data from the first image data, the second image data indicating an image of the object illuminated by the at least one second background light.

[0008] A comprehensive or specific aspect of the present disclosure may be realized by a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable recording disk, or may be realized by any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. The computer-readable recording medium may include a volatile recording medium or a non-volatile recording medium such as a CD-ROM (Compact Disc-Read Only Memory). The apparatus may be composed of one or more devices. When the apparatus is composed of two or more devices, the two or more devices may be arranged in one device, or may be arranged separately in two or more separate devices. In this specification and the claims, "apparatus" may mean not only one device, but also a system consisting of multiple devices. Effect of the Invention

[0009] According to one aspect of the present disclosure, it is possible to improve the color reproducibility of an image provided to a user.

[0010] Additional benefits and advantages of certain aspects of the present disclosure will become apparent from the specification and drawings, and the benefits and / or advantages may be provided individually by the various aspects and features disclosed in the specification and drawings, and not all are required to obtain one or more of them. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 illustrates a system configuration according to an exemplary embodiment. [Figure 2A] FIG. 1 is a diagram showing an example of data for one pixel in an image that contains information only in three general wavelength ranges: red, green, and blue. [Figure 2B] FIG. 1 is a diagram showing an example of data for one pixel in a hyperspectral image in which the wavelength ranges of red, green, and blue are each divided into three. [Figure 2C] FIG. 1 shows an example of a hyperspectral image in which the red, green, and blue wavelength ranges are each further divided into more components. [Diagram 3] FIG. 11 is a sequence diagram showing an example of the operations and data flows of a seller terminal, a server, and a user terminal. [Figure 4] FIG. 13 is a diagram illustrating an example of a web page displayed on a user terminal. [Diagram 5] 6 is a flowchart illustrating an example of an operation performed by a processor of a server. [Figure 6] FIG. 13 is a diagram showing an example of an image displayed on a seller terminal. [Figure 7] 13 is a flowchart showing a specific example of the solar spectrum estimation process in step S530. [Figure 8] FIG. 13 is a diagram showing an image of the contents recorded in a solar spectrum database stored in a memory. [Figure 9] 13 is a flowchart showing a specific example of the illumination light spectrum estimation process in step S550. [Figure 10A] FIG. 13 is a diagram showing an example of spectrum data of an LED lighting. [Figure 10B]FIG. 11 is a diagram illustrating an example of spectrum data of a fluorescent lamp. [Figure 10C] FIG. 2 is a diagram showing an example of spectrum data of an incandescent lamp. [Figure 11] FIG. 15 is a diagram showing three reference wavelength ranges enclosed by dashed lines in the example spectra shown in FIGS. 10A to 10C. [Figure 12] 13 is a flowchart showing the operation of step S550 in more detail. [Figure 13] 13 is a flowchart showing a specific example of the test image generating process in step S570. [Figure 14] 10 is a flowchart illustrating an example of a process executed by a processor of a seller terminal. [Figure 15] FIG. 11 is a sequence diagram showing another example of the processing executed by the server and the user terminal. [Figure 16] FIG. 11 is a diagram illustrating an example of a system further including an operator terminal used by an operator who operates a server. [Figure 17] FIG. 11 is a sequence diagram showing an outline of an operation in a modified example. [Figure 18] FIG. 11 is a sequence diagram showing an outline of an operation in another modified example. [Figure 19] FIG. 13 is a diagram showing a modified example in which the carrier terminal also functions as a server. [Figure 20] FIG. 11 is a sequence diagram showing the operation of a system according to another modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] In the present disclosure, all or part of a circuit, unit, device, member or part, or all or part of a functional block in a block diagram may be implemented by one or more electronic circuits including, for example, a semiconductor device, a semiconductor integrated circuit (IC), or an LSI (large scale integration). The LSI or IC may be integrated into one chip, or may be configured by combining multiple chips. For example, functional blocks other than memory elements may be integrated into one chip. Here, although it is called an LSI or an IC, the name may change depending on the degree of integration, and it may be called a system LSI, a VLSI (very large scale integration), or an ULSI (ultra large scale integration). A Field Programmable Gate Array (FPGA), which is programmed after the manufacture of the LSI, or a reconfigurable logic device, which can reconfigure the junction relationship inside the LSI or set up the circuit partition inside the LSI, can also be used for the same purpose.

[0013] Furthermore, all or part of the functions or operations of a circuit, unit, device, member, or section can be executed by software processing. In this case, the software is recorded in one or more non-transitory recording media such as ROMs, optical disks, hard disk drives, etc., and when the software is executed by a processor, the functions specified in the software are executed by the processor and peripheral devices. The system or device may include one or more non-transitory recording media on which the software is recorded, a processor, and necessary hardware devices, such as interfaces.

[0014] Before describing specific embodiments of the present disclosure, an overview of the embodiments of the present disclosure will be provided.

[0015] An image data processing method according to an exemplary embodiment of the present disclosure includes the following steps. (1) Obtaining first image data indicative of a hyperspectral image of an object captured under a first background light. (2) generating first spectral data indicating an estimated spectrum of the first background light based on the first image data; (3) Using the first spectral data and at least one type of second spectral data indicating a spectrum of at least one second background light different from the first background light, at least one type of second image data indicating an image of the object illuminated by the at least one second background light is generated from the first image data.

[0016] "Hyperspectral image" means an image that contains information of four or more wavelength ranges for each pixel. A hyperspectral image can be acquired, for example, by a hyperspectral camera that can acquire information of four or more wavelength ranges for each pixel.

[0017] According to the above configuration, first image data showing an image of an object under a first background light can be converted into second image data showing an image of the object under a second background light. This makes it possible to improve the color reproducibility of an image of an object, which is an object. In particular, according to the above configuration, first spectral data showing an estimated spectrum of the first background light is generated based on the first image data. This makes it possible to generate an image of an object under the second background light, unlike conventional techniques, even if the spectrum of the first background light at the time the object was photographed is unknown.

[0018] In one embodiment, the at least one second background light may include a plurality of second background lights different from each other. The at least one type of second image data may include a plurality of types of second image data. Each of the plurality of types of second image data may represent an image of the object illuminated by a respective one of the plurality of second background lights.

[0019] According to the above configuration, it is possible to generate images of the object under a plurality of types of second background light.

[0020] The plurality of second background lights may include sunlight and one or more artificial lighting lights.

[0021] According to the above configuration, images of an object can be generated under sunlight and one or more artificial lighting sources.

[0022] Generating the at least one type of second image data may include generating reflection spectrum data indicating a reflection spectrum of the object from the first image data using the first spectral data, and generating the at least one type of second image data using the reflection spectrum data and the at least one type of second spectral data.

[0023] Generating the first spectral data may include determining whether the hyperspectral image was taken outdoors or indoors based on the first image data, and generating the first spectral data using different processing depending on whether the hyperspectral image was taken outdoors or indoors.

[0024] According to the above configuration, the second image data can be generated by appropriate processing depending on whether the hyperspectral image of the object has been captured outdoors or indoors.

[0025] In the determining, if it is determined that the hyperspectral image was captured outdoors, generating the first spectral data may further include obtaining data indicating at least one selected from the group consisting of a date, a time, a location, and weather when the hyperspectral image was captured, obtaining sunlight spectral data associated with at least one selected from the group consisting of the date, the time, the location, and weather, and recording the sunlight spectral data on a recording medium as the first spectral data.

[0026] According to the above configuration, when a hyperspectral image of an object is captured outdoors, more appropriate second image data can be generated.

[0027] In the determining, when it is determined that the hyperspectral image was captured indoors, generating the first spectral data may further include estimating to which artificial illumination the first background light corresponds based on spectral data of at least one preset reference wavelength range extracted from the first image data, and recording the spectral data of the artificial illumination in a recording medium as the first spectral data.

[0028] According to the above configuration, when a hyperspectral image of an object is captured indoors, more appropriate second image data can be generated.

[0029] The at least one reference wavelength range may include a wavelength range belonging to the blue and a wavelength range belonging to the green.

[0030] According to the above configuration, it is possible to generate more accurate spectral data of artificial illumination.

[0031] The at least one reference wavelength range may include a wavelength range belonging to blue, a wavelength range belonging to green, and a wavelength range belonging to red.

[0032] According to the above configuration, it is possible to generate more accurate spectral data of artificial illumination.

[0033] The image data processing method may be executed by a server computer that provides a website for selling the object as a commodity via a network. The method may further include transmitting web page data including the at least one type of second image data to a user terminal used by a user of the website in response to a request from the user terminal.

[0034] An image data processing method according to another exemplary embodiment of the present disclosure is executed by a server computer that provides a website for selling products via a network, the method including: acquiring first image data representing a hyperspectral image of a first product captured under a first background light; generating first spectral data representing an estimated spectrum of the first background light based on the first image data; generating at least one type of second spectral data representing a spectrum of at least one second background light different from the first background light and at least one type of second image data representing an image of the first product illuminated by the at least one second background light from the first image data using the first spectral data; and transmitting data of a web page including the at least one type of second image data to a user terminal used by a user of the website in response to a request from the user terminal.

[0035] According to the above configuration, it is possible to appropriately process an image of a product such as clothing sold in electronic commerce and display it on a user terminal. In electronic commerce, a photo of a product displayed on a web page may give a different impression from the actual product. For example, if the spectrum of the illumination light used when the product was photographed is significantly different from the spectrum of the background light in the environment in which the purchaser uses the product, the impression of the product may be significantly different. According to the above configuration, it is possible for a user to check how the product looks under a desired background light before purchasing the product. Even if the spectrum of the background light when the product was photographed is unknown, it is possible to display an image of the product under a background light selected by the user. This can improve user satisfaction.

[0036] Obtaining the first image data may include receiving the first image data from a seller terminal used by a seller of the first product. The method may further include, after generating the at least one type of second image data, sending a request to the seller terminal for approval of the at least one type of second image data, and receiving data approving the at least one type of second image data from the seller terminal. Sending the web page data to the user terminal may be executed after receiving the data approving.

[0037] According to the above configuration, after the second image data is generated, the seller of the product can check the validity of the second image data. Only when approval is obtained from the seller, the second image data is used on the web page. This makes it possible to prevent, for example, inappropriate second image data from being posted on the web page.

[0038] Transmitting the web page data to the user terminal may include transmitting, in response to a first request from the user terminal, first web page data including default image data of the first product to the user terminal, and transmitting, in response to a second request from the user terminal, second web page data in which the default image data in the first web page has been replaced with the at least one type of second image data or in which the at least one type of second image data has been added to the default image data in the first web page.

[0039] According to the above configuration, for example, when a user viewing a first webpage requests the display of an image of a product under a second background light, i.e., a second image, a second webpage including the second image can be displayed.

[0040] The at least one second background light may include a plurality of second background lights. The first web page may include a display area for allowing a user to select one scene from a plurality of scenes associated with the plurality of second background lights, respectively.

[0041] According to the above configuration, by selecting one scene from the plurality of scenes, the user can check the image under the second background light associated with the selected scene.

[0042] The display area may include a plurality of regions each showing one of the plurality of scenes, and the plurality of regions may be displayed in the display area in an order according to the number of times each of the plurality of scenes has been selected on the website in the past.

[0043] According to the above configuration, a highly convenient web display is possible, in which the scenes for which the product has been selected more frequently are displayed higher up the list.

[0044] The second request may be received when one scene is selected from the plurality of scenes. The second web page may further include image data of at least one second product determined based on the number of times the second product is displayed in combination with the selected scene. Or, the second web page may further include image data showing at least one second product illuminated by a second background light associated with the selected scene from the plurality of second background lights.

[0045] According to the above configuration, images of other products that are considered to interest the user can be displayed on the second web page, allowing the user to know other products that match the scene selected by the user.

[0046] Obtaining the first image data may include receiving the first image data from a seller terminal used by a seller of the first product. Generating the first spectral data may further include determining whether the first background light can be identified based on spectral data of at least one preset reference wavelength range extracted from the first image data, and transmitting instruction data to the seller terminal to prompt the seller to capture the hyperspectral image of the product under background light different from the first background light when the first background light cannot be identified.

[0047] According to the above configuration, when the first background light cannot be identified, it is possible to notify the seller of this fact and to urge the seller to re-create the first image data.

[0048] The at least one reference wavelength range may include a wavelength range belonging to blue. The determining step may include determining that the first background light cannot be identified when an amount of a component in the wavelength range belonging to blue included in the spectral data of the at least one reference wavelength range is less than a reference value.

[0049] The product may be a clothing item, but is not limited to a clothing item and may be any other product such as furniture, automobiles, or electrical appliances.

[0050] The present disclosure also includes an image data processing apparatus comprising a computer for carrying out any of the methods described above, and a computer program for causing a computer to carry out any of the methods described above. A computer-readable recording medium according to one embodiment of the present disclosure is a computer-readable recording medium storing a program for processing image data, wherein when the program is executed by the computer, the following operations are executed: acquiring first image data indicating a hyperspectral image of an object photographed under a first background light; generating first spectral data indicating an estimated spectrum of the first background light based on the first image data; and generating at least one type of second spectral data indicating a spectrum of at least one second background light different from the first background light and at least one type of second image data indicating an image of the object illuminated by the at least one second background light from the first image data using the first spectral data. A computer-readable recording medium according to one embodiment of the present disclosure is a computer-readable recording medium storing a program for processing image data, wherein when the program is executed by the computer, the following operations are executed: acquiring first image data indicating a hyperspectral image of a first product photographed under a first background light; generating first spectral data indicating an estimated spectrum of the first background light based on the first image data; generating at least one type of second spectral data indicating a spectrum of at least one second background light different from the first background light and at least one type of second image data indicating an image of the first product illuminated by the at least one second background light from the first image data using the first spectral data; and transmitting webpage data including the at least one type of second image data to the user terminal in response to a request from the user terminal used by the website.

[0051] An image data processing system according to another embodiment of the present disclosure includes an image processing computer and a server computer that provides a website for selling products via a network. The image processing computer acquires first image data representing a hyperspectral image of the product photographed under a first background light, generates first spectral data representing an estimated spectrum of the first background light based on the first image data, and generates at least one type of second image data representing an image of the product illuminated by the at least one second background light from the first image data using at least one type of second spectral data representing a spectrum of at least one second background light different from the first background light and the first spectral data. The server computer transmits data of a web page including the at least one type of second image data to the user terminal in response to a request from the user terminal used by the website.

[0052] According to the above configuration, when the image processing computer that converts the first image data into the second image data is different from the server computer that transmits the web page data to the user terminal, the above-mentioned service can be provided.

[0053] Hereinafter, the embodiments of the present disclosure will be described in detail. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, components, arrangement and connection forms of components, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. In addition, among the components in the following embodiments, components that are not described in an independent claim showing the highest concept are described as optional components. In addition, each figure is a schematic diagram and is not necessarily illustrated strictly. Furthermore, in each figure, substantially the same or similar components are given the same reference numerals, and duplicated descriptions may be omitted or simplified.

[0054] (Embodiment 1) 1 is a diagram showing the configuration of the system of this embodiment. This system includes a seller terminal 100, a server 200 which is a server computer, and a user terminal 300. The server 200 is connected to the seller terminal 100 and the user terminal 300 via a network such as the Internet. The server 200 is also connected to a weather server 500 via the Internet or another network.

[0055] The server 200 functions as a data processing device that executes the data processing method of the present disclosure. The server 200 functions as a web server that generates data for a website that sells products such as clothing and furniture. The clothing and furniture may be, for example, clothes, shoes, bags, wallets, accessories, watches, and fashion goods.

[0056] The server 200 includes a processor 202, a memory 203, and a communication interface 204. The processor 202 executes the processes described below by executing a computer program stored in the memory 203. In response to a request from the user terminal 300, the server 200 generates website data and provides it to the user terminal 300.

[0057] The seller terminal 100 is a computer used by a seller who sells products posted on a website provided by the server 200. The seller may be a company, a store, or an individual. If the server 200 provides a web service such as a flea market site or an auction site, the seller may include an individual. The business providing the web service may itself be the seller.

[0058] The seller terminal 100 may be any computer, such as a smartphone, a tablet computer, or a personal computer. The seller terminal 100 in this embodiment includes a camera 101, which is a hyperspectral camera, a processor 102, a memory 103, a communication interface 104, and a display 105. The camera 101 is built into the seller terminal 100 in this embodiment, but may be an external element of the seller terminal 100.

[0059] The camera 101 is an imaging device capable of acquiring a hyperspectral image. A hyperspectral image means an image including information on wavelength ranges more than the three general wavelength ranges of red, green, and blue. An example of a hyperspectral image is an image including information on wavelength ranges of four or more wavelength bands. Another example of a hyperspectral image is an image including information on wavelength ranges of ten or more wavelength bands. In this specification, the wavelength range of visible light is 380 nm to 750 nm, the wavelength range of blue is 380 nm to 500 nm, the wavelength range of green is 500 nm to 600 nm, and the wavelength range of red is 600 nm to 750 nm.

[0060] FIG. 2A is a diagram showing an example of data of one pixel in an image containing only information of three general wavelength ranges of red (R), green (G), and blue (B). FIG. 2B is a diagram showing an example of data of one pixel in a hyperspectral image in which each of the red, green, and blue wavelength ranges is divided into three. FIG. 2C is a diagram showing an example of a hyperspectral image in which each of the red, green, and blue wavelength ranges is further divided into more components. The camera 101 in this embodiment acquires a hyperspectral image in which each pixel has data such as that shown in FIG. 2B or FIG. 2C. The camera 101 may include a hyperspectral image sensor capable of acquiring data of four or more wavelength ranges within the wavelength range of visible light for each pixel, and an optical system including one or more lenses.

[0061] The processor 102 controls the operation of the seller terminal 100 by executing a program stored in the memory 103. The processor 102 transmits, for example, hyperspectral image data of a product captured by the camera 101 to the server 200 via the communication interface 104. The processor 102 also causes the display 105 to display an image of an application for uploading hyperspectral image data.

[0062] The hyperspectral image data may include time stamp data indicating the date and time of capture. The seller terminal 100 may include a GPS (Global Positioning System) receiver. The seller terminal 100 may include data indicating the position (e.g., latitude and / or longitude) measured by the GPS receiver in the uploaded data. The capture time and position data may be used by the server 200 in a process of estimating the solar spectrum when the image is captured outdoors.

[0063] The user terminal 300 is a computer used by a user who wishes to purchase a product posted on a website provided by the server 200. In reality, there may be many users and many user terminals 300, but FIG. 1 illustrates only one of the multiple user terminals 300 as a representative. The user terminal 300 may be any computer, such as a smartphone, a tablet computer, or a personal computer. The user terminal 300 includes a processor 302, a memory 303, a communication interface 304, and a display 305.

[0064] Processor 302 controls the operation of user terminal 300 by executing a program stored in memory 303. Processor 302 requests web page data from server 200 in accordance with a user's operation. Processor 302 causes display 305 to display an image based on the data obtained from server 200.

[0065] The weather server 500 is a server that records weather data for each date and time in each location. The server 200 can obtain from the weather server 500 the weather data for the date and time and location at which the hyperspectral image was generated.

[0066] 3 is a sequence diagram showing an example of the operations and data flow of the seller terminal 100, the server 200, and the user terminal 300. An overview of the operation of the system of this embodiment will be described with reference to FIG.

[0067] A seller uses a hyperspectral camera, camera 101, to generate a hyperspectral image of a product to be sold (step S101). The seller uses a seller terminal 100 to upload data of the hyperspectral image. This image data is referred to as "first image data." Also, the background light in the environment in which the product is photographed is referred to as "first background light." The first background light may be artificial lighting or sunlight.

[0068] The server 200 acquires the uploaded first image data. Then, the server 200 estimates the spectrum of the first background light based on the first image data (step S201). A specific example of the operation of estimating the spectrum of the first background light will be described later. The server 200 generates first spectral data indicating the estimated spectrum of the first background light. The server 200 records the generated first spectral data in a recording medium such as the memory 203.

[0069] Next, the server 200 generates product reflection spectrum data from the first image data using the first spectrum data (step S202). For example, the product reflection spectrum data can be generated by dividing the value for each wavelength of each pixel in the first image data by the value of the corresponding wavelength in the first spectrum data.

[0070] Next, the server 200 generates second image data showing an image of the above-mentioned product under each virtual background light by using the reflected spectrum data and the spectrum data of one or more virtual background lights previously recorded in a recording medium such as the memory 203 (step S203). The virtual background light is referred to as a "second background light", and the spectrum data of the virtual background light is referred to as "second spectrum data". Here, the virtual background light refers to a background light associated with a scene selectable by a user who makes a purchase on a website provided by the server 200. The selectable scenes may include, for example, outdoor (daytime), outdoor (evening), indoor (warm LED), indoor (neutral white LED), or indoor (fluorescent light). Thus, the virtual background light may include, for example, sunlight, LED lighting light, fluorescent light light, or incandescent light bulb light.

[0071] When the server 200 generates the second image data corresponding to each scene, it transmits a request for approval of each second image data to the seller terminal 100. When the seller terminal 100 receives this request, it displays on the display 105 an image based on each second image data and an image for selecting whether or not to approve each second image data. These images may be displayed immediately after the hyperspectral image is uploaded, or may be displayed after a while. The seller performs an approval operation for the second image data of each scene according to the instructions of the displayed image (step S102). When the seller approves, the seller terminal 100 transmits data to the server 200 indicating that the second image data is approved. After receiving the data indicating the approval, the server 200 lists the product on a sales web page and starts accepting purchases.

[0072] After that, the user can purchase the product. When the user makes a request to access a sales web page for the product (step S301), the server 200 transmits data of the web page to the user terminal 300. When the product is selected in the user terminal 300 (step S302), the server 200 transmits data of the web page including default image data of the product. The default image data may be, for example, first image data uploaded by the seller terminal 100, or may be data obtained by processing the first image data. An image for selecting one scene from a plurality of scenes may be displayed on the display 305 of the user terminal 300 together with an image of the product. When the user selects one scene (step S303), the user terminal 300 requests data of a web page including image data associated with the selected scene from the server 200. In response to this request, the server 200 transmits data of a web page in which the default image data has been replaced with second image data corresponding to the selected scene. Alternatively, the server 200 transmits data of a web page in which the second image data corresponding to the selected scene has been added to the default image data. The user terminal 300 receives this data and displays an image of the requested scene on the display 305 .

[0073] FIG. 4 is a diagram showing an example of a webpage displayed on the user terminal 300. The webpage in this example includes a plurality of images 810 showing styling examples of clothing selected by the user, and a display area 820 of a plurality of selectable scenes. The plurality of scenes in this example include outdoor (daytime), outdoor (evening), indoor (warm LED), indoor (neutral white LED), indoor (fluorescent light), and indoor (incandescent light). When the user selects one of the plurality of scenes, the image 810 changes according to the selected scene. The layout of the webpage and the displayed contents are not limited to the illustrated example. For example, each scene may be displayed in the form of a thumbnail, not limited to text. The plurality of scenes may be set, for example, in terms of time and location. In addition to the illustrated scenes, scenes such as outdoor (night) or a party may be selectable. Not only the color of the image 810 but also the background itself may change depending on the selected scene. If image data of the background and image data of a person wearing the clothing are recorded separately, the combination of the background and the person can be changed arbitrarily.

[0074] The server 200 may change the order of the scenes in the display area 820 of the multiple scenes depending on the selected product. For example, the multiple scenes may be displayed in an order according to the number of times each scene has been selected by multiple users for the product on the website in the past. For each product, the scene that has been selected more frequently in the past may be displayed higher, or the second image data associated with the scene that has been selected most frequently in the past may be displayed by default. Such a display allows the user to know the combination of popular scenes and the product.

[0075] The web page data transmitted by the server 200 when the user selects one scene may further include an image of at least one other product. For example, an image showing the at least one other product under a virtual background light corresponding to the selected scene may be added. The at least one other product may be a product previously selected by the user, or may be determined from the user's Internet search history. The at least one other product may also be determined based on the number of times it has been displayed in combination with the selected scene. For example, the web page data may include image data of one or more other products that have been displayed most frequently in combination with the selected scene. Images of such other products may be displayed as recommended products on the side or bottom of the screen, for example, as in image 830 shown in FIG. 4. Such a display allows the user to easily know other popular products that match the selected scene. In the example of FIG. 4, only one image 830 of the other product is displayed, and the image 830 is switched to an image of another candidate product by pressing a triangular mark displayed in the upper right and upper left of the image 830. Instead of such a display form, for example, a form in which images of multiple other products are displayed on one screen may be used.

[0076] In the example shown in Fig. 3, after generating the second image data for various scenes, the server 200 transmits a request to the seller terminal 100 to obtain approval for the second image data, but this approval process may be omitted. In that case, the second image data generated in step S203 is used as is for the image to be posted on the website. In this example, the server 200 generates the second image data in step S203 before posting it on the website. The present invention is not limited to this example, and the server 200 may generate the second image data after a scene is selected by the user in step S303.

[0077] Next, the operation of the server 200 in this embodiment will be described in more detail.

[0078] Fig. 5 is a flowchart showing an example of the operation executed by the processor 202 of the server 200. In this example, the server 200 executes the processes of steps S510 to S590 shown in Fig. 5. The operation of each step will be described below.

[0079] In step S510, the server 200 receives, from the seller terminal 100, first image data representing a hyperspectral image of the product captured under a first background light.

[0080] Next, the server 200 judges whether the product was photographed outdoors or indoors based on the received first image data. The server 200 estimates the spectrum data of the first background light by different processes depending on whether the product was photographed outdoors or indoors. In the example shown in FIG. 5, the server 200 first judges whether the photograph was taken outdoors or indoors based on the contents of the first image data in step S520. If this judgment is Yes, the process proceeds to step S530. If this judgment is No, the process proceeds to step S540, where the server 200 judges whether the photograph was taken indoors or indoors based on the contents of the first image data. If this judgment is Yes, the process proceeds to step S550. If this judgment is No, the process proceeds to step S590.

[0081] In step S590, the server 200 transmits an error notification to the seller terminal 100 indicating that the shooting environment could not be identified. In addition to this notification, the server 200 may transmit instruction data to the seller terminal 100 to encourage the seller terminal 100 to take a picture of the product in a different environment. When the seller terminal 100 receives the instruction data, it displays an image on the display 105 encouraging the seller terminal 100 to take a picture of the product in a different environment. For example, as shown in FIG. 6, a message such as "The background light cannot be identified. Please take the picture again in front of a white wall or the like" may be displayed. The content of the message may also be a simple instruction to take the picture again or to change the shooting location.

[0082] In steps S520 and S540, whether the image was taken outdoors or indoors can be determined from the first image data using a predetermined image recognition algorithm. For example, if an object existing outdoors, such as the sky, clouds, trees, buildings, vehicles, roads, mountains, or rivers, is recognized in the image, it can be determined that the image was taken outdoors. Also, if an object mainly existing indoors, such as a wall, electrical appliances, carpets, or furniture, is recognized in the image, it can be determined that the image was taken indoors. Alternatively, it can be estimated whether the image was taken outdoors or indoors from the overall brightness and / or color tone of the image. The server 200 can determine whether the image was taken outdoors or indoors based on these various factors. Alternatively, it can be determined whether the image was taken outdoors or indoors by applying a learned model trained by a machine learning algorithm to the first image data.

[0083] If the server 200 determines that the image was captured outdoors, it performs a process of estimating the spectrum of sunlight, which is the background light, in step S530. On the other hand, if the server 200 determines that the image was captured indoors, it performs a process of estimating the spectrum of illumination light, which is the background light, in step S550.

[0084] 7 is a flow chart showing a specific example of the solar spectrum estimation process in step S530. Step S530 includes the processes of steps S531 to S535 shown in FIG.

[0085] In step S531, the server 200 identifies the date and time of the image from the time stamp of the uploaded hyperspectral image. In step S532, the server 200 identifies the location of the image from the position data acquired by the GPS receiver. In step S533, the server 200 accesses the weather server 500 to identify the weather on the date, time, and location of the image. Note that the order of steps S531 to S533 may be interchanged. In step S534, the server 200 refers to a database stored in advance in the memory 203 to acquire solar spectrum data corresponding to the identified date, time, location, and weather. In the following step S535, the server 200 records the acquired solar spectrum data in the memory 203 as an estimated background light spectrum.

[0086] FIG. 8 is a diagram showing an image of the contents recorded in the solar spectrum database stored in the memory 203. In this example, the database records a combination of the photographing date and time, location, and weather in association with solar spectrum data. Such data is recorded in advance in the memory 203 or other recording media. The server 200 can obtain solar spectrum data corresponding to the photographing date, time, location, and weather by referring to such a database. Note that, for ease of understanding, FIG. 8 shows the spectrum data as a graph, but in reality, data indicating the intensity for each wavelength is recorded. Also, in FIG. 8, location data is recorded for each rough city, but data may be recorded for each smaller area of ​​each city.

[0087] Fig. 9 is a flowchart showing a specific example of the process of estimating the illumination light spectrum in step S550. Step S550 includes the processes of steps S551 to S557 shown in Fig. 9. The spectrum of the illumination light, which is the indoor background light, can be estimated by extracting features from the spectrum of the object or background in the image.

[0088] In step S551, the server 200 selects a part of the region estimated to be close to white from the acquired hyperspectral image. For example, a region of a background or an object estimated to be close to white may be selected. Whether or not the color is close to white may be determined based on the ratio of components in three wavelength ranges, red, green, and blue. For example, a red object has extremely low reflectance of blue and green components, so there is insufficient information for estimating the spectrum of the illumination light. On the other hand, for example, from a region where the reflectance spectrum components are not zero over the range from 400 nm to 700 nm where humans have visual sensitivity, sufficient information for estimating the spectrum of the illumination light can be obtained. In particular, the spectrum of the illumination light can be estimated with high accuracy from an object with small variation in reflectance over the visible range.

[0089] In step S552, the server 200 extracts (1) a 440-460 nm component, (2) a 540-560 nm component, and (3) a 600-650 nm component from the data of one or more pixels in the selected region. Hereinafter, these three wavelength ranges are referred to as "reference wavelength ranges."

[0090] In step S553, the server 200 judges whether the components of the three reference wavelength bands are present. For example, it judges whether the average value of the values ​​of each reference wavelength band in the plurality of pixels included in the region selected in step S551 exceeds a predetermined threshold value for each reference wavelength band. If this judgment is Yes, the process proceeds to step S554. If this judgment is No, the process proceeds to step S557.

[0091] Step S557 is the same process as step S590 described above. In step S557, the server 200 transmits a notification to the seller terminal 100 that the background light could not be identified. In addition to this notification, the server 200 may transmit instruction data to the seller terminal 100 to prompt the seller terminal 100 to change the background image. For example, the server 200 may transmit instruction data to the seller terminal 100 to prompt the seller terminal 100 to take a picture of the product in a different environment. When the seller terminal 100 receives the instruction data, it displays an image on the display 105 to prompt the seller terminal 100 to take a picture of the product in a different environment. For example, a message as shown in FIG. 6 may be displayed on the display 105. The content of the message may simply instruct the seller to take the picture again or to change the shooting location.

[0092] If data for all components (1) to (3) are available, the process proceeds to step S554, where server 200 refers to the spectrum data of a plurality of illumination lights stored in memory 203 to determine the type of illumination light. Since the spectrum of illumination light has characteristics according to the illumination light emission method, the type of illumination can be identified by capturing the characteristics from the hyperspectral data. Server 200 further estimates the color temperature according to the determined illumination in step S555. Details of this process will be described below.

[0093] Spectral data for a plurality of types of lighting is recorded in advance in memory 203. The types of lighting include, for example, LED lighting, fluorescent lighting, and incandescent lighting. Since the spectral shape has characteristics depending on the light emission method, general spectral data may be stored for each type of lighting. Alternatively, data for a plurality of lightings may be prepared according to the model numbers of the manufacturers for each type of lighting.

[0094] 10A to 10C are diagrams showing examples of spectral data of illumination light stored in memory 203. Fig. 10A shows an example of spectral data of an LED lamp. Fig. 10B shows an example of spectral data of a fluorescent lamp. Fig. 10C shows an example of spectral data of an incandescent lamp. In addition to the spectra shown in Figs. 10A to 10C, memory 203 may also store spectral data of other types of light sources, such as a halogen light bulb.

[0095] FIG. 11 shows the above three reference wavelength ranges in the example of the spectrum shown in FIG. 10A to FIG. 10C, framed by dashed lines. LED lighting generates white light by exciting phosphors (yellow and red) with blue light from a blue LED. Therefore, the light from LED lighting has a blue peak and a green to red peak. In many cases, the blue peak is caused by the emission of 440 nm to 460 nm from a GaN semiconductor LED, the green to yellow peak is caused by the emission of YAG phosphor, and the red peak is caused by the emission of 600 nm to 650 nm from a CASN phosphor. The color temperature is adjusted by adjusting the ratio of these three wavelength ranges. If there is a peak in the wavelength range of 440 nm to 460 nm belonging to blue and a spectrum bottom around 480 nm, it can be estimated that the lighting is LED lighting. In addition, the color temperature can also be estimated from the components of the wavelength range of 530 nm to 550 nm belonging to green and the wavelength range of 600 nm to 650 nm belonging to red.

[0096] Fluorescent lamps are made up of a combination of broadband phosphors and narrowband phosphors. Fluorescent lamps have a peak at around 440 nm caused by phosphor emission. This characteristic is similar to that of LED lighting, but they differ from LED lighting in that they also have a sharp peak at around 550 nm caused by phosphor emission. By detecting this peak by comparing the amount of components from 540 nm to 560 nm with the amount of components of those surrounding wavelengths, it is possible to determine that the illumination light is fluorescent.

[0097] Incandescent lamps have the characteristic that there is no peak and that the spectral intensity increases as the wavelength becomes longer. It is possible to distinguish between LED lighting, fluorescent lamps, and incandescent lamps from the ratio of components in a total of four wavelength ranges: two wavelength ranges from 440nm to 460nm and 540nm to 560nm, and the surrounding wavelength ranges.

[0098] Furthermore, taking into account the red 600nm to 650nm component also improves the accuracy of the estimation, especially for incandescent lighting.

[0099] In step S556 of FIG. 9, after estimating the type and color temperature of the illumination, the server 200 stores in the memory 203 the spectrum data of the estimated illumination light.

[0100] In this embodiment, the wavelength ranges of 440 nm to 460 nm, 540 nm to 560 nm, and 600 nm to 650 nm are selected as three reference wavelength ranges, and the spectrum of the illumination light is estimated based on the components of these wavelength ranges, but this is merely an example. For example, as shown in FIG. 12, the wavelength range of 600 nm to 650 nm may be excluded from the reference wavelength range. In the example of FIG. 12, in step S552, only the components of 440 nm to 460 nm and the components of 540 nm to 560 nm are extracted. In addition, in step S553, it is determined whether the components of 440 nm to 460 nm and the components of 540 nm to 560 nm are present. As in this example, the type of illumination and the color temperature can be estimated in many cases by only considering the information of the wavelength range belonging to blue and the wavelength range belonging to green. Alternatively, only the wavelength range belonging to blue may be set as the reference wavelength range. If the amount of blue spectral components included in the spectral data in the reference wavelength range is less than a reference value, it may be determined that the first background light cannot be identified.

[0101] Referring again to Fig. 5, when the spectrum of background light is estimated by the process of step S530 or S550, the server 200 generates a test image for each scene in step S570. Data of the test image is sent to the seller terminal 100. When the test image is approved by the seller, the server 200 records the test image data for each scene, i.e., the second image data, in a recording medium such as the memory 203 in step S580.

[0102] 13 is a flowchart showing a specific example of the test image generation process in step S570. After estimating the background light spectrum, server 200 calculates the absolute reflectance spectrum of the target product (step S571). Server 200 normalizes the hyperspectral image of the product with the estimated background light spectrum. Specifically, server 200 generates reflectance spectrum data of the product by dividing the value of each wavelength of each pixel of the hyperspectral image of the product by the value of the corresponding wavelength of the estimated background light spectrum. This reflectance spectrum is referred to as the "absolute reflectance spectrum."

[0103] Next, the server 200 acquires the spectral data of the virtual background light of each scene from the memory 203 (step S572).

[0104] Next, the server 200 generates a test image for each scene using the calculated product reflectance spectrum and the acquired virtual background light spectrum of each scene (step S573). Specifically, the server 200 calculates the value of each pixel in the test image of the scene by multiplying each wavelength value of the product reflectance spectrum by the corresponding wavelength value in the virtual background light spectrum.

[0105] Once the test images for each scene have been generated, the server 200 transmits the data of the test images to the seller terminal 100, which is the uploader (step S574). Upon receiving the test image data, the seller terminal 100 displays the test images and a screen inquiring whether or not to approve the test images on the display 105. The seller selects whether or not to approve in accordance with the display. Once the seller selects whether or not to approve, the seller terminal 100 transmits data indicating the approval result to the server 200.

[0106] The server 200 judges whether an approval result has been received from the seller terminal 100 (step S575). If an approval result has been received, the server 200 judges whether the test data has been approved (step S576). If approved, the server 200 sets the test image of each scene as an image to be actually used on the website (step S577). In this case, it is judged that the estimation of the background light spectrum and the calculation of the absolute reflectance spectrum of the product were correct, and the generated test image is adopted. If not approved, the server 200 transmits data to the seller terminal 100 indicating that the image should be retaken (step S578). In this case, it is considered that there was an error in the estimation of the background spectrum. For this reason, similar to step S590 shown in FIG. 5 and step S557 shown in FIG. 9, data indicating an error display, an instruction to take a picture again, an instruction to change the shooting location, or an instruction to take a picture in front of a white wall may be transmitted to the seller terminal 100.

[0107] FIG. 14 is a flowchart showing an example of a process executed by the processor 102 of the seller terminal 100 in this embodiment. In this example, the seller terminal 100 first acquires data of a hyperspectral image generated by the camera 101 from the memory 103 in step S610. When an upload instruction operation is received from the seller in step S620, the seller terminal 100 uploads the image data to the server 200 (step S630). Then, the seller terminal 100 waits until a test image is transmitted from the server 200 (step S640). When the test image is received, the seller terminal 100 displays the test image and an approval confirmation screen (step S650). As described above, the test images, which are candidate images of each scene generated by the server 200, and a screen for selecting whether or not to approve each test image are displayed on the display 105. When the seller selects whether or not to approve in step S660, the seller terminal 100 transmits the approval result to the server 200 (step S670).

[0108] If the server 200 is unable to estimate the background light spectrum for the uploaded image after step S630, a notification to that effect may be sent from the server 200. In this case, for example, an instruction to prompt the user to take the image again may be displayed on the display 105. Also, if the user selects in step S660 to not approve the test image, for example, an instruction to prompt the user to take the image again may be displayed on the display 105 after step S670.

[0109] 15 is a sequence diagram showing another example of the process executed by the server 200 and the user terminal 300. In this example, after the purchasing user selects a scene, the server 200 generates second image data corresponding to the selected scene.

[0110] First, the user terminal 300 displays a web page (step S731). The user who is to purchase selects a desired product and scene on the web page (step S732). The server 200 acquires image data associated with the selected product and scene from the memory 203 (step S721). This image data may include, for example, image data of a background that matches the scene. Next, the server 200 acquires background light spectrum data corresponding to the selected scene from the memory 203 (step S722). The server 200 also acquires reflection spectrum data of the product calculated in advance by the above-mentioned method from the memory 203 (step S723). The server 200 uses the data acquired in steps S721 to S723 to generate image data of the product and scene to be displayed (step S724). In step S724, the server 200 first generates image data of the product to be displayed by multiplying the reflection spectrum data and the background light spectrum data of the selected scene for each pixel. This image data is combined with the image data acquired in step S721 to generate image data of the selected product and scene. The user terminal 300 displays the image of the product and scene based on the data transmitted from the server 200 (step S733).

[0111] As described above, according to this embodiment, even if the background light at the time of photographing the product is unknown, the image displayed can be appropriately corrected according to the scene selected by the user. The user can check how the product looks in the desired scene before purchasing. This makes it possible to prevent problems such as the impression being different between the displayed product image and the actual product.

[0112] (Modification) Next, some modifications of this embodiment will be described.

[0113] FIG. 16 is a diagram showing an example of a system further including a business operator terminal 400 used by a business operator who operates the server 200. The business operator terminal 400 is a computer including a processor 402, a memory 403, a display 405, and a communication IF 404. FIG. 17 is a sequence diagram showing an overview of the operation in this modification. As shown in FIG. 17, in this example, the approval operation after the seller terminal 100 uploads the hyperspectral image to the server 200 is performed by the business operator terminal 400, not the seller terminal 100. In this way, the generation of the second image data and the subsequent approval may be performed by the same business operator.

[0114] 18, the processes of steps S201 to S203 may be performed on the business operator terminal 400, and the generated second image data may be uploaded to the server 200 that provides the web service. Alternatively, among steps S201 to S203, only steps S201 and S202 may be performed on the business operator terminal 400, the generated reflection spectrum data of the product may be uploaded to the server 200, and the generation of the second image (step S203) may be performed on the server 200. Alternatively, among steps S201 to S203, only step S201 may be performed on the business operator terminal 400, the generated first spectrum data may be uploaded to the server 200 together with the first image, and the calculation of the reflection spectrum of the product (step S202) and the generation of the second image (step S203) may be performed on the server 200.

[0115] 19 is a diagram showing a modified example in which the operator terminal 400 also functions as the server 200. As in this example, the above-mentioned web service may be provided by using the operator terminal 400, which is a general-purpose computer such as a personal computer, without installing a dedicated server.

[0116] In each of the above examples, the seller terminal 100 is used by a user different from the business operator who operates the web service, but this is not limited to the above. There are also cases where the business operator who operates the web service sells the product itself. In such a case, the seller terminal 100 is used by the business operator.

[0117] FIG. 20 is a sequence diagram showing the operation of a system according to another modified example. The configuration in this modified example is similar to the configuration shown in FIG. 1, but the operation of the server 200 is different. In this example, the server 200 generates the second image data of each scene in step S203, and then in step S910, judges the condition of the product, determines the price or a discount rate from the list price, and notifies the seller terminal 100 of the judgment result. The server 200 judges the quality of the material, scratches, aging, etc. of the product based on the reflection spectrum of the product calculated in step S202. For example, products sold in the past, data on the reflection spectrum, and prices are associated and recorded in a recording medium such as the memory 203. Based on the accumulated data, the condition of the product shown in the uploaded image can be judged and an appropriate price can be estimated. The condition and price of the product may be determined, for example, by using a learning model trained in advance by a machine learning algorithm. Based on a huge amount of data accumulated in the past, the condition and appropriate price of the product shown in the uploaded image can be automatically judged.

[0118] The judgment result is fed back to the seller terminal 100. The seller decides whether to approve the proposed price (step S920). At this time, it may be possible to input whether the judgment results regarding the material, scratches, usability, etc. are correct. The input result of the judgment may be recorded in the memory 203 of the server 200 and displayed as reference information when viewed by the purchasing user. Also, a mechanism may be provided whereby the purchasing user evaluates the judgment result of the seller as to whether it is correct or not. This makes it possible to monitor whether the seller is giving an inappropriate evaluation of his / her own product.

[0119] In this specification, an example of applying the image processing technique of the present disclosure to images of products sold mainly through online shopping has been described, but the technique of the present disclosure is not limited to such images of products and can be applied to hyperspectral images of any item. [Industrial Applicability]

[0120] The technology of the present disclosure can be used, for example, to process hyperspectral images of an item. The technology of the present disclosure can be used, for example, to process images of products sold through online shopping using a network such as the Internet. [Explanation of symbols]

[0121] 100 Merchant Terminals 101 Camera 102 processors 103 Memory 104 Communication Interface 105 Display 200 Servers 202 Processor 203 Memory 204 Communication Interface 300 User terminals 302 Processor 303 Memory 304 Communication Interface 305 Display 400 Operator terminal 402 processor 403 Memory 404 Communication Interface 500 Weather Server

Claims

1. 1. An image data processing method executed by a server computer that provides a website for selling products via a network, comprising: acquiring first image data indicative of a hyperspectral image of a first product captured under a first background light; obtaining first spectral data indicative of an estimated spectrum of the first background light based on the first image data; generating, from the first image data, at least one type of second image data representing an image of the first product illuminated by the at least one second background light, using the first spectral data and at least one type of second spectral data representing a spectrum of at least one second background light different from the first background light; Responding to a request from a user terminal used by a user of the website, transmitting web page data including the at least one type of second image data to the user terminal; Including, acquiring the first image data includes receiving the first image data from a seller terminal used by a seller of the first product; Obtaining the first spectral data includes: determining whether the first background light can be identified based on the first image data; When the first background light cannot be identified, transmitting instruction data to the seller terminal to prompt the seller terminal to capture the hyperspectral image of the product under background light different from the first background light; Including, method.

2. The method further comprises: After generating the at least one type of second image data, sending a request for approval of the at least one type of second image data to the seller terminal; receiving data approving the at least one type of second image data from the seller terminal; Including, transmitting the web page data to the user terminal after receiving the data indicating approval; The method of claim 1.

3. Transmitting the web page data to the user terminal includes: In response to a first request from the user terminal, transmitting data of a first web page including default image data of the first product to the user terminal; and transmitting to the user terminal, in response to a second request from the user terminal, data of a second web page in which the default image data in the first web page is replaced with the at least one type of second image data or in which the at least one type of second image data is added to the default image data in the first web page. The method according to claim 1 or 2.

4. the at least one second background light includes a plurality of second background lights; the first web page includes a display area for allowing a user to select one scene from a plurality of scenes associated with the plurality of second background lights, respectively; The method according to claim 3.

5. the display area includes a plurality of areas each showing the plurality of scenes, In the display area, the plurality of areas are displayed in an order according to the number of times each of the plurality of scenes has been selected on the website in the past. The method according to claim 4.

6. receiving the second request when a scene is selected from the plurality of scenes; the second web page further includes image data of at least one second product determined based on the number of times the second product has been displayed in combination with the selected scene. The method according to claim 4 or 5.

7. receiving the second request when a scene is selected from the plurality of scenes; the second web page further includes image data showing at least one second product illuminated by a second background light associated with a selected one of the plurality of second background lights; The method according to claim 4 or 5.

8. Determining whether or not it is possible to identify the first background light includes determining whether or not it is possible to identify the first background light based on spectral data of at least one preset reference wavelength range extracted from the first image data. The method according to any one of claims 1 to 7.

9. The at least one reference wavelength range includes a wavelength range belonging to blue, the determining step includes determining that the first background light cannot be identified when an amount of a component in the wavelength range belonging to blue included in the spectral data of the at least one reference wavelength range is less than a reference value. The method according to claim 8.

10. The first product is an accessory.

10. The method according to any one of claims 1 to 9.

11. The hyperspectral image includes information of at least four wavelength ranges.

11. The method according to any one of claims 1 to 10.

12. An image data processing apparatus comprising a computer for carrying out the method according to any one of claims 1 to 11.

13. A computer program product causing a computer to carry out a method according to any one of claims 1 to 11.

14. 1. An image data processing system, comprising: an image processing computer; A server computer that provides a website for selling products via a network, The image processing computer includes: acquiring first image data indicative of a hyperspectral image of the product captured under a first background light; obtaining first spectral data indicative of an estimated spectrum of the first background light based on the first image data; generating, from the first image data, at least one type of second image data representing an image of the product illuminated by the at least one second background light, using the first spectral data and at least one type of second spectral data representing a spectrum of at least one second background light different from the first background light; The server computer, In response to a request from a user terminal used by a user of the website, data of a web page including the at least one type of second image data is transmitted to the user terminal; The image processing computer includes: receiving the first image data from a seller terminal used by a seller of the product; determining whether the first background light can be identified based on the first image data; If the first background light cannot be identified, instruction data is sent to the seller terminal to prompt the seller terminal to capture the hyperspectral image of the product under background light different from the first background light. Image data processing system.

Images