Information provision system

Abstract

To obtain not only the name and price but also various other related information about an object.SOLUTION: An information provision system 100 includes a user terminal 10 equipped with an imaging unit configured to capture an object image, and a server computer 40 connected to the user terminal 10 via a communication network 20 for obtaining related information about the object. The server computer 40 includes a learning unit 44-2 as an identification unit configured to identify an object classification based on the object image captured by the imaging unit, and an object database 46 that outputs related information about the object, including its environmental load, based on the classification identified by the learning unit 44-2. The related information output from the object database 46 is provided to the user terminal 10.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information providing system that provides information about an image of an object. [Background technology]

[0002] Conventionally, user devices such as smartphones have various functions, and by installing a specific application, when a photograph of an object such as a flower or animal is taken, the name of the object can be displayed. This is because when an image is taken on a mobile device, the image is sent to a server computer associated with the application, and this server computer creates related information and sends it back to the device.

[0003] Furthermore, Patent Document 1 discloses a system that provides price information of an item using an image of the item. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-52672 Summary of the Invention [Problem to be solved by the invention]

[0005] Here, it would be useful to be able to see not only the name and price of the object, but also various other related information. [Means for solving the problem]

[0006] The information provision system of the present disclosure includes a user terminal having an imaging unit that acquires an image of an object, and a server computer that is connected to the user terminal via a communication network and acquires related information of the object, the server computer including an identification unit that identifies the classification of the object based on the object image acquired by the imaging unit, and an object database that outputs related information about the object, including its environmental impact, based on the classification identified by the identification unit, and provides the related information output from the object database to the user terminal.

[0007] The object database may be configured to output, in correspondence with the classification, information on the environmental load and recommendations for reducing the environmental load for the object of the classification.

[0008] The related information may include information related to the life cycle of the object, including the time of manufacture, use, and disposal.

[0009] The server computer may receive the objects and information related to the objects transmitted via the communication network and update the object database. [Effects of the Invention]

[0010] According to the information providing system according to the present disclosure, it is possible to provide not only the name and price of an object, but also related information including the environmental impact of the object. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a schematic diagram illustrating a configuration of an information providing system according to an embodiment of the present invention. [Figure 2] 10 is a flowchart showing a process during learning. [Figure 3] FIG. 10 is a sequence diagram showing operations when a search is executed. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that the following embodiments do not limit the present disclosure, and configurations formed by selectively combining multiple examples are also included in the present disclosure.

[0013] 1 is a schematic diagram showing the configuration of an information provision system 100 according to an embodiment of the present invention. As shown in the figure, the information provision system 100 according to the present embodiment includes a user terminal 10, a communication network 20, various information sources 30, and a server computer 40. The communication network 20 connects the user terminal 10, the various information sources 30, and the server computer, enabling data exchange among them.

[0014] The user terminal 10 is a mobile terminal such as a smartphone, but it does not necessarily have to be portable and can also be a personal computer, tablet terminal, etc. The user terminal 10 includes a display 12 as an input / output device, a camera 14 as an imaging unit, a processing unit 16 that processes various data, and a terminal communication unit 18 that processes communications.

[0015] For example, since the display 12 functions as a touch panel, it is possible to take still images, videos, and other images using the camera 14 in response to input instructions from the touch panel. The captured images are stored in the memory of the processing unit 16 and are also transmitted to the outside via the device communication unit 18.

[0016] Furthermore, data from the outside is displayed on the display 12 in a desired format via the terminal communication unit 18 and the processing unit 16. Of course, a microphone speaker can also be provided to input and output audio. The processing unit 16 is an arithmetic processing unit and can have a configuration similar to that of a general-purpose computer.

[0017] The communication network 20 is, for example, the Internet, and includes wired and wireless lines. Various terminal devices, server computers, etc. are connected to the communication network 20, and data communication is carried out between them. In this example, various information sources 30 are connected to the communication network 20, and the user terminal 10 and the server computer 40 can obtain necessary information from the various information sources 30 as needed.

[0018] The server computer 40 generates related information about the object in the target image based on the target image sent from the user terminal 10, and returns the information to the user terminal 10. Note that the target image may be a moving image as described above, a plurality of still images, or a 3D image.

[0019] The various information sources 30 are information providing sites connected to the communication network 20, and may be free or paid, and may include personal computers, smartphones, and other terminals as long as they have the function of providing information.

[0020] The server computer 40 is a computer having data processing functions including communication functions, and usually includes a large capacity memory, but a personal computer or the like can also be used.

[0021] The server computer 40 has a communication unit 42 connected to the communication network 20 , and the communication unit 42 performs processing for communication with the user terminal 10 and various information sources 30 via the communication network 20 .

[0022] The communication unit 42 is connected to an analysis unit 44. The analysis unit 44 includes a data processing unit 44-1, a learning device 44-2, and a search unit 44-3.

[0023] An object DB 46 is also connected to the analysis unit 44. The object DB 46 includes a learning information DB 46-1 and a related information DB 46-2.

[0024] The data processing unit 44-1 receives from the communication unit 42 image information required to obtain a classification from the object image, classification, and related information such as costs, environmental impacts, and recommended information associated with the classification, and edits and outputs the information as appropriate.

[0025] For example, the image information and classification are supplied to the learning information DB 46-1 of the object database 46 and registered therein.

[0026] Here, "classification" refers to the classification of the target object (item), such as "automobile," "television," "camera," "watch," "telephone," etc. In the case of "automobile," more detailed classifications may be established, such as "electric automobile," "hybrid automobile," and "gasoline automobile."

[0027] The data processing unit 44-1 searches various information sources 30 via the communication unit 42 and the communication network 20, collects images of objects for each classification, and registers them in the learning information DB 46-1. The data processing unit 44-1 also links related information such as cost, environmental impact, and recommended information with the classification and registers them in the related information DB 46-2 of the object database 46. The data processing unit 44-1 also searches and collects related information from various information sources 30 via the communication unit 42 and the communication network 20.

[0028] Here, "cost" refers to the price of an item, and it is advisable to use the representative price of the classified item. "Environmental impact" refers to, for example, the amount of carbon dioxide (CO2) emissions during the manufacture, use, and disposal of an item. "Recommended information" is, for example, information recommending ways to reduce environmental impact. For example, in the case of a television, this information suggests reducing CO2 emissions by shortening the time the television is on and lowering the brightness. In the case of a car, this information suggests reducing CO2 emissions by shortening the warm-up time, reducing air conditioning use, and avoiding sudden starts and sudden acceleration. Recommended information also includes information on products that can further reduce environmental impact and costs, as well as information on companies that sell them. Furthermore, detailed information about each object can be registered, such as the URL of an information site or a barcode that leads to the site.

[0029] The learning device 44-2 outputs a classification of an object from an object image supplied from the communication unit 42. The learning device 44-2 is configured, for example, as a neural network, and the function of the learning device 44-2 is achieved by learning. For example, object images and related classification information are supplied as training data from the learning information DB 46-1, and the learning device 44-2 learns this. Furthermore, even after learning is once completed, further learning can be carried out thereafter to update the function. The learning device 44-2 functions as an identification unit for classifying object images.

[0030] An object image sent from the user terminal 10 is supplied to the learning device 44-2, which outputs a classification corresponding to the object image.

[0031] The search unit 44-3 searches the related information DB 46-2 according to the classification of the object output from the learning device 44-2, and outputs the related information corresponding to the classification of the object as the search result. The related information obtained by the search unit 44-3 is supplied to the user terminal 10 via the communication unit 42 and the communication network 20.

[0032] Therefore, the user terminal 10 can display related information corresponding to the transmitted object image.

[0033] "Processing during learning" FIG. 2 is a flowchart showing the learning process. To achieve its functions, the information providing system 100 first collects information about an object in the data processing unit 44-1 of the server computer 40 (S11). The collected information is registered in the learning information DB 46-1 (S12). For example, consider a classification such as "automobile." Images corresponding to the term "automobile" are then acquired from various information sources 30. In addition to the images, related information such as the cost, environmental impact, and recommended information is also collected. Once sufficient information has been collected, the learning device 44-2 learns using the data in the learning information DB 46-1 (S13). This learning enables the learning device 44-2 to output a corresponding classification for input of object images, including videos, obtained by the user terminal 10. As described above, this learning can be performed at any time, and the functions of the learning device 44-2 can be updated at any time. Furthermore, the learning device 44-2 may be updated using information provided by the user terminal 10.

[0034] In particular, the information provision system according to this embodiment acquires information about the costs and environmental impacts associated with the life cycle of an object. This life cycle environmental impact includes, for example, information about the amount of CO2 and other emissions generated by a single automobile during its entire or partial life cycle, such as during its manufacture, use, and disposal. An automobile is manufactured from many parts. Therefore, the CO2 emissions of each part are integrated. For example, for a synthetic resin made from petroleum used in a single part, the CO2 emissions are calculated by integrating the CO2 emissions associated with the amount of work required for the extraction, transportation, refining, synthesis, and distribution of the petroleum, as well as the CO2 emissions generated during disposal. Therefore, the environmental impact of one automobile differs from that of another. In this embodiment, individual differences are ignored, and each classification is represented by a single representative environmental impact value. This is because it is important to recognize the approximate CO2 emissions of various objects and to encourage users to reduce their CO2 emissions. Note that a rough range of values ​​can be provided instead of or in addition to a single representative value. In addition, it is possible to prepare indicators of various environmental impacts other than CO2, such as impacts on human health, biodiversity, and resource consumption, as well as numerical values ​​that integrate these impacts and numerical values ​​that convert environmental impacts into costs.

[0035] Registering an Application The server computer 40 also stores applications for the information provision system and can provide these applications. These applications may be provided via an application purchase site, etc. When a request to download an application is made to the user terminal 10, the corresponding information provision application is downloaded to the user terminal 10 and installed therein.

[0036] "Processing when a search is performed" 3 is a sequence diagram showing the operation when a search is executed. An application for providing information is started in the user terminal 10. Note that the application may be downloaded and then started each time.

[0037] When an application is started on the user terminal 10, the user terminal 10 accesses the server computer 40. The server computer 40 confirms the access of the user terminal 10. After the server computer 40 performs predetermined authentication, communication is established between the server computer 40 and the user terminal 10.

[0038] In response to the launch of the application, the user terminal 10 displays an input screen for an object image on the display 12 of the user terminal 10. The object image is input by a predetermined input operation on the input screen. This input operation is, for example, taking an image of the object with the camera 14 of the user terminal 10. Alternatively, the object image may be input by selecting an object image that has been taken in advance and stored in memory.

[0039] In this way, when an object image is input, the user terminal 10 transmits the object image to the server computer 40. Here, the image may be in color or black and white, or may be a moving image.

[0040] When an object image is sent from the user terminal 10, the learning device 44-2 of the server computer 40 outputs a corresponding classification. Then, the search unit 44-3 obtains related information corresponding to the obtained classification from the related information DB 46-2.

[0041] Then, the related information corresponding to the obtained object image is transmitted to the user terminal 10. The user terminal 10 displays the received related information on the display 12.

[0042] Furthermore, if a URL or the like of a related site is provided along with the related information, the URL or the like is displayed on the user terminal 10. Therefore, the user can access the site by touching the URL or the like to obtain more detailed information. Also, by displaying a two-dimensional code or the like of the URL, the user can access the site from another terminal.

[0043] "Processing during additional learning" The learning information DB 46-1 and the related information DB 46-2 in the server computer 40 can also be updated using information from the user terminal 10. When the learning information DB 46-1 is updated, additional learning can be performed in the learning device 44-2.

[0044] For example, after starting an information provision application on the user terminal 10, a button for providing learning information is selected. This allows the user terminal 10 to provide desired information to the data processing unit 44-1 of the server computer 40. Object images and their corresponding classifications and related information are supplied from the user terminal 10 to the server computer 40. It is also possible to introduce specific information sources from the user terminal 10. This allows the server computer 40 to collect new information. [Explanation of symbols]

[0045] 10 User terminal, 12 Display, 14 Camera, 16 Processing unit, 18 Terminal communication unit, 20 Communication network, 30 Various information sources, 40 Server computer, 42 Communication unit, 44 Analysis unit, 44-1 Data processing unit, 44-2 Learning device, 44-3 Search unit, 46 Object database, 46-1 Learning information database, 100 Information provision system, 46 Object DB, 46-1 Learning information DB, 46-2 Related information DB.

Claims

1. a user terminal having an imaging unit for acquiring an object image; a server computer connected to the user terminal via a communication network and configured to obtain information related to the object; Including, The server computer an identification unit that identifies a classification of an object based on an object image acquired by the imaging unit; an object database that outputs related information about the object, including its environmental impact, based on the classification identified by the identification unit; Including, providing the related information output from the object database to the user terminal; Information provision system.

2. 2. The information providing system according to claim 1, and outputting, to the object database, information on the environmental load and recommendations for reducing the environmental load for the object of the classification in accordance with the classification. Information provision system.

3. 2. The information providing system according to claim 1, The related information includes information related to the life cycle of the object, including the time of manufacture, the time of use, and the time of disposal. Information provision system.

4. The information providing system according to any one of claims 1 to 3, the server computer receives the objects and information related to the objects transmitted via the communication network and updates the object database; Information provision system.

Images