Information processing device, information processing method and information processing program

Abstract

To allow users to make appropriate decisions about giving up their possessions.SOLUTION: An information processing device according to the present application includes a recognition unit, an identification unit, and a display control unit. The recognition unit recognizes a photographed item based on photographing information. The identification unit identifies a bidding price in electronic commerce for the item recognized by the recognition unit. The display control unit performs processing for displaying content indicating the bidding price identified by the identification unit in superimposition on the item.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, there are known techniques for providing information on market prices of products, etc. For example, a technique is known in which a market price for a product is predicted from product information of the product for which the market price is to be predicted, and information on the predicted market price is provided (Patent Document 1 below). Also, a technique is known in which a user is provided with information to encourage the user to choose to dispose of possessions that the user does not use frequently (Patent Document 2 below). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6719201 [Patent Document 2] JP 2023-042472 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional technology leaves room for improvement in enabling users to make appropriate decisions about parting with their possessions.

[0005] The present application has been made in consideration of the above, and aims to provide an information processing device, an information processing method, and an information processing program that enable a user to make an appropriate decision to give up possessions. [Means for solving the problem]

[0006] The information processing device of the present application is characterized by having a recognition unit that recognizes an item being photographed based on shooting information, an identification unit that identifies the winning bid price in electronic commerce for the item recognized by the recognition unit, and a display control unit that performs processing to display content indicating the winning bid price identified by the identification unit superimposed on the item. Effect of the Invention

[0007] According to one aspect of the embodiment, it is possible to provide an effect that a user can make an appropriate decision to give up a possession. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of information processing according to the embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of a shooting screen according to the embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a shooting screen according to the embodiment. [Diagram 5] FIG. 5 is a diagram showing an example of a shooting screen according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of a terminal device according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of an item recognition information storage unit according to the embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of a winning bid market price information storage unit according to the embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of an article registration information storage unit according to the embodiment. [Figure 11] FIG. 11 is a flowchart illustrating an example of information processing according to the embodiment. [Figure 12]FIG. 12 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the information processing device, the information processing method, and the information processing program according to the present application will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to the embodiments. In addition, the same parts in the following embodiments are given the same reference numerals, and duplicated explanations are omitted.

[0010] (Embodiment) [1. Configuration of information processing system] An information processing system 1 shown in Fig. 1 will be described. As shown in Fig. 1, the information processing system 1 includes a terminal device 10 and an information processing device 100. The terminal device 10 and the information processing device 100 are connected to each other via a predetermined communication network (network N) so as to be able to communicate with each other in a wired or wireless manner. Fig. 1 is a diagram showing an example of the configuration of the information processing system 1 according to an embodiment.

[0011] The terminal device 10 is an information processing device used by a user who photographs an item. For example, the user consciously or unconsciously photographs items in the user's home through the terminal device 10. The terminal device 10 may be any device that can realize the processing in the embodiment. The terminal device 10 is a terminal equipped with an augmented reality (AR) technology, and may be, for example, a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, a PDA, or a smart glass such as an AR glass. FIG. 2 shows a case where the terminal device 10 is a smartphone.

[0012] The terminal device 10 is, for example, a smart device such as a smartphone or smart glasses, and is a mobile terminal device that can communicate with any server device via a wireless communication network such as 4G to 5G (Generation) or LTE (Long Term Evolution). The terminal device 10 has a screen such as a liquid crystal display with a touch panel function, and may accept various operations on display data such as content, such as tapping, sliding, and scrolling, performed by a user's finger or a stylus. In FIG. 2, the terminal device 10 is used by a user U1.

[0013] The information processing device 100 is an information processing device intended to enable a user to make an appropriate decision to part with (for example, dispose of) possessions, and may be any device capable of implementing the processes in the embodiments. The information processing device 100 is implemented, for example, by a server device or a cloud system that provides a platform for electronic commerce such as an auction site or a shopping site. The information processing device 100 performs a process for, for example, recognizing an item based on image information, identifying a bidding price for the item in an electronic commerce transaction, and displaying content indicating the bidding price for the item superimposed on the item (image information of the item). This enables, for example, a user to appropriately decide the timing to part with a possession.

[0014] Although FIG. 1 illustrates a case in which the terminal device 10 and the information processing device 100 are separate devices, the terminal device 10 and the information processing device 100 may be integrated.

[0015] [2. An example of information processing] FIG. 2 is a diagram showing an example of information processing of the information processing system 1 according to the embodiment. Also, FIG. 3 to FIG. 5 are diagrams showing an example of a shooting screen (or a shot image) according to the embodiment. The shooting screens shown in FIG. 3 to FIG. 5 are shooting information displayed on the terminal device 10, and information that the user U1 can visually recognize through the terminal device 10 is displayed on the screen G. FIG. 2 will be described below with appropriate reference to FIG. 3 to FIG. 5. The user U1 consciously or unconsciously shoots items in his / her home while walking around the house. The user U1 shoots through the terminal device 10, but may shoot without thinking about which item to shoot. In FIG. 3, the user U1 focuses on the item B1, which is a sofa, through the terminal device 10, so that the screen G displays content related to the item B1 (step S11). For example, content such as auction prices and last use date is displayed, but the details of the content will be described later. Also, in FIG. 4, from the situation of FIG. 3, the user U1 focuses the image on the item B2, which is a potted plant, via the terminal device 10, so that the content related to the item B2 is displayed on the screen G (step S12). At this time, the content related to the item B1 continues to be displayed because the item B1 is included in the angle of view of the image. In this way, the content related to the item B1 may continue to be displayed until the item B1 is out of the angle of view of the image and is no longer photographed. Also, in FIG. 5, from the situation of FIG. 4, the user U1 focuses the image on the item B3, which is a table, via the terminal device 10, so that the content related to the item B3 is displayed on the screen G (step S13). At this time, the content related to the items B1 and B2 is no longer displayed because the items B1 and B2 are out of the angle of view of the image, but since the items are recognized, they will be displayed again when they return to the angle of view of the image. In this way, the content according to the user's image (content related to the recognized item) is displayed in real time on the screen G. Also, different content may be displayed on screen G in real time in response to the user's photography.

[0016] The information processing device 100 acquires shooting information of a photograph taken by the user U1 (step S101). In FIG. 3, the information processing device 100 acquires shooting information including the item B1 because the user U1 focuses the shooting on the item B1. Also, in FIG. 4, the information processing device 100 acquires shooting information including the item B2 because the user U1 focuses the shooting on the item B2. Also, in FIG. 5, the information processing device 100 acquires shooting information including the item B3 because the user U1 focuses the shooting on the item B3. The information processing device 100 acquires visually recognizable information as shooting information in real time via the terminal device 10.

[0017] The information processing device 100 recognizes the object being photographed based on the photographing information (step S102). For example, the information processing device 100 recognizes the object being photographed using a conventional technology for recognizing an object included in the photographed screen. The information processing device 100 recognizes the object for each object included in the screen G. In FIG. 3, the information processing device 100 recognizes, for example, the object B1 as the product P1 of the "XX" brand. Note that in FIG. 3, only the object B1 is recognized, but other objects included in the photographed screen shown in FIG. 3 may be recognized. For example, an object B4, which is a blind, may be recognized. Also, in FIG. 4, the information processing device 100 recognizes, for example, the object B2 as the product P2 of the "XX" brand from the situation in FIG. 3. Note that in FIG. 4, only the object B1 and the object B2 are recognized from the situation in FIG. 3, but other objects included in the photographed screen shown in FIG. 4 may be recognized. Also, in FIG. 5, the information processing device 100 recognizes, for example, the object B3 as the product P3 of the "XX" brand from the situation in FIG. 4. In Fig. 5, only the item B3 is recognized from the situation in Fig. 4, but other items included in the photographed screen shown in Fig. 5 may be recognized. The information processing device 100 recognizes the photographed item in real time based on the photographing information.

[0018] The information processing device 100 specifies the bidding price in electronic commerce of the item (step S103). For example, the information processing device 100 specifies the bidding price of the item B1 by specifying the price at which the product P1 of the "XX" brand was sold in a specified online shopping mall (for example, a specified auction site). At this time, the information processing device 100 may specify the bidding price of the item B1 in the specified period, for example, if a specified period is set. For example, if one week is set as the specified period, the information processing device 100 may specify the bidding price of the item B1 from the present to one week ago. Also, for example, if one year is set as the specified period, the information processing device 100 may specify the bidding price of the item B1 from the present to one year ago. Also, the information processing device 100 specifies the bidding price of the item B2 by specifying the price at which the product P2 of the "XX" brand was sold in a specified online shopping mall. The information processing device 100 also identifies the bidding price of the item B3 by identifying the price at which the "XX" brand product P3 was sold in a specific online shopping mall. The information processing device 100 identifies the bidding price in electronic commerce in real time for each item recognized in real time.

[0019] The information processing device 100 performs a process for displaying the content indicating the bidding price of the item superimposed on the item (photographed information of the item) (step S104). For example, when the bidding price of the item B1 is 45,000 yen, the information processing device 100 transmits information for displaying the content indicating that the bidding price of the item B1 is 45,000 yen superimposed on the item to the terminal device 10. When the terminal device 10 receives the information for displaying the content indicating that the bidding price of the item B1 is 45,000 yen superimposed on the item, it displays the information of 45,000 yen, which is the bidding price of the item B1, superimposed on the item. At this time, when the screen G has an area (hereinafter referred to as a "predetermined area" as appropriate) for displaying the total price of the bidding price, the information processing device 100 transmits information for displaying the content indicating that the total price of the bidding price is 45,000 yen in the area R, which is the predetermined area, to the terminal device 10. When the terminal device 10 receives information for displaying content indicating that the total price of the bidding market is 45,000 yen in the area R, the terminal device 10 displays the information of 45,000 yen, which is the total price of the bidding market, in the area R. At the time of FIG. 3 when the information processing device 100 recognizes the item B1 after the user U1 starts photographing, only the item B1 has been recognized, so the bidding market price of the item B1 is displayed as the total price of the bidding market. The total price of the bidding market is reflected in real time each time an item is recognized. The information processing device 100 performs a process in real time for displaying content indicating the bidding market price of the item superimposed on the item for each item recognized in real time. In addition, the information processing device 100 performs a process for continuing to display content based on AR technology (for example, content indicating the bidding market price of the item) superimposed on the item until the item is no longer photographed.

[0020] For example, when the bidding price of item B2 is 6000 yen, the information processing device 100 transmits to the terminal device 10 information for displaying content indicating that the bidding price of item B2 is 6000 yen superimposed on the item. When the terminal device 10 receives information for displaying content indicating that the bidding price of item B2 is 6000 yen superimposed on the item, the information processing device 10 causes the information of 6000 yen, which is the bidding price of item B2, to be superimposed on the item. Then, the information processing device 100 transmits to the terminal device 10 information for displaying content indicating that the total price of the bidding price is 51000 yen in the area R. When the terminal device 10 receives information for displaying content indicating that the total price of the bidding price is 51000 yen in the area R, the information of 51000 yen, which is the total price of the bidding price, is displayed in the area R. At the point in time shown in Figure 4 when the information processing device 100 recognized item B2 after user U1 began photographing, items B1 and B2 had been recognized, so the bidding price obtained by adding the bidding price of item B1 to the bidding price of item B2 is displayed as the total bidding price.

[0021] For example, when the bidding price of item B3 is 9000 yen, the information processing device 100 transmits to the terminal device 10 information for displaying content indicating that the bidding price of item B3 is 9000 yen superimposed on the item. When the terminal device 10 receives information for displaying content indicating that the bidding price of item B3 is 9000 yen superimposed on the item, the information processing device 10 causes the information of 9000 yen, which is the bidding price of item B3, to be superimposed on the item. Then, the information processing device 100 transmits to the terminal device 10 information for displaying content indicating that the total price of the bidding price is 60000 yen in the area R. When the terminal device 10 receives information for displaying content indicating that the total price of the bidding price is 60000 yen in the area R, the information of 60000 yen, which is the total price of the bidding price, to be displayed in the area R. At the point in time shown in Figure 5 when the information processing device 100 recognized item B3 after user U1 began photographing, items B1, B2, and B3 had been recognized, so the bidding price for items B1 and B2 plus the bidding price for item B3 is displayed as the total bidding price.

[0022] In this way, the information processing device 100 recognizes the item photographed in real time in response to the photographing of the user U1 via the terminal device 10, identifies the bidding price of the item in real time, and performs processing in real time for the content indicating the bidding price of the item to be superimposed on the item. In addition, each time the information processing device 100 newly recognizes an item in response to the photographing of the user U1 via the terminal device 10, it identifies the bidding price of the item, performs processing in real time for the content indicating the bidding price of the item to be superimposed on the item, and reflects the total price of the bidding price displayed in the area R in real time. Note that. In Figs. 3 to 5, the total price of the bidding price is displayed in the lower right of the screen G, but this is not particularly limited to this example, and for example, it may be displayed in the upper right of the screen G. In addition, in Figs. 3 to 5, the screen G has an area R for displaying the total price of the bidding price, but this is not particularly limited to this example, and it may not have the area R. Note that if the screen G does not have the area R, the total price of the bidding price may not be displayed. 3 to 5, the information processing device 100 performs processing for displaying content indicating the bidding price of an item superimposed on the item along with the item recognition information (for example, an "XX" brand item P1 and an "XX" brand item P2, etc.), but the display mode of the item recognition information and the content indicating the bidding price of the item need not be limited to this example. Also, in FIG. 3 to FIG. 5, the item recognition information does not need to be displayed on the screen G.

[0023] (Information processing variation 1: Display of last use date) In the above embodiment, the information processing device 100 performs processing for displaying content indicating the bidding price of an item superimposed on the item. For example, the information processing device 100 performs processing for displaying content indicating the bidding price of an item superimposed on the item alongside the recognition information of the item. Here, the information processing device 100 may perform processing for displaying content indicating the last use date of the item superimposed on the item. For example, the information processing device 100 may perform processing for displaying content indicating the last use date of the item superimposed on the item together with the recognition information of the item and content indicating the bidding price of the item. In addition, the information processing device 100 may perform processing for displaying content indicating the last use date of the item estimated based on the shooting information superimposed on the item.

[0024] At this time, the information processing device 100 may estimate the last use date of the item. For example, if there is no change in the relative position of the item B2 with respect to the item B3 (and if the user U1 is not the type to keep things very neat), the information processing device 100 may estimate that the item B2 has not been used for a while. Also, for example, if there is nothing placed on the item B3, the information processing device 100 may estimate that the item B3 has not been used for a while if there is dust on the item B3. In this way, the information processing device 100 may estimate the last use date of the item by estimating the usage status of the item from the photographing information. In this way, for example, if the last use date of the item B2 is estimated to be two months ago, content indicating that the last use date of the item B2 was two months ago is displayed.

[0025] (Information processing variation 2: Displaying the number of users wanting an item) In the above embodiment, the information processing device 100 performs a process for displaying the content indicating the bidding price of the item superimposed on the item. For example, the information processing device 100 performs a process for displaying the content indicating the bidding price of the item superimposed on the item alongside the recognition information of the item. Here, the information processing device 100 may perform a process for displaying the content indicating the number of users who desire the item superimposed on the item. For example, the information processing device 100 may perform a process for displaying the content indicating the number of users who desire the item superimposed on the item together with the recognition information of the item, the content indicating the bidding price of the item, and the content indicating the last use date of the item. The number of users who desire the item may be specified based on, for example, user registration information on a predetermined service that performs electronic commerce (for example, a predetermined electronic shopping mall, etc.). For example, if two users have made a first bid for the item B1, a content indicating that two users desire the item B1 is displayed.

[0026] (Information processing variation 3: Display based on location information) In the above embodiment, the information processing device 100 may acquire the location information of the terminal device 10, and when the location information of the terminal device 10 satisfies a predetermined condition, perform a process for displaying the content indicating the bidding price of the item superimposed on the item. For example, when the terminal device 10 is located within a range of a location registered in advance as a location associated with the user U1 (for example, the location of the home of the user U1), the information processing device 100 may perform a process for displaying the content indicating the bidding price of the item superimposed on the item. For example, when the user U1 takes a picture at his / her home, the information processing device 100 may perform a process for displaying the content indicating the bidding price of the item superimposed on the item. In other words, when the user U1 takes a picture at someone else's home, the information processing device 100 may not perform a process for displaying the content indicating the bidding price of the item superimposed on the item. Furthermore, when the terminal device 10 is located within a range of a location estimated as a location associated with the user U1, the information processing device 100 may perform a process for displaying the content indicating the bidding price of the item superimposed on the item. At this time, the information processing device 100 may estimate a location associated with the user U1. For example, the information processing device 100 may estimate a location associated with the user U1 based on the location history of the terminal device 10.

[0027] (Information processing variation 4: Display according to item status) In the above embodiment, the information processing device 100 may perform a process for displaying content indicating the bidding price of an item according to the state (condition) of the item superimposed on the item. For example, when the item is a new, unused item without scratches and in good condition, the information processing device 100 may perform a process for displaying content indicating the bidding price of an item with a long history of use (or in a very dirty state) superimposed on the item. For example, when the item has a long history of use and is quite dirty, the information processing device 100 may perform a process for displaying content indicating the bidding price of an item with a long history of use (or in a very dirty state) superimposed on the item. The information processing device 100 may perform a process for displaying content indicating the bidding price of an item according to the state of the item estimated based on the imaging information superimposed on the item. The information processing device 100 may also perform an estimation of the state of the item. For example, the information processing device 100 may perform an estimation of the state of the item based on the imaging information. For example, the information processing device 100 may estimate the condition of the item by determining whether the item is in an unused, brand new condition based on the imaging information, or may estimate the condition of the item by estimating the usage history based on the imaging information.

[0028] (Information processing variation 5: Display according to item category) In the above embodiment, the information processing device 100 may perform a process for displaying content indicating the bidding price of the item superimposed on the item when the category of the item satisfies a predetermined condition. For example, when there is a category registered in advance as an excluded category for superimposed display, the information processing device 100 may perform a process for displaying content indicating the bidding price of the item superimposed on the item when the category of the item is not a category registered in advance as an excluded category. When a category that should not be priced, such as posters or family photos, is registered as an excluded category, the information processing device 100 may perform a process for displaying content indicating the bidding price of the item superimposed on the item when the category is other than such a category. In this case, for example, an excluded category is determined in advance according to user information, and the information processing device 100 may perform a process for displaying content indicating the bidding price of the item superimposed on the item when the category is not an excluded category according to the user information.

[0029] (Information processing variation 6: Displaying recall information) In the above embodiment, the information processing device 100 performs a process for displaying the content indicating the bidding price of the item superimposed on the item. For example, the information processing device 100 performs a process for displaying the content indicating the bidding price of the item superimposed on the item alongside the recognition information of the item. Here, the information processing device 100 may perform a process for displaying the content indicating that the item is the subject of a recall (voluntary recall) superimposed on the item. For example, the information processing device 100 may perform a process for displaying the content indicating that the item is the subject of a recall superimposed on the item together with the recognition information of the item, the content indicating the bidding price of the item, the content indicating the last use date of the item, the content indicating the number of users who desire the item, and the like. In addition, the information processing device 100 may determine whether the item is the subject of a recall using the item information of the item, and if the item is the subject of a recall, perform a process for displaying the content indicating that the item is the subject of a recall superimposed on the item. Whether or not the item is the subject of a recall may be specified based on the item information of the item. Furthermore, the information processing device 100 may perform processing for superimposing and displaying content indicating, for example, "This product should not be sold but should be recalled because it is subject to recall" on the product.

[0030] (Information processing variation 7: Display of pre-registered registration information) In the above embodiment, the information processing device 100 performs a process for displaying the content indicating the bidding price of the item superimposed on the item. For example, the information processing device 100 performs a process for displaying the content indicating the bidding price of the item superimposed on the item alongside the recognition information of the item. Here, the information processing device 100 may perform a process for displaying the content indicating the information registered in advance by the user who desires the item (for example, information on the first bid, information on the shipping fee and the trade-in price, etc.) superimposed on the item. For example, the information processing device 100 may perform a process for displaying the content indicating the information registered in advance by the user who desires the item superimposed on the item together with the recognition information of the item, the content indicating the bidding price of the item, the content indicating the last use date of the item, the content indicating the number of users who desire the item, the content indicating that the item is the subject of a recall, etc. The information processing device 100 may also determine whether or not there is information for an item that has been registered in advance by a user who desires the item, and if there is information for an item that has been registered in advance by a user who desires the item, perform processing for displaying content indicating the registered information superimposed on the item. For example, if a user who desires an item has registered information regarding an electricity charge for the item, the information processing device 100 may perform processing for displaying content indicating information regarding the electricity charge superimposed on the item. For example, if a user who desires an item has registered information indicating that shipping is free for the item, the information processing device 100 may perform processing for displaying content indicating that shipping is free superimposed on the item.

[0031] (Information processing variation 8: Display of alternative products) In the above embodiment, the information processing device 100 performs a process for displaying the content indicating the bidding price of the item superimposed on the item. For example, the information processing device 100 performs a process for displaying the content indicating the bidding price of the item superimposed on the item in line with the recognition information of the item. Here, the information processing device 100 may perform a process for displaying the content indicating the substitute product of the item superimposed on the item. For example, the information processing device 100 may perform a process for displaying the content indicating the substitute product of the item superimposed on the item so that all or part of the item is overwritten. Note that the substitute product may be, for example, a product traded on a predetermined service that performs electronic commerce. In addition, when there are multiple candidates for the substitute product, the information processing device 100 may perform a process for displaying the content indicating the substitute product selected from the candidates based on the product information of the substitute product as a substitute product having a similar shape to the item superimposed on the item. In addition, when there are multiple candidates for the substitute product, the information processing device 100 may perform a process for displaying the content indicating the substitute product selected from the candidates based on the layout of the room in which the item is placed superimposed on the item.

[0032] (Information Processing Variation 9: Other Representations) In the above embodiment, the information processing device 100 may perform a process for displaying, for example, content indicating "3% commission & free shipping when listing from AR" on the item. In this case, the information processing device 100 may perform a process for displaying, for example, information for enabling listing on an app. The information processing device 100 may perform a process for automatically listing an item on a predetermined service by a user performing an operation (for example, clicking or tapping) on ​​the displayed information. The information processing device 100 may also perform a process for displaying, for example, content indicating "There are few listings for this item category at present, so it would be better to list it now" on the item. The information processing device 100 may also perform a process for displaying, for example, content indicating "The next generation model of this item has been released, so if you are replacing it, it would be better to trade it in" on the item.

[0033] 3. Terminal Device Configuration Next, the configuration of the terminal device 10 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the configuration of the terminal device 10 according to the embodiment. As shown in Fig. 6, the terminal device 10 has a communication unit 11, an input unit 12, an output unit 13, and a control unit 14.

[0034] (Communications Department 11) The communication unit 11 is realized by, for example, a network interface card (NIC) etc. The communication unit 11 is connected to a predetermined network N by wire or wirelessly, and transmits and receives information to and from the information processing device 100 etc. via the predetermined network N.

[0035] (Input section 12) The input unit 12 accepts various operations from a user. In Fig. 2, the input unit 12 accepts various operations from a user U1. For example, the input unit 12 may accept various operations from a user via a display surface using a touch panel function. The input unit 12 may also accept various operations from buttons provided on the terminal device 10, or a keyboard or mouse connected to the terminal device 10.

[0036] (Output section 13) The output unit 13 is a display screen of a tablet terminal or the like realized by, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, and is a display device for displaying various information. For example, the output unit 13 displays content (for example, screen G, etc.) based on information received from the information processing device 100 in real time.

[0037] (Control unit 14) The control unit 14 is, for example, a controller, and is realized by executing various programs stored in a storage device inside the terminal device 10 using a RAM (Random Access Memory) as a working area by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). For example, the various programs include application programs installed in the terminal device 10. For example, the various programs include application programs that display content based on information received from the information processing device 100. The control unit 14 is also realized by an integrated circuit, such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0038] As shown in FIG. 6, the control unit 14 has a receiving unit 141 and a transmitting unit 142, and realizes or executes the information processing operations described below.

[0039] (Receiving unit 141) The receiving unit 141 receives, for example, information in real time for displaying content based on information transmitted from the information processing device 100. The receiving unit 141 also receives, for example, information for content based on AR technology to be superimposed on an item and displayed. For example, the receiving unit 141 receives information for content indicating the bidding price of the item to be superimposed on the item. For example, the receiving unit 141 receives information for content indicating the bidding price of the item to be superimposed on the item. The receiving unit 141 also receives, for example, information for superimposing on the item recognition information, content indicating the bidding price of the item, content indicating the last use date of the item, content indicating the number of users who desire the item, content indicating that the item is subject to recall, content indicating information registered in advance by users who desire the item, and the like.

[0040] (Transmitter 142) The transmission unit 142 transmits, for example, in real time, photographing information photographed in real time by the terminal device 10. In addition, the transmission unit 142 transmits, for example, in real time, operation information of a user on content displayed based on information transmitted from the information processing device 100.

[0041] 4. Configuration of Information Processing Device Next, the configuration of the information processing device 100 according to the embodiment will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 7, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130. Note that the information processing device 100 may have an input unit (e.g., a keyboard, a mouse, etc.) that accepts various operations from an administrator of the information processing device 100, and a display unit (e.g., a liquid crystal display, etc.) that displays various information.

[0042] (Communication unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the terminal device 10 etc. via the network N.

[0043] (Storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 7, the storage unit 120 has an item recognition information storage unit 121, a bidding market price information storage unit 122, and an item registration information storage unit 123.

[0044] The item recognition information storage unit 121 stores information for recognizing an item photographed by the terminal device 10 or the like. For example, when an item is registered on a predetermined service in association with its characteristics (e.g., name, brand, category, detailed shape, detailed size, etc.) and image data, the item recognition information storage unit 121 acquires and stores the information. Here, FIG. 8 shows an example of the item recognition information storage unit 121 according to the embodiment. As shown in FIG. 8, the item recognition information storage unit 121 has items such as "item ID" and "item recognition information."

[0045] "Item ID" indicates identification information for identifying an item. "Item recognition information" indicates information such as item characteristics and image data. In the example shown in FIG. 8, conceptual information such as "Item Recognition Information #1" and "Item Recognition Information #2" is stored in the "Item Recognition Information", but in reality, information such as the name, brand, and category of the item, details of the item's shape and size, and image data is stored. In addition, for example, the URL where the image data is located, or a file path name indicating the storage location, may be stored.

[0046] The bidding price range information storage unit 122 stores information related to the bidding price range of an item. For example, the bidding price range information storage unit 122 acquires and stores information related to the bidding price range of an item on a specified service. FIG. 9 shows an example of the bidding price range information storage unit 122 according to the embodiment. As shown in FIG. 9, the bidding price range information storage unit 122 has items such as "item ID" and "bidding price range information."

[0047] "Item ID" indicates identification information for identifying an item. "Successful bid price information" indicates information related to the successful bid price of an item. In the example shown in Fig. 9, conceptual information such as "successful bid price information #1" and "successful bid price information #2" is stored in "successful bid price information", but in reality, information such as the individual dates and times when items were sold, the individual winning bid prices for determining the winning bid price, and the condition of each of the sold items is stored.

[0048] The item registration information storage unit 123 stores information registered for an item. For example, the item registration information storage unit 123 acquires and stores information regarding an item's recall, information regarding the number of users who desire the item on a specified service, information registered by users who desire the item on a specified service, information regarding substitute products for the item, and the like. Here, FIG. 10 shows an example of the item registration information storage unit 123 according to the embodiment. As shown in FIG. 10, the item registration information storage unit 123 has items such as "item ID" and "item registration information".

[0049] "Item ID" indicates identification information for identifying an item. "Item registration information" indicates information registered for an item. In the example shown in FIG. 10, conceptual information such as "Item registration information #1" and "Item registration information #2" is stored in "Item registration information", but in reality, information such as whether the item has been recalled, the number of users who desire the item on a specific service, whether free shipping is available and trade-in prices registered by users who desire the item on a specific service, and identification information for identifying substitute products for the item is stored.

[0050] (Control unit 130) The control unit 130 is a controller, and is realized, for example, by a CPU, an MPU, or the like, executing various programs stored in a storage device inside the information processing device 100 using a RAM as a working area. The control unit 130 is also realized, for example, by an integrated circuit such as an ASIC or an FPGA.

[0051] 7, the control unit 130 has an acquisition unit 131, a recognition unit 132, a specification unit 133, a display control unit 134, and an estimation unit 135, and realizes or executes the information processing action described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 7, and may be other configurations as long as they perform the information processing described below.

[0052] (Acquisition part 131) The acquiring unit 131 acquires various types of information from the storage unit 120. In addition, the acquiring unit 131 stores the acquired various types of information in the storage unit 120.

[0053] The acquisition unit 131 acquires various pieces of information from an external information processing device. The acquisition unit 131 acquires various pieces of information from other information processing devices such as the terminal device 10.

[0054] The acquisition unit 131 acquires shooting information. For example, the acquisition unit 131 acquires shooting information captured in real time via the terminal device 10. In addition, the acquisition unit 131 acquires position information of the shooting captured in real time via the terminal device 10.

[0055] (Recognition unit 132) The recognition unit 132 recognizes the object being photographed based on the imaging information acquired by the acquisition unit 131. The recognition unit 132 recognizes the object being photographed in real time, for example, by using a conventional technology for recognizing objects included in the imaging screen. For example, the recognition unit 132 recognizes the object in the user's home based on the imaging information.

[0056] (Specific Section 133) The identifying unit 133 identifies a bidding price in electronic commerce for the item recognized by the recognizing unit 132. The identifying unit 133, for example, identifies a bidding price for the item on a predetermined service in real time.

[0057] (Display control unit 134) The display control unit 134 performs processing for displaying content indicating the bidding price of the item identified by the identification unit 133 in a superimposed manner on the item. For example, in shooting via the terminal device 10, the display control unit 134 performs processing for continuing to display predetermined content based on AR technology in a superimposed manner on the item until the item identified by the identification unit 133 goes out of the angle of view of the shooting.

[0058] The display control unit 134 performs processing to superimpose on the item, for example, identification information of the item, content indicating the bidding price for the item, content indicating the last use date of the item, content indicating the number of users who want the item, content indicating that the item is subject to a recall, and content indicating information previously registered by users who want the item.

[0059] The display control unit 134 transmits information for displaying these contents, such as contents showing the bidding price of the item, superimposed on the item.

[0060] (Estimation part 135) The estimation unit 135 performs estimation based on the imaging information acquired by the acquisition unit 131. For example, the estimation unit 135 estimates the last use date of the item by estimating the state of the item based on the imaging information. In addition, the estimation unit 135 estimates a position associated with a user such as the terminal device 10 based on the position history of the terminal device 10. For example, the estimation unit 135 estimates the position of the home of the user such as the terminal device 10 based on the position history of the terminal device 10. In addition, the estimation unit 135 estimates that the user is taking pictures at home when the user is within a range of a position registered in advance as a position associated with the user such as the terminal device 10. In addition, the estimation unit 135 estimates that the user is taking pictures at home when the user is within a range of a position estimated as a position associated with the user such as the terminal device 10.

[0061] [5. Information processing flow] Next, the procedure of information processing by the information processing system 1 according to the embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the procedure of information processing by the information processing system 1 according to the embodiment.

[0062] As shown in FIG. 11, the information processing device 100 acquires shooting information of an image captured by a user (step S201).

[0063] The information processing device 100 recognizes the item photographed by the user based on the acquired photographing information (step S202).

[0064] The information processing device 100 identifies the bidding price in electronic commerce for the recognized item (step S203).

[0065] The information processing device 100 transmits information for displaying the content indicating the identified successful bid price superimposed on the item (step S204).

[0066] 6. Effects As described above, the information processing device 100 according to the embodiment includes the recognition unit 132, the identification unit 133, and the display control unit 134. The recognition unit 132 recognizes an item that has been photographed based on the photographing information. The identification unit 133 identifies a bidding price in electronic commerce for the item recognized by the recognition unit 132. The display control unit 134 performs processing for displaying content indicating the bidding price identified by the identification unit 133 in a superimposed manner on the item.

[0067] As a result, the information processing device 100 of the embodiment allows a user to easily understand the bidding price of an item photographed, for example, by consciously or unconsciously photographing the item, and therefore enables the user to make an appropriate decision about parting with the possession by photographing the item inside the user's own home.

[0068] Furthermore, the display control unit 134 performs processing for continuously displaying content based on augmented reality technology in a superimposed manner based on a predetermined condition.

[0069] As a result, the information processing device 100 according to the embodiment can, for example, superimpose the image information of the item based on augmented reality technology and display it, thereby more effectively enabling the user to make an appropriate decision about whether to part with their possessions.

[0070] Furthermore, the display control unit 134 performs processing for continuing to display the content based on the augmented reality technology in a superimposed manner until the item is no longer photographed by the terminal device 10 that is photographing the item.

[0071] As a result, the information processing device 100 according to the embodiment can, for example, superimpose the image on the photographed information of the item based on augmented reality technology until the item moves out of the field of view of the photograph, thereby more effectively enabling the user to make an appropriate decision as to whether to part with the possession.

[0072] Furthermore, the display control unit 134 performs processing for superimposing and displaying content indicating the bidding price of the item and content indicating the final use date of the item estimated based on the photographing information on the item.

[0073] As a result, the information processing device 100 of the embodiment can, for example, allow a user to easily know the last date of use of an item, thereby more effectively enabling the user to make an appropriate decision to part with an item.

[0074] Furthermore, the display control unit 134 performs processing for displaying content indicating the bidding price of the item and content indicating the number of users who want the item in a superimposed manner on the item.

[0075] As a result, the information processing device 100 according to the embodiment allows a user to easily grasp, for example, the number of users who want an item, thereby more effectively enabling the user to make an appropriate decision about parting with an item.

[0076] In addition, based on the location information of the terminal device 10 performing the photographing, the display control unit 134 performs processing to superimpose the content on the item and display it when the terminal device 10 is within a range of a location that has been pre-registered as a location associated with the user of the terminal device 10.

[0077] This allows the information processing device 100 according to the embodiment to perform appropriate processing based on whether or not the user is taking pictures at home, for example.

[0078] In addition, the display control unit 134 performs processing to superimpose and display the content on the item when the content is within a range of a location estimated as being associated with the user of the terminal device 10 based on the location history of the terminal device 10 performing the photographing.

[0079] This allows the information processing device 100 according to the embodiment to perform appropriate processing based on whether or not the user is taking pictures at home, for example.

[0080] Furthermore, the display control unit 134 performs processing for superimposing and displaying content indicating the bidding price of the item according to the condition of the item estimated based on the photographing information on the item.

[0081] As a result, the information processing device 100 of the embodiment allows a user to easily grasp, for example, the bidding market price according to the condition of an item, thereby more effectively enabling the user to make an appropriate decision about parting with their possessions.

[0082] Furthermore, when the category of the item is not a category that has been registered in advance as an excluded category for superimposed display, the display control unit 134 performs processing for displaying the content superimposed on the item, based on the item information of the item.

[0083] This allows the information processing device 100 according to the embodiment to perform appropriate processing based on, for example, whether or not the category of the item is an excluded category.

[0084] Furthermore, when the item is subject to a recall based on the item information of the item, the display control unit 134 performs processing for superimposing and displaying content indicating that the item is subject to a recall on the item.

[0085] As a result, the information processing device 100 according to the embodiment allows a user to easily understand, for example, that an item is subject to a recall, thereby enabling the user to make an appropriate decision as to whether to give up an item due to a recall.

[0086] Furthermore, when there is information registered for an item by a user who desires the item, the display control unit 134 performs processing to display content indicating the registered information superimposed on the item.

[0087] As a result, the information processing device 100 according to the embodiment allows a user to easily grasp, for example, information registered by a user who desires an item, thereby more effectively enabling the user to make an appropriate decision about parting with an item.

[0088] Furthermore, the display control unit 134 performs processing for displaying content indicating a substitute product for the product in a manner superimposed on the product so as to overwrite the product.

[0089] As a result, the information processing device 100 of the embodiment allows the user to easily understand the interior when a substitute product for an item is installed, thereby enabling the user to make an appropriate decision to purchase a substitute product and give up the possession.

[0090] [7. Hardware Configuration] Moreover, the information processing device 100 according to the embodiment described above is realized, for example, by a computer 1000 having a configuration as shown in Fig. 12. Fig. 12 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0091] The CPU 1100 operates and controls each unit based on a program stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, programs that depend on the hardware of the computer 1000, and the like.

[0092] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 acquires data from other devices via a predetermined communication network and sends it to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0093] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0094] Media interface 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1200. CPU 1100 loads the program from recording medium 1800 onto RAM 1200 via media interface 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0095] For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via a predetermined communication network.

[0096] [8. Other] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

[0097] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0098] Furthermore, the above-described embodiments can be appropriately combined as long as the processing contents are not contradictory.

[0099] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be embodied in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the forms described in the Disclosure of the Invention section.

[0100] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit", etc. For example, an acquisition section can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0101] 1. Information Processing Systems 10 Terminal Equipment 11 Communications Department 12 Input section 13 Output section 14 Control section 100 Information processing device 110 Communications Department 120 Storage section 121 Article recognition information storage unit 122 Bidding price information storage unit 123 Item registration information storage unit 130 Control section 131 Acquisition Department 132 Recognition part 133 Specific part 134 Display control section 135 Estimation part 141 Receiving unit 142 Transmitter N Network

Claims

1. a recognition unit that recognizes an object that has been photographed based on the photographing information; an identification unit that identifies a bidding price in electronic commerce for the item recognized by the recognition unit; a display control unit that performs processing for displaying content indicating the winning bid price identified by the identification unit in a superimposed manner on the item; 13. An information processing device comprising:

2. The display control unit is A process is performed to continuously display the content based on the augmented reality technology in an overlaid manner based on a predetermined condition.

2. The information processing apparatus according to claim 1,

3. The display control unit is A process is performed for continuously displaying the content based on the augmented reality technology in a superimposed manner until the item is no longer photographed in the terminal device photographing the item.

3. The information processing apparatus according to claim 2.

4. The display control unit is A process is performed to display a content indicating the bidding price of the item and a content indicating the final use date of the item estimated based on the photographing information in a superimposed manner on the item.

2. The information processing apparatus according to claim 1,

5. The display control unit is A process is performed to display content indicating the bidding price of the item and content indicating the number of users who want the item superimposed on the item.

2. The information processing apparatus according to claim 1,

6. The display control unit is When the captured image is within a range of positions registered in advance as positions associated with a user of the terminal device based on position information of the terminal device, the content is displayed superimposed on the item.

2. The information processing apparatus according to claim 1,

7. The display control unit is When the image capturing is performed within a range of a position estimated as being associated with a user of the terminal device based on a position history of the terminal device, a process is performed for displaying the content superimposed on the item.

2. The information processing apparatus according to claim 1,

8. The display control unit is A content indicating a bidding price of the item according to the condition of the item estimated based on the photographing information is displayed superimposed on the item.

2. The information processing apparatus according to claim 1,

9. The display control unit is If the category of the item is not a category that is registered in advance as an excluded category for superimposed display based on item information of the item, a process is performed for superimposing the content on the item.

2. The information processing apparatus according to claim 1,

10. The display control unit is If the item is subject to a recall based on the item information of the item, a process is performed to display content indicating that the item is subject to a recall superimposed on the item.

2. The information processing apparatus according to claim 1,

11. The display control unit is When there is information registered for the item by a user who desires the item, a process is performed for displaying content indicating the registered information superimposed on the item.

2. The information processing apparatus according to claim 1,

12. The display control unit is A process is performed to display a content showing a substitute product for the product in a manner superimposed on the product so as to overwrite the product.

2. The information processing apparatus according to claim 1,

13. 1. A computer-implemented information processing method, comprising: a recognition step of recognizing an object photographed based on the photographing information; a specification step of specifying a bidding price in electronic commerce for the item recognized by the recognition step; a display control step of performing processing for displaying the content indicating the winning bid price identified by the identification step in a manner superimposed on the item; 13. An information processing method comprising:

14. A recognition step of recognizing an object photographed based on the photographing information; a determination step of determining a bidding price in electronic commerce for the item recognized by the recognition step; a display control step of performing processing for displaying a content indicating the winning bid price identified by the identification step in a manner superimposed on the item; An information processing program characterized by causing a computer to execute the above.

Images