Information communication program and information processing device

Abstract

Provided are an information communication program and an information processing device that execute an event in association with an unindexed object in content information, and on the basis of a relationship with another user of the object. An information processing device (1) comprises: a range designation accepting means (101) for accepting a designation of an image information (112) range from a user; an associating means (106) for setting and associating degrees of association of each of a first user and another user on the basis of an overlap between a range designated by the first user with respect to the image information (112) and a range designated by the other user; and an associated execution means (107) for, when an event relating to the image information (112) occurs, executing an operation corresponding to the event for the first user and / or the other user in accordance with the degrees of association.

Description

Information communication program and information processing device

[0001] The present invention relates to an information communication program and an information processing device.

[0002] As a conventional technique, an information processing device that outputs item purchase information via the Internet has been proposed (see, for example, Patent Document 1).

[0003] The information processing device disclosed in Patent Document 1 receives purchaser information from a client system, including the purchaser's ID, payment information, and shipping information, assigns an ID to the client, associates the assigned ID with the purchaser information, identifies the assigned ID and item, and sends an HTML document including an order button to the client. The client then receives and stores the assigned ID and receives and displays the document. When the information processing device receives a purchase request for the identified item sent from the client in response to selection of the order button, it combines the client's client ID with the associated purchaser information and generates an item purchase order according to invoicing and shipping information, allowing the purchaser to select the order button to order the product.

[0004] Japanese Patent Application Publication No. 11-161717

[0005] However, the information processing device of Patent Document 1 has a problem in that although it outputs item purchase information for indexed items, it cannot output item purchase information for non-indexed items, such as items that appear in images that include a background. In other words, it is necessary to prepare and index the items included in the image in advance.

[0006] Furthermore, since there is only one purchaser for an item, it is not possible to set actions for the item based on the relationship with other purchasers.

[0007] The object of the present invention is to provide an information communication program and an information processing device that associates an object in content information that is not indexed with the object and executes an event based on the relationship with other users of the object.

[0008] In order to achieve the above object, one aspect of the present invention provides the following information communication program and information processing device.

[0009] [1] An information and communication program that causes a computer to function as: a receiving means that receives a designation of a range of content information from a user; an associating means that sets and associates a degree of relevance between a first user and another user based on an overlap between the range designated by the first user and the range designated by another user for the content information; and an executing means that, when an event for the content information occurs, causes the first user and / or the other user to take an action corresponding to the event based on the degree of relevance. [2] The information and communication program described in [1], wherein the executing means displays the degree of relevance between the first user and the other user as the event. [3] The information and communication program described in [1], wherein the executing means displays a heat map on the content information based on the degree of relevance as the event. [4] The information and communication program described in [1], further causing a computer to function as a notifying means that, when the first user requests a response regarding the content information from the user who owns the content information, notifies the other users of information regarding the request for the response based on the degree of relevance. [5] The information and communication program according to [1], wherein the associating means, when ownership of a product or service related to the content information is transferred to a second user, transfers the content information and the degree of relevance to the second user. [6] The information and communication program according to [1], further comprising: a notification receiving means, when receiving from a user designation of a plurality of ranges of the content information and notification content for the ranges, receiving the plurality of ranges and the notification content as notification information; and a notification execution means, further functioning as a notification means, which selects a user determined based on a combination condition of the degrees of relevance of the plurality of ranges and notifies the user selected by the execution means based on the notification information.[7] An information processing device having: a receiving means for receiving a specification of a range of content information from a user; an associating means for setting a degree of association between the first user and the other users based on an overlap between the range specified by the first user for the content information and the range specified by the other users; and an executing means for, when an event occurs for the content information, executing an action corresponding to the event on the first user and / or the other users according to the degree of association.

[0010] According to the invention of claim 1 or 7, an event can be executed in association with an unindexed target in content information and based on the relationship between the target and other users. According to the invention of claim 2, the relevance with other users can be displayed to a first user as an event. According to the invention of claim 3, a heat map according to the relevance can be displayed on the content information as an event. According to the invention of claim 4, when a first user requests a response regarding the content information from the user who owns the content information, information regarding the response request can be notified to other users based on the relevance. According to the invention of claim 5, when ownership of a product or service related to the content information is transferred to a second user, the associating means can transfer the content information and the relevance to the second user. According to the invention of claim 6, when a user specifies multiple ranges of the content information and notification content for the ranges, the multiple ranges and the notification content can be received as notification information, a user determined based on a combination of the relevance of the multiple ranges can be selected, and the user selected based on the notification information can be notified.

[0011] FIG. 1 is a schematic diagram showing an example of the configuration of an information processing system according to an embodiment. FIG. 2 is a block diagram showing an example of the configuration of an information processing device according to an embodiment. FIG. 3 is a schematic diagram showing an example of the configuration of user information. FIG. 4 is a schematic diagram showing an example of the configuration of image information. FIG. 5 is a schematic diagram showing an example of the configuration of range specification information. FIG. 6 is a schematic diagram showing an example of the configuration of notification information. FIG. 7 is a schematic diagram showing an example of the configuration of sales information. FIG. 8 is a schematic diagram showing an example of the configuration of associated information. FIG. 9 is a schematic diagram for commonly explaining each notification operation. FIG. 10A is a schematic diagram for explaining an association operation. FIG. 10B is a schematic diagram for explaining an association operation. FIG. 10C is a schematic diagram for explaining an association operation. FIG. 11 is a schematic diagram showing an example of display of associated information. FIG. 12A is a diagram for explaining transfer of associated information due to an owner change. FIG. 12B is a diagram for explaining transfer of associated information due to an owner change. FIG. 12C is a diagram for explaining transfer of associated information due to an owner change. FIG. 13 is a flowchart for explaining basic operations and basic notification operations. FIG. 14A is a diagram for explaining grouping of users using associated information of a plurality of pieces of image information. FIG. 14B is a diagram for explaining grouping of users using associated information of a plurality of pieces of image information. FIG. 15 is a schematic diagram for explaining an association operation when a map is used as image information. FIG. 16A is a diagram for explaining a method for counting and displaying associated information when an area is clipped and quoted. FIG. 16B is a diagram for explaining a method for counting and displaying associated information when an area is clipped and quoted. FIG. 16C is a diagram for explaining a method for counting and displaying associated information when an area is clipped and quoted.

[0012] [Embodiment] (Configuration of Information Processing System) FIG. 1 is a schematic diagram showing an example of the configuration of an information processing system according to an embodiment.

[0013] This information processing system 5 is configured by connecting an information processing device 1 and terminals 2a, 2b, 2c, etc. so that they can communicate with each other via a network 4. The terminals 2a, 2b, 2c, etc. are operated by users 3a, 3b, 3c, etc., respectively.

[0014] The information processing device 1 is a server-type information processing device that operates in response to requests from terminals 2a, 2b, 2c, etc., and includes electronic components such as a CPU (Central Processing Unit) having a function for processing information within the device itself, a flash memory, etc. Note that the information processing device 1 is not limited to a server, and may operate using resources on a cloud.

[0015] Terminals 2a, 2b, 2c, etc. are information processing devices such as smartphones, and are equipped with electronic components such as a CPU, flash memory, and an image sensor that have functions for processing information within the device. Note that terminals 2a, 2b, 2c, etc. are not limited to smartphones; they may be any device capable of processing information, such as a personal computer or tablet. Furthermore, terminals 2a, 2b, 2c, etc. may not be equipped with an image sensor and instead read image information captured by other devices, such as a digital camera or a camera mounted on an artificial satellite.

[0016] The network 4 is a communication network capable of high-speed communication, and is, for example, a wired or wireless communication network such as an intranet or a LAN (Local Area Network).

[0017] As an example, the information processing device 1 accepts uploads of image information as content information in response to requests from terminals 2a, 2b, 2c, etc., stores the uploaded image information in a storage unit, controls the display of the stored image information, and accepts range specifications for the displayed image information from users (who specify the range and send the notification) along with notification content such as text and action details, and notifies the accepted notification content to the user who uploaded the image information or the user who owns the subject of the image information. Furthermore, it associates the range specifications of multiple users for a certain image information based on the relationship between the range specifications, and arranges the notification method based on the association. The arrangement of the notification method will be described later. Note that this operation may be performed on multiple servers. Users 3a, 3b, 3c, etc. can play one or more roles: uploader, owner of the subject, or source of range specification and notification.

[0018] Although the image information as the content information described above will be described below as a still image, the content information may be video information, audio information, or text information. In the case of video information, an image area and a time range are specified as the range. Alternatively, one frame of the video information may be specified, or one frame and its image area may be specified. In the case of audio information, a playback time range is specified as the range. Furthermore, in the case of text information, an arbitrary range such as a word, a sentence, a paragraph, or a page is specified as the range. The content information may also be a screen displayed on a web browser. In this case, an arbitrary area, an arbitrary image / video, or an arbitrary text range is specified as the range. Furthermore, an icon for selecting a specific part or all of the content information may be prepared in advance, so that the specific part or all of the content information is selected when the icon is selected.

[0019] (Configuration of Information Processing Apparatus) FIG. 2 is a block diagram showing an example of the configuration of the information processing apparatus 1 according to the embodiment.

[0020] The information processing device 1 comprises a control unit 10 which is composed of a CPU and the like and controls each part and executes various programs, a memory unit 11 which is composed of a storage medium such as a flash memory and stores information, and a communication unit 12 which communicates with the outside via a network 4.

[0021] The control unit 10 executes the information communication program 110 described later to function as an image information receiving means 100, a range specification receiving means 101, a notification receiving means 102, a notification means 103, a display control means 104, a sales processing means 105, an association means 106, and an association execution means 107, etc.

[0022] The image information accepting means 100 accepts image information uploaded from the terminals 2 a , 2 b , 2 c , . . . and stores it in the storage unit 11 as image information 112 .

[0023] The area specification receiving means 101 receives the specification of the area of ​​the image information 112 from the terminals 2 a , 2 b , 2 c , . . . and stores it in the storage unit 11 as area specification information 113 .

[0024] The notification receiving means 102 receives notification contents from the terminals 2 a , 2 b , 2 c . . . in association with the image information 112 and the area designation information 113 , and stores the information as notification information 114 .

[0025] The notification means 103 notifies the notification information 114 to the terminals 2a, 2b, 2c, . . . of the user who uploaded the image information 112 or the user who is the owner of the subject of the image.

[0026] The display control means 104 controls the display of image information 112 on terminals 2a, 2b, 2c, etc., and also controls the display of notification information 114 on terminals 2a, 2b, 2c, etc., and also controls the display of operation images and operation result images on terminals 2a, 2b, 2c, etc. in accordance with the operation of each means 100-103, 105, 107.

[0027] If the object specified by the range designation information 113 of the image information 112 is an object for sale, the sales processing means 105 processes the sale of the object for sale between users 3a, 3b, 3c, etc., and stores the information during and after the processing in the memory unit 11 as sales information 115.

[0028] The associating means 106 associates the range designation information 113 belonging to different users according to the area of ​​the overlapping selection frames, etc., and stores the information in the storage unit 11 as associated information 116 .

[0029] The association execution means 107 changes the operation of the notification means 103, the display control means 104, and the sales processing means 105 based on the association information 116. The specific changes will be described later.

[0030] The storage unit 11 stores an information communication program 110 that causes the control unit 10 to operate as each of the above-mentioned means 100-107, user information 111 including the user names, location information, contact information, etc. of users 3a, 3b, 3c, etc., image information 112, range designation information 113, notification information 114, sales information 115, and associated information 116. Note that the data items of each piece of information 111-116 described below are examples, and each piece of information 111-116 may be appropriately interchanged for management.

[0031] Furthermore, the information communication program 110 in the above embodiment may be provided as an add-on or API.

[0032] FIG. 3 is a schematic diagram showing an example of the configuration of the user information 111. As shown in FIG.

[0033] User information 111 is information including the user name, location information, contact information, etc. of users 3a, 3b, 3c, etc., and includes a user ID for identifying the user, the user name, the user's current or fixed location information, and contact information such as an email address, telephone number, and address.

[0034] FIG. 4 is a schematic diagram showing an example of the configuration of the image information 112. As shown in FIG.

[0035] Image information 112 is information that includes image content and accompanying information, and has an image ID for identifying the image information, image content that indicates specific image data, location information that is the location where the image information was taken or the location of the subject in the image, and user information that is the user ID of the user who uploaded the image information or the user who is the owner of the subject in the image, etc.

[0036] FIG. 5 is a schematic diagram showing an example of the configuration of the range designation information 113. As shown in FIG.

[0037] The range designation information 113 is information indicating the range designated in the image information 112, and includes a range ID for identifying the range designation information, an image ID, the ID of the user who designated the range, and the range, which is information such as coordinates that designate the range in the image. If the range is pre-defined, as in the case of cropping, which will be described later, the coordinates may be omitted and only the ID may be used.

[0038] FIG. 6 is a schematic diagram showing an example of the configuration of the notification information 114.

[0039] Notification information 114 is information indicating the details of the notification, and includes a notification ID for identifying the notification information, notification content which may be free-form text or selected text, a range ID, an image ID, and a notification source ID which is the user ID of the source of the notification.

[0040] FIG. 7 is a schematic diagram showing an example of the configuration of the sales information 115. As shown in FIG.

[0041] Sales information 115 is information exchanged when an object in image information 112 is bought and sold, and includes a sales ID for identifying the sales information, an image ID, a range ID, the price of the product, a payment source which is the purchaser's user ID, a payment destination which is the seller's user ID, and a deliverer which is the deliverer's user ID or company name.

[0042] FIG. 8 is a schematic diagram showing an example of the configuration of the association information 116. As shown in FIG.

[0043] The association information 116 is information for associating a specified range, and includes an association ID for identifying the association information, multiple range IDs (range ID1, range ID2, etc.) of the associated range designation information 113, and an overlap area, which is the area (or predetermined area unit) of the overlapping area of ​​each range ID.

[0044] (Operations of Information Processing Apparatus) Next, the operations of this embodiment will be explained by dividing them into (1) basic operations, (2) basic notification operations, (3) association and display operations, and (4) other applied operations.

[0045] (1) Basic Operation FIG. 13 is a flowchart for explaining the basic operation and basic notification operation.

[0046] First, users 3a, 3b, 3c, etc. who use the services provided by the information processing device 1 operate terminals 2a, 2b, 2c, etc. to register their own name, location information, contact information, etc. in advance as user information 111 in the information processing device 1, as shown in Fig. 3. Here, the location information may be information about a fixed location such as a home, or may be information about the real-time location of terminals 2a, 2b, 2c, etc. Furthermore, the contact information is not limited to an email address or telephone number, but may also be an ID unique to the service, etc.

[0047] Next, user 3b uses terminal 2b to take a photograph and operates terminal 2b to upload image information resulting from the photograph to information processing device 1. Terminal 2b transmits the photographed image information together with user information of user 3b, photographing location information, etc. to information processing device 1 (S300).

[0048] The image information accepting means 100 of the information processing device 1 accepts upload of image information from terminal 2b and stores it as image information 112 in the storage unit 11 (S100). As shown in FIG. 4, the uploaded image information is recorded as the image content of the image information 112, the shooting location information as the location information of the image information 112, and the user information of user 3b as "Upload" in the user information of the image information 112. If user 3b is the owner (seller, owner, etc.) of the photographed object (product, menu, etc.), the user information of user 3b is also recorded as "Owner" in the user information of the image information 112. The uploading user and the owner of the photographed object may be different, and the owner may be left blank in the case of image information without an owner or object. The owner may also be left blank in the case where an owner exists but the uploading user has accepted a request for a replacement purchase. The location information is not limited to the shooting location, but may be the location information of terminal 2b at the time of upload.

[0049] (2) Basic Notification Operations FIG. 9 is a schematic diagram for explaining each notification operation in common.

[0050] Next, in order to send a basic notification (a fixed notification such as "Like"), the user 3a requests to view an image using the terminal 2a (S200), and upon receiving the viewing request, the display control means 104 of the information processing device 1 controls the display of image information 112 on the display unit of the terminal 2a (S101). The image information 112 displayed by the display control means 104 is, for example, image information 112a as shown in FIG.

[0051] Next, the user 3a refers to the image information 112a and selects a desired target by touching a position on the touch panel of the terminal 2a that corresponds to the position of the desired crop from multiple divided areas (hereinafter referred to as "crops"), as shown in Figure 9, and selecting selection frames 113a1, 113a2, and 113a3 (S201). The terminal 2a transmits information on the selection ranges corresponding to the selection frames 113a1, 113a2, and 113a3 to the information processing device 1.

[0052] The selection frames 113a1, 113a2, and 113a3 may be used to select multiple areas for one piece of image information 112a, as shown in the figure, or may be used to select a single area. When selecting multiple areas, the multiple selections may be made simultaneously or at different times. A single selection frame may also include multiple targets. The multiple targets may be a set of products, or may include multiple varieties of a single product.

[0053] The selection frames 113a1, 113a2, and 113a3 may be selected by the user who uploaded the image or the user who is the owner.

[0054] In addition to cropping, the selection frames 113a1, 113a2, and 113a3 may also be used to specify two diagonal points of a rectangular frame, to specify the center and radius of a circle, to specify the center and size of an arbitrary shape, to enclose the outline of an area, or to specify an area by filling it in, and the method of specifying an area is not limited to the example given.

[0055] Furthermore, the selection frames 113a1, 113a2, and 113a3 may be selected by the user 3a, or may be automatically selected from objects recognized by image recognition and presented as candidates for the selection frame.Furthermore, when an uploading user takes a photo to be uploaded, the objects recognized by image recognition may be automatically selected and presented as candidates for the selection frame.

[0056] Next, the range specification accepting means 101 of the information processing device 1 accepts a range specification from the terminal 2a and stores information about the accepted range as range specification information 113 in the storage unit 11 (S102). Next, the display control means 104 of the information processing device 1 displays operation items for the selection boxes 113a1, 113a2, and 113a3. The operation items include, for example, an item for expressing a "like" (LIKE), an item for entering a comment, an item for asking the price (ASK), an item for selling / purchasing (SELL), an item for lending / borrowing (RENT), an item for adding multiple items to a cart for paying for them all at once, and an item for associating them with other images. Note that a temporary holding frame corresponding to a cart may be provided for consolidating multiple selection ranges not only when paying for multiple selection ranges all at once, but also when expressing a "like," entering a comment, or asking the price.

[0057] The user 3a operates, for example, an item for transmitting "like" among the operation items. The terminal 2a transmits to the information processing device 1 a message that the item for transmitting "like" has been operated (S202). The user 3a may also operate multiple items (such as "like" and a comment) simultaneously from the operation items. In this case, the terminal 2a transmits to the information processing device 1 a message that multiple items have been operated.

[0058] The notification receiving means 102 of the information processing device 1 receives the notification content from the terminal 2a and stores it in the storage unit 11 as notification information 114 (S103). The notification information 114 stores a range ID for the image ID, a notification source ID which is the user ID of the user 3a who is the source of the notification, and the notification content "Like."

[0059] Next, the notification means 103 of the information processing device 1 notifies the terminal 2b of the user who uploaded the image information 112 or the user 3b who is the owner of the photographed subject based on the notification information 114, and executes notification processing (S104). Note that whether to notify the uploading user or the owner of the photographed subject may be determined according to the content of the notification, may be selected by the user 3a who is notifying, or may notify both.

[0060] Terminal 2b receives the notification content from information processing device 1 and displays a message together with selection frames 113a1, 113a2, and 113a3 on display screen 104c (S301).

[0061] User 3b of terminal 2b views the message and checks selection frames 113a1, 113a2, and 113a3 and the contents of the message. If user 3b views only the images in selection frames 113a1, 113a2, and 113a3 and does not know the original image, he or she may send a search request for image information 112a, which is the original image, and the position of the selection range from terminal 2b to information processing device 1 using selection frames 113a1, 113a2, and 113a3 as search keys. In response to the request, information processing device 1 responds to terminal 2b with image information 112a, which is the original image, and the position of the selection range.

[0062] The above operation is performed not only by user 3a but also by terminals 2b, 2c, etc. operated by other users 3b, 3c, etc., and the subsequent "(3) Association and display operation" is executed based on the area of ​​the overlapping selection frames, etc.

[0063] (3) Association and Display Operations FIGS. 10A to 10C are schematic diagrams for explaining the association operations.

[0064] For example, as shown in FIG. 10A, in a situation where user 3a selects selection box 113b1 for image information 112a, user 3b selects selection box 113b2, and user 3c selects selection box 113b3 and sends a standard notification such as "like," the associating means 106 associates these selection boxes 113b1 to 113b3 according to the overlapping area, etc., and stores the association information in the memory unit 11 as association information 116.

[0065] The overlapping area may be the overlapping area itself, or may be counted in a predetermined area unit among the overlapping areas. Furthermore, it may be possible to count overlaps between the same notification method, for example, overlaps between selection boxes related to "likes," as well as overlaps between different notification methods, for example, overlaps between selection boxes related to items for asking "likes" and prices, and the overlapping area may be defined based on settings by the service operator.

[0066] As a result, the association execution means 107 executes display processing via the display control means 104 based on the association information 116, and on the display screen of the image information 112a, the display screen of user 3a displays the degree of association with user 3b as "2" and the degree of association with user 3c as "2." Furthermore, the display screen of user 3b displays the degree of association with user 3c as "3" and the degree of association with user 3a as "2." Furthermore, the display screen of user 3c displays the degree of association with user 3b as "3" and the degree of association with user 3a as "2." These displays are displayed in order of the magnitude of the degree of association of each user with other users within the image information 112a. Note that the displays may be in an order other than the magnitude of the degree of association.

[0067] Next, for example, in a situation where user 3a selects selection box 113c1 for image information 112b, and user 3b selects selection box 113c2 and sends a standard notification such as "like," as shown in Figure 10B, the association means 106 associates these selection boxes 113c1 and 113c3 based on the overlapping area, etc., and stores the association information in the memory unit 11 as association information 116.

[0068] As a result, the association execution means 107 executes display processing via the display control means 104 based on the association information 116, and on the display screen of the image information 112b, the display screen of user 3a displays the degree of association with user 3b as "3." Also, the display screen of user 3b displays the degree of association with user 3a as "3." These displays are displayed in order of the magnitude of the degrees of association of each user with other users within the image information 112a. Note that the displays may be in an order other than the magnitude of the degrees of association.

[0069] Furthermore, the association execution means 107 executes display processing via the display control means 104 based on the association information 116, and on a screen showing the overall association levels of all image information 112, the display screen for user 3a displays, as association level display 116d1, the association level with user 3b of "5" and the association level with user 3c of "2." The display screen for user 3b displays, as association level display 116d2, the association level with user 3a of "5" and the association level with user 3c of "3." The display screen for user 3c displays, as association level display 116d3, the association level with user 3b of "3" and the association level with user 3a of "2." These displays are displayed in order of magnitude of association level, but may be displayed in any other order.

[0070] As another example of display, in addition to displaying the degree of relevance to the user, the degree of relevance to the image information 112 may be displayed as shown in FIG. 11 below.

[0071] FIG. 11 is a schematic diagram showing an example of the display of the association information 116. As shown in FIG.

[0072] The association execution means 107 executes a display process via the display control means 104 based on the association information 116, and displays, on the display screen of the image information 112a, for example, on the display screen of the user who owns the image information 112a, the number of users who selected each crop and gave it a "like" on each of the crops 113e1 to 113e5, like a heat map. Note that this display is not limited to being displayed to the owner user, but may be displayed to any user. While an example of displaying numbers has been shown, this display may also be expressed using color, density, or the like. Furthermore, these displays may not be displayed normally, but may be displayed temporarily when an operation is performed on the image information 112a. The value obtained by accumulating the number of "likes" displayed in the heat map may be used as the popularity of the owner of the image information 112a. The popularity of multiple image information of the owner may also be further accumulated to obtain a total popularity, and a ranking including other users may be displayed based on the total popularity.

[0073] As an application example of the heat map display, when certain image information is displayed as an advertisement to multiple users, the related execution means 107 may set a crop number for the image information according to the advertisement fee, and may terminate the advertisement when the total number of areas in the image information cropped by users reaches the set value. Note that the area cropped by the user that is counted as the advertisement termination condition may be a predetermined area in the image information, or the advertisement may be viewed without being cropped and counted as one crop, and the total number setting can be changed in various ways.

[0074] (4) Other Applied Operations In addition to the above display operations, we will now explain examples of how to use the association information 116 of the association execution means 107. The following example explains how to handle the user associated with the selection frame when the owner of the product corresponding to the selection frame sells the product to another user and the product owner changes.

[0075] 12A to 12C are diagrams for explaining the transfer of the association information 116 accompanying an owner change.

[0076] First, as shown in FIG. 12A, it is assumed that the owner of the sofa corresponding to the area 113f1 of the image information 112a is the "previous owner," and five users have "liked" the sofa in the area 113f1.

[0077] Next, as shown in FIG. 12B, five users who "liked" the sofa in area 113f1 want to sell it, and after three users make an offer, a user who wants a price of 3,000 yen purchases it. Note that the seller, who is the previous owner, may select another buyer to sell to, for example, taking into account the degree of association with the seller. In this state, the purchasing user becomes the new owner of the sofa in area 113f1. At this time, along with the transfer of ownership of the sofa in area 113f1, the association information 116 of area 113f1 corresponding to the sofa is transferred to the new owner.

[0078] Next, as shown in FIG. 12C, for example, if a new owner offers to sell the sofa, the new owner can use the associated information 116 of the image information 112a to make an offer to sell the sofa to users who previously "liked" the sofa in area 113f1 and to users who have made offers to purchase it.

[0079] The user may also send any notification other than an offer, such as a notification of a change in the sofa's status (sale availability, price, comments, owner, etc.).

[0080] As yet another example, users may be grouped by combining the association information 116 for multiple pieces of image information 112 and combining the selection ranges of multiple images. Notifications (such as event announcements and advertisement displays) may be sent to the grouped users, for example, as shown in FIG.

[0081] 14A and 14B are diagrams for explaining grouping of users using range specification information 113 and association information 116 of multiple pieces of image information 112. FIG.

[0082] As shown in Figure 14A, areas 113g, 113h, and 113i (areas corresponding to dogs, patchwork, and furniture) are specified for image information 112g, 112h, and 112i, respectively, and there is a user in associated information 116 who has specified an area that includes (or partially overlaps with) areas 113g, 113h, and 113i. If, as shown in Figure 14B, a user wishes to send an advertisement or coupon to users who are interested in all of dogs, patchwork, and furniture, the user who is sending the notification can narrow down the users using the "and" condition.

[0083] In addition, once the user who is sending the notification has narrowed down the users using the AND condition, the user may reuse the condition and send a notification to or including users who have newly specified areas 113g, 113h, and 113i.

[0084] Furthermore, for areas that do not exist in the range specification information 113 or the association information 116, the user who sends the notification may predetermine multiple areas and the combination conditions for those areas, and the notification may be sent when the user's range specification matches those areas and conditions.

[0085] Furthermore, if a user wishes to send a notification to users who are interested in dogs, patchwork, or furniture, the user who sends the notification can narrow down the users by using an OR condition. Furthermore, the user may narrow down the users by using a combination of conditions such as AND, OR, NOT, NAND, and NOR, or a combination of these. Furthermore, the order in which the areas are selected may also be incorporated into the conditions.

[0086] The owners of the image information 112g, 112h, and 112i may be the same user or different users.

[0087] Furthermore, the image information 112g, 112h, and 112i are different pieces of image information, but different areas may be specified for the same image information, and users may be narrowed down based on the combination of these different areas.

[0088] (Effects of the embodiment) According to the embodiment described above, range specifications for image information 112 are accepted, and the degree of association between users is set based on the overlap of the range specifications, and the association execution means 107 executes an event for the user according to the degree of association.As a result, an event can be executed in association with an object that is not indexed in the content information and based on the relationship of the object with other users.

[0089] Specifically, the degree of association of a user can be displayed based on the "Like" notification. Also, by displaying a heat map on the image information 112, areas of interest to other users can be displayed.

[0090] Furthermore, when the owner of the product or service in the image information 112 changes, the associated information 116 is transferred, so that the new owner can take over users who are interested in the product or service, and the information becomes useful to the new owner when selling the product or service.

[0091] Other Embodiments The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the present invention.

[0092] The range specification accepting unit 101 may not only accept a range specification for captured image information, but also accept a range specification for a preview image being captured by the user who is the photographer via a touch panel. In other words, the range specification may be accepted before image generation by capturing an image. Furthermore, for example, image capture may be performed simultaneously with range specification. In other words, image generation by capturing an image and range specification may be performed simultaneously. Furthermore, the range specification may not only be performed via a touch panel for a preview image, but also may be performed by a gesture made by the photographer's hand between the actual object being captured and the camera, and the gesture recognized by image processing. Furthermore, the range specification may be accepted via a touch panel from a user for a video being captured and distributed by another user, for example, a video being live-streamed. Furthermore, the accepted range specification may be used to give arbitrary instructions from the user to the other user, such as instructions on which direction to go or an instruction to purchase. Note that videos being live-streamed may be captured using a smartphone or other device owned by the other user, or may be captured using a camera or other filming equipment.

[0093] The range specification receiving unit 101 may also receive a range boundary specification by free drawing, or the center and radius of a circular or elliptical range by a dragging operation, or the start point and end point or center and maximum (minimum) outer shape of a polygon by a dragging operation. Furthermore, the range specification receiving unit 101 may also receive an operation other than a dragging operation, such as multiple taps or pinch-outs.

[0094] Furthermore, the notification means 103 may be configured not to notify (store as information) or not to immediately notify (the information processing device 1 temporarily stores and periodically notifies) the user who uploaded the image information 112 or the user who is the owner of the photographed subject of the notification information 114. For example, the notification information 114 received by the notification receiving means 102 according to predetermined rules may be stored for a predetermined period of time, and the contents may be compiled before notifying the user of statistical information. Furthermore, if no notification is made, the notification information 114 may be accessed by the user. Specific examples include the following.

[0095] For example, if an image containing a questionnaire and its selection items (such as "○" or "×" or numbers indicating a degree on a scale of 1 to 10) is prepared as image information 112, range designation receiving means 101 may receive range designations for the selection items of the questionnaire from image information 112 to generate range designation information 113, and notification receiving means 102 may tally the selection items of the questionnaire from range designation information 113, which is responses from one or more users, and generate the tally as notification information 114. The tally may be anonymous, or may be associated with the user's ID or the like.

[0096] Also, for example, when reserving a rental studio or rental conference room, an image in which dates and times are drawn in a grid pattern for each studio or conference room is prepared as image information 112, range specification receiving means 101 may receive a range specification for the grid in image information 112 and set it as range specification information 113, and notification receiving means 102 may receive reservations for each studio or conference room from one or more users based on range specification information 113 and set the contents of the received reservation as notification information 114.

[0097] Furthermore, for example, when an image showing a seating chart or an area is prepared as image information 112 for seating designation at a live concert or reserving an area at a campsite, the range designation receiving means 101 may receive a range designation for a seat or free area designation in the image information 112 and set it as range designation information 113, and the notification receiving means 102 may receive reservations for seats or free areas from one or more users based on the range designation information 113 and set the content of the received reservation as notification information 114. In addition, in the case of seat designation, seats may be arbitrarily selected from the designated area, such as "two seats in the designated area." Furthermore, the area designation may be not only two-dimensional but also three-dimensional or more-dimensional.

[0098] The notification means 103 may also be configured to transmit the notification information 114 as an operation instruction to a device such as a drone, actuator, or robot, rather than to the user who uploaded the image information 112 or the user who is the owner of the subject being photographed. Alternatively, the notification means 103 may be configured to transmit the notification information 114 as a program execution instruction to a PC or server. Specific examples include the following.

[0099] For example, when a photograph of a television remote control, an electric switch in a house, a printer button, a PC keyboard, etc. is prepared as image information (the image information may be prepared by taking a photograph using a drone, a robot, etc.), the range designation receiving means 101 receives a range designation for the remote control buttons, electric switch, printer buttons, PC keyboard, etc. in the image information 112 and sets it as range designation information 113, and the notification receiving means 102 receives a pressing operation, a rotating operation, a pulling operation, etc. of the switch, button, etc. specified from the range designation information 113 (these operations may be specified separately or may be predetermined operations), and transmits the received operation content as notification information 114 as an operation instruction to a device such as a drone, actuator, or robot. Furthermore, the operation instruction is not limited to the operation of a switch, etc., and may also be movement to a position specified in the image information.

[0100] For example, if photographs of a television remote control, a light switch in the house, a printer button, a PC keyboard, etc. are prepared as image information, the range designation receiving means 101 receives a range designation for the remote control buttons, light switch, printer button, PC keyboard, etc. in the image information 112 and sets it as range designation information 113, and the notification receiving means 102 receives the transmission of a wireless signal such as infrared or electromagnetic wave output as a result of operating the switch, button, etc. specified from the range designation information 113, and transmits the received operation content as notification information 114 as an operation instruction to a wireless communication simulator such as an infrared emulator or a wireless signal emulator (the emulator is assumed to be previously trained to associate images with transmitted signals). This allows the same results as when operating a button, etc. in the image information (such as operating the television, adjusting the lights in the house, canceling the printer, putting the PC to sleep, etc.) to be obtained.

[0101] Furthermore, for example, when a screenshot of a screen on a PC or smartphone on which an operation execution button (GUI; Graphic User Interface) is displayed is prepared as image information, the range specification receiving means 101 may receive a range specification for the operation execution button or the like in the image information 112 to generate range specification information 113, and the notification receiving means 102 may receive a pressing operation of the operation execution button or the like specified from the range specification information 113, and transmit the received operation content as notification information 114 as an operation instruction to the corresponding PC or smartphone or a server or the like that manages a website corresponding to the screen (which is registered as user information for the image information 112). Furthermore, even if the website to be specified is not registered as user information, it may be identified by performing an image search.

[0102] Furthermore, for example, as an application of the display example of the associated information 116 shown in Figure 11, it is possible to generate a heat map display by aggregating "LIKE" (or "Needs correction") by users for an image created by a generation AI (Artificial Intelligence), and instruct the generation AI to correct areas in the heat map display with few "LIKE"s (or areas with many "Needs correction"s).

[0103] FIG. 15 is a schematic diagram for explaining the associating operation when a map is used as the image information 112. In FIG.

[0104] Furthermore, for example, a map may be used as the image information 112j, and when a certain point is designated, the point 113J １ , 113J ２ As an example, a circular area 113j with a radius of 500 m １ , 113j ２ It may also be possible to specify the point 113J. １ , 113J ２ The circular area 113j of these multiple locations may be the GPS location of the smartphone used by the user (which may be stationary or moving), a location specified by the user's operation, or a location with a time range specified by the user's operation. １ , 113j ２ When these two points overlap, the point 113J １ , 113J ２ This allows for control such as increasing the degree of association between users who specify each other, and allowing them to view each other's information according to the degree of association.

[0105] Furthermore, various controls such as displaying advertisements or prioritizing the display of user profiles may be performed based on the relevance obtained by combining the relevance between users in the image information 112 and the relevance between users in specifying locations on a map.

[0106] In the above embodiment, the divided areas are displayed so that they can be seen by the user, but instead of displaying the divided areas, when the user selects a point on the image, the display control means 104 may display only the selected point, and the range designation receiving means 101 may count the (pre-divided, not displayed) areas that include the selected point. Furthermore, when the user selects a point on the image, the selected point may not be displayed either, and the range designation receiving means 101 may count the (pre-divided, not displayed) areas that include the selected point.

[0107] 16A to 16C are diagrams for explaining a method for counting and displaying associated information when an area is clipped and quoted.

[0108] As shown in Figure 16A, a user selects area 113k from image information 112k, and then, as shown in Figure 16B, displays image information 112l corresponding to the selected area 113k as a quoted image on a page managed by the user, resulting in 10 "likes" from other users. As a result, as shown in Figure 16C, the number of "likes" may be displayed in the corresponding area 113ki of the original image information 112k. Note that if area 113k is cited by multiple users, the total number of "likes" received by the multiple users from other users may be displayed.

[0109] In the above embodiment, the functions of the means 100 to 107 of the control unit 10 are realized by a program, but all or part of the means may be realized by hardware such as an ASIC. The program used in the above embodiment may also be stored on a recording medium such as a CD-ROM and provided. The steps described in the above embodiment may be replaced, deleted, or added without departing from the spirit of the present invention. Possible industrial applications

[0110] An information communication program and an information processing device are provided that associate an unindexed target in content information with the target and execute an event based on the relationship between the target and other users.

[0111] 1: Information processing device 2a, 2b, 2c: Terminal 3a, 3b, 3c: User 4: Network 5: Information processing system 10: Control unit 11: Storage unit 12: Communication unit 100: Image information receiving means 101: Range designation receiving means 102: Notification receiving means 103: Notification means 104: Display control means 105: Sales processing means 106: Association means 107: Association execution means 110: Information communication program 111: User information 112: Image information 113: Range designation information 114: Notification information 115: Sales information 116: Association information

Claims

1. An information and communications program that causes a computer to function as: a receiving means for receiving a specification of a range of content information from a user; an associating means for setting and associating a degree of association between the first user and the other users based on the overlap between the range specified by the first user for the content information and the range specified by the other users; and an execution means for, when an event occurs for the content information, executing an action corresponding to the event on the first user and / or the other users according to the degree of association.

2. The information communication program according to claim 1, wherein said execution means displays the degree of association with said other user to said first user as said event.

3. The information communication program according to claim 1, wherein the execution means displays a heat map according to the relevance on the content information as the event.

4. An information and communication program as described in claim 1, further functioning as a notification means for notifying other users of information regarding the request for a response based on the relevance when the first user requests a response regarding the content information from the user who is the owner of the content information.

5. An information and communication program as described in claim 1, wherein the associating means transfers the content information and the relevance to a second user when ownership of a product or service related to the content information is transferred to the second user.

6. An information and communication program as claimed in claim 1, further comprising a notification receiving means for receiving, from a user, the specification of a range of a plurality of pieces of content information and notification content for said ranges, and receiving said ranges and notification content as notification information; and said execution means for selecting a user based on a combination of conditions for the relevance of said plurality of ranges, and notifying the user selected by said execution means based on said notification information.

7. An information processing device having: a receiving means for receiving a specification of a range of content information from a user; an associating means for setting and associating a degree of association between the first user and the other users based on the overlap between the range specified by the first user for the content information and the range specified by the other users; and an execution means for executing an action corresponding to an event on the first user and / or the other users according to the degree of association when an event occurs for the content information.

Images