Information processing device, information processing method, and program

Abstract

To provide a technique capable of accurately distributing a content suitable for a user.SOLUTION: An information processing apparatus according to one aspect of the present disclosure includes identification means that identifies a position of a photographer who photographs a photographic image using a terminal and a direction the photographer faces based on utility pole identification mark included in the photographic image acquired by the terminal, and content determination means that determines a content to be distributed to the terminal among a plurality of contents based on the identified position and the direction.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to techniques for distributing content. [Background technology]

[0002] There is technology that utilizes mobile devices such as smartphones and tablets to provide services based on a user's location information.

[0003] Patent Document 1 discloses a technology for acquiring user location information using a global positioning system (GPS) installed in a mobile terminal, and delivering content to the user based on the acquired location information and preset user information.

[0004] Furthermore, as a document relating to acquisition of location information, Patent Document 2 discloses identifying the location of a user by using image information acquired from a mobile terminal carried by the user. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2014-241600 A [Patent Document 2] JP 2007-011607 A Summary of the Invention [Problem to be solved by the invention]

[0006] In the technology described in Patent Document 1, the user's location information is acquired using only GPS. Therefore, for example, if there are obstacles such as high-rise buildings around the user, the user's location information may not be identified accurately. As a result, when content based on the user's location information is delivered, it may not be possible to deliver content suitable for the user.

[0007] The technology described in Patent Document 2 simply identifies the user's location status, and does not disclose determining which content to provide to the user from a plurality of pieces of content depending on the location status.

[0008] The present disclosure has been made in consideration of the above-mentioned problems, and has an object to provide a technique capable of delivering content suited to a user with high accuracy. [Means for solving the problem]

[0009] An information processing device according to one aspect of the present disclosure includes an identification means for identifying a position of a photographer who captured an image using a terminal and a direction in which the photographer is facing based on a utility pole identification sign that appears in the captured image obtained from the terminal, and a content determination means for determining which content to deliver to the terminal from among a plurality of contents based on the identified position and direction.

[0010] An information processing device according to one aspect of the present disclosure includes an identification means for identifying the location of a photographer who captured the image using the terminal based on a utility pole identification sign that appears in a captured image acquired from a terminal and location information of the terminal acquired by a location information acquisition means possessed by the terminal, and a content determination means for determining which content to deliver to the terminal from among a plurality of contents based on the identified location.

[0011] An information processing method according to one aspect of the present disclosure identifies the position of the photographer who captured the image using a terminal and the direction in which the photographer is facing based on a utility pole identification sign that appears in a captured image obtained from the terminal, and determines which of a plurality of contents to deliver to the terminal based on the identified position and direction.

[0012] A program according to one aspect of the present disclosure causes a computer to perform the following processes: based on a utility pole identification sign appearing in a captured image obtained from a terminal, identifying the position of a photographer who used the terminal to capture the image and the direction in which the photographer is facing; and based on the identified position and direction, determining which of multiple contents to deliver to the terminal. Effect of the Invention

[0013] According to the present disclosure, an effect is obtained in that it becomes possible to deliver content suited to a user with high accuracy. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a content distribution system according to a first embodiment. [Diagram 2] 1 is a block diagram illustrating an example of a functional configuration of an information processing device according to a first embodiment. [Diagram 3] 5 is a flowchart illustrating an example of an operation of the information processing device according to the first embodiment. [Figure 4] FIG. 11 is a block diagram illustrating an example of a functional configuration of a content distribution system according to a second embodiment. [Diagram 5] FIG. 11 is a diagram showing an example of a utility pole identification sign according to a second embodiment. [Figure 6] FIG. 11 is a sequence diagram illustrating an operation of a content delivery system according to a second embodiment. [Figure 7] FIG. 11 is a diagram showing an example of a sign according to the second embodiment. [Figure 8] FIG. 11 is a diagram showing another example of a sign according to the second embodiment. [Figure 9] FIG. 13 is a block diagram illustrating an example of a functional configuration of a content delivery system according to a third embodiment. [Figure 10] FIG. 13 is a block diagram illustrating an example of a functional configuration of a content delivery system according to a fourth embodiment. [Figure 11]FIG. 13 is a block diagram illustrating an example of a functional configuration of a content delivery system according to a fifth embodiment. [Figure 12A] FIG. 13 is a diagram showing an example of a captured image according to the fifth embodiment. [Figure 12B] FIG. 13 is a diagram showing an example of a captured image according to the fifth embodiment. [Figure 13] FIG. 1 is a block diagram showing an example of a hardware configuration of a computer device that realizes an information processing device in the first, second, third, fourth and fifth embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0016] <First embodiment> An information processing device according to a first embodiment will be described.

[0017] Fig. 1 is a diagram illustrating an example of a configuration of a content delivery system 1000 including an information processing device 100 according to a first embodiment. As illustrated in Fig. 1, the content delivery system 1000 includes an information processing device 100 and a delivery device 200. The information processing device 100 is communicably connected to the delivery device 200 and a terminal 300 via a network.

[0018] The terminal 300 is communicably connected to the information processing device 100 and the distribution device 200 via a network. The terminal 300 has a function of capturing an image of the surroundings and a function of outputting content. The terminal 300 is, for example, a mobile phone, a smartphone, or a tablet, but is not limited to these examples.

[0019] In the situation shown in Fig. 1, a user is using the terminal 300 to capture an image of a utility pole identification sign (details will be described later) attached to a utility pole. The image captured by the terminal 300 may be a still image or a moving image. In this specification, an image captured by the terminal 300 is referred to as a captured image. Also, in this specification, a user who captures an image using the terminal 300 is also referred to as a photographer. The terminal 300 transmits the captured image to the information processing device 100.

[0020] When the information processing device 100 acquires a captured image from the terminal 300, the information processing device 100 determines the content to be delivered to the terminal 300 in accordance with the information acquired based on the captured image.

[0021] The distribution device 200 distributes the content determined by the information processing device 100 to the terminal 300.

[0022] In this manner, the content delivery system 1000 according to the first embodiment is a system that delivers content to the terminal 300 in accordance with a captured image acquired from the terminal 300.

[0023] 1, the information processing device 100 and the distribution device 200 are shown as independent devices, but are not limited thereto. For example, the information processing device 100 and the distribution device 200 can be realized as an integrated device. Also, the information processing device 100 and the distribution device 200 may be constructed in an on-premise environment or in a cloud environment.

[0024] [Details of the information processing device 100] Next, a description will be given of details of the information processing device 100. Fig. 2 is a block diagram showing an example of a functional configuration of the information processing device 100 according to the first embodiment. As shown in Fig. 2, the information processing device 100 has an identification unit 110 and a content determination unit 120.

[0025] The identification unit 110 identifies the position of the photographer and the direction in which the photographer is facing, based on the captured image acquired from the terminal 300. For example, the identification unit 110 reads characters written on a utility pole identification sign shown in the captured image. Here, the utility pole identification sign is a sign on which information for identifying a utility pole is written. The utility pole identification sign is attached to a utility pole. For example, the utility pole identification sign contains characters indicating the place name where the utility pole is installed and a number that identifies the utility pole. In this specification, such information written on a sign is also referred to as sign information.

[0026] The identification unit 110, for example, reads sign information from a utility pole identification sign, and searches the sign database for position information and direction information corresponding to the read sign information. The sign database includes data in which sign information is associated with position information and direction information corresponding to the sign information. Here, the direction information is, for example, a direction opposite to the direction in which the sign faces. That is, the direction information corresponding to the sign information corresponds to, for example, the direction in which the photographer faces when facing the sign information. The sign database may be stored in advance in a storage device (not shown) included in the information processing device 100, or may be stored in an external storage device communicably connected to the information processing device 100. The information processing device 100 may also acquire the sign database from an external server device communicably connected. For example, the identification unit 110 searches for position information and direction information corresponding to the read sign information, and when the search is successful, the position and direction indicated by the position information and direction information corresponding to the read sign information are determined to be the position of the photographer and the direction in which the photographer faces.

[0027] In this way, the identification unit 110 identifies the position of the photographer who captured the image using the terminal and the direction in which the photographer is facing, based on the utility pole identification sign included in the captured image acquired from the terminal. The identification unit 110 is an example of an identification means.

[0028] The content determination unit 120 determines, based on the position and direction specified by the specification unit 110, a content to be delivered to the terminal 300 from among a plurality of contents. For example, the content determination unit 120 selects a content corresponding to information indicating the specified position and direction from a content database. Here, the content database includes a plurality of pieces of data in which information for identifying a content (hereinafter also referred to as content identification information) is associated with position information and direction information. The content database may be stored in advance in a storage device (not shown) included in the information processing device 100, or may be stored in an external storage device communicably connected to the information processing device 100. The information processing device 100 may also acquire the content database from an external server device communicably connected. Then, the content determination unit 120 determines the selected content as a content to be delivered to the terminal 300.

[0029] Next, the content determination unit 120 transmits, for example, content identification information of the determined content to the distribution device 200. The distribution device 200 distributes the content corresponding to the content identification information received from the information processing device 100 to the terminal 300. The distribution device 200 distributes the content by, for example, transmitting content data indicating actual data of the content to the terminal 300. Note that the method of distributing the content is not limited to this example. For example, when the content data is stored in a storage device (not shown) of the terminal 300, the distribution device 200 may transmit the content identification information to the terminal 300. Then, the terminal 300 may output the content by reading the content corresponding to the received content identification information from the storage device of the terminal 300. In this case, instead of the distribution device 200, the content determination unit 120 of the information processing device 100 may transmit the content identification information to the terminal 300.

[0030] In this way, the content determining unit 120 determines which of the multiple pieces of content to distribute to the terminal based on the specified position and direction. The content determining unit 120 is an example of a content determining means.

[0031] [Operation of information processing device 100] Next, the operation of the information processing device 100 will be described with reference to Fig. 3. Fig. 3 is a flowchart illustrating the operation of the information processing device 100. In the operation described below, it is assumed that the information processing device 100 acquires a captured image from the terminal 300 in the situation of Fig. 1. Note that in this specification, each step in a flowchart or sequence diagram will be expressed using a number assigned to each step, such as "S101".

[0032] The identifying unit 110 identifies the position of the photographer and the direction in which the photographer is facing, based on the utility pole identification sign included in the captured image acquired from the terminal 300 (S101).

[0033] The content determination unit 120 determines the content to be distributed to the terminal based on the specified position and direction (S102). The content determination unit 120 transmits, for example, content identification information indicating the determined content to the distribution device 200.

[0034] Then, the distribution device 200 transmits content data corresponding to the content identification information to the terminal 300, whereby the content is distributed to the terminal 300.

[0035] As described above, the information processing device 100 according to the first embodiment specifies the position of the photographer who took the image using the terminal and the direction in which the photographer is facing, based on the utility pole identification sign shown in the captured image acquired from the terminal. Then, the information processing device 100 determines the content to be delivered to the terminal from among the multiple contents based on the specified position and direction. For example, a content may be delivered in which the sound output from the terminal is determined according to the user's position, and the volume changes depending on the direction in which the user is facing. In addition, for example, a content may be delivered in which an object included in the image output by the terminal is determined according to the user's position, and the appearance of the object changes depending on the direction in which the user is facing. By having the above configuration, the information processing device 100 according to the first embodiment can accurately specify the user's location when delivering content based on the user's location situation, such as the user's location and the direction in which the user is facing. Therefore, the information processing device 100 according to the first embodiment has an effect of being able to deliver content suitable for the user with high accuracy.

[0036] In the present embodiment, an example in which a utility pole identification sign is photographed by the terminal 300 has been described, but the subject to be photographed is not limited to a utility pole identification sign. For example, instead of a utility pole identification sign, an existing sign whose installation location is uniquely determined, such as a guide sign installed on a road or a railroad crossing identification sign, may be the subject to be photographed. In this case, the information processing device 100 identifies the user's position and the direction in which the user is facing based on the sign shown in the photographed image.

[0037] <Second embodiment> Next, a content distribution system including an information processing device according to a second embodiment will be described.

[0038] Fig. 4 is a block diagram showing an example of the configuration of a content delivery system 1001 according to the second embodiment. As shown in Fig. 4, the content delivery system 1001 includes an information processing device 101 instead of the information processing device 100 in the first embodiment, and is otherwise similar to the content delivery system 1000 described in the first embodiment. That is, the content delivery system 1001 includes the information processing device 101 and a delivery device 200. Note that a description of the configuration and operation of the content delivery system 1001 shown in Fig. 4 that overlaps with the description of the first embodiment will be omitted.

[0039] [Details of information processing device 101] As shown in FIG. 4, the information processing device 101 includes a specification unit 110, a content determination unit 120, and a communication unit .

[0040] The communication unit 130 transmits and receives data to and from the distribution device 200 and the terminal 300 .

[0041] The identification unit 110 includes a sign information reading unit 111 and a search unit 112. The sign information reading unit 111 reads sign information from the area of ​​the sign shown in the captured image acquired from the terminal 300 via the communication unit 130. The sign information indicates a character string or a symbol string written on the sign, and is information uniquely determined for each sign. FIG. 5 is a diagram showing an example of a utility pole identification sign. The utility pole identification sign is an example of a sign in this specification. In the example of FIG. 5, the place name "Kawasaki City" is written as the sign name, and "0001" is written as the utility pole number. Such a combination of the sign name and the utility pole number is uniquely determined. In the example of FIG. 5, the sign information indicates the sign name and the utility pole number. Note that the description example of the utility pole identification sign is not limited to the example of FIG. 6. For example, the sign name may use a number or a symbol, and the utility pole number may use a character or a symbol other than a number. In addition, a predetermined character string without a character string division may be used, as in the sign name and the utility pole number of FIG. 5.

[0042] The sign information reading unit 111, for example, recognizes an area in which the sign name and the pole number of the utility pole identification sign are reflected from the captured image, and reads the sign name and the pole number as sign information. The sign information reading unit 111 recognizes a character area of ​​the sign from the captured image, for example, by using an OCR (Optical Character Reader) technique, and reads characters one by one from the character area. Note that the sign information reading unit 111 may read the sign information by using other techniques, not limited to the OCR technique. For example, the sign information reading unit 111 can read the sign information by using a known machine learning technique. Examples of known machine learning techniques include an SVM (Support Vector Machine), a neural network, and a random forest. Furthermore, the sign information reading unit 111 may use a deep learning technique when reading the sign information.

[0043] If the label information cannot be read, the label information reading unit 111 may notify the content determining unit 120 that an error has occurred in reading.

[0044] In this way, the sign information reading unit 111 reads the sign information written on the utility pole identification sign from the area in which the utility pole identification sign appears in the captured image. The sign information reading unit 111 is an example of a sign information reading means.

[0045] The search unit 112 specifies the user's location based on the sign information read by the sign information reading unit 111. For example, the search unit 112 searches the sign database for position information and direction information corresponding to the read sign information. The sign database includes data in which the sign information is associated with the position information and direction information corresponding to the sign information. For example, in the case of a utility pole identification sign as shown in the example of FIG. 5, the sign database associates the position information indicating the position of the utility pole on which the sign is attached and the direction information indicating the direction the sign faces with the combination of the sign name and the utility pole number. The search unit 112 searches the sign database using, for example, the read sign information as a key. If the search is successful, the user's position and the direction the user faces are specified according to the position information and direction information associated with the sign information that is successful. If the search is not successful, the search unit 112 does not need to specify the user's position and the direction the user faces.

[0046] In this way, the search unit 112 searches for position information and direction information corresponding to the read sign information from a database in which sign information is associated with position information and direction information, and if the search is successful, identifies the position and direction of the photographer according to the position information and direction information corresponding to the read sign information. The search unit 112 is an example of a search means.

[0047] Here, the sign database is the same as the sign database described in the first embodiment. Note that the information in which the combination of the sign name and the utility pole number is associated with the location information is provided, for example, by an electric power company or a communication company that manages the utility pole. In addition, the location on the utility pole where the utility pole identification sign is attached is often a location that is easy for an employee of the electric power company or the communication company to confirm, such as a location facing a road. Therefore, for example, the direction in which the sign faces can be calculated from the location information indicating the location of the utility pole and the map data. Such calculation of the direction in which the sign faces and the opposite direction and creation of the sign database may be performed by the information processing device 101. The sign database may be stored in advance in a storage device (not shown) included in the information processing device 101, or may be stored in an external storage device communicably connected to the information processing device 101. In addition, the information processing device 101 may acquire the sign database from an external server device communicably connected.

[0048] The content determination unit 120 determines the content to be delivered to the terminal 300 based on the position and direction identified by the identification unit 110. For example, the content determination unit 120 selects content corresponding to information indicating the identified position and direction from a content database. This makes it possible to select content according to the user's position and the direction in which the user is facing. The content database is the same as the content database described in the first embodiment. The content database may be stored in advance in a storage device (not shown) included in the information processing device 101, or may be stored in an external storage device communicatively connected to the information processing device 101. In addition, the information processing device 101 may acquire the content database from an external server device communicatively connected.

[0049] Then, the content determining unit 120 transmits the content identification information of the determined content to the distribution device 200 via the communication unit .

[0050] If the identifying unit 110 does not identify the user's position and the direction in which the user is facing (i.e., if the search unit 112 does not find a search result), the content determining unit 120 may transmit information indicating that the position and the direction in which the user is facing have not been identified to the distribution device 200 via the communication unit 130. Furthermore, if the content determining unit 120 receives a notification from the sign information reading unit 111 indicating that an error has occurred in reading, the content determining unit 120 may transmit information indicating that an error has occurred in reading to the distribution device 200 via the communication unit 130.

[0051] [Details of distribution device 200] The distribution device 200 includes a communication unit 210 and a distribution unit 220.

[0052] The communication unit 210 transmits and receives data to and from the information processing device 101 and the terminal 300 .

[0053] The distribution unit 220 distributes content to the terminal 300. For example, the distribution unit 220 receives content identification information from the information processing device 101 via the communication unit 210. Then, the distribution unit 220 transmits content data corresponding to the content identification information to the terminal 300.

[0054] When information indicating that the user's position and the direction in which the user is facing have not been specified or information indicating that an error has occurred in reading has been received from the information processing device 101, content data corresponding to the respective information may be transmitted. For example, when the user's position and the direction in which the user is facing have not been specified, the distribution unit 220 may transmit to the terminal 300 content data of content indicating that the photographed sign is different. Furthermore, when the distribution unit 220 receives information indicating that an error has occurred in reading, the distribution unit 220 may transmit to the terminal 300 content data of content indicating an instruction to photograph the sign so that it is larger.

[0055] [Terminal 300 Details] The terminal 300 includes a communication unit 310 , an image capturing unit 320 , and an output unit 330 .

[0056] The communication unit 310 transmits and receives data to and from the information processing device 101 and the distribution device 200 .

[0057] The photographing unit 320 photographs a predetermined range and generates a photographed image. The photographing unit 320 photographs, for example, in response to a user's operation. The photographed image may include information indicating the time at which the photographed image was generated (i.e., the photographing time). The photographing unit 320 transmits the photographed image to the information processing device 101 via the communication unit 310.

[0058] The output unit 330 acquires content data from the distribution device 200 via the communication unit 310. Then, the output unit 330 outputs the content based on the acquired content data. If the content includes video, the output unit 330 outputs the video using a display of the terminal, and if the content includes audio, the output unit 330 outputs the audio using a speaker of the terminal.

[0059] In addition, when content data is stored in a storage device (not shown) possessed by the terminal 300, the output unit 330 may output content according to content identification information acquired from the distribution device 200 or the information processing device 101 via the communication unit 310.

[0060] [Operation of content distribution system 1001] Next, the operation of the content distribution system 1001 will be described with reference to Fig. 6. In the operation described below, it is assumed that the user of the terminal 300 photographs an image of a utility pole identification sign. Fig. 6 is a sequence diagram illustrating the operation of the content distribution system 1001.

[0061] The photographing unit 320 of the terminal 300 photographs a utility pole identification sign (S201). Then, the photographing unit 320 transmits the photographed image to the information processing device 101 via the communication unit 310.

[0062] The sign information reading unit 111 of the information processing device 101 reads sign information from the area of ​​the utility pole identification sign shown in the captured image received from the terminal 300 (S203). The search unit 112 searches the sign database using the read sign information as a key (S204). If the search returns a hit, the search unit 112 identifies the position and direction of the photographer based on the position information and direction information corresponding to the read sign information (S205). The content determination unit 120 determines the content to be distributed to the terminal 300 based on the identified position and direction (S206). The content determination unit 120 transmits content identification information indicating the determined content to the distribution device 200 (S207).

[0063] The distribution unit 220 of the distribution device 200 distributes the content to the terminal 300 in accordance with the content identification information received from the information processing device 101 via the communication unit 210 (S208). More specifically, the distribution unit 220 transmits content data of the content corresponding to the content identification information to the terminal 300.

[0064] The output unit 330 of the terminal 300 outputs the content based on the content data acquired via the communication unit 310 (S209).

[0065] As described above, the information processing device 101 according to the second embodiment specifies the position of the photographer who took the image using the terminal and the direction in which the photographer is facing, based on the utility pole identification sign shown in the captured image acquired from the terminal. Then, the information processing device 100 determines the content to be delivered to the terminal from among the multiple contents, based on the specified position and direction. With this configuration, the information processing device 101 according to the second embodiment can accurately specify the user's location status when delivering content based on the user's location status, such as the user's location and the direction in which the user is facing, in the same way as the information processing device 100 according to the first embodiment. Therefore, the information processing device 100 according to the second embodiment has the effect of being able to deliver content suitable for the user with high accuracy.

[0066] Moreover, the information processing device 101 does not need to use information obtained from a GPS possessed by a terminal possessed by the user in order to specify the user's position. Therefore, the information processing device 101 can accurately specify the user's position even when there are obstacles such as high-rise buildings around the user. Here, in order to deal with cases where the position information cannot be acquired by the GPS, for example, a marker such as a QR (Quick Response) code indicating the position information is installed, and the user is made to read the marker using a terminal, thereby specifying the user's position. However, in such a case, costs for installing the marker and for maintaining the installed marker are incurred. In contrast, in the content distribution system 1001 according to the second embodiment, existing signs are used to specify the user's position, so there is no need to newly install a marker indicating the position information. Furthermore, existing signs such as utility pole identification signs are maintained by the power company or communication company that manages the signs. Therefore, in the content distribution system 1001 according to the second embodiment, the cost for maintaining the signs can also be reduced.

[0067] [Variation 1] In the second embodiment, the use of utility pole identification signs to identify the user's location has been mainly described, but signs other than utility pole identification signs may be used. For example, guide signs installed on roads may be used. FIG. 7 is a diagram showing an example of a road guide sign. In this case, for example, the user photographs the guide sign using the terminal 300. The information processing device 101 acquires a photographed image showing the guide sign from the terminal.

[0068] The sign information reading unit 111 of the identification unit 110 reads the characters written on the guide sign. For example, if the guide sign shown in Fig. 7 is shown in the captured image, the sign information reading unit 111 reads the characters "Kawasaki 12km" and "Higashi-Kanagawa 5.3km" as sign information. The search unit 112 searches the sign database using the read sign information as a key. At this time, the sign database contains data in which the sign information indicating the characters written on the guide sign is associated with the position information and the direction information.

[0069] Furthermore, the sign used in the present disclosure may be an identification sign installed at a railroad crossing. Fig. 8 is a diagram showing an example of an identification sign at a railroad crossing. In this case, for example, a user photographs the identification sign using the terminal 300. The information processing device 101 acquires a photographed image showing the identification sign from the terminal.

[0070] The sign information reading unit 111 of the identification unit 110 reads the characters written on the identification sign. For example, if the identification sign shown in Fig. 8 is captured in the captured image, the sign information reading unit 111 reads the characters "Kawasaki No. 1 Crossing" as sign information. The search unit 112 searches the sign database using the read sign information as a key. At this time, the sign database contains data in which the sign information indicating the characters written on the identification sign is associated with position information and direction information.

[0071] Note that the above-mentioned signs are merely examples, and the signs used in the present disclosure are not limited to utility pole identification signs, road guide signs, and railroad crossing identification signs.

[0072] [Variation 2] In the second embodiment, the identification unit 110 reads the written characters from the area of ​​the sign shown in the captured image as sign information, and identifies the user's position and the direction in which the user is facing based on the read sign information. The example of identifying the user's position and the direction in which the user is facing is not limited to this example.

[0073] For example, the information processing device 101 may hold in advance a feature database in which feature amounts of images of signs are associated with information identifying the signs. In this case, the identification unit 110 may extract feature amounts of an area in which a sign appears from a captured image, and identify a sign that matches the feature amount using the feature database. In this case, the identification unit 110 may use information identifying the identified sign as sign information and search the sign database using the sign information as a key. In this case, the sign database includes data in which information identifying a sign is used as sign information and the sign information is associated with position information and direction information.

[0074] In the second modification, the identification unit 110 does not necessarily have to include the label information reading unit 111.

[0075] [Variation 3] Furthermore, examples of identifying the user's position and the direction in which the user is facing are not limited to the above examples.

[0076] The terminal 300 may acquire the user's voice. For example, when the user speaks a word indicating sign information toward the terminal 300, the terminal 300 acquires information spoken by the user (also referred to as voice information) via a microphone (not shown) included in the terminal 300. Then, the communication unit 310 transmits the voice information to the information processing device 101 during the process of S202.

[0077] The identification unit 110 acquires voice information from the terminal 300 via the communication unit 130. The identification unit 110 performs voice recognition using the voice information and converts the voice into text. The identification unit 110 then identifies the converted text information as sign information written on a sign. Such a process of identifying sign information written on a sign using the voice information may be performed by the sign information reading unit 111.

[0078] The identification unit 110 then searches the sign database using the sign information identified based on the voice information as a key to identify the user's position and the direction the user is facing. Note that the process of searching the sign database using the sign information identified based on the voice information as a key may be performed by the search unit 112.

[0079] The specification unit 110 can perform voice recognition using a known technique. For example, the specification unit 110 can perform voice recognition by analyzing voice information using a voice recognition dictionary created by machine learning, deep learning, or the like.

[0080] In this way, the information processing device 101 according to the third variant example identifies sign information based on the voice information acquired from the terminal 300, and identifies the user's position and the direction in which the user is facing based on the identified sign information.

[0081] Characters written on a sign may be handwritten or may have missing parts due to aging. In this case, in the process of reading sign information from a captured image, reading of characters may fail. For example, assume that the sign information reading unit 111 fails to read sign information in the process of S203. In response to this, the information processing device 101 according to the third modification identifies the sign information written on the sign using voice information, for example, after the process of S203. Then, instead of the processes of S204 and S205, the information processing device 101 searches the sign database using the sign information identified based on the voice information as a key to identify the position and direction of the user. In this way, the information processing device 101 according to the third modification can identify sign information using voice information, and therefore can identify the user's location even if reading of characters fails.

[0082] [Variation 4] In the second embodiment, an example has been described in which the sign database includes data in which sign information is associated with position information and direction information, but the sign database may include data in which either position information or direction information is associated with sign information. In this case, the identification unit 110 identifies either the position of the photographer or the direction in which the photographer is facing. Then, the content determination unit 120 determines the content to be delivered to the terminal 300 based on information indicating either the identified position of the photographer or the direction in which the photographer is facing. At this time, the content database may include data in which content identification information is associated with either position information or direction information.

[0083] <Third embodiment> Next, a content distribution system including an information processing device according to a third embodiment will be described.

[0084] Fig. 9 is a block diagram showing an example of the configuration of a content delivery system 1002 according to the third embodiment. As shown in Fig. 9, the content delivery system 1002 includes an information processing device 102 instead of the information processing device 101 in the second embodiment, and is otherwise similar to the content delivery systems 1000 and 1001 described in the first and second embodiments. That is, the content delivery system 1002 includes an information processing device 102 and a delivery device 200. Also, in Fig. 9, a terminal 301 is shown instead of the terminal 300 in Fig. 4. Note that a description of the configuration and operation of the content delivery system 1002 shown in Fig. 9 that overlap with the description of the first and second embodiments will be omitted.

[0085] As shown in FIG. 9, the terminal 301 further includes a location information acquisition unit 340 in addition to the configuration of the terminal 300. The location information acquisition unit 340 acquires location information indicating the location of the terminal 301. For example, the location information acquisition unit 340 may acquire the location information by a positioning signal receiving device mounted on the terminal 301. Specifically, for example, the location information acquisition unit 340 may be configured to receive a signal transmitted from a positioning satellite of a GNSS (Global Navigation Satellite System) such as a GPS satellite, and acquire location information indicating the location of the terminal based on the received signal. The location information acquisition unit 340 transmits the acquired location information together with the captured image captured by the image capture unit 320 to the information processing device 102 via the communication unit 310. The location information acquisition unit 340 is an example of a location information acquisition means.

[0086] [Details of the information processing device 102] 9, the information processing device 102 includes an identification unit 140 instead of the identification unit 110 in the configuration of the information processing device 101. The identification unit 140 includes a label information reading unit 141 and a search unit 142. The label information reading unit 141 and the search unit 142 have the following functions in addition to the functions of the label information reading unit 111 and the search unit 112, respectively.

[0087] The sign information reading unit 141 acquires the captured image and the location information from the terminal 301 via the communication unit 130. Here, in the case of a utility pole identification sign as shown in FIG. 5, the location in the sign where the sign name indicating the place name and the utility pole number are written is often determined in advance. In this case, if the acquired location information includes the place name information indicated by the sign name, the sign information reading unit 141 does not need to read the sign name again. In such a case, for example, in the process of S203 in the sequence diagram shown in FIG. 6, the sign information reading unit 141 may control so that the reading of characters is not performed for the area where the sign name is written, but only the area where the utility pole number is written. In addition, the utility pole number as shown in FIG. 5 may have a hierarchical structure. The hierarchical structure indicates a structure in which an address is determined according to the position and number of characters, such as, for example, if the utility pole number is four digits, the first two digits correspond to the town name and the latter two digits correspond to the block number. In such a case, if the acquired location information includes town name information, the sign information reading unit 141 may perform control so as to read characters only in a part of the area in which the utility pole number is written. Specifically, in the process of S203, the sign information reading unit 141 may perform control so as not to read characters in the area in which the first two digits of the utility pole number are written, but to read characters only in the area in which the last two digits are written. Then, the search unit 142 may treat the location information acquired from the terminal 301 and the read utility pole number as sign information, and may search the sign database using the sign information as a key.

[0088] That is, the information processing device 102 according to the third embodiment determines the area to be read from among the areas of the captured image showing the utility pole identification sign, based on the location information of the terminal acquired by the location information acquisition unit of the terminal. As a result, the information processing device 102 can reduce the area from which characters are read from, for example, in the captured image, thereby reducing the processing time required for reading characters. Furthermore, the information processing device 102 can reduce the range to be read, thereby suppressing the occurrence of reading errors and improving the accuracy of reading characters.

[0089] Furthermore, when searching the sign database using sign information, the search unit 142 may narrow the search range of data included in the sign database according to location information acquired from the terminal 301. For example, in S204 of the sequence diagram shown in Fig. 6, the search unit 142 may limit the search range to sign information of signs existing in the city, town, or village indicated by the location information acquired from the terminal 301.

[0090] That is, the information processing device 102 according to the third embodiment can determine the range of searching the database based on the location information of the terminal acquired by the location information acquisition unit of the terminal. This allows the information processing device 102 to narrow down the search range, thereby reducing the processing time required for searching.

[0091] As described above, the information processing device 102 according to the third embodiment identifies the location of the photographer who took the captured image using the terminal, based on the utility pole identification sign shown in the captured image acquired from the terminal and the location information of the terminal acquired by the location information acquisition means of the terminal. Then, the information processing device 102 determines the content to be delivered to the terminal from among a plurality of contents, based on the identified location. In this way, the information processing device 102 according to the third embodiment can suppress an increase in processing time and deliver content suitable for the user with high accuracy.

[0092] [Variation 5] In the third embodiment, an example has been described in which the location information acquisition unit 340 acquires the location information of the terminal 301 based on a signal transmitted from a GNSS positioning satellite. An example in which the location information acquisition unit 340 acquires the location information of the terminal 301 is not limited to this example.

[0093] The terminal 301 may acquire the voice of the user. For example, when the user speaks words indicating the position at the time of shooting toward the terminal 301, the terminal 301 acquires information uttered by the user (voice information) via a microphone (not shown) of the terminal 301. Then, the communication unit 310 transmits the voice information together with the captured image to the information processing device 102 during the process of S202.

[0094] The identification unit 140 acquires the captured image and the voice information from the terminal 301 via the communication unit 130. The identification unit 140 performs voice recognition using the voice information and converts the voice into text. The identification unit 140 then identifies the user's location from the text information. For example, if the user utters "Kawasaki City," the identification unit 140 identifies the user's location as Kawasaki City.

[0095] The sign information reading unit 111 determines an area to be read in the captured image based on the position of the user identified from the voice information. For example, in the case of a utility pole identification sign as shown in FIG. 5, the sign information reading unit 141 may control the process of S203 so that the area in which the sign name is written is not read, and the area in which the utility pole number is written is read. In addition, when the acquired voice information includes information such as a town name (when the user also speaks the town name, etc.), the sign information reading unit 141 may read the characters only in a part of the area in which the utility pole number is written. Then, the sign information reading unit 111 specifies the sign information of the sign shown in the captured image based on the information converted into text from the voice information and the information of the read characters. Note that when the acquired voice information includes all of the sign information (when the user speaks all of the characters written on the sign), the sign information reading unit 141 does not need to read the characters. In this case, the sign information is specified based on the information converted into text from the voice information. In this way, the sign information reader 111 uses the voice information acquired from the terminal 301 to identify the sign information of the sign appearing in the captured image.

[0096] The specification unit 140 can perform voice recognition using a known technique. For example, the specification unit 140 can perform voice recognition by analyzing voice information using a voice recognition dictionary created by machine learning, deep learning, or the like.

[0097] Then, the search unit 142 searches the sign database using the sign information identified using the voice information as a key. Note that when searching the sign database using the sign information, the search unit 142 may narrow down the search range of data included in the sign database according to the location information of the user identified from the voice information. For example, in S204 of the sequence diagram shown in FIG. 6, the search unit 142 may limit the search range to the sign information of signs existing in the city or town indicated by the location information acquired from the terminal 301.

[0098] In this way, the information processing device 102 according to the fifth modification identifies sign information appearing in the captured image by using the voice information acquired from the terminal. More specifically, the information processing device 102 determines an area to be read from among the areas in which the utility pole identification sign appears in the captured image based on the voice information, and identifies the sign information from the voice information and the read character information. As a result, the information processing device 102 according to the fifth modification can suppress an increase in processing time and deliver content suitable for the user with high accuracy, similar to the information processing device 102 according to the third embodiment.

[0099] <Fourth embodiment> Next, a content distribution system including an information processing device according to a fourth embodiment will be described.

[0100] Fig. 10 is a block diagram showing an example of the configuration of a content delivery system 1003 according to the fourth embodiment. As shown in Fig. 10, the content delivery system 1003 includes an information processing device 103 instead of the information processing device 102 in the third embodiment, and is otherwise similar to the content delivery system 1002 described in the third embodiment. That is, the content delivery system 1003 includes the information processing device 103 and a delivery device 200. Note that a description of the configuration and operation of the content delivery system 1003 shown in Fig. 10 that overlaps with the description of the first to third embodiments will be omitted.

[0101] [Details of the information processing device 103] 10, the information processing device 103 includes a content determination unit 121 instead of the content determination unit 120 in the configuration of the information processing device 102. The information processing device 103 also includes a determination unit 150. That is, the information processing device 103 includes a communication unit 130, an identification unit 140, the content determination unit 121, and the determination unit 150. Note that the content determination unit 121 has the functions described below in addition to the functions of the content determination unit 120.

[0102] The determination unit 150 determines whether or not the user is in the position identified from the captured image. For example, in the sequence diagram of FIG. 6, after the process of S205, the determination unit 150 compares the position information acquired from the terminal with the position information identified by the identification unit 140. If the comparison result shows that the distance between the position information acquired from the terminal and the position information identified by the identification unit 140 is equal to or greater than a predetermined threshold, the determination unit 150 determines that the user is not in the position identified from the captured image. At this time, the determination unit 150 notifies the content determination unit 121 of information indicating that the user is not in the position identified from the captured image.

[0103] If the comparison result shows that the distance between the location information acquired from the terminal and the location information identified by the identification unit 140 is less than a predetermined threshold, the determination unit 150 determines that the user is in the location identified from the captured image. At this time, the determination unit 150 notifies the content determination unit 121 of information indicating that the user is in the location identified from the captured image.

[0104] In this way, the determination unit 150 determines whether or not the photographer is at the position identified by the identification unit, based on the terminal position information acquired by the terminal position information acquisition unit. The determination unit 150 is an example of a determination means.

[0105] When it is determined that the user is not at the location identified from the captured image, the content determination unit 121 determines a specific content as the content to be delivered to the terminal 301, regardless of the location identified from the captured image, instead of the process of S206 in the sequence diagram of Fig. 6. The specific content is, for example, content indicating that the content corresponding to the location situation identified from the captured image cannot be delivered. Then, the content determination unit 121 transmits content identification information of the specific content to the delivery device 200.

[0106] If it is determined that the user is in the position identified from the captured image, the process of S206 in the sequence diagram of FIG. 6 is performed.

[0107] As described above, the information processing device 103 according to the fourth embodiment determines whether or not the photographer is at a location identified by the identification unit and the location information of the terminal acquired by the location information acquisition unit of the terminal. In the content distribution system according to the present disclosure, there are cases where a user does not take a photo, but attempts to acquire content using an image acquired by other means. The information processing device 103 according to the fourth embodiment has the above configuration, and thus can prevent such fraudulent acts by the user.

[0108] <Fifth embodiment> Next, a content distribution system including an information processing device according to the fifth embodiment will be described.

[0109] Fig. 11 is a block diagram showing an example of the configuration of a content delivery system 1004 according to the fifth embodiment. As shown in Fig. 11, the content delivery system 1004 includes an information processing device 104 instead of the information processing device 103 in the fourth embodiment, and is otherwise similar to the content delivery system 1003 described in the fourth embodiment. That is, the content delivery system 1004 includes the information processing device 104 and a delivery device 200. Note that a description of the configuration and operation of the content delivery system 1004 shown in Fig. 11 that overlaps with the description of the first to fourth embodiments will be omitted.

[0110] Although the determination unit 150 described in the fourth embodiment is not shown in FIG. 11, it is possible to configure the information processing device 104 so as to include the determination unit 150.

[0111] [Details of the information processing device 104] 11, the information processing device 104 includes a communication unit 130, an identification unit 160, and a content determination unit 122. In addition to the functions of the content determination units 120 and 121, the content determination unit 122 has the following functions.

[0112] The identification unit 160 includes a sign information reading unit 141, a search unit 142, and an age estimation unit 161. The age estimation unit 161 estimates the age of the photographer based on the area of ​​the sign appearing in the captured image. Here, a method of estimating age from a captured image will be described.

[0113] FIG. 12A and FIG. 12B are examples of captured images. Both FIG. 12A and FIG. 12B are images of a utility pole identification sign. In the captured image of FIG. 12A, the utility pole identification sign is captured as a rectangle. If the utility pole identification sign is a rectangle, it can be seen that the captured image of FIG. 12A was captured from almost the front of the utility pole identification sign. On the other hand, in the captured image of FIG. 12B, the utility pole identification sign and the utility pole are captured as a trapezoid whose bottom base is longer than its top base. Furthermore, the utility pole identification sign captured in the captured image of FIG. 12B is smaller than the utility pole identification sign captured in the captured image of FIG. 12A. In other words, it can be seen that the image of FIG. 12B was captured from below the utility pole identification sign. In this way, the shape of the sign captured in the captured image changes depending on the angle and distance at which the sign is captured. In other words, the shape of the sign captured in the captured image allows one to roughly estimate the height at which the photographer took the photo, and further allows one to roughly estimate the height of the photographer. The age estimation unit 161 roughly estimates the age of the photographer based on such estimated height information. For example, the age estimation unit 161 estimates whether the photographer is an adult or a child.

[0114] In this way, the age estimation unit 161 estimates the age of the photographer based on the shape of the utility pole identification sign shown in the captured image. The age estimation unit 161 is an example of an age estimation means.

[0115] The age estimation unit 161 performs the above-mentioned process, for example, at any timing between the processes of S203 to S205 in the sequence diagram of FIG.

[0116] For example, instead of the process of S206 in the sequence diagram of Fig. 6, the content determination unit 122 determines the content to be delivered to the terminal 301 based on the user's position identified from the captured image, the direction the user is facing, and the estimated age. At this time, the content database stores data in which the content identification information is associated with the position information, direction information, and age.

[0117] As described above, the information processing device 104 according to the fifth embodiment estimates the age of the photographer based on the shape of the utility pole identification sign shown in the captured image, and determines the content to be delivered to the terminal based on the specified position and direction and the estimated age. With this configuration, the information processing device 104 according to the fifth embodiment can determine content according to not only the user's position and the direction the user is facing, but also the user's age, using information obtained from the captured image. In other words, the information processing device 104 according to the fifth embodiment can deliver content more suitable for the user.

[0118] As described above, the information processing device of the present disclosure has been described in the first, second, third, fourth, and fifth embodiments. However, the above-described first, second, third, fourth, and fifth embodiments can be realized in appropriate combination.

[0119] <Example of hardware configuration of information processing device> The hardware constituting the information processing device according to the first, second, third, fourth and fifth embodiments will be described. Fig. 13 is a block diagram showing an example of the hardware configuration of a computer device that realizes the information processing device in each embodiment. Each block shown in Fig. 13 can be realized by a combination of a computer device 10 that realizes the information processing device and information processing method in each embodiment and software.

[0120] As shown in FIG. 13, a computer device 10 includes a processor 11, a random access memory (RAM) 12, a read only memory (ROM) 13, a storage device 14, an input / output interface 15, a bus 16, and a drive device 17.

[0121] The storage device 14 stores a program (computer program) 18. The processor 11 executes the program 18 for the information processing device using the RAM 12. Specifically, for example, the program 18 includes a program that causes a computer to execute the processing of the information processing device described in the first to fifth embodiments. In response to the processor 11 executing the program 18, the functions of each component of the information processing device (such as the above-mentioned identification units 110, 140, and 160, the content determination units 120, 121, and 122, and the determination unit 150) are realized. The program 18 may be stored in the ROM 13. In addition, the program 18 may be recorded in the storage medium 20 and read out using the drive device 17, or may be transmitted to the computer device 10 from an external device (not shown) via a network (not shown).

[0122] The input / output interface 15 exchanges data with peripheral devices (such as a keyboard, a mouse, and a display device) 19. The input / output interface 15 functions as a means for acquiring or outputting data. The bus 16 connects the various components.

[0123] There are various variations in the method of implementing the information processing device. For example, the information processing device may be implemented as a dedicated device. Furthermore, the information processing device may be implemented as a combination of multiple devices.

[0124] The scope of each embodiment also includes a processing method for recording a program for implementing each component of the function of each embodiment on a storage medium, reading the program recorded on the storage medium as code, and executing the program on a computer. That is, a computer-readable storage medium is also included in the scope of each embodiment. Also, the storage medium on which the above-mentioned program is recorded and the program itself are included in each embodiment.

[0125] The storage medium is, for example, but not limited to, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disc)-ROM, a magnetic tape, a non-volatile memory card, or a ROM. Furthermore, the programs recorded on the storage medium are not limited to programs that execute processes independently, but also include programs that operate on an OS (Operating System) and execute processes in cooperation with other software and functions of an expansion board, which are included in the scope of each embodiment.

[0126] The present disclosure has been described above with reference to the above-mentioned embodiments. However, the present disclosure is not limited to the above-mentioned embodiments. That is, the present disclosure can be applied in various aspects that a person skilled in the art can understand, such as various combinations or selections of the various disclosed elements described above, within the scope of the present disclosure.

[0127] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.

[0128] <Additional Notes> [Appendix 1] A means for identifying a position of a photographer who has taken an image using a terminal and a direction in which the photographer is facing, based on a utility pole identification sign shown in the image acquired from the terminal; and a content determination means for determining, from among a plurality of contents, a content to be delivered to the terminal based on the specified position and direction. Information processing device.

[0129] [Appendix 2] The identification means includes a label information reading means and a search means, The sign information reading means reads sign information written on the utility pole identification sign from an area in which the utility pole identification sign is captured in the photographed image, the search means searches for position information and direction information corresponding to the read sign information from a database in which the sign information is associated with position information and direction information, and when the search is successful, specifies the position and direction of the photographer according to the position information and direction information corresponding to the read sign information. 2. An information processing device according to claim 1.

[0130] [Appendix 3] The sign information reading means determines an area to be read from among the area in which the utility pole identification sign is captured in the captured image based on the location information of the terminal acquired by a location information acquisition means included in the terminal. 3. An information processing device according to claim 2.

[0131] [Appendix 4] The sign information reading means identifies the sign information appearing in the captured image by using the voice information acquired from the terminal, The search means searches the database for position information and direction information corresponding to the sign information identified using the voice information. 4. The information processing device according to claim 2 or 3.

[0132] [Appendix 5] the identifying means identifies the sign information based on the voice information when the sign information reading means fails to read the sign information. 5. The information processing device according to claim 4.

[0133] [Appendix 6] The sign information reading means determines an area to be read out of the area in which the utility pole identification sign is captured in the photographed image based on the voice information. 5. The information processing device according to claim 4.

[0134] [Appendix 7] a determination unit that determines whether or not the photographer is at the location based on the location identified by the identification unit and location information of the terminal acquired by a location information acquisition unit included in the terminal; 7. An information processing device according to any one of claims 1 to 6.

[0135] [Appendix 8] The identification means includes an age estimation means for estimating the age of the photographer based on a shape of the utility pole identification sign shown in the photographed image, the content determination means determines content to be delivered to the terminal based on the specified location and direction and the estimated age. 8. An information processing device according to any one of claims 1 to 7.

[0136] [Appendix 9] Instead of the utility pole identification sign, a road guide sign or a railroad crossing identification sign is used. 8. An information processing device according to any one of claims 1 to 7.

[0137] [Appendix 10] An identification means for identifying the location of a photographer who captured the image using the terminal based on a utility pole identification sign shown in the captured image acquired from the terminal and location information of the terminal acquired by a location information acquisition means included in the terminal; and a content determination means for determining, based on the identified location, a content to be delivered to the terminal from among a plurality of contents. Information processing device.

[0138] [Appendix 11] Identifying a position of a photographer who took the photographed image using the terminal and a direction in which the photographer is facing based on a utility pole identification sign shown in the photographed image acquired from the terminal; determining a content to be delivered to the terminal from among a plurality of contents based on the identified position and direction; Information processing methods.

[0139] [Appendix 12] reading sign information written on the utility pole identification sign from an area in which the utility pole identification sign is captured in the photographed image; a database in which the sign information is associated with position information and direction information is searched for position information and direction information corresponding to the read sign information, and if the search is successful, the position and direction of the photographer are specified according to the position information and direction information corresponding to the read sign information; 12. The information processing method according to claim 11.

[0140] [Appendix 13] determining an area to be read from among the area in which the utility pole identification sign is captured in the captured image based on the location information of the terminal acquired by a location information acquisition means included in the terminal; 13. The information processing method according to claim 12.

[0141] [Appendix 14] Identifying the sign information appearing in the captured image using audio information acquired from the terminal; Searching the database for position information and direction information corresponding to the sign information identified using the voice information. 14. The information processing method according to claim 12 or 13.

[0142] [Appendix 15] When the reading of the sign information has failed, the sign information is identified based on the voice information. 15. An information processing method according to claim 14.

[0143] [Appendix 16] determining an area to be read out of the area in which the utility pole identification sign is captured in the photographed image based on the voice information; 15. The information processing device according to claim 14.

[0144] [Appendix 17] a determination unit that determines whether or not the photographer is at the location based on the specified location and location information of the terminal acquired by a location information acquisition unit of the terminal; 17. An information processing method according to any one of appendix 11 to 16.

[0145] [Appendix 18] Estimating the age of the photographer based on the shape of the utility pole identification sign shown in the photographed image; determining content to be delivered to the terminal based on the identified location and direction and the estimated age; 18. An information processing method according to any one of appendix 11 to 17.

[0146] [Appendix 19] Instead of the utility pole identification sign, a road guide sign or a railroad crossing identification sign is used. 19. An information processing method according to any one of appendix 11 to 18.

[0147] [Appendix 20] A process of identifying a position of a photographer who captured an image using a terminal and a direction in which the photographer is facing, based on a utility pole identification sign shown in the captured image acquired from the terminal; determining a content to be delivered to the terminal from among a plurality of contents based on the specified position and direction; program.

[0148] [Appendix 21] In the identifying process, reading sign information written on the utility pole identification sign from an area in which the utility pole identification sign is captured in the photographed image; a database in which the sign information is associated with position information and direction information is searched for position information and direction information corresponding to the read sign information, and if the search is successful, the position and direction of the photographer are specified according to the position information and direction information corresponding to the read sign information; 21. The program according to claim 20.

[0149] [Appendix 22] In the identifying process, determining an area to be read from among the area in which the utility pole identification sign is captured in the captured image based on the location information of the terminal acquired by a location information acquisition means included in the terminal; 22. The program according to claim 21.

[0150] [Appendix 23] In the identifying process, Identifying the sign information appearing in the captured image using audio information acquired from the terminal; searching the database for position information and direction information corresponding to the sign information identified using the voice information; 23. A program according to claim 21 or 22.

[0151] [Appendix 24] In the identifying process, when reading of the sign information fails, the sign information is identified based on the voice information. 24. The program according to claim 23.

[0152] [Appendix 25] In the process of specifying, a region to be read is determined from the region in which the utility pole identification sign is captured in the photographed image based on the voice information. 24. The program according to claim 23.

[0153] [Appendix 26] and further causing the computer to execute a process of determining whether or not the photographer is at the specified position based on the specified position and position information of the terminal acquired by a position information acquisition means of the terminal. 26. The program according to any one of appendix 20 to 25.

[0154] [Appendix 27] In the identification process, an age of the photographer is estimated based on a shape of the utility pole identification sign shown in the photographed image; In the process of determining the content, the content to be delivered to the terminal is determined based on the specified position and direction and the estimated age. 27. A program according to any one of appendix 20 to 26.

[0155] [Appendix 28] Instead of the utility pole identification sign, a road guide sign or a railroad crossing identification sign is used. A program according to any one of appendixes 20 to 27. [Explanation of symbols]

[0156] 10 Computer equipment 11 Processors 12 RAM 13 ROM 14 Storage device 15 Input / Output Interface 16 Bus 17 Drive device 18 Programs 19 Peripheral Equipment 20 Storage medium 100, 101, 102, 103, 104 Information processing device 110, 140, 160 Specific part 111, 141 Sign information reading unit 112, 142 Search Department 120, 121, 122 Content determination unit 150 Judgment section 161 Age Estimation Department

Claims

1. An identification means for identifying a position of a photographer who took an image using a terminal at the time the image was taken, and a direction in which the photographer was facing at the time the image was taken, based on a utility pole identification sign shown in the image obtained from the terminal; and a content determination means for determining, from among a plurality of contents, a content to be delivered to the terminal based on the specified position and direction. Information processing device.

2. The identification means includes a label information reading means and a search means, The sign information reading means reads sign information written on the utility pole identification sign from an area in which the utility pole identification sign is captured in the photographed image, the search means searches for position information and direction information corresponding to the read sign information from a database in which the sign information is associated with position information and direction information, and when the search is successful, specifies the position and direction of the photographer according to the position information and direction information corresponding to the read sign information. The information processing device according to claim 1 .

3. The sign information reading means determines an area to be read from among the area in which the utility pole identification sign is captured in the captured image based on the location information of the terminal acquired by a location information acquisition means included in the terminal. The information processing device according to claim 2 .

4. The sign information reading means identifies the sign information appearing in the captured image by using the voice information acquired from the terminal, The search means searches the database for position information and direction information corresponding to the sign information identified using the voice information.

4. The information processing device according to claim 2 or 3.

5. a determination unit that determines whether or not the photographer is at the location based on the location identified by the identification unit and location information of the terminal acquired by a location information acquisition unit included in the terminal; The information processing device according to claim 1 .

6. The identification means includes an age estimation means for estimating the age of the photographer based on a shape of the utility pole identification sign shown in the photographed image, the content determination means determines content to be delivered to the terminal based on the specified location and direction and the estimated age. The information processing device according to claim 1 .

7. Instead of the utility pole identification sign, a road guide sign or a railroad crossing identification sign is used. The information processing device according to claim 1 .

8. An identification means for identifying the location of a photographer who took the photographed image using the terminal at the time the photographed image was taken, based on a utility pole identification sign shown in the photographed image obtained from the terminal and location information of the terminal acquired by a location information acquisition means included in the terminal; and a content determination means for determining, based on the identified location, a content to be delivered to the terminal from among a plurality of contents. Information processing device.

9. Based on the utility pole identification sign shown in the photographed image acquired from the terminal, a position of a photographer who took the photographed image using the terminal at the time when the photographed image was taken and a direction in which the photographer was facing at the time when the photographed image was taken are identified; determining a content to be delivered to the terminal from among a plurality of contents based on the identified position and direction; Information processing methods.

10. A process for identifying a position of a photographer who captured an image using a terminal at the time the image was captured, and a direction in which the photographer was facing at the time the image was captured, based on a utility pole identification sign shown in the captured image obtained from the terminal; determining a content to be delivered to the terminal from among a plurality of contents based on the specified position and direction; program.

Images