Map expression data processing device, information processing method, and program

Abstract

In the past, navigation using map expression data acquired from a map photo taken by photographing could not be realized. The present invention enables navigation using map expression data acquired from a map photo taken by photographing through a map expression data processing device that includes a photo receiving section that receives a map photo from a terminal device, a decision section that searches for a navigation information set having two or more navigation information, decides navigation information having a relationship with the map photo that satisfies a first condition, the navigation information having two or more corresponding information that are a set of coordinate information and position information in the map expression data and the map expression data, and a navigation information sending section that sends the navigation information decided by the decision section to the terminal device (H).

Description

TECHNICAL FIELD

[0001] The present application relates to a map appearance data processing apparatus that receives a map photo, uses the map photo, retrieves one or more map appearance data, and transmits the one or more map appearance data to a terminal device, and the like. BACKGROUND

[0002] Conventionally, there is a map information system that enables a user of one or more first terminal devices to register a hand-drawn map or the like, which is made or prepared by the user himself / herself, and a map, such as an illustrated map, to be used by a user of one or more second terminal devices, and enables the map to be given geographical information as information of an object, such as a landmark (see Patent Literature 1).

[0003] PRIOR ART DOCUMENTS

[0004] PATENT LITERATURE

[0005] Patent Literature 1: Japanese Patent Application Publication No. 2011-158518 SUMMARY

[0006] PROBLEMS TO BE SOLVED BY THE INVENTION

[0007] However, in the conventional technology, in the conventional map appearance data processing apparatus, navigation using map appearance data acquired by using a captured map photo cannot be implemented. That is, in the conventional technology, for example, a general map or the like, which is present on the streets, cannot be captured, prepared using the acquired map photo, map appearance data that can be used in navigation is acquired, and the map appearance data is used.

[0008] Further, navigation refers to, for example, indication of a current position on map appearance data.

[0009] MEANS FOR SOLVING THE PROBLEMS

[0010] The map appearance data processing apparatus of the first application includes a photo receiving section that receives a captured map photo from a terminal device, a decision section that retrieves a navigation information set having two or more navigation information, decides navigation information having a relationship with the map photo that satisfies a first condition, the navigation information having two or more corresponding information of a group of coordinate information and position information in map appearance data as any of an illustrated map, a hand-drawn map, and a general map, and map appearance data, and a navigation information transmitting section that transmits the navigation information decided by the decision section to the terminal device.

[0011] According to the structure involved, navigation using map appearance data acquired by using a captured map photo can be implemented.

[0012] Further, in the second invention, the decision section of the map expression data processing device includes a decision unit that decides map expression data similar to the map photo to satisfy the first condition, and a retrieval unit that retrieves navigation information including the map expression data decided by the decision unit from the navigation information set, and the navigation information transmission section transmits the navigation information retrieved by the retrieval unit to the terminal device.

[0013] According to the structure, navigation using map expression data similar to the image and the photographed map photo can be realized.

[0014] Further, in the third invention, the map expression data processing device further includes a character string retrieval section that retrieves one or more character strings from the map photo, and the decision section decides the navigation information satisfying the first condition using the one or more respective character strings.

[0015] According to the structure, navigation using more suitable map expression data can be realized.

[0016] Further, in the fourth invention, the map expression data processing device stores the location information of the location in association with the corresponding information, the decision section judges whether the one or more respective character strings coincide with the location information, and the decision section decides the navigation information satisfying the first condition using the judgment result related to the coincidence of the character string and the location information.

[0017] According to the structure, navigation using more suitable map expression data can be realized.

[0018] Further, in the fifth invention, the map expression data processing device stores the region determination information that determines the region covered by the map expression data in association with the navigation information, the character string retrieval section retrieves three or more character strings from the map photo, further includes a position information retrieval section that retrieves the position information corresponding to the location information of the three or more respective character strings retrieved by the character string retrieval section using a location dictionary having one or more pieces of location information that are information corresponding to the location information of the determined location and the position information of the determined position in association with each other, and a region determination information retrieval section that retrieves the region determination information that determines the region covered by the map photo using the three or more pieces of position information retrieved by the position information retrieval section, and the decision section decides the navigation information corresponding to the region determination information satisfying the first condition with the region determination information retrieved by the region determination information retrieval section.

[0019] According to the structure, navigation using more suitable map expression data can be realized.

[0020] Further, with respect to any one of the first to fifth inventions, the deciding section of the map expression data processing apparatus of the sixth invention cuts out a region of a map from a map photo, acquires a map cutout image, and using the map cutout image, searches for a navigation information set having two or more navigation information, the navigation information having map expression data and two or more corresponding information that are groups of coordinate information and position information in the map expression data, and decides the navigation information to be transmitted.

[0021] According to the structure involved, navigation using more appropriate map expression data can be realized.

[0022] Further, with respect to the sixth invention, the deciding section of the map expression data processing apparatus of the seventh invention corrects the map cutout image to be rectangular, acquires a corrected map image, and using the corrected map image, searches for a navigation information set having two or more navigation information, the navigation information having map expression data and two or more corresponding information that are groups of coordinate information and position information in the map expression data, and decides the navigation information to be transmitted.

[0023] According to the structure involved, navigation using more appropriate map expression data can be realized.

[0024] Further, with respect to any one of the first to seventh inventions, the photo receiving section of the map expression data processing apparatus of the eighth invention further receives terminal position information that specifies a current position of the terminal apparatus, and the deciding section decides the navigation information that contains position information indicating a position close to the terminal position information to satisfy a second condition, in a case where the navigation information satisfying a first condition cannot be decided.

[0025] According to the structure involved, in a case where appropriate map expression data cannot be decided using a map photo, appropriate map expression data using position information can be decided.

[0026] Further, with respect to any one of the first to eighth inventions, the map expression data processing apparatus of the ninth invention further includes: a selection image transmitting section that, in a case where two or more navigation information are decided by the deciding section, transmits two or more selection images that are map expression data possessed by each of the two or more navigation information or thumbnail images of the map expression data, to the terminal apparatus; and a selection receiving section that receives a selection instruction having an image identifier that identifies the selection image, from the terminal apparatus, and the navigation information transmitting section transmits two or more corresponding information paired with the image identifier possessed by the selection instruction, to the terminal apparatus.

[0027] According to the structure involved, the user can select map expression data that suits the preference.

[0028] Further, in the tenth application according to any one of the first to seventh applications, the map representation data processing apparatus further receives terminal position information that specifies the current position of the terminal apparatus, and further includes: a character string acquisition section that acquires three or more characters from the map photo; a coordinate information acquisition section that acquires coordinate information of each of the three or more characters; a position information acquisition section that acquires position information corresponding to each of the three or more characters using a place dictionary that has one or more pieces of place information that are associated with each other in correspondence with place information that specifies a place and position information that specifies the position of the place; and a current coordinate acquisition section that acquires current coordinate information that specifies a coordinate corresponding to the terminal position information using the three or more pieces of corresponding information that are a group of the coordinate information and the position information, and the terminal position information, and the navigation information transmission section transmits the current coordinate information to the terminal apparatus instead of the navigation information.

[0029] According to the structure, it is possible to show the current position in the map photo.

[0030] Further, the terminal apparatus of the eleventh application includes: a terminal photographing section that photographs a map photo; a terminal transmission section that transmits the map photo to the map representation data processing apparatus; a terminal reception section that receives navigation information from the map representation data processing apparatus; a terminal position acquisition section that acquires current position information; a terminal coordinate acquisition section that acquires current coordinate information corresponding to the current position information using two or more pieces of corresponding information possessed by the navigation information; and a terminal output section that outputs current position additional map representation data that indicates the current position at a coordinate position shown by the current coordinate information on map representation data possessed by the navigation information.

[0031] According to the structure, it is possible to realize navigation using map representation data acquired using a photographed map photo.

[0032] Further, in the twelfth application according to the eleventh application, the terminal apparatus further includes a terminal clipping section that clips a region of a map from the map photo to acquire a map clipped image, and the terminal transmission section transmits the map clipped image to the map representation data processing apparatus instead of the map photo.

[0033] According to the structure, it is possible to realize navigation using map representation data acquired using a photographed map photo.

[0034] Further, in the thirteenth application according to the twelfth application, the terminal apparatus further includes a terminal correction section that corrects the map clipped image to be rectangular to acquire a corrected map image, and the terminal transmission section transmits the corrected map image to the map representation data processing apparatus instead of the map clipped image.

[0035] According to the structure involved, navigation using map expression data acquired using a photographed map photo can be realized.

[0036] Effects of the Invention

[0037] According to the map expression data processing apparatus based on the present invention, navigation using map expression data acquired using a photographed map photo can be realized. BRIEF DESCRIPTION OF DRAWINGS

[0038] Figure 1 is a block diagram of a learning device A in the first embodiment.

[0039] Figure 2 is a block diagram of a classification device B.

[0040] Figure 3 is a flowchart illustrating an example of the operation of the learning device A.

[0041] Figure 4 is a flowchart illustrating an example of the operation of the classification device B.

[0042] Figure 5 is a diagram illustrating a specific example of the operation of the learning device A and the classification device B.

[0043] Figure 6 is a diagram showing an example of the learning source information.

[0044] Figure 7 is a block diagram of a map expression data processing apparatus C in the second embodiment.

[0045] Figure 8 is a flowchart illustrating an example of the operation of the map expression data processing apparatus C.

[0046] Figure 9 is a flowchart illustrating an example of the grouping processing.

[0047] Figure 10 is a flowchart illustrating an example of the region determination processing.

[0048] Figure 11 is a flowchart illustrating an example of the orientation acquisition processing.

[0049] Figure 12 is a flowchart illustrating an example of the output processing.

[0050] Figure 13 is a diagram showing an example of the map expression data and the like.

[0051] Figure 14 is a diagram showing an example of the map expression data and the like.

[0052] Figure 15 Fig. 2 is a diagram showing an example of the place dictionary.

[0053] Figure 16 Fig. 3 is a diagram showing an example of the correspondence information management table.

[0054] Figure 17 Fig. 4 is a block diagram of a map expression data processing apparatus D in the third embodiment.

[0055] Figure 18 Fig. 5 is a flowchart explaining an example of the operation of the map expression data processing apparatus D.

[0056] Figure 19 Fig. 6 is a block diagram of a map expression data processing apparatus E in the fourth embodiment.

[0057] Figure 20 Fig. 7 is a block diagram of a processing section E3 constituting the map expression data processing apparatus E.

[0058] Figure 21 Fig. 8 is a flowchart explaining an example of the operation of the map expression data processing apparatus E.

[0059] Figure 22 Fig. 9 is a flowchart explaining an example of the correspondence information acquisition processing.

[0060] Figure 23 Fig. 10 is a flowchart explaining an example of the distance relationship information acquisition processing.

[0061] Figure 24 Fig. 11 is a flowchart explaining an example of the angle relationship information acquisition processing.

[0062] Figure 25 Fig. 12 is a flowchart explaining an example of the region determination processing.

[0063] Figure 26 Fig. 13 is a flowchart explaining an example of the direction information acquisition processing.

[0064] Figure 27 Fig. 14 is a flowchart explaining an example of the place addition processing.

[0065] Figure 28 Fig. 15 is a flowchart explaining an example of the output map configuration processing.

[0066] Figure 29 Fig. 16 is a diagram showing a specific processing example of the map expression data processing apparatus E.

[0067] Figure 30 Fig. 17 is a diagram showing an example of the map expression data.

[0068] Figure 31 is a diagram showing an example of information that the map expression data processing apparatus E acquires in the middle of processing.

[0069] Figure 32 is a diagram showing an example of information that the map expression data processing apparatus E acquires in the middle of processing.

[0070] Figure 33 is a diagram showing an image of information that the map expression data processing apparatus E acquires in the middle of processing.

[0071] Figure 34 is a diagram showing an example of information that the map expression data processing apparatus E acquires in the middle of processing.

[0072] Figure 35 is a diagram showing an example of information that the map expression data processing apparatus E acquires in the middle of processing.

[0073] Figure 36 is a diagram showing an image of information that the map expression data processing apparatus E acquires in the middle of processing.

[0074] Figure 37 is a diagram showing an image of information that the map expression data processing apparatus E acquires in the middle of processing.

[0075] Figure 38 is a diagram showing an example of information that the map expression data processing apparatus E acquires in the middle of processing.

[0076] Figure 39 is a diagram showing an example of information that the map expression data processing apparatus E acquires in the middle of processing.

[0077] Figure 40 is an image explaining the processing of the map expression data processing apparatus E.

[0078] Figure 41 is an image explaining the processing of the map expression data processing apparatus E.

[0079] Figure 42 is a diagram showing an example of output of the map expression data processing apparatus E.

[0080] Figure 43 is an image explaining the processing of the map expression data processing apparatus E.

[0081] Figure 44 is an image explaining the processing of the map expression data processing apparatus E.

[0082] Figure 45 is an image explaining the processing of the map expression data processing apparatus E.

[0083] Figure 46 is a diagram showing an output example of accurate map information of the map representation data processing apparatus E.

[0084] Figure 47 is a conceptual diagram of the information system F in the fifth embodiment.

[0085] Figure 48 is a block diagram of the information system F.

[0086] Figure 49 is a block diagram of the map representation data processing apparatus G.

[0087] Figure 50 is a flowchart explaining the operation of the map representation data processing apparatus G.

[0088] Figure 51 is a flowchart explaining an example of the first decision processing.

[0089] Figure 52 is a flowchart explaining an example of the second decision processing.

[0090] Figure 53 is a flowchart explaining an example of the operation of the terminal apparatus H.

[0091] Figure 54 is a diagram showing the navigation information management table.

[0092] Figure 55 is a diagram showing an example of a pictorial map of the photographed object.

[0093] Figure 56 is a diagram showing an example of the map photo.

[0094] Figure 57 is a diagram showing an example of the map photo in which the pre-processing is performed.

[0095] Figure 58 is a diagram showing an example of the selection screen.

[0096] Figure 59 is a diagram showing an output example.

[0097] Figure 60 is an overview diagram of the computer system in the above-described embodiments.

[0098] Figure 61 is a block diagram of the computer system. DETAILED DESCRIPTION

[0099] Hereinafter, an embodiment of a map expression data processing apparatus and the like will be described with reference to the drawings. Furthermore, the same action is performed by the constituent elements to which the same reference numerals are given in the embodiments, and thus there is a case where the same description is omitted.

[0100] (First Embodiment)

[0101] In the present embodiment, a learning device that learns two or more pieces of learning source information having a string having two or more characters and a label for classifying the string by a technique of machine learning and constitutes a learner will be described. Furthermore, the label is a label related to the number of occurrences in a place dictionary, and is any of two or more labels. In addition, the label is preferably any of three kinds of 1, 0, and 2 or more of the frequency of occurrence. Furthermore, the technique of machine learning and the algorithm using machine learning are the same meaning.

[0102] In addition, in the present embodiment, a learning device that learns a string (a stream of a string) by giving a string to a learning module in units of characters and constitutes a learner will be described.

[0103] Further, in the present embodiment, a classification device that gives a string to a classification module and acquires a label corresponding to the string using a learner constituted by a learning device will be described. Furthermore, the classification module can also be referred to as a prediction module.

[0104] Figure 1 is a block diagram of a learning device A in the present embodiment. In addition, Figure 2 is a block diagram of a classification device B in the present embodiment.

[0105] The learning device A includes a storage section A1, a reception section A2, a processing section A3, and an output section A4. The storage section A1 includes a learning source information storage section A11 and a learner storage section A12. The processing section A3 includes a learning section A31. The output section A4 includes an accumulation section A41.

[0106] The classification device B includes a storage section B1, a reception section B2, a processing section B3, and an output section B4. The storage section B1 includes the learner storage section A12. The reception section B2 includes a string reception section B21. The processing section B3 includes a classification section B31. The output section B4 includes a label output section B41.

[0107] Various information is stored in a storage section A1 that constitutes the learning device A. The various information is, for example, learning source information to be described later, a learner to be described later, and a learning module. The learning module is a program that constitutes a learning section A31 and is a program for acquiring a learner. The learning module is, for example, a function in a machine learning architecture of fastText, tinySVM, TensorFlow, and various random forest functions.

[0108] Two or more pieces of learning source information are stored in a learning source information storage section A11. The learning source information is information that is a learning target. The learning source information has a character string and a label. The character string has two or more characters. The label is information related to the number of occurrences in a place dictionary to be described later. The label can adopt any of two or more labels.

[0109] The label is preferably any of a first label indicating that the number of occurrences in the place dictionary is one, a second label indicating that the number of occurrences in the place dictionary is zero, and a third label indicating that the number of occurrences in the place dictionary is two or more. That is, the label can preferably adopt any of the information of the three.

[0110] The place dictionary refers to a dictionary related to a place name. The place dictionary has, for example, two or more pieces of correspondence information having a place name and information indicating a location of a place determined by the place name. The place name is, for example, a name of a place, a name of a scenic spot, a name of a specific place, a name of a prefecture, a name of a city, town, or village, a name of a river or a mountain or a park or a scenic spot, or the like. The place dictionary has, for example, two or more pieces of correspondence information having a place name and information indicating a description of a place determined by the place name.

[0111] A learner is stored in a learner storage section A12. The learner can also be referred to as a classifier. In addition, the learner can also be referred to as a classification model, a prediction model, or the like. The learner is information acquired by a learning module using a technique of machine learning. The technique of machine learning is not limited to deep learning, SVM, decision tree, random forest, or the like. The technique of machine learning is, for example, preferably a technique using a recurrent neural network (RNN). That is, the learner is preferably an RNN.

[0112] The reception section A2 receives various information and instructions. Here, the reception refers to reception of input by a user, reception from an external device, or the like. However, it is only necessary that the various information and the instructions can be acquired by the reception. The input unit of the various information and the instructions can be, for example, any of an input unit based on a touch screen, a keyboard, a mouse, and a menu screen, or the like.

[0113] The processing section A3 performs various processing. The various processing is, for example, processing performed by the learning section A31.

[0114] The learning unit A31 performs learning processing of a technique based on machine learning using two or more pieces of learning source information of the learning source information storage unit A11, and acquires a learner.

[0115] The learning unit A31, for example, sequentially gives each character of a string possessed by each of the two or more pieces of learning source information that constitute the learning source information storage unit A11 to a learning module of machine learning, and gives a label paired with the string to the learning module, executes the learning module, and acquires a learner. Further, the processing of sequentially giving each character that constitutes a string to a learning module of machine learning can also be referred to as processing of giving a flow of a string to a learning module of machine learning. That is, the learning unit A31 can also be referred to as learning a flow of a string possessed by each of the two or more pieces of learning source information. In addition, the learning module of machine learning is stored in the storage unit A1, for example.

[0116] In addition, the technique of machine learning for acquiring a learner can use deep learning, SVR, random forest, decision tree, and the like, for example. In addition, the learning module of machine learning is a function in a machine learning architecture of fastText, tinySVM, TensorFlow, and the like, and various random forest functions, and the like, for example.

[0117] In addition, the learner acquired by the learning unit A31 is information for outputting a label in a case where a string is given to a classification module of machine learning as input. The learner acquired by the learning unit A31 is information for outputting a label in a case where characters that constitute a string are sequentially given one character by one character, for example.

[0118] Further, it can be considered that the learning unit A31 includes a learning module, and it can also be considered that it does not include a learning module.

[0119] The output unit A4 outputs various information. The various information is, for example, a learner. Here, output generally refers to accumulation to a recording medium, but it can also be considered to include display to a display, projection using a projector, printing by a printer, sound output, transmission to an external device, delivery of a processing result to other processing devices and other programs, and the like.

[0120] The accumulation unit A41 accumulates the learner acquired by the learning unit A31. The accumulation unit A41 generally accumulates the learner acquired by the learning unit A31 in the learner storage unit A12. However, the accumulation unit A41 can also transmit the learner acquired by the learning unit A31 to an external device not illustrated.

[0121] The storage unit B1 that constitutes the classification device B stores various information. The various information is, for example, a learner, a classification module of machine learning, map information.

[0122] The machine learning technique in the classification module is deep learning, SVM, decision tree, random forest, etc., without limitation. The machine learning technique is preferably, for example, a technique using a regression-type neural network. The classification module is a program for classifying a received string, and is, for example, a function in a machine learning architecture of fastText, tinySVM, TensorFlow, etc., and various random forest functions, etc.

[0123] The map information is information related to a map. The map information is, for example, map representation data. The map representation data refers to information representing a limited geographical area. The map representation data is preferably associated with a map identifier that identifies the map representation data. The map identifier is, for example, an ID, a file name having the map representation data, a name of the map representation data, etc. The map representation data is, for example, an old map, a pictorial map, a sketch map, a hand-drawn map, etc., but the kind thereof is not limited. The map representation data is usually image data, but can also be vector data, etc., without limitation on the data structure. The map representation data is associated with one or more attribute values. The one or more attribute values are attribute values of the map representation data. The attribute values are information representing the properties and characteristics of the map representation data, etc. The one or more attribute values associated with the map representation data include area determination information. The area determination information is information determining the area represented by the map representation data. The area is usually rectangular, but can also be triangular, octagonal, circular, etc., a shape other than rectangular. The area represented by the map representation data can also be referred to as the area represented by the map representation data. The area determination information is, for example, a set of (latitude, longitude). In addition, the area determination information is, for example, a set of information representing relative coordinates from a reference point. However, the data structure of the area determination information is not limited as long as it is information determining the area.

[0124] The one or more attribute values associated with the map expression data, for example, are static attribute values that are static. In addition, the one or more attribute values associated with the map expression data, for example, are dynamic attribute values that dynamically change. The one or more attribute values can also include one or more static attribute values and one or more dynamic attribute values. The static attribute values, for example, are a scale rate (appropriately, referred to as simply "scale rate") of a map that is the map expression data, an actual area (appropriately, referred to as simply "area") on a map of a region shown by the map expression data, content information that indicates the contents of the map. The content information is a degree of completion of the map expression data, a theme of the map expression data, metadata corresponding to the map expression data, keywords, and the like. The metadata, keywords, for example, are a genre of the map expression data, a name of a sightseeing spot existing in a region of the map expression data, a name of a place, and the like. The genre of the map expression data, for example, is "theme park" indicating a map of a theme park, "sightseeing map" indicating a map for sightseeing, information indicating a map of a specific region (for example, a school, and the like), and the like. In addition, the one or more static attribute values, for example, can also be a marker indicating a position shown by explicit position determination information, or a marker indicating a position that cannot be indicated by the explicit position determination information, and the like. The dynamic attribute values, for example, are a distance from a position shown by the position determination information to a place that represents the map expression data, user action information related to an action of a user with respect to the map expression data.

[0125] Further, the place that represents the map expression data, for example, refers to a center point of the map expression data, an arbitrary point of an end portion of the map expression data, an arbitrary point of a boundary of a region constituting the map expression data.

[0126] The map expression data is preferably contained in a file. However, the map expression data can also be data in a database, and the data format and management method thereof are not limited. In the case where the map expression data is contained in a file, two or more map expression data can also be contained in the file. In addition, one map expression data can also be realized by two or more files. That is, one map expression data can also be divided into two or more files.

[0127] The learner storage section A12 that constitutes the classification device B stores the learner accumulated by the learning device A.

[0128] The reception section B2 receives various information and instructions. Here, the reception, for example, refers to reception of input by a user, reception from an external device, and the like. However, as long as various information and instructions can be acquired by the reception, it is arbitrary. The input unit of the various information and instructions, for example, can also be an input unit based on a touch panel, a keyboard, a mouse, a menu screen, and the like.

[0129] The character string accepting section B21 accepts a character string. Here, the acceptance refers to a concept including acceptance of information input from an input device such as a keyboard and a mouse, a touch panel, and the like, reception of information transmitted through a wired or wireless communication line, acceptance of information read from a recording medium such as an optical disk and a magnetic disk, a semiconductor memory, and the like.

[0130] The character string accepting section B21 performs character recognition processing on, for example, map information, and acquires one or more character strings.

[0131] The processing section B3 performs various processing. The various processing refers to, for example, processing performed by the classification section B31.

[0132] The classification section B31 acquires a label corresponding to a character string using a learner of the learner storage section A12 and a machine learning technique with respect to the character string accepted by the accepting section B2.

[0133] The classification section B31, for example, sequentially gives two or more characters that constitute a character string accepted by the accepting section B2 to a classification module of a machine learning in units of characters, and gives a learner of the learner storage section A12 to the classification module, executes the classification module, and acquires a label.

[0134] Further, it can be considered that the classification section B31 includes a classification module, and it can be considered that the classification section B31 does not include a classification module.

[0135] The output section B4 outputs various information. The various information refers to, for example, a label acquired by the classification section B31.

[0136] The label output section B41 outputs a label acquired by the classification section B31. Here, the output can be considered to include a concept of accumulation to a recording medium, display to a display, projection using a projector, printing by a printer, sound output, transmission to an external device, delivery of a processing result to another processing device and another program, and the like.

[0137] The storage section A1, the learning source information storage section A11, the learner storage section A12, the storage section B1, and the learner storage section A12 are preferably nonvolatile recording media, but can be realized by volatile recording media.

[0138] A process of storing information in the storage section A1 and the like is not limited. For example, information can be stored in the storage section A1 and the like by a recording medium, information transmitted through a communication line or the like can be stored in the storage section A1 and the like, or information input through an input device can be stored in the storage section A1 and the like.

[0139] The accepting section A2, the accepting section B2, and the character string accepting section B21 can be realized by a device driver of an input unit such as a touch panel and a keyboard, and control software of a menu screen, and the like.

[0140] The processing section A3, the learning section A31, the accumulation section A41, the processing section B3, and the classification section B31 can also be implemented by an MPU and a memory or the like. The processing steps of the processing section A3 or the like are generally implemented by software recorded in a recording medium such as a ROM. However, the processing steps can also be implemented by hardware (a dedicated circuit).

[0141] The output section A4, the output section B4, and the label output section B41 can be considered to include output devices such as a display and a speaker, or can be considered not to include them. The output section A4 or the like can also be implemented by a driver software of the output device, or a driver software of the output device and the output device or the like.

[0142] Next, an example of the operation of the learning device A will be described using the flowchart of Fig. 6. Figure 3

[0143] (Step S301) The learning section A31 substitutes 1 into the counter i.

[0144] (Step S302) The learning section A31 determines whether the i-th learning source information exists in the learning source information storage section Al l. In the case where the i-th learning source information exists, the process proceeds to Step S303, and in the case where the i-th learning source information does not exist, the process proceeds to Step S312.

[0145] (Step S303) The learning section A31 acquires the i-th learning source information from the learning source information storage section Al l.

[0146] (Step S304) The learning section A31 substitutes 1 into the counter j.

[0147] (Step S305) The learning section A31 determines whether the j-th character exists in the string possessed by the i-th learning source information acquired in Step S303. In the case where the j-th character exists, the process proceeds to Step S306, and in the case where the j-th character does not exist, the process proceeds to Step S309.

[0148] (Step S306) The learning section A31 acquires the j-th character in the string possessed by the i-th learning source information acquired in Step S303.

[0149] (Step S307) The learning section A31 imparts the j-th character acquired in Step S306 to the learning module of the storage section Al. Further, the process of imparting the character to the learning module is widely interpreted as, for example, imparting the character as a parameter of a function or a method, i.e., the learning module, imparting the character to the learning module as an execution module, or the like, and enabling the learning module to perform a learning process using the character.

[0150] ​(Step S308) The learning unit A31 increments the counter j by 1. The process returns to Step S305.

[0151] (Step S309) The learning unit A31 acquires the label possessed by the i-th learning source information acquired in Step S303.

[0152] (Step S310) The learning unit A31 imparts the label acquired in Step S309 to the learning module of the storage unit Al. Further, the process of imparting the label to the learning module is broadly interpreted, for example, as imparting the label to a parameter of the learning module as a function or a method, imparting the label to the learning module as an execution module, and the like, and enables the learning module to perform the learning process using the label.

[0153] (Step S311) The learning unit A31 increments the counter i by 1. The process returns to Step S302.

[0154] (Step S312) The learning unit A31 executes the learning module to which the character stream and the label are imparted, and acquires the learner.

[0155] (Step S313) The accumulation unit A41 accumulates the learner acquired in Step S312 in the learner storage unit Al 2. The process ends.

[0156] Next, an example of the operation of the classification device B will be described using the flowchart of Figure 4

[0157] (Step S401) The character string reception unit B21 determines whether a character string has been received. In the case where a character string has been received, the process proceeds to Step S402, and in the case where a character string has not been received, the process returns to Step S401.

[0158] (Step S402) The classification unit B31 assigns 1 to the counter i.

[0159] (Step S403) The classification unit B31 determines whether the i-th character exists in the character string received in Step S401. In the case where the i-th character exists, the process proceeds to Step S404, and in the case where the i-th character does not exist, the process proceeds to Step S407.

[0160] (Step S404) The classification unit B31 acquires the i-th character in the character string received in Step S401.

[0161] (Step S405) The classification unit B31 imparts the i-th character acquired in Step S404 to the classification module of the storage unit Bl. Further, the process of imparting the character to the classification module is broadly interpreted, for example, as imparting the character to a parameter of the classification module as a function or a method, imparting the character to the classification module as an execution module, and the like, and enables the classification module to perform the classification process using the character. ​

[0162] (Step S406) Classification department B31 increments counter i by 1. Return to step S403.

[0163] (Step S407) The classification unit B31 assigns the learning module of the classification module in the storage unit B1 to the learning module in the storage unit A12. Furthermore, the process of assigning the learning module to the classification module can be broadly interpreted as assigning the learning module as a parameter of a function or method (i.e., the classification module), assigning the learning module to the classification module (which is an execution module), assigning link information to the learning module as a parameter of a function or method (i.e., the classification module), and assigning link information to the learning module to the classification module (which is an execution module), etc., enabling the classification module to perform classification processing using the learned module.

[0164] (Step S408) The classification department B31 executes the classification module to obtain the label.

[0165] (Step S409) Tag output unit B41 outputs the tag obtained in step S408. Return to step S401.

[0166] In addition, Figure 4 In the flowchart, the process ends by powering off and triggering an interrupt.

[0167] The following uses Figure 5 The specific operation examples of the learning device A and the classification device B in this embodiment will be explained. The processing of the learning device A is the learning stage 501. The processing of the classification device B is the classification stage 502.

[0168] Now, suppose that the learning source information storage unit A11 of the learning device A stores information having Figure 6 The structure shown contains information from multiple learning sources. Figure 6 In the learning source information, there are strings and tags. The tag is any one of the following: a first tag (value "1") indicating that it appears once in the location dictionary, a second tag (value "0") indicating that it appears zero times in the location dictionary, and a third tag (value "2") indicating that it appears two or more times in the location dictionary.

[0169] Furthermore, in learning phase 501, learning device A uses... Figure 6The described learning source information is first, a plurality of learning source information is given to the learning module of the storage unit Al, and a learner is constituted. Here, in the learning stage 501, the learning unit A31 gives the characters constituting the string possessed by the learning source information to the learning module one character by one character in order. In addition, the learning unit A31 gives the label possessed by the learning source information to the learning module. Furthermore, the learning unit A31 executes the learning module, and acquires the learner. Furthermore, the accumulation unit A41 accumulates the learner 504 in the learner storage unit A12. Furthermore, here, the learning module is, for example, 503, and here, for example, a module using Long short-term memory (LSTM) in a regression type neural network is used.

[0170] Next, in the classification stage 502, the string reception unit B21 of the classification device B performs character recognition processing on, for example, the map information of the storage unit B1, and acquires one or more strings. Furthermore, the processing of performing character recognition processing on the map information as an image and acquiring one or more strings is a known technology, and thus detailed description is omitted.

[0171] Furthermore, the classification unit B31 gives the characters constituting the string to the classification module one or more string units in order, and gives the learner 504 to the classification module, executes the classification module, and acquires the scores corresponding to the first label, the second label, and the third label for each string unit (505). Next, the classification unit B31 acquires the label of the highest score. Next, the label output unit B41 outputs the label of the highest score in association with the string (506).

[0172] According to the present embodiment, a learner for appropriately classifying information related to a place name can be acquired.

[0173] Furthermore, according to the present embodiment, information related to a place name can be appropriately classified.

[0174] Further, the processing in the present embodiment can also be realized by software. Also, the software can be distributed by software download or the like. In addition, the software can be distributed by being recorded in a recording medium such as a CD-ROM. Further, the same applies to the other embodiments in the present specification. Further, the software that realizes the learning device A in the present embodiment is a program as described below. That is, the program is a program for causing a computer that can access a learning source information storage unit that stores two or more pieces of learning source information having a character string having two or more characters and a tag that is any of two or more tags as a tag related to the number of occurrences in a place dictionary to function as the following: a learning unit that sequentially gives each character that constitutes the character string possessed by each piece of the two or more pieces of learning source information that constitute the learning source information storage unit to a learning module that is machine-learned in character units and gives the tag paired with the character string to the learning module, executes the learning module, and acquires a learner; and an accumulation unit that accumulates the learner.

[0175] In addition, the software that realizes the classification device B in the present embodiment is a program as described below. That is, the program is a program for causing a computer that can access a learner storage unit that stores a learner accumulated by the learning device A to function as the following: a character string reception unit that receives a character string; a classification unit that sequentially gives each character that constitutes the character string to a classification module that is machine-learned in character units and gives the learner to the classification module, executes the classification module, and acquires a tag; and a tag output unit that outputs the tag.

[0176] (Second Embodiment)

[0177] In the present embodiment, a map representation data processing device that acquires one or more character strings from map representation data, acquires position information (latitude, longitude) paired with each of the one or more character strings, acquires coordinate information on the map representation data of each of the one or more character strings, and accumulates the coordinate information of each of the one or more character strings in association with the position information is described.

[0178] In addition, in the present embodiment, a map representation data processing device that decides an appropriate character string from one or more character strings acquired from map representation data and accumulates coordinate information corresponding to only the appropriate character string in association with position information is described. Further, it is preferable to use the learner acquired by the learning device A described in the first embodiment in the decision processing of the appropriate character string. Further, it is preferable to use the classification processing in the classification device B described in the first embodiment in the decision processing of the appropriate character string.

[0179] In addition, in the present embodiment, a map information generating apparatus that stores coordinate information of one or more graphic feature points, such as intersections, and position information corresponding to the one or more graphic feature points in association with each other is described, the one or more graphic feature points being acquired from map representation data. Further, the graphic feature points are preferably one or more of intersections and bridges.

[0180] In addition, in the present embodiment, a map representation data processing apparatus that stores coordinate information of two or more strings and position information corresponding to the two or more strings in association with each other is described, the two or more strings being acquired from map representation data, and the position information being acquired up to a set of position information that satisfies a predetermined condition.

[0181] In addition, in the present embodiment, a map representation data processing apparatus that determines a region in accurate map information corresponding to a region of map representation data is described. Further, in such a case, it is preferable to determine a region in accurate map information, taking into account a region outside a string that is not present in map representation data.

[0182] Further, in the present embodiment, a map representation data processing apparatus that acquires orientation information of map representation data is described.

[0183] Figure 7 is a block diagram of the map representation data processing apparatus C in the present embodiment. The map representation data processing apparatus C includes a storage section C1, a reception section C2, a processing section C3, and an output section C4.

[0184] The storage section C1 includes a place dictionary storage section C11, a map representation data storage section C12, an accurate map information storage section C13, a learner storage section A12, and a correspondence information storage section C14. The reception section C2 includes a map representation data reception section C21. The processing section C3 includes a string acquisition section C31, a classification section C32, a grouping section C33, a feature place detection section C34, a coordinate information acquisition section C35, a position information acquisition section C36, a region determination information acquisition section C37, and an orientation information acquisition section C38. The region determination information acquisition section C37 includes, for example, a first region determination information acquisition unit C371, an outside string determination unit C372, a size information acquisition unit C373, a distance information acquisition unit C374, and a second region determination information acquisition unit C375. The output section C4 includes a correspondence output section C41, an accurate map information output section C42, and an orientation information output section C43.

[0185] Various information is stored in the storage section Cl. The various information is, for example, a place dictionary to be described later, map expression data to be described later, accurate map information to be described later, a learner, correspondence information to be described later, a classification module. Further, the storage section Cl can not include the place dictionary storage section Cl 1. The place dictionary storage section Cl 1 can exist in an external device not shown.

[0186] The place dictionary is stored in the place dictionary storage section Cl 1. The place dictionary has one or two or more pieces of place position information. The place position information is information in which place information that specifies a place and position information that specifies a position are associated with each other. The place position information is, for example, information having place information and position information. The place position information is, for example, information having a pointer to the place information and a pointer to the position information. However, the data structure of the place position information is not limited.

[0187] Further, the place information is, for example, a place name, an ID that specifies a place. The place name is, for example, a name of a place, a name of a scenery, a name of a specified place, a name of a prefecture, a name of a city, town or village, a name of a river or a mountain or a park or a scenic spot, a name of an intersection, or the like. Further, the position information is, for example, (latitude, longitude), but can be other data forms. Further, the ID that specifies a place is usually associated with the place name.

[0188] One or two or more pieces of map expression data are stored in the map expression data storage section Cl 2. The map expression data is data that expresses a map. The map expression data is information in which a geographical area to be represented is limited. The map expression data is not accurate map information to be described later. The map expression data is, for example, data in which accuracy of a map is lacking. The map expression data is, for example, an old map, a pictorial map, a sketch map, a hand-drawn map, or the like, but the kind thereof is not limited. The map expression data is preferably associated with a map identifier that identifies the map expression data. The map identifier is, for example, an ID, a file name having the map expression data, a name of the map expression data, or the like.

[0189] The map expression data is usually image data, but can also be vector data or the like, and the data structure is not limited. The map expression data can also include a string of place information. In addition, in the case of image data and vector data as the map expression data, it is usually data in which the place information is expressed. In addition, the map expression data is preferably included in a file. The map expression data can also be a file. However, the map expression data can also be data in a database, and the data format and management method are not limited. In the case where the map expression data is included in a file, two or more map expression data can also be included in the file. In addition, one map expression data can also be realized by two or more files. That is, one map expression data can also be divided into two or more files. In addition, of course, the map expression data can also be one file.

[0190] The accurate map information is stored in the accurate map information storage section C13. The accurate map information is information of an accurate electronic map. The kind of map expressed by the accurate map information, and the data form of the map information, and the like are not limited. The kind of map is, for example, a topographic map, and a landform map, a geological map, a land use map, a residential map, a route map, a road map, a guide map, an aerial photograph, a satellite photograph, and the like. In addition, the data form of the accurate map information is, for example, raster data, and vector data, a KIWI format, and the like.

[0191] One or two or more learners are stored in the learner storage section A12. The learner of the learner storage section A12 is preferably a learner acquired by the learning device A. In such a case, as described above, the learner is information acquired by giving two or more pieces of learning source information having a string having two or more characters and a label related to the number of occurrences in the place dictionary to a learning module of machine learning, executing the learning module, and the label is an arbitrary label of two or more labels or three or more labels. However, the learner can also be a learner obtained by learning one or more positive examples of place name information and one or more negative examples of place name information by a technique of machine learning, not a learner acquired by the learning device A.

[0192] One or two or more pieces of correspondence information are stored in the correspondence information storage section C14. The correspondence information is information indicating the correspondence of the coordinate information and the position information. The correspondence information can also be information of a group of the coordinate information and the position information. In addition, the correspondence information can also be information of a group of a pointer to the coordinate information and a pointer to the position information. The correspondence information can be associated with the place name information, or can have the place name information. The data structure of the correspondence information is not limited. The correspondence information is preferably associated with a map expression data identifier that identifies the map expression data.

[0193] The reception unit C2 receives various information and instructions. The various information and instructions are, for example, map expression data, an instruction to start an action, and an output instruction. The instruction to start an action is an instruction to start an action of acquiring corresponding information of the map expression data processing apparatus C. The output instruction is an instruction to output the map expression data and the like. The output instruction has, for example, a map expression data identifier that identifies the map expression data.

[0194] Here, the reception refers to reception of input by a user, reception from an external apparatus (for example, a terminal apparatus not shown), and the like. However, as long as various information and instructions can be acquired through the reception, it is acceptable. The input unit of the various information and instructions can be, for example, any of an input unit based on a touch panel, a keyboard, a mouse, and a menu screen, and the like.

[0195] The map expression data reception unit C21 receives the map expression data. Here, the reception refers to a concept of reception of information input from an input device such as a keyboard and a mouse, a touch panel, and the like, reception of information transmitted through a wired or wireless communication line, reception of information read from a recording medium such as an optical disc and a magnetic disc, a semiconductor memory, and the like. That is, the map expression data reception unit C21 can also read the map expression data from the map expression data storage unit C12.

[0196] The processing unit C3 performs various processing. The various processing is, for example, processing performed by the string acquisition unit C31, the classification unit C32, the grouping unit C33, the feature place detection unit C34, the coordinate information acquisition unit C35, the position information acquisition unit C36, the region determination information acquisition unit C37, the orientation information acquisition unit C38, the first region determination information acquisition unit C371, the outside string determination unit C372, the size information acquisition unit C373, the distance information acquisition unit C374, and the second region determination information acquisition unit C375.

[0197] The string acquisition unit C31 acquires one or more than two strings from the map expression data received by the map expression data reception unit C21. The string acquisition unit C31 preferably acquires more than three strings from the map expression data. The string acquisition unit C31 acquires one or more than two strings from the map expression data, for example, by character recognition processing. Further, the character recognition processing is a publicly known technology, and thus detailed description is omitted. In addition, the string acquisition unit C31 acquires one or more than two strings included in the map expression data, for example.

[0198] The classification unit C32 determines whether each of the one or more than two strings acquired by the string acquisition unit C31 is a string of a certain place.

[0199] The classification section C32 determines, for example, whether one or more of the respective strings acquired by the string acquisition section C31 is a string of a place to be definitely registered. The string of a place to be definitely registered is, for example, a place information or unique place information.

[0200] The classification section C32 performs, for example, classification processing of determining one of place information and non-place information for one or more of the respective strings acquired by the string acquisition section C31 using a learner by a machine learning technique.

[0201] The classification section C32 performs, for example, learning processing by a machine learning technique using a string of one or more of the respective place information as a positive example and a string of one or more of the respective non-place information as a negative example, and performs processing of determining one of place information and non-place information for one or more of the respective strings acquired by the string acquisition section C31 using a learner acquired by the learning processing.

[0202] Further, the machine learning technique is not limited to deep learning, SVM, decision tree, random forest, and the like as described above. In addition, the learning module that performs the learning processing and constitutes the learner is, for example, a function in a machine learning architecture of fastText, tinySVM, TensorFlow, and the like, and various random forest functions, and the like. Further, the classification module that performs the determination processing by the classification section C32 is, for example, a function in a machine learning architecture of fastText, tinySVM, TensorFlow, and the like, and various random forest functions, and the like.

[0203] The classification section C32 preferably acquires a label corresponding to one or more of the respective strings acquired by the string acquisition section C31 by the same processing as the classification section B31. In this case, the classification section C32 sequentially gives two or more characters constituting a string acquired by the string acquisition section C31 to a classification module of machine learning in character units, and gives a learner of the learner storage section A12 to the classification module, executes the classification module, and acquires a label.

[0204] Further, the classification section C32 preferably determines, for example, only a string corresponding to the first label as a definite place string. In addition, the classification section C32 can also determine, for example, a string corresponding to the first label and the third label as a definite place string.

[0205] The grouping section C33 determines two or more pieces of position information indicating positions close to satisfying a predetermined condition, among three or more pieces of position information acquired by the position information acquisition section C36. That is, the grouping section C33 performs processing of excluding position information not located at a place in the map expression data. Further, one or more pieces of position information not located at a place in the map expression data is information indicating a position far to satisfying a predetermined condition with respect to other position information acquired by the position information acquisition section C36.

[0206] The processing of the grouping section C33 is, for example, any of the following two processes.

[0207] (1) Process using representative position information

[0208] The grouping section C33, for example, determines representative position information as position information representing three or more pieces of position information acquired by the position information acquisition section C36. The representative position information is generally position information indicating a central portion among three or more pieces of position information acquired by the position information acquisition section C36.

[0209] Next, the grouping section C33, for example, calculates distances of each of the position information other than the representative position information from the representative position information, and acquires position information other than the representative position information as position information far to satisfying a predetermined condition with respect to the distances. One or more pieces of such position information and the representative position information are position information determined by the grouping section C33. Further, position information not acquired here is excluded position information.

[0210] Further, examples of the method of acquiring the representative position information are (1-1) or (1-2) or (1-3) or (1-4) below.

[0211] (1-1) The grouping section C33, for example, calculates distances of three or more combinations of two pieces of position information among three or more pieces of position information acquired by the position information acquisition section C36, and acquires two pieces of representative position information as a group of two pieces of position information corresponding to the shortest distance among the distances of the three or more combinations.

[0212] (1-2) The grouping section C33 acquires any one of the shortest group acquired in the above (1-1) as the representative position information.

[0213] (1-3) The grouping section C33 can also acquire a center point of a region including three or more pieces of position information acquired by the position information acquisition section C36 as the representative position information.

[0214] (1-4) The grouping section C33 can also acquire position information of a position closest to a center point among a region including three or more pieces of position information acquired by the position information acquisition section C36 as the representative position information.

[0215] Further, the acquisition algorithm of the representative position information is not limited to the above (1-1) to (1-4).

[0216] (2) Clustering processing

[0217] The grouping section C33 performs clustering processing of the position information using three or more position information acquired by the position information acquisition section C36, for example. Further, the grouping section C33 acquires two or more position information acquired by the clustering processing. Further, the clustering processing is a known technique, and thus detailed description is omitted.

[0218] Further, the corresponding information corresponding to the position information decided by the grouping section C33 is accumulated. In addition, the corresponding information corresponding to the position information is, for example, corresponding information including the position information, or corresponding information including a pointer to the position information.

[0219] The feature place detection section C34 detects a feature place of a place represented by a feature pattern which is a pattern decided in advance as a feature, from the map representation data. The feature place detection section C34 detects a feature place of a place represented by a feature pattern which is a pattern decided in advance as a feature, from the map representation data, for example, by an image recognition technique. Further, the feature pattern is preferably one or more patterns of an intersection or a bridge.

[0220] The feature pattern of the intersection or the bridge or the like is stored in the storage section Cl, and the feature place detection section C34, for example, shifts the start pixel in the map representation data, and extracts a region in accordance with the size of the feature pattern from the map representation data, calculates the similarity of the extracted region to the feature pattern of the storage section Cl, and detects a region in which the similarity is greater than or equal to a threshold value as a feature place, for example.

[0221] In addition, the feature place detection section C34 performs object recognition processing of the feature pattern with respect to the map representation data, for example, and detects a feature place. Further, the object recognition processing is a known technique, and thus detailed description is omitted.

[0222] The coordinate information acquisition section C35 acquires coordinate information (normally, (x, y)) as information that specifies a coordinate position corresponding to the string acquired by the string acquisition section C31 and as information that specifies a relative coordinate position in the map expression data. The coordinate position corresponding to the string refers to a coordinate of a point that represents a region of the string in the map expression data, and is a representative point of the string. The representative point is a center point of the region of the string in the map expression data, a point at the upper left of the region of the string in the map expression data, a point at the lower right of the region of the string in the map expression data, or the like. That is, the coordinate position corresponding to the string acquired by the string acquisition section C31 can be a coordinate position of a center point of a region in which the string is arranged, can be a coordinate position of a place of a corner at the upper left of a region in which the string is arranged, can be a coordinate position of a place of a corner at the lower right of a region in which the string is arranged, or the like.

[0223] The coordinate information acquisition section C35 can also acquire coordinate information that specifies a coordinate position corresponding to a string in the string acquired by the string acquisition section C31 that corresponds to the position information decided by the grouping section C33. In this case, the coordinate information acquisition section C35 can also be said to acquire coordinate information that specifies a coordinate position corresponding to the string acquired by the string acquisition section C31.

[0224] The coordinate information acquisition section C35 acquires coordinate information corresponding to the feature pattern. The coordinate information acquisition section C35 acquires information of a coordinate of a representative point of a region of the feature pattern detected by the feature position detection section C34.

[0225] The coordinate information acquisition section C35 acquires, as a coordinate position of a center of gravity of the region, for example, the coordinate position of the region of the feature pattern detected by the feature position detection section C34. In addition, the coordinate information acquisition section C35 acquires, as a coordinate position of a point at the upper left of the region, for example, the coordinate position of the region of the feature pattern in the map expression data. In addition, the coordinate information acquisition section C35 acquires, as a coordinate position of a point at the lower right of the region, for example, the coordinate position of the region of the feature pattern in the map expression data.

[0226] The position information acquisition section C36 acquires position information corresponding to the place information that is the string acquired by the string acquisition section C31 using a place dictionary. The position information acquisition section C36 acquires position information paired with the place information that is the string acquired by the string acquisition section C31 from the place dictionary. Furthermore, acquiring position information using a place dictionary generally means acquiring position information from a place dictionary.

[0227] The position information acquisition section C36 acquires position information corresponding to the location information as a string corresponding to the feature pattern, for example, from the location dictionary. The string corresponding to the feature pattern refers to, for example, a string disposed at a position closest to the feature pattern. The string corresponding to the feature pattern refers to, for example, a string (for example, "ABC intersection") obtained by combining a string (for example, "ABC") disposed at a position closest to the feature pattern with the name (for example, "intersection") of the feature pattern. That is, the position information acquisition section C36 acquires a string (for example, "ABC") on the map expression data as a string disposed at a position closest to the feature pattern, reads the name (for example, "intersection") of the feature pattern from the storage section Cl, synthesizes the two strings, acquires a string (for example, "ABC intersection"), and acquires position information paired with the string (for example, "ABC intersection") from the location dictionary storage section Cl l. Note that the position information acquisition section C36 can acquire position information from a location dictionary storage section Cl l present in an external device not shown.

[0228] The position information acquisition section C36 acquires position information corresponding to the string (for example, "intersection") corresponding to the feature pattern, for example, from the storage section Cl, acquires a string containing the string and disposed at a position closest to the feature pattern, and acquires position information corresponding to the string from the location dictionary storage section Cl l.

[0229] The region determination information acquisition section C37 acquires region determination information that determines a region in the accurate map information as a region containing positions indicated by two or more pieces of position information decided by the grouping section C33.

[0230] The region determination information acquisition section C37 can acquire region determination information that determines a region in the accurate map information as a region containing positions indicated by two or more pieces of position information acquired by the position information acquisition section C36.

[0231] The region determination information acquisition section C37 acquires region determination information, for example, through processing by a first region determination information acquisition unit C371, an outside string decision unit C372, a size information acquisition unit C373, a distance information acquisition unit C374, and a second region determination information acquisition unit C375.

[0232] The first region determination information acquisition unit C371 acquires first region determination information that determines a first region in the accurate map information as a region containing positions indicated by two or more pieces of position information decided by the grouping section C33. The first region determination information is, for example, position information that determines two points of a rectangle. However, the region determined by the first region determination information can not be a rectangle, but can be a polygon, a circle, or the like.

[0233] The first region determination information acquisition unit C371 preferably acquires first region determination information that determines a first region that is a rectangular region containing all the positions indicated by the two or more pieces of position information decided by the grouping section C33.

[0234] The first region determination information acquisition unit C371 preferably acquires first region determination information that determines a first region that is a rectangular region containing all the positions indicated by the two or more pieces of position information decided by the grouping section C33, with the smallest area.

[0235] The outermost string decision unit C372 decides strings corresponding to one or more pieces of position information located at the outermost sides, among the position information acquired by the position information acquisition section C36. The outermost string decision unit C372 preferably decides strings corresponding to four pieces of position information located at the four sides (top, bottom, left, and right on the map expression data) at the outermost sides. The position information acquired by the position information acquisition section C36 can also be not all the position information acquired by the position information acquisition section C36. The position information acquired by the position information acquisition section C36 can also be the position information decided by the grouping section C33.

[0236] The size information acquisition unit C373 acquires size information that determines the size up to the corner of the map expression data, of the outside of one or more strings decided by the outermost string decision unit C372. Further, the size information is, for example, the number of pixels. The size information is, for example, the size on the coordinates.

[0237] The distance information acquisition unit C374 acquires distance information that determines a distance corresponding to the size information acquired by the size information acquisition unit C373, using two or more groups of the coordinate information acquired by the coordinate information acquisition section C35 and the position information acquired by the position information acquisition section C36. The distance information is information that determines the actual distance, the distance in the real world (information in units of m, km, etc.).

[0238] The distance information acquisition unit C374 acquires information of a unit of distance (e.g., m / pixel) as a unit of the coordinate information (e.g., one pixel) using, for example, two or more sets of the coordinate information (e.g., (xl, yl), (x2, y2)) acquired by the coordinate information acquisition section C35 and the position information (e.g., (XI, Yl), (X2, Y2)) acquired by the position information acquisition section C36. That is, for example, the distance information acquisition unit C374 calculates the number of pixels A between (xl, yl) and (x2, y2) and the distance B of (XI, Yl) and (X2, Y2), and acquires the unit information by the calculation formula "unit information = distance B / number of pixels A". Further, the distance information acquisition unit C374, for example, multiplies the size information (e.g., the number of pixels) acquired by the size information acquisition unit C373 and the unit information (e.g., the distance for one pixel) to acquire the distance information. The distance information acquisition unit C374, for example, preferably acquires the distance information of the four sides.

[0239] The second region determination information acquisition unit C375 acquires second region determination information that determines a second region that is an area expanded from the first region determined by the first region determination information, using the distance information acquired by the distance information acquisition unit C374. The second region determination information acquisition unit C375, for example, acquires second region determination information that determines a second region that is an area expanded to each side of the first region determination information corresponding to each distance information of the four sides. The second region determination information is, for example, position information that determines two points of a rectangle. However, the region determined by the first region determination information can not be a rectangle, but can be a polygon, a circle, or the like.

[0240] The orientation information acquisition section C38 acquires orientation information related to the orientation of the map expression data using the region determination information or the second region determination information. In the case where the region determination information or the second region determination information is a rectangle, the orientation information acquisition section C38 preferably acquires orientation information of the angle of the figure of the rectangle of the region determination information or the second region determination information with respect to the orientation (e.g., true north) as a reference. The orientation information is, for example, the angle with respect to true north (information between 0 degrees and 360 degrees, or information between -180 degrees and 180 degrees). Further, the orientation information is, for example, information (e.g., a vector) that determines the direction of true north in the map expression data, or information that indicates the direction of true up from the center of the map expression data. The information that indicates the direction of true up from the center of the map expression data is, for example, an angle, for example, "0 degrees" in the case where the direction of true up from the center is true north, or "-90 degrees" or "270 degrees" in the case where the direction of true up from the center is true east.

[0241] The azimuth information acquisition section C38, for example, acquires a pair of the position information of two or more places from the position information acquired by the position information acquisition section C36. The azimuth information acquisition section C38 calculates a first angle, which is an angle of the two places with respect to a direction (for example, north) as a reference, from the two pieces of position information of the pair. Also, the azimuth information acquisition section C38 acquires, for example, the coordinate information of the pair acquired by the coordinate information acquisition section C35. Next, the azimuth information acquisition section C38 calculates a second angle, which is an angle in the map expression data, from the two pieces of coordinate information. Next, the azimuth information acquisition section C38 acquires the azimuth information related to the azimuth in the map expression data using the first angle and the second angle. In a case where the first angle is "0 degrees" (the two places are in a relationship of due north and due south) and the second angle is "90 degrees" (the values of the y-axes of the coordinate information of the two points are the same), the azimuth information acquisition section C38 acquires the azimuth information "90 degrees".

[0242] For example, in a case where the positional relationship indicated by each of the position information of the pair of place 1 and place 2 indicates due north, the first angle between place 1 and place 2 is calculated as 0 degrees. Also, the azimuth information acquisition section C38 acquires, for example, the coordinate information of the pair acquired by the coordinate information acquisition section C35. Next, the azimuth information acquisition section C38 acquires the azimuth information indicating the due north direction (for example, a vector from place 1 to place 2) in the map expression data from the two pieces of coordinate information.

[0243] Further, the azimuth information acquisition section C38, for example, preferably acquires two or more pairs from the position information of three or more places, and performs the same processing for each of the two or more pairs to acquire two or more pieces of azimuth information, and calculates a representative value (for example, an average value or a median value, or the like) of the two or more pieces of azimuth information. The output section C4 outputs various information. The various information, for example, refers to the correspondence information, the map expression data, the accurate map information, and the azimuth information.

[0244] The correspondence output section C41 outputs the coordinate information acquired by the coordinate information acquisition section C35 in association with the position information acquired by the position information acquisition section C36 in correspondence with each other. The output of the coordinate information in association with the position information in correspondence with each other can also refer to the output of the correspondence information having the coordinate information and the position information. Here, the output generally refers to the accumulation to a recording medium (for example, the correspondence information storage section C14), but can also be considered to include the concept of display to a display, projection using a projector, printing by a printer, sound output, transmission to an external device, delivery of a processing result to another processing device and another program, and the like. Further, the correspondence output section C41 preferably also outputs the place information in which the coordinate information and the position information are associated with each other in pairs with the coordinate information and the position information.

[0245] The correspondence output section C41 outputs coordinate information corresponding to a string judged by the classification section C32 to be a string of a certain place in association with position information.

[0246] The correspondence output section C41 outputs coordinate information corresponding to a string classified by the classification section C32 as position information in association with position information.

[0247] The correspondence output section C41 outputs each of two or more pieces of position information decided by the grouping section C33 in association with each of two or more pieces of coordinate information acquired by the coordinate information acquisition section C35.

[0248] The accurate map information output section C42 outputs accurate map information, for example, in a manner of knowing a region determined by the region determination information. Here, it can be considered that outputting includes displaying to a display, projecting using a projector, storing to a recording medium, printing by a printer, sound output, transmitting to an external device, delivering a processing result to another processing device and another program, and the like. Further, the manner of knowing a region determined by the region determination information refers to, for example, surrounding the region determined by the region determination information with a frame, changing a background color of the region determined by the region determination information to another, and the like, but is not limited to these.

[0249] The accurate map information output section C42 outputs accurate map information, for example, preferably in a manner of knowing a region determined by the second region determination information.

[0250] The direction information output section C43 outputs direction information acquired by the direction information acquisition section C38. The output manner of the direction information is not limited. Here, it can be considered that outputting includes displaying to a display, projecting using a projector, storing to a recording medium, printing by a printer, sound output, transmitting to an external device, delivering a processing result to another processing device and another program, and the like.

[0251] The storage section C1, the place dictionary storage section C11, the map expression data storage section C12, the accurate map information storage section C13, the learner storage section A12, and the correspondence information storage section C14 are preferably non-volatile recording media, but can be realized by volatile recording media.

[0252] The process of storing information in the storage section C1 and the like is not limited. For example, information can be stored in the storage section C1 and the like by a recording medium, information transmitted through a communication line and the like can be stored in the storage section C1 and the like, or information input through an input device can be stored in the storage section C1 and the like.

[0253] The reception unit C2 and the map expression data reception unit C21 can also be implemented by a device driver of an input unit such as a touch panel and a keyboard, and control software of a menu screen, and the like.

[0254] The processing unit C3, the character string acquisition unit C31, the classification unit C32, the grouping unit C33, the feature place detection unit C34, the coordinate information acquisition unit C35, the position information acquisition unit C36, the region determination information acquisition unit C37, the orientation information acquisition unit C38, the first region determination information acquisition unit C371, the outside character string determination unit C372, the size information acquisition unit C373, the distance information acquisition unit C374, and the second region determination information acquisition unit C375 can also be implemented by an MPU and a memory, and the like. The processing procedure of the processing unit C3 and the like can be implemented by software, which is recorded in a recording medium such as a ROM. However, the processing unit C3 and the like can also be implemented by hardware (a dedicated circuit).

[0255] It can be considered that the output unit C4, the corresponding output unit C41, the accurate map information output unit C42, and the orientation information output unit C43 include an output device such as a display and a speaker, and it can also be considered that the output unit C4 does not include the output device. The output unit C4 can also be implemented by a driver software of the output device, or the driver software of the output device and the output device, and the like.

[0256] Next, an example of the operation of the map expression data processing apparatus C will be described using the flowchart of Figure 8

[0257] (Step S801) The reception unit C2 determines whether or not an operation start instruction has been received. In the case where the operation start instruction has been received, the process proceeds to Step S802, and in the case where the operation start instruction has not been received, the process proceeds to Step S821.

[0258] (Step S802) The processing unit C3 assigns 1 to the counter i.

[0259] (Step S803) The processing unit C3 determines whether or not the i-th map expression data exists in the map expression data storage unit C12. In the case where the i-th map expression data exists, the process proceeds to Step S804, and in the case where the i-th map expression data does not exist, the process returns to Step S801.

[0260] (Step S804) The map expression data reception unit C21 acquires the i-th map expression data from the map expression data storage unit C12.

[0261] (Step S805) The character string acquisition unit C31 acquires one or more character strings expressed on the i-th map expression data acquired in Step S804. The character string acquisition unit C31 acquires one or more character strings expressed on the i-th map expression data, for example, by character recognition processing. ​

[0262] (Step S806) The classification section C32 substitutes 1 for the counter j.

[0263] (Step S807) The classification section C32 judges whether or not the jth string exists in the strings acquired in step S805. In the case where the jth string exists, the process proceeds to step S808, and in the case where the jth string does not exist, the process proceeds to step S813.

[0264] (Step S808) The classification section C32 performs classification processing on the jth string, and acquires a tag. Further, the classification processing is, for example, the processing of the classification device B described above, and is, for example, the processing from step S402 to step S409 of the classification device B. Figure 4

[0265] (Step S809) The coordinate information acquisition section C35 judges whether or not the jth string is place information to be registered. If it is place information to be registered, the process proceeds to step S810, and if it is not place information to be registered, the process proceeds to step S812.

[0266] Further, the place information to be registered is, for example, a tag indicating that the string is a string to be registered, which is acquired in step S808. In addition, the tag indicating that the string is a string to be registered is, for example, the first tag.

[0267] (Step S810) The coordinate information acquisition section C35 acquires coordinate information of a representative point of a region on the ith map expression data, which is a region in which the jth string is arranged. Further, the representative point can be a center point of the region, a point at the upper left, a point at the lower right, or the like. In addition, it is assumed that information of a region in which a string is arranged is acquired when the string is acquired from the map expression data.

[0268] (Step S811) The position information acquisition section C36 acquires position information paired with the place information of the jth string from the place dictionary storage section C11. Further, the corresponding output section C41 temporarily stores the position information paired with the coordinate information acquired in step S810 in at least a buffer not shown.

[0269] (Step S812) The classification section C32 increments the counter j by 1. The process returns to step S807.

[0270] (Step S813) The grouping section C33 performs grouping processing on two or more pieces of position information stored in step S811. For an example of the grouping processing, the flowchart of FIG. 18 is used for explanation. Figure 9

[0271] (Step S814) The corresponding output section C41 substitutes 1 for the counter k.

[0272] ​​(Step S815) The correspondence output section C41 determines whether or not the kth position information exists in the position information acquired in step S813. In the case where the kth position information exists, the process proceeds to step S816, and in the case where the kth position information does not exist, the process proceeds to step S818.

[0273] (Step S816) The correspondence output section C41 acquires the coordinate information paired with the kth position information from a buffer not shown. Further, the correspondence output section C41 stores the kth position information in association with the acquired coordinate information in the correspondence information storage section C14 in association with the ith map expression data.

[0274] (Step S817) The correspondence output section C41 increments the counter k by 1. The process returns to step S807.

[0275] (Step S818) The region determination information acquisition section C37 performs a region determination process. The region determination process is a process of determining a region in the accurate map information which is a region corresponding to the region of the ith map expression data. An example of the region determination process is explained using the flowchart of Figure 10 .

[0276] (Step S819) The orientation information acquisition section C38 performs an orientation acquisition process. The orientation acquisition process is a process of acquiring orientation information which determines the orientation of the ith map expression data. An example of the orientation acquisition process is explained using the flowchart of Figure 11 .

[0277] (Step S820) The processing section C3 increments the counter i by 1. The process returns to step S803.

[0278] (Step S821) The reception section C2 determines whether or not an output instruction has been received. In the case where the output instruction has been received, the process proceeds to step S822, and in the case where the output instruction has not been received, the process returns to step S801.

[0279] (Step S822) The output section C4 performs an output process. The process returns to step S801. Further, the output process is a process of outputting an instruction corresponding to the output instruction, such as the map expression data. An example of the output process is explained using the flowchart of Figure 12 .

[0280] Further, in the flowchart of Figure 8 , the process is ended by a power-off and an interruption of the process end.

[0281] Next, an example of the grouping process of step S813 is explained using the flowchart of Figure 9 .

[0282] (Step S901) The grouping section C33 assigns 1 to the counter i.

[0283] (Step S902) The grouping section C33 determines whether or not a group of the i-th two position information exists from the two or more position information acquired in step S811. In the case where the group of the i-th two position information exists, the process proceeds to step S903, and in the case where it does not exist, the process proceeds to step S905.

[0284] (Step S903) The grouping section C33 calculates the distance between the two points determined by the i-th two position information.

[0285] (Step S904) The grouping section C33 increments the counter i by 1. The process returns to step S807.

[0286] (Step S905) The grouping section C33 acquires the two position information corresponding to the smallest distance from among the distances between the two points calculated in step S903. Further, the grouping section C33 acquires one of the two position information at random as the representative position information.

[0287] (Step S906) The grouping section C33 assigns 1 to the counter j.

[0288] (Step S907) The grouping section C33 determines whether or not the j-th position information other than the representative position information exists from among the two or more position information acquired in step S811. In the case where the j-th position information exists, the process proceeds to step S908, and in the case where the j-th position information does not exist, the process returns to the process of the higher level.

[0289] (Step S908) The grouping section C33 calculates the distance between each of the position information other than the representative position information from among the two or more position information acquired in step S811 and the representative position information.

[0290] (Step S909) The grouping section C33 determines whether or not the distance calculated in step S907 is close to satisfy a predetermined condition (for example, whether or not the distance is smaller than a threshold value, or whether or not the distance is smaller than or equal to a threshold value). In the case where it is close to satisfy the predetermined condition, the process proceeds to step S910, and in the case where it is not close to satisfy the predetermined condition, the process proceeds to step S911.

[0291] (Step S910) The grouping section C33 temporarily stores the j-th position information in a buffer not shown. Further, the position information temporarily stored in the buffer is the position information acquired by the grouping section C33.

[0292] (Step S911) The grouping section C33 increments the counter j by 1. The process returns to step S807.

[0293] Next, an example of the region determination process of step S818 will be described using the flowchart of FIG. 18. Figure 10 Next, an example of the region determination process of step S818 will be described using the flowchart of FIG. 18.

[0294] (Step S1001) The first region determination information acquiring unit C371 acquires the position information of the smallest longitude among the position information temporarily accumulated in the buffer not shown by the grouping section C33 in step S910.

[0295] (Step S1002) The first region determination information acquiring unit C371 acquires the position information of the largest longitude among the position information temporarily accumulated in the buffer not shown by the grouping section C33 in step S910.

[0296] (Step S1003) The first region determination information acquiring unit C371 acquires the position information of the smallest latitude among the position information temporarily accumulated in the buffer not shown by the grouping section C33 in step S910.

[0297] (Step S1004) The first region determination information acquiring unit C371 acquires the position information of the largest latitude among the position information temporarily accumulated in the buffer not shown by the grouping section C33 in step S910.

[0298] (Step S1005) The first region determination information acquiring unit C371 acquires the region determination information having the position information of the four points of the corners of the region of the determined rectangle which determines the region containing all the position information acquired by the grouping section C33, including the four position information acquired in steps S1001 to S1004 in the boundary. Further, the first region determination information acquiring unit C371 preferably acquires the region determination information having the position information of the four points of the corners of the region of the smallest rectangle which determines the region containing all the position information acquired by the grouping section C33, including the four position information acquired in steps S1001 to S1004 in the boundary.

[0299] (Step S1006) The outermost string determining unit C372 acquires the strings of the four directions (up, down, left and right) of the outermost in the region determined by the region determination information. Also, the size information acquiring unit C373 acquires the size information of the number of the outermost pixels of the four respective strings of the outermost and the map expression data.

[0300] (Step S1007) The distance information acquiring unit C374 acquires the distance in the pixel unit (the unit of one coordinate) using two or more sets of position information and coordinate information.

[0301] (Step S1008) The distance information acquisition unit C374 multiplies the pixel-unit distance acquired in step S1007 by the four pieces of size information acquired in step S1006, and calculates the distance expanded in the four directions. Further, the four directions in which the distance is expanded are the directions perpendicular to the respective sides of the four sides of the rectangle determined by the region determination information.

[0302] (Step S1009) The second region determination information acquisition unit C375 acquires second region determination information that is information that determines a region in which the width of the four directions of the first region determination information is expanded in correspondence with the distance acquired in step S1008. Further, the second region determination information is usually two pieces of position information that determine a rectangular region.

[0303] (Step S1010) The second region determination information acquisition unit C375 accumulates the second region determination information acquired in step S1009 in association with the i-th map expression data. The process returns to the parent process.

[0304] Next, an example of the orientation acquisition process of step S819 will be described using the flowchart of Figure 11

[0305] (Step S1101) The orientation information acquisition unit C38 acquires the second region determination information acquired by the second region determination information acquisition unit C375.

[0306] (Step S1102) The orientation information acquisition unit C38 acquires orientation information using the four pieces of position information that constitute the second region determination information.

[0307] (Step S1103) The orientation information acquisition unit C38 accumulates the orientation information acquired in step S1102 in association with the i-th map expression data. The process returns to the parent process.

[0308] Next, an example of the output process of step S822 will be described using the flowchart of Figure 12

[0309] (Step S1201) The output unit C4 acquires the map expression data identifier possessed by the accepted output instruction.

[0310] (Step S1202) The output unit C4 acquires the map expression data identified by the map expression data identifier acquired in step S1201 from the map expression data storage unit C12.

[0311] (Step S1203) The output unit C4 acquires one or more pieces of coordinate information paired with the map expression data identifier acquired in step S1201 from the correspondence information storage unit C14.

[0312] ​​(Step S1204) The outputter C4 acquires the orientation information paired with the map representation data acquired in step S1202.

[0313] (Step S1205) The outputter C4 constructs the map representation data that indicates the place determined by each coordinate information on the map representation data acquired by step S1202, and constructs the map representation data that indicates the orientation information acquired by step S1204.

[0314] (Step S1206) The outputter C4 acquires the second region determination information paired with the map representation data acquired in step S1202.

[0315] (Step S1207) The outputter C4 acquires the accurate map information of the region determined by the second region determination information acquired in step S1206 from the accurate map information storage C13.

[0316] (Step S1208) The outputter C4 acquires one or more position information paired with the map representation data identifier acquired in step S1201 from the correspondence information storage C14.

[0317] (Step S1209) The outputter C4 constructs the accurate map information that indicates the place determined by each position information acquired in step S1208 on the accurate map information acquired by step S1207.

[0318] (Step S1210) The outputter C4 outputs the map representation data acquired in step S1205. In addition, the outputter C4 outputs the accurate map information acquired in step S1209. The process returns to the parent process.

[0319] Further, in the flowchart of Figure 12 , only one of the map representation data and the accurate map information can be outputted.

[0320] In addition, in the flowchart of Figure 12 , the map representation data outputted can be the map representation data that does not indicate the place determined by each coordinate information. In addition, in the flowchart of Figure 12 , the map representation data outputted can be the map representation data that does not indicate the orientation information.

[0321] In addition, in the flowchart of Figure 12 , the accurate map information outputted can be the map representation data that does not indicate the second region determination information. In addition, in the flowchart of Figure 12 , the accurate map information outputted can be the map representation data that does not indicate the place determined by each position information. Further, in the flowchart of Figure 12In the flowchart, the accurate map information output can also be map representation data that explicitly defines the area.

[0322] The specific operation of the map representation data processing device C in this embodiment will be described below.

[0323] Now, for example, suppose Figure 13 Map data showing the five main streets of Kyoto in 1301. Figure 14 The map representation data of the three main streets of 1401 is stored in the map representation data storage unit C12. Furthermore, it is assumed that map representation data of 1301 is stored in pairs with the map representation data identifier "five main streets", and map representation data of 1401 is stored in pairs with the map representation data identifier "three main streets".

[0324] In addition, the location dictionary storage unit C11 stores... Figure 15 The location dictionary shown contains two or more records with "Location Information" and "Location Information". "Location Information" is a meaningless string here, but is usually the location name. "Location Information" is (latitude, longitude) here.

[0325] Furthermore, the corresponding information storage unit C14 stores information having Figure 16 The structure shown corresponds to an information management table. This table stores one or more records with "ID", "Map Representation Data Identifier", "Coordinate Information", "Location Information", and "Location Information". "ID" identifies the record. "Map Representation Data Identifier" identifies the map representation data. "Coordinate Information" represents the coordinate values ​​indicating the relative position on the map representation data. "Location Information" here is (latitude, longitude). "Location Information" is a meaningless string here, but is usually the location name.

[0326] In this situation, suppose the user inputs an action start instruction to the map display data processing device C.

[0327] Therefore, the receiving unit C2 of the map representation data processing device C begins its receiving action. Furthermore, the map representation data processing device C performs the aforementioned processing on the map representation data for the "five main streets" and the map representation data for the "three main streets," storing one or more corresponding pieces of information in the corresponding information management table in association with each piece of map representation data. The stored records are... Figure 16 The record with ID = 1, 2, 3, ..., 38, ...

[0328] Furthermore, let's assume that the user, for example, inputs an output instruction with the map representation data identifier "five streets" into the map representation data processing device C.

[0329] Therefore, the receiving unit C2 of the map representation data processing device C receives the output instruction. Next, the output unit C4 performs the aforementioned output processing. Furthermore, the output... Figure 13 The map representation data for 1301, and the accurate map information for 1302. Furthermore, Figure 13 13021 is the region determined by the region determination information. Additionally, 13022 is the region determined by the second region determination information. Furthermore, 13023 is a pattern for determining location information corresponding to the first label. Further, 13024 is a pattern for determining location information corresponding to the third label or location information excluded through grouping processing.

[0330] According to this embodiment, the coordinate information of place names and other information on the map display data can be automatically obtained in a corresponding and related manner.

[0331] Furthermore, according to this embodiment, it is possible to extract appropriate place names and other strings from map representation data, and automatically obtain the coordinate information of the place names and other strings in relation to the location information.

[0332] Furthermore, according to this embodiment, it is possible to extract appropriate place names and other strings from map representation data with high precision, and automatically obtain the coordinate information of the place names and other strings in correspondence with the location information.

[0333] Furthermore, according to this embodiment, it is possible to obtain graphic feature points on map representation data and automatically obtain the coordinate information of the graphic feature points in relation to their location information.

[0334] Furthermore, according to this embodiment, the scope of accurate map information corresponding to map representation data can be clearly defined.

[0335] Furthermore, according to this embodiment, the appropriate range of accurate map information corresponding to map representation data can be clearly defined.

[0336] Furthermore, according to this embodiment, it is possible to obtain directional information related to the location of the map representation data.

[0337] Furthermore, in this embodiment, the essential components are a location dictionary storage unit C11, a map representation data receiving unit C21, a string acquisition unit C31, a coordinate information acquisition unit C35, a location information acquisition unit C36, and a corresponding output unit C41. Other components constituting the map representation data processing apparatus C may be omitted.

[0338] Furthermore, in this embodiment, Figure 13 Other output examples are Figure 14 .

[0339] Further, the software that realizes the map expression data processing apparatus C in the present embodiment is a program as described below. That is, the program is a program for causing a computer that can access a place dictionary storage section that stores a place dictionary having one or more pieces of place information that are information that associates a place determined by place information with a position determined by position information corresponding to each other to function as: a map expression data reception section that receives map expression data of a kind that is any one or more of a pictorial map, a hand-drawn map, and an outline map; a character string acquisition section that acquires a character string from the map expression data; a coordinate information acquisition section that acquires coordinate information that is information that determines a coordinate position corresponding to the character string acquired by the character string acquisition section and that is information that determines a relative coordinate position in the map expression data; a position information acquisition section that acquires position information corresponding to the place information of the character string acquired by the character string acquisition section using the place dictionary; and a correspondence output section that outputs the coordinate information acquired by the coordinate information acquisition section and the position information acquired by the position information acquisition section in association with each other.

[0340] (Third Embodiment)

[0341] In the present embodiment, a map expression data processing apparatus D that can indicate a current position on map expression data using the correspondence information acquired in the second embodiment is described.

[0342] Figure 17 is a block diagram of the map expression data processing apparatus D in the present embodiment.

[0343] The map expression data processing apparatus D has a storage section D1, a reception section D2, a processing section D3, and an output section D4. The storage section D1 has a map expression data storage section C12 and a correspondence information storage section C14.

[0344] The processing section D3 has a current position information acquisition section D31, a coordinate information acquisition section D32, and a data construction section D33. The output section D4 has a map expression data output section D41.

[0345] Various information is stored in the storage section D1. The various information is, for example, map expression data, correspondence information.

[0346] One or two or more pieces of map expression data are stored in the map expression data storage section C12.

[0347] Two or more pieces of correspondence information are stored in the correspondence information storage section C14. The correspondence information is preferably associated with map expression data.

[0348] The reception unit D2 receives various information and instructions. The various information and instructions are, for example, an operation start instruction.

[0349] Here, the reception refers to reception of input by a user, reception from an external device (for example, a terminal device not shown), and the like. However, as long as the various information and instructions can be acquired through the reception, it is acceptable. The input unit of the various information and instructions can be, for example, any of an input unit based on a touch screen, a keyboard, a mouse, and a menu screen, and the like.

[0350] The processing unit D3 performs various processing. The various processing is, for example, processing performed by the current position information acquisition unit D31, the coordinate information acquisition unit D32, and the data construction unit D33.

[0351] The current position information acquisition unit D31 acquires current position information that determines a current position. The current position information acquisition unit D31 can be implemented by, for example, a GPS receiver. The current position information acquisition unit D31 is a well-known technology, and thus a detailed description is omitted.

[0352] The coordinate information acquisition unit D32 acquires coordinate information corresponding to the current position information using two or more pieces of correspondence information paired with map expression data of an object. The coordinate information is a coordinate value that determines a relative position on the map expression data in display.

[0353] The coordinate information acquisition section D32 reads, for example, the correspondence information 1 (coordinate information 1 (xl, yl), position information 1 (XI, Yl)) and the correspondence information 2 (coordinate information 2 (x2, y2), position information 2 (X2, Y2)) paired with the map expression data of the object from the correspondence information storage section C14. Also, the coordinate information acquisition section D32 acquires the current position information (X3, Y3) acquired by the current position information acquisition section D31. Next, the coordinate information acquisition section D32 calculates (XI - X2), (Yl - Y2) from the position information 1 (XI, Yl) and the position information 2 (X2, Y2). Also, the coordinate information acquisition section D32 calculates (xl - x2), (yl - y2) from the coordinate information 1 (xl, yl) and the coordinate information 2 (x2, y2). Next, the coordinate information acquisition section D32 calculates the number of pixels with respect to a unit distance (for example, 100 m) in the x axis from (XI - X2) and (xl - x2). Also, the coordinate information acquisition section D32 calculates the number of pixels with respect to a unit distance (for example, 100 m) in the y axis from (Yl - Y2) and (yl - y2). Next, the coordinate information acquisition section D32, for example, calculates the number of pixels with respect to a unit distance in the x axis from (XI - X3), adds the number of pixels to xl, and acquires the x coordinate (x3) with respect to the current position information. Also, the coordinate information acquisition section D32, for example, calculates the number of pixels with respect to a unit distance in the y axis from (Yl - Y3), adds the number of pixels to yl, and acquires the y coordinate (y3) with respect to the current position information.

[0354] The data construction section D33 constructs the current position additional map expression data on the map expression data as the map expression data of the position indicated by the coordinate information acquired by the coordinate information acquisition section D32. In addition, the indication of the position by the coordinate information is not limited. The data construction section D33, for example, arranges a predetermined pattern at the position indicated by the coordinate information.

[0355] The output section D4 outputs various information. The various information, for example, refers to the current position additional map expression data.

[0356] The map expression data output section D41 outputs the current position additional map expression data acquired by the data construction section D33.

[0357] The storage section Dl, the map expression data storage section C12, and the correspondence information storage section C14 are preferably nonvolatile recording media, but can be realized by volatile recording media.

[0358] The process of storing information in the storage section Dl and the like is not limited. For example, information can be stored in the storage section Dl and the like through a recording medium, information to be transmitted can be stored in the storage section Dl and the like through a communication line and the like, or information to be input can be stored in the storage section Dl and the like through an input device.

[0359] The reception section D2 can be implemented by a device driver of an input unit such as a touch panel and a keyboard, and control software of a menu screen and the like.

[0360] The processing section D3, the current position information acquisition section D31, the coordinate information acquisition section D32, and the data construction section D33 can also be implemented by an MPU and a memory and the like. The processing steps of the processing section D3 can be implemented by software, which can also be recorded in a recording medium such as a ROM. However, the processing section D3 can also be implemented by hardware (a dedicated circuit).

[0361] It can be considered that the output section D4 and the map expression data output section D41 include output devices such as a display and a speaker, or it can be considered that the output section D4 and the map expression data output section D41 do not include the output devices. The output section D4 can be implemented by a driver software of an output device, or a driver software of an output device and the output device and the like.

[0362] Next, an example of the operation of the map expression data processing apparatus D will be described using the flowchart of Figure 18

[0363] (Step S1801) The reception section D2 acquires map expression data of a display object from the map expression data storage section C12.

[0364] (Step S1802) The current position information acquisition section D31 acquires current position information.

[0365] (Step S1803) The coordinate information acquisition section D32 acquires two or more pieces of correspondence information which correspond to a map expression data identifier of the map expression data acquired in step S1801, from the correspondence information storage section C14. Next, the coordinate information acquisition section D32 acquires coordinate information corresponding to the current position information, using the two or more pieces of correspondence information.

[0366] (Step S1804) The data construction section D33 constructs, on the map expression data acquired in step S1801, current position additional map expression data which is map expression data of a position indicated by the coordinate information acquired in step S1803.

[0367] (Step S1805) The map expression data output section D41 outputs the current position additional map expression data constructed in step S1804. The processing ends.

[0368] ​According to the present embodiment, the current position can be indicated on the map representation data using two or more pieces of correspondence information acquired automatically.

[0369] Further, the software that realizes the map representation data processing apparatus D in the present embodiment is a program as follows. That is, the program is a program for causing a computer that can access a map representation data storage section that stores map representation data and a correspondence information storage section that stores two or more pieces of correspondence information that are groups of coordinate information output by the map representation data processing apparatus C and position information acquired by the position information acquisition section to function as the following sections: a current position information acquisition section that acquires current position information that specifies a current position; a coordinate information acquisition section that acquires coordinate information corresponding to the current position information using the two or more pieces of correspondence information; a data construction section that constructs current position additional map representation data that is map representation data that explicitly represents a position indicated by the coordinate information on the map representation data; and a map representation data output section that outputs the current position additional map representation data.

[0370] (Fourth Embodiment)

[0371] In the present embodiment, a map representation data processing apparatus that acquires three or more place names from map representation data, acquires coordinate information corresponding to each of the place names from the map representation data, acquires true position information corresponding to the place names from a place dictionary, and outputs correspondence information that is a proper group of coordinate information and position information using the coordinate information and the position information is described.

[0372] Further, in the present embodiment, a map representation data processing apparatus that determines an inappropriate place from relationship information related to a relationship between two pieces of correspondence information, and outputs map representation data that does not include inappropriate correspondence information corresponding to the inappropriate place is described. Further, in the present embodiment, in order to determine an inappropriate place, for example, distance relationship information related to a distance, angle relationship information related to an angle, or the like is used. Further, an inappropriate place refers to a place corresponding to correspondence information that is considered to be erroneous.

[0373] Further, in the present embodiment, a map representation data processing apparatus that acquires and outputs scale information of map representation data is described.

[0374] Further, in the present embodiment, a map representation data processing apparatus that acquires and outputs a range of map representation data is described.

[0375] Further, in the present embodiment, a map representation data processing apparatus that appends a place name or the like that enters the range of map representation data to map representation data is described.

[0376] Further, in the present embodiment, a map representation data processing apparatus that acquires and outputs information related to the orientation of map representation data is described.

[0377] Figure 19 is a block diagram of the map representation data processing apparatus E in the present embodiment. In addition, Figure 20 is a block diagram of the processing section E3 that constitutes the map representation data processing apparatus E.

[0378] The map representation data processing apparatus E is provided with a storage section C1, a reception section C2, a processing section E3, and an output section E4

[0379] The storage section C1 is provided with a place dictionary storage section C11, a map representation data storage section C12, an accurate map information storage section C13, a learner storage section A12, and a correspondence information storage section C14. The reception section C2 is provided with a map representation data reception section C21. The processing section E3 is provided with a character string acquisition section C31, a classification section C32, a feature place detection section C34, a coordinate information acquisition section C35, a position information acquisition section C36, a relationship information acquisition section E31, a correspondence information acquisition section E32, a scale acquisition section E33, a region determination information acquisition section E34, an additional place acquisition section E35, an additional position acquisition section E36, an additional coordinate acquisition section E37, a place registration section E38, and an orientation information acquisition section E39. The correspondence information acquisition section E32 is provided with a judgment unit E321 and a correspondence information acquisition unit E322. The output section E4 is provided with a correspondence output section E41, a scale information output section E42, a region determination information output section E43, and an orientation information output section E44.

[0380] The processing section E3 performs various processing. The various processing refers to, for example, processing performed by the character string acquisition section C31, the classification section C32, the feature place detection section C34, the coordinate information acquisition section C35, the position information acquisition section C36, the relationship information acquisition section E31, the correspondence information acquisition section E32, the scale acquisition section E33, the region determination information acquisition section E34, the additional place acquisition section E35, the additional position acquisition section E36, the additional coordinate acquisition section E37, the place registration section E38, the orientation information acquisition section E39.

[0381] The relationship information acquisition section E31 acquires relationship information. The relationship information is information related to a relationship among three or more pieces of correspondence information. The relationship information acquisition section E31 acquires the relationship information using the three or more pieces of correspondence information. The relationship information is, for example, distance relationship information to be described later, angle relationship information to be described later. Further, the correspondence information is a group of coordinate information and position information corresponding to a string acquired by the string acquisition section C31. The coordinate information corresponding to the string acquired by the string acquisition section C31 is information acquired by the coordinate information acquisition section C35. The position information corresponding to the string acquired by the string acquisition section C31 from the map expression data is information acquired by the position information acquisition section C36. Further, the string is usually the name of a place. The place is, for example, a station, a sightseeing spot, a scenic spot, a building, a prefecture, a city, a town, a village, a park, and the like.

[0382] The relationship information acquisition section E31 preferably acquires relative relationship information between correspondence information corresponding to two respective strings among three or more strings acquired by the string acquisition section C31 in units of a group of two strings.

[0383] The relationship information acquisition section E31 acquires distance relationship information using correspondence information of two respective strings in units of a group of two strings, for example. The distance relationship information is information indicating a relationship between a relative distance as a difference in coordinate information of two strings and an absolute distance as a difference in position information of two strings. Further, the group of two strings refers to a group of two strings among three or more strings acquired by the string acquisition section C31.

[0384] The distance relationship information is, for example, MPP. MPP is meters per pixel (m / pixcel). In a case where the correspondence information corresponding to two respective strings is correspondence information 1 "coordinate information 1 (x1, y1) position information 1 (X1, Y1)", and correspondence information 2 "coordinate information 2 (x2, y2) position information 2 (X2, Y2)", MPP = "(distance (m) of position information 1 and position information 2) / (number of pixels between coordinate information 1 and coordinate information 2)". In addition, the distance relationship information is, for example, PPM. PPM is "PPM = (number of pixels between coordinate information 1 and coordinate information 2) / (distance (m) of position information 1 and position information 2)". Further, a method of calculating a distance of position information 1 (X1, Y1) and position information 2 (X2, Y2) and a method of calculating a number of pixels of coordinate information 1 (x1, y1) and coordinate information 2 (x2, y2) are known techniques, and thus the description thereof is omitted here.

[0385] The relationship information acquisition section E31 acquires angle relationship information using correspondence information of two respective strings in units of a group of two strings, for example.

[0386] Angular relationship information represents the relationship between relative and absolute angles. A relative angle is the angle obtained from the coordinate information of two strings. It is the angle relative to a baseline (e.g., the line at the bottom of a rectangular map representation or the line at the right of a rectangular map representation) connecting the two coordinate information strings. An absolute angle, for example, is the angle between a line connecting the reference azimuth (e.g., east, north) and the line obtained from the positional information of the two strings.

[0387] Angular relationship information refers to information related to the difference between relative and absolute angles (e.g., "relative angle - absolute angle", "absolute angle - relative angle", "|relative angle - absolute angle|"). Information related to the difference between relative and absolute angles can also be, for example, (cos(relative angle - absolute angle), sin(relative angle - absolute angle)) or (cos(absolute angle - relative angle), sin(absolute angle - relative angle)). Furthermore, information related to the difference between relative and absolute angles can also be appropriately referred to as Rotation.

[0388] The corresponding information acquisition unit E32 uses the relationship information to acquire only two or more corresponding information that correspond to the relationship information that satisfies the predetermined relationship among three or more corresponding information.

[0389] The corresponding information acquisition unit E32 determines whether the distance relationship information of three or more items satisfies the predetermined relationship. From the corresponding information corresponding to the three or more strings obtained by the string acquisition unit C31, it excludes the corresponding information corresponding to the distance relationship information that does not satisfy the predetermined relationship, and only acquires the remaining two or more corresponding information.

[0390] The corresponding information acquisition unit E32 determines whether the three or more angle relationship information satisfies the predetermined relationship. From the corresponding information corresponding to the three or more strings obtained by the string acquisition unit C31, it excludes the corresponding information corresponding to the angle relationship information that does not satisfy the predetermined relationship, and only acquires the remaining two or more corresponding information.

[0391] The corresponding information acquisition unit E32 preferably acquires only two or more corresponding information that correspond to the distance relationship information and the angle relationship information when the distance relationship information and the angle relationship information satisfy a predetermined relationship.

[0392] The determination unit E321 that constitutes the correspondence information acquisition unit E32 groups the three or more pieces of relationship information acquired by the relationship information acquisition unit E31, and determines relationship information that does not enter a group. In addition, as an algorithm for clustering relationship information, for example, hierarchical agglomerative clustering (HAC) can be used. For HAC, refer to Internet URLs "http: / / pub.ist.ac.at / ~edels / Papers / 1984-J-05-HierarchicalClustering.pdf" "http: / / citeseerx.ist.psu.edu / viewdoc / download?doi=10.1.1.299.7703&rep=rep1&type=pdf". In addition, the algorithm for clustering of a set of information is not limited.

[0393] The correspondence information acquisition unit E322 excludes correspondence information corresponding to relationship information that does not enter a group from correspondence information corresponding to each of the three or more pieces of strings acquired by the string acquisition unit C31, and acquires only the remaining two or more pieces of correspondence information.

[0394] The scale acquisition unit E33 acquires a representative value of distance relationship information from the three or more pieces of distance relationship information, and acquires scale information of the map expression data using the representative value of the distance relationship information. In addition, the representative value is, for example, an average value, a median value. For example, in a case where the representative value of the distance relationship information (here, for example, MPP) is α, the scale acquisition unit E33 acquires scale information "α", for example.

[0395] The region determination information acquisition unit E34 acquires a relative perpendicular distance that is a perpendicular distance of coordinate information corresponding to a string acquired by the string acquisition unit C31 from each of the four edges of the map expression data, and acquires region determination information that determines a range in the real world of the map expression data using the relative perpendicular distance and the scale information (for example, MPP). In addition, the range in the real world refers to a range in accurate map information.

[0396] The region determination information acquisition unit E34, for example, calculates a relative perpendicular distance of coordinate information possessed by each of the two or more pieces of correspondence information finally acquired by the correspondence information acquisition unit E32 from each edge (upper edge, lower edge, left edge, right edge) of the map expression data. In addition, a technique for calculating a perpendicular distance of a point from a straight line is a well-known technique.

[0397] Furthermore, the area determination information acquisition unit E34, for example, obtains representative values ​​(e.g., median, average) of two or more relative vertical distances according to each side unit. Next, the area determination information acquisition unit E34, for example, obtains location information of the location relative to the representative value of the relative vertical distance according to each side unit. Next, the area determination information acquisition unit E34, for example, obtains the latitude or longitude of each side according to each side unit by "distance relationship information (MPP) × representative value of relative vertical distance".

[0398] The additional location acquisition unit E35 acquires location information within the range indicated by the region determination information from the location dictionary. For example, the additional location acquisition unit E35 preferably acquires two or more location information within the range indicated by the region determination information from the location dictionary, and based on this acquired location information, acquires location information excluding strings acquired by the string acquisition unit C31. Furthermore, the location dictionary used can be either the location dictionary in the location dictionary storage unit C11 or a location dictionary stored in an external device (not shown).

[0399] In addition, the additional location acquisition unit E35 preferably acquires location information within the range shown in the area determination information, as well as one or more attribute values ​​of the location information (e.g., station name, whether it is a scenic spot, intersection name, etc.), and retrieves location information from the location dictionary that is paired with one or more attribute values ​​that meet the predetermined conditions.

[0400] The additional location acquisition unit E36 retrieves location information from the location dictionary that corresponds to the location information retrieved by the additional location acquisition unit E35.

[0401] The additional coordinate acquisition unit E37 acquires coordinate information corresponding to the position information acquired by the additional position acquisition unit E36. For example, the additional coordinate acquisition unit E37 acquires the difference between the position information of a corresponding piece of information and the position information acquired by the additional position acquisition unit E36, uses the difference in position information and distance relationship information (MPP) to acquire the difference in coordinate information with the corresponding piece of information, and uses the difference in coordinate information with the corresponding piece of information to acquire the coordinate information corresponding to the position information acquired by the additional position acquisition unit E36.

[0402] Location tracking unit E38 configures location information (string) obtained by additional location acquisition unit E35 at the location indicated by the coordinate information obtained by additional coordinate acquisition unit E37. In addition, location information is added to the map display data.

[0403] The orientation information acquisition unit E39 obtains representative values ​​of the angle relationship information based on three or more angle relationship information, and uses the representative values ​​of the angle relationship information to obtain orientation information representing the orientation of the map representation data.

[0404] In the case where the angle relationship information (here, for example, "relative angle-absolute angle") is "-30", the north of the real world is the right up direction of 30 degrees in the map representation data, and the azimuth information acquisition section E39 obtains, for example, the azimuth information "30 degrees". Further, it is assumed that the azimuth information here is the angle of the clockwise rotation from the straight up in the map representation data. Further, the azimuth information can also be a pattern corresponding to the acquired angle.

[0405] The output section E4 outputs various information. The various information is, for example, the correspondence information, the scale information, the map representation data, the accurate map information, and the azimuth information. The output here generally means the accumulation to a recording medium, but can also be considered as a concept including the display to a display, the projection using a projector, the printing by a printer, the sound output, the transmission to an external device, the delivery of the processing result to other processing devices and other programs, and the like.

[0406] The correspondence output section E41 accumulates two or more pieces of the correspondence information acquired by the correspondence information acquisition section E32. The correspondence output section E41 can also display two or more pieces of the correspondence information, or transmit to other devices.

[0407] The scale information output section E42 outputs the scale information acquired by the scale acquisition section E33. The output here generally means the display, but can also be the accumulation to a recording medium, the transmission to an external device, and the like.

[0408] The region determination information output section E43 outputs the region determination information acquired by the region determination information acquisition section E34. The output here generally means the display, but can also be the accumulation to a recording medium, the transmission to an external device, and the like.

[0409] The azimuth information output section E44 outputs the azimuth information acquired by the azimuth information acquisition section E39. The output here generally means the display, but can also be the accumulation to a recording medium, the transmission to an external device, and the like.

[0410] The processing section E3, the string acquisition section C31, the classification section C32, the feature place detection section C34, the coordinate information acquisition section C35, the position information acquisition section C36, the relationship information acquisition section E31, the correspondence information acquisition section E32, the scale acquisition section E33, the region determination information acquisition section E34, the additional place acquisition section E35, the additional position acquisition section E36, the additional coordinate acquisition section E37, the place note section E38, and the azimuth information acquisition section E39 can generally be implemented by an MPU and a memory, or the like. The processing steps of the processing section E3 and the like are generally implemented by software recorded in a recording medium such as a ROM. However, they can also be implemented by hardware (a dedicated circuit).

[0411] The output unit E4, corresponding output unit E41, scale information output unit E42, area determination information output unit E43, and orientation information output unit E44 can be considered to include output devices such as displays and speakers, or they can be considered not to include them. The output unit E4, etc., can also be implemented through the driver software of the output device, or the driver software of the output device and the output device, etc.

[0412] Next, use Figure 21 The flowchart illustrates the operation of the map representation data processing device E. Figure 21 In the flowchart, for the... Figure 8 The same steps as in the flowchart are omitted. Furthermore, in Figure 21 The flowchart includes steps S804 to S812.

[0413] (Step S2101) Processing unit E3 uses the map representation data obtained in step S804 to perform corresponding information acquisition processing. For an example of corresponding information acquisition processing, it uses... Figure 22 The flowchart is explained below. Furthermore, the corresponding information acquisition process involves acquiring one or more accumulated corresponding information. Additionally, the map representation data being processed is typically the map representation data stored in the map representation data storage unit C12, but it can also be map representation data received from an external device.

[0414] (Step S2102) The corresponding output unit E41 stores one or more corresponding information obtained in step S2101. Furthermore, the storage destination for the corresponding information is, for example, the storage unit C1, but it could also be other devices. The corresponding output unit E41 stores one or more corresponding information obtained in step S2101 in a corresponding association with the map representation data obtained in step S804.

[0415] (Step S2103) The scale acquisition unit E33 uses the representative value (e.g., MPP) of the distance relationship information obtained in step S2101 to acquire scale information and accumulates it in association with the map representation data obtained in step S804. Furthermore, the destination for accumulating the scale information is, for example, the storage unit C1, but it could also be other devices.

[0416] (Step S2104) The region determination information acquisition unit E34 performs region determination processing. For an example of region determination processing, using... Figure 25 The flowchart is used for illustration. Furthermore, region determination processing refers to the process of obtaining information representing the real-world regions corresponding to the map regions in the map representation data.

[0417] (Step S2105) The orientation information acquisition unit E39 performs orientation information acquisition processing. For an example of orientation information acquisition processing, using...Figure 26 The flowchart of FIG. 14 is used to explain an example of the position information acquisition processing. The position information acquisition processing refers to processing for acquiring information related to the position (also referred to as inclination) of the map expression data.

[0418] (Step S2106) The place addition processing is performed by the place addition section E35 or the like. An example of the place addition processing is explained using the flowchart of FIG. 15. The place addition processing refers to processing for adding place information (strings) not recorded in the map expression data. Figure 27

[0419] (Step S2107) The processing section E3 performs processing for constructing the output map. An example of the output map construction processing is explained using the flowchart of FIG. 16. Figure 28

[0420] (Step S2108) The output section E4 outputs the map expression data constructed in Step S2107 and the accurate map information constructed in Step S2107. The processing is ended. Note that the output section E4 can also output only one of the map expression data and the accurate map information.

[0421] Next, an example of the correspondence information acquisition processing of Step S2101 is explained using the flowchart of FIG. 17. Figure 22

[0422] (Step S2201) The distance relationship information acquisition section E31 performs the distance relationship information acquisition processing. An example of the distance relationship information acquisition processing is explained using the flowchart of FIG. 18. Note that the distance relationship information acquisition processing is processing for acquiring one or more distance relationship information for a set of two or more correspondence information. Figure 23

[0423] (Step S2202) The judging unit E321 groups three or more distance relationship information acquired in Step S2201. Then, the judging unit E321 acquires one or more groups of distance relationship information. Note that, for example, the HAC described above is used for the grouping.

[0424] (Step S2203) The correspondence information acquisition unit E322 assigns 1 to the counter i.

[0425] (Step S2204) The correspondence information acquisition unit E322 judges whether or not the i-th group acquired by Step S2202 exists. In the case where the i-th group exists, the processing proceeds to Step S2205, and in the case where the i-th group does not exist, the processing returns to the parent processing.

[0426] ​​​​(Step S2205) The correspondence information acquiring unit E322 determines whether the i-th group satisfies a predetermined condition related to the number of places within the group. In the case where the condition is satisfied, the process proceeds to step S2206, and in the case where the condition is not satisfied, the process proceeds to step S2209. Further, the predetermined condition is, for example, that the number of places (may also be referred to as strings) corresponding to the i-th group is equal to or greater than a threshold value, that the number of places corresponding to the i-th group is greater than the threshold value, that the proportion of places corresponding to the i-th group is equal to or greater than a threshold value, that the proportion of places corresponding to the i-th group is greater than a threshold value, or the like. Further, the proportion means "the number of places corresponding to the i-th group / the number of places belonging to any group".

[0427] (Step S2206) The correspondence information acquiring unit E322 acquires correspondence information of two or more places corresponding to the i-th group.

[0428] (Step S2207) The relationship information acquiring unit E31 performs angle relationship information acquiring processing on the correspondence information of two or more places acquired in step S2206. An example of the angle relationship information acquiring processing will be described using the flowchart of FIG. 8. Figure 24

[0429] (Step S2208) The determination unit E321 groups three or more pieces of angle relationship information acquired in step S2207. Further, the determination unit E321 acquires one or two or more groups of angle relationship information. Further, the grouping uses, for example, the HAC described above.

[0430] (Step S2209) The correspondence information acquiring unit E322 assigns 1 to the counter j.

[0431] (Step S2210) The correspondence information acquiring unit E322 determines whether the j-th group exists in the group acquired in step S2208. In the case where the j-th group exists, the process proceeds to step S2211, and in the case where the j-th group does not exist, the process proceeds to step S2214.

[0432] (Step S2211) The correspondence information acquiring unit E322 determines whether the j-th group satisfies a predetermined condition related to the number of places within the group. In the case where the condition is satisfied, the process proceeds to step S2212, and in the case where the condition is not satisfied, the process proceeds to step S2213. Further, the predetermined condition is, for example, that the number of places (may also be referred to as strings) corresponding to the j-th group is equal to or greater than a threshold value, that the number of places corresponding to the j-th group is greater than the threshold value, that the proportion of places corresponding to the j-th group is equal to or greater than a threshold value, that the proportion of places corresponding to the j-th group is greater than a threshold value, or the like. Further, the proportion means "the number of places corresponding to the j-th group / the number of places belonging to any group".​

[0433] (Step S2212) The correspondence information acquiring unit E322 acquires correspondence information of two or more places corresponding to the jth group.

[0434] (Step S2213) The correspondence information acquiring unit E322 increments the counter j by 1. The process returns to Step S2210.

[0435] (Step S2214) The correspondence information acquiring unit E322 increments the counter i by 1. The process returns to Step S2204.

[0436] Further, in the flowchart of Figure 22 , in Step S2202 or Step S2208, in a case where a plurality of groups are detected, the correspondence information acquiring unit E322 can also select only one group having the largest number of places.

[0437] Next, an example of the distance relationship information acquiring process of Step S2201 will be described using the flowchart of Figure 23 .

[0438] (Step S2301) The relationship information acquiring unit E31 sets the counter i to 1.

[0439] (Step S2302) The relationship information acquiring unit E31 determines whether or not a group of the ith two places among three or more places that are the processing targets exists. In a case where the group of the ith two places exists, the process proceeds to Step S2303, and in a case where it does not exist, the process returns to the parent process.

[0440] (Step S2303) The relationship information acquiring unit E31 acquires position information of the two places of the ith group, and calculates an absolute distance of the two places from the two pieces of position information.

[0441] (Step S2304) The relationship information acquiring unit E31 acquires coordinate information of the two places of the ith group, and calculates a relative distance of the two places from the two pieces of coordinate information.

[0442] (Step S2305) The relationship information acquiring unit E31 acquires distance relationship information (for example, MPP) using the absolute distance calculated in Step S2303 and the relative distance calculated in Step S2304, and temporarily stores the distance relationship information in association with information of the ith group.

[0443] (Step S2306) The relationship information acquiring unit E31 increments the counter i by 1. The process returns to Step S2302.

[0444] Next, an example of the angle relationship information acquiring process of Step S2207 will be described using the flowchart of Figure 24 .

[0445] (Step S2401) The relationship information acquisition section E31 substitutes 1 for the counter i.

[0446] (Step S2402) The relationship information acquisition section E31 judges whether or not there is a group of the i-th two places among the three or more places which are the processing targets. In the case where there is the i-th group of two places, the processing proceeds to Step S2403, and in the case where there is not, the processing returns to the upper level processing.

[0447] (Step S2403) The relationship information acquisition section E31 acquires the position information of the two places of the i-th group, and calculates the absolute angle of the two places from the two pieces of position information.

[0448] (Step S2404) The relationship information acquisition section E31 acquires the coordinate information of the two places of the i-th group, and calculates the relative angle of the two places from the two pieces of coordinate information.

[0449] (Step S2405) The relationship information acquisition section E31 acquires the angle relationship information (for example, Rotation) using the absolute angle calculated in Step S2403 and the relative angle calculated in Step S2404, and temporarily stores the angle relationship information in association with the information of the i-th group.

[0450] (Step S2406) The relationship information acquisition section E31 increments the counter i by 1. The processing returns to Step S2402.

[0451] Next, an example of the region determination processing of Step S2104 will be described using the flowchart of Fig. 21. Figure 25

[0452] (Step S2501) The region determination information acquisition section E34 substitutes 1 for the counter i.

[0453] (Step S2502) The region determination information acquisition section E34 judges whether or not there is the i-th edge which is the processing target. In the case where there is the i-th edge, the processing proceeds to Step S2503, and in the case where there is not, the processing returns to the upper level processing. In addition, generally, the map representation data is rectangular, and the edges of the processing target are generally the four edges of the top, the bottom, the left and the right.

[0454] ​(Step S2503) The region determination information acquisition section E34 acquires edge information of the i-th edge of the map expression data. Further, the edge information is, for example, coordinate information (xl, yl), (x2, y2) of two end points constituting the edge. In addition, the region determination information acquisition section E34 acquires coordinate information of two end points of an edge of a file of the map expression data, for example, on the premise that the entire map expression data (generally, an image file) is the map data. In addition, the region determination information acquisition section E34 can also perform a contour extraction process on the map expression data to acquire information of a contour line of a region other than the map (for example, a blank region) and a map region, for example. The process of acquiring such contour line information is a process of acquiring edge information.

[0455] (Step S2504) The region determination information acquisition section E34 substitutes 1 into the counter j.

[0456] (Step S2505) The region determination information acquisition section E34 determines whether or not the j-th object information of the processing target exists. In the case where the j-th object information exists, the process proceeds to step S2506, and in the case where the j-th object information does not exist, the process proceeds to step S2510. Further, the object information of the processing target corresponds to a place.

[0457] (Step S2506) The region determination information acquisition section E34 acquires the j-th object information of the processing target.

[0458] (Step S2507) The region determination information acquisition section E34 calculates a straight line distance (for example, the number of pixels) from the j-th place to the map expression data of the i-th edge using coordinate information possessed by the j-th object information and the edge information of the i-th edge.

[0459] (Step S2508) The region determination information acquisition section E34 acquires position information of two respective end points of the i-th edge using position information possessed by the j-th object information, the straight line distance calculated in step S2507, and a representative value (for example, MPP) of the distance relationship information. Further, the position information of such two respective end points is the edge information.

[0460] (Step S2509) The region determination information acquisition section E34 increments the counter j by 1. The process returns to step S2505.

[0461] (Step S2510) The region determination information acquisition section E34 acquires a representative value (for example, the median, the average) of two or more pieces of edge information with respect to the i-th edge. Further, such a representative value is representative edge information. The representative edge information is, for example, information of a middle line of two or more pieces of edge information. The representative edge information is, for example, an average of two respective end points possessed by two or more respective pieces of edge information. For example, in the case where two pieces of edge information are edge information 1 (xl, yl), (x2, y2) and edge information 2 (x3, y3), (x4, y4), the representative edge information is (x2.5, y2.5). 11 , y11 ), (x 12 y 12 ), edge information 2 (x 21 y 21 ), (x 22 y 22 In the case of ), the representative edge information of the average value is ((x) 11 +x 21 / 2), (y 11 +y 21 / 2)), ((x 12 +x 22 / 2), (y 12 +y 22 / 2)).

[0462] (Step S2511) The region determination information acquisition unit E34 increments the counter i by 1. Return to step S2502.

[0463] Next, use Figure 26 The flowchart illustrates an example of obtaining and processing the orientation information in step S2105.

[0464] (Step S2601) The orientation information acquisition unit E39 inputs 1 into the counter i.

[0465] (Step S2602) The location information acquisition unit E39 determines whether there is a group with the i-th location. If there is a group with the i-th location, proceed to step S2603; otherwise, proceed to step S2605.

[0466] (Step S2603) The orientation information acquisition unit E39 acquires the angle relationship information of the i-th location.

[0467] (Step S2604) The orientation information acquisition unit E39 increments the counter i by 1. Return to step S2602.

[0468] (Step S2605) The orientation information acquisition unit E39 acquires the representative value (e.g., average value, median) from the two or more angle relationship information acquired in step S2603.

[0469] (Step S2606) The azimuth information acquisition unit E39 uses the representative value from the angle relationship information obtained in step S2605 to acquire angle information. It then returns to the previous processing stage. Furthermore, the azimuth information acquisition unit E39 acquires angle information according to the calculation formula "Angle information = f(representative value of angle relationship information)". For example, the calculation formula is "Angle information = -1 × (representative value of angle relationship information)".

[0470] Next, use Figure 27The flowchart of FIG. 21 is a flowchart of the process of the additional place acquisition section E35. An example of the process of the additional place acquisition section E35 will be described with reference to the flowchart of FIG. 21.

[0471] (Step S2701) The additional place acquisition section E35 substitutes 1 for the counter i.

[0472] (Step S2702) The additional place acquisition section E35 determines whether the i-th place position information exists in the place dictionary. In the case where the i-th place position information exists, the process proceeds to step S2703, and in the case where the i-th place position information does not exist, the process returns to the process of the superior level.

[0473] (Step S2703) The additional position acquisition section E36 acquires the position information possessed by the i-th place position information from the place dictionary.

[0474] (Step S2704) The additional place acquisition section E35 determines whether the position information acquired in step S2703 is within the range of the area indicated by the area determination information. In the case where the position information is within the range of the area, the process proceeds to step S2705, and in the case where the position information is not within the range of the area, the process proceeds to step S2711. Further, in the case where the area determination information indicating the range of the area exists, it is known technology to determine whether one position information is position information of a place within the area.

[0475] (Step S2705) The additional coordinate acquisition section E37 acquires the coordinate information corresponding to the position information acquired in step S2703.

[0476] (Step S2706) The additional place acquisition section E35 acquires the place information possessed by the i-th place position information from the place dictionary.

[0477] (Step S2707) The additional place acquisition section E35 determines whether to arrange the place information acquired in step S2706 in the map expression data. In the case of arrangement, the process proceeds to step S2708, and in the case of non-arrangement, the process proceeds to step S2709. Further, the additional place acquisition section E35 determines to arrange in the map expression data, for example, in the case where one or more attribute values corresponding to the place information acquired in step S2706 satisfy a predetermined condition.

[0478] (Step S2708) The place recording section E38 arranges the string of the place information acquired in step S2706 at the position indicated by the coordinate information acquired in step S2705 as a position on the map expression data.

[0479] (Step S2709) The corresponding information acquisition section E32 constructs the corresponding information having the corresponding information acquired in step S2703 and the coordinate information acquired in step S2705.

[0480] (Step S2710) The corresponding output unit E41 stores the corresponding information constructed in step S2709.

[0481] (Step S2711) Increment counter i by 1. Return to step S2702.

[0482] Next, use Figure 28 The flowchart illustrates an example of the output map construction process in step S2107.

[0483] (Step S2801) Output unit E4 acquires map representation data of the object being processed. Furthermore, the map representation data here is preferably processed based on the locations described above, with additional location data added.

[0484] (Step S2802) The processing unit E3 acquires the current location information. Alternatively, the processing unit E3 may also have a current location information acquisition unit D31.

[0485] (Step S2803) The processing unit E3 uses two or more corresponding pieces of information to obtain coordinate information corresponding to the current position information obtained in step S2802. Alternatively, the processing unit E3 may also have a coordinate information acquisition unit D32.

[0486] (Step S2804) The processing unit E3 constructs additional map representation data on the map representation data, indicating the current location as shown by the coordinate information obtained in step S2803. Alternatively, the processing unit E3 may also include a data construction unit D33.

[0487] (Step S2805) The processing unit E3 obtains the region determination information obtained through the above region determination process.

[0488] (Step S2806) The processing unit E3 obtains accurate map information of the region shown in the region determination information obtained in step S2805.

[0489] (Step S2807) Processing unit E3 constructs accurate map information of the extent of the area shown in the explicit area determination information. Returns to the previous processing unit.

[0490] In addition, it can also be done in Figure 28 In the flowchart, map representation data for the current location is supplemented with orientation information and scale information.

[0491] The following describes a specific example of the operation of the map representation data processing device E in this embodiment.

[0492] In this specific example, the map representation data processing device E performs... Figure 29the processing shown. That is, the map representation data processing device E sequentially performs (1) processing based on the OCR module, (2) processing based on the machine learning module, (3) processing based on the geocoding module, (4) processing based on the clustering module, and (5) processing based on the map information extraction module. Further, in Figure 29 the processing of (2) is optional.

[0493] Now, assume that Figure 30 map representation data is stored in the map representation data storage section C12. Further, the map representation data can be appropriately referred to as an input image.

[0494] In this situation, assume that the map representation data reception section C21 reads the input image from the map representation data storage section C12.

[0495] Assume that the character string acquisition section C31 performs character recognition processing (OCR) on the input image, and acquires a list of character strings "Takatsuki Post Office", "Kadagaya Station", "2015", "Kawasaki Citizens' Plaza", "Humen Hospital Branch", and "Cargo Terminal".

[0496] In addition, the coordinate information acquisition section C35 acquires coordinate information of each character string acquired by the character string acquisition section C31. The coordinate information is relative coordinates (x, y) in the input image. The coordinate information acquisition section C35, for example, acquires coordinate information of a center of gravity point of a region in which each character string is disposed.

[0497] Next, the classification section C32 determines whether each character string acquired by the character string acquisition section C31 is location information using a technique of machine learning (here, an LSTM Neural Network), and writes a location information flag "-1" for "2015" which is not location information. According to the above processing, for example, information of Figure 31 can be obtained. Further, the location information flag refers to a flag for determining whether a character string is location information.

[0498] Next, the position information acquisition section C36 acquires position information (latitude, longitude) corresponding to each character string "Takatsuki Post Office", "Kadagaya Station", "Kawasaki Citizens' Plaza", "Humen Hospital Branch", and "Cargo Terminal" by searching a location dictionary using each character string as a key. Further, for example, information of Figure 32 can be obtained.

[0499] Next, the relationship information acquisition section E31 performs a check process using the distance relationship information as follows. That is, the relationship information acquisition section E31 calculates the relative distance (here, the number of pixels) of the difference in coordinate information between the locations belonging to each group of two locations "C1-C2", "C1-C3", "C2-C4", "C3-C4", "C3-C5", "C4-C5" among the locations C1 "Takatsu Post Office", C2 "Kajikumo Station", C3 "Kawasaki Citizen Plaza", C4 "Toro Hospital Branch", C5 "Cargo Terminal" from the coordinate information of each location. In addition, the relationship information acquisition section E31 calculates the absolute distance (here, meters) of the difference in position information between the locations belonging to each group of two locations "C1-C2", "C1-C3", "C2-C4", "C3-C4", "C3-C5", "C4-C5" from the position information of each location. Furthermore, the relationship information acquisition section E31 calculates the distance relationship information (here, MPP) of each group of two locations by "absolute distance / relative distance" using the relative distance and the absolute distance (refer to FIG. 9). Figure 33 ). Furthermore, the relationship information acquisition section E31 obtains a table of the distance relationship information of the result of the process involved, Figure 34

[0500] Next, the correspondence information acquisition section E32 clusters the distance relationship information of Figure 34 into groups of "0.45", "0.41", "0.33", "0.41", "0.37", "0.44" and groups of "523", "470", "941", "809". Furthermore, the correspondence information acquisition section E32 obtains the location identifiers "C1", "C2", "C3", "C4" corresponding to the groups of "0.45", "0.41", "0.33", "0.41", "0.37", "0.44" and the location identifier "C5" corresponding to the groups of "523", "470", "941", "809".

[0501] Furthermore, the correspondence information acquisition section E32 selects the location identifiers of the groups whose number of location identifiers is large enough to satisfy a predetermined condition. Here, the predetermined condition is, for example, "the number of location identifiers is the largest", "the number of location identifiers is equal to or greater than a threshold value (for example, 3)", "the number of location identifiers is greater than a threshold value (for example, 5)", and the like. Furthermore, the correspondence information acquisition section E32 acquires the location identifiers "C1", "C2", "C3", "C4". That is, the correspondence information acquisition section E32 selects "Takatsu Post Office", "Kajikumo Station", "Kawasaki Citizen Plaza", "Toro Hospital Branch" and excludes (deletes) "Cargo Terminal". By the above process, the correspondence information acquisition section E32 obtains Figure 35 ​That is, as a result of the checking process using the distance relationship information, "Ferry Terminal" is excluded.

[0502] Next, the relationship information acquisition section E31 performs a checking process using angle relationship information as follows. That is, the relationship information acquisition section E31 acquires the relative angle and the absolute angle between the points of each group belonging to two points of the groups "C1-C2", "C1-C3", "C2-C4", "C3-C4" in each of the points of C1 "Takatsu Post Office", C2 "Kajigaya Station", C3 "Kawasaki Citizen Plaza", and C4 "Takuho Hospital Branch". Further, the relationship information acquisition section E31 calculates the relative angle of the two points using the coordinate information of the two points constituting the group. In addition, the relationship information acquisition section E31 calculates the absolute angle of the two points using the position information of the two points constituting the group. In addition, Figure 36 3601 is an image of the relative angle (angle with the bottom edge in the input image of the rectangle as a reference) between C1 and C3. In addition, Figure 36 3602 is an image of the absolute angle (angle with the east-west direction in the real world as a reference) between C1 and C3. Further, the relationship information acquisition section E31 calculates the angle relationship information (Rotation) using the relative angle and the absolute angle. Here, the relationship information acquisition section E31 calculates the angle relationship information according to "Angle relationship information = Relative angle - Absolute angle".

[0503] According to the above processing, the relationship information acquisition section E31 obtains the information shown in Figure 37 In addition, the information shown in Figure 37 is made into table information Figure 38 . In addition, the relationship information acquisition section E31 calculates (cos(Angle relationship information), sin(Angle relationship information)) according to the angle relationship information of Figure 38 , and calculates the vector data in units of groups of two points (refer to Figure 39 ). Further, the vector data can be considered as the angle relationship information.

[0504] Next, the correspondence information acquisition section E32 clusters the vectors of Figure 39 and acquires the group 1 "(cos(-2), sin(-2)), (cos(-1), sin(-2))", and the group 2 "(cos(-40), sin(-40)), (cos(-24), sin(-24)), (cos(-32), sin(-32)), (cos(-26), sin(-26))". Further, the correspondence information acquisition section E32 obtains the point identifier "C2" corresponding to the group 1, and the point identifiers "C1", "C3", "C4" corresponding to the group 2.

[0505] Furthermore, the corresponding information acquisition unit E32 selects a group of location identifiers that meet the predetermined conditions. Also, assume that the corresponding information acquisition unit E32 acquires location identifiers “C1”, “C3”, and “C4”. That is, the corresponding information acquisition unit E32 selects “Takatsu Post Office”, “Kawasaki Civic Plaza”, and “Toromo Hospital Branch”, excluding (deleting) “Kajiya Station”.

[0506] In addition, such as Figure 40 As shown, the corresponding information acquisition unit E32 can, for example, create links between locations corresponding to the appropriate values ​​of group 2 "(cos(-40), sin(-40)), (cos(-24), sin(-24)), (cos(-32), sin(-32)), (cos(-26), sin(-26))" to obtain the location identifiers "C1", "C3", and "C4" of the largest closed space. Additionally, the corresponding information acquisition unit E32 can, for example, perform the process of creating links between locations corresponding to the appropriate values ​​of group 2 and deleting the location identifier "C2" that does not exist in the closed space.

[0507] Based on the above processing, the Correspondence Information Acquisition Unit E32 selects three locations as the locations for storing the correspondence information of the objects: "Takatsu Post Office," "Kawasaki Civic Square," and "Toromo Hospital Branch." Furthermore, the Correspondence Information Acquisition Unit E32 acquires the correspondence information (coordinate information, location information) for each of the three locations. In addition, the correspondence information can also be linked with a string (the name of the location).

[0508] Next, the three corresponding information entries are stored in the corresponding output unit E41. Furthermore, the destination for storing the corresponding information is, for example, the corresponding information storage unit C14, or an external device not shown.

[0509] Next, the corresponding information acquisition unit E32 obtains the MPPs "0.41", "0.33", and "0.44" corresponding to the three locations "C1", "C3", and "C4". Next, the corresponding information acquisition unit E32 calculates the representative value (here, the average value) of the three MPPs, obtaining "0.39" (refer to...). Figure 41 ).

[0510] Next, the scale acquisition unit E33 uses the representative value (MPP "0.39") of the acquired distance relationship information to acquire scale information (e.g., "0.39"), and stores it in association with the input image.

[0511] Next, the azimuth information acquisition section E39 performs the azimuth information acquisition processing as follows. That is, the azimuth information acquisition section E39 acquires the angle relationship information "-40" "-24" "-26" of each group among the place identifiers "C1" "C3" "C4". Next, the azimuth information acquisition section E39 acquires the representative value (here, the average value) "-30" of the angle relationship information. Next, the azimuth information acquisition section E39 acquires "30 degrees" according to the calculation formula "azimuth information = -1 x (representative value of angle relationship information)". Further, the azimuth information acquisition section E39 acquires the pattern (here, the angle information) indicating the azimuth of 30 degrees (30 degrees in the clockwise direction) from the north to the east side. Further, the azimuth information output section E44 appends the pattern (the angle information) indicating the azimuth to the input image and performs the output. Such an output example is Figure 42 . Figure 42 4201 is an example of the angle information.

[0512] Next, the region determination information acquisition section E34 performs the region determination processing as follows. For example, first, the region determination information acquisition section E34 detects each side (30a, 30b, 30c, 30d) of the region of the map of the input image by the contour extraction technique. Further, the technique of detecting the region by the contour extraction technique is a publicly known technique. Figure 30

[0513] Next, the region determination information acquisition section E34 acquires the relative distance (here, the number of pixels) "720" from the place of the place identifier "C1" to the right side 30a. Further, the relative distance is the number of pixels of the vertical line from the place of "C1" to the right side 30a. Next, the region determination information acquisition section E34 calculates the absolute distance "280 m" to the right side 30a according to the operation "720 x 0.39" using the representative value (0.39) of the MPP and the number of pixels "720". Next, it is assumed that the region determination information acquisition section E34 acquires the position information [35.5918, 139.6053] of the right side of the place of "C1" using the position information of "C1" and the absolute distance "280 m" (refer to Figure 43 ).

[0514] ​Similarly, the region determination information acquisition section E34 acquires the number of pixels "1199" from the position of the place identifier "C3" to the right edge 30a. In addition, the region determination information acquisition section E34 multiplies the number of pixels "1199" by the representative value (0.39) of the MPP, and calculates the absolute distance "468 m" from the position of the place identifier "C3" to the right edge 30a. In addition, the region determination information acquisition section E34 acquires the position information [35.5849, 139.6096] of the position right to the position of "C3" in the right edge 30a using the position information of "C3" and the absolute distance "468 m" (refer to Figure 43 ). In addition, similarly, the region determination information acquisition section E34 acquires the position information of the position right to the position of "C4" in the right edge 30a.

[0515] Next, the region determination information acquisition section E34 acquires the information (the information of a straight line) of the right edge of each of the positions of "C1", "C3", and "C4" using the position information on the right edge corresponding to each of the positions of "C1", "C3", and "C4" and the azimuth information [44a, 44b, 44c]. Further, the relevant conceptual diagram is Figure 44 Next, the region determination information acquisition section E34 acquires the representative value of the right edge of the three right edge information (here, the median 44c). The representative value of the right edge is determined as the boundary line of the right edge in the accurate map information. Further, the representative value of the right edge can be the average value.

[0516] The region determination information acquisition section E34 performs the same processing as the processing of acquiring the boundary line of the right edge in the accurate map information, and acquires the information of the boundary line of the lower edge (45a), the left edge (45b), and the upper edge (45c) in the accurate map information. Next, the region determination information acquisition section E34 obtains the intersection points (X1, Y1), (X2, Y2), (X3, Y3), and (X4, Y4) of the four edges (44c, 45a, 45b, 45c) (refer to Figure 45 ). Further, the intersection points are (latitude, longitude).

[0517] Through the above processing, the region determination information acquisition section E34 obtains the region determination information which corresponds to the region of the map in the input image and which determines the region of the accurate map information. Further, the region determination information is, for example, the information of the four intersection points, or the information of the two points (X1, Y1) and (X3, Y3), or the information of the two points (X2, Y2) and (X4, Y4).

[0518] Next, the processing section E3 reads accurate map information including the area determined by the area determination information. Next, the processing section E3 constructs accurate map information that explicitly shows the area determined by the area determination information in the accurate map information. Next, the output section E4 outputs the accurate map information that explicitly shows the area determined by the area determination information. An example of the output of such accurate map information is Figure 46 In addition, the area is a rectangle, and is 4601.

[0519] Next, by the processing based on the flowchart of Figure 27 , the additional place acquisition section E35 searches the place dictionary and acquires one or more pieces of place position information that enter the area determined by the area determination information. Next, the additional place acquisition section E35 acquires place information that one or more pieces of the respective place position information have. Next, the additional coordinate acquisition section E37 acquires coordinate information that corresponds to the position information that one or more pieces of the respective place position information have. Next, the place recording section E38, for each piece of the place position information, arranges a string of the acquired place information on the input image at a position shown by the acquired coordinate information. According to the above processing, the accurate map information that is the output object is constructed.

[0520] Next, the output section E4 outputs the constructed accurate map information. According to the present embodiment, above, it is possible to automatically acquire appropriate corresponding information that associates coordinate information of a place name or the like on the map representation data with position information.

[0521] In addition, according to the present embodiment, it is possible to acquire a range in the real world that is supported by the map representation data.

[0522] In addition, according to the present embodiment, it is possible to attach new place information to the map representation data.

[0523] Further, according to the present embodiment, it is possible to acquire orientation information of the map representation data.

[0524] Furthermore, the map representation data processing apparatus D explained in the third embodiment can use one or more pieces of the corresponding information that are automatically acquired in the present embodiment to explicitly show the current position on the map representation data.

[0525] In such a case, it is possible to use two or more pieces of the corresponding information that are automatically acquired by the map representation data processing apparatus E to indicate the current position on the map representation data.

[0526] Further, the processing in the present embodiment can also be realized by software. Also, the software can be distributed by software download or the like. In addition, the software can be distributed by being recorded on a recording medium such as a CD-ROM. Furthermore, the same applies to the other embodiments in the present specification. Furthermore, the software that realizes the information processing apparatus in the present embodiment is a program as follows. That is, the program is a program for causing a computer to function as: a map expression data receiving section that receives map expression data of a kind of a map that is any one or more of a pictorial map, a hand-drawn map, and an outline map; a character string acquisition section that acquires three or more character strings from the map expression data; a coordinate information acquisition section that acquires coordinate information in the map expression data as coordinate information corresponding to each of the three or more character strings acquired by the character string acquisition section; a position information acquisition section that acquires position information corresponding to the position information of each of the three or more character strings acquired by the character string acquisition section using a place dictionary having one or more pieces of place information that associate place information of a determined place with position information of a position where the place is determined; a relationship information acquisition section that acquires relationship information related to a relationship between the coordinate information and the position information as a set corresponding to each of the three or more character strings acquired by the character string acquisition section; a corresponding information acquisition section that acquires, using the relationship information, two or more pieces of corresponding information that correspond to relationship information that satisfies a predetermined relationship among the three or more pieces of corresponding information; and a corresponding output section that stores the two or more pieces of corresponding information acquired by the corresponding information acquisition section.

[0527] (Fifth Embodiment)

[0528] In the present embodiment, an information system that has a map expression data processing apparatus that receives a map photo, searches for one or more pieces of map expression data using the map photo, and transmits navigation information including the one or more pieces of map expression data to a terminal apparatus is described. Furthermore, in the map expression data processing apparatus, a search for map expression data is performed using one or two or more of similarity of an image using the map photo and map expression data, similarity of a set of character strings expressed in the map photo and a set of character strings corresponding to the map expression data, and similarity of a range supported by the map photo and a range supported by the map expression data. Furthermore, the supported range refers to a range of a map area.

[0529] In addition, in the present embodiment, a first pre-processing that cuts out a map area from a map photo and acquires a map cutout image is described. In addition, in the present embodiment, a second pre-processing that corrects a map cutout image to a rectangle and acquires a corrected map image is described.

[0530] Further, in the present embodiment, an information system provided with a map representation data processing device is described, which, in a case where no map photo satisfying the first condition is found as a result of the search using the map photo, searches for one or more map representation data using the received current position information of the terminal device.

[0531] Further, in the present embodiment, an information system provided with a map representation data processing device is described, which, in a case where two or more map representation data are decided, transmits two or more selection images in order to select the map representation data to be used in the terminal device, and transmits two or more corresponding information corresponding to the selected selection image. Further, the selection image refers to an image selected by the user, and is a thumbnail image of the map representation data, or the map representation data.

[0532] Further, in the present embodiment, an information system provided with a map representation data processing device that transmits coordinate information of the current position of the terminal device instead of the map representation data is described. Further, the coordinate information is coordinate information in the map representation data used in the terminal device.

[0533] Further, in the present embodiment, a terminal device that, after photographing a map photo and transmitting the map photo to a map representation data processing device, receives navigation information, and outputs the current position attached map representation data using the navigation information is described.

[0534] Figure 47 is a conceptual diagram of an information system F in the present embodiment. The information system F is provided with a map representation data processing device G, and one or two or more terminal devices H. The map representation data processing device G is a so-called server. The server is, for example, a so-called cloud server, an ASP server, or the like, and the kind thereof is not limited. Further, the terminal device H is, for example, a so-called personal computer, a tablet terminal, a smart phone, or the like, and the kind thereof is not limited. The map representation data processing device G and the one or more terminal devices H are capable of communicating through a network such as the Internet.

[0535] Figure 48 is a block diagram of the information system F in the present embodiment. Figure 49 is a block diagram of the map representation data processing device G constituting the information system F.

[0536] The map expression data processing apparatus G has a storage section Gl, a reception section G2, a processing section G3, and a transmission section G4. The storage section Gl has a place dictionary storage section Cl l, an accurate map information storage section Cl 3, a learner storage section A 12, and a navigation information storage section Gl l. Further, the place dictionary storage section Cl l, the accurate map information storage section Cl 3, the learner storage section A 12, and the navigation information storage section Gl l can exist in an external device not shown. The reception section G2 has a photo reception section G21 and a selection reception section G22. The processing section G3 has a character string acquisition section G31, a position information acquisition section G32, a region determination information acquisition section G33, a coordinate information acquisition section G34, a current coordinate acquisition section G35, and a decision section G36. The decision section G36 has a clipping unit G361, a correction unit G362, a character string judgment unit G363, an image judgment unit G364, a region judgment unit G365, a score acquisition unit G366, a decision unit G367, and an acquisition unit G368. The transmission section G4 has a selection image transmission section G41 and a navigation information transmission section G42.

[0537] Further, the processing section G3 can realize the same functions as the processing section E3. That is, the processing section G3 can further have one or more of the classification section C32, the feature place detection section C34, the relationship information acquisition section E31, the correspondence information acquisition section E32, the scale acquisition section E33, the additional place acquisition section E35, the additional position acquisition section E36, the additional coordinate acquisition section E37, the place registration section E38, and the direction information acquisition section E39.

[0538] The terminal apparatus H has a terminal storage section Hl, a terminal reception section H2, a terminal processing section H3, a terminal transmission section H4, a terminal reception section H5, and a terminal output section H6. The terminal processing section H3 has a terminal photographing section H31, a terminal clipping section H32, a terminal correction section H33, a terminal position acquisition section H34, and a terminal coordinate acquisition section H35.

[0539] Various information is stored in the storage section Gl constituting the map expression data processing apparatus G. The various information is, for example, a place dictionary, a learner, and navigation information to be described later.

[0540] A set of navigation information is stored in the navigation information storage section Gl l. The set of navigation information has two or more navigation information. The navigation information has two or more correspondence information and map expression data. The correspondence information has coordinate information and position information. The coordinate information is information that specifies a coordinate in the map expression data. The position information is, for example, (latitude, longitude).

[0541] The reception section G2 receives various information. The various information is, for example, a map photo to be described later, and a selection instruction to be described later.

[0542] The photo receiving section G21 receives a map photo from the terminal device H. The map photo is a photo of a photographed map. The map is preferably an illustrated map, a hand-drawn map, a sketch map. The map is, for example, a map depicted in a signboard, a wall, a real estate, and the like on a street, a map depicted on a signboard in an amusement park, a theme park, an entertainment facility, and the like, a map depicted on a pamphlet and a guidebook. However, the photographed map can also be an accurate map. In addition, the map photo is preferably a photo photographed by the terminal device H. However, the map photo can also be a photo photographed by another device and stored in the terminal device H. Furthermore, the map photo is generally an image. The map photo is, for example, jpeg, gif, ping, and the like, but the data structure thereof is not limited.

[0543] The photo receiving section G21 preferably further receives terminal position information that specifies the current position of the terminal device H. The terminal position information can be information embedded in the map photo or information other than the map photo. The photo receiving section G21 receives the terminal position information, for example, in pairs with the map photo.

[0544] The selection receiving section G22 receives a selection instruction from the terminal device H. The selection instruction is information indicating the result of selection of a selection image by the terminal device H. The selection instruction has an image identifier that identifies the selection image.

[0545] The processing section G3 performs various processes. The various processes are, for example, processes performed by the character string acquiring section G31, the position information acquiring section G32, the region specifying information acquiring section G33, the coordinate information acquiring section G34, the current coordinate acquiring section G35, and the decision section G36.

[0546] The various processes are, for example, a judgment process of whether or not to perform a pre-process. The processing section G3, for example, judges whether or not to perform a pre-process on a photographed map photo by the terminal device H. The processing section G3, for example, judges whether or not a mark indicating that a pre-process is performed is received.

[0547] The processing section G3, for example, acquires one or more pieces of correspondence information from the received map photo. The process of acquiring one or more pieces of correspondence information from the map photo is the same as the process of acquiring correspondence information from the map expression data explained in the fourth embodiment. That is, the processing section G3 acquires one or more place names (character strings) from the map photo, acquires coordinate information corresponding to each of the place names from the map photo, acquires real position information corresponding to the place names from a place dictionary, and constitutes one or more pieces of correspondence information having the coordinate information and the position information.

[0548] The string acquisition section G31 acquires one or more strings from the map photo received by the photo reception section G21. The string acquisition section G31 preferably acquires three or more strings from the map photo. Further, the string acquisition section C31 acquires one or more strings from the map photo by, for example, character recognition processing. The string acquisition section G31 performs the same processing as the string acquisition section C31. Further, it is preferable that, for one or more strings acquired by the string acquisition section G31, it is determined whether or not it is a string that specifies a place determined by the classification section C32, and only the string that specifies a place is acquired.

[0549] The position information acquisition section G32 acquires position information corresponding to the position information of each of the three or more strings acquired by the string acquisition section G31 using a place dictionary. Further, the place dictionary can be stored in the storage section G1 or in an external device not shown. In addition, the position information acquisition section G32 performs the same processing as the position information acquisition section C36. In addition, it is preferable that the processing of excluding position information of a place not located in the map photo from the position information acquired by the position information acquisition section G32 is performed by the grouping section C33.

[0550] The region determination information acquisition section G33 acquires region determination information that determines a region covered by the map photo using the three or more pieces of position information acquired by the position information acquisition section G32. The region determination information acquisition section G33 performs the same processing as the region determination information acquisition section C37, for example. Further, the three or more pieces of position information acquired by the position information acquisition section G32 preferably exclude position information of a place not located in the map photo by the grouping section C33.

[0551] The coordinate information acquisition section G34 acquires coordinate information of each of the three or more strings represented in the map photo. The coordinate information is information that specifies a coordinate in the map photo. The coordinate information acquisition section G34 performs the same processing as the coordinate information acquisition section C35.

[0552] The current coordinate acquisition section G35 acquires current coordinate information that specifies a coordinate corresponding to the terminal position information using the three or more pieces of correspondence information and the received terminal position information. The current coordinate acquisition section G35 performs the same processing as the coordinate information acquisition section D32. Further, the correspondence information has coordinate information and position information. In addition, the current coordinate information is information that specifies a coordinate in the map photo.

[0553] The decision section G36 searches the navigation information set and decides navigation information having a relationship satisfying the first condition with the map photo. Further, the navigation information set can exist in the navigation information storage section G11 or in an external device not shown.

[0554] The first condition has one or two or more of an image similarity condition, a character string similarity condition, and a range similarity condition. The image similarity condition is a condition related to a degree of similarity of images.

[0555] The image similarity condition is generally a condition related to a degree of similarity of a map photo as an image and map expression data as an image. The image similarity condition is, for example, (a) a degree of similarity of the map photo to each of two or more map expression data is the greatest, (b) a degree of similarity of the map photo to the map expression data is greater than or equal to a threshold value, (c) a degree of similarity of the two images is greater than a threshold value, or (d) a sub-score using a degree of similarity of the two images is greater than or equal to a threshold value. The sub-score can be either a degree of similarity itself as a score related to a degree of similarity of the two images or a value calculated by an increasing function using a degree of similarity as a parameter. Furthermore, a process of calculating a degree of similarity of two images is a well-known technique, and thus the description thereof is omitted.

[0556] The character string similarity condition is a condition related to a degree of coincidence of a first character string set as one or more character strings expressed in the map photo and a second character string set as one or more character strings corresponding to the map expression data. The character string similarity condition is, for example, (a) a number or a ratio of coincident character strings is the greatest in the first character string set and the second character string set corresponding to each of two or more map expression data, (b) a number or a ratio of coincident character strings is greater than or equal to a threshold value or greater than a threshold value in the first character string set and the second character string set, or (c) a sub-score using a degree of coincidence of a character string included in the first character string set and a character string included in the second character string set is greater than or equal to a threshold value. The sub-score can be either a number or a ratio of coincident character strings of a character string included in the first character string set and a character string included in the second character string set or a value calculated by an increasing function using the number or the ratio as a parameter.

[0557] Furthermore, the second character string set as one or more character strings corresponding to the map expression data can be either one or more character strings expressed in the map expression data or one or more character strings expressed in the map expression data and one or more place information (generally, a name of a place) in a region in the map expression data.

[0558] The range similarity condition is a condition related to the relationship between a first range of an area supported by the map photo and a second range of an area supported by the map representation data. The range similarity condition is, for example, (a) the first range is included in the second range, (b) the ratio of the first range included in the second range is greater than or equal to a threshold value or greater than a threshold value, (c) the first range coincides with the second range, (d) the overlapping range of the first range and the second range is greater than or equal to a threshold value or greater than a threshold value, (e) the overlapping range of the first range and the second range is the largest, or (f) a sub-score using information related to the overlap of the first range and the second range is large enough to satisfy the condition. The sub-score can be a value of the ratio of the first range included in the second range, the area of the overlapping range of the first range and the second range, or the like, or a value calculated by an increasing function of the ratio or the area as a parameter.

[0559] The first condition can also be a condition using a sub-score of the degree of satisfaction of two or more of the image similarity condition, the character string similarity condition, and the range similarity condition. The condition using the sub-score is, for example, a condition in which a score obtained using two or three sub-scores is large enough to satisfy a condition decided in advance, all of the two or more sub-scores are greater than or equal to a threshold value. Further, the score obtained using the sub-score is a value calculated by an increasing function of the sub-score as a parameter, for example, a total value of the two or more sub-scores, an average value of the two or more sub-scores, a weighted average of the two or more sub-scores, or the like.

[0560] The decision section G36 decides navigation information satisfying the first condition using one or more of the respective character strings. The use of one or more of the respective character strings is, for example, a case in which one or two of the character string similarity condition and the range similarity condition are used.

[0561] The decision section G36 judges whether or not one or more of the respective character strings coincides with the place information, and decides navigation information satisfying the first condition using a judgment result related to the coincidence of the character string and the place information.

[0562] The decision section G36 decides navigation information corresponding to the region determination information satisfying the first condition with respect to the region determination information acquired by the region determination information acquisition section G33. Further, the region determination information acquisition section G33 acquires the region determination information using the character string acquired by the character string acquisition section G31.

[0563] The decision section G36 preferably cuts out a region of the map from the map photo, acquires a map cutout image, and searches for the navigation information set using the map cutout image, and decides the navigation information to be transmitted. Further, the process of cutting out a region of the map from the map photo is performed using, for example, a contour extraction technique in image processing, and is a publicly known technique. In addition, the map cutout image is also an example of the map photo.

[0564] The decision unit G36 preferably corrects the map cut image to be rectangular, acquires a corrected map image, and uses the corrected map image to search for a set of navigation information, and decides the navigation information to be transmitted. In addition, the map cut image is not always rectangular, and in this case, the decision unit G36 performs a correction process on the map cut image, and acquires a corrected map image that is rectangular (rectangular or square). In addition, the process of correcting a distorted image to be rectangular is a known technique. Further, the corrected map image is also an example of the map photo.

[0565] The decision unit G36 preferably decides, in a case where it fails to decide the navigation information that satisfies the first condition, the navigation information that contains position information indicating a position close to the received terminal position information to satisfy a second condition. In addition, the second condition is, for example, (a) the area supported by the map expression data contains the position of the terminal position information, (b) the position information of the center point of the map expression data is close to the terminal position information to satisfy a condition decided in advance, (c) the area supported by the map expression data contains the position of the terminal position information, and the area supported by the map expression data is wide to be greater than or equal to a threshold value, and the like.

[0566] The cutting unit G361 cuts the area of the map from the map photo, and acquires a map cut image.

[0567] The correction unit G362 corrects the map cut image to be rectangular, and acquires a corrected map image.

[0568] The string judgment unit G363 judges whether or not the one or more respective strings acquired by the string acquisition unit G31 from the map photo, and the one or more respective pieces of location information paired with the map expression data are identical. The string judgment unit G363 can also acquire, as a score related to the similarity of the strings, a string sub-score based on the result of the judgment of whether or not the strings are identical. In addition, in general, the larger the number or the proportion of the identical strings, the higher the string sub-score is. For example, the string sub-score is calculated by an increasing function of the number or the proportion of the identical strings as a parameter.

[0569] The image judgment unit G364 acquires the similarity of the map photo as an image and the map expression data as an image. The image judgment unit G364 can also acquire, as a score related to the similarity of the images, an image sub-score based on the similarity of the images. In addition, in general, the larger the similarity of the images, the higher the image sub-score is. For example, the image sub-score is calculated by an increasing function of the similarity of the images as a parameter.

[0570] The region judging unit G365 acquires information related to the relationship of the first range of the region supported by the map photo and the second range of the region supported by the map expression data. The information related to the relationship is, for example, information indicating whether the first range is contained in the second range, the ratio of the first range contained in the second range, information indicating whether the first range and the second range are identical, information determining the overlapping range of the first range and the second range, a sub-score using information related to the overlap of the first range and the second range. Further, such a sub-score is a range sub-score. The range sub-score is generally higher as the overlapping range of the first range and the second range is larger. The range sub-score is calculated, for example, by taking the value (e.g., area) of the overlapping range of the first range and the second range as a parameter of an increasing function.

[0571] The score acquiring unit G366 calculates the above-described score using two or more sub-scores. The two or more sub-scores are sub-scores acquired by two or more of the string judging unit G363, the image judging unit G364, and the region judging unit G365.

[0572] The deciding unit G367 decides the map expression data similar to the map photo to satisfy the first condition. Further, the similarity is any one or more of the image similarity, the string similarity, and the region similarity. In addition, the first condition is, for example, that the score acquired by the score acquiring unit G366 is the largest, or that the score is greater than or equal to a threshold value or greater than a threshold value. In addition, the first condition is stored in the storage section G1, for example. In addition, the decided map expression data is the same as the decided navigation information.

[0573] The acquiring unit G368 acquires the navigation information containing the map expression data decided by the deciding unit G367 from the navigation information set.

[0574] The transmitting section G4 transmits various information. The various information is, for example, the selection image, the navigation information, and the correspondence information.

[0575] In a case where two or more navigation information are decided by the deciding section G36, the selection image transmitting section G41 transmits two or more selection images to the terminal device H. The selection image is the map expression data or a thumbnail image. The thumbnail image is preferably stored in advance in association with the map expression data. However, it can also be dynamically constructed from the map expression data as needed. The selection image is associated with the image identifier. In addition, the image identifier is generally transmitted together.

[0576] The navigation information transmitting section G42 transmits one or more navigation information decided by the deciding section G36 to the terminal device H. The navigation information transmitting section G42, for example, transmits one or more navigation information acquired by the acquiring unit G368 to the terminal device H. The navigation information transmitting section G42 can also transmit two or more pieces of correspondence information corresponding to the image identifier possessed by the selection instruction to the terminal device H. Further, in this case, the navigation information transmitting section G42 preferably does not transmit the map representation data. In addition, in the case where only the thumbnail image has been transmitted, the map representation data is normally also transmitted.

[0577] The navigation information transmitting section G42 can also transmit the navigation information corresponding to the image identifier possessed by the selection instruction to the terminal device H.

[0578] The navigation information transmitting section G42 can also transmit the current coordinate information to the terminal device H instead of the navigation information. The case where the current coordinate information is transmitted to the terminal device instead of the navigation information is preferably the case where the deciding section G36 cannot decide the navigation information. In addition, the case where the current coordinate information is transmitted to the terminal device instead of the navigation information is the case where the photographed map photo is used in the terminal device H.

[0579] Further, the transmitted navigation information is used for navigation in the terminal device H. The navigation normally means the explicit indication of the current position.

[0580] The terminal storage section Hl constituting the terminal device H stores various information. The various information, for example, means the map photo, the navigation information, and the correspondence information.

[0581] The terminal receiving section H2 receives various instructions and information, and the like. The various instructions, for example, mean the photographing instruction of the photo, the selection instruction, and the transmission instruction. The transmission instruction means the instruction to transmit the map photo.

[0582] The input unit of the various instructions and information, and the like can be any of an input unit based on a touch panel, a keyboard, a mouse, and a menu screen, and the like.

[0583] The terminal processing section H3 performs various processes. The various processes, for example, are the processes performed by the terminal photographing section H31, the terminal clipping section H32, the terminal correcting section H33, the terminal position acquiring section H34, and the terminal coordinate acquiring section H35.

[0584] The various processes, for example, are the process of accumulating the navigation information received by the terminal receiving section H5 to the terminal storage section Hl. The various processes, for example, are the process of constructing the current position added map representation data in which the pattern explicitly indicating the current position is added to the coordinate position indicated by the current coordinate information acquired on the map representation data possessed by the received navigation information. Further, the process of constructing the current position added map representation data is the same as the process performed by the data constructing section D33.

[0585] The terminal photographing section H31 photographs a map photo. The terminal photographing section H31 is realized by, for example, a camera.

[0586] The terminal cutting section H32 cuts a region of the map from the map photo, and acquires a map cut image. The processing of the terminal cutting section H32 is the same as that of the cutting unit G361.

[0587] The terminal correction section H33 corrects the map cut image to be rectangular, and acquires a corrected map image. The processing of the terminal correction section H33 is the same as that of the correction unit G362.

[0588] The terminal position acquiring section H34 acquires current position information. The terminal position acquiring section H34 has, for example, a GPS receiver. The terminal position acquiring section H34 can also acquire the current position information using the electric waves of three or more base stations of a cellular phone. The processing by which the terminal position acquiring section H34 acquires the current position information is not limited.

[0589] The terminal coordinate acquiring section H35 acquires current coordinate information corresponding to the current position information using two or more pieces of correspondence information possessed by the navigation information. The processing of the terminal coordinate acquiring section H35 is the same as that of the current coordinate acquiring section G35.

[0590] The terminal transmitting section H4 transmits the map photo to the map presentation data processing apparatus G. Further, the map photo can be the photographed image as it is after the photographing, or can be the map cut image or the corrected map image.

[0591] The terminal transmitting section H4 transmits the map cut image to the map presentation data processing apparatus G instead of the map photo. Further, the map photo in this case is the photographed image as it is after the photographing.

[0592] The terminal transmitting section H4 transmits the corrected map image to the map presentation data processing apparatus G instead of the map cut image.

[0593] The terminal receiving section H5 receives the navigation information from the map presentation data processing apparatus G. Further, the received navigation information is usually at least temporarily stored in the terminal storage section Hl.

[0594] The terminal outputting section H6 outputs the current position additional map presentation data that indicates the current position on the coordinate position shown by the current coordinate information on the map presentation data possessed by the navigation information.

[0595] Here, the outputting is usually display to a display, but can be considered to include projection using a projector, printing by a printer, sound output, transmission to an external apparatus, accumulation to a recording medium, delivery of the processing result to other processing apparatuses and other programs, and the like.

[0596] The storage section Gl, the navigation information storage section Gl l, and the terminal storage section Hl are preferably nonvolatile recording media, but can also be realized by volatile recording media.

[0597] The process of storing information in the storage section Gl and the like is not limited. For example, information can be stored in the storage section Gl and the like through a recording medium, information transmitted through a communication line and the like can be stored in the storage section Gl and the like, or information input through an input device can be stored in the storage section Gl and the like.

[0598] The reception section G2, the photograph reception section G21, the selection reception section G22, and the terminal reception section H5 are usually realized by a wireless or wired communication unit, but can also be realized by a unit that receives a broadcast.

[0599] The processing section G3, the character string acquisition section G31, the position information acquisition section G32, the region determination information acquisition section G33, the coordinate information acquisition section G34, the current coordinate acquisition section G35, the decision section G36, the clipping unit G361, the correction unit G362, the character string judgment unit G363, the image judgment unit G364, the region judgment unit G365, the score acquisition section G366, the decision unit G367, the acquisition unit G368, the terminal processing section H3, the terminal clipping section H32, the terminal correction section H33, the terminal position acquisition section H34, and the terminal coordinate acquisition section H35 can usually be realized by an MPU and a memory and the like. The processing steps of the processing section G3 and the like are usually realized by software recorded in a recording medium such as a ROM. However, it is also possible to realize them by hardware (a dedicated circuit). Furthermore, it is of course also possible to use other processors such as a CPU and a GPU instead of an MPU.

[0600] The transmission section G4, the selected image transmission section G41, the navigation information transmission section G42, and the terminal transmission section H4 are usually realized by a wireless or wired communication unit, but can also be realized by a broadcast unit.

[0601] The terminal reception section H2 can also be realized by a device driver of an input unit such as a touch panel and a keyboard, and control software of a menu screen and the like.

[0602] It can be considered that the terminal output section H6 includes an output device such as a display and a speaker, and it can also be considered that it does not include them. The terminal output section H6 can also be realized by a driver software of an output device, or a driver software of an output device and an output device and the like.

[0603] Next, the operation of the information system F will be described. First, the operation example of the map expression data processing apparatus G will be described using the flowchart of Figure 50 ​

[0604] (Step S5001) The photo receiving section G21 judges whether or not a map photo is received. In the case where a map photo is received, the process proceeds to step S5002, and in the case where a map photo is not received, the process proceeds to step S5017.

[0605] (Step S5002) The processing section G3 judges whether or not pre-processing is performed. In the case where pre-processing is performed, the process proceeds to step S5003, and in the case where pre-processing is not performed, the process proceeds to step S5005. Further, the processing section G3 judges that pre-processing is not performed in the case where pre-processing is being performed in the terminal device H, and judges that pre-processing is to be performed in the case where pre-processing is not being performed in the terminal device H. A mark indicating this can also be received by the photo receiving section G21 in the case where pre-processing is being performed in the terminal device H. Further, information indicating that pre-processing is performed in the terminal device H can also be included in the received map photo (for example, a header section, a footer section, or the like). Further, it can also be decided in advance whether or not pre-processing is performed.

[0606] (Step S5003) The clipping unit G361 clips a region of a map from the map photo received in step S5001, and acquires a map clip image.

[0607] (Step S5004) The correction unit G362 corrects the map clip image acquired in step S5003 to be rectangular, and acquires a corrected map image. Further, it is assumed that this corrected map image is also a map photo. Further, the map clip image can also be used as a map photo without being corrected.

[0608] (Step S5005) The decision section G36 performs first decision processing that is processing of deciding navigation information using a map photo. The decision section G36 decides one navigation information using the map photo received in step S5001. Figure 51 The flowchart of FIG. 34 is used to explain an example of the first decision processing.

[0609] (Step S5006) The decision section G36 judges whether or not one navigation information is decided in step S5005. In the case where one navigation information is decided, the process proceeds to step S5007, and in the case where one navigation information is not decided, the process proceeds to step S5009.

[0610] (Step S5007) The decision section G36 acquires one navigation information decided in step S5005 from the navigation information storage section G11.

[0611] (Step S5008) The navigation information sending section G42 sends one navigation information acquired by the decision section G36 in step S5007 to the terminal device H. The process returns to step S5001.

[0612] (Step S5009) The decision section G36 determines whether two or more navigation information are decided in step S5005. In the case where two or more navigation information are decided, the process proceeds to step S5010, and in the case where no navigation information is decided, the process proceeds to step S5012.

[0613] (Step S5010) The decision section G36 acquires map expression data included in each of the two or more navigation information decided in step S5005, or a thumbnail image of the map expression data. Further, such map expression data or thumbnail image is a selection image.

[0614] (Step S5011) The selection image transmission section G41 transmits the two or more selection images acquired in step S5010 to the terminal device H. The process returns to step S5001. Further, the selection image transmission section G41 normally also transmits an image identifier in association with each of the two or more selection images to the terminal device H. The image identifier is information capable of identifying the selection image, such as an ID of the navigation information, an ID of the map expression data, or an ID of the thumbnail image.

[0615] (Step S5012) The decision section G36 determines whether the received map photo is used in the terminal device H. In the case where the map photo is used, the process proceeds to step S5013, and in the case where the map photo is not used, the process proceeds to step S5015.

[0616] (Step S5013) The processing section G3 acquires one or more corresponding information corresponding to the map photo.

[0617] (Step S5014) The navigation information transmission section G42 transmits the one or more corresponding information acquired in step S5013 to the terminal device H. The process returns to step S5001.

[0618] (Step S5015) The decision section G36 determines whether to decide the navigation information using the current position information. In the case where the current position information is used, the process proceeds to step S5016, and in the case where the current position information is not used, the process returns to step S5001. Further, at this time, it is preferable to transmit error information to the terminal device H.

[0619] (Step S5016) The decision section G36 performs a second decision process as a process of deciding the navigation information using the current position information. The process of the second decision process is described using the flowchart of Fig. 17. Figure 52

[0620] (Step S5017) The selection reception section G22 determines whether a selection instruction is received. In the case where the selection instruction is received, the process proceeds to step S5018, and in the case where no selection instruction is received, the process returns to step S5001.

[0621] ​The determination section G36 acquires the image identifier included in the selection instruction received in step S5017.

[0622] In step S5019, the determination section G36 acquires one or more pieces of correspondence information corresponding to the image identifier from the navigation information storage section G11. Alternatively, the determination section G36 can acquire navigation information corresponding to the image identifier from the navigation information storage section G11.

[0623] In step S5020, the navigation information transmission section G42 transmits the one or more pieces of correspondence information acquired in step S5019 to the terminal device H. The process returns to step S5001. Alternatively, the navigation information corresponding to the image identifier can be transmitted to the terminal device H.

[0624] In the flowchart of FIG. 17, the process is ended by the power-off interrupt and the process end interrupt. Figure 50

[0625] Next, an example of the first determination process of step S5005 will be described using the flowchart of FIG. 18. Figure 51

[0626] In step S5101, the determination section G36 determines whether the first condition includes the image similarity condition. If the image similarity condition is included, the process proceeds to step S5102. If the image similarity condition is not included, the process proceeds to step S5106.

[0627] In step S5102, the determination section G36 assigns 1 to the counter i.

[0628] In step S5103, the determination section G36 determines whether the i-th map expression data exists in the navigation information storage section G11. If the i-th map expression data exists, the process proceeds to step S5104. If the i-th map expression data does not exist, the process proceeds to step S5106.

[0629] In step S5104, the determination section G36 acquires the image similarity, which is the similarity between the map photo as an image and the i-th map expression data as an image, and temporarily stores it in association with the i-th map expression data. Alternatively, the image similarity can be an image sub-score.

[0630] In step S5105, the determination section G36 increments the counter i by 1. The process returns to step S5103.

[0631] In step S5106, the determination section G36 determines whether the first condition includes the character string similarity condition. If the character string similarity condition is included, the process proceeds to step S5107. If the character string similarity condition is not included, the process proceeds to step S5113.

[0632] ​​(Step S5107) The string acquisition section G31 performs character recognition processing on the map photo, and acquires a string set as a set of one or more strings. Also, here, it is preferable to judge whether or not it is a string of a certain place by the classification section C32, and to acquire only the string of a certain place. In addition, it is preferable to perform processing by the position information acquisition section G32 and the grouping section C33, and to exclude a string corresponding to position information of a place not located in the map photo.

[0633] (Step S5108) The decision section G36 assigns 1 to the counter i.

[0634] (Step S5109) The decision section G36 judges whether or not the i-th map expression data exists in the navigation information storage section G11. In the case where the i-th map expression data exists, it proceeds to step S5110, and in the case where it does not exist, it proceeds to step S5113.

[0635] (Step S5110) The decision section G36 acquires one or more pieces of position information paired with the i-th map expression data from the navigation information storage section G11. Also, the one or more pieces of position information are the string set of the i-th map expression data.

[0636] (Step S5111) The decision section G36 acquires a string similarity as a degree of similarity of the string set of the map photo and the string set of the i-th map expression data, and temporarily stores it in association with the i-th map expression data. Also, the string similarity can be a string sub-score.

[0637] (Step S5112) The decision section G36 increments 1 to the counter i. It returns to step S5109.

[0638] (Step S5113) The decision section G36 judges whether or not the first condition includes the range similarity condition. In the case where the range similarity condition is included, it proceeds to step S5114, and in the case where it is not included, it proceeds to step S5121.

[0639] (Step S5114) The string acquisition section G31 performs character recognition processing on the map photo, and acquires a string set as a set of one or more strings.

[0640] (Step S5115) The region determination information acquisition section G33 acquires region determination information of the map photo using the string set. The region determination processing involved is, for example, processing of Figure 10 , Figure 25 .

[0641] (Step S5116) The decision section G36 assigns 1 to the counter i.

[0642] (Step S5117) The decision section G36 determines whether or not the i-th map expression data exists in the navigation information storage section Gl l. In the case where the i-th map expression data exists, the process proceeds to step S5118, and in the case where it does not exist, the process proceeds to step S5121.

[0643] (Step S5118) The decision section G36 acquires the region determination information of the i-th map expression data from the navigation information storage section Gl l.

[0644] (Step S5119) The decision section G36 acquires the similarity of the two region determination information, and temporarily accumulates the range similarity in association with the i-th map expression data. Further, the range similarity can be a range sub-score.

[0645] (Step S5120) The decision section G36 increments the counter i by 1. The process returns to step S5117.

[0646] (Step S5121) The decision section G36 uses the image similarity, the character string similarity, and the range similarity in association with each map expression data, and determines whether or not it coincides with the first condition on a map expression data unit basis, and decides the navigation information including the coincident map expression data.

[0647] Next, an example of the second decision process of step S5016 will be described using the flowchart of Figure 52

[0648] (Step S5201) The decision section G36 acquires the received current position information.

[0649] (Step S5202) The decision section G36 assigns 1 to the counter i.

[0650] (Step S5203) The decision section G36 determines whether or not the i-th navigation information exists in the navigation information storage section Gl l. In the case where the i-th navigation information exists, the process proceeds to step S5204, and in the case where it does not exist, the process proceeds to step S5207.

[0651] (Step S5204) The decision section G36 acquires the region determination information corresponding to the i-th navigation information.

[0652] (Step S5205) The decision section G36 acquires one or more feature amounts using the region determination information corresponding to the i-th navigation information and the current position information, and temporarily accumulates them in association with the i-th navigation information. Further, the feature amounts are, for example, the distance of the center point of the region determination information from the current position information, whether or not the position indicated by the current position information is included in the region indicated by the region determination information, the width of the region indicated by the region determination information, and the coordinate information corresponding to the current position information in the region indicated by the region determination information. ​

[0653] (Step S5206) The decision section G36 increments the counter i by 1. The process returns to Step S5203.

[0654] (Step S5207) The decision section G36 decides one or more pieces of navigation information in which the one or more features acquired in Step S5205 coincide with the second condition. The process returns to the parent process. Further, the decision section G36, for example, decides one or more pieces of navigation information in which a position indicated by the current position information is included in a region indicated by the region determination information, and a distance between a center point of the region determination information and the current position information is equal to or less than a threshold value or is less than the threshold value.

[0655] Next, an example of the operation of the terminal device H will be described using the flowchart of Figure 53

[0656] (Step S5301) The terminal reception section H2 determines whether or not a photographing instruction has been received. In the case where the photographing instruction has been received, the process proceeds to Step S5302, and in the case where the photographing instruction has not been received, the process returns to Step S5301.

[0657] (Step S5302) The terminal photographing section H31 photographs a picture, acquires a map picture, and temporarily stores the map picture in a buffer.

[0658] (Step S5303) The terminal reception section H2 determines whether or not a transmission instruction has been received. In the case where the transmission instruction has been received, the process proceeds to Step S5304, and in the case where the transmission instruction has not been received, the process returns to Step S5303.

[0659] (Step S5304) The terminal position acquisition section H34 acquires current position information.

[0660] (Step S5305) The terminal clipping section H32 clips a region of a map from the map picture in the buffer, and acquires a map clip image.

[0661] (Step S5306) The terminal correction section H33 corrects the map clip image acquired in Step S5305 to be rectangular, and acquires a corrected map image. Further, the corrected map image is also a map picture.

[0662] (Step S5307) The terminal transmission section H4 transmits the map picture acquired in Step S5306 and the current position information to the map presentation data processing device G. Further, the processes of Step S5305 and Step S5306 are optional. Also, in the case where the processes of Step S5305 and Step S5306 are not performed, the terminal transmission section H4 transmits the map picture stored in the buffer in Step S5302 and the current position information to the map presentation data processing device G.

[0663] ​(Step S5308) The terminal receiving section H5 judges whether or not information is received from the map expression data processing apparatus G. In the case where information is received, the process proceeds to step S5309, and in the case where information is not received, the process returns to step S5308.

[0664] (Step S5309) The terminal processing section H3 judges whether or not the information received in step S5308 is two or more selection images. If it is two or more selection images, the process proceeds to step S5310, and if it is not two or more selection images, the process proceeds to step S5314.

[0665] (Step S5310) The terminal outputting section H6 outputs the two or more selection images received.

[0666] (Step S5311) The terminal accepting section H2 judges whether or not an instruction for one selection image is accepted. In the case where an instruction is accepted, the process proceeds to step S5312, and in the case where an instruction is not accepted, the process returns to step S5311.

[0667] (Step S5312) The terminal processing section H3 constructs a selection instruction transmitted as an instruction including an image identifier corresponding to the instruction accepted in step S5311. The terminal transmitting section H4 transmits the selection instruction including the image identifier to the map expression data processing apparatus G.

[0668] (Step S5313) The terminal receiving section H5 judges whether or not one navigation information is received from the map expression data processing apparatus G. In the case where one navigation information is received, the process proceeds to step S5314, and in the case where one navigation information is not received, the process returns to step S5313.

[0669] (Step S5314) The terminal position acquiring section H34 acquires current position information.

[0670] (Step S5315) The terminal coordinate acquiring section H35 acquires current coordinate information corresponding to the current position information acquired in step S5314 using two or more correspondence information possessed by the navigation information received in step S5313.

[0671] (Step S5316) The terminal processing section H3 constructs current position added map expression data in which a pattern indicating a current position is added to a coordinate position indicated by the current coordinate information of the map expression data possessed by the navigation information received by step S5313.

[0672] (Step S5317) The terminal outputting section H6 outputs the current position added map expression data constructed in step S5316.

[0673] (Step S5318) The terminal processing unit H3 determines whether to end the output of the current location's additional map display data. If the output is complete, it returns to step S5301; otherwise, it returns to step S5314. Furthermore, in the case of completion, it is usually the case that the terminal receiving unit H2 has received a completion instruction from the user.

[0674] (Step S5319) The terminal receiving unit H5 determines whether it has received navigation information from the map display data processing device G. If navigation information has been received, proceed to step S5314; otherwise, proceed to step S5320.

[0675] (Step S5320) The terminal receiving unit H5 determines whether it has received an error message from the map display data processing device G. If an error message has been received, proceed to step S5321; otherwise, return to step S5301.

[0676] (Step S5321) The terminal output unit H6 outputs the received error information. Return to step S5301. Furthermore, the content of the error information is not limited. For example, the error information may indicate that navigation information could not be obtained.

[0677] The following describes specific operational examples of the information system F in this embodiment. The conceptual diagram of the information system F is as follows: Figure 47 .

[0678] Now, assume that the navigation information storage unit G11 of the map display data processing device G stores... Figure 54 The navigation information management table shown is a table that stores two or more records with "ID", "Navigation Information", "Region Determination Information", and "Thumbnail Image". "Navigation Information" contains "Map Representation Data" and two or more "Corresponding Information". "Corresponding Information" contains "Coordinate Information" and "Location Information". Here, "Region Determination Information" determines the area supported by the map representation data; it is the top-left (latitude, longitude) and bottom-right (latitude, longitude) location information of the map representation data, which is represented as a rectangle. That is, the P1(X) record of "ID=1"... P1 Y P1 ) represents the top-left position information, P2(X) P2 Y P2 The bottom right corner is the location information. Additionally, the attribute value for "Map Representation Data" is the file name or filename of the map representation data. Furthermore, "Thumbnail Image" is a thumbnail image of the map representation data, which is assumed to have been pre-stored.

[0679] In this scenario, suppose a user is visiting a tourist attraction, launches a map display data application on terminal device H, and uses the camera function of terminal device H to take a picture of the map set up at the bus stop. Figure 55 (5501). Next, the terminal imaging unit H31 of the terminal device H captures and obtains map photos ( Figure 56 Furthermore, assuming that the terminal location acquisition unit H34 of the terminal device H obtains the current location information (X) of the terminal. t Y t ).

[0680] Furthermore, immediately after the image is taken, the terminal sending unit H4 sends the map image to the map display data processing device G. Figure 56 ) and current location information (X) t Y t Furthermore, if preprocessing is performed by the terminal clipping unit H32 and the terminal correction unit H33 of the terminal device H, a flag indicating that preprocessing is complete is sent to the map display data processing device G. However, it is assumed here that no preprocessing is performed.

[0681] Next, the photo receiving unit G21 of the map rendering data processing device G receives... Figure 56 Map photos and current location information (X t Y t Next, the processing unit G3 determines that it has not received a flag indicating that preprocessing is complete, and decides that preprocessing should proceed.

[0682] Next, the shear unit G361 from Figure 56 The map image is obtained by cropping a region from a map photograph. Additionally, the correction unit G362 corrects the obtained map crop image into a rectangle. Figure 57 The corrected map image. Alternatively, the corrected map image can also be referred to as a map photograph.

[0683] Next, let's assume that decision-making unit G36 uses a pre-processed map photograph ( Figure 57 The first decision process, which determines the navigation information, identifies three navigation parameters. Details of this first decision process have already been described above, and therefore will not be repeated here.

[0684] Next, it was decided that the G36 would be subject to the navigation information management table ( Figure 54 The selected image is obtained as a thumbnail image included in the three navigation information determined.

[0685] Next, the processing section G3 constructs information of a selection screen including the three selection images acquired. Also, the selection image transmission section G41 transmits the information of the selection screen to the terminal device H. Further, the information of the selection screen is described by, for example, HTML, XML, or the like.

[0686] Next, the terminal reception section H5 of the terminal device H receives the information of the selection screen. Also, the terminal processing section H3 constructs a selection screen using the received information of the selection screen. Next, the terminal output section H6 outputs the selection screen as shown in Figure 58 .

[0687] Next, it is assumed that the user selects one selection image 5801 from the three selection images. At this time, the terminal reception section H2 of the terminal device H receives the selection instruction. Also, the terminal processing section H3 constructs a selection instruction having the image identifier of the selection image 5801. Next, the terminal transmission section H4 transmits the selection instruction to the map expression data processing device G.

[0688] Next, the selection reception section G22 of the map expression data processing device G receives the selection instruction. Next, the decision section G36 acquires the image identifier included in the received selection instruction. Further, the decision section G36 acquires the navigation information corresponding to the image identifier from the navigation information management table. Next, the navigation information transmission section G42 transmits the acquired navigation information to the terminal device H.

[0689] Next, the terminal reception section H5 of the terminal device H receives one navigation information. Also, the terminal position acquisition section H34 acquires the current position information. Next, the terminal coordinate acquisition section H35 acquires the current coordinate information corresponding to the acquired current position information using the two or more corresponding information included in the received navigation information. Next, the terminal processing section H3 constructs the current position added map expression data in which a pattern indicating the current position is added to the coordinate position indicated by the current coordinate information of the map expression data included in the received navigation information. Next, the terminal output section H6 outputs the constructed current position added map expression data. Further, this output example is Figure 59 . Further, the pattern 5901 indicates the current position.

[0690] According to the present embodiment, the navigation using the map expression data acquired using the photographed map photo can be implemented.

[0691] Further, according to the present embodiment, the appropriate map expression data can be selected with high precision by performing the pre-processing on the photographed map photo.

[0692] Further, according to the present embodiment, the map expression data that the user likes can be selected from two or more map expression data corresponding to the photographed map photo. Further, according to the present embodiment, the map expression data that the user likes can be selected from two or more map expression data corresponding to the photographed map photo.

[0693] Further, according to the present embodiment, it is possible to achieve navigation using a photographed map photo by automatically acquiring corresponding information corresponding to the photographed map photo and transmitting the corresponding information to the terminal device H.

[0694] Further, the processing in the present embodiment can also be implemented by software. Moreover, the software can be distributed by software download or the like. In addition, the software can be distributed by being recorded on a recording medium such as a CD-ROM. Further, the software implementing the map representation data processing device G in the present embodiment is a program as follows. That is, the program is a program for causing a computer to function as a photo receiving section that receives a photographed map photo from a terminal device; a decision section that searches for a set of navigation information having two or more navigation information that has two or more corresponding information of a set of coordinate information and position information in map representation data as any of a pictorial map, a hand-drawn map, and an outline map and map representation data having a relationship satisfying a first condition with the map photo; and a navigation information transmitting section that transmits the navigation information decided by the decision section to the terminal device.

[0695] In addition, the software implementing the terminal device H is a program as follows. That is, the program is a program for causing a computer to function as a terminal photographing section that photographs a map photo; a terminal transmitting section that transmits the map photo to a map representation data processing device; a terminal receiving section that receives navigation information from the map representation data processing device; a terminal position acquiring section that acquires current position information; a terminal coordinate acquiring section that acquires current coordinate information corresponding to the current position information using two or more corresponding information possessed by the navigation information; and a terminal output section that outputs current position additional map representation data that indicates a current position at a coordinate position shown by the current coordinate information on map representation data possessed by the navigation information.

[0696] In addition, Figure 60 An appearance of a computer that executes a program stated in the present specification, and realizes the map representation data processing device C and the like of the above-described embodiments is shown. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. Figure 60 is an overview of the computer system 300, Figure 61 is a block diagram of the system 300.

[0697] In Figure 60 , the computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

[0698] In Figure 61In this computer 301, in addition to the CD-ROM drive 3012, it also includes an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012, a ROM 3015 for storing programs such as boot programs, a RAM 3016 connected to the MPU 3013 for temporarily storing application commands and providing temporary storage space, and a hard disk 3017 for storing applications, system programs, and data. Although not shown here, the computer 301 may further include a network card providing a connection to a LAN.

[0699] The program that enables the computer system 300 to perform the functions of the map rendering data processing device G, etc., as described above, can also be stored in CD-ROM 3101 and inserted into CD-ROM drive 3012 for further transfer to hard disk 3017. Alternatively, the program can also be sent to computer 301 via a network (not shown) and stored in hard disk 3017. The program is loaded into RAM 3016 during execution. The program can also be loaded directly from CD-ROM 3101 or via a network.

[0700] The program may not include an operating system (OS) or a third-party program that enables the computer 301 to perform the functions of the map representation data processing device G, etc., as described above. The program may also call appropriate functions (modules) in a controlled manner and contain only the command portion to obtain the desired result. How the computer system 300 operates is well-known, and detailed descriptions are omitted.

[0701] Furthermore, the above procedure does not include hardware-based processing, such as processing via a modem and interface card in the sending step or the receiving step (processing performed only by hardware).

[0702] Furthermore, the computers executing the above programs can be a single computer or multiple computers. That is, they can perform centralized processing or distributed processing.

[0703] Furthermore, in the above embodiments, two or more communication units existing in a device can also be physically one.

[0704] Furthermore, in the above embodiments, each process can be implemented either centrally by a single device or distributed by multiple devices. In other words, the map representation data processing device G, etc., can also operate as a standalone unit.

[0705] This invention is not limited to the above-described embodiments and various modifications can be made; naturally, these modifications are also included within the scope of this invention.

[0706] Industrial applicability

[0707] As above, the map expression data processing apparatus to which the present application relates has the effect that coordinate information of a place name or the like on map expression data can be automatically acquired in association with position information, and is useful as a map expression data processing apparatus or the like.

[0708] Explanation of reference numerals

[0709] A: learning apparatus

[0710] B: classification apparatus

[0711] C, D, E, G: map expression data processing apparatus

[0712] F: information system

[0713] H: terminal apparatus

[0714] A1, B1, C1, D1, G1: storage section

[0715] A2, B2, C2, D2: reception section

[0716] A3, B3, C3, D3, E3, G3: processing section

[0717] A4, B4, C4, D4, E4: output section

[0718] G2: reception section

[0719] G4: transmission section

[0720] A11: learning source information storage section

[0721] A12: learner storage section

[0722] A31: learning section

[0723] A41: accumulation section

[0724] B21: character string reception section

[0725] B31: classification section

[0726] B41: label output section

[0727] C11: place dictionary storage section

[0728] C12: map expression data storage section

[0729] C13: accurate map information storage section

[0730] C14: correspondence information storage section

[0731] C21: map expression data accepting section

[0732] C31, G31: string obtaining section

[0733] C32: classification section

[0734] C33: grouping section

[0735] C34: feature place detecting section

[0736] C35, G34: coordinate information obtaining section

[0737] C36, G32: position information obtaining section

[0738] C37, G33: area determination information obtaining section

[0739] C38: orientation information obtaining section

[0740] C41: correspondence output section

[0741] C42: accurate map information output section

[0742] C43: orientation information output section

[0743] C371: first area determination information obtaining unit

[0744] C372: outside string determining unit

[0745] C373: size information obtaining unit

[0746] C374: distance information obtaining unit

[0747] C375: second area determination information obtaining unit

[0748] D31, G35: current position information obtaining section

[0749] D32: coordinate information obtaining section

[0750] D33: data constructing section

[0751] D41: map expression data output section

[0752] E31: relationship information obtaining section

[0753] E32: correspondence information obtaining section

[0754] E33: scale obtaining section

[0755] E34: area determination information obtaining section

[0756] E35: additional place obtaining section

[0757] E36: additional position acquisition section

[0758] E37: additional coordinate acquisition section

[0759] E38: place recording section

[0760] E39: orientation information acquisition section

[0761] E41: correspondence output section

[0762] E42: scale information output section

[0763] E43: region determination information output section

[0764] E44: orientation information output section

[0765] E321: determination unit

[0766] E322: correspondence information acquisition unit

[0767] G11: navigation information storage section

[0768] G21: photo reception section

[0769] G22: selection reception section

[0770] G36: determination section

[0771] G41: selected image transmission section

[0772] G42: navigation information transmission section

[0773] G361: cutting unit

[0774] G362: correction unit

[0775] G363: character string determination unit

[0776] G364: image determination unit

[0777] G365: region determination unit

[0778] G366: score acquisition unit

[0779] G367: determination unit

[0780] G368: acquisition unit

[0781] H1: terminal storage section

[0782] H2: terminal reception section

[0783] H3: terminal processing section

[0784] H4: terminal transmission section

[0785] H5: terminal receiving section

[0786] H6: terminal output section

[0787] H31 : terminal photographing section

[0788] H32: terminal cutting section

[0789] H33: terminal correcting section

[0790] H34: terminal position obtaining section

[0791] H35: terminal coordinate obtaining section

Claims

1. A map representation data processing device, comprising: The photo receiving unit receives captured map photos from the terminal device; The decision unit, based on a set of navigation information containing two or more navigation information pieces, determines navigation information having map representation data that is similar to the map photograph to the point of satisfying a first condition. The navigation information has two or more corresponding pieces of information, which are groups of coordinate information and location information in the map representation data, and the map representation data is any one of a graphic map, a hand-drawn map, or a sketch map. The navigation information sending unit sends the navigation information determined by the decision unit to the terminal device. The photo receiving unit also receives terminal location information that determines the current location of the terminal device. If the decision-making unit fails to determine navigation information that satisfies the first condition, it determines navigation information that includes location information indicating a location that is close enough to the terminal location information to satisfy the second condition. The decision-making unit has the following features: The decision unit determines map representation data that is similar to the map photograph to satisfy the first condition; and The acquisition unit acquires navigation information from the navigation information set, including map representation data determined by the decision unit. The navigation information sending unit sends the navigation information obtained by the acquisition unit to the terminal device. The first condition has one or more of the following conditions: image similarity condition, string similarity condition, and range similarity condition. The image similarity condition is a condition related to the similarity between the map photograph and the map representation data as an image. The string similarity condition is a condition related to the degree of consistency between a first set of strings representing one or more strings displayed in the map photograph and a second set of strings representing one or more strings corresponding to the map representation data. The range similarity condition is a condition related to the relationship between a first range of the area supported by the map photograph and a second range of the area supported by the map representation data.

2. The map representation data processing apparatus according to claim 1, wherein, Furthermore, it includes a string acquisition unit, which acquires one or more strings from the map image. The decision unit uses one or more of the strings to determine navigation information that satisfies the first condition.

3. The map representation data processing apparatus according to claim 2, wherein, Location name information is stored in association with the corresponding information. The decision unit determines whether one or more of the strings are consistent with the name information, and uses the determination result related to the consistency between the strings and the name information to determine the navigation information that satisfies the first condition.

4. The map representation data processing apparatus according to claim 2, wherein, Corresponding to the navigation information, area determination information is stored in association with the area covered by the map representation data. The string acquisition unit obtains three or more strings from the map image. Further features include: The location information acquisition unit uses a location dictionary with more than one location location information to acquire location information corresponding to the location information of three or more strings acquired by the string acquisition unit, wherein the location location information is information that associates the location information of a determined location with the location information of the determined location; and The region determination information acquisition unit uses three or more location information points obtained by the location information acquisition unit to obtain region determination information that determines the area covered by the map photograph. The decision unit determines navigation information corresponding to the region determination information obtained by the region determination information acquisition unit that satisfies the first condition.

5. The map representation data processing apparatus according to claim 1, wherein, The decision unit obtains a cut map image by cropping a region from the map photograph, and uses the cut map image to retrieve a set of navigation information with two or more navigation information, and decides on the navigation information to be sent. The navigation information has map representation data and two or more corresponding information as a group of coordinate information and location information in the map representation data.

6. The map representation data processing apparatus according to claim 5, wherein, The decision unit corrects the cropped map image into a rectangle, obtains a corrected map image, and uses the corrected map image to retrieve a set of navigation information with two or more navigation information, and determines the navigation information to be sent. The navigation information has map representation data and two or more corresponding information that are groups of coordinate information and location information in the map representation data.

7. The map representation data processing apparatus according to claim 1, further comprising: The image sending unit selects two or more images, which are map representation data or thumbnail images of the map representation data, as each of the two or more navigation information pieces, when the decision unit determines two or more navigation information pieces; and sends these images to the terminal device. The selection receiving unit receives a selection instruction from the terminal device, which includes an image identifier for recognizing the selected image. The navigation information sending unit sends two or more corresponding information pairs to the terminal device, which are paired with the image identifiers of the selection indication.

8. The map representation data processing apparatus according to claim 1, wherein, The photo receiving unit also receives terminal location information that determines the current location of the terminal device. Further features include: The string acquisition unit retrieves three or more strings from the map image. The coordinate information acquisition unit acquires the coordinate information of three or more of the aforementioned strings; The location information acquisition unit uses a location dictionary with more than one location location information to acquire location information corresponding to each of the three or more strings, wherein the location location information is information that associates the location information of a determined location with the location information of the determined location. as well as The current coordinate acquisition unit uses three or more corresponding pieces of information, which are groups of coordinate information and position information, and the terminal position information, to obtain current coordinate information that determines the coordinates corresponding to the terminal position information. The navigation information sending unit replaces the navigation information and sends the current coordinate information to the terminal device.

9. An information system, comprising: The map representation data processing apparatus according to any one of claims 1 to 8; as well as Terminal device, the terminal device comprising: Terminal photography unit, taking photos of maps; The terminal transmitting unit sends the map image to the map display data processing device; The terminal receiving unit receives navigation information from the map display data processing device; The terminal location acquisition unit obtains the current location information; The terminal coordinate acquisition unit uses two or more corresponding pieces of information contained in the navigation information to obtain current coordinate information corresponding to the current position information; as well as The terminal output unit outputs additional map display data for the current location, which is indicated by the coordinates shown in the current coordinate information, on top of the map display data in the navigation information.

10. The information system according to claim 9, wherein, The terminal device further includes a terminal cropping unit, which crops a region of the map from the map photograph to obtain a cropped map image. The terminal sending unit replaces the map photograph and sends the map cropping image to the map display data processing device.

11. The terminal device according to claim 10, wherein, The terminal device further includes a terminal correction unit, which corrects the cropped map image into a rectangle to obtain a corrected map image. The terminal sending unit replaces the map cropping image and sends the corrected map image to the map representation data processing device.

12. An information processing method, implemented through a photo receiving unit, a decision unit, and a navigation information sending unit, comprising: In the photo receiving step, the photo receiving unit receives the captured map photos from the terminal device; The decision step involves the decision unit determining, based on a set of navigation information containing two or more navigation information pieces, navigation information that has map representation data similar to the map photograph to the point of satisfying a first condition. The navigation information has two or more corresponding pieces of information, which are groups of coordinate and location information within the map representation data, and the map representation data can be any of a graphic map, a hand-drawn map, or a sketch map. The navigation information sending step involves the navigation information sending unit sending the navigation information determined by the decision unit to the terminal device. In the photo receiving step, terminal location information that determines the current location of the terminal device is also received, and In the decision-making step, if navigation information that satisfies the first condition cannot be determined, navigation information that includes location information indicating a location that is close enough to the terminal location information to satisfy the second condition is determined. The decision-making steps include: The decision operation determines map representation data that is similar to the map photograph to satisfy the first condition; and The operation retrieves navigation information from the navigation information set, including map representation data determined by the decision operation. In the navigation information sending step, the navigation information obtained by the acquisition operation is sent to the terminal device. The first condition has one or more of the following conditions: image similarity condition, string similarity condition, and range similarity condition. The image similarity condition is a condition related to the similarity between the map photograph and the map representation data as an image. The string similarity condition is a condition related to the degree of consistency between a first set of strings representing one or more strings displayed in the map photograph and a second set of strings representing one or more strings corresponding to the map representation data. The range similarity condition is a condition related to the relationship between a first range of the area supported by the map photograph and a second range of the area supported by the map representation data.

13. A recording medium storing a program, said program being used to enable a computer to function as: The photo receiving unit receives captured map photos from the terminal device; The decision unit, based on a set of navigation information containing two or more navigation information pieces, determines navigation information that has map representation data similar to the map photograph to the point of satisfying a first condition. The navigation information has two or more corresponding pieces of information, which are groups of coordinate information and location information in the map representation data, and the map representation data is any of a graphic map, a hand-drawn map, or a sketch map. The navigation information sending unit sends the navigation information determined by the decision unit to the terminal device. The photo receiving unit also receives terminal location information that determines the current location of the terminal device. If the decision-making unit fails to determine navigation information that satisfies the first condition, it determines navigation information that includes location information indicating a location that is close enough to the terminal location information to satisfy the second condition. The decision-making unit has the following features: The decision unit determines map representation data that is similar to the map photograph to satisfy the first condition; and The acquisition unit acquires navigation information from the navigation information set, including map representation data determined by the decision unit. The navigation information sending unit sends the navigation information obtained by the acquisition unit to the terminal device. The first condition has one or more of the following conditions: image similarity condition, string similarity condition, and range similarity condition. The image similarity condition is a condition related to the similarity between the map photograph and the map representation data as an image. The string similarity condition is a condition related to the degree of consistency between a first set of strings representing one or more strings displayed in the map photograph and a second set of strings representing one or more strings corresponding to the map representation data. The range similarity condition is a condition related to the relationship between a first range of the area supported by the map photograph and a second range of the area supported by the map representation data.

Images