Information processing device, information processing device control method and program

Abstract

To provide an information processing device that can explore routes suitable for a three-dimensional movement of a user in a cyber urban space.SOLUTION: A head-mounted display (HMD) 100 comprises: 3D urban model information acquisition means 201 of acquiring 3D urban model information on a cyber urban space where a plurality of CG objects exists; user information acquisition means 202 of acquiring user information; route exploration networking means 203 of using the 3D urban model information to network a route exploration network 300, calculating at least a score Sv based on easiness of viewing of the CG object, and a score Su based on preference of a user to the CG object by use of the 3D urban model information, and user information, and thereby setting a link score Score; and route exploration means 206 of, in the route exploration network 300, exploring a route from a departure location to a destination location, using the link score Score.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a control method for the information processing apparatus, and a program.

Background Art

[0002] In recent years, due to the recording of various urban activity data in the real world in the virtual space, a high degree of integration of the physical space (real space) and the cyber space (virtual space) has been realized. As an example of such a high degree of integration, the Ministry of Land, Infrastructure, Transport and Tourism has been promoting the development of 3D city models, which are 3D urban space information platforms that reproduce the urban space itself in the virtual space. Hereinafter, the urban space reproduced in the virtual space will be referred to as "virtual urban space". Urban activity information such as names, tags, pedestrian flow, and traffic volume is assigned to CG objects such as buildings and roads existing in the virtual urban space in the 3D city model. Furthermore, by utilizing such 3D city models, applications (hereinafter referred to as "urban exploration applications") that allow users to explore the virtual urban space have been created. In this regard, in a vast virtual urban space, if means are provided for users to move up and down, left and right, and back and forth in the air, users can view the CG objects existing in the virtual urban space from various angles.

[0003] However, the operation of moving in the air, that is, the three-dimensional movement operation, is generally not an intuitive operation. For example, changing the left and right directions and the forward and backward movement operations are performed by left-clicking and dragging the mouse, and the up and down movement operation is performed by right-clicking and dragging the mouse. That is, the three-dimensional movement operation is performed by combining a plurality of operations. Therefore, it is difficult for users to perform the three-dimensional movement operation intuitively, and if they concentrate on the operation, they cannot enjoy the original exploration experience. Therefore, in urban exploration applications and the like, a path in the air is created, and by allowing the user to move along that path, the complexity of the three-dimensional movement operation is reduced.

[0004] For example, Patent Document 1 discloses a technique for searching for a flight route in an aerial network for drones, which consists of a plurality of nodes provided in a three-dimensional space and links connecting the nodes. In the technique disclosed in Patent Document 1, the cost of a link is determined based on the ease of drone flight, such as population density, the presence or absence of buildings, whether it is a flyable area, and weather information. Furthermore, the flight route is determined to pass through links with a low total cost.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, even if a technique for searching for a flight route for a drone is used, there is a problem that it is difficult to search for an aerial movement route suitable for the user's roaming experience in a virtual urban space.

[0007] The present invention has been made in view of the above problems. An object of the present invention is to provide an information processing apparatus, a control method for the information processing apparatus, and a program that can search for a route suitable for three-dimensional movement of a user in a virtual urban space.

Means for Solving the Problems

[0008] In order to achieve the above object, an information processing apparatus according to the present invention is information about a virtual urban space in which a plurality of CG objects exist, and includes 3D urban model information including the attached information possessed by each of the plurality of CG objects. A first information acquisition means for acquiring; a construction means for constructing a path search network composed of a plurality of nodes and a plurality of links in a three-dimensional space in the virtual urban space using the 3D urban model information; and a user for acquiring user information about the user's preferences. A second information acquisition means; using the 3D urban model information and the user information, for each of the plurality of links, at least a first score based on the visibility of CG objects near the link and a second score based on the user's preference for CG objects near the link. A setting means for setting a link score by calculating; a first position acquisition means for acquiring a starting position; a second position acquisition means for acquiring a destination position; and in the path search network, a path from the starting position to the destination position is determined by using the link score. And a path search means for searching.

Effect of the Invention

[0009] According to the present invention, it is possible to search for a path suitable for three-dimensional movement of a user in a virtual urban space.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Modes for Carrying Out the Invention

[0011] Hereinafter, each embodiment of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in each embodiment. For example, each part constituting the present invention can be replaced with any configuration that can exhibit the same function. Also, any component may be added. Further, any two or more configurations (features) among the embodiments can be combined.

[0012] <First Embodiment> Hereinafter, a first embodiment will be described with reference to FIGS. 1 to 9. FIG. 1 is a block diagram showing an example of the hardware configuration of the HMD 100 according to the first embodiment. As shown in FIG. 1, the HMD 100 includes a CPU 101, a ROM 102, a RAM 103, a bus 104, an operation unit 105, and a display unit 106. In the HMD 100, the CPU 101, the ROM 102, the RAM 103, the operation unit 105, and the display unit 106 are connected via the bus 104. The CPU 101 is an arithmetic unit that comprehensively controls the HMD 100, and executes various programs stored in the ROM 102, such as a city exploration application, to perform various processes. Note that the city exploration application may be acquired from the outside by a communication means (not shown).

[0013] The ROM 102 is a read-only non-volatile memory device, and stores programs and parameters that do not require modification, such as an image processing program and initial data. The RAM 103 is a memory device that provides a working area for the CPU 101, and temporarily stores input information from various devices and calculation results in image processing. The operation unit 105 is an operation device such as a grip type or a wearable type that receives input from user operations, and includes a controller, a switch, and the like. The display unit 106 is a display device that displays a virtual space on a display. Therefore, the HMD 100 is a fully immersive type.

[0014] FIG. 2 is a functional block diagram showing an example of the software configuration of the HMD 100 according to the first embodiment. The 3D city model information acquisition means 201 (first information acquisition means) acquires 3D city model information. The 3D city model information is information in which various city activity information in the real world is recorded in a virtual city space and has CG objects such as buildings and roads existing in the virtual city space. The CG objects such as buildings and roads are virtual objects such as buildings and roads in the real world and have attached information. The attached information is information showing details in the real world. The attached information includes geometric information such as shape and size, tags such as name and type, and attribute information such as pedestrian flow and traffic volume. Note that the 3D city model information may be held by the HMD 100 or may be acquired from the outside by a communication means (not shown).

[0015] The user information acquisition means 202 (second information acquisition means) acquires user information. The user information is information held for each user who uses the city tour application and is information about the user's preferences such as places and things that the user is interested in, obtained from user questionnaires and past application usage histories. Note that the user information acquisition means 202 can acquire information about places and things that the user is interested in by cooperating with the user's SNS account or the like via a communication means (not shown) and hold the acquired information as user information. The route search network construction means 203 (construction means) constructs a route search network composed of a plurality of nodes arranged at regular intervals and a plurality of links connecting those nodes in a three-dimensional space in the virtual city space using the 3D city model information. Further, the route search network construction means 203 (setting means) sets a link score for each link of the route search network as will be described later using the 3D city model information and the user information.

[0016] The starting position acquisition means 204 (first position acquisition means) acquires the starting position of the tour in the virtual urban space in the urban tour application. Note that the starting position acquisition means 204 may acquire the current position of the user in the virtual urban space in the urban tour application and use the acquired current position of the user as the starting position of the tour in the virtual urban space in the urban tour application. The destination position acquisition means 205 (second position acquisition means) acquires the destination position of the tour in the virtual urban space in the urban tour application, for example, based on an input by a user operation on the operation unit 105.

[0017] The route search means 206 (route search means) searches for a route from the starting position to the destination position of the tour in the virtual urban space in the urban tour application. At this time, the route search means 206 uses the information obtained by the route search network construction means 203, the starting position acquisition means 204, and the destination position acquisition means 205. The route display means 207 (second display means) displays the virtual urban space and the route searched by the route search means 206 on the display of the display unit 106 based on the current position of the user in the virtual urban space. The virtual space movement means 208 is a means for moving the user in the virtual urban space in the urban tour application. The virtual space movement means 208 (first movement means) can move the current position of the user along the route searched by the route search means 206 based on an input by a user operation on the operation unit 105.

[0018] FIG. 3 is a diagram for explaining a route search network 300 constructed by the route search network construction means 203. 301 indicates a virtual object on the ground in a virtual urban space (hereinafter referred to as "ground 301"). Note that CG objects such as buildings and roads included in the 3D city model information are arranged on the ground 301. In the route search network 300, each of the plurality of black circles indicates a plurality of nodes in the three-dimensional space. Each node is arranged at a position higher than the ground 301 and at regular intervals within the virtual urban space where CG objects such as buildings and roads exist. However, each node may be arranged at non-uniform intervals.

[0019] In FIG. 3, some of the nodes are indicated by 302, 303, and 304. Note that each node is preferably arranged along CG objects such as buildings and roads. In the route search network 300, each of the plurality of solid lines indicates a plurality of links in the three-dimensional space. Each link is created to connect the nodes before, after, left, and right. In FIG. 3, the link connecting the node 302 and the node 303 is indicated by 305, and the link connecting the node 303 and the node 304 is indicated by 306.

[0020] FIG. 4 is a flowchart showing the operation flow of the HMD 100 from 3D city model information acquisition to link score setting when the HMD 100 according to the first embodiment executes the urban exploration application. The operation flow of the HMD 100 (control method of the information processing apparatus) shown in the flowchart of FIG. 4 is realized by the CPU 101 (computer) expanding and executing the program stored in the ROM 102 in the RAM 103. In step S401, the CPU 101 acquires 3D city model information by the 3D city model information acquisition means 201 (first information acquisition step).

[0021] In step S402, the CPU 101 constructs a route search network by the route search network construction means 203 (construction step). As a result, for example, as shown in FIG. 3 above, in a virtual urban space where CG objects such as buildings and roads in the 3D city model information exist, a route search network 300 is constructed. In step S403, the CPU 101 acquires user information by the user information acquisition means 202 (second information acquisition step). In step S404, the CPU 101 sets a link score by the route search network construction means 203 (setting step). Then, the processing of this flow ends.

[0022] In the first embodiment, in setting the link score in step S404, the link score is set for each link of the route search network as follows. The CPU 101 sets the link score of the link from the viewpoint of how much the user can enjoy wandering when moving in the virtual urban space along the link. The link score is set based on three scores. The first score is a score based on whether the user can clearly see the CG object at the three-dimensional position of the link. That is, the first score is a score (first score) based on the visibility of the CG object near the link. The second score is a score (third score) based on the attributes of the CG object near the link. The third score is a score based on the user information reflected in the link. That is, the third score is a score (second score) based on the user's preference for the CG object near the link.

[0023] FIG. 5 is a diagram for explaining the visibility of a CG object. The visibility of a CG object is calculated from the distance and angle between a link and the CG object in the vicinity of the link. Generally, it is said that the direction of the line of sight that is easy for a person to view naturally is the direction in which the person looks slightly downward. Therefore, the area within the range where the direction of the line of sight is 10 degrees to 30 degrees below the horizontal is an important area when the user views the CG object. Thus, if the angle between the link and the CG object is within the angular range of 10 degrees to 30 degrees, and the distance between the link and the CG object is within the distance range where the user can clearly see the CG object, the link is considered an easy-to-view link for the user. Note that the distance range where the user can clearly see the CG object is the range obtained by adding several meters to the shortest distance at which the user can see the entire CG object.

[0024] In FIG. 5, 501 indicates a CG object. 502 indicates the center of gravity of the CG object 501. The angle and distance between the CG object 501 and the link are measured based on the center of gravity 502 of the CG object 501. 503 indicates the position of the shortest distance at which the user can see the entire CG object 501 at a depression angle of 10 degrees. 504 indicates the position of the shortest distance at which the user can see the entire CG object 501 at a depression angle of 30 degrees. 505 indicates the position obtained by adding several meters to the shortest distance at which the user can see the entire CG object 501 at a depression angle of 10 degrees. 506 indicates the position obtained by adding several meters to the shortest distance at which the user can see the entire CG object 501 at a depression angle of 30 degrees. 507 indicates the range of the three-dimensional space where the user can clearly see the CG object 501 from the link. Note that hereinafter, the depression angle when the user views the CG object is referred to as the "browsing angle".

[0025] The following formula (1) is a calculation formula for the shortest distance (hereinafter referred to as the "browsing distance") at which the user can see the entire CG object.

[0026]

Equation

[0027] According to the pinhole camera model, the size of the subject captured by the camera can be calculated based on the focal length, the size of the image sensor, and the distance to the subject. Therefore, assuming the size of the subject is the long side size of the CG object, the viewing distance can be calculated using the above formula (1). Also, when using the field of view FOV, the viewing distance can be calculated using the following formula (2).

[0028]

Equation

[0029] However, the field of view FOV is the smaller of the horizontal field of view and the vertical field of view. Note that the size of the subject may be assumed to be the diagonal side size of the CG object.

[0030] The following formula (3) is a diagram showing the formula for setting the link score Score.

[0031] Score = αSv + βSa + γSu ··· (3)

[0032] The link score Score is composed of a score Sv based on the visibility of CG objects near the link, a score Sa based on the attributes of CG objects near the link, and a score Su based on the user's preference for CG objects near the link. Furthermore, the link score Score is set by adding each of the scores Sv, Sa, and Su after multiplying them by weight coefficients α, β, and γ. As a result, the link score Score has the nature of a comprehensive evaluation that is set by adding the scores Sv, Sa, and Su with weights assigned according to their respective importance levels. Note that the CPU 101 may determine the weight coefficients α, β, and γ for each of the scores Sv, Sa, and Su based on user information by the path search network construction means 203. In this case, the importance levels of the scores Sv, Sa, and Su are quantitatively evaluated according to the user's preference.

[0033] The score Sv based on the visibility of CG objects near the link is set by items such as the viewing distance from the CG objects near the link, the viewing angle, and whether the position of the link faces the front of the CG object. Note that for CG objects of facilities or landmarks composed of multiple buildings, the score Sv may be set by providing each of the above items for all the CG objects of the buildings.

[0034] The score Sa based on the attributes of the CG object near the link is set from the perspective of whether the effect of wandering around the CG object near the link is high. For example, when the CG object has a high popularity, when the CG object faces a road with a lot of pedestrian traffic, or when the CG object is a building that can be entered, the effect of wandering is considered high. Also, when a commercial facility such as a department store or a public facility such as a school is the CG object, it may be considered that the effect of wandering is high from the purpose of use of the CG object. On the other hand, when there is a CG object in an industrial area or a residential area, etc., since the attractions of the CG object are scarce, it may be considered that the effect of wandering is low. In addition, in the setting of the score Sa, at least one of the name, tags such as type, pedestrian flow, traffic volume, etc. included in the attribute information of the CG object is used. Therefore, in the setting of the score Sa, the attribute information of the CG object included in the 3D city model information can be diverted.

[0035] The score Su based on the user's preference for the CG object near the link is set from the perspective of the user's wandering preference obtained through a prior questionnaire or the like. For example, when user information such as places of high user interest (commercial facilities, restaurants, etc.) or movement methods (on buildings, on roads, etc.) is stored in advance, and there is a CG object near the link that has attribute information that matches or is similar to the user information, the score Su is set high. In addition, the CPU 101 (storage means) stores in the user information places visited and routes traveled by the user in past wandering experiences, etc., and when there is a CG object near the link that has attribute information that matches or is similar to the stored information, the score Su may be set high. In this case, the CPU 101 can also set the score Su from the perspective of the user's wandering preference obtained from the user's past wandering experiences in the virtual city space.

[0036] Also, if the CPU 101 cooperates with an SNS account or the like via a communication means (not shown) by the user information acquisition means 202 as described above, it can acquire information such as the location visited by the user in the real world and tags of high interest as user information. In this case, if a CG object having attribute information that matches or is similar to the information acquired from the user's SNS account or the like is near the link, the effect of roaming around the CG object is high, so the score Su may be set high. Each of the scores Sv, Sa, and Su can be composed of a plurality of elements, and weights may be provided for these elements.

[0037] FIG. 6 is a diagram showing an example of the link score Score set for each link. For the link with ID 1, compared with other links, all of the scores Sv, Sa, and Su are the highest, so the link score Score is also the highest. For the link with ID 2, compared with the link with ID 3, the score Sv is the same. Therefore, between the links with IDs 2 and 3, the superiority or inferiority of the link score Score is determined by which of the scores Sa and Su is given a greater weight.

[0038] FIG. 7 is a flowchart showing the flow of operations of the HMD 100 from the acquisition of the starting position to the route search when the HMD 100 according to the first embodiment executes the urban exploration application. The flow of operations of the HMD 100 (control method of the information processing apparatus) shown in the flowchart of FIG. 7 is realized by the CPU 101 (computer) expanding and executing the program stored in the ROM 102 in the RAM 103. In step S701, the CPU 101 acquires the starting position by the starting position acquisition means 204 (first position acquisition step). Thereby, the starting position of the route to be searched, that is, the starting position of the exploration, is acquired. Note that the acquisition of the starting position may be performed by allowing the user to specify a position in the virtual urban space by a user operation on the operation unit 105, or by allowing the user to select the starting position by a user operation on the operation unit 105 from a list of GUIs displayed on the display unit 106 or the like. Further, the starting position may be input by a user operation on the operation unit 105. In these cases, the CPU 101 can start the exploration of the virtual urban space from the position desired by the user. Further, the CPU 101 may set the starting position as the current position of the user in the virtual urban space as described above. In this case, the input operation of the starting position is omitted, and the CPU 101 can start the exploration of the virtual urban space from the current position of the user.

[0039] In step S702, the CPU 101 acquires the target position by the target position acquisition means 205 (second position acquisition step). As a result, the target position of the route to be searched, that is, the target position of the tour, is acquired. Note that the acquisition of the target position may be performed by having the user operate the operation unit 105 to specify a position in the virtual city space, or by having the user operate the operation unit 105 to select the target position from a list of GUIs displayed on the display unit 106 or the like. Further, as described above, the target position may be input by the user operation on the operation unit 105. In these cases, the CPU 101 can cause the user to end the tour of the virtual city space at a desired position. In step S703, the CPU 101 acquires the route search network. As a result, for example, the route search network 300 constructed in step 402 above is acquired.

[0040] In step S704, the CPU 101 performs route search by the route search means 206 (route search step). Specifically, the CPU 101 searches for a route from the starting position of the tour to the target position using the starting position, the target position, the route search network 300, the link score Score, and the route search algorithm. As the route search algorithm, a generally widely used algorithm such as a genetic algorithm, Dijkstra's method, or A* (A-star) algorithm is used. Further, as described above, the link score Score set for each link of the route search network 300 is set higher as the effect of the tour is higher. Note that when the route search algorithm used searches for a route with the smallest total value of the score (or cost), the difference from the maximum value of the link score Score may be used for the route search so that a route with a high tour effect may be searched.

[0041] The CPU 101 displays the searched route (hereinafter referred to as the "searched route") together with the virtual city space on the display of the display unit 106 based on the current position of the user in the virtual city space by the route display means 207. Thereby, the searched route is visualized in the virtual city space. Further, the CPU 101 moves the current position of the user from the starting position to the destination position along the searched route by the virtual space moving means 208 based on an input in a user operation at the operation unit 105. At that time, the CPU 101 may move the current position of the user by the distance input at the operation unit 105, or may move the current position of the user at the speed input at the operation unit 105. In this way, the user can wander around the virtual city space at his own pace.

[0042] Also, the CPU 101 may automatically move the current position of the user from the starting position to the destination position along the searched route by the virtual space moving means 208 (second moving means) at a predetermined speed. In this case, even if no user operation is performed at the operation unit 105, the current position of the user moves along the searched route, so that the user can concentrate on wandering around the virtual city space. However, the speed at which the current position of the user automatically moves may be changed based on an input in a user operation at the operation unit 105.

[0043] Note that the CPU 101 may search for a plurality of routes by changing the weighting factors α, β, and γ of the scores Sv, Sa, and Su, respectively, by the route search means 206. Thereby, the CPU 101 can search for a plurality of routes with different balances of the scores Sv, Sa, and Su. However, in this case, the CPU 101 displays the plurality of searched routes (hereinafter referred to as "plurality of search routes") on the display of the display unit 106 by the route display means 207 (first display means). Further, the CPU 101 (selection means) allows the user to select any one of the plurality of search routes displayed on the display unit 106 by an input by a user operation on the operation unit 105. Thereby, the user can select an optimal route for wandering in the virtual city space from among the plurality of routes searched with different balances of the scores Sv, Sa, and Su. When the route search is performed as described above, the operation flow of the HMD 100 shown in the flowchart of FIG. 7 ends.

[0044] As described above, the HMD 100 calculates three scores Sv, Sa, and Su and sets the link score Score, thereby searching for a route from the starting position to the destination position. Therefore, it is possible to search for a route suitable for the three-dimensional movement of the user in the virtual city space.

[0045] <Second Embodiment> Hereinafter, the second embodiment will be described with reference to FIGS. 8 and 9. The second embodiment is different from the first embodiment in that the link score Score is set using an aerial image of a real object taken in a real-world city. Here, the description will focus on the parts different from the first embodiment. FIG. 8 is a functional block diagram showing an example of the software configuration of the HMD 100 according to the second embodiment. As shown in FIG. 8, the software configuration of the HMD 100 according to the second embodiment is a configuration in which an aerial image acquisition means 801 and an aerial image position and orientation estimation means 802 are added to the software configuration of the HMD 100 according to the first embodiment shown in FIG. 2 above.

[0046] The aerial photography image acquisition means 801 (image acquisition means) acquires an aerial photography image. The aerial photography image is an image in which real objects (here, buildings and roads) of CG objects existing in a virtual urban space are aerially imaged in the real world. Note that the aerial photography image may be held by the HMD 100 or may be acquired from the outside by a communication means (not shown). The aerial photography image position and orientation estimation means 802 (estimation means) estimates a three-dimensional position and orientation indicating the position and camera angle when the aerial photography image is taken in the virtual urban space, from the geometric information possessed by the CG objects of the 3D urban model information. The route search network construction means 203 sets a link score Score for each link of the route search network 300, using the three-dimensional position and orientation estimated by the aerial photography image position and orientation estimation means 802, in addition to the 3D urban model information and user information.

[0047] FIG. 9 is a flowchart showing the flow of operations of the HMD 100 from 3D urban model information acquisition to link score setting when the HMD 100 according to the second embodiment executes the urban exploration application. The flow of operations of the HMD 100 shown in the flowchart of FIG. 9 is realized by the CPU 101 expanding and executing the program stored in the ROM 102 in the RAM 103. Steps S901, S902, and S903 are the same as steps S401, S402, and S403 of the first embodiment described above, and thus detailed descriptions thereof are omitted. In step S904, the CPU 101 acquires an aerial photography image by the aerial photography image acquisition means 801. That is, an image in which real objects (here, buildings and roads) of CG objects existing in the virtual urban space are aerially imaged in the real world is acquired.

[0048] In step S905, the CPU 101 estimates the three-dimensional position and orientation by the aerial image position and orientation estimation means 802. At this time, the CPU 101 estimates the three-dimensional position and orientation by measuring the matching points between the information such as the feature points of the aerial image and the geometric information of the CG object in the 3D city model information. In step S906, the CPU 101 sets the link score Score in the same manner as step S404 of the first embodiment described above. However, in the aerial image, there are many images taken from a camera angle that allows the user to clearly see the urban scenery and landmarks of the real world. Therefore, the CPU 101 also uses the three-dimensional position and orientation estimated in step S905 above to set the link score Score. For example, for the links near the position assuming that the aerial image is taken in the virtual urban space, the CPU 101 adjusts to set a high score Sv based on the visibility of the CG object, assuming that the effect of the tour is high.

[0049] As described above, since the HMD 100 calculates the score Sv based on the visibility of the CG object in consideration of the aerial image, it can search for a path more suitable for the three-dimensional movement of the user in the virtual urban space.

[0050] <Others> As described above, the preferred embodiments of the present invention have been described. However, the present invention is not limited to the above-described embodiments, and various modifications and changes are possible within the scope of the gist thereof. For example, even if the HMD 100 omits the score Sa based on the attributes of the CG object near the link and sets the link score Score, it can search for a path suitable for the three-dimensional movement of the user in the virtual urban space. In this case, the link score Score is set by adding the score Sv based on the visibility of the CG object near the link and the score Su based on the user's preference for the CG object near the link, each multiplied by the weight coefficients α and γ.

[0051] Further, the CPU 101 may perform the route search network construction in step S402 in step 703 and perform the link score setting in step S404 between step S703 and step S704. Also, for the viewing angle, for example, a depression angle of 0 to 10 degrees may be added. Further, instead of the depression angle, an elevation angle of up to 27 degrees that allows the user to see the CG object without looking up may be added.

[0052] Further, the information processing apparatus of the present invention desirably has a glasses-type configuration to be worn on the user's head. In each embodiment, the HMD 100 has been described as the information processing apparatus of the present invention. However, the information processing apparatus of the present invention is not limited to the HMD 100, and may be, for example, a fully immersive smart glass. Further, the information processing apparatus of the present invention may be a computer connected to the HMD 100 or smart glass by wire or wirelessly. Such computers include, for example, a small box computer that can be worn on the user's shoulder, a notebook PC, a tablet PC, or a portable computer such as a smartphone, or a stationary computer such as a desktop PC. In this case, the operation unit 105 and the display unit 106 may be combined with a touch panel having both display and input functions.

[0053] The present invention can also be realized by supplying a program that realizes one or more functions of each of the above embodiments to a system or apparatus via a network or a storage medium, and having one or more processors of a computer of the system or apparatus read and execute the program. Further, the present invention can also be realized by a circuit (for example, an ASIC) that realizes one or more functions.

[0054] The disclosure of each embodiment includes the following configurations, methods, and programs. (Configuration 1) First information acquisition means for acquiring 3D city model information including the associated information of each of the plurality of CG objects, which is information about a virtual city space in which a plurality of CG objects exist. In a three-dimensional space in the virtual urban space, construction means for constructing a path search network composed of a plurality of nodes and a plurality of links using the 3D urban model information; Second information acquisition means for acquiring user information about the user's preferences; Based on the 3D urban model information and the user information, for each of the plurality of links, at least a first score based on the visibility of the CG object near the link and a second score based on the user's preference for the CG object near the link are calculated, and setting means for setting a link score; First position acquisition means for acquiring a starting position; Second position acquisition means for acquiring a destination position; In the path search network, path search means for searching for a path from the starting position to the destination position using the link score, characterized in that the information processing apparatus comprises the path search means. (Configuration 2) The information processing apparatus according to Configuration 1, characterized in that the setting means calculates the first score for each of the plurality of links based on the angle and distance with respect to the CG object near the link. (Configuration 3) The information processing apparatus according to Configuration 1 or 2, characterized in that the setting means sets the link score by multiplying each of the first score and the second score by a weight coefficient. (Configuration 4) The information processing apparatus according to Configuration 3, characterized in that the setting means determines the weight coefficients of each of the first score and the second score based on the user information. (Configuration 5) The information processing apparatus according to Configuration 3 or 4, characterized in that the path search means searches for a plurality of the paths by changing the weight coefficients of each of the first score and the second score. (Configuration 6) The information processing apparatus according to any one of Configurations 1 to 5, characterized in that the setting means sets the link score by calculating, for each of the plurality of links, in addition to the first score and the second score, a third score based on the attributes of the CG object near the link. (Configuration 7) The information processing apparatus according to Configuration 6, wherein the attribute is at least one of a name, a tag, a human flow, and a traffic volume included in the associated information. (Configuration 8) The information processing apparatus according to Configuration 6 or 7, wherein the setting means sets the link score by multiplying each of the first score, the second score, and the third score by a weight coefficient. (Configuration 9) The information processing apparatus according to Configuration 8, wherein the setting means determines a weight coefficient for each of the first score, the second score, and the third score based on the user information. (Configuration 10) The information processing apparatus according to Configuration 8 or 9, wherein the route search means searches for a plurality of the routes by changing a weight coefficient for each of the first score, the second score, and the third score. (Configuration 11) First display means for displaying the plurality of the routes on a display device; Selection means for selecting any one of the plurality of the routes based on a user operation on an operation device, the information processing apparatus according to Configuration 5 or 10. (Configuration 12) The information processing apparatus according to any one of Configurations 1 to 11, wherein the second information acquisition means acquires the user information from a user's SNS account. (Configuration 13) The information processing apparatus according to any one of Configurations 1 to 12, wherein the first position acquisition means acquires the current position of the user in the virtual urban space as the departure position. (Configuration 14) The information processing apparatus according to any one of Configurations 1 to 13, wherein the second position acquisition means acquires the destination position based on a user operation on an operation device. (Configuration 15) The information processing apparatus according to any one of Configurations 1 to 14, further comprising second display means for displaying the virtual urban space and the route on a display device based on the current position of the user in the virtual urban space. (Configuration 16) The information processing apparatus according to Configuration 15, further comprising first moving means for moving the current position of the user in the virtual urban space along the route based on a user operation on an operating device. (Configuration 17) The information processing apparatus according to Configuration 15 or 16, further comprising second moving means for automatically moving the current position of the user in the virtual urban space along the route. (Configuration 18) The information processing apparatus according to Configuration 16 or 17, further comprising storage means for storing the route in the user information. (Configuration 19) Image acquisition means for acquiring an aerial image obtained by aerial photography of a real object of a CG object existing in the virtual urban space in the real world, Estimation means for estimating a three-dimensional position and orientation indicating the position and camera angle when the aerial photography of the aerial image is performed in the virtual urban space, using the attached information, The setting means calculates the first score using the three-dimensional position and orientation, according to any one of Configurations 1 to 18. (Configuration 20) The information processing apparatus according to any one of Configurations 1 to 19, wherein the CG object existing in the virtual urban space is a virtual object of a building or a road existing in the real world. (Method 1) A first information acquisition step of acquiring 3D urban model information including attached information of each of a plurality of CG objects, which is information about a virtual urban space in which a plurality of CG objects exist, A construction step of constructing a route search network composed of a plurality of nodes and a plurality of links in a three-dimensional space in the virtual urban space, using the 3D urban model information, A second information acquisition step of acquiring user information about user preferences, Using the 3D city model information and the user information, for each of the plurality of links, setting a link score by calculating at least a first score based on the visibility of CG objects near the link and a second score based on the user's preference for the CG objects near the link; a setting step; A first position acquisition step of acquiring a starting position; A second position acquisition step of acquiring a destination position; In the path search network, a path search step of searching for a path from the starting position to the destination position using the link score, wherein the control method of the information processing apparatus is characterized by comprising the above steps. (Program 1) A program for causing a computer to execute each means of the information processing apparatus according to any one of Configurations 1 to 20.

Explanation of Signs

[0055] 100 HMD (Information Processing Apparatus) 201 3D City Model Information Acquisition Means (First Information Acquisition Means) 202 User Information Acquisition Means (Second Information Acquisition Means) 203 Path Search Network Construction Means (Construction Means) (Setting Means) 204 Starting Position Acquisition Means (First Position Acquisition Means) 205 Destination Position Acquisition Means (Second Position Acquisition Means) 206 Path Search Means 300 Path Search Network 302, 303, 304 Nodes 305, 306 Links

Claims

1. Information about a virtual urban space in which a plurality of CG objects exist, comprising: first information acquisition means for acquiring 3D urban model information including the accompanying information possessed by each of the plurality of CG objects; construction means for constructing a path search network composed of a plurality of nodes and a plurality of links in a three-dimensional space in the virtual urban space using the 3D urban model information; second information acquisition means for acquiring user information about the user's preferences; setting means for setting a link score by calculating, for each of the plurality of links, at least a first score based on the visibility of CG objects near the link and a second score based on the user's preference for CG objects near the link, using the 3D urban model information and the user information; first position acquisition means for acquiring a starting position; second position acquisition means for acquiring a destination position; and path search means for searching for a path from the starting position to the destination position in the path search network using the link score. An information processing apparatus characterized by comprising the above.

2. The information processing apparatus according to claim 1, wherein the setting means calculates the first score for each of the plurality of links based on the angle and distance with respect to CG objects near the link.

3. The information processing apparatus according to claim 1, wherein the setting means sets the link score by multiplying each of the first score and the second score by a weight coefficient.

4. The information processing apparatus according to claim 3, wherein the setting means determines the weight coefficients of each of the first score and the second score based on the user information.

5. The information processing apparatus according to claim 3, wherein the path search means searches for a plurality of the paths by changing the weight coefficients of each of the first score and the second score.

6. The information processing apparatus according to claim 1, wherein the setting means sets the link score by calculating, for each of the plurality of links, in addition to the first score and the second score, a third score based on the attributes of CG objects near the link.

7. The information processing apparatus according to claim 6, wherein the attribute is at least one of a name, a tag, a human flow, and a traffic volume included in the associated information.

8. The information processing apparatus according to claim 6, wherein the setting means sets the link score by multiplying each of the first score, the second score, and the third score by a weight coefficient.

9. The information processing apparatus according to claim 8, wherein the setting means determines a weight coefficient for each of the first score, the second score, and the third score based on the user information.

10. The information processing apparatus according to claim 8, wherein the route search means searches for a plurality of the routes by changing a weight coefficient for each of the first score, the second score, and the third score.

11. A first display means for displaying the plurality of the routes on a display device; A selection means for selecting any one of the plurality of the routes based on a user operation on an operation device, the information processing apparatus according to claim 5 or 10.

12. The information processing apparatus according to claim 1, wherein the second information acquisition means acquires the user information from a user's SNS account.

13. The information processing apparatus according to claim 1, wherein the first position acquisition means acquires the current position of the user in the virtual urban space as the departure position.

14. The information processing apparatus according to claim 1, wherein the second position acquisition means acquires the destination position based on a user operation on an operation device.

15. The information processing apparatus according to claim 1, further comprising a second display means for displaying the virtual urban space and the route on a display device based on the current position of the user in the virtual urban space.

16. The information processing apparatus according to claim 15, further comprising a first moving means for moving the current position of the user in the virtual urban space along the route based on a user operation on an operation device.

17. The information processing apparatus according to claim 15, further comprising a second moving means for automatically moving the current position of the user in the virtual urban space along the route.

18. The information processing apparatus according to claim 16 or 17, further comprising storage means for storing the path in the user information.

19. Image acquisition means for acquiring an aerial image obtained by aerial photography of a real object of a CG object existing in the virtual urban space in the real world; Estimation means for estimating a three-dimensional position and orientation indicating the position and camera angle when the aerial image is taken in the virtual urban space, using the associated information; and The setting means calculates the first score using the three-dimensional position and orientation. The information processing apparatus according to claim 1.

20. The CG object existing in the virtual urban space is a virtual object of a building or a road existing in the real world. The information processing apparatus according to claim 1.

21. A first information acquisition step of acquiring 3D urban model information including associated information of each of a plurality of CG objects, which is information about a virtual urban space in which a plurality of CG objects exist; A construction step of constructing a path search network composed of a plurality of nodes and a plurality of links in a three-dimensional space in the virtual urban space, using the 3D urban model information; A second information acquisition step of acquiring user information about user preferences; A setting step of setting a link score by calculating, for each of the plurality of links, at least a first score based on the visibility of the CG object near the link and a second score based on the user's preference for the CG object near the link, using the 3D urban model information and the user information; A first position acquisition step of acquiring a starting position; A second position acquisition step of acquiring a destination position; A path search step of searching for a path from the starting position to the destination position in the path search network, using the link score. A control method for an information processing apparatus.

22. A program for causing a computer to execute each means of the information processing apparatus according to claim 1.

Images