Program, information processing method and information processing device

Abstract

To provide a program, an information processing method and an information processing device capable of displaying a globe in a captured image and three-dimensionally displaying clouds at corresponding positions.SOLUTION: An augmented reality (AR) system causes a computer 2 to execute processing of, when an altitude of cloud at each location is acquired and a globe 1 in a real space is held up thereto, displaying a globe in a first virtual space in response to the movement of the globe, and three-dimensionally displaying clouds according to specified altitudes at corresponding positions on the first virtual space. The AR system can thus display the globe in a captured image and three-dimensionally display the clouds at the corresponding positions.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a program, an information processing method, and an information processing device. [Background technology]

[0002] In recent years, products using an Augmented Reality (AR) system have been developed. In the AR system, an application program for recognizing an AR marker is installed in an information device having a camera and a display unit, such as AR glasses (AR goggles) such as Apple (registered trademark) Vision Pro, a smartphone, a tablet terminal, a portable game machine, etc. When an object with an AR marker is photographed using such an information device, the information device recognizes the AR marker and displays content corresponding to the recognized AR marker superimposed on the photographed image. This allows a user to view an image in which the content is superimposed on the photographed object on the display unit. Patent Document 1 discloses a system that photographs a three-dimensional object and displays additional information such as an image or text superimposed on the three-dimensional object in the photographed image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-92407 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the invention of Patent Document 1 has a problem in that it is not possible to display a globe (three-dimensional object) in a captured image and at the same time to display clouds in 3D at the corresponding position.

[0005] One aspect of the present invention is to provide a program or the like that can display a globe in a captured image and also display clouds in 3D at the corresponding position. [Means for solving the problem]

[0006] A program relating to one aspect causes a computer to execute a process of obtaining the altitude of clouds at each location and, when a globe in real space is held up, displaying a globe in a first virtual space in response to the movement of the globe and displaying clouds in 3D at the corresponding position in the first virtual space according to the specified altitude. Effect of the Invention

[0007] In one aspect, it is possible to display a globe in the captured image and also display clouds in 3D at the corresponding position. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram showing a configuration example of an AR system. [Diagram 2] FIG. 2 is a block diagram showing an example of the configuration of a user terminal. [Diagram 3] The process of displaying clouds in 3D at corresponding positions in the first virtual space will now be described. [Figure 4] FIG. 13 is an explanatory diagram for explaining adjustment of cloud shading. [Diagram 5] 13 is a flowchart showing a processing procedure for displaying clouds in 3D at corresponding positions in the first virtual space. [Figure 6] 13 is a flowchart showing the procedure of a subroutine for processing to display the first virtual space. [Figure 7] 1 is a flowchart showing a subroutine for estimating cloud altitude. [Figure 8] 13 is a flowchart showing the procedure of a subroutine for adjusting the shading of clouds. [Figure 9] 13 is a flowchart showing the procedure of a subroutine for adjusting the brightness of clouds. [Figure 10] FIG. 13 is an explanatory diagram showing an example of a display screen of an animation based on the amount of precipitation. [Figure 11]13 is a flowchart showing a processing procedure for displaying an animation based on the amount of precipitation. [Figure 12] FIG. 11 is an explanatory diagram showing an example of a screen on which a character is displayed as an augmented reality. [Figure 13] 13 is a flowchart showing a processing procedure for displaying a character in augmented reality. [Figure 14] FIG. 13 is an explanatory diagram showing an example of a screen on which wind flow is displayed on a globe in a first virtual space. [Figure 15] 13 is a flowchart showing a processing procedure for displaying wind flow on a globe in the first virtual space. [Figure 16] 11 is an explanatory diagram showing an example of a screen that displays the user's current position in a first virtual space. FIG. [Figure 17] 13 is a flowchart showing a processing procedure for displaying the user's current position in the first virtual space. [Figure 18] FIG. 11 is an explanatory diagram showing an example of a display screen of a national flag icon and a composite national flag icon. [Figure 19] 13 is a flowchart showing a processing procedure for accepting a selection operation of a composite national flag icon. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the present invention will be described in detail with reference to the drawings showing embodiments thereof.

[0010] (Embodiment 1) The first embodiment relates to a mode in which, when a globe (earth ball) in real space is held over the device, the globe in a first virtual space is displayed and clouds are displayed in 3D at corresponding positions in the first virtual space.

[0011] 1 is a schematic diagram showing a configuration example of an AR system. The AR system of this embodiment includes a globe 1, which is a sphere having AR markers (markers) on its surface, and an information processing terminal 2. The globe 1 is used as a subject, and is photographed by the information processing terminal 2.

[0012] The globe 1 is, for example, a hollow sphere made of plastic, but is not limited to this. A map of the earth is printed on the surface of the globe 1, and AR markers are attached at appropriate positions on the map. For example, in the example shown in Fig. 1, each of the oceans and continents on the map is given a name, and each country and city is given a country name and city name. These characters constitute the AR markers.

[0013] Although omitted in Fig. 1, if the map includes national borders of each country, the national borders may also be included as AR markers. If the rivers, plains, mountain ranges, etc. on the map are colored in a specific color according to the terrain, each color may also be included as an AR marker.

[0014] In addition, the oceans in the map may be marked with a specific mark to identify each ocean, ocean area, etc. Or, a specific mark may be marked to identify an animal such as a ship, a turtle, or a seagull, etc. Furthermore, the continents in the map may be marked with a specific mark to identify each continent, region, etc.

[0015] The information processing terminal 2 is a terminal device of each user. The information processing terminal 2 is, for example, an information processing device such as AR glasses such as Apple Vision Pro, a smartphone, a mobile phone, a wearable device such as Apple Watch (registered trademark), a tablet, a game machine, or a personal computer terminal. For the sake of simplicity, the information processing terminal 2 will be read as a user terminal 2 below.

[0016] The user terminal 2 according to this embodiment acquires an infrared image of clouds. The user terminal 2 estimates the altitude of clouds at each position based on the acquired infrared image. When the user terminal 2 holds up the globe 1 in real space, the user terminal 2 displays the globe in the first virtual space in response to the movement of the globe 1, and also displays the clouds in 3D at the corresponding positions in the first virtual space according to the specified altitude.

[0017] 2 is a block diagram showing an example of the configuration of the user terminal 2. The user terminal 2 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, a display unit 25, an imaging unit 26, and a large-capacity storage unit 27. Each component is connected by a bus B.

[0018] The control unit 21 includes an arithmetic processing device such as a central processing unit (CPU), a micro-processing unit (MPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), a digital signal processor (DSP), or a quantum processor. The control unit 21 reads out and executes a control program 2P (program product) stored in the storage unit 22, thereby performing various information processing or control processing related to the user terminal 2. Note that, although the control unit 21 is described in FIG. 2 as being a single processor, it may be a multiprocessor.

[0019] The storage unit 22 includes memory elements such as a RAM (Random Access Memory) and a ROM (Read Only Memory), and stores a control program 2P or data required for the control unit 21 to execute processing. The storage unit 22 also temporarily stores data required for the control unit 21 to execute arithmetic processing. The communication unit 23 is a communication module for performing processing related to communication, and transmits and receives information to and from an external information processing device, etc., via the network N.

[0020] The input unit 24 may be a controller, a gesture input device for sensing a gesture, a keyboard, a mouse, or a touch panel integrated with the display unit 25. When using a gesture input device, the control unit 21 recognizes the position and shape of the hand from an image of the hand captured by the image capture unit 26, for example. The control unit 21 determines the gesture (movement) of the hand based on the recognized position and shape of the hand. The control unit 21 performs a corresponding operation according to the determined hand gesture. For example, when the control unit 21 determines a gesture such as pinching with the thumb and index finger, it may perform an operation such as selecting an object at the position of the hand.

[0021] Display unit 25 is a liquid crystal display or an organic EL (electroluminescence) display, etc., and displays various information according to instructions from control unit 21. Photography unit 26 is, for example, a photography device such as a CCD (Charge Coupled Device) camera or a CMOS (Complementary Metal Oxide Semiconductor) camera. Note that photography unit 26 does not need to be built into user terminal 2, but may be configured to be externally connected directly to user terminal 2 and capable of taking photographs.

[0022] The large-capacity storage unit 27 includes a recording medium such as a hard disk drive (HDD) or a solid state drive (SSD). In this embodiment, the storage unit 22 and the large-capacity storage unit 27 may be configured as an integrated storage device. The large-capacity storage unit 27 may also be configured with a plurality of storage devices. Furthermore, the large-capacity storage unit 27 may be an external storage device connected to the user terminal 2.

[0023] 3 illustrates a process for displaying clouds in 3D at corresponding positions in the first virtual space. The screen includes a first virtual space display field 11a and a cloud display field 11b. The first virtual space display field 11a is a display field that displays the first virtual space. The first virtual space is a virtual space that includes a globe area and a real space area outside the globe area. The cloud display field 11b is a display field that displays clouds in 3D at corresponding positions in the first virtual space.

[0024] The user terminal 2 acquires an infrared (IR) image of clouds from an external server of the Japan Meteorological Agency or a weather data distribution system. An infrared image of clouds is one of the satellite observation images, and is an image in which shading is added according to the intensity of infrared radiation emitted from the Earth's surface or clouds. An infrared image is an image of temperature distribution that is converted into brightness temperature by regarding the observed radiant energy as approximately blackbody radiation.

[0025] Infrared cloud images are obtained by measuring cloud-top temperatures using infrared radiation observed by satellites, with warm surfaces appearing black and cool surfaces appearing white. The brightness temperature of cloud pixels indirectly indicates the cloud height. In the troposphere, where clouds exist, the temperature decreases with increasing height, so the cloud-top temperature can be converted to cloud-top height.

[0026] The user terminal 2 estimates the altitude of clouds at each position based on the acquired infrared image. Specifically, the user terminal 2 acquires the pixel value of each pixel of the infrared image, which is the luminance temperature, from the infrared image. The user terminal 2 determines whether or not each acquired pixel value corresponds to a cloud. For example, when the luminance temperature of the image corresponding to each pixel value is lower than the ground surface temperature, the user terminal 2 determines that the pixel value corresponds to a cloud because a cloud is reflected in the pixel. Note that the method is not limited to the cloud determination process for the pixel described above, and other determination methods may be used.

[0027] For each pixel corresponding to a cloud, the user terminal 2 linearly converts each pixel value into altitude. For example, the user terminal 2 converts each pixel value into altitude information on a 3D graphic of a globe at the longitude and latitude to which each pixel corresponds.

[0028] Note that the conversion process is not limited to the above-mentioned conversion from cloud top temperature to cloud top altitude. For example, the user terminal 2 calculates the cloud top temperature from the brightness of the cloud included in the region of the infrared image of the cloud. The user terminal 2 may calculate the altitude corresponding to the brightness temperature based on the relationship information between the temperature and altitude (for example, the vertical profile of the temperature).

[0029] When the user terminal 2 is held up over the globe 1 in real space, it captures a photographed image of the globe 1 having markers on its surface via the photographing unit 26, and displays the photographed image of the globe 1 including the globe area in the first virtual space display field 11a.

[0030] The user terminal 2 identifies each position of the globe area displayed in the captured image based on the marker information in the captured image of the globe 1. For example, the user terminal 2 recognizes AR marker information according to the globe area displayed in the captured image. The user terminal 2 extracts position information based on the recognized AR marker information.

[0031] The user terminal 2 refers to the extracted position information and displays the clouds in the cloud display field 11b in 3D according to the altitude of the clouds identified at the corresponding position in the first virtual space. For example, a technique called volumetric rendering may be used for the 3D display (drawing) process of the clouds. By using volumetric rendering, it is possible to express the shading of the transparency depending on the thickness of the clouds, making it possible to express more realistic clouds.

[0032] Volumetric rendering is a technique that converts 3D data formed by a collection of cubes called voxels, calculates the brightness of each voxel, and converts it into pixels of a 2D image that can be seen in its entirety. By performing volumetric rendering, the surface of the rendering target is made semi-transparent to express the internal structure underneath, making it possible to express realistic clouds.

[0033] Fig. 4 is an explanatory diagram for explaining the 3D rendering process of clouds. Fig. 4A is an explanatory diagram for explaining the adjustment of the shading of clouds. Fig. 4A shows a schematic cross-sectional view of the globe when the surface of the globe 1 is viewed from the photographing unit 26. Reference numeral 11c indicates the upper limit altitude of the clouds, and reference numeral 11d indicates the lower limit altitude of the clouds. Also, hatching in the figure indicates clouds.

[0034] The user terminal 2 calculates the shading of clouds at a specific point (pixel) on the screen using the following method: First, the user terminal 2 identifies the intersection point between the line of sight extended from the image capture unit 26 to the globe and the upper limit altitude 11c.

[0035] Next, the user terminal 2 further advances the line of sight from the identified intersection at fixed distances, and identifies each point for which judgment is to be made. The user terminal 2 further advances the line of sight from the identified intersection at fixed distances, and determines whether or not a predetermined condition is satisfied. The predetermined condition is, for example, that the line of sight falls below the lower limit altitude 11d of the clouds, or that the line of sight is on the opposite side of the globe in the first virtual space. If the predetermined condition is not satisfied, the user terminal 2 identifies the point for which judgment is to be made. If the predetermined condition is satisfied, the user terminal 2 ends the process of identifying the point for which judgment is to be made.

[0036] For each point, the user terminal 2 compares the line of sight altitude at that point with the cloud altitude at that point (latitude and longitude) and determines whether the line of sight altitude is equal to or lower than the cloud altitude. If it is determined that the line of sight altitude is equal to or lower than the cloud altitude, the user terminal 2 increments a predetermined counter (hereinafter referred to as a "cloud counter"). The user terminal 2 performs the above determination for each point and calculates the cloud counter. The user terminal 2 adjusts the shading of the pixel corresponding to the line of sight so that the larger the calculated cloud counter is, the darker the shading of the clouds will be.

[0037] For example, in the example of Fig. 4, the line of sight extending from the photographing unit 26 is below the cloud altitude at two points A and B. Therefore, the cloud counter in this case is "2." The user terminal 2 adjusts the shading of the pixel corresponding to the line of sight so that the density corresponds to the cloud counter "2."

[0038] In this way, by adjusting the shading of the clouds described above, clouds that can express shading can be drawn in 3D graphics. The user terminal 2 displays the clouds drawn in 3D graphics in the cloud display field 11b.

[0039] Furthermore, in this embodiment, the user terminal 2 performs a process of adjusting the brightness of the clouds (shading expression) according to the inclination of the cloud top. 4B is an explanatory diagram illustrating the process of adjusting the brightness of clouds. The user terminal 2 calculates the degree to which the cloud top is receiving light (sunlight) from the front based on the direction of the light source (sun) and the inclination of the cloud top, and reflects this in the brightness of the clouds in the image to represent realistic clouds.

[0040] First, the user terminal 2 calculates the inclination of the cloud top at the point of interest (pixel) by comparing it with the cloud top heights of nearby points. The cloud top is the boundary between the saturated air that contains the cloud body and the unsaturated air outside. For example, as shown in FIG. 4B, the point of interest is point C, and point D is a nearby point of the point of interest C. The user terminal 2 calculates the inclination of the cloud top as the inclination of the approximated straight line 11e (more precisely, the approximated plane of the cloud top surface including the point of interest C and the nearby point D) based on the cloud height of the point of interest C and the cloud height of the nearby point D.

[0041] Next, the user terminal 2 calculates the inner product of the normalized light source direction vector and the normalized cloud top normal vector. First, the user terminal 2 identifies the light source (S) direction. For example, the user terminal 2 calculates the position of the sun at the current time by simulation. The simulation is performed using a predetermined sun position calculation method that uses a formula to find the solar altitude and solar azimuth angle. Based on the calculated sun position, the user terminal 2 identifies the direction of the sun as seen from the earth as the light source (S) direction.

[0042] The user terminal 2 adjusts the brightness of the cloud top based on the specified light source (S) direction and the calculated cloud-to-cloud gradient. The brightness of the cloud top can be calculated based on the light source direction vector (L) and the cloud top normal vector (N).

[0043] Specifically, the user terminal 2 calculates a normalized light source direction vector (L) based on the coordinate values ​​(x, y, z) of the point of interest C and the coordinate values ​​(x1, y1, z1) of the light source (S). The user terminal 2 calculates a normalized cloud top normal vector (N) based on the calculated slope between the clouds. The user terminal 2 calculates the dot product of the normalized light source direction vector (L) and the normalized cloud top normal vector (N).

[0044] If the calculated dot product is a negative value, the user terminal 2 regards it as 0. Based on the calculated dot product (a value between 0 and 1), the user terminal 2 identifies a color obtained by linearly interpolating between the RGB values ​​of the color when there is no sunlight at all (when the dot product is 0) and the RGB values ​​of the color when the sunlight is the most intense (when the dot product is 1), which are specified in advance, and sets this color as the RGB value of the attention point C.

[0045] 5 is a flowchart showing a processing procedure for displaying clouds in 3D at corresponding positions in the first virtual space. The control unit 21 of the user terminal 2 acquires an infrared image of clouds from an external server of the Japan Meteorological Agency or a weather data distribution system, etc., via the communication unit 23 (step S201).

[0046] Control unit 21 executes a subroutine for estimating the altitude of clouds (step S202). The subroutine for estimating the altitude of clouds will be described later. When globe 1 in real space is held up, control unit 21 executes a subroutine for displaying a first virtual space (step S203). The subroutine for displaying the first virtual space will be described later.

[0047] The control unit 21 executes a subroutine for adjusting the shading of the clouds by referring to the position information extracted based on the AR marker information (step S204). The control unit 21 executes a subroutine for adjusting the brightness of the clouds (step S205). The subroutine for adjusting the shading of the clouds and the subroutine for adjusting the brightness of the clouds will be described later. The control unit 21 ends the process.

[0048] 6 is a flowchart showing the processing procedure of a subroutine for processing to display the first virtual space. The control unit 21 of the user terminal 2 captures a captured image of the globe 1 having markers on its surface via the photographing unit 26 (step S01). The captured image includes the globe area and a real space area outside the globe area. The control unit 21 displays the captured captured image in the first virtual space using the display unit 25 (step S02).

[0049] The control unit 21 recognizes the AR marker information according to the globe area displayed in the captured image (step S03). The control unit 21 identifies each position of the globe area displayed in the captured image based on the recognized marker information (step S04). The control unit 21 returns to the subroutine of the display process of the first virtual space.

[0050] 7 is a flowchart showing the procedure of a subroutine for estimating cloud altitude. The control unit 21 of the user terminal 2 acquires pixel values ​​of each pixel of the infrared image from the infrared image (step S11). The control unit 21 selects one pixel value from the acquired pixel values ​​(step S12).

[0051] The control unit 21 determines whether the acquired pixel value corresponds to a cloud (step S13). For example, when the brightness temperature of the image corresponding to the pixel value is lower than the earth surface temperature, the control unit 21 determines that the pixel value corresponds to a cloud.

[0052] If the acquired pixel value does not correspond to a cloud (NO in step S13), the control unit 21 returns to the process of step S12. If the acquired pixel value corresponds to a cloud (YES in step S13), the control unit 21 converts the pixel value into altitude information on the 3D graphics of the globe at the longitude and latitude to which the pixel corresponds (step S14).

[0053] The control unit 21 determines whether the pixel value is the last pixel value among the multiple pixel values ​​(step S15). If the pixel value is not the last pixel value (NO in step S15), the control unit 21 returns to the process of step S12. If the pixel value is the last pixel value (YES in step S15), the control unit 21 returns to the subroutine of the cloud altitude estimation process.

[0054] 8 is a flowchart showing the processing procedure of a subroutine for adjusting the shading of clouds. The control unit 21 of the user terminal 2 acquires a plurality of pixels corresponding to clouds from the infrared image (step S21). The control unit 21 selects one pixel from the acquired plurality of pixels (step S22). For the selected pixel, the control unit 21 identifies the intersection point between the line of sight extended from the photographing unit 26 to the globe and the upper limit altitude of the clouds (step S23). The control unit 21 further advances the line of sight from the identified intersection point by a fixed distance at a time, and identifies the point at which judgment is to be made (step S24).

[0055] Control unit 21 determines whether the line of sight altitude at the identified point is lower than the cloud altitude at the position (latitude and longitude) of that point (step S25). If control unit 21 determines that the line of sight altitude is not lower than the cloud altitude (NO in step S25), control unit 21 proceeds to processing in step S27, which will be described later. If the line of sight altitude is lower than the cloud altitude (YES in step S25), control unit 21 increments a cloud counter for drawing clouds (step S26).

[0056] The control unit 21 determines whether or not a predetermined condition is satisfied, for example, until the line of sight falls below the lowest altitude of the clouds, or until the line of sight reaches the opposite side of the globe in the first virtual space (step S27). If the predetermined condition is not satisfied (NO in step S27), the control unit 21 returns to the process of step S24. If the repetition condition is satisfied (YES in step S27), the control unit 21 adjusts the shading of the clouds in the pixel selected in step S22 based on the incremented cloud counter value (step S28).

[0057] The control unit 21 determines whether the pixel is the last pixel among the multiple pixels (step S29). If the control unit 21 determines that the pixel is not the last pixel (NO in step S29), the control unit 21 returns the process to step S22. If the control unit 21 determines that the pixel is the last pixel (YES in step S29), the control unit 21 returns to the subroutine of the cloud shading adjustment process.

[0058] 9 is a flowchart showing the procedure of a subroutine for adjusting the brightness of clouds. The control unit 21 of the user terminal 2 acquires a plurality of pixels corresponding to clouds from an infrared image (step S31). The control unit 21 selects one pixel from the acquired plurality of pixels (step S32).

[0059] The control unit 21 compares the altitude of the cloud corresponding to the acquired pixel with the altitude of the cloud top near the pixel to calculate the slope between the clouds at the pixel (step S33). For example, the control unit 21 acquires the coordinate value of the pixel and each coordinate value of the cloud top near the pixel based on the altitude of the cloud at each position. The control unit 21 may calculate the slope of an approximation line formed by each acquired coordinate value as the slope between the clouds.

[0060] The control unit 21 calculates the position of the sun at the current time by simulation, and specifies the direction of the sun as seen from the earth as the light source direction based on the calculated position of the sun (step S34). The control unit 21 calculates a normalized light source direction vector based on the coordinate value of the pixel and the coordinate value of the light source (step S35). The control unit 21 calculates a normalized cloud top normal vector based on the calculated cloud slope (step S36).

[0061] The control unit 21 calculates the inner product of the normalized light source direction vector and the normalized cloud top normal vector (step S37). The control unit 21 determines whether the calculated inner product is a negative value (step S38). If the calculated inner product is not a negative value (NO in step S38), the control unit 21 transitions to the process of step S40 described later.

[0062] If the calculated dot product is a negative value (YES in step S38), control unit 21 sets the dot product to 0 (step S39). Based on the calculated dot product (a value between 0 and 1), control unit 21 identifies a color obtained by linearly interpolating between the RGB values ​​of a color when no sunlight is shining on the pixel (when the dot product is 0) and the RGB values ​​of a color when the pixel is illuminated most by sunlight (when the dot product is 1), which are specified in advance, and sets the color as the RGB value of the pixel (step S40).

[0063] The control unit 21 determines whether or not the pixel value is the last pixel value among the multiple pixel values ​​(step S41). If the pixel value is not the last pixel value (NO in step S41), the control unit 21 returns to the process of step S32. If the pixel value is the last pixel value (YES in step S41), the control unit 21 returns to the subroutine of the cloud brightness adjustment process.

[0064] When the user terminal 2 detects a movement such as a rotation of the globe 1 or a change in the relative position between the user terminal 2 and the globe 1, the user terminal 2 recaptures the captured image of the globe 1 in response to the detected movement. The user terminal 2 displays the recaptured captured image of the globe 1 in the first virtual space display field 11a.

[0065] Similar to the above-described process, the user terminal 2 re-identifies each position of the globe area displayed in the captured image based on the marker information in the captured image of the globe 1. The user terminal 2 displays the globe in the first virtual space, and also displays in 3D the clouds in the first virtual space according to the cloud altitude at each re-identified position.

[0066] According to this embodiment, it is possible to display a globe in a first virtual space and also to display clouds in 3D at corresponding positions in the first virtual space.

[0067] According to this embodiment, by displaying clouds in 3D, it is possible to realize a more realistic representation of clouds.

[0068] According to this embodiment, it is possible to adjust the shading of the clouds at each position based on the line of sight to the globe in the first virtual space and the altitude of the clouds at each position.

[0069] According to this embodiment, it is possible to adjust the brightness of the clouds at each position based on the light source and the inclination between the clouds.

[0070] (Embodiment 2) The second embodiment relates to a mode in which raindrop animation or snowflake animation is displayed at each position according to the amount of precipitation. Note that a description of the contents that overlap with the first embodiment will be omitted.

[0071] Fig. 10 is an explanatory diagram showing an example of a display screen of an animation based on the amount of precipitation. Fig. 10A is an explanatory diagram showing an example of a display screen of a raindrop animation. Fig. 10B is an explanatory diagram showing an example of a display screen of a snow animation.

[0072] When the user terminal 2 is held up over the globe 1 in real space, it captures a photographed image of the globe 1 via the photographing unit 26, and displays the photographed image of the globe 1 including the globe area in the first virtual space display field 11a.

[0073] The user terminal 2 identifies each position of the globe area displayed in the captured image based on the marker information in the captured image of the globe 1. For example, the user terminal 2 recognizes AR marker information according to the globe area displayed in the captured image. The user terminal 2 extracts position information based on the recognized AR marker information.

[0074] The user terminal 2 refers to the extracted location information and acquires precipitation data and temperature data for each location from an external Meteorological Agency server, a weather data distribution system, etc. For example, the precipitation data is a precipitation bitmap representing the amount of precipitation at each location, and the temperature data is a temperature bitmap representing the temperature at each location.

[0075] The user terminal 2 identifies the amount of precipitation in the area identified by the multiple location groups based on the acquired precipitation data. Specifically, the user terminal 2 refers to the location information extracted based on the AR marker information, and identifies the rainfall area where it is raining based on the acquired precipitation data.

[0076] The user terminal 2 identifies the amount of precipitation in the identified rainfall area. For example, the user terminal 2 acquires the amount of precipitation at each position (longitude and latitude) corresponding to each pixel value in the rainfall area from the precipitation data. The user terminal 2 calculates the average value of each acquired amount of precipitation as the amount of precipitation in the rainfall area. Note that the process of identifying the amount of precipitation in the rainfall area is not limited to the average value. For example, the median or mode (the value with the highest frequency among the multiple precipitation amounts) of multiple precipitation amounts may be used. Note that the amount of precipitation may be selected randomly from the multiple precipitation amounts.

[0077] The user terminal 2 selects an area according to weighting according to the amount of precipitation in the identified rainfall area. Specifically, the user terminal 2 generates an area list by grouping the longitude, latitude, and amount of precipitation for the identified rainfall area. The user terminal 2 selects one area from the generated area list for each raindrop using a random number with a probability weighted according to the amount of precipitation in the area. For the random number, for example, an Alias ​​method function (algorithm), which is a method of generating random numbers based on a discrete probability distribution, may be used.

[0078] The user terminal 2 displays the raindrop animation within the selected region. The user terminal 2 repeats the above-described raindrop animation display process until a predetermined number of raindrops (e.g., 1000) is reached. The predetermined number of raindrops may be dynamically changed depending on the total amount of precipitation. As shown in FIG. 10A, a particle special effect simulating the raindrop animation is displayed within the rainfall region.

[0079] The user terminal 2 acquires the longitude and latitude of each position in the selected area. The user terminal 2 acquires the temperature of each position from the temperature data based on the acquired longitude and latitude of each position. The user terminal 2 determines whether the acquired temperature is equal to or lower than a predetermined temperature (for example, minus 6 degrees).

[0080] When the acquired temperature is equal to or lower than a predetermined temperature, the user terminal 2 displays a snow animation in place of the raindrop animation in the area. As shown in Fig. 10B, a particle special effect simulating a snow animation is displayed in the rainfall area.

[0081] 11 is a flowchart showing a processing procedure for displaying an animation based on the amount of precipitation. When the globe 1 in the real space is held up, the control unit 21 of the user terminal 2 executes a subroutine for processing to display the first virtual space (step S211). The control unit 21 acquires precipitation data and temperature data for each position in the globe area of ​​the first virtual space from, for example, a weather data distribution system or the like, via the communication unit 23 (step S212).

[0082] The control unit 21 refers to the position information extracted based on the AR marker information, and identifies the rainfall area where it is raining based on the acquired precipitation data (step S213). The control unit 21 identifies the amount of precipitation in the identified rainfall area (step S214). For example, the control unit 21 acquires the amount of precipitation at each position corresponding to each pixel value in the rainfall area from the precipitation data. The control unit 21 calculates the average value of each acquired amount of precipitation as the amount of precipitation in the rainfall area.

[0083] The control unit 21 generates a region list by grouping the longitude, latitude, and precipitation amount for the identified rainfall region (step S215). The control unit 21 selects one region from the generated region list for each raindrop using a random number with a probability weighted according to the precipitation amount of the identified rainfall region (step S216). The control unit 21 acquires the temperature at each position in the selected region from the temperature data (step S217). The control unit 21 determines whether the acquired temperature is equal to or lower than a predetermined temperature (step S218).

[0084] If the acquired temperature exceeds a predetermined temperature (NO in step S218), control unit 21 displays a raindrop animation in the selected area on display unit 25 (step S219), and proceeds to processing in step S221 described below. If the acquired temperature is equal to or lower than a predetermined temperature (YES in step S218), control unit 21 displays a snow animation in place of the raindrop animation in the selected area on display unit 25 (step S220).

[0085] The control unit 21 determines whether or not the number of raindrops displayed on the screen reaches a predetermined number (step S221). If the number of raindrops has not reached the predetermined number (NO in step S221), the control unit 21 returns to the process of step S213. If the number of raindrops has reached the predetermined number (YES in step S221), the control unit 21 ends the process.

[0086] According to this embodiment, it is possible to display raindrop animations at each position according to the amount of precipitation.

[0087] According to this embodiment, it is possible to display a snow animation instead of a raindrop animation at each position where the air temperature is equal to or lower than a predetermined temperature.

[0088] (Embodiment 3) The third embodiment relates to a form in which a character providing commentary is displayed as an augmented reality. Note that a description of the contents that overlap with the first and second embodiments will be omitted. A character providing commentary can be displayed as an augmented reality in the first virtual space.

[0089] Fig. 12 is an explanatory diagram showing an example of a screen displaying a character as an augmented reality. Fig. 12A is an explanatory diagram showing an example of a display screen with character explanation. Fig. 12B is an explanatory diagram showing an example of a display screen without character explanation.

[0090] The screen includes a character display field 12a and an explanation information display field 12b. The character display field 12a is a display field that displays a character. The character display field 12a is displayed in the first virtual space in accordance with the display position of the character. The explanation information display field 12b is a display field that displays explanation information explained by the character.

[0091] The user terminal 2 acquires the character image data and commentary information from a server device, etc. The character image data and commentary information may be stored in advance in the storage unit 22 or the mass storage unit 27 of the user terminal 2.

[0092] The user terminal 2 displays the acquired image data of the character in the first virtual space as an augmented reality. The display position of the character is not particularly limited. For example, the character may be displayed as an augmented reality in the globe area of ​​the first virtual space or in a real space area outside the globe area.

[0093] When the character provides an explanation, the user terminal 2 displays the acquired explanation information in the explanation information display field 12b. The explanation includes, for example, an operation method of the AR system, an explanation of the screen, or an explanation of an object (such as a cloud, raindrop, or a national flag) displayed on the screen. The user terminal 2 may display the explanation information in the explanation information display field 12b and output the explanation information through a speaker. When the character does not provide an explanation, the user terminal 2 moves the character on the globe in the first virtual space.

[0094] 12B, when a character does not provide commentary, the character is moved above the globe in the first virtual space. Note that the character is not limited to being moved above the globe, and user terminal 2 may move the character to any position around the globe or within the globe area.

[0095] 13 is a flowchart showing a processing procedure for displaying a character as an augmented reality. When the user terminal 2 holds up the globe 1 in the real space, the control unit 21 executes a subroutine for processing to display the first virtual space (step S231). The control unit 21 acquires image data and commentary information of the character from the server device via the communication unit 23 (step S232).

[0096] Control unit 21 displays the acquired image data of the character as augmented reality in the first virtual space via display unit 25 (step S233). Control unit 21 determines whether the character will provide commentary (step S234). If the character will provide commentary (YES in step S234), control unit 21 displays the acquired commentary information on display unit 25 (step S235). Control unit 21 returns to the process of step S234.

[0097] If the character does not provide commentary (NO in step S234), control unit 21 moves the character on the globe in the first virtual space (step S236). For example, control unit 21 may move the character above or to the opposite side of the globe in the first virtual space. Control unit 21 returns to the process of step S234.

[0098] Next, a process for displaying the wind flow on a globe in the first virtual space in accordance with the information relating to the wind will be described.

[0099] Fig. 14 is an explanatory diagram showing an example of a screen that displays the wind flow on a globe in the first virtual space. Note that the same reference numerals are used to denote the same contents as in Fig. 12, and the description thereof will be omitted. The screen includes an object display field 12c and a wind display field 12d.

[0100] The object display field 12c is a display field that displays an object. The object is, for example, a paper airplane, a balloon, or a kite that moves according to the flow of the wind. The wind display field 12d is a display field that displays the flow of the wind. Note that, although an example in which the object is a paper airplane is described in FIG. 14, the same can be applied to other types of objects.

[0101] The user terminal 2 acquires information about the wind at each location from an external Meteorological Agency server, a weather data distribution system, or the like. The information about the wind includes, for example, wind speed or wind direction. The user terminal 2 displays the wind flow (wind direction) according to the acquired wind information on a globe in the first virtual space. As shown in the figure, the wind flow is shown in the wind display field 12d.

[0102] In addition, the display mode of the wind flow can be changed based on the information about the wind and the information about the temperature at each location. Specifically, the user terminal 2 acquires information about the temperature at each location (temperature data) from an external server of the Japan Meteorological Agency or a weather data distribution system. For example, the information about the temperature is a temperature bitmap that indicates the temperature at each location.

[0103] The user terminal 2 changes the display color of the wind flow along with the display of the wind flow according to the information on the wind, based on the acquired information on the temperature at each position. The display color may be set appropriately according to the temperature. For example, the display color for high temperatures (28°C or higher) may be set to red, the display color for medium temperatures (10°C or higher and less than 28°C) to yellow, the display color for low temperatures (3°C or higher and less than 10°C) to blue, and the display color for extremely low temperatures (less than 3°C) to white.

[0104] The display mode of the wind flow is not limited to color coding, but may be the shape of the wind flow or any other various display formats.

[0105] The user terminal 2 acquires image data of the paper airplane from a server device or the like. The image data of the paper airplane may be stored in advance in the storage unit 22 or the large-capacity storage unit 27 of the user terminal 2. The user terminal 2 acquires an animation of a character throwing a paper airplane from a server device or the like. The animation may be stored in advance in the storage unit 22 or the large-capacity storage unit 27 of the user terminal 2.

[0106] The user terminal 2 executes the acquired animation. The user terminal 2 displays the acquired image data of the paper airplane in the object display field 12c. The user terminal 2 moves the paper airplane displayed in the object display field 12c according to the wind flow, based on the information about the wind. As shown in the figure, the paper airplane displayed in the object display field 12c moves according to the wind flow blowing from north to southeast.

[0107] The user terminal 2 may control the movement speed of the paper airplane according to, for example, wind speed.

[0108] 15 is a flowchart showing a processing procedure for displaying wind flow on a globe in the first virtual space. When globe 1 in the real space is held up, control unit 21 of user terminal 2 executes a subroutine for processing to display the first virtual space (step S241). Control unit 21 acquires information about wind (wind speed or wind direction, etc.) and information about temperature (e.g., temperature bitmap) at each position in the globe area of ​​the first virtual space from, for example, a weather data distribution system, etc., via communication unit 23 (step S242).

[0109] Control unit 21 displays, via display unit 25, the wind flow corresponding to the acquired wind-related information on the globe in the first virtual space in a display format (e.g., color-coded display) corresponding to the acquired temperature-related information (step S243).

[0110] Control unit 21 acquires character image data and object image data from the server device via communication unit 23 (step S244). Control unit 21 displays the acquired character image data as augmented reality in the first virtual space via display unit 25 (step S245).

[0111] Control unit 21 acquires an animation from the server device via communication unit 23 (step S246). For example, control unit 21 may acquire an animation of a character throwing an object (e.g., a paper airplane). Control unit 21 executes the acquired animation (step S247). Based on information about the wind, control unit 21 moves the object thrown by the character in accordance with the wind flow (step S248). Control unit 21 ends the process.

[0112] According to this embodiment, it is possible to display a character providing commentary as an augmented reality.

[0113] According to this embodiment, when a character does not provide commentary, it is possible to move the character on the globe in the first virtual space.

[0114] According to this embodiment, it is possible to display the wind flow according to the information relating to the wind on a globe in the first virtual space.

[0115] According to this embodiment, it is possible to move an object thrown by a character in accordance with the flow of wind.

[0116] (Embodiment 4) The fourth embodiment relates to a form in which the current position of the user is displayed in the first virtual space. Note that a description of the contents that overlap with the first to third embodiments will be omitted.

[0117] Fig. 16 is an explanatory diagram showing an example of a screen displaying the user's current position in the first virtual space. Fig. 16A is an explanatory diagram showing an example of the display screen when the current position is on the front side of the globe area. Fig. 16B is an explanatory diagram showing an example of the display screen when the current position is on the opposite side of the globe area.

[0118] The screen includes a current location icon 13a and a line 13b. The current location icon 13a is an icon that is associated with the user's current location and is displayed outside the globe area of ​​the first virtual space. The line 13b is a line that connects the current location icon 13a and the user's current location.

[0119] The user terminal 2 acquires the user's current location through, for example, a GPS (Global Positioning System) module or the like built into the user terminal 2. The user terminal 2 displays a current location icon 13a outside the globe area of ​​the first virtual space. The user terminal 2 generates a straight line 13b connecting the acquired current location and the displayed current location icon 13a. The user terminal 2 displays the generated straight line 13b in the first virtual space display field 11a.

[0120] As shown in FIG. 16A, when the user's current location is in front of the globe area of ​​the first virtual space, user terminal 2 displays current location icon 13a above the globe area of ​​the first virtual space in first virtual space display field 11a, and displays a straight line 13b connecting the current location and current location icon 13a.

[0121] Also, as shown in FIG. 16B, when the user's current location is on the opposite side of the globe area of ​​the first virtual space, the user terminal 2 displays a current location icon 13a in the first virtual space display field 11a, and does not display the part of the straight line 13b that is hidden by the globe.

[0122] 17 is a flowchart showing a processing procedure for displaying the user's current position in the first virtual space. When the user holds up globe 1 in the real space, control unit 21 of user terminal 2 executes a subroutine for processing to display the first virtual space (step S251). Control unit 21 acquires the user's current position, for example, through a GPS module or the like built into user terminal 2 (step S252).

[0123] Control unit 21 displays current position icon 13a indicating the obtained current position outside the globe area of ​​the first virtual space via display unit 25 (step S253). Control unit 21 generates straight line 13b connecting the obtained current position and displayed current position icon 13a (step S254). Control unit 21 determines whether or not the current position is on the opposite side of the globe area of ​​the first virtual space based on the obtained longitude and latitude of the current position (step S255).

[0124] If the current position is in front of the globe area (NO in step S255), control unit 21 displays generated straight line 13b in the first virtual space via display unit 25 (step S256). Control unit 21 ends the process.

[0125] If the current position is on the opposite side of the globe area (YES in step S255), control unit 21 performs a hiding process to hide the part of generated straight line 13b hidden by the globe (step S257). Control unit 21 displays straight line 13b that has been hidden in the first virtual space via display unit 25 (step S258). Control unit 21 ends the process.

[0126] The above-mentioned process prioritizes displaying the straight line connecting the current location icon and the user's current location over objects such as clouds in the first virtual space, making it possible to prevent the user from losing sight of the user's current location on the globe that indicates the end point of the straight line. Also, by performing a display process in which the straight line is hidden by the globe, it is possible to clearly grasp that the user's current location (the end point of the straight line) is on the opposite side of the globe area.

[0127] According to this embodiment, it is possible to display the user's current location in the first virtual space.

[0128] According to this embodiment, it is possible to display, in the first virtual space, a current position icon that is displayed outside the globe area of ​​the first virtual space, and a straight line that connects the current position icon and the current position.

[0129] (Embodiment 5) The fifth embodiment relates to a form in which a composite content icon indicating a plurality of contents is displayed in the first virtual space. Note that a description of the contents that overlap with the first to fourth embodiments will be omitted.

[0130] The contents include, for example, national flags, badges, medals, etc. When displaying a plurality of content icons in a small display area, there are problems such as not being able to fit the icons in the area, or the content icons being displayed overlapping each other, etc. For this reason, there has been a demand for a display technique for a composite content icon that can solve such problems.

[0131] In the following, an example in which the content is a national flag will be described, but the present invention can be similarly applied to other types of content.

[0132] When the national flags of neighboring countries with small land areas are displayed in the globe area of ​​the first virtual space, the national flag icons showing the national flags are displayed overlapping each other, making it difficult to distinguish the national flag icons for each country. As a result, there is a problem that it is difficult to select a national flag icon. By using a composite national flag icon showing the national flags of multiple countries, the above-mentioned problem can be solved.

[0133] For example, if the Finnish flag icon, Danish flag icon, Swedish flag icon and Norwegian flag icon were displayed separately for Finland, Denmark, Sweden and Norway, which are located in Northern Europe, they would not fit in the display area, so a composite flag icon showing the flags of the four countries can be used.

[0134] Fig. 18 is an explanatory diagram showing an example of a display screen of a national flag icon and a composite national flag icon. Fig. 18A is an explanatory diagram showing an example of a reception screen for a selection operation of a composite national flag icon. Fig. 18B is an explanatory diagram showing an example of a display screen of each national flag icon corresponding to the composite national flag icon.

[0135] The screen includes a national flag icon 14a and a composite national flag icon 14b. The national flag icon 14a is a national flag icon that shows a national flag. The composite national flag icon 14b is a composite national flag icon that shows a plurality of national flags.

[0136] For example, when showing the flags of four countries, the composite flag icon may be arranged to display the flag icons or portions of the flag icons of each country in four cells divided by four intersecting grid lines, or the composite flag icon may be arranged to reduce the flag icons of each country and display the reduced flag icons side by side within the area of ​​the composite flag icon.

[0137] The number of national flags displayed in the composite national flag icon is not particularly limited. The number of national flags displayed in the composite national flag icon is set according to the number of neighboring countries, and may be, for example, three or four.

[0138] When the user terminal 2 is held up over the globe 1 in real space, it captures a photographed image of the globe 1 via the photographing unit 26, and displays the photographed image of the globe 1 including the globe area in the first virtual space display field 11a.

[0139] The user terminal 2 identifies each position of the globe area displayed in the captured image based on the marker information in the captured image of the globe 1. For example, the user terminal 2 recognizes AR marker information according to the globe area displayed in the captured image. The user terminal 2 extracts position information based on the recognized AR marker information.

[0140] The user terminal 2 refers to the extracted location information and acquires the national flag icon of the corresponding country and a composite national flag icon showing the national flags of neighboring countries from an external server device, etc. The national flag icons and composite national flag icons may be stored in advance in the storage unit 22 or the mass storage unit 27 of the user terminal 2.

[0141] The user terminal 2 displays the acquired flag icon of each country on the corresponding flag icon 14a. The user terminal 2 generates straight lines connecting the position of each country and each flag icon 14a. The user terminal 2 displays the generated straight lines in the first virtual space display field 11a together with the display of the flag icon 14a.

[0142] The user terminal 2 displays the acquired composite national flag icon in the corresponding composite national flag icon 14b. The user terminal 2 generates a straight line connecting the position corresponding to the composite national flag icon 14b and the composite national flag icon 14b. The position corresponding to the composite national flag icon 14b may be, for example, the center position within the area of ​​the multiple countries shown in the composite national flag icon 14b, or may be the position of one of the multiple countries. The user terminal 2 displays the generated straight line in the first virtual space display field 11a together with the display of the composite national flag icon 14b.

[0143] As an example, the first virtual space display field 11a displays a composite flag icon 14b showing the flags of Finland, Denmark, Sweden, and Norway, as well as straight lines connecting the positions corresponding to these four countries to the composite flag icon 14b.

[0144] 18A and 18B, the national flag icon 14a and a straight line, and the composite national flag icon 14b and a straight line are displayed above or diagonally above the corresponding positions, but the present invention is not limited to this. For example, the national flag icon 14a and a straight line, and the composite national flag icon 14b and a straight line may be displayed below or diagonally below the corresponding positions.

[0145] When the user terminal 2 accepts a selection operation of the composite national flag icon 14b, the user terminal 2 displays a combination of the corresponding national flag icon 14a of each country and a straight line separately. For example, the user terminal 2 accepts a selection operation of the composite national flag icon 14b showing the flags of Finland, Denmark, Sweden, and Norway.

[0146] As shown in FIG. 18B, the user terminal 2 separates from the selected composite national flag icon 14b the combination of the Finland flag icon 14a, the Denmark flag icon 14a, the Sweden flag icon 14a, and the Norway flag icon 14a corresponding to the composite national flag icon 14b, and straight lines (straight lines connecting these national flag icons 14a with the positions of each country).

[0147] The user terminal 2 displays the separated flag icons 14a of the four countries and the straight lines connecting the positions of each country and each flag icon 14a above the globe area of ​​the first virtual space. Note that the display position after separation is not limited to the above the globe area, and may be any displayable area.

[0148] 19 is a flowchart showing the processing procedure when accepting a selection operation of a composite national flag icon. When the globe 1 in the real space is held over the user terminal 2, the control unit 21 executes a subroutine for processing to display the first virtual space (step S261). According to the position information extracted based on the AR marker information, the control unit 21 acquires the national flag icons of the corresponding countries and a composite national flag icon including the national flags of multiple countries from the server device via the communication unit 23 (step S262).

[0149] The control unit 21 displays the acquired flag icons of each country and the straight lines connecting the positions of each country and each flag icon 14a at a predetermined position in the first virtual space via the display unit 25 (step S263). The predetermined position may be, for example, above or diagonally above the positions of each country.

[0150] The control unit 21 displays each of the acquired composite national flag icons and a line connecting each composite national flag icon to a position corresponding to each of the composite national flag icons at a predetermined position in the first virtual space via the display unit 25 (step S264). The predetermined position may be, for example, above or diagonally above the position corresponding to the composite national flag icon.

[0151] The control unit 21 accepts a selection operation of the composite national flag icon via the input unit 24 (step S265). The control unit 21 acquires the national flag icons of the countries corresponding to the selected composite national flag icon from the server device via the communication unit 23 (step S266). The control unit 21 displays the acquired national flag icons of the countries and the straight lines connecting the positions of the countries and the national flag icons at a predetermined position in the first virtual space (for example, above the globe area) via the display unit 25 (step S267). The control unit 21 ends the process.

[0152] According to this embodiment, it is possible to display a content icon and a straight line at a predetermined position in the first virtual space.

[0153] According to this embodiment, it is possible to display a compound content icon and a straight line at a predetermined position in the first virtual space.

[0154] According to this embodiment, when the selection of a composite content icon is accepted, it is possible to separately display the combination of the content icon of each corresponding content and a straight line.

[0155] The embodiments disclosed herein are illustrative in all respects and should not be considered as limiting. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the scope and meaning equivalent to the claims.

[0156] The matters described in each embodiment can be combined with each other. In addition, the independent claims and dependent claims described in the claims can be combined with each other in any combination regardless of the reference format. Furthermore, the claims use a format in which a claim references two or more other claims (multiple claim format), but this is not limited to this format. [Explanation of symbols]

[0157] 1. Globe 2. Information processing terminal (user terminal) 21 Control section 22 Memory section 23 Communications Department 24 Input section 25 Display section 26 Photography Department 27 Mass storage 2P control program

Claims

1. Obtain the cloud altitude for each location, When a globe in real space is held up, the globe in the first virtual space is displayed in response to the movement of the globe, and clouds according to a specified altitude are displayed in 3D at the corresponding position in the first virtual space. A program that causes a computer to carry out processing.

2. Obtaining infrared images of clouds, Estimate the cloud height at each of the above locations based on the acquired infrared images. The program according to claim 1.

3. The cloud shading at each position is adjusted based on the line of sight to the globe in the first virtual space and the altitude of the cloud at each position.

3. The program according to claim 1 or 2.

4. Calculate the cloud slope based on the cloud height at each location, Adjust the brightness of the clouds at each position based on the light source and the calculated cloud-to-cloud gradient 3. The program according to claim 1 or 2.

5. Get the amount of precipitation for each location, Display raindrop animations at each location according to the amount of precipitation obtained 3. The program according to claim 1 or 2.

6. determining a precipitation amount for an area identified by the plurality of locations; Select areas according to weights according to the identified precipitation amounts, Display the raindrop animation within a selected area The program according to claim 5.

7. Get the temperature at each location, Displaying a snow animation instead of the raindrop animation at a location where the acquired temperature is below a predetermined temperature The program according to claim 5.

8. The character providing the commentary is displayed as augmented reality. When the character does not provide commentary, the character is moved on a globe in the first virtual space.

3. The program according to claim 1 or 2.

9. Obtain wind information for each location, displaying a wind flow on a globe in the first virtual space according to the acquired wind information; The object thrown by the character is moved according to the wind flow. The program according to claim 8.

10. Obtaining wind and temperature information for each location; A wind flow corresponding to the obtained wind information is displayed on the globe of the first virtual space in a display mode corresponding to the obtained temperature information.

3. The program according to claim 1 or 2.

11. Get the user's current location, The acquired current location of the user is displayed in the first virtual space.

3. The program according to claim 1 or 2.

12. A current location icon is displayed outside a globe area of ​​the first virtual space, and a straight line connecting the current location icon and the current location is displayed in the first virtual space. The program according to claim 11.

13. When the current position is on the opposite side of the globe area of ​​the first virtual space, the current position icon is displayed, and the straight line in the portion hidden by the globe is not displayed. The program according to claim 12.

14. A content icon and a straight line representing the content are displayed at a predetermined position; A composite content icon representing a plurality of contents and a straight line are displayed at a predetermined position; When the selection of a composite content icon is accepted, the combination of the content icon of each corresponding content and a straight line is displayed separately.

3. The program according to claim 1 or 2.

15. Obtain the cloud altitude for each location, When a globe in real space is held up, the globe in the first virtual space is displayed in response to the movement of the globe, and clouds according to a specified altitude are displayed in 3D at the corresponding position in the first virtual space. An information processing method in which processing is performed by a computer.

16. An information processing device including a control unit, The control unit is Obtain the cloud altitude for each location, When a globe in real space is held up, the globe in the first virtual space is displayed in response to the movement of the globe, and clouds according to a specified altitude are displayed in 3D at the corresponding position in the first virtual space. Information processing device.

Images