Management Server

The system generates AR precipitation videos based on user-specific weather data and building information to simulate and assess leak risks, addressing the inefficiencies in existing leak assessment methods.

JP7624754B2Active Publication Date: 2025-01-31木島 忠興
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023098515
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-06-15
Publication Date
2025-01-31
Estimated Expiration
2043-06-15

AI Technical Summary

Technical Problem

Existing systems struggle to intuitively and efficiently assess the potential for leaks in buildings based on weather information, as expressions like '15 mm per hour, 10 meters of wind speed' do not provide clear insights into actual precipitation levels, making it difficult to identify leaked areas effectively.

Method used

A system that generates an Augmented Reality (AR) precipitation video based on user-specific weather data and building information, allowing users to simulate and visualize precipitation conditions at desired dates and locations, and assess potential leaks.

Benefits of technology

Enables users to efficiently and intuitively assess leak risks by providing a simulated AR precipitation video, facilitating accurate leak surveys without on-site measurements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007624754000001
    Figure 0007624754000001
  • Figure 0007624754000002
    Figure 0007624754000002
  • Figure 0007624754000003
    Figure 0007624754000003
Patent Text Reader

Abstract

To provide an AR precipitation moving image generation system that generates a pseudo precipitation moving image based upon data related to rain leak inspection that a user desires and meteorological information, and inspects a possibility of rain leak of a building at time on a day and in a place that the user desires.SOLUTION: There are provided a user terminal 100, a meteorological information DB 110, and a management server 120 that is connected to the user terminal 100 and meteorological DB 110 through a network, and the management server has an AR precipitation moving image generation part 140 which generates an AR precipitation moving image 700 based upon AR data 210 included in user information 200 received from the user terminal 100 and detail data 310 included in meteorological information 300 acquired from the meteorological information DB 110.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a management server. [Background technology]

[0002] In the past, to efficiently conduct water sprinkling surveys for leak detection in buildings, the wind direction and rainfall amount at the time of the leak were obtained from meteorological information. However, for example, descriptions such as "15 mm per hour, wind speed 10 meters" did not allow intuitive understanding of the scale of precipitation, and there was a possibility that a water sprinkling survey would be conducted with a scale different from the actual precipitation, making it difficult to efficiently identify the location of the leak. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2014-240754 A Summary of the Invention [Problem to be solved by the invention]

[0004] For example, Patent Document 1 discloses a weather information providing device that provides weather information and weather-related disaster prevention information.

[0005] However, Patent Document 1 is not intended to be directed to an AR (Augmented Reality, meaning "augmented reality"; the same applies below) precipitation video generation system that generates pseudo precipitation videos based on data related to rain leak investigations desired by the user and weather information, and verifies the possibility of rain leaks in buildings at a desired date, time, and location.

[0006] The object of the present invention is to provide an AR precipitation video generation system that generates a pseudo precipitation video based on data related to rain leak investigations desired by a user and meteorological information, and verifies the possibility of rain leaks in a building at a desired date, time, and location. [Means for solving the problem]

[0007] Among the inventions disclosed in this application, a brief summary of representative inventions is as follows.

[0008] One embodiment of the present invention includes a user terminal 100, a weather information DB 110, and a management server 120 connected to the user terminal 100 and the weather information DB 110 via a network, and includes an AR precipitation movie generating unit 140 that generates an AR precipitation movie 700 based on AR data 210 included in user information 200 received from the user terminal 100 and detailed data 310 included in weather information 300 acquired from the weather information DB 110. The management server 120 also includes an AR precipitation movie providing unit 150 that provides the generated AR precipitation movie 700 to the user terminal 100. Effect of the Invention

[0009] According to the present invention, a management server can provide an AR precipitation video generation system that generates a simulated precipitation video based on data related to a rain leak investigation desired by a user and meteorological information, and verifies the possibility of rain leaks in a building at a desired date, time, and location. [Brief description of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating an overview of a configuration example of an AR precipitation animation generation system according to an embodiment of the present invention. [Diagram 2] 1A to 1C are diagrams showing an overview of user information, AR data, and verification data stored in a user information storage unit of a management server in an embodiment of the present invention. [Diagram 3] FIG. 2 is a diagram showing an overview of meteorological information and detailed data stored in a meteorological information DB of the AR precipitation animation production system in one embodiment of the present invention. [Figure 4] FIG. 2 is a diagram showing an overview of the entire process according to an embodiment of the present invention. [Diagram 5]1A to 1C are diagrams illustrating an overview of a user information acquisition process and a user information storage process according to an embodiment of the present invention. [Figure 6] FIG. 2 is a diagram showing a flow of AR precipitation video generation in one embodiment of the present invention. [Figure 7] FIG. 1 is a diagram showing an outline of an AR precipitation video according to an embodiment of the present invention. [Figure 8] FIG. 1 is a diagram showing an overview of an AR precipitation video generation process according to an embodiment of the present invention. [Figure 9] FIG. 1 is a diagram showing an overview of an AR precipitation video providing process according to an embodiment of the present invention. [Figure 10] FIG. 1 is a diagram showing an overview of a risk index calculation process and a risk index storage process according to an embodiment of the present invention. [Figure 11] FIG. 1 is a diagram showing an overview of a verification process according to an embodiment of the present invention. [Figure 12] FIG. 13 is a diagram showing an outline of a verification result screen according to an embodiment of the present invention. [Figure 13] FIG. 13 is a diagram showing an outline of a verification result screen generation process according to an embodiment of the present invention. [Figure 14] FIG. 13 is a diagram showing an outline of a verification result screen providing process according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Note that this is merely an example, and the technical scope of the present invention is not limited to this example. In addition, in all drawings for explaining the embodiment, the same parts are generally given the same reference numerals, and repeated explanations will be omitted. <System configuration> FIG. 1 is a diagram showing an outline of a configuration example of an AR precipitation animation generation system according to an embodiment of the present invention.

[0012] As shown in FIG. 1, the AR precipitation animation generation system according to this embodiment includes a user terminal 100, a weather information DB 110, and a management server 120 connected to the user terminal 100 and the weather information DB 110 via a network.

[0013] The management server 120 has a user information storage unit 130, an AR precipitation video storage unit 131, a danger index storage unit 132, a verification result screen storage unit 133, an AR precipitation video generation unit 140, an AR precipitation video providing unit 150, a danger index calculation unit 160, a verification unit 170, a verification result screen generation unit 180, and a verification result screen providing unit 190.

[0014] The user information storage unit 130 stores user information 200 (described later, FIG. 2). The weather information DB 110 stores weather information 300 (described later, FIG. 3). The AR precipitation video storage unit 131 stores an AR precipitation video 700 (described later, FIG. 7). The verification result screen storage unit 133 stores a verification result screen 1200 (described later, FIG. 12).

[0015] The AR precipitation video generation unit 140 extracts AR data 210 included in user information 200 acquired from the user information storage unit 130, acquires weather information 300 corresponding to the contents of each item of the extracted AR data 210 from the weather information DB 110, extracts detailed data 310 included in the acquired weather information 300, generates an AR precipitation video 700 based on the AR data 210 and the detailed data 310, and stores the AR precipitation video 700 in the AR precipitation video storage unit 131.

[0016] The AR raining video providing unit 150 provides the generated AR raining video 700 to the user terminal 100.

[0017] The risk index calculation unit 160 calculates a risk index 1000 based on the risk index information 900 acquired from the user terminal 100 .

[0018] The verification unit 170 extracts the verification data 220 included in the user information 200 acquired from the user information storage unit 130, acquires the weather information 300 and risk index 1000 corresponding to the contents of each item of the extracted verification data 220, and generates a verification result 1100 by calculating the possibility of a leak at the date, time, place, and building included in the verification data 220 based on the acquired weather information 300 and risk index 1000.

[0019] The verification result screen generating unit 180 acquires the verification result 1100 from the verification unit 170 , generates a verification result screen 1200 based on the acquired verification result 1100 , and stores the verification result screen 1200 in the verification result screen storage unit 133 .

[0020] The verification result screen providing unit 190 provides the generated verification result screen 1200 to the user terminal 100 . <User information storage unit> FIG. 2(a) is a diagram showing an outline of an example of the configuration of user information 200 stored in the user information storage unit 130 of the management server 120 in one embodiment of the present invention.

[0021] As shown in FIG. 2(a), the user information 200 is composed of data items such as a user ID, a name, AR data 210, and verification data 220.

[0022] The user ID indicates a code by which the management server 120 identifies the user. The name indicates the user's name. The AR data 210 indicates data required to generate the AR precipitation video 700 that the user terminal 100 acquires by accepting input from the user (details will be described later). The verification data 220 indicates data required to generate the verification result 1100 that the user terminal 100 acquires by accepting input from the user (details will be described later).

[0023] 2(b) is a diagram showing an outline of a configuration example of AR data 210 included in the user information 200 stored in the user information storage unit 130 of the management server 120 according to an embodiment of the present invention. The AR data 210 indicates information such as an AR data ID, shooting data, desired AR date and time, and desired AR location.

[0024] The AR data ID indicates a code that the management server 120 uses to identify the AR data 210 .

[0025] The shooting data indicates video data actually captured by the user on-site of a building that the user desires to display in the AR precipitation video 700. For example, the shooting data is indicated as "XXX.mp4". The time and capacity of the shooting data are not particularly limited. The shooting data may be directly captured by the user terminal 100 using a camera function provided in the terminal, or may be video data captured by an external camera and received and stored by the user terminal 100.

[0026] The shooting data is stored together with the video data in association with the shooting date and time. Furthermore, the shooting data is stored in association with various information such as the position, acceleration, and direction acquired by a GPS, a gyro sensor, etc., provided in the user terminal 100.

[0027] The AR desired date and time indicates the date and time of precipitation that the user desires to display in the AR precipitation video 700. For example, the AR desired date and time is indicated as "23 / 3 / 15, 9:10." In this manner, the AR precipitation video 700 can virtually display the precipitation conditions for the user's desired date and time.

[0028] The AR desired location indicates a location of precipitation that the user desires to display in the AR precipitation video 700. For example, the AR desired location is indicated as "XX ward, Omiya city...". In this way, the AR precipitation video 700 can virtually display the precipitation conditions for the user's desired location.

[0029] In this way, the management server 120 can generate the AR precipitation video 700 that simulates the precipitation conditions at the date, time, place, and building desired by the user. In other words, the user can easily view the AR precipitation video 700 at the date, time, place, and building desired by the user.

[0030] 2(c) is a diagram showing an outline of a configuration example of the verification data 220 included in the user information 200 stored in the user information storage unit 130 of the management server 120 in one embodiment of the present invention. The verification data 220 indicates information such as a verification data ID, building data, desired verification date and time, and desired verification location.

[0031] The verification data ID indicates a code by which the management server 120 identifies the verification data 220 .

[0032] The building data indicates information about the building for which the user wishes to verify the possibility of leaks. For example, the building data indicates the structure and age of the building, such as "two-story wooden structure, 21 years old." The building data also includes "finishing materials, thickness, size, and length of the walls, ceiling, roof, floor, pillars, and beams."

[0033] The desired verification date and time indicates the date and time of precipitation that occurred in the building for which the user wishes to verify the possibility of rain leakage. For example, the desired verification date and time is indicated as "'23 / 4 / 15, 9:10." In this way, the management server 120 allows the user to grasp the possibility of rain leakage in the building for the desired date and time.

[0034] The desired verification location indicates the location where precipitation occurred in the building for which the user wishes to verify the possibility of rain leakage. For example, the desired verification location is indicated as "XX ward, Yokohama city...". In this way, the management server 120 allows the user to grasp the possibility of rain leakage in the building for the desired location.

[0035] In this manner, the management server 120 can allow the user to know the possibility of rain leaks at the date, time, place, and building desired by the user. In other words, the user can easily know the possibility of rain leaks at the date, time, place, and building desired by the user. <Weather information database> FIG. 3(a) is a diagram showing an overview of weather information 300 stored in the weather information DB 110 of the AR precipitation animation generation system in one embodiment of the present invention.

[0036] As shown in FIG. 3( a ), the weather information 300 is made up of data items such as a weather information ID, a date and time, a location, and detailed data 310 .

[0037] The weather information ID indicates a code by which the management server 120 identifies the weather information 300 .

[0038] The date and time indicates the date and time to which the weather information 300 pertains. For example, the date and time is indicated as "'23 / 3 / 15, 8:10".

[0039] The location indicates the location to which the weather information 300 applies. For example, the location is indicated as "XX ward, Tokyo...".

[0040] The detailed data 310 indicates information necessary for verifying the weather information 300 desired by the user (details will be described later).

[0041] FIG. 3(b) is a diagram showing an overview of detailed data 310 stored in the weather information DB 110 of the AR precipitation animation production system according to one embodiment of the present invention.

[0042] As shown in FIG. 3(b), the detailed data 310 is made up of data items such as a weather information ID, precipitation, wind direction, wind speed (average wind speed and maximum instantaneous wind speed), and temperature.

[0043] The amount of precipitation indicates the amount of rain or snowfall at the date, time and place corresponding to the weather information 300. More specifically, the amount of precipitation indicates the depth of water that has accumulated on the ground surface without evaporating or running off, such as rain, snow, hail, or sleet. The unit of precipitation is millimeters (per hour). For example, the amount of precipitation is indicated as "25 mm / h".

[0044] The wind direction indicates the direction of the wind at the date, time and place corresponding to the weather information 300. More specifically, the wind direction indicates the direction from which the wind blows using 16 compass directions. For example, the wind direction is indicated as "south-southeast."

[0045] The wind speed indicates the speed at which the wind blows at the date, time and location corresponding to the weather information 300. More specifically, the wind speed indicates the distance that air moves in one second. Note that the wind speed may include the average wind speed and the maximum instantaneous wind speed as separate information. The average wind speed indicates the average wind speed for the previous 10 minutes at a time approximately 10 meters above the ground. Furthermore, the maximum instantaneous wind speed indicates the maximum value of the instantaneous wind speed (instantaneous value of wind speed) in a specified time period or period. The unit of wind speed is meters per second. For example, the average wind speed is indicated as "11.3 m / s" and the maximum instantaneous wind speed is indicated as "18.0 m / s".

[0046] The temperature indicates the air temperature at the date, time and place corresponding to the weather information 300. For example, the temperature is indicated as "20°C". <Overall processing> FIG. 4 is a diagram showing an overview of the entire process in one embodiment of the present invention.

[0047] First, in S401, the management server 120 performs a user information acquisition process and a user information storage process (described later with reference to FIG. 5).

[0048] Next, in S402, the management server 120 performs an AR precipitation video generation process (described later with reference to FIGS. 6 to 8).

[0049] Next, in S403, the management server 120 performs an AR precipitation video providing process (described later with reference to FIG. 9).

[0050] Next, in S404, the management server 120 performs a risk index calculation process and a risk index storage process (described later with reference to FIG. 10).

[0051] Next, in S405, the management server 120 performs a verification process (described later with reference to FIG. 11).

[0052] Next, in S406, the management server 120 performs a verification result screen generation process (described later in FIG. 12 and FIG. 13). After that, in S407, the management server 120 performs a verification result screen provision process (described later in FIG. 14).

[0053] If the user wishes to re-verify, the management server 120 proceeds to step S401. <User information storage process> 5(a) is a diagram showing an overview of the user information storage process in one embodiment of the present invention. A method in which the management server 120 stores the user information 200 will be described below.

[0054] First, in S501, the management server 120 provides a user information input screen to the user terminal 100. Next, in S502, the user terminal 100 displays the user information input screen on the display.

[0055] Thereafter, when the user uses the system according to the present invention for the first time, or when the user changes (re-verifies) the verification data 220, in S503, the user terminal 100 accepts input of the user information 200 from the user. Note that the user information 200 accepted from the user at this time includes the verification data 220.

[0056] Next, in S504, the user terminal 100 transmits to the management server 120 the user information 200 inputted and accepted in S503.

[0057] Next, at S505, the management server 120 obtains the user information 200 by receiving the user information 200 transmitted at S504. Next, at S506, the management server 120 attaches a user ID to the received user information 200 and stores the user information 200 received at S503 in the user information storage unit 130. <User Information Acquisition Process> FIG. 5(b) is a diagram showing an overview of the user information acquisition process in an embodiment of the present invention. Hereinafter, a method for the management server 120 to obtain the user information 200 will be described.

[0058] When the user uses the system according to the present invention for the second time or later, at S507, the user terminal 100 receives an input of the user ID from the user. Note that the user ID is included in the user information 200.

[0059] Next, at S508, the user terminal 100 transmits the user ID received at S507 to the management server 120.

[0060] Thereafter, at S509, the management server 120 obtains the user information 200 corresponding to the key of the user ID transmitted at S508 from the user information storage unit 130. <Flow of AR Precipitation Video Generation> FIG. 6 is a diagram showing the flow of AR precipitation video generation in an embodiment of the present invention.

[0061] As shown in FIG. 6, first, user 101 takes a picture of the actual appearance of the building with user terminal 100. At this time, using known means by the camera function provided in user terminal 100, user 101 takes a picture of building 610. Also, this building 610 is the building that the user wishes to display in AR precipitation video 700. Also, the shooting date and time are not particularly limited, and user 101 takes the picture at any date and time convenient for the user. Note that the captured video data is stored as "captured data" linked to the date and time, location, etc. as part of AR data 210. That is, (since AR data 210 is included in user information 200), the captured data is stored in user terminal 100 as part of user information 200.

[0062] Next, when the user uses this system, user terminal 100 transmits user information 200 including the captured data to management server 120 (already described in FIG. 5, S504). After that, in the process described later (FIG. 8), management server 120 receives weather information 300 near building 610 at the AR desired date and time (for example, '23 / 3 / 15, 9:10) from weather information DB 110.

[0063] Then, through the process described later, management server 120 generates AR precipitation video 700 and provides it to user terminal 100. <AR precipitation video> FIG. 7 is a diagram showing an overview of AR precipitation video 700 in an embodiment of the present invention.

[0064] As shown in FIG. 7, AR precipitation video 700 includes a video display area 710, an AR data display area 720, a rain leakage possibility input tab 730, and a precipitation layer 740. AR precipitation video 700 is displayed on user terminal 100.

[0065] Video display area 710 displays the content (video) of AR precipitation video 700 generated based on AR data 210 extracted by management server 120 in S802 described later and detailed data 310 extracted by management server 120 in S804.

[0066] The video display area 710 first displays the content of the image capturing data at the desired AR date and time and the desired AR location included in the AR data 210. For example, the video display area 710 first displays the exterior of a building 610 located at the location "XX Ward..., Omiya City" at the date and time "3 / 15 / '23, 9:10."

[0067] The video display area 710 displays a "precipitation layer 740" generated based on the detailed data 310 included in the weather information 300 corresponding to the desired AR date and time and the desired AR location. The precipitation layer 740 displays a pseudo precipitation line (rain pattern) by moving line segment data of a predetermined length at a predetermined angle and at a predetermined interval from the top to the bottom of the screen. The precipitation layer 740 is generated based on a simulation program that reflects the contents of the detailed data 310 (weather information 300).

[0068] For example, if the contents of the detailed data 310 for "XX ward, Omiya city..." on "'23 / 3 / 15, 9:10" are "precipitation: 25 mm / h," "wind direction: south-southeast," "average wind speed: 11.3 m / s," "temperature: 20°C," etc., the precipitation layer 740 is generated by reflecting these contents in the program. In other words, the pseudo precipitation lines (rain patterns) that make up the precipitation layer 740 have the amount of line segments, angle, speed of movement, etc. determined from information on the precipitation amount, wind direction, wind speed, etc.

[0069] Then, the moving image display area 710 displays the precipitation layer 740 so as to be superimposed on the layer displaying the building 610. In this way, the moving image display area 710 displays a simulated precipitation condition at a date, time, and place desired by the user. Note that there is no particular limitation on the way in which the moving image display area 710 is displayed.

[0070] The AR data display area 720 displays the contents of the AR data 210.

[0071] The rain leakage possibility input tab 730 displays a tab for a user who has viewed the AR precipitation video 700 to input information about the possibility of rain leakage in the building 610. For example, the rain leakage possibility input tab 730 may display "Possibility: 70" or "South - east wall on the first floor", etc. This indicates the locations (walls, ceilings, roofs, floors, etc.) of the building where the possibility of rain leakage is high, and it may be preset so that they can be selected in advance. Also, the possibility may be a numerical value from 1 to 100, or it may be a five - level evaluation, etc., and is not particularly limited.

[0072] In this way, by generating the AR precipitation video 700 and providing it to the user terminal 100, the management server 120 can generate the AR precipitation video 700 that pseudo - displays the precipitation situation at the date, time, location, and building desired by the user. That is, the user can easily view the AR precipitation video 700 of the date, time, location, and building they desire.

[0073] Also, by providing the rain leakage possibility input tab 730, the management server 120 can obtain what is so - called "the risk level of rain leakage evaluated by the user who has viewed the AR precipitation video 700", and use this to calculate the risk index 1000 (details will be described later).

[0074] In this way, the intuitive risk level of rain leakage in the building evaluated by the user who has viewed the AR precipitation video 700 can be associated with the building, and the management server 120 can cause other users to verify the possibility of rain leakage for the desired date, time, location, and building through a verification process (details will be described later). <AR precipitation video generation process> Figure 8 is a diagram showing an overview of the AR precipitation video generation process in an embodiment of the present invention.

[0075] First, in S801, the AR precipitation video generation unit 140 of the management server 120 acquires the user information 200 required for generating the AR precipitation video 700 from the user information storage unit 130.

[0076] Next, in S802, the AR precipitation video generator 140 extracts the AR data 210 included in the user information 200 acquired in S801.

[0077] Next, in S803, the AR precipitation video generating unit 140 acquires the weather information 300 corresponding to the contents of each item of the AR data 210 extracted in S802 from the weather information DB 110. More specifically, the weather information 300 corresponding to the contents of the desired AR date and time, the desired AR location, etc. included in the AR data 210 is acquired. For example, when the desired AR date and time is "23 / 3 / 15, 9:10" and the desired AR location is "XX ward, Omiya city..." among the items of the AR data 210 acquired in S801, the weather information 300 corresponding to the date and time and location is extracted.

[0078] Next, in S804, the AR precipitation video generator 140 extracts the detailed data 310 included in the weather information 300 acquired in S803.

[0079] Next, in S805, the AR precipitation moving image generator 140 generates the AR precipitation moving image 700 based on the AR data 210 extracted in S802 and the detailed data 310 extracted in S804.

[0080] As described above, the AR precipitation video generator 140 generates the AR precipitation video 700 by including a "video display area 710" that displays the contents of the shooting data at the desired AR date and time and the desired AR location included in the AR data 210. In addition, the video display area 710 displays a "precipitation layer 740" that is generated based on the detailed data 310 (amount of precipitation, wind direction, wind speed, temperature, etc.) included in the weather information 300 that corresponds to the desired AR date and time and the desired AR location included in the extracted AR data 210.

[0081] Next, in S806, the AR precipitation moving image generating unit 140 stores the AR precipitation moving image 700 generated in S805 in the AR precipitation moving image storage unit 131.

[0082] Next, in S807, the AR raining movie generation unit 140 requests the AR raining movie provision unit 150 to provide the AR raining movie 700. <AR precipitation video providing process> FIG. 9 is a diagram showing an overview of a configuration example of the AR precipitation video providing process according to an embodiment of the present invention.

[0083] First, in S901, the AR precipitation video providing unit 150 of the management server 120 receives a request for providing the AR precipitation video 700 requested in S807.

[0084] Next, in S902, the AR precipitation video providing unit 150 extracts the AR precipitation video 700 stored in S806 from the AR precipitation video storage unit 131.

[0085] Next, in S903, the AR precipitation video providing unit 150 extracts user information 200 corresponding to the user ID of the user who wants to provide the AR precipitation video 700 extracted in S902 from the user information storage unit 130.

[0086] Next, in S904, the AR precipitation video providing unit 150 provides the AR precipitation video 700 extracted in S903 to the user terminal 100.

[0087] Next, in S905, the user terminal 100 displays the AR precipitation video 700 provided from the management server 120 in S904 on the display of the terminal.

[0088] Next, in S906, the user terminal 100 receives an input from the user to the rain leakage possibility input tab 730 included in the AR precipitation video 700. That is, first, the user views the provided AR precipitation video 700 and inputs or selects the possibility of rain leakage in the building 610 and the locations (wall surface, floor, roof, floor number, direction, etc.) where the possibility is high to the "rain leakage possibility input tab 730". Note that the rain leakage possibility input tab 730 may allow the user to freely input characters, or numerical values indicating the possibility of rain leakage and candidates for the locations where the possibility is high may be preset in advance, and the user may select from among them.

[0089] For example, if the user watches the AR precipitation video 700 and judges that "the wind and rain are hitting the southeast wall of the first floor strongly, so there is a high possibility of rain leaking from the southeast wall of the first floor," the user selects or inputs "rain leak possibility: 70%, location: southeast wall of the first floor" in the rain leak possibility input tab 730. In this way, the user terminal 100 accepts input from the user to the rain leak possibility input tab 730 included in the AR precipitation video 700.

[0090] Next, in S907, the user terminal 100 temporarily stores the content received in S906 as risk index information 900.

[0091] In S908, the user terminal 100 transmits a risk index calculation instruction to the management server 120. Thereafter, the management server 120 requests the risk index calculation unit 160 to calculate the risk index 1000.

[0092] In this way, by generating the AR precipitation video 700 and providing it to the user terminal 100, the management server 120 can generate the AR precipitation video 700 that simulates the precipitation conditions at the date, time, place, and building desired by the user. In other words, the user can easily view the AR precipitation video 700 at the date, time, place, and building desired by the user. <Danger index calculation process> FIG. 10 is a diagram showing an outline of the risk index calculation process and the risk index storage process in one embodiment of the present invention.

[0093] First, in S1001, the risk index calculation unit 160 of the management server 120 receives the request for the risk index calculation process requested in S908.

[0094] Next, in S1002, the risk index calculation unit 160 acquires the risk index information 900 that the user terminal 100 temporarily stored in S907.

[0095] Next, in S1003, the risk index calculation unit 160 calculates a risk index 1000 based on the risk index information 900 acquired in S1002. For example, if the content of the risk index information 900 is "rain leak possibility: 70%, location: southeast wall on the first floor", the risk index calculation unit 160 calculates the risk index 1000 to be "75." The value of the risk index 1000 is indicated by a value from 1 to 100, etc., and the higher the value, the higher the possibility of rain leaks.

[0096] Also, the method of calculating the risk index 1000 is not particularly limited, but for example, the risk index 1000 is calculated as a value of "rain leakage possibility x coefficient α". A predetermined value is set for this coefficient α depending on the location of the wall. For example, it is set as "coefficient α of the southeast wall of the first floor = 1.07". The value of the coefficient α is set according to "which wall is prone to rain leakage" based on past cases of rain leakage, but it may be set arbitrarily. In this way, the risk index calculation unit 160 can calculate the risk index 1000 based on the contents of the risk index information 900.

[0097] The risk index 1000 can be said to be "the risk of rainwater leakage evaluated by the user who viewed the AR precipitation video 700" and can be regarded as a value that is specific to the building. Using the risk index 1000, which is a "value that is specific to the building", the management server 120 can calculate the verification result 1100 by the method described later.

[0098] Next, in S1004, the risk index calculation section 160 stores the generated risk index 1000 in the risk index storage section 132. <Verification process> FIG. 11 is a diagram showing an outline of the verification process in one embodiment of the present invention.

[0099] First, in S1101, the verification unit 170 of the management server 120 acquires the user information 200 from the user information storage unit 130 and extracts the verification data 220.

[0100] Next, in S1102, the verification unit 170 acquires from the weather information DB 110 the weather information 300 corresponding to the contents of the items of the verification data 220 extracted in S1101. More specifically, the weather information 300 corresponding to the contents of the desired verification date and time, the desired verification location, etc., included in the verification data 220 is acquired. For example, if the desired verification date and time of "23 / 4 / 15, 9:10" and the desired verification location of "XX Ward, Yokohama City..." are among the items of the verification data 220 extracted in S1101, the weather information 300 corresponding to the date and time and location is extracted.

[0101] Next, in S1103, the verification unit 170 obtains a danger index 1000 corresponding to the contents of the items of the verification data 220 extracted in S1101 from the danger index storage unit 132. More specifically, the verification unit 170 obtains a danger index 1000 corresponding to the contents of the building data, the desired verification location, etc., included in the verification data 220. For example, when the building data of the items of the verification data 220 extracted in S1101 is "wooden, 2 stories, built 21 years ago" and the desired verification location is "XX Ward, Yokohama City...", the verification unit 170 extracts a danger index 1000 for the building corresponding to the building data and location.

[0102] Next, in S1104, the verification unit 170 generates and temporarily stores a verification result 1100 by calculating the possibility of a leak in the date, time, place, and building included in the verification data 220 based on the weather information 300 acquired in S1102 and the risk index 1000 acquired in S1103.

[0103] The method of calculating the verification result 1100 is not particularly limited, but for example, the verification result 1100 is calculated as a value of "risk index 1000 x coefficient β." In other words, the verification result 1100 is calculated by first using the weather conditions (presence or absence of precipitation) at the date, time, and location to be verified as a criterion, and multiplying the risk index 1000 (which is a building-specific value, so to speak) linked to the date, time, and location and building by the coefficient β, which is set according to the strength of precipitation and wind and rain.

[0104] For example, if the verification data 220 is building data “2-story wooden structure, built 21 years ago,” desired verification date and time “23 / 4 / 15, 9:10,” and desired verification location “XX ward, Yokohama city...,” and the weather information 300 corresponding to the building data, date, time, and location is “no precipitation (coefficient β=0),” then regardless of the value of the risk index 1000, the possibility of a leak will be 0, and the verification result 1100 will be calculated as “leak risk: 0.”

[0105] In other words, as mentioned above, the risk index 1000 is, so to speak, a "building-specific value" regarding the risk of rainwater leakage, whereas the verification result 1100 can be said to be "a value that changes according to the weather information of the date, time, and place to be verified." For example, if there is a building Y (a building rated by many users as having a high risk of rainwater leakage), no matter how high the risk index 1000 is, if the date and time verified by a certain user is "sunny," the verification result 1100 value for building Y will be calculated as "0."

[0106] Next, in S1105, the verification unit 170 requests the verification result screen generation unit 180 to generate a verification result screen 1200.

[0107] In this way, by calculating the verification result 1100 by combining (multiplying) the risk index 1000 and the weather information 300, the management server 120 can obtain not just a building-specific rain leak risk but a rain leak risk corresponding to the weather conditions at the verification date and time desired by the user. Then, the management server 120 can generate a verification result screen 1200 using this verification result 1100. In other words, the management server 120 can provide the user with more reliable information about the possibility of rain leaks. <Verification result screen> FIG. 12 is a diagram showing an overview of a verification result screen 1200 according to an embodiment of the present invention.

[0108] 12, the verification result screen 1200 includes a verification data display area 1210, a verification result display area 1220, and a re-verification tab 1230. The verification result screen 1200 is displayed on the user terminal 100.

[0109] The verification data display area 1210 displays the contents of the verification data 220 relating to the date, time, place, and building for which the user wishes to verify the possibility of rain leakage. Note that there is no particular limitation on the way in which the verification data display area 1210 is displayed.

[0110] The verification result display area 1220 displays the contents of the verification result 1100 calculated by the verification unit 170. For example, the verification result display area 1220 displays the contents of the verification result 1100 such as "Risk of rain leakage: 75%". Note that there is no particular limitation on how the verification result display area 1220 is displayed.

[0111] In this way, by providing the verification result screen 1200 to the user terminal 100, the management server 120 can obtain more reliable information about the possibility of rainwater leaking from the building at the date, time, and location desired by the user. Also, the user can easily grasp the possibility of rainwater leaking for the date, time, and location of the building that he or she wishes to verify, without actually taking pictures of the building on-site. <Verification result screen generation process> FIG. 13 is a diagram showing an outline of a verification result screen generation process in one embodiment of the present invention.

[0112] First, in S1301, the verification result screen generating unit 180 of the management server 120 receives a request to generate the verification result screen 1200 requested in S1105.

[0113] Next, in S1302, the verification result screen generating unit 180 acquires from the verification unit 170 the verification result 1100 that the verification unit 170 temporarily stored in S1104.

[0114] Next, in S1303, the verification result screen generating unit 180 generates the verification result screen 1200 based on the verification result 1100 acquired in S1302.

[0115] Specifically, the verification result screen generating unit 180 generates the verification result screen 1200 by displaying in the verification data display area 1210 the contents of the verification data 220 regarding the date, time, location, and building for which the user wishes to verify the possibility of rain leakage, and by displaying in the verification result display area 1220 the contents of the verification result 1100 calculated by the verification unit 170.

[0116] Next, in S1304, the verification result screen generating unit 180 stores the verification result screen 1200 generated in S1303 in the verification result screen storage unit 133.

[0117] Next, in S1305, the verification result screen generating unit 180 requests the verification result screen providing unit 190 to provide the verification result screen 1200. <Verification result screen provision process> FIG. 14 is a diagram showing an outline of a configuration example of a verification result screen providing process in an embodiment of the present invention.

[0118] First, in S1401, the verification result screen providing unit 190 of the management server 120 receives the request to provide the verification result screen 1200 requested in S1305.

[0119] Next, in S1402, the verification result screen providing unit 190 extracts the verification result screen 1200 to be provided from the verification result screen storage unit 133.

[0120] Next, in S1403, the verification result screen providing unit 190 extracts, from the user information storage unit 130, the user information 200 corresponding to the user ID for which the verification result screen 1200 extracted in S1402 is to be provided.

[0121] Next, in S1404, the verification result screen providing unit 190 provides the verification result screen 1200 extracted in S1402 to the user terminal 100.

[0122] Next, in S1405, the user terminal 100 displays the verification result screen 1200 provided by the management server 120 in S1404 on the display of the terminal.

[0123] Next, in S1406, the user terminal 100 determines whether or not it has received an input from the user to press the re-verification tab 1230. If it has received an input from the user to press the re-verification tab 1230, the user terminal 100 proceeds to step S1407. If it has not received an input from the user to press the re-verification tab 1230, the user terminal 100 ends this step.

[0124] In S1407, the user terminal 100 transmits a re-verification instruction to the management server 120. Thereafter, the management server 120 proceeds to step S401 to perform re-verification, and subsequently performs steps S405 to S407.

[0125] In this way, by providing the verification result screen 1200 to the user terminal 100, the management server 120 can obtain more reliable information about the possibility of rainwater leaking from the building at the date, time, and location desired by the user. Also, the user can easily grasp the possibility of rainwater leaking for the date, time, and location of the building that he or she wishes to verify, without actually taking pictures of the building on-site. <Effects of this embodiment> According to the embodiment of the present invention described above, the management server 120 can provide an AR precipitation video generation system that generates a pseudo precipitation video based on data related to a rain leak investigation desired by the user and meteorological information, and verifies the possibility of rain leaks in a building at a desired date, time, and location.

[0126] Furthermore, by providing the user terminal 100 with the AR precipitation video 700 that simulates the precipitation conditions at the date, time, place, and building desired by the user, the management server 120 allows the user to easily understand the precipitation conditions at the desired date, time, place, and building, and to easily confirm how much water should be sprayed in which places when investigating a leak. In other words, the user can efficiently conduct a leak investigation by watching the AR precipitation video 700.

[0127] In addition, by having a user view the provided AR precipitation video 700 and input the possibility of rain leaks, the management server 120 can link the intuitive risk of rain leaks assessed by the user to the building, and allow other users to credibly verify the possibility of rain leaks for the desired date, time, location, and building.

[0128] In other words, users can easily grasp the plausible possibility of a leak for the date, time, location, and building they wish to verify without actually taking photographs of the building on-site, and can therefore conduct leak investigations more efficiently.

[0129] Although the invention made by the present inventor has been specifically described based on the embodiment, the present invention is not limited to the above embodiment, and it goes without saying that various modifications can be made without departing from the gist of the invention. For example, the user terminal includes all user terminals of various types, such as notebook PCs and tablet terminals, in addition to smartphones.

[0130] In addition, the above-mentioned embodiments have been described in detail to clearly explain the present invention, and are not necessarily limited to those including all of the configurations described. In addition, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. In addition, other configurations may be added, deleted, or replaced with part of the configuration of each embodiment.

[0131] Furthermore, the above configurations, functions, and processing units may be realized in part or in whole by hardware (for example, an integrated circuit).The above configurations, functions, and processing units may be realized by software installed via a network or a storage medium such as a disk, in which a processor interprets and executes a program that realizes each function, or by a network application such as an ASP.Information such as the programs, tables, and files that realize each function can be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD. [Explanation of symbols]

[0132] 100...User terminal 110…Weather information database 120...Administration server 130...User information storage unit 131…AR precipitation video storage section 132…Danger index memory section 133... Verification result screen storage section 140…AR precipitation video generation section 150…AR Precipitation Video Provider 160…Danger Index Calculation Section 170…Verification Department 180...Verification result screen generation unit 190…Verification result screen providing section 700…AR precipitation video 1200…Verification result screen

Claims

[Claim 1] A management server connected to a user terminal and a meteorological information DB via a network, a user information storage unit that stores user information received from the user terminal, the user information including data items of a user ID, a name, AR data, and verification data; an AR precipitation video generating unit that generates an AR precipitation video to be displayed on the user terminal based on the AR data and detailed data included in the weather information acquired from the weather information DB; an AR precipitation video providing unit that provides the generated AR precipitation video to the user terminal; A risk index calculation unit that calculates a risk index indicating a possibility of rain leakage in a building based on risk index information acquired from the user terminal and including a possibility of rain leakage in the building and a location of rain leakage in the building; a verification unit that acquires meteorological information and the risk index corresponding to the contents of each item of the verification data, and generates a verification result by calculating the possibility of rain leakage at the date, time, place, and building included in the verification data based on the acquired meteorological information and the risk index; a verification result screen generating unit that generates a verification result screen based on the verification result and stores the verification result screen in a verification result screen storage unit; a verification result screen providing unit that provides the verification result screen to the user terminal; having The AR data includes information such as an AR data ID, shooting data, desired AR date and time, and desired AR location, The detailed data includes data items such as a weather information ID, precipitation, wind direction, wind speed, and temperature. The verification data includes information on a verification data ID, building data, a desired verification date and time, and a desired verification location, The AR precipitation video includes a video display area, an AR data display area, a rain leakage possibility input tab, and a precipitation layer; the AR precipitation animation generating unit displays, in the animation display area, a precipitation layer generated based on detailed data included in the weather information corresponding to the desired AR date and time and the desired AR location; Management server.

Citation Information

Patent Citations

  • Housing analytic diagnosis system

    JP2002317560A

  • Weather forecast imaging device

    JP2004184224A

  • Meteorological information provision device and meteorological information provision program

    JP2014240754A

  • Information processing terminal, information processing method, and information processing program

    JP2018115907A

  • Image generation device and image generation method

    WO2020075430A1