Measurement system, display terminal, photographing terminal, server, measurement method, measurement program

Abstract

To provide a measurement system, a display terminal, an imaging terminal, a server, a measurement method, and a measurement program, capable of conducting a measurement without a specialized marker.SOLUTION: A measurement system 1 includes: at least one display part 11; display control part 12 configured to control to display, in a display part 11, a mark in a state in which a size to display is grasped; a photographing part 21 configured to photograph a mark 41 displayed in the display part 11; and an arithmetic part 22 configured to calculate at least one of a relative physical relation of the photographing part 21 and the mark 41, a distance between specified positions or a size of an object in a vicinity of the mark 41, a distance between marks 41 displayed in the display part 11 arranged in plurality, and an attitude of the display part 11 displaying the mark 41, by using an image of the mark 41 photographed by the photographing part 21.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a measurement system, a display terminal, a photographing terminal, a server, a measurement method, and a measurement program for measuring length and relative positional relationships. [Background technology]

[0002] Patent Document 1 discloses a method for capturing an image of a subject and measuring the actual dimensions of the subject. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2013 / 099271 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the method described in Patent Document 1 cannot perform measurements without a dedicated marker.

[0005] An object of the present invention is to provide a measurement system, a display terminal, an imaging terminal, a server, a measurement method, and a measurement program that can perform measurements without using a dedicated marker. [Means for solving the problem]

[0006] The present invention solves the above-mentioned problems by the following means: For ease of understanding, the following description will be given with reference to the corresponding embodiments of the present invention, but the present invention is not limited to these.

[0007] The first invention is a measurement system (1, 1B) comprising at least one display unit (11), a display control unit (12) that controls the display of a mark (41) on the display unit (11) while grasping the dimensions to be displayed, a photographing unit (21, 13) that photographs the mark (41) displayed on the display unit (11), and a calculation unit (22, 14) that uses the image of the mark (41) photographed by the photographing unit (21, 13) to calculate at least one of the relative positional relationship between the photographing unit (21, 13) and the mark (41), the dimensions of an object near the mark (41) or the distance between designated positions, the distance between the marks (41) displayed on a plurality of the display units (11), and the attitude of the display units (11) that display the mark (41).

[0008] The second invention is a measurement system (1, 1B) according to the first invention, characterized in that the display unit (11) is provided in a display terminal (10, 10B) configured by installing a computer program in a general-purpose communication terminal.

[0009] A third invention is a measurement system (1, 1B) according to the second invention, characterized in that the display control unit (12) controls the display of the mark (41) based on the arrangement format of the display elements in the display unit (11) and the arrangement pitch of the display elements.

[0010] A fourth invention is a measurement system (1, 1B) according to the second or third invention, characterized in that it further comprises a model data storage unit (31) that stores the arrangement format of the display elements in the display unit (11) and the arrangement pitch of the display elements for each model of communication terminal used in the display terminal (10, 10B), and the display control unit (12) identifies the model of the communication terminal used in the display terminal (10, 10B) and controls the display of the mark (41) based on the information stored in the model data storage unit (31).

[0011] The fifth invention is a measurement system (1, 1B) according to any one of the first to fourth inventions, characterized in that the photographing unit (21, 13) is provided in a photographing terminal (20) configured by installing a computer program in a general-purpose communication terminal.

[0012] A sixth invention is a measurement system (1B) according to the fourth invention, characterized in that the photographing unit (13) is provided in a communication terminal used for the display terminal (10B), photographs the mark (41) displayed on the display unit (11) as reflected in a mirror (50), and the calculation unit (14) performs calculations using the image of the mark (41) photographed by the photographing unit (13) as reflected in the mirror (50).

[0013] The seventh invention is a measurement system (1, 1B) according to any one of the first to sixth inventions, characterized in that the display unit (11) displays a figure (42) representing unique information together with the mark (41).

[0014] The eighth invention is a measurement system (1, 1B) according to any one of the first to seventh inventions, characterized in that the display control unit (12) controls the display so as to improve the display of the mark (41) photographed by the photographing unit (21, 13) to a form suitable for calculation by the calculation unit (22, 14).

[0015] A ninth invention is a measurement system (1, 1B) according to the eighth invention, characterized in that, before displaying the mark (41), the display control unit (12) causes the display unit (11) to display a plurality of figures (42) representing unique information in an array, the photographing unit (21, 13) photographs the figures (42), the display control unit (12) selects a display position for the figure (42) suitable for photographing from the photographed plurality of figures (42), and causes the mark (41) to be displayed at the selected display position.

[0016] A tenth invention is a measurement system (1, 1B) according to the eighth invention, characterized in that the display control unit (12) sequentially displays the mark (41) at multiple locations on the display unit (11), the photographing unit (21, 13) photographs the sequentially displayed mark (41), the display control unit (12) selects a display position of the mark (41) suitable for photographing from the marks (41) at multiple locations photographed by the photographing unit (21, 13), and displays the mark (41) at the selected display position.

[0017] An eleventh invention is a measurement system (1, 1B) according to the eighth invention, characterized in that the display control unit (12) simultaneously displays the marks (41) in multiple locations on the display unit (11), the photographing unit (21, 13) photographs the marks (41) displayed simultaneously, and the calculation unit (22, 14) selects a mark (41) suitable for calculation from the marks (41) in multiple locations photographed by the photographing unit (21, 13) and uses the mark (41) for calculation.

[0018] A twelfth invention is a measurement system (1, 1B) according to the eighth invention, characterized in that the display control unit (12) determines whether the mark (41) in the image captured by the photographing unit (21, 13) is suitable for calculation, and if there is a display form that is likely to enable more accurate measurement, changes the display form of the mark (41).

[0019] The thirteenth invention is a measurement system (1, 1B) according to the eighth invention, characterized in that the display control unit (12) determines whether the mark (41) in the image captured by the photographing unit (21, 13) is suitable for calculation, and if it determines that the mark (41) in the image captured by the photographing unit (21, 13) is inappropriate for calculation, it changes the display form of the mark (41).

[0020] A fourteenth invention is a measurement system (1, 1B) according to any one of the first to twelfth inventions, characterized in that it further comprises a server (30) provided separately from the display unit (11) and the photographing unit (21, 13), and the server (30) performs at least one of processing at least a portion of the processes performed in the measurement system (1, 1B) and storing at least a portion of the data required in the measurement system (1, 1B).

[0021] A fifteenth invention is a display terminal (10, 10B) used in the measurement system (1, 1B) according to any one of the first to fourteenth inventions, the display terminal (10, 10B) having the display unit (11).

[0022] A sixteenth invention is a display terminal (10, 10B) according to the fifteenth invention, characterized in that the display unit (11) is configured by installing a computer program on a general-purpose communication terminal.

[0023] A seventeenth aspect of the present invention is the display terminal (10, 10B) according to the fifteenth aspect of the present invention, characterized in that the display unit (11) has electronic paper.

[0024] An 18th invention is an imaging terminal (20) used in the measurement system (1, 1B) according to any one of the first to fourteenth inventions, the imaging terminal (20) including the imaging unit (21, 13).

[0025] A 19th invention is the photographing terminal (20) according to the 18th invention, characterized in that the photographing unit (21, 13) is configured by installing a computer program in a general-purpose communication terminal.

[0026] A twentieth aspect of the present invention is a server (30) used in the measurement system (1, 1B) according to the fourteenth aspect of the present invention.

[0027] The 21st invention is a measurement method comprising the steps of: a step in which a display unit (11) displays a mark (41) on the display unit (11) while grasping the dimensions to be displayed; a step in which a photographing unit (21, 13) photographs the mark (41) displayed on the display unit (11); and a step in which a calculation unit (22, 14) calculates at least one of the relative positional relationship between the photographing unit (21, 13) and the mark (41) using the image of the mark (41) photographed by the photographing unit (21, 13), the dimension of an object near the mark (41) or the distance between designated positions, and the distance between the marks (41) displayed on a plurality of the display units (11).

[0028] The 22nd invention is a measurement program for causing a computer to execute the following steps: a step in which a display unit (11) displays a mark (41) on the display unit (11) while grasping the dimensions to be displayed; a step in which a photographing unit (21, 13) photographs the mark (41) displayed on the display unit (11); and a step in which a calculation unit (22, 14) uses the image of the mark (41) photographed by the photographing unit (21, 13) to calculate at least one of the relative positional relationship between the photographing unit (21, 13) and the mark (41), the dimension of an object near the mark (41) or the distance between designated positions, and the distance between the marks (41) displayed on a plurality of the display units (11). [Effects of the Invention]

[0029] According to the present invention, it is possible to provide a measurement system, a display terminal, an imaging terminal, a server, a measurement method, and a measurement program that can perform measurements without using a dedicated marker. [Brief explanation of the drawings]

[0030] [Figure 1] 1 is a diagram showing an overview of a measurement system 1 according to a first embodiment. [Figure 2] 1 is a block diagram showing the configuration of a measurement system 1 according to a first embodiment. [Figure 3]1 is a diagram showing an example of a marker 40 displayed on a display unit 11. FIG. [Figure 4] 10 is a flowchart illustrating the flow of operations of the display terminal 10 and the photographing terminal 20. [Figure 5] FIG. 10 is a diagram showing an overview of a measurement system 1B according to a second embodiment. [Figure 6] FIG. 10 is a block diagram showing the configuration of a measurement system 1B according to a second embodiment. [Figure 7] FIG. 10 is a diagram illustrating an improved control example 1. [Figure 8] 10A and 10B are diagrams illustrating an improved control example 2 and an improved control example 3. [Figure 9] FIG. 10 is a diagram illustrating an improved control example 4. [Figure 10] FIG. 10 is a diagram illustrating an improved control example 5. DETAILED DESCRIPTION OF THE INVENTION

[0031] Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings.

[0032] (First embodiment) FIG. 1 is a diagram showing an overview of a measurement system 1 according to the first embodiment. FIG. 2 is a block diagram showing the configuration of the measurement system 1 of the first embodiment. Note that the figures shown below, including Figures 1 and 2, are schematic diagrams, and the size and shape of each part are exaggerated or omitted as appropriate to make them easier to understand. In the following description, specific numerical values, shapes, etc. are used, but these can be changed as appropriate.

[0033] The measurement system 1 of the first embodiment includes a display terminal 10, an imaging terminal 20, and a server 30, which are configured to cooperate to function as a single system. Furthermore, if necessary, part of each configuration described in the embodiment may be appropriately moved to any of the display terminal 10, the imaging terminal 20, or the server 30.

[0034] The display terminal 10, the photographing terminal 20, and the server 30 are each provided with a computer that controls the operation of the measurement system 1. In the present invention, a computer refers to an information processing device equipped with a control unit, a storage device, etc. The display terminal 10, the photographing terminal 20, and the server 30 are all information processing devices equipped with a control unit, a storage device, etc., and are included in the concept of a computer in the present invention, and are capable of executing a measurement program and implementing the measurement method of this embodiment. The control unit here refers to a central processing unit (CPU) that controls the operation of the display terminal 10, the photographing terminal 20, and the server 30. The control units provided in the display terminal 10, the photographing terminal 20, and the server 30 cooperate with the above-mentioned hardware to perform various functions by appropriately reading and executing an operating system (OS) and various application programs stored in the storage device, etc. Furthermore, the display terminal 10, the photographing terminal 20, and the server 30 are provided with communication units (not shown), and wireless communication and wired communication are possible between each terminal and the server.

[0035] The display terminal 10 is configured by installing a computer program on a general-purpose communication terminal. More specifically, the display terminal 10 of this embodiment is configured by downloading and installing an application program for the measurement system of the present invention on a general-purpose smartphone. Note that the display terminal 10 is not limited to a smartphone, and may also be a tablet terminal, a laptop computer, or the like. Here, an example in which one display terminal 10 is installed will be described, but multiple display terminals 10 may be installed. The display terminal 10 is provided with a display control unit 12 and a display unit 11. The display unit 11 is a display panel provided in the communication terminal used as the display terminal 10, and the display is controlled by the display control unit 12. The display control unit 12 controls the display of the mark 41 on the display unit 11 while grasping the dimensions to be displayed. The display control unit 12 also controls the display of the mark 41 on the display unit 11 together with a graphic 42 representing unique information.

[0036] FIG. 3 is a diagram showing an example of the marker 40 displayed on the display unit 11. As shown in FIG. The display control unit 12 causes the display unit 11 to display a marker 40 including a mark 41 and a graphic 42. The marks 41 are photographed by the photographing terminal 20, and are used for various measurements, which will be described later, depending on how the marks 41 appear in the photographed image. In this embodiment, the marks 41 are black perfect circles on a white background, and are arranged in four locations so as to form a square with each mark as a vertex. The mark 41 displayed on the display unit 11 is controlled by the display control unit 12, and is displayed on the display unit 11 in a state where the dimensions to be displayed are grasped by the display control unit 12. Here, "a state where the dimensions to be displayed are grasped" refers to a state where the actual dimensions of the mark 41 displayed on the display unit 11 are known. For example, this is a state where the display control unit 12 has obtained information that the mark 41 actually displayed on the display unit 11 has a diameter of 1 cm.

[0037] Here, a general-purpose smartphone is used as the display terminal 10. There are various types of display units (display panels) for smartphones, tablet terminals, and the like. Therefore, when performing normal display, the diameter of the displayed marks 41 and the spacing (the spacing between the centers of the marks 41) (hereinafter, the diameter and spacing dimensions are simply referred to as the dimensions of the marks 41) will vary depending on which display unit of the communication terminal is used for display. The calculation unit 22, which will be described later, performs various measurements using the size of the marks 41 in the captured image and the spacing between the centers of the marks 41, so the actual dimensions of the marks 41 on the display unit 11 are important.

[0038] Therefore, the display control unit 12 of this embodiment controls the dimensions of the mark 41 actually displayed on the display unit 11 to be predetermined dimensions regardless of the type of communication terminal used. Specifically, the display control unit 12 controls the display so that the mark 41 is displayed at predetermined dimensions based on the arrangement format of the display elements in the display unit 11 and the arrangement pitch of the display elements. Note that the display element here does not refer to a display panel such as an LCD (Liquid Crystal Display) panel or an OLED (Organic Light Emitting Diode) panel, but rather refers to one pixel of each of R, G, B, etc., arranged in plurality on the display panel.

[0039] Display panels widely used as the display unit of a communication terminal include LCD (Liquid Crystal Display) and OLED (Organic Light Emitting Diode). LCDs use a stripe array in which display elements are closely arranged. In contrast, OLEDs use a pentile array in which more green display elements are arranged than other color (red, blue) display elements and the display elements are spaced farther apart than in the stripe array. The pitch at which the display elements are arranged also differs between LCDs and OLEDs, as well as depending on the resolution of the display unit. Therefore, for example, when displaying a mark 41 with a diameter of 1 cm on the display unit 11, it is necessary to control the display so that the mark 41 is displayed at a predetermined size based on the arrangement format and the arrangement pitch of the display elements on the display unit 11, and the display control unit 12 performs this control. Therefore, regardless of differences in the layout, screen size, resolution, etc. of the display panel of the communication device being used, the display unit 11 displays a mark 41 of a predetermined size.

[0040] The size of the mark 41 is preferably 50 times or more the arrangement pitch of the display elements. It is preferable that this multiple be even larger; the size of the mark 41 is more preferably 100 times or more, and even more preferably 300 times or more, or even 500 times or more, the arrangement pitch of the display elements. Here, when the mark 41 has an irregular shape, such as an ellipse, the size is preferably the width at the smallest distance when sandwiched between two parallel lines. By making the size of the mark 41 50 times or more the arrangement pitch of the display elements, the pattern shape of the mark 41 can be expressed smoothly, thereby improving measurement accuracy. For example, when the arrangement pitch of the display elements is 30 μm, the size of the mark 41 is preferably 50 times, or 1.5 mm or more.

[0041] The graphic 42 is a code representing unique information (ID: identification). The graphic 42 may be any type as long as it can represent unique information. For example, it may be a block pattern as shown in FIG. 3, or a barcode, two-dimensional code, etc. However, since minute barcodes, two-dimensional codes, etc. are difficult to read when photographed from a long distance, a larger block pattern as shown in FIG. 3 is preferable.

[0042] The photographing terminal 20 is configured by installing a computer program on a general-purpose communication terminal. More specifically, the photographing terminal 20 of this embodiment is a general-purpose smartphone on which an application program for the measurement system of the present invention has been downloaded and installed. Note that the photographing terminal 20 is not limited to a smartphone, and may also be a tablet terminal, a laptop computer, etc. The photographing terminal 20 is provided with a photographing unit 21, a calculation unit 22, and a photographing unit side display unit 23. The photographing unit 21 is a camera provided in the communication terminal, and photographs the mark 41 (marker 40) displayed on the display unit 11.

[0043] The calculation unit 22 calculates at least one of various dimensions and the orientation of the mark 41 using the image of the mark 41 photographed by the photographing unit 21. The method used by the calculation unit 22 to calculate the dimensions or orientation of the mark 41 using a photographed image of the mark 41 is the method described in Hideyuki Tanaka, "Fundamentals and Latest Trends of AR Marker Technology," Journal of the Institute of Electrical, Information and Communication Engineers, Vol. 97, No. 8, 2014, pp. 734-740. The dimensions or orientation of the mark 41 calculated by the calculation unit 22 include the following.

[0044] (Calculation example 1) First, the calculation unit 22 can calculate the relative positional relationship between the photographing unit 21 and the mark 41. The relative positional relationship between the photographing unit 21 and the mark 41 includes not only the dimension (distance) from the photographing unit 21 to the mark 41, but also the direction in which the front of the mark 41 (marker 40) faces, that is, the attitude of the mark (the attitude of the display unit 11 that displays the mark 41). Here, the attitude of the mark 41 can be expressed, for example, by roll, yaw, and pitch.

[0045] (Calculation example 2) The calculation unit 22 can also calculate the dimensions of an object or the like near the mark 41. For example, when a person is standing and holding the display terminal 10 that displays the mark 41, the height of that person can be measured. People can be recognized automatically. In addition to people, the object may be the height of a tree, the size of an animal, the size of a window, or the like.

[0046] (Calculation example 3) The calculation unit 22 can also calculate the dimension (distance) between positions designated near the mark 41. The positions designated near the mark 41 are positions designated by the user within the range photographed together with the mark 41 on the photographing unit side display unit 23 of the photographing terminal 20.

[0047] (Calculation example 4) Furthermore, the calculation unit 22 can calculate the dimension (distance) between multiple marks 41. By placing multiple display terminals 10 and using the photographing unit 21 to photograph the marks 41 displayed by the multiple display terminals 10 on one screen, the dimension (distance) between the multiple marks 41 can be calculated. Also, as explained above, the calculation unit 22 can calculate the relative positional relationship between the photographing unit 21 and the marks 41. Therefore, even if multiple display terminals 10 are photographed separately without moving the position of the photographing terminal 20, the dimension (distance) between the multiple marks 41 can be calculated. At this time, each marker 40 can be recognized separately using the unique information represented by the figure 42, so that the calculation can be performed correctly.

[0048] The photographing unit side display unit 23 is a display panel provided in a communication terminal used as the photographing terminal 20. The photographing unit side display unit 23 displays a preview image when photographing by the photographing unit 21, photographing results, calculation results by the calculation unit 22, etc.

[0049] The server 30 is located away from the display terminal 10 and the photographing terminal 20, and is capable of wireless communication with the display terminal 10 and the photographing terminal 20 via a public wireless communication line, a wireless LAN, etc. Note that wireless communication is also possible between the display terminal 10 and the photographing terminal 20 via short-range wireless communication, a public communication line, or a wireless LAN, etc.

[0050] The server 30 is provided with a model data storage unit 31 . The model data storage unit 31 stores the arrangement format and arrangement pitch of the display elements in the display unit 11 for each model of communication terminal used in the display terminal 10. Therefore, if the model of the communication terminal used in the display terminal 10 is known, the arrangement format and arrangement pitch of the display elements in the display unit 11 can be identified by referring to the model data storage unit 31. If the display terminal 10 can directly acquire information about the arrangement format of the display elements in the display unit 11 and the arrangement pitch of the display elements, the model data storage unit 31 may be omitted.

[0051] Next, the operation of the measurement system 1 will be described. FIG. 4 is a flowchart illustrating the flow of operations of the display terminal 10 and the photographing terminal 20. First, in steps (hereinafter simply referred to as S) 11 and S21, the measurement program of the measurement system 1 is downloaded from the server 30 to the display terminal 10 and the photographing terminal 20, respectively, and installed. Also, since this is not the operation of the display terminal 10 or the photographing terminal 20, it is not shown in Figure 4, but the display terminal 10 with the measurement program installed is installed at the measurement point so that the display unit 11 is visible depending on the purpose of measurement.

[0052] In S12, the display control unit 12 acquires model information of the display terminal 10. In S13, the display control unit 12 refers to the model data storage unit 31. In S14, the display control unit 12 acquires the arrangement of the display elements and the arrangement pitch of the display elements corresponding to the model information of the display terminal 10 from the information stored in the model data storage unit 31 that has been referenced. In S15, the display control unit 12 displays the mark 41 of a predetermined size on the display unit 11. In S22, the photographing unit 21 photographs the mark 41. In S23, the calculation unit 22 calculates various dimensions, the orientation of the mark 41, etc. based on the photographed image of the mark 41. In S24, the imaging unit side display unit 23 displays the calculation result on the imaging unit side display unit 23, and the operation ends.

[0053] For ease of understanding, the display terminal 10 and the photographing terminal 20 of the first embodiment have been described here as having different configurations. However, as long as the same measurement program can be installed and they are equipped with a camera and a display panel, there is no substantial difference between the display terminal 10 and the photographing terminal 20; it is sufficient to have one function as the display terminal 10 and the other function as the photographing terminal 20.

[0054] As described above, the measurement system 1 of the first embodiment displays the mark 41 while grasping the dimensions to be displayed on the display unit 11 of the display terminal 10. Therefore, according to the measurement system 1, various dimensions and the like can be measured easily and accurately without having to carry a mark, as long as there is a communication terminal on which a measurement program can be installed.

[0055] (Second embodiment) FIG. 5 is a diagram showing an overview of a measurement system 1B according to the second embodiment. FIG. 6 is a block diagram showing the configuration of a measurement system 1B according to the second embodiment. The second embodiment differs from the measurement system 1 of the first embodiment in that, instead of using the photographing terminal 20 in the first embodiment, measurement is performed using the photographing unit 13 of the display terminal 10B and a mirror 50. Therefore, parts that perform the same functions as in the first embodiment described above are given the same reference numerals, and duplicated explanations will be omitted as appropriate.

[0056] The display terminal 10B of the second embodiment further includes an imaging unit 13 and a calculation unit . The photographing unit 13 is a camera provided in the communication terminal, and photographs the mark 41 (marker 40) displayed on the display unit 11. Note that the photographing unit 13 is a so-called "selfie" camera, in which the photographing lens is arranged on the same side as the display unit 11. The calculation unit 14 is basically the same as the calculation unit 22 in the first embodiment. However, in the second embodiment, calculations are performed using a photographed image of the marker 40 reflected in the mirror 50, and therefore the obtained calculation results are corrected. That is, the marker 40 and the mark 41 are photographed so that they appear to be at a position twice as far away as in the first embodiment (the marker 40 and the mark 41 are half the size), and the calculation results are corrected taking this into account.

[0057] The mirror 50 is a commonly used plane mirror. Note that the mirror 50 used for measurement must be a plane mirror, since accurate measurements cannot be made if it is a concave or convex mirror. The mirror is installed in an appropriate position depending on the purpose of the measurement, similar to the position of the display terminal 10 in the first embodiment.

[0058] In the second embodiment, the display terminal 10B serves as both the display terminal 10 and the photographing terminal 20 in the first embodiment. When performing the measurement, the marker 40 is displayed on the display unit 11 of the display terminal 10B, and the display unit 11 is directed toward the mirror 50. The orientation of the display terminal 10B is adjusted so that the marker 40 on the display unit 11 is properly reflected in the mirror 50 and can be photographed by the photographing unit 13. At this time, the display unit 11 displays the marker 40 together with a preview screen of the image being photographed by the photographing unit 13, making it easy to adjust the orientation. The image is captured with the display terminal 10B adjusted to an appropriate orientation. Note that the image may be captured manually by the photographer, or may be captured automatically when an image that can be calculated by the calculation unit 14 is obtained. After that, except for correcting the calculation results, various measurements can be performed in the same manner as in the first embodiment. Furthermore, measurements can be performed at multiple locations on the mirror 50 in the same manner as in the first embodiment.

[0059] For ease of understanding, the display terminal 10B has been described here as having a different configuration from the display terminal 10 and the photographing terminal 20 of the first embodiment, but as long as a measurement program can be installed and both are equipped with a camera and a display panel, there is no substantial difference between the display terminal 10 and the photographing terminal 20. Therefore, when performing measurement using a mirror 50, the second embodiment can be realized in a form in which the measurement program is executed in mirror measurement mode.

[0060] As described above, the measurement system 1B of the second embodiment uses the mirror 50, so as long as a mirror is available, various dimensions and the like can be measured simply and accurately with only one communication terminal.

[0061] (Third embodiment) The third embodiment is an embodiment in which the operation of the display control unit 12 in the first embodiment is further improved, and the configuration of each unit is the same as that of the first embodiment. In the third embodiment, the display control unit 12 controls the display so as to improve the display of the mark 41 photographed by the photographing unit 21 to a form suitable for calculation by the calculation unit 22. Examples of the control performed by the display control unit 12 to improve the display of the mark 41 to a form suitable for calculation by the calculation unit 22 include the following forms.

[0062] (Improvement control example 1) FIG. 7 is a diagram illustrating the first improved control example. In the improved control example 1, the display control unit 12 causes the display unit 11 to display a plurality of graphics 42 representing unique information in an arranged manner before displaying the mark 41 (FIG. 7(a)). Then, the photographing unit 21 photographs the figure 42, and the display control unit 12 selects a display position of the figure 42 suitable for photographing from among the photographed multiple figures 42, and displays the marker 40 (mark 41) at the selected display position (Figure 7(b)). 7, if there is an unclear area B due to surface reflection or the like, an area outside this area is selected as the display position of the graphic 42 suitable for photography. Because the graphic 42 represents unique information, each individual graphic 42 can be distinguished and identified, making it easy to identify the appropriate area.

[0063] (Improvement control example 2) FIG. 8 is a diagram illustrating the improved control example 2 and the improved control example 3. In FIG. In the improved control example 2, the display control unit 12 sequentially displays the markers 40 in multiple locations on the display unit 11. Note that while Fig. 8 shows the sequentially displayed markers 40 collectively, in the improved control example 2, each marker 40 is sequentially displayed one by one. Also, the graphic 42 of each marker is displayed in a form that represents unique information. Then, the photographing unit 21 photographs the markers 40 that are displayed sequentially, and the display control unit 12 selects a display position of the marker 40 that is suitable for photographing from among the markers 40 photographed at multiple locations by the photographing unit 21, and displays the marker 40 at the selected display position.

[0064] (Improvement control example 3) Improved control example 3 is an example similar to the above-described improved control example 2. Display control unit 12 simultaneously displays markers 40 in multiple locations on display unit 11. Also, the figures 42 of each marker are displayed in a form that represents unique information (see FIG. 8). The photographing unit 21 photographs the markers 40 that are simultaneously displayed, and the calculation unit 22 selects the markers 40 suitable for calculation from the markers 40 photographed at multiple locations by the photographing unit and uses them for calculation.

[0065] (Improvement control example 4) FIG. 9 is a diagram illustrating the fourth improved control example. In improved control example 4, the display control unit 12 determines whether the mark 41 in the image captured by the photographing unit 21 is suitable for calculation, and if there is a display form that is likely to enable more accurate measurements, changes the display form of the mark 41. Fig. 9(a) shows the marker 40 that is initially displayed, and Figs. 9(b) to 9(d) show examples in which the display form of the mark 41 is changed to a display form that is more likely to enable highly accurate measurements. In Fig. 9(b), the size of the mark 41 is changed. In Fig. 9(c), the mark 41 is transformed into an ellipse. In Fig. 9(d), the spacing between the marks 41 in the vertical direction is increased.

[0066] (Improvement control example 5) FIG. 10 is a diagram illustrating the fifth improved control example. In improved control example 5, the display control unit 12 determines whether the mark 41 in the image captured by the photographing unit 21 is suitable for calculation, and if it determines that the mark 41 in the image captured by the photographing unit 21 is inappropriate for calculation, it changes the display form of the mark 41. For example, when a blurred area B occurs due to surface reflection or the like as shown in FIG. 10(a), the display position of the marker 40 is changed to a position that does not overlap with the blurred area B as shown in FIG. 10(b). Furthermore, for example, if a blurred area B occurs due to surface reflection or the like as shown in Figure 10(c) and cannot be improved by simply changing the display position of the marker 40, the arrangement of the mark 41 and figure 42 within the marker 40 is changed as shown in Figure 10(d) so that the mark 41 and figure 42 do not overlap with the blurred area B.

[0067] Note that the improvement control example by the display control unit 12 in the third embodiment is not limited to the above-described example, and other improvement controls may be performed. Furthermore, the above-described improvement control example and other improvement controls may be executed in appropriate combination.

[0068] As described above, in the third embodiment, the display control unit 12 controls the display so as to improve the display of the mark 41 captured by the capturing unit 21 to a form suitable for calculation by the calculation unit 22. Therefore, according to the third embodiment, the measurement system 1 can perform appropriate measurement even when an unclear area occurs due to surface reflection or the like. Furthermore, according to the third embodiment, the measurement system 1 can perform more accurate measurement.

[0069] (Variations) The present invention is not limited to the above-described embodiment, and various modifications and variations are possible, and these are also within the scope of the present invention.

[0070] (1) In each embodiment, the measurement systems 1 and 1B are exemplified as including a server 30, but may be configured not to include a server 30. In this case, the information stored in the model data storage unit may be included in the measurement program installed in the display terminal 10. Also, the server 30 may be omitted if information regarding the arrangement format of the display elements of the display unit and the arrangement pitch of the display elements can be obtained from the display terminal 10 (communication terminal).

[0071] (2) In each embodiment, the server 30 includes the model data storage unit 31. However, the present invention is not limited to this. For example, the server 30 may further include the functions of a calculation unit and a display control unit. Furthermore, the present invention is not limited to this. For example, the display terminals 10, 10B and the photographing terminal 20 may be installed with a measurement program. However, the present invention is not limited to this. For example, the same functions as those of the display terminal and the photographing terminal may be realized on a web browser installed on the communication terminal by accessing a predetermined website on the Internet without installing a dedicated measurement program. In this case, the server 30 may be provided with the functions of a calculation unit and a display control unit.

[0072] (3) In each embodiment, an example has been described in which an LCD and an OLED are used for the display unit 11. However, the present invention is not limited to this, and for example, the display unit 11 may be configured using electronic paper. In this case, the display unit 11 may have a simpler configuration than a smartphone or the like. That is, a simple display terminal may be configured that includes electronic paper as the display unit 11, a battery for driving it, and an IC chip for minimal communication. In this case, the display terminal can be provided inexpensively and is suitable for applications in which multiple display terminals are arranged and used. An example of electronic paper is one that can display using a particle migration display method. The particle migration display method can reverse at least two colors by electrically moving or rotating positively or negatively charged colored particles to change the display color. In addition, it consumes little power when changing the display color, and basically requires no power to maintain the display color as is. Examples of display devices using the particle migration display method include a twist ball method, an electrophoretic one-particle type, an electrophoretic two-particle type, and an electronic powder type.

[0073] (4) In each embodiment, the display control unit 12 controls the dimensions of the mark 41 actually displayed on the display unit 11 to be displayed at predetermined dimensions regardless of the type of communication terminal used. This is not limiting, and for example, the display control unit may control the display of the mark 41 to be displayed at different dimensions depending on the type of communication terminal used. In this case, as long as the dimensions of the mark 41 actually displayed on the display unit 11 are known, calculations such as distance can be performed in the same manner as in each embodiment. Furthermore, by using a communication terminal with a large display unit 11, it is possible to display the mark 41 larger, which is expected to improve measurement accuracy when photographing at long distances.

[0074] The embodiments and modifications may be used in combination as appropriate, but detailed description thereof will be omitted. The present invention is not limited to the embodiments described above. [Explanation of symbols]

[0075] 1.1B Measurement System 10, 10B display terminal 11 Display section 12 Display control unit 13 Photography Department 14 Arithmetic section 20 Photographic device 21 Photography Department 22 Arithmetic section 23. Display unit on the imaging unit side 30 servers 31 Model data storage unit 40 markers 41 marks 42 Shapes 50 mirror

Claims

1. at least one display; a display control unit that controls the display of the mark on the display unit while grasping the dimensions to be displayed; an image capturing unit that captures an image of the mark displayed on the display unit; a calculation unit that calculates, using an image of the mark photographed by the photographing unit, at least one of the relative positional relationship between the photographing unit and the mark, the dimensions of an object near the mark or the distance between designated positions, the distance between the marks displayed on the display units that are arranged in plurality, and the attitude of the display units that display the marks; Equipped with the display control unit controls the display of the mark together with a graphic as a marker on the display unit; the graphic represents the information of the marker by any one of a block pattern, a barcode, and a two-dimensional code; A measurement system characterized by:

2. 2. The measurement system of claim 1, the display unit is provided in a display terminal configured by installing a computer program in a general-purpose communication terminal; A measurement system characterized by:

3. 3. The measurement system according to claim 2, the display control unit controls display of the mark based on an arrangement format of the display elements in the display unit and an arrangement pitch of the display elements; A measurement system characterized by:

4. The measurement system according to claim 2 or 3, a model data storage unit that stores an arrangement format of the display elements in the display unit for each model of a communication terminal used in the display terminal, and an arrangement pitch of the display elements; the display control unit specifies a model of a communication terminal used for the display terminal, and controls display of the mark based on information stored in the model data storage unit; A measurement system characterized by:

5. The measurement system according to any one of claims 1 to 4, The photographing unit is provided in a photographing terminal configured by installing a computer program in a general-purpose communication terminal; A measurement system characterized by:

6. at least one display; a display control unit that controls the display of the mark on the display unit while grasping the dimensions to be displayed; an image capturing unit that captures an image of the mark displayed on the display unit; a calculation unit that calculates, using an image of the mark photographed by the photographing unit, at least one of the relative positional relationship between the photographing unit and the mark, the dimensions of an object near the mark or the distance between designated positions, the distance between the marks displayed on the display units that are arranged in plurality, and the attitude of the display units that display the marks; Equipped with the display unit is provided in a display terminal configured by installing a computer program in a general-purpose communication terminal, a model data storage unit that stores an arrangement format of the display elements in the display unit for each model of a communication terminal used in the display terminal, and an arrangement pitch of the display elements; the display control unit identifies a model of a communication terminal used in the display terminal, and controls display of the mark based on information stored in the model data storage unit, and the display control unit controls displaying a figure that is one of a block pattern, a barcode, and a two-dimensional code together with the mark as a marker on the display unit; the graphic represents information about the marker; the photographing unit is provided in a communication terminal used as the display terminal, and photographs the mark displayed on the display unit as reflected in a mirror; the calculation unit performs calculation using an image of the mark photographed by the photographing unit and reflected in the mirror; A measurement system characterized by:

7. 7. The measurement system according to claim 1, the display control unit controls the display so as to improve the display of the mark photographed by the photographing unit to a form suitable for calculation by the calculation unit; A measurement system characterized by:

8. at least one display; a display control unit that controls the display of the mark on the display unit while grasping the dimensions to be displayed; an image capturing unit that captures an image of the mark displayed on the display unit; a calculation unit that calculates, using an image of the mark photographed by the photographing unit, at least one of the relative positional relationship between the photographing unit and the mark, the dimensions of an object near the mark or the distance between designated positions, the distance between the marks displayed on the display units that are arranged in plurality, and the attitude of the display units that display the marks; Equipped with the display control unit causes the display unit to display a plurality of figures representing the unique information in an arranged manner before displaying the mark; the photographing unit photographs the figure, the display control unit selects a display position of a figure suitable for photographing from among the photographed plurality of figures, and displays the mark at the selected display position; A measurement system characterized by:

9. 8. The measurement system according to claim 7, the display control unit sequentially displays the mark at a plurality of locations on the display unit; the photographing unit photographs the marks displayed sequentially; the display control unit selects a display position of the mark suitable for photographing from among the marks at a plurality of locations photographed by the photographing unit, and displays the mark at the selected display position; A measurement system characterized by:

10. 8. The measurement system according to claim 7, the display control unit simultaneously displays the mark in a plurality of locations on the display unit; the photographing unit photographs the mark displayed at the same time; the calculation unit selects a mark suitable for calculation from the marks at the plurality of locations photographed by the photographing unit and uses the selected mark for calculation; A measurement system characterized by:

11. 8. The measurement system according to claim 7, the display control unit determines whether the mark in the image captured by the imaging unit is suitable for calculation, and if there is a display form that is likely to enable more accurate measurement, changes the display form of the mark; A measurement system characterized by:

12. 8. The measurement system according to claim 7, the display control unit determines whether the mark in the image captured by the photographing unit is suitable for calculation, and when it determines that the mark in the image captured by the photographing unit is inappropriate for calculation, changes the display form of the mark; A measurement system characterized by:

13. The measurement system according to any one of claims 1 to 11, a server provided separately from the display unit and the photographing unit; the server performs at least one of processing at least a part of the processing performed in the measurement system and storing at least a part of the data required in the measurement system; A measurement system characterized by:

14. A display terminal used in the measurement system according to claim 6, A display terminal including the display unit.

15. 15. The display terminal according to claim 14, the display unit is configured by installing a computer program in a general-purpose communication terminal; A display terminal characterized by:

16. 15. The display terminal according to claim 14, the display unit has electronic paper; A display terminal characterized by:

17. An imaging terminal used in the measurement system according to claim 6, A photographing terminal including the photographing unit.

18. 18. The photographing terminal according to claim 17, the photographing unit is configured by installing a computer program in a general-purpose communication terminal; A photographic device characterized by the following.

19. A server for use in the measurement system according to claim 13.

20. a step in which a display control unit controls the display unit to display a graphic together with the mark, and the display unit displays the graphic together with the mark as a marker on the display unit while grasping the dimensions to be displayed; a step of an imaging unit imaging the mark displayed on the display unit; a calculation unit calculating at least one of a relative positional relationship between the image capturing unit and the mark using an image of the mark captured by the image capturing unit, a dimension of an object near the mark or a distance between designated positions, and a distance between the marks displayed on the display unit; Equipped with the graphic represents the information of the marker by any one of a block pattern, a barcode, and a two-dimensional code; A measurement method characterized by:

21. On the computer, a step in which a display control unit controls the display unit to display a graphic together with the mark, and the display unit displays the graphic together with the mark as a marker on the display unit while grasping the dimensions to be displayed; a step of photographing the mark displayed on the display unit by a photographing unit; a calculation unit calculating at least one of a relative positional relationship between the image capturing unit and the mark using an image of the mark captured by the image capturing unit, a dimension of an object near the mark or a distance between designated positions, and a distance between the marks displayed on the display unit; A measurement program for executing the graphic represents the information of the marker by any one of a block pattern, a barcode, and a two-dimensional code; A measurement program featuring:

Images