Systems and methods for measuring displacement of objects

Abstract

Methods and systems of measuring a displacement of an object are described herein. The methods include applying a first marker to a portion of the object, the first marker having a pattern of markings thereon. Each marking of the pattern of markings has an initial position. The method also includes capturing an image of the pattern of markings after applying the first marker to the object. At least one marking of the pattern of markings has a subsequent position at the time when the image is captured. A change of position of the at least one marking is determined by comparing the subsequent position in the captured image in relation to a reference marking to the initial position of the at least one marking in relation to the reference marking. Based on the change of position, the displacement of the object is determined.

Description

Title: SYSTEMS AND METHODS FOR MEASURING DISPLACEMENT OF OBJECTSTechnical Field

[0001] The embodiments disclosed herein relate to systems and methods for performing measurements, and, in particular to systems and methods of performing measurements of objects that undergo changes in shape and / or position.Background

[0002] There are currently various techniques available for measuring displacement of an object.

[0003] These techniques are commonly divided into two categories: contact measurement techniques and non-contact measurement techniques.

[0004] Contact measurement techniques typically include the placement of high precision displacement sensors on the object being measured and the detection of movement of the sensors. The

[0005] Non-contact measurement systems have previously relied on laser technology, radar technology, geographic positioning systems (GPS) technology, and on the processing and analysis of images obtained by video technology or digital photography. Some non-contact measurement systems combine one or more of these technologies to enhance the overall performance of the measurement system.

[0006] For image processing procedures there are generally two options: the use of techniques based on the tracking of a set of characteristic points extracted from the images or the use of all information present in the images.

[0007] Although image processing procedures have been evolving greatly with advances in digital photography, these systems are generally very costly and several factors may affect the precision of the system, such as the dimensional precision of the target, the lighting, the light refraction phenomena, the phenomena of image distortion caused by the optical elements and the image processing. Further, external factors may influence the system’s performance, such as precipitation, fog, variation of natural light, and wind action.

[0008] Accordingly, there is a need for systems and methods for measuring displacement of an object that overcome some of these difficulties.Summary

[0009] In accordance with a broad aspect, a method of measuring a displacement of an object is described herein. The method includes applying a first marker to a portion of the object, the first marker having a pattern of markings thereon. Each marking of the pattern of markings has an initial position. The method also includes capturing an image of the pattern of markings after applying the first marker to the object. At least one marking of the pattern of markings has a subsequent position at the time when the image is captured. A change of position of the at least one marking is determined by comparing the subsequent position in the captured image in relation to a reference marking to the initial position of the at least one marking in relation to the reference marking. Based on the change of position, the displacement of the object is determined.

[0010] In at least one embodiment the method also include applying a second marker to the object as the reference marker.

[0011] In at least one embodiment, capturing the image includes capturing a first image of the pattern of markings when the marker is at a first position and capturing a second image of the pattern of markings at a second position to determine a complete spectrum of movement of the object.

[0012] In at least one embodiment, prior to applying the marker to the portion of the object, applying a stencil to the portion of the object, the stencil having the pattern of markings cut out to provide for the placement of a pattern of markings onto the object.

[0013] In at least one embodiment, the pattern of markings includes straight line segment markings and curved line segment markings.

[0014] In at least one embodiment, the pattern of markings includes a plurality of dots and a plurality of fiducials.

[0015] In at least one embodiment, the plurality of fiducials each have a cross shape.

[0016] In at least one embodiment, the pattern includes three fiducials, each having a cross shape.

[0017] In at least one embodiment, determining the change of position of the at least one marking includes comparing a subsequent position of at least one feature of at least one of the fiducials in the captured image to an initial position of the at least one feature of the of at least one of the fiducials in a template image.

[0018] In accordance with another broad aspect, a method of measuring a displacement of an object is described herein. The method includes identifying a plurality of markings on the object, each marking of the plurality of markings having an initial position. The method also includes identifying a reference marking. For example, the reference marking may be a marking native to the object, native to a portion of the object, or native to another object adjacent to the object. The method also includes capturing an image of the plurality of markings at a first time after identifying the plurality of markings on the object, at least one marking of the pattern of markings having a subsequent position at the time when the image is captured. The method also includes determining a change of position of the at least one marking by comparing the subsequent position of the at least one marking in the captured image in relation to a reference marking to the initial position of the at least one marking in relation to the reference marking. Based on the change of position of the at least one marking, the displacement of the object is determined.

[0019] In at least one embodiment, the reference marking is on the object.

[0020] In at least one embodiment, the reference marking is not on the object.

[0021] In at least one embodiment, the method also includes applying a second marker to the object as the reference marker.

[0022] In at least one embodiment, capturing the image includes capturing a first image of the pattern of markings when the marker is at a first position and capturing a second image of the pattern of markings at a second position to determine a complete spectrum of movement of the object.

[0023] In at least one embodiment, determining the change of position of the at least one marking includes comparing a subsequent position of at least one feature of at least one of the fiducials in the captured image to an initial position of the at least one feature of the of at least one of the fiducials in a template image.

[0024] In accordance with another broad aspect, a system for determining a displacement of an object is described herein. The system includes a computer processor coupled to a memory, the computer processor being programmed to determine the displacement by: identifying a plurality of markings on the object, each marking of the plurality of markings having an initial position; identifying a reference marking; capturing an image of the plurality of markings at a first time after identifying the plurality of markings on the object, at least one marking of the pattern of markings having a subsequent position at the time when the image is captured; determining a change of position of the at least one marking by comparing the subsequent position of the at least one marking in the captured image in relation to a reference marking to the initial position of the at least one marking in relation to the reference marking; and based on the change of position of the at least one marking, determining the displacement of the object.

[0025] Other aspects and features will become apparent to those ordinarily skilled in the art, upon review of the following description of some exemplary embodiments.Brief Description of the Drawings

[0026] The drawings included herewith are for illustrating various examples of articles, methods, and apparatuses of the present specification. In the drawings:

[0027] FIG. 1 is block diagram of steps of a method of measuring displacement of an object, according to at least one embodiment described herein.

[0028] FIG. 2 is block diagram of steps of another method of measuring displacement of an object, according to at least one embodiment described herein.

[0029] FIG. 3A is a front view of an object in an unstretched configuration having two reticles positioned thereon, according to at least one embodiment described herein.

[0030] FIG. 3B is a front view of the object of FIG. 3A in a stretched configuration having two reticles positioned thereon, each reticle having been stretched by displacement of the object in a horizontal direction.

[0031] FIG. 30 is a front view of an object in an unstretched configuration, according to at least one embodiment described herein.

[0032] FIG. 3D is a front view of the object of FIG. 3C.

[0033] FIG. 4A is a top view of a marker for use in measuring displacement of an object, according to at least one embodiment described herein.

[0034] FIG. 4B is a top view of another marker for use in measuring displacement of an object, according to at least one embodiment described herein.

[0035] FIG. 40 is a top view of the marker of FIG. 3B in a first stretched configuration.

[0036] FIG. 4D is a top view of the marker of FIG. 3B in a second stretched configuration.

[0037] FIG. 5 is a block diagram of a system for measuring displacement of an object, according to at least one embodiment described herein.

[0038] FIG. 6 is a block diagram of a server of the system for measuring displacement of an object, according to at least one embodiment described herein.Detailed Description

[0039] Various apparatuses, systems and methods will be described below to provide an example of each claimed embodiment. No embodiment described below limits any claimed embodiment and any claimed embodiment may cover apparatuses, systems and methods that differ from those described below. The claimed embodiments are not limited to apparatuses, systems and methods having all of the features of any one apparatus, system or method described below or to features common to multiple or all of the apparatuses, systems and methods described below.

[0040] The embodiments described herein are implemented as apparatuses, systems and methods for measuring displacement of an object, and more specifically for measuring displacement of an object using non-contact digital image correlation.

[0041] Digital image correlation and tracking is an optical method that employs tracking and image registration techniques for accurate 2D and 3D measurements of changes in images.

[0042] Apparatuses, systems and methods for measuring the changes in volume of an object and / or changes in position of an object or a portion of an object, are described herein. The apparatuses, systems and methods provide for a subject (e.g., a person) to capture an image (e.g. with a camera, a mobile device, etc.) of an object, or a portion of an object, to perform the displacement measurement. Prior to capturing the image, in at least one embodiment, a marker may be applied to the potion of the object. The marker may be an indicia that is used during processing of the image to measure and / or assess movement of a portion of the object underlying the marker. For example, the marker may include a pattern of lines (hereinafter referred to as a marker and / or a reticle or a reticule) positioned thereon that change shape in response to movement of the object underlying the marker.

[0043] In at least one embodiment, the marker is a sticker or the like.

[0044] In at least one embodiment, the marker can be applied by being ink positioned on a film and by being placed directly on the object, such as but not limited to by applying pressure against the object.

[0045] In at least one embodiment, the marker can be a sticker held in place on the object by an adhesive.

[0046] Prior to capturing the image, in at least one embodiment, one or more markers present on the object may be identified by the image device and / or a processor communicatively coupled to the image capture device.

[0047] The apparatuses, systems and methods described herein may provide for the person to capture an image of the at least one marker on the object over various periods of time to perform a measurements of displacement of the object at various timepoints, to thereby assess changes in the size and / or shape of the object over time. The apparatuses, systems and methods described herein provide for a user to capture an image of the one or more markers with any camera, such as but not limited to a camera on a mobile device (e.g. a smart phone, a tablet, etc.).

[0048] It should also be understood that in some embodiments, the apparatuses, systems and methods described herein provide for the person to capture a video of the at least one marker on the object for a period of time to perform the displacement measurement(s) and assess changes in the size and / or shape and / or position of the object over the time of the video.

[0049] These systems, apparatuses and methods may be advantageous for measuring the displacement of objects, such as but not limited to structural objects.

[0050] As described further below, in these embodiments, a video may be captured showing motion of the object between a first position and a second position, the motion of the object between the first position and the second position representing a spectrum of movement in a particular direction. For example, the displacement, or movement, of the object between the first position and the second position may represent a spectrum of movement of a retaining wall moving, for example outwardly as it receives stress from, for example, soil.

[0051] Generally, the systems and methods described herein may be used for measuring displacement of any structural objects, including but not limited to retaining walls, bridges, an elevated structure of an expressway or a railway, or the like. In addition, the systems and methods described herein may be used for measuring displacement of other structural objects, such as but not limited to tubes and / or hoses and airplane components, such as wings.

[0052] It should be understood that as the object changes shape and / or volume and / or position, the pattern of markings on the marker change shape. The change in shape of the pattern of markings on the marker can be used to perform one or more displacement measurements.

[0053] In another embodiment, the apparatuses, systems and methods described herein may provide for the person to capture an image of the at least one marker on the object over various periods of time to perform a measurements of displacement of the object at various time points, to thereby assess changes in the size and / or shape of the object over time. The apparatuses, systems and methods described herein provide for a user to capture an image of the one or more markers with any camera, such as but not limited to a camera on a mobile device (e.g. a smart phone, a tablet, etc.), where the one or more markers are inherent features of the object.

[0054] For example, in this embodiment, the marker is a pattern of markings to measure displacement of an object, however, the pattern of markings itself may not change shape. Rather, the pattern of markings may change position relative to a fixed reference point adjacent to or proximate to the pattern of markings. In some examples, the fixed reference point may be indicated by a second marker that is either: applied to a portion of the object; separate and distinct from the object; one or more inherent features of the object.

[0055] In at least one embodiment, the apparatuses, systems and methods described herein provide for determining the change size and / or shape and / or position of an object by measuring, for example, changes in a distance between two or more markings of a pattern of markings with one or more reference points over time.

[0056] In at least one embodiment, the apparatuses, systems and methods described herein provide for converting a two-dimensional image of the pattern of markings into a three-dimensional image of the object.

[0057] In at least one embodiment, the measurements contemplated herein are performed without the use of any sensors or fixtures or other articles other than the markers described herein.

[0058] Generally, two different embodiments are described herein. In a first embodiment, a marker is applied to the structural object to measure the displacement of the structural object. The movement of markings of the marker in relation to a fixed reference marking is used to measure the displacement of the object.

[0059] In a second embodiment, features that are inherent to the object are used to measure the displacement of the structural object. Here, the movement of a plurality of markings of the object itself in relation to a fixed reference marking is used to measure the displacement of the object.

[0060] Referring now to FIG. 1 , a method 100 of measuring a displacement of an object is shown therein.

[0061] At a first step 102, a first marker is applied (i.e. fixed) to a portion of the object. In at least one embodiment, the first marker is applied to the object that is being measured. In at least one embodiment, the marker is applied to an outer surface of the object superficial to an interior feature of the object being monitored.

[0062] The marker can be any indicator that can be temporarily or permanently applied to the object. For example, the marker may be ink that is removable and / or fades over a period of time. In at least one embodiment, markers appropriate for use in the systems and methods described herein may include an ink that comprises a carrier and a colorant. The marker may also be a sticker that is applied to the object and adheres thereto.

[0063] The marker may be applied to the object using any method known to the skilled person for applying markers to surfaces. For example, the marker may be applied as a sticker onto the object, the sticker having a pattern of markings thereon. Each marking of the pattern of markings having an initial position.

[0064] The marker may be applied as ink directly onto the object using, for example, a dropper or a pen. The ink may optionally absorb at least partially into the object. The ink may optionally be applied by spraying the ink onto a stencil or template.

[0065] Herein, the marker includes a plurality of markings, or a pattern of markings, and be referred to as a reticle, or reticule, where a reticle is a series or a pattern of fine lines (e.g. straight and / or curved lines).

[0066] In at least one embodiment, a second marker (not shown) may be provided to the object to provide a fixed reference point for analysis of the movement and / or change in shape of the object. The second marker may be placed on a part of the object thatgenerally remains fixed during movement of the first portion having the first marker. For example, the second marker may be placed on a lowermost portion of the object where movement of the object is expected to be minimal (e.g., nearest to the ground, in the case of a retaining wall).

[0067] Turning back to FIG. 1 , at step 104, an image of the pattern of markings on the marker is captured at a first time after applying the marker to the portion of the object. At the first time, at least one marking of the pattern of markings has a subsequent position. In its subsequent position, the at least one marking of the pattern of markings has changed position relative to its first position when applied to the object.

[0068] In embodiments where the displacement of the object is measured using a reference marking, as the object moves, a position of at least one marking of the plurality of markings of the first marker will change relative to a second marker positioned at a fixed reference point. Accordingly, the position of the first marker can be measured relative to the second marker at the fixed reference point and the displacement of the object can be determined.

[0069] In other embodiments, as the object displaces, a position of at least one marking of the plurality of markings may change within the first marker. Accordingly, the dimensions of the markings comprising the first marker will change relative to one another (e.g. changes in the length, width and / or spacing between horizontal lines 202, vertical lines 204, curved lines 206 and / or reference points 208). As noted above, the change in dimensions of the markings of the marker can be used to measure displacement of the object having the marker. Put another way, changes in two-dimensional measurements between markings of the marker are used to measure three-dimensional displacement of the object underlying the marker.

[0070] For example, changes in the length and / or spacing between horizontal lines of the marker can be used to measure displacement in a vertical plane of the object, whereas changes in the length and / or spacing of the vertical lines of the marker can be used to measure displacement in a horizontal plane of the object. Similarly, changes in both vertical and horizontal line spacing or distortion can indicate a general state of object displacement (e.g. expansion or contraction). Changes in the physical dimensionsbetween markings of the marker (e.g. changes in spacing between markings, changes in length and / or width of the markings (i.e. both lines and / or circles and / or other shapes of the marker) are measured by an algorithm of a mobile application (as described further below) when an image of the marker in a subsequent arrangement and / or configuration are captured, such as but not limited to being captured using a camera of a on a smart phone or other mobile device (e.g. tablet).

[0071] After an image is captured using the device at step 104, at step 106, a change of position of the at least one marking of the pattern of markings is determined by comparing the subsequent position of the at least one marking in the captured image in relation to a reference marking to the initial position of the at least one marking in relation to the reference marking.

[0072] In at least one embodiment, the determining of the change of position of the at least one marking of the pattern of markings can be performed by an application running on a mobile device, such as but not limited to the mobile device having the camera that captured the image.

[0073] In another embodiment, the determining of the change of position of the at least one marking of the pattern of markings can be performed by a processor running, for example, on a computer or server that is remote from the mobile device that captured the image of the marker. In this case, prior to determining the change of position of the at least one marking of the pattern of markings, the image captured by the camera of the mobile device can be transmitted from the mobile device to the remote (e.g. lengths of lines and / or symbols of the marker, widths of lines and / or symbols of the marker, spacing between lines and / or symbols of the marker, etc.) in the image to stored dimensions of the first marker 200.

[0074] The image capture device can collect and store images of markers for later use.

[0075] At a step 108, based on the change of position of the at least one marking, determining the displacement of the object. After the image is captured and transmitted to a processor for processing, the processor measures the distances between the markings 201 and determines a displacement of the object.

[0076] Turning now to FIG. 2, shown therein is a method 150 of measuring a displacement of an object. Method 150 includes at a first step 152, identifying a plurality of markings on the object, each marking of the plurality of markings having an initial position. In this embodiment, it should be understood that the term “mark” or “markings” as used herein means any feature that can be used as an identifier in an image. The term “mark” or “markings” may include an edge of the object, a line on the object, a protrusion on the object,

[0077] Method 150 includes at a second step 252, identifying a reference marking.

[0078] Method 150 includes at a third step 154, capturing an image of the plurality of markings at a first time after identifying the plurality of markings on the object, at least one marking of the pattern of markings having a subsequent position at the time when the image is captured;

[0079] Method 150 includes at a fourth step 156, determining a change of position of the at least one marking by comparing the subsequent position of the at least one marking in the captured image in relation to a reference marking to the initial position of the at least one marking in relation to the reference marking.

[0080] Method 150 includes at a fifth step 158, based on the change of position of the at least one marking, determining the displacement of the object.

[0081] FIG. 3A is a front view of an object 175 in an unstretched configuration having two reticles 210 (described in greater detail below) positioned thereon. In this example, the object 175 is a retaining wall having a plurality of bricks 176. Over time, particularly with retaining walls, bricks forming the retaining wall may be displaced. In FIG. 3B, a plurality of bricks 176 of the wall 175 have protruded outwardly. Displacement of the bricks 176 has caused changes in the shape of reticle 210, as shown in FIG. 3B. The systems and methods described herein can be used to determine the displacement of the object 175 based on the changes in the shape of reticle 210, as captured by a camera.

[0082] In another embodiment, FIG. 3C shows a front view of an object is a front view of an object in an unstretched configuration. Again, in this example, the object 175 is a retaining wall having a plurality of bricks 176. In FIG. 3D, a plurality of bricks 176 ofthe wall 175 have protruded outwardly. In this case, displacement of the bricks 176 can be measured using the systems and methods described herein by measuring displacement of the bricks 176 relative to a reference or a template. For example, the reference can be an image of object 175 in the unstretched configuration. In another example, the reference can be an object having one or more markers that is spaced apart or otherwise not present on the object 175. In this example, displacement of the bricks 176 can be determined based on a comparison of a measurement between the displaced bricks 176 and the reference to a measurement between the undisplaced bricks 176 and the reference.

[0083] Turning to FIGS. 4A-4D, illustrated therein are examples of markers that may be used with the apparatus, systems and methods described herein.

[0084] The initial shape of the marker can provide for measuring a change in size and or shape of the object.

[0085] The marker includes markings that respond to movement of the underlying object. By measuring distances between points (e.g. reference points, or reference lines, or straight line segments, or curved line) of the markings shown in the captured image, the image can be used to assess the change in shape (e.g., displacement) of a portion of the object adjacent, or underlying, the marker.

[0086] Briefly, in one embodiment of a marker shown in FIG. 4A, marker 200 has a plurality of markings 201 including one or more vertical lines 202, horizontal lines 204, curved lines 206 and / or reference points 208. It should be understood that each of the lines 202, 204 also has end points, such as but not limited to end points 204a, 204b shown in FIG. 4A, that can be used as reference points for determining a change in shape of the marker 200 over time.

[0087] FIG. 4B shows another example of a marker 210. As shown therein, the one or more vertical lines 202, horizontal lines 204, curved lines 206 and / or reference points 208 may have different arrangements than shown in FIG. 4A. For example, a plurality of one or more vertical lines 202, horizontal lines 204, curved lines 206 and / or reference points 208 may be grouped to form shapes. For example, the one or more vertical lines 202 may be substantially vertical, the one or more horizontal lines 204 maybe substantially horizontal, the one or more curved lines 206 may be circular or may form other curved lines, or arc, having other shapes (oblong circles, etc.) and / or the one or more reference points 208 may be positioned at a centre of the marker or, alternatively, may be positioned anywhere within a perimeter of the marker. The perimeter of the marker is an imaginary boundary that is formed by an outermost marking on each of four sides of the marker.

[0088] FIG. 4B shows marker 210 comprising vertical lines 202, horizontal lines 204 and a curved line 206 in a neutral configuration. FIG. 4C shows a first stretched configuration of marker 210 where both vertical lines 202 and horizontal lines 204 have been stretched in at least two directions (e.g. the horizontal and the vertical direction) by movement of the underlying object. Further, curved line 206 has been stretched.

[0089] In FIG. 4D, vertical lines 202 remain unchanged relative to vertical lines 202 in FIG. 4C, however horizontal lines 204 are stretched due to movement of the underlying object in one direction (e.g. in a direction perpendicular to the horizontal lines 204 in FIG. 3A). In FIG. 4D, curved line 206 is stretched in another direction due to movement of the underlying object in one direction (e.g. in a direction perpendicular to the horizontal lines 204 in FIG. 4A).

[0090] It should be understood that the examples of markers shown herein are only a few examples, and the shape and / or configuration and / or arrangement of markings 201 within a marker 200 should be not limited to those arrangements shown in the examples.

[0091] Each of the markings 201 of the marker 200 (as well as markers 210, 220, 230) has known dimensions and / or known spacings from other markings within the marker the initial configuration or arrangement of marker 200.

[0092] In at least one embodiment, an engineer, for example, may then assess the displacement of the object and, for example, may relate the displacement to an expected outcome from knowledge or from a data base of similar displacements.

[0093] Management System

[0094] Referring now to FIG. 5, illustrated therein is a system 300 for measuring displacement of an object. System 300 comprises a plurality of mobile devices 302, eachhaving a camera 304, and a processor 806. For example, a person can capture a picture of the object using their mobile device 302. Stored on the mobile device 302 is an application 308. The person can use the mobile application 308 to send the picture to server 310 (via network 309) for redistribution for assessment. Device 312 can send information back to server 310 or directly to mobile device 302.

[0095] The server 310 may communicate with the plurality of mobile devices 302, a plurality of secondary devices 312 via network 309. The server 310 may be a purpose built machine designed specifically for implementing a system and method for creating maps of a facility.

[0096] The server 310, mobile devices 302 and secondary devices 312 may be a server computer, desktop computer, notebook computer, tablet, PDA, smartphone, or another computing device. The devices 302, 310 and 312 may include a connection with the network 309 such as a wired or wireless connection to the Internet. In some cases, the network 309 may include other types of computer or telecommunication networks. The devices 302, 310 and 312 may include one or more of a memory, a secondary storage device, a processor, an input device, a display device, and an output device. Memory may include random access memory (RAM) or similar types of memory. Also, memory may store one or more applications for execution by processor. Applications may correspond with software modules comprising computer executable instructions to perform processing for the functions described below. Secondary storage device may include a hard disk drive, floppy disk drive, CD drive, DVD drive, Blu-ray drive, or other types of non-volatile data storage. Processor may execute applications, computer readable instructions or programs. The applications, computer readable instructions or programs may be stored in memory or in secondary storage, or may be received from the Internet or other network 309. Input device may include any device for entering information into device 302, 310 and 312. For example, input device may be a keyboard, keypad, cursor-control device, touch-screen, camera, or microphone. Display device may include any type of device for presenting visual information. For example, display device may be a computer monitor, a flat-screen display, a projector or a display panel. Output device may include any type of device for presenting a hard copy of information, such as a printer for example. Output device may also include other types of output devices suchas speakers, for example. In some cases, devices 302, 310 and 312 may include multiple of any one or more of processors, applications, software modules, second storage devices, network connections, input devices, output devices, and display devices.

[0097] Although devices 302, 310 and 312 are described with various components, one skilled in the art will appreciate that the devices 302, 310 and 312 may in some cases contain fewer, additional or different components. In addition, although aspects of an implementation of the devices 302, 310 and 312 may be described as being stored in memory, one skilled in the art will appreciate that these aspects can also be stored on or read from other types of computer program products or computer-readable media, such as secondary storage devices, including hard disks, floppy disks, CDs, or DVDs; a carrier wave from the Internet or other network; or other forms of RAM or ROM. The computer- readable media may include instructions for controlling the devices 302, 310 and 312 and / or processor to perform a particular method.

[0098] In the present description, devices 302, 310 and 312 are described performing certain acts. It will be appreciated that any one or more of these devices may perform an act automatically or in response to an interaction by a user of that device. That is, the user of the device may manipulate one or more input devices (e.g. a touchscreen, a mouse, or a button) causing the device to perform the described act. In many cases, this aspect may not be described below, but it will be understood.

[0099] As an example, it is described below that the devices 302, 310 and 312 may send information to each other. For example, a person user may manipulate one or more input devices (e.g. a mouse, touchscreen, a keyboard, etc.) to interact with a user interface displayed on a display of the primary device 302. Generally, the device 302 may receive a user interface from the network 309 (e.g. in the form of a webpage). Alternatively or in addition, a user interface may be stored locally at a primary device 302 (e.g. a cache of a webpage or a mobile application).

[0100] Server 310 may be configured to receive a plurality of information, from each of the plurality of primary devices 302 and secondary devices 310. Generally, the information may comprise at least an identifier identifying a user of the primary device 302 and / or secondary device, respectively. For example, the information may compriseone or more of a username, e-mail address, password, or social media handle. The server may also receive an image of an object for devices 302, as described above, for a user to assess the object in the image.

[0101] In response to receiving information, the server 310 may store the information in a storage database. The storage database may correspond with secondary storage of the devices 302, 312. Generally, the storage database may be any suitable storage device such as a hard disk drive, a solid state drive, a memory card, or a disk (e.g. CD, DVD, or Blu-ray etc.). Also, the storage database may be locally connected with server 806. In some cases, the storage database may be located remotely from server 310 and accessible to server 310 across a network for example. In some cases, storage database may comprise one or more storage devices located at a networked cloud storage provider.

[0102] Primary device(s) 302 may be associated with a user account. Similarly, the secondary device(s) 312 may be associated with a user account. Any suitable mechanism for associating a device with an account is expressly contemplated. In some cases, a device may be associated with an account by sending credentials (e.g. a cookie, login, or password etc.) to the server 310. The server 310 may verify the credentials (e.g. determine that the received password matches a password associated with the account). If a device is associated with an account, the server 310 may consider further acts by that device to be associated with that account.

[0103] Devices 302, 312 and server 310 may communicate asynchronously, for example, by using an implementation of the WebSocket protocol, such as Socket. IO. Updates may be sent from the server 310 to each of the devices 302, 312 in real time as interrupts, i.e. , without polling. Likewise, user interaction data may be sent from each of the devices 302, 312 to the server 310 in real time as interrupts, i.e., without polling.

[0104] Turning now to FIG. 6, illustrated therein is the server 310, in accordance with an embodiment. The server 310 includes a content management system (CMS) 324, and an analytics database system 326. The server 310 may include multiple backend devices, e.g., servers. The CMS 324 and the analytics database system 326 may be hosted by the server 310.

[0105] In some embodiments, the CMS 324 may be a frontend interface application, typically, implemented as a web service. In some embodiments, CMS 324 stores content, including information relating to the displacement of the object, manages updates to the content received from the devices 302, 312 and provides content to the devices 302, 312. For example, the CMS 324 may be a no structured query language (NoSQL) database application.

[0106] In some embodiments, the analytics database system 326 includes or is operatively connected to an analytics engine 332. The analytics database system 826 may be a database application, typically implemented as a web service. The analytics database system 326 stores all user interactions, e.g., user selections or "hits", searches, dates, types of mobile device, and generates analytics relating to the user interactions. Advantageously, because user interactions are recorded for several different devices of the devices 302, 312 a relatively large sample size is obtained. Further, the analytics database system 326, with analytics engine 332, performs and stores aggregate data analysis on the collective data set that can allow for analysis of all parameters relating to the object.

[0107] In some embodiments, the application 308, when launched on the mobile device 302, takes control of the camera 304. In some embodiments, an identity of the user is confirmed prior to launching the application. For example, the application 308 can confirm the identity of the user using one or more of facial recognition software, an iris scan or a fingerprint scan on the mobile device 302. Confirmation information generated based on one of the aforementioned techniques of confirming an identity can be recorded and linked to the medical record at server 310. Confirmation can occur when the application 308 has been downloaded into mobile device 302. In another example, a user can provide confirmation information through secondary device 312 such as by entering a license number, for example. Confirmation information cannot be viewed or retrieved by the user of the primary device 302 but resides on server 310.

[0108] When application 308 is launched and camera 304 is focused on the marker 200, application 308 may assume control by the camera 304 through recognition of, for example, specific features of marker 200. The application 308 can then project an azimuthonto a display of the mobile device 302 which can guide the holder of the device 302 to align the camera 304 with the marker 200 to the most optimal position to get a representative picture of the marker 200 and / or the object.

[0109] Application 308 can use the marker 200 to both guide the device 302 as to positioning and to measure displacement of the object.

[0110] In another embodiment, the user is able to control who has access to the image date transferred via application 308, so that various secondary users can have access to the image data. Access to data can be configured at server 310 where the image data is stored. In some embodiments, image data may not be stored on the device 302. Rather, a user can request to receive image data stored on server 310 for a period of time after providing the image data to server 310 (e.g. for a period of 2 years after the service is used).

[0111] While the applicant's teachings described herein are in conjunction with various embodiments for illustrative purposes, it is not intended that the applicant's teachings be limited to such embodiments as the embodiments described herein are intended to be examples. On the contrary, the applicant's teachings described and illustrated herein encompass various alternatives, modifications, and equivalents, without departing from the embodiments described herein, the general scope of which is defined in the appended claims.

Claims

ClaimsWhat is claimed is:1 . A method of measuring a displacement of an object, the method comprising: applying a first marker to a portion of the object, the first marker having a pattern of markings thereon, each marking of the pattern of markings having an initial position; capturing an image of the pattern of markings at a first time after applying the first marker to the object, at least one marking of the pattern of markings having a subsequent position at the first time when the image is captured; determining a change of position of the at least one marking by comparing the subsequent position of the at least one marking in the captured image in relation to a reference marking to the initial position of the at least one marking in relation to the reference marking; and based on the change of position of the at least one marking, determining the displacement of the object.

2. The method of claim 1 further comprising applying a second marker to the object as the reference marker.

3. The method of claim 1 or claim 2, wherein capturing the image includes capturing a first image of the pattern of markings when the marker is at a first position and capturing a second image of the pattern of markings at a second position to determine a complete spectrum of movement of the object.

4. The method of any one of claims 1 to 3 further comprising, prior to applying the marker to the portion of the object, applying a stencil to the portion of the object, the stencil having the pattern of markings cut out to provide for the semi-permanent ink to pass through openings forming the pattern of markings and into the object.

5. The method of any one of claims 1 to 4, wherein the pattern of markings includes straight line segment markings and curved line segment markings.

6. The method of any one of claims 1 to 5, wherein the pattern of markings includes a plurality of dots and a plurality of fiducials.

7. The method of claim 6, wherein the plurality of fiducials each have a cross shape.

8. The method of claim 6, wherein the pattern includes three fiducials, each having a cross shape.

9. The method of claim any one of claims 1 to 8, wherein determining the change of position of the at least one marking includes comparing a subsequent position of at least one feature of at least one of the fiducials in the captured image to an initial position of the at least one feature of the of at least one of the fiducials in a template image.

10. A method of measuring a displacement of an object, the method comprising: identifying a plurality of markings on the object, each marking of the plurality of markings having an initial position; identifying a reference marking; capturing an image of the plurality of markings at a first time after identifying the plurality of markings on the object, at least one marking of the pattern of markings having a subsequent position at the time when the image is captured; determining a change of position of the at least one marking by comparing the subsequent position of the at least one marking in the captured image in relation to a reference marking to the initial position of the at least one marking in relation to the reference marking; and based on the change of position of the at least one marking, determining the displacement of the object.11 . The method of claim 10, wherein the reference marking is on the object.

12. The method of claim 10, wherein the reference marking is not on the object.

13. The method of any one of claims 10 to 12 further comprising applying a second marker to the object as the reference marker.

14. The method of any one of claims 10 to 13, wherein capturing the image includes capturing a first image of the pattern of markings when the marker is at a first position and capturing a second image of the pattern of markings at a second position to determine a complete spectrum of movement of the object.

15. The method of any one of claims 10 to 14, wherein determining the change of position of the at least one marking includes comparing a subsequent position of at least one feature of at least one of the fiducials in the captured image to an initial position of the at least one feature of the of at least one of the fiducials in a template image.

16. A system for performing a measurement of an object, the system comprising: a computer processor coupled to a memory, wherein the computer processor is programmed to perform the measurement by: identifying a plurality of markings on the object, each marking of the plurality of markings having an initial position; identifying a reference marking; capturing an image of the plurality of markings at a first time after identifying the plurality of markings on the object, at least one marking of the pattern of markings having a subsequent position at the time when the image is captured; determining a change of position of the at least one marking by comparing the subsequent position of the at least one marking in thecaptured image in relation to a reference marking to the initial position of the at least one marking in relation to the reference marking; and based on the change of position of the at least one marking, determining the displacement of the object.

17. The system of claim 16, wherein the reference marking is on the object.

18. The system of claim 16, wherein the reference marking is not on the object.

Images