A system and method for creating surface textures using augmented reality.

Abstract

The invention relates to a system and method that automatically calculates the surface area in square meters by allowing the user to accurately determine corner points, and determines the required amount of material for that area in real time. It also performs dynamic cost calculations based on unit price and allows users to quickly switch between different cladding options.

Description

1 TARIFF Augmented reality system and method for creating surface textures. Technical Area 5 The invention involves using augmented reality (AR) technology in the construction and interior design fields to apply materials such as parquet and ceramics. enabling the virtual placement of surface coating materials into the real world. It is related to the system and method. State of the Art Current augmented reality (AR) applications involve the virtual placement and preview of objects. Although these applications offer basic functions for monitoring, they have significant shortcomings and technical issues. It has limitations. 15 1. Surface Area Measurement and Square Meter Calculation Problems Current Applications: Some AR-based applications can manipulate objects that occupy space on a surface. It offers the function of virtually placing the image on top of the user's current environment. This Applications generally focus on providing visual previews, but also things like square meter calculations. They don't take detailed measurements. For example, IKEA's AR-based app allows users to measure furniture. and allows the placement of decorative items, but only the space occupied by the placed items. It doesn't measure. Deficiency: The user is only able to see a virtual preview and does not get an accurate representation of the area to be textured. In order to calculate it this way, an additional application or manual measurement is required. Furthermore, Because current applications generally do not provide automatic measurement of surface area. It becomes difficult for users to determine how much material they will need for the coating. In particular, functions such as accurately determining corner points are missing. Technical Problem: - Manual Calculation Requirement: Users must manually calculate the square meterage. This becomes a time-consuming and error-prone process. Incorrect calculations... These areas may result in excess or insufficient material procurement. 2 - Inefficiency: Especially in large projects, when accurate measurements are not taken, the project budget can be wasted. Problems may arise or delays may occur. Also, due to incorrect area calculations. Problems such as material waste or project disruptions may occur. 2. Sensitivity and User Interaction Problems 5 Current Applications: Most AR applications require the user to manually place virtual items. It allows for modification, but these operations are generally not precise and do not accurately determine the surface area. It can be difficult to determine this in any way. Also, the accuracy of the points placed by the users is another matter. It is limited. Such applications require the proper placement of materials in a real-world environment. It does not simulate. 10 Disadvantage: The user has to manually select each point on the surface, and AR technology... The level of precision it offers is often insufficient. For example, on the floor or wall. The designated points may be misaligned or the virtual placement of the coating material may be incorrect. Slippage may occur during this process. 15 Technical Problem: - Incorrect Point Placement: Applications may involve the incorrect placement of corner points or surface boundaries. When it does not allow for precise determination, the materials placed may be incorrect. Alignment or visual distortions occur. This reduces the usability of the application. It reduces it significantly. - Deterioration of User Experience: Such applications, which fail to offer adequate sensitivity, This produces results that are inconsistent with what users would achieve in the real world. Therefore, the user finds that the design they see in the AR application is satisfactory in the real world. He might realize it won't happen. 25 3. Lack of Real-Time Dynamic Computing Current Applications: Many current AR applications only show the placed objects. It provides a visual preview and dynamic information such as the price or quantity of these materials. It doesn't provide calculations. For example, in the Marshall paint-and-see application, the application only provides those 30 It shows what the material will look like, but also how much material is needed for that coating. It cannot detect this and calculate the cost in real time. Shortcoming: Applications typically provide static images, and after the user applies the surface, When the surface area changes or different materials are tried, the cost of these changes is 35. 3 It cannot perform the calculation. Also, it cannot quickly switch between different texture options. It would also be impossible to see the cost differences. Technical Problem: - Cost Analysis Challenge: Users wonder which coating material is more cost-effective. To determine if it is feasible, external cost calculations must be performed. This is especially important when the surface dimensions change frequently or when different materials are being tested. It becomes quite laborious when desired. - Time Wasted: The user uses the application for material selection and placement, but After that, you have to evaluate the material costs using a separate calculation tool. 10 This prolongs the process and makes the application more complicated to use. 4. Compatibility and Scalability Issues Current Applications: Some AR applications are based on a specific surface type or material. It has been optimized. For example, healthy 15 is only suitable for rooms of certain sizes or on flat floors. It works. It may not work correctly in areas with complex shapes or curved surfaces. Shortcoming: The applications do not allow users to apply coatings to areas of different shapes and sizes. It may be insufficient to meet the needs. This means the application has a large user base. This makes it difficult for them to adopt it. 20 Technical Problem: - Limited Application Area: Existing applications are limited to standard rooms or flat surfaces. This also allows for the coating of surfaces with complex shapes or in larger projects. It makes it difficult to use. 25 - Lack of Realistic Experience: Inability to work on curved surfaces or irregular areas. The applications do not offer users sufficient realism. The application numbered 2020 / 11632 was revealed as a result of technical investigations. Summary: “The invention is a carpet, rug, 30 that can be used for educational, gaming, product information and / or advertising purposes. patterns of pile products made of right-angled yarns such as mats, tufts and / or runners Identifying and embedded products in these patterns through augmented reality applications. It is related to a system that enables information to be presented to users interactively.” It is in this form. 35 4 As can be seen, the system is related to augmented reality and smart carpet applications, and this alongside a structure that can provide solutions to the disadvantages mentioned above It does not mention it. In conclusion, due to the negative aspects described above and the current solutions, topic 5 Due to its shortcomings, it has become necessary to make improvements in the relevant technical field. The purpose of the invention The invention represents a new breakthrough in this field, unlike the structures used in the current technology. The aim is to create a structure with different technical specifications that bring these elements together. The primary purpose of the invention is to combine augmented reality (AR) technology with construction and interior design. Virtually bringing surface covering materials such as parquet and ceramics into the real world. The goal is to establish a system and method that enables its placement. 15 One aim of the invention is to enable users to visually plan surface coating processes, It can measure the area to be covered in square meters and the material costs. The goal is to enable calculations. This invention benefits both professionals and individual users. It aims to facilitate surface coating operations. 20 The purpose of the invention is to enable the user to accurately determine the corner points of a surface. automatically calculates the area in square meters and the materials needed for that area. The goal is to develop a system and method that determines the quantity in real time. Furthermore, It performs dynamic cost calculations based on unit price and allows users to choose different textures. 25 This allows them to quickly switch between options. This makes projects both more efficient and better. This ensures both faster completion and greater cost efficiency. The invention allows the user to specify the surface they want to cover in an AR-based application using corners. It allows the selection of points in real time. By connecting these points, the surface area is 30 It is automatically calculated in square meters. This allows the user to determine the area they will cover. You don't have to measure manually and you get accurate results quickly.  Real-time Corner Point Determination: The application uses the camera to... It allows specific points on the surface to be selected by clicking. These points By connecting them, the boundaries of the surface are drawn. 35  Automatic Square Meter Calculation: Surface area based on selected corner points, The application automatically calculates the square meter value and displays it instantly. It is shown to the user. The invention uses augmented reality (AR) technology to more precise cornering and surface identification. It offers user-friendly interaction in the alignment and placement of coating materials. This In this way, users can accurately mark and coat every corner of the surface. The materials are placed on the surface in a realistic and accurate manner.  Enhanced AR Sensitivity: More precise identification of surface corner points. And AR technology has been optimized for alignment. 10  Even Material Placement: The application ensures an even placement of materials on the surface. This ensures proper alignment and prevents slippage, resulting in a more accurate virtual environment. It offers an experience. The invention is a 15 that can work on both flat surfaces and surfaces with complex shapes. It has a structure. The application accurately marks corner points even on irregular surfaces. By sensing the surface area, it can calculate it and optimize the coating process.  Adaptive Geometric Algorithms: The application works with different shapes and sizes. It includes algorithms that can work on surfaces. Thanks to these algorithms, sloping or Successful results are also obtained on irregular surfaces. 20  Scalable Structure: Suitable for both small projects (e.g., floor covering for a room) and also in larger projects (for example, covering all the floors inside a building) available. To fulfill the purposes described above, the invention has 25 years of experience in the fields of construction and interior design. Augmented reality technology brings surface coating materials into the real world virtually. It is a system that enables its placement, and its feature is;  mobile where the augmented reality application runs and interacts with the user device,  Real-time scanning of the surface, 30 images of a specific surface The camera enables the capture and transfer of the data to the microprocessor.  By providing the core processing power for augmented reality applications, image processing, area calculation, corner detection, and augmented reality data processing tasks. the microprocessor that performs,  The microprocessor operates on and detects the corner points defined by the user on the surface. 35 detecting the boundaries and corners of the surface in the images provided by the camera. 6 Corner detection uses edge and corner detection techniques to find corner points. unit,  the microprocessor that runs on the material to be used for coating the surface to ensure that its texture and color are placed on the existing surface in the most suitable way 5. Performs color and texture analysis, simulates natural lighting and shadow effects on the surface. by performing color and texture analysis, which allows for a realistic representation of the object. unit,  a microprocessor that recognizes and processes planar areas of a surface. This enables virtual objects to be positioned evenly on the surface. surface detection unit, 10  The microprocessor operates and displays the user-defined corner points on the screen. ensuring it remains stable and, during surface scanning, at each corner point By tracking its location via the image, the area is determined according to the user's selections. image marking unit that marks,  running on a microprocessor and virtual flooring or cladding objects on the surface 15 enabling the virtual object to be placed on the surface with the correct perspective and the surface an object placement unit that maintains its coherence and presents a realistic visual impression,  running on a microprocessor and making virtual objects appear natural on the surface It performs ambient lighting and shadow calculations, and thus provides virtual 20 that allows materials to present a harmonious image with other objects on the surface lighting and shading unit,  a surface that operates on a microprocessor and between the vertices selected by the user It uses the pixel density on the image to calculate its area, and this thus, a surface area calculation unit that determines the surface area covered by the surface.  virtual 25 that runs on the microprocessor and is placed on the surface chosen by the user the material to fit the surface perfectly in terms of scale and proportion tissue placement and scaling unit that enables adjustment,  The unit operates on a microprocessor and after the coating material is applied. automatically calculates the cost based on the price and the total square meterage of the surface. 30 that provides the user with instant cost information using the value and unit price of the material. cost calculation unit,  Visual outputs from the augmented reality application's user interface enabling the user to define the surface area, corner points, and texture elements. allows monitoring the installed state and the progress of the surface coating process. Screen 35 that displays calculated costs in real time It includes. 7 The structural and characteristic features and all the advantages of the invention are given in the figures below. Thanks to the detailed explanation written with references to the figures, it becomes clearer. This will be understood, and therefore the evaluation should also take these figures and detailed explanations into account. It must be done by taking 5. Ways to Help Understand the Discovery Figure 1 shows a general representation of the system that is the subject of the invention. The drawings do not necessarily need to be scaled and are necessary for understanding the invention. Details that are not present may have been overlooked. Furthermore, at least to a large extent... Elements that are identical or at least have substantially identical functions are numbered the same. It is shown. Explanation of Part References 10. Mobile device Camera 20 30. Microprocessor 20 31. Corner detection unit 32. Color and texture analysis unit 33. Surface detection unit 34. Image marking unit 35. Object placement unit 25 36. Lighting and shading unit 37. Unit for calculating surface area. 38. Tissue placement and scaling unit 39. Cost accounting unit 40. Screen 30 Detailed Description of Find In this detailed explanation, the preferred configurations of the invention are not merely for better understanding the subject. 35 It is explained. 8 The invention involves using augmented reality (AR) technology in the construction and interior design fields to apply materials such as parquet and ceramics. enabling the virtual placement of surface coating materials into the real world. It is related to the system and method. The elements and functions used in the system and method that are the subject of the invention are as follows: The mobile device (10) runs the augmented reality (AR) application and interacts with the user. It is the device that provides. The mobile device has a camera (20), screen (40), microprocessor (30), GPU and operating system components enable the mobile application to run. 10 The camera (20) enables real-time scanning of the surface, and captures an image of a specific surface. It is the element that enables the capture and transfer to the microprocessor (30). The microprocessor (30) provides the core processing power of the AR application, image processing, area 15 performing calculation, corner detection and augmented reality data processing tasks It is an element. For the analysis of the surface area in the images taken via the camera (20). Image processing algorithms are run. Corner point identification and area calculations are performed. This is done on the microprocessor (30). The necessary mathematical operations for area calculations (e.g., determining the surface area according to pixel density) by microprocessor (30) 20 The results are integrated with augmented reality data and displayed in real time. It is updated. The microprocessor (30) constantly exchanges data with the camera (20). The microprocessor (30), It transmits the data to the server, enabling further processing when needed. Screen (40) provides visual outputs via the AR application's user interface, 25 the user's surface area, corner points, and the placement of texture elements It allows monitoring the progress of the surface coating process and the calculated costs. It is a unit that displays surface texture images processed by AR in real time. is displayed on the screen (40). After the user determines the corner points he / she has chosen, how the surface looks how it will be coated, how the coating materials will look live on the screen (40) 30 can be monitored. When the user selects a corner point or changes the covering material. The screen (40) instantly displays these updates, allowing the user to quickly and intuitively It experiences the surface by working in sync with the screen (40), camera (20) and microprocessor (30). It presents images, user input, and calculations in real time. 35 9 The corner detection unit (31) runs on the microprocessor (30) and detects the user's surface In the images provided by the camera (20) which detects the corner points it has determined using edge and corner detection techniques to find surface boundaries and corner points It is a unit. In the corner detection unit (31), the camera (20) image is filtered using gradient-based filtering. By processing the material, the points where the edges are located are determined. These points are 5 of the surface. It is used as a reference in defining boundaries and placing objects. The color and texture analysis unit (32) works on the microprocessor (30) and the surface coating The texture and color of the material to be used should be most suitable for the existing surface. color and texture analysis is performed to ensure proper placement, taking into account natural lighting on the surface and 10 By simulating shadow effects, it enables the object to be displayed realistically. It is a unit. In the color and texture analysis unit (32), histogram analysis of the image is performed and The color intensities on the surface are determined. The virtual material is then placed on the surface using these colors. They are adapted to their densities. The surface detection unit (33) operates on the microprocessor (30) and detects the planar areas of the surface. recognition and thus the proper positioning of virtual objects on the surface It is the unit that provides. In the surface detection unit (33), between successive frames of the images Parallax differences are calculated and used in conjunction with the device's depth sensors to determine the plane. Structures are determined. These algorithms identify virtual objects by determining the surface position. It identifies the area where it will be placed. The Image Tracking unit (34) runs on the microprocessor (30) and The system ensures that the corner points defined by the user remain fixed on the screen and on the surface. During scanning, by tracking the position of each corner point on the image, 25 It is the unit that marks the area according to the user's selections. In the image marking unit (34), The characteristics of selected corner points on the surface are extracted and continuously monitored on the image. This This ensures that virtual objects remain stationary on the surface even if the user moves. Image The pointing unit (34) keeps the selected corner points or certain features fixed on the screen. This allows for continuous monitoring of the surface. This process ensures that certain 30 images are captured by the camera (20). by defining points, extracting features, and tracking these features in each frame. This is achieved. Even if the position of the corner points changes, the object remains fixed on these points. The object placement unit (35) runs on the microprocessor (30) and is a virtual tile or This allows the coating objects to be placed on the surface with an accurate perspective, and 35 It is a unit that maintains the virtual object's conformity with the surface and provides a realistic visual impression. Object placement unit (35) places 3D virtual objects according to the image taken from the camera (20). To adapt, object transformation algorithms are used. As the camera (20) moves, the object, It is recalculated and fitted to the surface so that it remains at the correct angle to the surface. Affine The transformation is used to correctly position the virtual object on the surface. The user's... 5 performs scaling, rotation, and scrolling operations according to the surface corner points it defines. It accomplishes. The lighting and shading unit (36) runs on a microprocessor (30) and is virtual ambient lighting and shadow calculations to make objects appear natural on the surface and thus creates a consistent image of virtual materials with other objects on the surface. 10 It is the unit that enables the presentation. In the lighting and shading unit (36), from the camera (20) By analyzing the incoming light intensity, natural shadow and light effects are created on the surface. Shading algorithms enhance the sense of depth of virtual materials on the surface, making them more realistic. It presents a visual. The surface area calculation unit (37) runs on the microprocessor (30) and is selected by the user. pixels on the image to calculate the surface area between the vertices. It is the unit that uses density and thus determines the surface area covered. Here Cost is calculated based on unit price over the calculated area. Surface area In the calculation unit (37), the area between the vertices selected by the user is 20 pixels. It is calculated via and provides a precise measurement of the surface. Length per pixel The surface area in square meters is determined by calculation. The tissue placement and scaling unit (38) runs on the microprocessor (30) and the user The virtual material (parquet, ceramic, etc.) to be placed on the selected surface must have a scale and proportion of 25. It is the unit that allows it to be adjusted to fit the surface perfectly. The size of the surface and The texture image is rendered on the surface by adjusting the scale of the virtual material according to its shape. is installed. Thanks to this unit, the surface coating process is carried out in real dimensions and detail. It is displayed. The cost calculation unit (39) runs on the microprocessor (30) and the coating material After installation, it automatically calculates the cost based on the unit price and the surface. The cost is instantly provided to the user using the total square meter value and the unit price of the material. It is the unit that provides information. This calculator helps the user plan their budget. 35 11 Finally, all steps of the coating process are controlled by a microprocessor (30) using AR technology. The surface is shown to the user visually via the screen (40). The user sees the surface applied You can see how the material will look in real time and make your choice accordingly. This allows the finished surface to be digitally modeled and presented to the user. An interactive experience is provided. 5 These elements work together to guide the user in applying the selected material to the surface correctly. performing placement, area calculation, and cost estimation processes quickly and efficiently. It offers the opportunity. The steps involved in the process of implementing the system described in this invention are listed below: 10  Applying a coating via the camera (20) using the user's mobile device (10). displaying the desired surface,  Transmission of data received from the camera (20) to the microprocessor (30),  Detection of corner points by the corner detection unit (31),  Color and texture analysis unit (32) will use 15 for surface coating. ensuring the texture and color of the material are placed in the most suitable way on the existing surface. color and texture analysis to ensure accuracy.  The surface detection unit (33) detects virtual objects smoothly on the surface. Recognizing the planar areas of the surface to enable its positioning,  The image marking unit (34) determines the corner points of the user. To ensure it remains fixed on the screen, each corner is scanned during the surface scanning process. The position of the point is tracked on the image, according to the user's selections. marking the area,  Virtual flooring or cladding objects by the object placement unit (35) placing it on the surface with a correct perspective, 25  The lighting and shading unit (36) creates the natural surface of virtual objects. Calculations of ambient lighting and shadows are necessary for the image to be visible.  The corner points selected by the user by the surface area calculation unit (37) Calculating the area of ​​the surface between them,  The tissue placement and scaling unit (38) places the 30 tissue on the surface selected by the user. The virtual material to be placed will fit the surface perfectly in terms of scale and proportion. adjusting in this way,  After the coating material is placed, by the cost calculation unit (39), Automatic cost calculation based on unit price and total surface area. Using the square meter value and the unit price of the material, the user is given an immediate cost of 35. information to be provided, 12  All steps of the coating process are augmented reality by the microprocessor (30) Showing the user visually on the screen (40) with technology.

Claims

13 REQUESTS 1. Augmented reality technology for surface coating in the fields of construction and interior design. It is a system that enables the virtual placement of materials into the real world. Feature; 5  mobile where the augmented reality application runs and interacts with the user device (10),  Real-time scanning of the surface, image of a specific surface camera (20) that enables capture and transfer to microprocessor (30),  By providing the core processing power for augmented reality applications, image processing, 10 area calculation, corner detection, and augmented reality data processing tasks. microprocessor (30) that performs  The microprocessor (30) runs on the corner points defined by the user on the surface detecting the boundaries and corners of the surface in the images provided by the camera (20). Corner detection unit 15 uses edge and corner detection techniques to find corner points. (31),  microprocessor (30) that runs on and will be used for surface coating ensuring the texture and color of the material are placed in the most suitable way on the existing surface. to provide color and texture analysis, considering natural lighting and shadow on the surface. 20 by simulating its effects, enabling a realistic display of the object. color and texture analysis unit (32),  microprocessors (30) that operate on and recognize the planar areas of the surface and This allows virtual objects to be positioned evenly on the surface. surface detection unit (33),  The microprocessor (30) runs on and the user-defined corner points 25 ensuring it stays fixed on the screen and, during surface scanning, each corner By tracking the position of the point on the image, according to the user's selections Image marking unit marking the area (34),  microprocessors (30) that run on virtual tile or cladding objects enabling the virtual object to be placed on the surface with an accurate perspective, and the virtual object's 30 an object that maintains its conformity with the surface and presents a realistic visual impression placement unit (35),  a microprocessor (30) that runs on the virtual objects and makes them appear natural on the surface It performs ambient lighting and shadow calculations, and thus provides virtual 35 that enable materials to present a harmonious image with other objects on the surface lighting and shading unit (36), 14  The microprocessor (30) runs on the and between the vertices selected by the user. It uses the pixel density on an image to calculate the surface area, and In this way, the surface area calculation unit (37) determines the surface area coverage area.  virtual machines that run on the microprocessor (30) and are placed on the surface chosen by the user 5 The material must fit the surface perfectly in terms of scale and proportion. Tissue placement and scaling unit (38) that enables adjustment,  running on the microprocessor (30) and after the coating material is placed, automatically calculates the cost based on the unit price and the total surface area. The cost is instantly provided to the user using the square meter value and the unit price of the material. The cost accounting unit (39) providing information, 10  Visual outputs from the augmented reality application's user interface enabling the user to define the surface area, corner points, and texture elements. allows monitoring the installed state and the progress of the surface coating process. Screen showing the calculated costs in real time (40) It includes. 15 2. Augmented reality technology for surface coating in construction and interior design. It is a method that enables the virtual placement of materials into the real world. feature;  Applying a coating via the camera (20) using the user's mobile device (10) 20 displaying the desired surface,  Transmission of data received from the camera (20) to the microprocessor (30),  Detection of corner points by the corner detection unit (31),  Color and texture analysis unit (32) will use the surface coating to be used 25 color and texture analysis to ensure accuracy.  The surface detection unit (33) detects virtual objects smoothly on the surface. Recognizing the planar areas of the surface to enable its positioning,  The corner points determined by the user by the image marking unit (34) To ensure it remains fixed on the screen, each corner is scanned 30 degrees during surface scanning. The position of the point is tracked on the image, according to the user's selections. marking the area,  Virtual flooring or cladding objects by the object placement unit (35) placed on the surface with the correct perspective,  The lighting and shading unit (36) creates the natural 35 of the virtual objects on the surface. Calculations of ambient lighting and shadows are necessary for the image to be visible.  The corner points selected by the user by the surface area calculation unit (37) Calculating the area of ​​the surface between them,  The tissue placement and scaling unit (38) is applied to the surface selected by the user. The virtual material to be placed will fit the surface perfectly in terms of scale and proportion. adjusting it in this way, 5  After the coating material is placed, by the cost calculation unit (39), Automatic cost calculation based on unit price and total surface area. The cost is instantly provided to the user using the square meter value and the unit price of the material. information to be provided,  All steps of the coating process are augmented reality by the microprocessor (30) 10 to be shown to the user visually via the screen (40) with technology It includes the steps of the process.