TWO-DIMENSIONAL PLAN-DIGITAL TWIN SYNCHRONOUS NAVIGATION, SPATIAL SIMULATION, AND REAL-TIME DECISION SUPPORT SYSTEM WITH PEN AND TOUCH-BASED INTERACTION.

Abstract

The invention comprises a touchscreen tablet / notebook body (1), a pen / touch input sensing unit (2) that detects user touch and pen-based interactions, an input interpretation and gesture recognition module (3), a two-dimensional plan processing module (4), a semantic mapping and plan-digital twin association engine (5) that semantically associates a point, line, area or spatial unit on a two-dimensional plan with its counterpart in a three-dimensional digital twin model, a three-dimensional digital twin model management module (6) that manages the three-dimensional digital twin model and performs operations on the spatial component determined as a result of semantic mapping, and a synchronous navigation and camera orientation module (7) that determines the viewing point, viewing direction or navigation route within the three-dimensional digital twin model depending on the result of semantic mapping.Pen-based spatial scenario simulation module (8), which converts pen-based or touch-based spatial inputs made on the plan into simulation input; real-time design impact analysis module (9), which processes design impact data based on spatial data associated with user interaction; adaptive layered plan-3D filtering and visualization module (10), which shows or hides the relevant data layers in the three-dimensional digital twin model based on the selected functional data on the plan; haptic feedback unit (11), which generates vibration or tactile signals based on spatial data; multi-user synchronization and data sharing module (12), which simultaneously brings together plan interactions, marking data and digital twin location data of multiple users through a common data structure; BIM / CAD data integration module (13), which transfers two-dimensional plan and three-dimensional model data from BIM / CAD-based sources to the system; navigation,The decision support and output generation module (14), which converts simulation and design impact analysis data into visual, numerical or reportable output data, consists of a processor (15), a database (16) and a server (17).

Description

1 TARIFF TWO-DIMENSIONAL PLANNING WITH PEN AND TOUCH-BASED INTERACTION. DIGITAL TWIN SYNCHRONOUS NAVIGATION, SPATIAL SIMULATION AND REAL-TIME DECISION SUPPORT SYSTEM 5 Technological Field: This invention has applications in architecture, interior design, building information modeling (BIM), and computer-aided design. design (CAD), digital twin systems, construction technologies, real estate development, facility 10 management, smart building systems, urban design, campus planning, architectural project design, interior design, concept development, implementation project review, project presentation, design validation, user experience evaluation, spatial simulation, circulation analysis, accessibility analysis, density analysis, user movement analysis, Security and circulation planning, disaster and evacuation scenario development, trade fairs and exhibitions 15 area planning, education, research, digital presentation, and real estate marketing applications. two-dimensional planning with pen and touch-based interaction that can be used in the fields. Digital twin synchronous navigation, spatial simulation, and real-time decision support. It is related to the system. State of the Art: In today's architectural and interior design project development processes, two-dimensional plans are used. creation, preparation of three-dimensional models, modeling of structural elements, and Computer-aided design (CAD) and building information systems for managing project data. 25 Building Information Modeling (BIM) based software is widely used. The systems allow a certain degree of correlation between two-dimensional plan data and three-dimensional model data. It can provide simultaneous updates and data integrity. In this context, it is two-dimensional. A geometric change made on the plan is reflected in the three-dimensional model. can be reflected or an arrangement performed on a three-dimensional model related to 30 It can be updated in two-dimensional views. However, with a two-dimensional plan... 2 The relationship between the three-dimensional models is primarily based on different versions of the same project data. It is based on the geometric and representational synchronization between the views. In known techniques, user interaction generally involves menus, toolbars, and commands. This is done through sequences and predefined software tools. 5 The user can interact with the two-dimensional plan using touch, drag, freehand drawing, and a pen. Interactions it performs in the form of direction finding, route creation, or area marking They cannot be interpreted as commands that mostly carry a direct spatial meaning, and Navigation within a three-dimensional model, layer filtering, scenario creation, It cannot be automatically transferred to simulation or analysis processes. Therefore, 10 an interaction that the user performs on a two-dimensional plan becomes a three-dimensional interaction Providing additional commands to perform a specific operation in the environment, relevant Selecting the view or tool and executing the necessary steps separately. This requires an active interaction and control interface for the two-dimensional plan. limiting its use as such, and the plan being primarily for drawing, visualization and 15 This caused it to remain as a representation surface used for geometric arrangement purposes. is happening. Spatial analysis, circulation assessment, accessibility review, density analysis, Processes such as scenario simulation and evaluation of the effects of design decisions 20 However, known techniques often involve different modules, plugins, external software, or This is accomplished through separate manual process steps. The user can review the plan, open the relevant three-dimensional view, and select the appropriate location or determining the perspective, selecting the necessary data or layers, analysis or Run the simulation tool and redesign the results in the design environment 25 This may require evaluation. These processes may be independent of each other or sequential. Execution of workflows through tools and commands, especially in the early design phases to the point of interruptions, increased data and process transfers between different software, this leads to repetitive manual processes and delays in the results of design decisions. This can lead to it being evaluated as such. 30 3 In addition, the effects of design decisions in known techniques are examined through user interaction. simultaneous analysis and real-time presentation of results to the user Transfer may be limited. The user can specify a certain type of travel on the plan. a direct simulation or spatial representation of a line, direction, area, or functional relationship The inability to convert this into analysis input necessitates rapid testing of design alternatives. 5 This makes things more difficult. Consequently, potential spatial conflicts and accessibility issues may arise. the effects of problems, circulation problems or functional decisions on design It may be noticed in later stages of the process; this situation is additional revision, remodeling, manual control and coordination need It can increase. Furthermore, the use of different tools and software, project data and 10 loss of coordination during the transfer of user decisions between systems and This can also bring with it the risk of user-generated errors. https: / / www.sciencedirect.com / science / article / pii / S2772991525000489 The link above shows "Digital twin for real-time data visualization in building maintenance 15". "Technologies and techniques" were discussed. https: / / www.sciencedirect.com / science / article / abs / pii / S0926580525003176 The link above contains the article "Digital twin for 3D interactive building operations: BIM, IoT". "Specialized building automation systems, integration of artificial intelligence and mixed reality" 20 It has been received. https: / / www.sciencedirect.com / science / article / abs / pii / S2352710224001438?utm The link above contains information on "Building Information Modeling with Augmented Reality". Case studies on the merging of elements: a literature review” were discussed. 25 In the systems mentioned in the links above; multiple projects can be worked on together. Simultaneous and interactive user interaction with two-dimensional plans and three-dimensional models. The problem is the limited number of integrated work structures that allow for this type of operation. The transfer of spatial data to the user is primarily through visual interfaces. 30 This is carried out through the user's plan and the three-dimensional environment they create. Tactile feedback mechanisms that support interaction are widespread. It is not available. Therefore, the two-dimensional plan, the three-dimensional digital model, and the user 4 interaction, real-time navigation, dynamic layer filtering, spatial simulation, analysis, and decision support processes are semantically and behaviorally interconnected. The design process is fragmented, and cannot be carried out within a single, interconnected interaction infrastructure. This leads to a multi-step and instrument-dependent structure. In this context, two The geometric and visual relationship between a 3D plan and a 3D digital environment. going beyond synchronization and incorporating user input directly into navigation, Techniques for associating simulation, analysis, and decision support processes. There is a need. Description of the invention: 10 The invention utilizes two-dimensional plans and three-dimensional digital twins in architectural and interior design processes. visualization, navigation, spatial simulation, and decision support analysis It ensures that it is carried out within an integrated interaction infrastructure. Two-dimensional. There is only a geometric or visual difference between the plan and the three-dimensional digital twin. Not only is synchronization limited to establishing it, but the semantic aspects of user interactions are also considered. and a data relationship is established where it is interpreted behaviorally. In this way, two 3D plan, active control of the three-dimensional digital twin and the digital twin operations to be performed on it through user interactions It acquires the character of an interface that enables its guidance. 20 The invention covers tablets, notebooks, touch screens, styluses, and similar user-friendly devices. Touch, drawing, and dragging are performed via hardware capable of detecting input. real-world user interactions such as navigation, area marking, and selection. interpreted in time and the spatial meaning of these interactions 25 This enables the conversion of semantic commands into two-dimensional information for the user. an interaction carried out on the plan, the relevant space in the three-dimensional digital twin positioning, focusing on a specific area, creating the appropriate appearance, relevant operations such as filtering layers or creating a specific scenario It can trigger it directly. User interactions are based solely on geometric input 30 not as, but as, a semantic processing input interpreted by the system the evaluation involves interaction between the two-dimensional plan and the three-dimensional digital twin, and It ensures operational integrity. The invention relates to a route, direction, area, or functional design created by the user on a plan. 5. Real-time spatial simulation and analysis processes of the markings This allows for the transfer of user input. The circulation scenario of these user inputs is as follows: density analysis, accessibility assessment, spatial relationship review, or design decisions can be used to trigger processes such as impact analysis. Thanks to this, user actions become a direct part of the decision support process. This structure ensures that the consequences of design decisions are seen in the early stages. evaluation and interactive testing of different design scenarios This makes it possible. Thus, potential design inconsistencies, functional problems, and Contributing to the identification of spatial problems before the implementation phase. is provided. Thanks to the integrated processing structure provided by the invention, plan review and three-dimensional digital analysis are possible. Navigating within the twin, creating the appropriate view, layer filtering, scenario planning. creation, simulation, analysis, and results evaluation processes This can be achieved within a seamless flow of interaction. This structure, design, and reducing the number of steps in evaluation processes and increasing user interaction. shortening the time between system outputs and faster project decisions. It enables the acquisition of spatial or functional data that the user needs. Thanks to its ability to be dynamically filtered, information density can be managed and This makes it possible to focus on the relevant data during the evaluation process. The effects of design decisions are real-time or early in the design process. Visualizing and analyzing them in stages allows for the identification of potential errors and discrepancies. This allows for early detection. In this way, repetitive manual modeling... checks, unnecessary revisions, and late-stage design flaws This contributes to reducing variations. The integrated 30 steps of the process... implementation within the system; making the use of labor more efficient, reducing the need for coordination and user-generated errors in the design process. 6 It helps to reduce the risk of the consequences of design decisions. Testing before implementation reduces the revision period and the associated labor costs. It provides technical and operational benefits in terms of reducing project costs. The invention enables multiple users to work together on the same 5 via a multi-user synchronous workflow structure. Simultaneous interaction on the project with a two-dimensional plan and a three-dimensional digital twin. It enables the creation of structures. Thus, it allows different users to... design, review and evaluation processes are carried out in a collaborative project environment. and it becomes possible to support coordination among team members. Additionally, thanks to optional haptic feedback integration, spatial data and 10 user interactions not only visually but also through haptic feedback This feature enables the spatial experience to be conveyed to the user in a multi-sensory way. support in this way, and especially in design evaluation, user experience, Interaction capacity in applications such as training, project presentations and scenario testing It contributes to its increase. 15 In conclusion, the invention enables active navigation, control, simulation, and decision-making using a two-dimensional plan. transforming user interactions into a support interface; semantically analyzing user interactions in real time. translating these commands into three-dimensional digital twin navigation, dynamic layering an integrated 20 that links filtering, scenario generation and spatial analysis processes. It offers a technical structure. Thanks to this structure, in addition to architectural and interior design, The list includes building information modeling, digital twin applications, facility management, training, and research. project presentation, user experience evaluation, urban and campus planning, spatial data such as circulation and accessibility analysis and disaster and evacuation scenarios 25 different application areas that require interactive evaluation A flexible and adaptable system is obtained that can be used. Thus, the invention, user interaction, data processing, spatial evaluation, and decision support functions all in one. by integrating design and evaluation processes within technical architecture It ensures that it is carried out in a fast, efficient and interactive manner. Explaining the Figures: 7 The invention will be described by referring to the attached figures, so that the features of the invention can be explained. It will be understood and appreciated more clearly, but the purpose of this invention is this obvious It is not about limiting it with regulations. On the contrary, the invention is defined by the accompanying claims. all alternatives, modifications, and options that could be included within the defined area The aim is to cover their equivalences. The details shown are only for 5 of the present invention. It is shown to illustrate the preferred arrangements and both the methods shaping, as well as the rules and conceptual features of the invention, in the most useful way. It should be understood that they are presented to provide a readily understandable definition. This in the drawings; Figure 1 shows a schematic view of the system. Illustrations that will help understand this invention are shown in the attached image. They are numbered and their names are given below. Explanation of References: 1. Touchscreen Tablet / Notebook Body 2. Pen / Touch Input Detection Unit 3. Input Interpretation and Gesture Recognition Module 20 4. Two-Dimensional Plan Processing Module 5. Semantic Matching and Plan-Digital Twin Association Engine 6. Three-Dimensional Digital Twin Model Management Module 7. Synchronous Navigation and Camera Orientation Module 8. Pen-Based Spatial Scenario Simulation Module 25 9. Real-Time Design Impact Analysis Module 10. Adaptive Layered Plan-3D Filtering and Visualization Module 11. Haptic Feedback Unit 12. Multi-User Synchronization and Data Sharing Module 13. BIM / CAD Data Integration Module 30 14. Decision Support and Output Generation Module 15. Processor 8 16. Database 17. Server Description of the Invention: The invention displays a two-dimensional architectural plan and enables user interaction. The touch screen tablet / notebook body (1) in which the user's touch is implemented and pen / touch input sensing unit (2) that detects pen-based interactions, Input that classifies perceived pen and touch gestures according to interaction types. interpretation and gesture recognition module (3), spatial and 10 in two-dimensional architectural plan. Two-dimensional plan processing module (4) that processes structural plan data, two-dimensional plan the point, line, area or spatial unit on it in the three-dimensional digital twin model Semantic mapping and plan-digital twin that semantically relate to their counterparts. association engine (5), which manages the three-dimensional digital twin model and semantic mapping a three-dimensional digital 15 that performs operations on the spatial component determined as a result. Twin Model Management Module (6), three-dimensional depending on the semantic mapping result. the viewing point, viewing direction, or navigation within the digital twin model Synchronous navigation and camera orientation module (7) which determines its route, plan simulation of pen or touch-based spatial inputs performed on it The pen-based spatial scenario simulation module (8) which converts the input to user 20 design impact data based on spatial data associated with interaction The working real-time design impact analysis module (9) selected functional on the plan showing the relevant data layers in the three-dimensional digital twin model depending on the data. or concealing adaptive layered plan-3D filtering and visualization module (10), haptic feedback, which produces vibrational or tactile signals based on spatial data 25 unit (11) displays plan interactions, marking data and for multiple users. Digital twins synchronize location data through a shared data structure. User synchronization and data sharing module (12), BIM / CAD based transferring two-dimensional plan and three-dimensional model data obtained from sources into the system BIM / CAD data integration module (13), navigation, simulation and design impact 30 decision that transforms analysis data into visual, numerical, or reportable output data Support and output production module (14), input interpretation, plan data processing, semantics 9 mapping, digital twin model management, navigation, simulation, and design impact analysis. The processor (15) that performs the operations converts two-dimensional plan data into a three-dimensional digital twin model data, semantic mapping data, user interaction data, and analytics data. the database (16) that records and performs project data transfer between users It consists of (17) servers. 5 The invention is by the multi-user synchronization and data sharing module (12) synchronized plan interactions, marking data, and digital twin location. It has a server (17) that transfers data between users. The invention enables two-dimensional plan-digital twin synchronization with pen and touch-based interaction. navigation, spatial simulation and real-time decision support system It relates to a method for implementation, involving two-dimensional architectural plan data and three-dimensional importing three-dimensional digital twin model data into the system, two-dimensional architectural plan The processing of spatial and structural plan data within it is done by the user 15 The actions performed include touching, dragging, freehand drawing, area selection, or direction marking. The detection of at least one of the inputs, the two-dimensional architecture of the detected user input. Determining its position on the plan and the associated plan data, perceived Classification of user input based on interaction type, classified users The input must be converted into at least one system command, two-dimensional architectural plan 20 with a point, line, area or spatial unit on it in a three-dimensional digital twin model Semantic mapping between equivalents, semantic mapping and classification Spatial simulation or design impact analysis based on user input. The triggering of at least one of the processes depends on the semantic matching result, three Within the 25-dimensional digital twin model, the viewing point, viewing direction, or navigation At least one of the routes must be determined and output data regarding the operations performed. It includes the steps involved in creating it. The invention involves the processing of perceived user input for selection, navigation, route definition, area definition, At least one of the interaction types for scenario creation or analysis triggering is 30. classification and navigation command of classified user input, simulation at least one of the following commands: layer filtering command or design impact analysis command It includes the transformation steps. The invention relates to a point, line, area, or spatial unit on a two-dimensional architectural plan. 5 related to the point, line, area or spatial unit with geometric position information. spatial meaning data are processed together to create a three-dimensional digital twin model of spatial meaning. It includes the step of determining the equivalent. The invention relates to navigation based on route, direction, or area data specified on a plan. scenario, user flow simulation, density analysis, accessibility analysis or 10 This includes the step of conducting at least one of the spatial relationship analyses. The invention is based on the position of a three-dimensional digital twin determined by semantic matching. as at least one of the viewing point, camera viewing direction or navigation route automatically determined and generated navigation, spatial simulation or 15 Converting design impact analysis data into visual or numerical output data. It includes the steps. Detailed Description of the Invention: The invention utilizes two-dimensional architectural plans and three-dimensional plans in architectural and interior design project development processes. a real-time, interaction-based and semantic one between three-dimensional digital twin models by establishing a relationship, user-led pen and touch-based digital twin navigation of interactions, spatial simulation, design impact analysis and an integrated system and method that enables the transformation of decision support processes 25 It is related to the system's perception of physical interaction received from the user. interpretation, correlation with two-dimensional plan data, three-dimensional digital twin determining the semantic equivalent in the model and the techniques related to that interaction It operates on the principle of carrying out transactions. The core hardware platform through which the system interacts directly with the user. It forms a touchscreen tablet / notebook body (1). Two-dimensional architecture 11 The plan is displayed on the touchscreen tablet / notebook body (1) and Interactions performed by the user are recorded in the system via that platform. is being transferred. The user touches the displayed two-dimensional architectural plan, dragging, freehand drawing, route plotting, direction marking, area marking, area fencing or performs interactions such as point selection. 5 These user-led interactions involve pen / touch input. It is detected by the sensing unit (2). Pen / touch input sensing unit (2) collects the user's physical movements on the plan as raw input data. and transfers it to the input interpretation and gesture recognition module (3) for processing. Input 10 interpretation and gesture recognition module (3), perceived pen and touch gestures It does not only consider physical contact data, but also the movements in question. It classifies them according to interaction types. Within this scope, the interactions carried out by the user... movement; selection, navigation, route definition, area definition, scenario creation or Analysis is defined as one or more types of interaction, such as triggering. 15 Classified interaction data can be used for relevant navigation, simulation, layer filtering, or system command for executing the design impact analysis process It is being transformed. Data regarding the planning area where user interaction takes place is presented in two-dimensional plan 20. It is processed by the processing module (4). The two-dimensional plan processing module (4) is the architecture. spatial elements of the plan such as walls, doors, circulation areas, room boundaries, functional zones, and so on. and in evaluating structural plan data, the data the user interacts with, selects, or the position of the point, line, area or spatial unit that it has marked on the plan and It identifies the related plan data. Thus, the user can determine 25 the physical interaction that takes place and the architecture in which the interaction takes place or Data relationships are established between spatial planning elements. Provision of two-dimensional plan and three-dimensional model data used in the system (BIM / CAD) This is done through the data integration module (13). BIM / CAD data 30 integration module (13), two-dimensional taken from BIM / CAD based project resources transferring plan and three-dimensional model data to the system and processing that data within the system 12 It enables its use in a processable form within the system. Two transferred to the system 3D plan data and 3D digital twin model data, user interactions the semantic matching and other data processing operations to be performed as a result of the data It constitutes the source. Plan location and associated plan determined by the two-dimensional plan processing module (4) The data is transferred to the semantic matching and plan-digital twin association engine (5). Semantic mapping and plan-digital twin association engine (5), two-dimensional architectural plan the geometric position information of a point, line, area or spatial unit on it The subject is processed together with spatial semantic data related to the planning element. This process is 10 As a result, the corresponding element in the two-dimensional plane appears in a three-dimensional digital twin model. The spatial equivalent is determined. Thus, user interaction on the plan is established. The interaction is not only transmitted at the coordinate or geometric position level, but also... the place, neighborhood, circulation line, functional area or other spatial component with which it is related taking into consideration, a three-dimensional digital twin model at the semantic level with 15 They are related. Semantic matching and plan-digital twin association engine (5) generated by The matching data is transferred to the three-dimensional digital twin model management module (6). Three 20-dimensional digital twin model management module (6), of the building, interior or project area managing the three-dimensional digital representation and determined as a result of semantic mapping. It activates the spatial component within the three-dimensional digital twin model. This within the scope of the spatial area that the user selects or marks on the two-dimensional plan. Navigation follows by determining the corresponding element within the three-dimensional model. It is used in visualization, simulation, and analysis processes. 25 The spatial location information determined as a result of semantic matching is used for synchronous navigation and The camera guidance module (7) is transferred to the synchronous navigation and camera. The orientation module (7) selects or marks the user on the two-dimensional plan. Depending on the location, the image point within the three-dimensional digital twin model, 30 The camera automatically determines the viewing direction or navigation route. The user's interaction with the plan within the three-dimensional digital twin. 13 Positioning is correlated simultaneously, allowing the user to see a two-dimensional plan. three-dimensional in accordance with the navigation or orientation operation performed on it It is directed to the relevant spatial location within the digital twin model. The user's interaction with the plan includes route, direction, area, and density zone 5. or pen-based spatial scenario simulation if it involves movement relationships. Module (8) is activated. Pen-based spatial scenario simulation module (8), the spatial input created by the user on the plan into the simulation input transforming and adapting the navigation scenario or user depending on the input in question. It creates a flow simulation. The route created by the user through freehand drawing is 10. or directional information is transformed into a spatial movement scenario within this scope and digitally It is processed in a manner related to the twin model. The spatial effects of choices or changes made by the user are real. It is evaluated by the time design impact analysis module (9). Actual 15 The temporal design impact analysis module (9), spatial associated with user interaction land use, circulation, accessibility, spatial relationships, and density, depending on the data. It processes at least one of the data points. In this context, the route and direction determined on the plan. or mobility assessment based on area data, user flow, density Analysis, accessibility analysis or spatial relationship analysis is performed. 20 Functional elements selected or interacted with by the user on the plan. Visualization of data in a three-dimensional digital twin model: adaptive layered plan-3D Filtering and visualization is performed by the module (10). Adaptive Layered Plan-3D Filtering and Visualization Module (10), 25 based on user interaction as a representation of the relevant data layers within a three-dimensional digital twin model, or It conceals this information, including circulation data, service areas, and user density. different spatial or functional data groups, such as data or specific neighborhood groups The system is filtered based on selection, and the relevant layers are isolated and displayed. The spatial data processed by the system is conveyed to the user through tactile feedback. haptic feedback is carried out via the haptic feedback unit (11). 14 unit (11), spatial density, privacy, orientation defined within the system or vibration or similar tactile sensations depending on data relating to critical decision points It generates signals. Thus, the determined spatial data is added to the visual output. It is transmitted to the user in the form of tactile signals. It is very easy for multiple users to work simultaneously on the same project. User synchronization and data sharing is provided through the module (12). Multi-user synchronization and data sharing module (12) allows users to synchronize in two dimensions. their selections on the plan, their markings, interaction data, and three-dimensional digital Synchronize location data within the twin model via a common data structure. The synchronized data is provided to users via the server (17). is transferred between them and thus performed by different users. Interactions are processed simultaneously within a collaborative project environment. The system's data processing operations are performed by the processor (15). Processor 15 (15), interpreting user inputs, processing plan data, semantic mapping performing operations, managing the three-dimensional digital twin model, Generation of navigation data, execution of simulation processes, and design. It carries out the processes related to conducting impact analyses within the system. two-dimensional plan data, three-dimensional digital twin model data, semantic 20 used Matching data, user interaction data and analysis data in the database (16) It is recorded and used in operations performed by the relevant modules. As a result of navigation, spatial simulation and design impact analysis processes. The generated data is transferred to the decision support and output production module (14). Decision 25 Support and output production module (14), obtained navigation, simulation and design impact It transforms analysis data into visual, numerical, or reportable output data. The generated visual or digital outputs are on the touchscreen tablet / notebook body (1) It is presented to the user via, and in cases dependent on defined spatial data, the word The subject is the haptic feedback unit (11) with tactile signals generated by 30 It is supported. The first step in the methodological workflow of the invention is the BIM / CAD data integration module (13) through two-dimensional architectural plan data and a three-dimensional digital twin of the project. The model data used in creating the model is being imported into the system. The received plan data is processed by the two-dimensional plan processing module (4) and the wall, 5 spatial and structural features such as doors, circulation areas, room boundaries, functional zones, and similar elements. The data is being prepared to be linked to user interaction. User on the plan displayed on the touchscreen tablet / notebook body (1) Interaction takes place through a pen or touch, and that interaction pen / touch input is detected by the sensing unit (2). The detected user input is processed by the input interpretation and gesture recognition module (3). They are classified according to the type of interaction and converted into the relevant system command. User input location on the plan two-dimensional plan processing module (4) determined by and spatial data semantic mapping and planning related to location. It is transferred to the digital twin association engine (5). Semantic mapping and plan-digital 15 twin association engine (5) combines geometric location information with spatial meaning data working together to create the corresponding three-dimensional digital twin model of the relevant plan element It determines. Based on the determined semantic mapping result, the three-dimensional digital twin model management 20 module (6) processes the relevant spatial component and synchronous navigation and camera orientation module (7) viewing point, camera viewing direction or circulation It automatically determines at least one of the routes. Depending on the nature of the user input... depending on the pen-based spatial scenario simulation module (8) navigation or user flow scenario is being created, real-time design impact analysis 25 Density, accessibility, circulation or spatial relationship data by module (9) is being processed and the adaptive layered plan-3D filtering and visualization module (10) The relevant data layers are displayed optionally by or It is hidden. If multiple users are connected to the system during the transactions being carried out Multi-user synchronization and data sharing module (12), user interactions, 16 Synchronize the marking data and digital twin location data and the server (17) The processor facilitates the transfer of this data between users. (15) performs data processing operations of system modules, during the process The data used and produced are recorded in the database (16). The workflow Ultimately, navigation, spatial simulation, and design impact analysis data support decision-making. 5 and visual, numerical or reportable output data by the output production module (14) being converted, the resulting touch screen tablet / notebook body (1) It is presented to the user via and haptic feedback is based on defined spatial data. A haptic signal can be generated via the notification unit (11). In this way, the user 10 performed by pen or touch on a two-dimensional architectural plan Starting from the interaction, perception, and classification stages based on planning data. are being linked, semantically mapped with a three-dimensional digital twin model, and related The results are transferred to navigation, simulation, analysis, and visualization processes. The process is completed when the data is presented to the user. 20 30

Claims

17 REQUESTS 1- The invention involves two-dimensional plan-digital twin synchronization with pen and touch-based interaction. It relates to navigation, spatial simulation, and real-time decision support systems. Feature; 5  Displays a two-dimensional architectural plan and user interactions touchscreen tablet / notebook body (1),  detects user touch and pen-based interactions pen / touch input detection unit (2),  10 that classify perceived pen and touch gestures according to interaction types input interpretation and gesture recognition module (3),  Processes spatial and structural plan data within a two-dimensional architectural plan. two-dimensional plan processing module (4),  three-dimensional representation of a point, line, area, or spatial unit on a two-dimensional plan semantically relating it to its counterpart in the digital twin model 15 matching and plan-digital twin association engine (5),  managing the three-dimensional digital twin model and the result of semantic mapping a three-dimensional digital twin that performs operations on a defined spatial component Model management module (6),  Three-dimensional digital twin model based on semantic mapping result 20 the viewing point, viewing direction, or navigation route within it Synchronous navigation and camera orientation module (7),  pen or touch-based spatial inputs performed on the plan pen-based spatial scenario simulation that converts into simulation input module (8), 25 Design impact based on spatial data associated with user interaction. real-time design impact analysis module that processes data (9),  Three-dimensional digital twin based on selected functional data on the plan adaptive layers that show or hide the relevant data layers in the model plan-3B filtering and visualization module (10), 30  haptic feedback, which produces vibrational or tactile signals based on spatial data. to the notification unit (11), 18  Plan interactions, signage data, and digital information belonging to multiple users. multi-factor that synchronizes twin location data through a common data structure user synchronization and data sharing module (12),  Two-dimensional plans and three-dimensional models obtained from BIM / CAD-based sources. BIM / CAD data integration module (13) which transfers data to the system, 5  Navigation, simulation, and design impact analysis data in visual, numerical, or formats. a decision support and output generation module that converts output data into reportable output data (14),  Input interpretation, plan data processing, semantic mapping, digital twin model 10 that conduct management, navigation, simulation and design impact analysis processes. to the processor (15),  two-dimensional plan data, three-dimensional digital twin model data, semantics recording mapping data, user interaction data, and analytics data. to the database (16) and  from the server that performs project data transfer between users (17) 15 It is the formation of. 2- Two-dimensional plan-digital interaction with pen and touch-based interaction as mentioned in Claim 1. Twin synchronous navigation, spatial simulation, and real-time decision support system. and its feature is; multi-user synchronization and data sharing module (12) by 20 synchronized plan interactions, marking data, and digital twin location. It is characterized by having a server (17) that transfers data between users. It is done. 3- The invention involves two-dimensional plan-digital twin synchronization with pen and touch-based interaction. navigation, spatial simulation and real-time decision support system It is a method for implementation, and its characteristic is;  two-dimensional architectural plan data and three-dimensional digital twin model data inclusion in the system  Spatial and structural plan data within a two-dimensional architectural plan 30 processing, 19  User-generated touch, drag, freehand drawing, area Detection of at least one of the selection or directional signaling inputs,  the position of the perceived user input on the two-dimensional architectural plan and Identifying the related plan data,  Classification of perceived user input according to interaction type, 5  Converting at least one of the classified user inputs into a system command,  points, lines, areas, or spatial units on a two-dimensional architectural plan, and three-dimensional Semantic mapping between the three-dimensional digital twin model and its counterpart,  Spatial mapping based on semantic mapping and categorized user input. Triggering at least one of the simulation or design impact analysis processes, 10  within the three-dimensional digital twin model depending on the semantic matching result at least one of the viewing point, viewing direction or circulation route determination and  The steps involved in generating output data related to the performed operations. It includes. 15 4- This is the method mentioned in claim 3, and its characteristic is; selection of perceived user input, navigation, route definition, area definition, scenario creation, or analysis triggering Classification as at least one of the interaction types and the classified user the input navigation command, simulation command, layer filtering command or 20 This includes steps to convert it to at least one of the design impact analysis commands. It is the characterization of the situation. 5- The method mentioned in Claim 3, its characteristic is; on a two-dimensional architectural plan geometric position information of a point, line, area or spatial unit, and the aforementioned 25 spatial semantic data associated with a point, line, area, or spatial unit by processing and determining its spatial equivalent in a three-dimensional digital twin model It is the characterization of the situation. 6- The method mentioned in Claim 3, its characteristic is; the route, direction or 30 determined on the plan. Navigation scenario, user flow simulation, density based on field data. at least one of the following: analysis, accessibility analysis or spatial relationship analysis It is characterized by its realization. 7- This is the method mentioned in Claim 3, and its characteristic is that it is determined as a result of semantic matching. The viewing point depends on the position of the three-dimensional digital twin, and the camera viewing direction is 5. or at least one of the circulation routes is automatically determined and generated visual or navigation, spatial simulation or design impact analysis data It is characterized by being converted into digital output data. 15 25

Images