Hand-held interactive plotting system with induction and display fusion and use method of hand-held interactive plotting system

Abstract

The invention discloses an induction and display fused handheld interactive plotting system and a use method, the system is used for realizing intelligent navigation plotting, the system comprises a positioning module, a control module, an image module, a display module, a man-machine module and a power supply module, the positioning module is used for sensing a position signal of the man-machine module and sending the position signal to the control module; the control module is used for processing the position coordinate information of the positioning module and controlling the power supply voltage of the positioning module; the image module receives image display information of the control module, processes the information and displays the information to the display module; the display module is used for displaying image information of the image module; the man-machine module comprises a handwriting assembly and is used for performing man-machine interaction operation on the positioning module; the power module is used for supplying power to other modules. According to the invention, through the closed-loop design of'induction, namely display ', sailors can directly observe the fusion scene of the virtual track and the real sea condition during touch drawing, so that the decision intuition is obviously improved.

Description

Technical Field

[0001] The present invention relates to the field of navigation technology, and in particular to a handheld interactive drawing and calculation system integrating sensing and display and a use method thereof. Background Art

[0002] Traditional technical means of nautical mapping and calculation operations have long relied on a combination of basic drawing tools, such as the alternating use of geometric tools such as rulers, triangles, and protractors. This mode of operation requires operators to frequently switch between different tools to complete route drawing, angle measurement, distance marking and other processes. The coordinated operation of multiple tools is not only prone to cumulative human errors, but also in large-scale nautical chart operations, the slight angle deviation of tool splicing or the distance interception error will increase exponentially with the expansion of the drawing size, directly affecting the accuracy of track calculation. At the same time, traditional tools are limited by their physical form, and have defects such as inconvenience in carrying and poor adaptability to the marine environment. Operation errors are more likely to be aggravated under complex working conditions such as ship turbulence.

[0003] With the acceleration of the process of electronic navigation, electronic-assisted drawing and calculation systems are gradually replacing traditional manual drawing. However, existing systems generally have the problem of discrete functional modules. For example, core functions such as heading correction, wind flow pressure difference calculation, and error analysis are scattered on different software and hardware platforms, lacking integrated data processing capabilities. Some electronic equipment still continues the tool-based design concept and only realizes the digitization of a single function (such as electronic protractor). At the automation level, most systems still rely on manual input of basic parameters, and lack intelligent prediction mechanisms for key links such as dynamic changes in wind flow elements and real-time correction of track errors. In terms of the paperless process, the insufficient digital conversion rate of nautical charts has resulted in a large number of operations still relying on paper media, and the hybrid mode of electronic screens and traditional drawing tools has increased the complexity of operations. These systemic defects have restricted the transformation and upgrading of navigation drawing and calculation towards intelligence and efficiency. Summary of the invention

[0004] In view of the problems existing in the prior art, the purpose of the present invention is to provide a handheld interactive drawing and calculation system with sensing and display fusion and a method of use. Through the closed-loop design of "sensing and display", the crew can directly observe the fusion scene of the virtual track and the actual sea conditions when drawing with touch, which significantly improves the intuitiveness of decision-making.

[0005] To achieve the above-mentioned purpose, the present invention provides a handheld interactive drawing and calculation system with sensing and display fusion, which is used to realize intelligent navigation drawing and calculation. The system includes a positioning module, a control module, an image module, a display module, a human-machine module and a power module, wherein the positioning module is used to sense the position signal of the human-machine module and send it to the control module; the control module is used to process the position coordinate information of the positioning module, and control the power supply voltage to the positioning module; the image module receives the image display information of the control module, and after processing, displays the information to the display module; the display module is used to display the image information of the image module; the human-machine module includes a handwriting component, which is used to perform human-machine interactive operations on the positioning module; and the power module is used to supply power to other modules.

[0006] Furthermore, the positioning module, the control module, the image module, the power module and the display mode are combined into a whole.

[0007] Furthermore, the control module, the image module, the power module and the display mode are combined into a whole, and the positioning module is separated from the other modules, and the two are used separately.

[0008] Furthermore, the connection and folding are performed by hinges, and the hinges are magnetic hinges, and the positioning module is connected and disassembled by magnetism.

[0009] Furthermore, an electromagnetic induction coil grid is built into the positioning board to generate an electromagnetic field and receive the resonant signal of the human-machine module; the handwriting component of the human-machine module is a stylus with a built-in resonant circuit. When the stylus is close to the positioning board, the internal resonant circuit resonates with the electromagnetic field of the positioning board, and electricity is obtained through the electromagnetic field of the positioning board.

[0010] Furthermore, the human-machine module also includes an AR component, which uses AR glasses to superimpose and display drawing information in the physical world, and perform gesture recognition through a binocular camera to operate the software interface; use a stylus to tap the positioning board to generate path nodes, and the microelectronic chip of the control module converts the coordinates into route data. The user inputs parameters through the AR glasses drawing and calculation panel, and the software automatically generates a compliant geometric route and projects it into the AR field of view.

[0011] Furthermore, the positioning module includes a positioning board and a control board. The control board is used to receive the signal from the human-machine module sensed by the positioning board. The signal is processed by the control board processor to obtain the position coordinates of the human-machine module, and the position coordinate information is sent to the control module through the control board interface.

[0012] Furthermore, the center of the positioning module is aligned with the center of the display module and is set as the physical zero point of the drawing; in the initial state, the physical zero point coincides with the software zero point, and when the software zero point moves and scales, the physical zero point is converted to the software zero point according to the movement ratio and the scaling ratio.

[0013] Furthermore, the control module includes a processor, a memory and an interface; the processor processes the position coordinate information of the positioning module, the software information in the memory and the AR information; the memory stores the software required for drawing calculations, which consists of a visualization unit, a database unit and a drawing and calculation unit; the visualization unit adopts a modular layout, and the left toolbar integrates multiple types of navigation drawing and calculation core functions; the database unit uses SQLite to build a lightweight database system, and realizes efficient management of multi-source data through a hierarchical storage architecture; the drawing and calculation unit constructs a multi-algorithm collaborative navigation positioning system, which supports the dynamic combination of manual strategy selection and intelligent parameter optimization.

[0014] A method for using a handheld interactive drawing and calculation system with sensor display fusion, the method comprising the following steps: S1. System initialization: Turn on the device to the power-on mode, touch the physical zero point in the center of the positioning module with the handwriting component to complete the calibration, the display unit loads the electronic chart, and the database unit automatically loads the navigation data of the ship and the AIS target information; S2. Initial situation plotting: Use the handwriting component to click to enter the line drawing mode, draw the ship's heading line in the positioning module, enter the command to mark the ship's position, and the system calls the observed data to lock the target ship B and generate an absolute motion line; S3. Generate an avoidance plan; double-click the fuselage button of the handwriting component to activate the intelligent collision avoidance module: the drawing unit calls the algorithm to calculate the safe steering method, and the database unit retrieves historical collision avoidance cases to generate a recommended plan or perform an avoidance operation through the handwriting component: the user can choose to draw a new route within the safety sector, and the system will calculate and display the corrected track in real time; S4. Dynamic correction verification: After the calculation is completed, the drawn track is fine-tuned according to the compensation track automatically generated by the system, or the handwriting component is used for autonomous fine-tuning. At this time, the tactile motor feedback confirms the operation node, and the display module synchronously updates the DR track calculation result; S5. Track record storage; tap the screen with three fingers to trigger data encapsulation: the original track, correction plan, and compensated track are stored in layers, a JSON instruction set bound to time and space stamps is generated, and the device generates a collision avoidance report.

[0015] The beneficial effects of the present invention are as follows: The present invention provides a handheld interactive drawing and calculation system with sensing and display fusion and a method of use. With "sensing and display fusion" as the core, the interactive paradigm of navigation drawing and calculation is reconstructed through the deep coordination of hardware sensing and dynamic display. The system uses electromagnetic resonance technology to capture the millimeter-level displacement and pressure changes of the stylus in real time, and synchronously drives the dual display of AR glasses and ink screens - after the pen tip trajectory is processed by the algorithm, a dynamic three-dimensional grid and track prediction line are superimposed in the AR field of view, and a high-precision vector chart is generated on the ink screen at the same time, realizing seamless mapping of physical operations and digital information. This closed-loop design of "sensing is display" allows crew members to directly observe the fusion scene of virtual tracks and real sea conditions when drawing with touch, significantly improving the intuitiveness of decision-making.

[0016] The system further enhances the intelligence of display feedback through multimodal sensing. For example, the pressure signal of the stylus triggers the automatic switching of the display mode: when light pressure is applied, the AR interface renders a freely drawn Bezier curve, and when heavy pressure is applied, precise node positioning is activated, and the ink screen simultaneously marks the heading parameters; after the gesture action (such as circular swiping) is captured by the binocular camera, the AR interface instantly scales the chart and highlights the corrected area. The real-time mutual drive of sensing data and display content not only reduces the sense of disconnection in the operation of traditional tools, but also maintains the drawing accuracy and display stability in the bumpy environment of the ship through the dynamic error compensation algorithm.

[0017] In addition, the concept of sensing and display fusion runs through the entire data process. The physical zero point of the positioning module is dynamically aligned with the software coordinates to ensure that the drawing results on the display end are always consistent with the real space; the database binds the sensing data and display instructions through time and space stamps to achieve visual retracing of the track correction history. In the foldable design, the separation sensing of the magnetic hinge triggers the dual-screen collaboration mode-the positioning board independently senses the drawing input, and the display module dynamically splits the screen to present local details and global situation, further expanding the interactive flexibility in complex scenarios. The present invention promotes the evolution of navigation drawing from tool-based operation to immersive intelligent decision-making through the deep integration of sensing and display. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a schematic diagram of the overall architecture of the handheld interactive drawing and computing system with sensor display fusion according to the present invention; Figure 2 This is a schematic diagram of the structure of a handheld interactive drawing and computing system with tablet-type sensing and display fusion according to the first embodiment; Figure 3 This is a schematic diagram of step 1 of the first embodiment; Figure 4 This is a schematic diagram of step 2 of the first embodiment; Figure 5 is a schematic diagram of step 3 of the first embodiment; Figure 6This is a schematic diagram of the structure of a handheld interactive drawing and computing system with foldable sensing and display fusion according to the second embodiment; Figure 7 is a schematic diagram of the second embodiment in which the positioning module and other modules are connected and folded through hinges; Figure 8 is a schematic diagram of the second embodiment in which the positioning module is separated from other modules; Fig. 9 is a comparative schematic diagram of lines generated by light pressure and heavy pressure of the pen tip in Example 2; Fig.10 is a schematic diagram of step 1 of the drawing and calculation process in an embodiment of the method of use of the present invention; Fig.11 is a schematic diagram of step 2 of the drawing and calculation process in an embodiment of the method of use of the present invention; Fig.12 is a schematic diagram of step 3 of the drawing and calculation process in the embodiment of the method of use of the present invention; Fig.13 Schematic diagram of step 4 of the calculation process in the embodiment of the method of use of the present invention. DETAILED DESCRIPTION

[0019] The technical solution of the present invention will be described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0020] In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0021] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0022] The following combination Figure 1-Figure 13 The specific embodiments of the present invention are described in detail. It should be understood that the specific embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0023] The present invention provides a handheld interactive drawing and calculation system with sensor display fusion, which is used to realize intelligent navigation drawing and calculation. Figure 1 As shown, the system includes a positioning module, a control module, an image module, a display module, a human-machine module and a power module. The positioning module is used to sense the position of the human-machine module and send it to the control module; the control module is used to process the position coordinate information of the positioning module and control the power supply voltage to the positioning module; the image module receives the image display information of the control module and displays the information to the display module after processing; the display module is used to display the image information of the image module; the human-machine module is used to perform human-machine interaction operations on the positioning module; and the power module is used to supply power to other modules.

[0024] The specific implementation of each module is as follows: 1. Positioning module The positioning module includes a positioning board and a control board. The control board consists of a processor and an interface. The control board is used to receive the signal from the human-machine module sensed by the positioning board. The signal is processed by the control board processor to obtain the position coordinates of the human-machine module, and the position coordinate information is sent to the control module through the control board interface. A coil can be set in the positioning board of the positioning module to wirelessly charge the human-machine module.

[0025] The control panel interface includes a communication interface and a power interface. The communication interface can be set to a limited interface such as USB, Ethernet port, etc.; it can also be set to a wireless interface such as Bluetooth, WiFi, etc. The power interface can be transmitted through USB or powered by a cable alone.

[0026] The center of the positioning module is aligned with the center of the display module and set as the physical zero point of the drawing. In the initial state, the physical zero point coincides with the software zero point. When the software zero point moves and scales, the physical zero point is converted to the software zero point according to the movement ratio and scaling ratio. The formula is as follows: ; in, is software zero, is the moving ratio, is the scaling factor, The physical zero point. Other coordinates are converted proportionally accordingly.

[0027] (II) Control module The control module includes a processor, a memory and an interface.

[0028] The processor processes the position coordinate information of the positioning module, the software information in the memory and the AR information, and controls the power supply voltage to the positioning module.

[0029] The memory stores the software required for drawing calculations, which consists of a visualization unit, a database unit, and a drawing calculation unit. The details are as follows: a. Visualization Unit The visualization unit adopts a modular layout, and the left toolbar integrates multiple core functions of navigation drawing and calculation. The toolbar contains eight operation modules such as selection, point drawing, and line drawing, and functional subdivision is achieved through hierarchical menus: the "selection module" supports point selection and frame selection modes, which can accurately locate single or multiple graphic elements; the "point drawing tool" provides basic point and line segment midpoint drawing functions to meet different positioning needs; the "line drawing component" contains three modes: line segment, straight line and ray, which can meet the scenes such as heading annotation and trajectory extension; "surface construction" supports square, circle and polygon generation, covering basic graphic drawing needs; "measurement system" integrates angle and distance measurement functions to ensure accurate acquisition of navigation parameters; "erase module" provides local deletion and global clearing dual modes, which is convenient for dynamic adjustment of drawing content; "setting panel" has built-in professional drawing grid switching function to adapt to different nautical chart operation standards.

[0030] Each functional unit adopts dynamic interactive design. When the mouse hovers, the function prompt is displayed, and the secondary menu is expanded after clicking. The graphics generation process follows the nautical mapping specifications, the measurement accuracy reaches the professional standard, and the error is controlled within the allowable range of the industry. The interface layout takes into account both operational efficiency and visual clarity, distinguishes functional areas through color coding, and adopts high-contrast design for important controls to ensure operational reliability in complex sea conditions.

[0031] b. Database unit The database unit uses SQLite to build a lightweight database system, and realizes efficient management of multi-source data through a hierarchical storage architecture. The core data table focuses on the dynamic parameters of the ship, and designs 13 types of structured fields including time and space references (such as timestamps, relative orientation), navigation status (speed, heading angle) and action type identification, forming a complete data chain of ship motion characteristics. The table structure draws on the design concept of object-oriented databases, abstracting complex entities into extensible data objects, which is convenient for the subsequent call and analysis of the track calculation module.

[0032] The database unit also sets up a unified data source table at the data integration level, and distinguishes between three types of data sources: manual drawing, form input, and background import through enumeration fields. In manual drawing mode, the system captures the touch drawing trajectory in real time and converts it into a coordinate sequence for storage, which meets the needs of rapid recording of sudden course adjustments during navigation operations; form input supports structured parameter entry, and combines the original input in JSON format to ensure data traceability; the background import mechanism realizes asynchronous loading of batch data through periodic polling of external APIs, and has built-in exception retry and data verification functions to ensure data transmission reliability under severe sea conditions. This multimodal data fusion strategy is consistent with the spatial data management ideas under the B / S architecture, and realizes the unified scheduling of massive information through standardized data interfaces.

[0033] In addition, the database unit also sets up a data tracking mechanism throughout the entire operation process, and builds a data relationship network with the help of foreign key associations and timestamp tags. The core table and the data source table form a cascade relationship through drawing_id, and with the time series record of the created_at field, the generation path of any track data can be accurately restored. The log system fully records the details of data changes. Its audit function not only meets the requirements of maritime safety regulations, but also provides the original basis for the error analysis of subsequent intelligent algorithms. While ensuring the advantages of SQLite transaction processing, this design lays the foundation for future access to new data sources such as AIS (automatic identification system) or visual sensors by reserving the source_type extension bit.

[0034] c. Drawing and calculation unit The drawing and calculation unit has built a multi-algorithm collaborative navigation positioning system, integrating classic algorithms such as two-position two-element, three-position one-element, etc., and supports the dynamic combination of manual strategy selection and intelligent parameter optimization. The system adopts a time-space coupled instruction architecture, and defines 12 drawing instructions in three categories of points, lines, and circles through the standardized JSON protocol, such as "point(RE)" to achieve polar coordinate offset positioning, "llinsec" to calculate route crossing warning points, and "arc(PR)" to generate dynamic protection circles. Each instruction is embedded with a time-space dual verification mechanism, carrying millisecond timestamps and time interval parameters, and cooperates with the element identity identification system (such as the "P3-L2-C1" encoding rule) to build a data lineage network to ensure situation consistency in complex navigation scenarios.

[0035] The core computing engine is based on a typical navigation positioning algorithm. It constructs the target motion trajectory through mathematical modeling and combines filtering technology to achieve noise suppression and error correction. The WebSocket two-way communication pipeline is used to achieve sub-second data synchronization: the front end transmits coordinates and heading data through measPxy / measLL events, and the back end performs trajectory initialization, dynamic calculation and loop optimization through multi-stage functions, and finally pushes the autoDraw command to the front end for dynamic rendering. The algorithm layer has a built-in dynamic error compensation algorithm to reduce the impact of ocean current fluctuations on drawing accuracy. The specific formula is as follows: ; In the above formula is the pitch acceleration, is the roll acceleration, is the hull deformation coupling matrix, and z is the average height of the stylus from the deck.

[0036] The drawing and calculation unit adopts layered rendering technology. The basic elements are presented by the vector graphics engine, and the accelerated rendering solution is enabled for complex scenes. The communication layer integrates the trajectory optimization algorithm to ensure trajectory accuracy while controlling the network load. The system has a built-in LSTM-based neural network prediction model, which has the ability to predict target tracks and efficiently process instructions. The error is controlled within a reasonable range, and the abnormal recovery mechanism ensures that it can continue to operate when the communication is interrupted. The design framework is compatible with the needs of multi-dimensional situation expansion and provides technical support for three-dimensional navigation operations. The gate control unit calculation of the LSTM-based neural network prediction model is as follows: ; in represents the forget gate output vector, represents the forget gate weight matrix, Represents the hidden state at the last moment. represents the current input vector, represents the forget gate bias term, represents the Sigmoid activation function, represents the input gate output vector, represents the input gate weight matrix, represents the candidate cell state, Represents the current cell state.

[0037] In addition, the loss function used by the model is as follows: ; in, represents the model prediction value, represents the true value, represents the learnable uncertainty parameter.

[0038] The interface includes communication and power interfaces. The communication interface can be a wired interface such as USB, Ethernet port, etc.; it can also be a wireless interface such as Bluetooth, WiFi, etc. The power interface can be transmitted through USB or powered by a cable alone.

[0039] (III) Image Module The image module receives the image display information from the control module, and after processing, displays the information to the display module. The image module has a built-in image display control algorithm to increase the image refresh rate and display grayscale effect, and power the display module. The formula is as follows: ; Where A is the RGB matrix of the current image, B is the RGB matrix of the image to be updated at the next moment, and C is the difference matrix between the two.

[0040] The image module can be built into the processor chip of the control module or implemented through separate programmable embedded hardware.

[0041] (IV) Display module The display module is used to display the image information of the image module. The display module can be an LED / OLED / LCD screen display or an ink screen display. To ensure the display accuracy and match the positioning accuracy of the positioning module, the typical pixel (dot) distance of the display module should be less than or equal to 0.2mm.

[0042] (V) Human-machine module The human-machine module includes a handwriting component for high-precision sensing of the positioning board and an AR component for information display and gesture recognition. The handwriting component is specifically an electromagnetic stylus, which is operated on the display screen of the display module to realize navigation drawing and calculation. The handwriting component of the human-machine module is wirelessly charged by generating electromagnetic resonance with the positioning module. The human-machine module has several built-in capacitors to store and release energy. The handwriting component uses the built-in Bezier curve algorithm to smooth the hand-painted jitter, thereby achieving the purpose of optimizing the trajectory. The specific formula is as follows: ; in, Indicates the coordinates of the starting point of the handwriting. Indicates the coordinates of the starting point of the handwriting, control point Dynamically generated by the speed adaptive algorithm, satisfying: ; in is the smoothing factor, is the original trajectory angular velocity.

[0043] The AR component uses AR glasses to overlay drawing information on the physical world, and recognize gestures through binocular cameras to zoom in / out on the software interface.

[0044] (VI) Power module The power module supplies power to the control module and the image module by dividing the voltage according to different voltage requirements.

[0045] The present invention also provides a method for using a handheld interactive drawing and calculation system with sensor display fusion, which achieves full-process optimization of navigation drawing and calculation operations through deep integration of software and hardware.

[0046] When the system starts, the user presses the power button of the human-machine module to activate the device. The power module supplies power to each component with divided voltage. The electromagnetic coil array of the positioning module generates a stable electromagnetic field covering the display area, and establishes wireless energy transmission with the built-in resonant circuit of the electromagnetic stylus.

[0047] The control module synchronously loads a dedicated software system, the display module presents a standardized navigation drawing and calculation interface, the left toolbar dynamically adapts to the current chart scale, and the right parameter panel automatically connects to the regional database.

[0048] The user holds the electromagnetic stylus and touches the physical zero point in the center of the display module to complete the coordinate system calibration. The AR glasses then project a three-dimensional dynamic grid, and the grid spacing is intelligently adjusted according to the drawing scale to achieve accurate mapping of physical coordinates and software coordinates.

[0049] During the route planning stage, the stylus captures the trajectory of the pen tip, and the pen pressure sensing technology automatically switches the operation mode: light pressure triggers free drawing, and the system optimizes the trajectory through the Bezier curve algorithm to smooth hand-drawn jitter; heavy pressure on the stylus can activate precise line drawing, and each contact point generates a millimeter-level positioning node. When the pen tip stays for more than 0.5 seconds, the drawing and calculation module starts the track prediction, and the AR interface superimposes the plan for the next three track points, and simultaneously updates the heading angle and distance parameters in the ink screen sidebar. After completing the path drawing, double-click the pen body button, the control module calls the algorithm to optimize the track, and the database unit stores the original data and the correction parameters in time and space alignment.

[0050] The dynamic adjustment link enhances the operation efficiency through AR gesture interaction: opening the palm action calls out the parameter panel, pinching the gesture locks the target element, circular gesture activates the calculation mode, and the stylus movement radius is mapped to the correction coefficient in real time. When the foldable device is unfolded, the dual screens work together to support multitasking.

[0051] After the operation is completed, three fingers tap the screen to trigger the data encapsulation protocol, package the structured track data, and synchronously generate vector charts and AR enhanced situation maps. The entire process forms a closed-loop control through the dynamic error compensation algorithm and LSTM-based neural network prediction, maintaining stable drawing accuracy in the bumpy environment of the ship. The intelligent power consumption management of the power module supports long-term continuous operation, realizing a seamless transition from traditional drawing and calculation to intelligent decision-making.

[0052] Embodiment 1: Flat plate like Figure 2 As shown, the positioning module 1, the control module 3, the image module 4, the power module 5 and the display mode 2 are combined into a whole to form a handheld interactive drawing and calculation system with a flat-panel induction display fusion. The positioning module 1 includes a positioning board 11 and a control board 12. The display module 2 and the positioning board 11 are aligned with the center as the zero point. The positioning module 1 adopts EMR (Electro-Magnetic Resonance) technology, and the human-machine module 6 adopts a stylus. An electromagnetic induction coil grid is built into the positioning board 11 to generate an electromagnetic field and receive the resonance signal of the human-machine module 6. The handwriting component of the human-machine module 6 has a built-in resonant circuit. When the handwriting component is close to the positioning board, the internal resonant circuit resonates with the electromagnetic field of the positioning board and obtains electricity through the electromagnetic field of the positioning board 11. The human-machine module 6 includes a handwriting component 61 and an AR component 62. The AR component 62 of the human-machine module 6 adopts AR glasses, which can superimpose and display drawing information in the physical world, and perform gesture recognition through a binocular camera to zoom in / out the software interface.

[0053] The control module 3 uses a microelectronic chip as the main controller and operating processor, and mounts a memory chip for storing software, systems and related content. It is connected to the positioning module control board and the image module through an FPC flexible cable.

[0054] The display module 2 uses an ink screen and is connected to the image module via an FPC flexible cable. The image module 4 uses a programmable processor as the main controller and operating processor, and is equipped with a memory chip for storing software, systems and related content.

[0055] The specific steps for using the handheld interactive drawing and calculation system with tablet-type sensing display fusion are as follows: Step 101: After the device is turned on, the ink screen automatically loads the dedicated drawing interface, and the side panel expands the geometry tool, free drawing and symbol library function modules. The user holds the stylus pen and touches the positioning board. The built-in electromagnetic induction coil captures the pen tip coordinate data in real time and synchronously maps it to the software interface to form a dynamic cursor. Figure 3 shown.

[0056] Step 102: After the user selects the line drawing component, he uses the stylus to tap the positioning board to generate the path node. The microelectronic chip of the control module converts the coordinates into the route data. The user inputs the parameters through the drawing and calculation panel of the AR glasses. The software automatically generates a compliant geometric route and projects it into the AR field of view. At the same time, the ink screen will also display the user's drawn track rendered by the programmable processor of the image module. Figure 4 shown.

[0057] Step 103: When the user switches to the free drawing mode, the continuous movement trajectory of the stylus is pre-processed by the control module, the software intelligently corrects the hand-drawn jitter, and the binocular camera automatically scales the canvas after recognizing the two-finger open gesture. Similarly, the drawn track will also be displayed on the ink screen at the same time. Figure 5 shown.

[0058] Step 104: After drawing, the user can use AR glasses to look at the correction point, pinch the gesture to call up the coordinate panel, and enter commands such as "X-axis correction + 0.5 meters" to achieve millimeter-level adjustment. In addition, all user operation data is stored in the memory chip in real time. When the user wants to withdraw the operation, the fist gesture can trigger the 10-step operation backtracking (undo function).

[0059] Step 105: The final solution is exported through a three-finger swipe-up gesture, and the programmable processor of the image module renders it into a low-power ink screen situation map, which is synchronized to the AR glasses to overlay the real scene display.

[0060] Embodiment 2: Folding like Figure 6 As shown, the handheld interactive drawing and calculation system with foldable induction display fusion separates the positioning module 1 from other modules, and connects and folds them through the hinge 100. Specifically, the display module 2, the control module 3, the image module 4 and the power module 5 are combined into an integral flat-plate structure, and the positioning module 1 including the control board 12 and the positioning board 11 is another flat-plate structure adapted thereto, and the two are foldably connected through the hinge 100. The hinge 100 is a magnetic hinge, which is connected and disassembled by magnetic attraction, so that the positioning module 1 can be separated and used separately. The power module supplies power to the positioning module through the power supply connector installed on the magnetic hinge.

[0061] The specific steps of using the handheld interactive drawing and computing system with foldable sensing display fusion are as follows: Step 201: Initially, the device is in a folded state, and the magnetic hinge 100 closes and locks the positioning module 1 and the display module 2. After the user turns on the device, the system automatically activates the dual-screen collaboration mode - the positioning module 1 independently runs the drawing function, and the display module 2 synchronously projects the drawing view.

[0062] Step 202: The user unfolds the device, and the stylus of the human-machine module 6 draws a trajectory on the separated positioning module 1. The control module 3 transmits the coordinate data to the graphics engine of the display module 2 in real time through a low-latency wireless protocol to achieve dynamic linkage of the two screens.

[0063] Step 203: When the user needs to disassemble the device into independent modules for use, the positioning module 1 switches to the portable drawing board mode, the stylus touches the trigger software streamlined interface (only retains the core geometry tools), and the hinge magnetic contacts enter the dormant state.

[0064] Step 204: When the user draws a path, the pressure sensor at the tip of the stylus dynamically adjusts the line width parameter - light pressure generates a thin dotted line (marking a covert action path), and heavy pressure generates a thick solid line (marking an assault path). The pressure threshold is fed back in real time through the tactile motor.

[0065] Step 205: The sketch is completed, and the data is quickly transmitted back to the display module through the magnetic hinge contact. The software automatically converts the drawing board mode data packet into a complete solution format. Double-click the hinge physical button again, and the system saves the solution as a joint instruction set, and updates it to the dual-screen display module and storage unit simultaneously.

[0066] Example 3: Usage In this embodiment, a scenario is set up, where ship A (the ship) is heading 030° and sailing at 15 knots; ship B (the target ship) is heading 150° and sailing at 14 knots. The two ships are in a cross-encounter situation and there is a risk of collision. Ship A needs to take evasive measures by turning right according to the COLREGs rules. In this scenario, the method of using the handheld interactive drawing and computing system with sensor display fusion of the present invention (i.e., the drawing process) is as follows: Step S1. System initialization The operator turns on the device to the power-on mode and touches the stylus to the center of the positioning module to complete the calibration (O 0 →O s The electronic chart is loaded into the ink screen, and the database module automatically loads the navigation data of the ship and the AIS target information.

[0067] Step S2. Initial situation plotting The operator uses the stylus to click to enter the line drawing mode, draws the ship's heading line (030° thin solid line) in the positioning module, enters the "point(RE)" command to mark the ship's position, and the system calls the observed data to lock the target ship B and generates an absolute motion line (150° thick solid line).

[0068] Step S3. Generate avoidance plan Double-click the pen button to activate the intelligent collision avoidance module: the drawing unit calls the algorithm to calculate the safe steering method, and the database unit retrieves historical collision avoidance cases to generate recommended solutions for the operator to choose. The operator can also manually perform avoidance operations with the stylus: the operator can choose to draw a new route (060° thick dashed line) within the safety sector, and the system will calculate and display the corrected track in real time.

[0069] Step S4. Dynamic correction verification When the operator has finished drawing and calculating, he can fine-tune the drawn track according to the compensation track (065° thin dotted line) automatically generated by the system; he can also use the stylus to make autonomous fine-tuning. For example, the operator can use light pressure to fine-tune the heading to 065°. At this time, the tactile motor feedback confirms the operation node, and the ink screen synchronously updates the DR track calculation result.

[0070] Step S5. Track record storage Finally, the operator taps the screen with three fingers to trigger data packaging: the original track (030° thin solid line), correction plan (060° thick dashed line), and compensated track (065° thin dashed line) are stored in layers, a JSON instruction set bound to time and space stamps is generated, and the device generates a collision avoidance report (PDF+vector diagram).

[0071] Any process or method description in the flowchart of the present invention or described in other ways herein can be understood as a module, segment or part of a code including one or more executable instructions for implementing the steps of a specific logical function or process, which can be implemented in any computer-readable medium for use by an instruction execution system, device or equipment, and the computer-readable medium can be any medium containing storage, communication, propagation or transmission programs for use by execution systems, devices or equipment, including read-only memories, magnetic disks or optical disks, etc.

[0072] In the description of this specification, the description with reference to the terms "embodiment", "example", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. In addition, those skilled in the art can combine or combine different embodiments or examples described in this specification and the features therein without causing any contradiction.

[0073] Although the above content has shown and described the embodiments of the present invention, it can be understood that the above embodiments are exemplary and cannot be understood as limitations of the present invention. Ordinary technicians in the field can change, modify, replace, modify and other update operations on the above embodiments within the scope of the present invention.

Claims

1. A handheld interactive drawing and calculation system with sensor display fusion, used to realize intelligent navigation drawing and calculation, characterized in that: The system includes a positioning module, a control module, an image module, a display module, a human-machine module and a power module, wherein the positioning module is used to sense the position signal of the human-machine module and send it to the control module; the control module is used to process the position coordinate information of the positioning module and control the power supply voltage to the positioning module; the image module receives the image display information of the control module and displays the information to the display module after processing; The display module is used to display the image information of the image module; The human-machine module includes a handwriting component for performing human-machine interactive operations on the positioning module; the power module is used to supply power to other modules.

2. The handheld interactive drawing and computing system with sensor display fusion according to claim 1 is characterized in that: The positioning module, the control module, the image module, the power module and the display mode are combined into a whole.

3. The handheld interactive drawing and computing system with sensor display fusion according to claim 1, characterized in that: The control module, image module, power module and display mode are combined into a whole, and the positioning module is separated from other modules and used separately.

4. The handheld interactive drawing and computing system with sensor display fusion according to claim 3 is characterized in that: The connection and folding are carried out through hinges. The hinges are magnetic hinges, and the positioning module is connected and disassembled through magnetism.

5. The handheld interactive drawing and computing system with sensor display fusion according to any one of claims 1 to 4, characterized in that: An electromagnetic induction coil grid is built into the positioning board to generate an electromagnetic field and receive the resonant signal of the human-machine module; the handwriting component of the human-machine module is a stylus with a built-in resonant circuit. When the stylus is close to the positioning board, the internal resonant circuit resonates with the electromagnetic field of the positioning board, and electricity is obtained through the electromagnetic field of the positioning board.

6. The handheld interactive drawing and computing system with sensor display fusion according to claim 5, characterized in that: The human-machine module also includes an AR component, which uses AR glasses to superimpose drawing information in the physical world, and uses a binocular camera to perform gesture recognition to operate the software interface; use a stylus to tap the positioning board to generate path nodes, and the microelectronic chip of the control module converts the coordinates into route data. The user inputs parameters through the AR glasses drawing and calculation panel, and the software automatically generates a compliant geometric route and projects it into the AR field of view.

7. The handheld interactive drawing and computing system with sensor display fusion according to claim 6, characterized in that: The positioning module includes a positioning board and a control board. The control board is used to receive the signal from the human-machine module sensed by the positioning board. The signal is processed by the control board processor to obtain the position coordinates of the human-machine module, and the position coordinate information is sent to the control module through the control board interface.

8. The handheld interactive drawing and computing system with sensor display fusion according to claim 7, characterized in that: The center of the positioning module is aligned with the center of the display module and is set as the physical zero point of the drawing; in the initial state, the physical zero point coincides with the software zero point. When the software zero point moves and scales, the physical zero point is converted to the software zero point according to the movement ratio and scaling ratio.

9. The handheld interactive drawing and computing system with sensor display fusion according to claim 1, characterized in that: The control module includes a processor, a memory and an interface; the processor processes the position coordinate information of the positioning module, the software information in the memory and the AR information; the memory stores the software required for drawing calculations, which consists of a visualization unit, a database unit and a drawing and calculation unit; the visualization unit adopts a modular layout, and the left toolbar integrates multiple types of navigation drawing and calculation core functions; the database unit uses SQLite to build a lightweight database system, and realizes efficient management of multi-source data through a hierarchical storage architecture; the drawing and calculation unit builds a multi-algorithm collaborative navigation positioning system, which supports the dynamic combination of manual strategy selection and intelligent parameter optimization.

10. A method for using a handheld interactive drawing and calculation system with sensor display fusion, characterized in that: The method of use is implemented according to the handheld interactive drawing and computing system for sensing and display fusion according to any one of claims 1 to 9, and the method of use comprises the following steps: S1. System initialization: Turn on the device to the power-on mode, touch the physical zero point in the center of the positioning module with the handwriting component to complete the calibration, the display unit loads the electronic chart, and the database unit automatically loads the navigation data of the ship and the AIS target information; S2. Initial situation plotting: Use the handwriting component to click to enter the line drawing mode, draw the ship's heading line in the positioning module, enter the command to mark the ship's position, and the system calls the observed data to lock the target ship B and generate an absolute motion line; S3. Generate an avoidance plan; double-click the fuselage button of the handwriting component to activate the intelligent collision avoidance module: the drawing and calculation unit calls the algorithm to calculate the safe steering method, and the database unit retrieves historical collision avoidance cases to generate a recommended plan or perform an avoidance operation through the handwriting component: the user chooses to draw a new route within the safety sector, and the system calculates and displays the corrected track in real time; S4. Dynamic correction verification: After the calculation is completed, the drawn track is fine-tuned according to the compensation track automatically generated by the system, or the handwriting component is used for autonomous fine-tuning. At this time, the tactile motor feedback confirms the operation node, and the display module synchronously updates the DR track calculation result; S5. Track record storage; tap the screen with three fingers to trigger data encapsulation: the original track, correction plan, and compensated track are stored in layers, a JSON instruction set bound to time and space stamps is generated, and the device generates a collision avoidance report.

Images