Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Ship profile 3D digital reconstruction method and device, storage medium and electronic equipment

A ship, 3D technology, applied in the field of intelligent ship digital twin, can solve the problems of real-time information interaction and real mapping between real ships and virtual ships, and inability to experience the complexity, diversity, and uncertainty of marine traffic, and achieve the realization of Real-time interaction, alleviating background interference, and improving quality

Pending Publication Date: 2022-07-12
SHANGHAI MARITIME UNIVERSITY
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, the 3D digital reconstruction of ship shape is based on a unified digital model. Although digital design and VR construction simulation can be carried out on the 3D platform, it cannot solve the problem of real-time information interaction and real mapping between physical ships and virtual ships.
[0004] Existing virtual simulation systems and platforms often use specific types of ships. During the simulation process, they cannot experience the complexity, diversity, and uncertainty of maritime traffic during real navigation, especially in the face of autonomous collision avoidance, On issues such as autonomous berthing and unparking, the type and authenticity of traffic participants are often particularly important to the results

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Ship profile 3D digital reconstruction method and device, storage medium and electronic equipment
  • Ship profile 3D digital reconstruction method and device, storage medium and electronic equipment
  • Ship profile 3D digital reconstruction method and device, storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] figure 1 A flow chart of a 3D digital reconstruction method of ship shape is shown, such as figure 1 As shown, the method for 3D digital reconstruction of ship shape in this embodiment includes steps S100 to S600:

[0061] Step S100, extracting the target ship image from the image including the ship.

[0062] In practical applications, images (images or videos) containing ships are captured in real time through marine monitoring equipment, and corresponding images are extracted frame by frame for the captured videos. Since the target ship in each frame image is fused with the background, it is necessary to segment the ship and the background. , in this embodiment, the target ship and the background are segmented by extracting the multi-scale feature map, so as to obtain the image of the target ship.

[0063] In this embodiment, the adopted feature fusion and extraction network framework includes using the hole convolution strategy as upsampling to perform feature fusi...

Embodiment 2

[0121] Image 6 A block diagram of a ship shape 3D digital reconstruction device is shown, such as Image 6 As shown, the device for 3D digital reconstruction of ship shape in this embodiment includes:

[0122] a ship extraction module 610, configured to extract the target ship image from the image containing the ship;

[0123] The position determination module 620 is used to extract the parameters of the 3D digital model of the ship shape by using the pre-built ship image 3D feature extractor, and determine the position of the 3D shape prior model, and use the 3D shape prior model as the initial ship shape 3D model digital model;

[0124] The first generation module 630 is used to optimize the parameters of the current 3D digital model of the ship shape, and use a differentiable renderer to generate n multi-view rendering samples of the ship;

[0125] The second generation module 640 is configured to use a pre-trained multi-view generator to generate n multi-view ship samp...

Embodiment 3

[0140] This embodiment provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by one or more processors, the method for 3D digital reconstruction of the ship shape of the first embodiment is implemented.

[0141] In this embodiment, the computer-readable storage medium may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, SRAM for short), electrically erasable In addition to Programmable Read-Only Memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), Erasable Programmable Read-Only Memory (referred to as EPROM), Programmable Read-Only Memory (Programmable Read-Only Memory, referred to as EPROM) PROM), read-only memory (Read-Only Memory, ROM for short), magnetic memory, flash memory, magnetic disk or optical disk. The content of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a ship shape 3D digital reconstruction method and device, a storage medium and electronic equipment, and the method comprises the steps: extracting a target ship image from a ship-containing image, employing feature fusion and a network frame to extract an image feature map, inverting the parameters of a ship shape 3D digital model, determining the position of a 3D shape prior model, and carrying out the 3D digital reconstruction of the ship shape. Performing parameter optimization on the current ship appearance 3D digital model, and generating n ship multi-view rendering samples by using a micro renderer; generating n ship multi-view samples by using a multi-view generator; optimizing parameters of the current ship appearance 3D digital model based on the n ship multi-view samples, and adjusting the current ship appearance 3D digital model based on the optimized parameters; and under the condition that the target optimization frequency is not reached, loop optimization is carried out until the target optimization frequency is reached, and a ship appearance 3D digital reconstruction model is output. According to the invention, 3D digital reconstruction of the ship appearance can be effectively realized in real time according to ship images or videos captured by marine monitoring.

Description

technical field [0001] The invention relates to the technical field of intelligent ship digital twins, in particular to a method, device, storage medium and electronic equipment for 3D digital reconstruction of ship shape. Background technique [0002] Nowadays, with the continuous development of intelligent ship technology on the road of digitization and automation, various types of intelligent ship perception technology and ship simulation test technology continue to improve, and intelligent ship digital twin technology has increasingly become the key technology for the development of intelligent ships in the future. [0003] At present, the 3D digital reconstruction of ship shape is based on a unified digital model. Although digital design and VR construction simulation can be carried out on the 3D platform, it cannot solve the real-time information interaction and real mapping between real ships and virtual ships. [0004] Existing virtual simulation systems and platform...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06K9/62G06T3/40G06T7/194G06V10/764G06V10/80
CPCG06T17/00G06T7/194G06T3/4053G06T2207/10012G06T2207/10021G06F18/241G06F18/253
Inventor 王胜正邱思源
Owner SHANGHAI MARITIME UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products