TMCnet News

Autonomous Inspection Of Undersea Structures [Sea Technology]
[May 03, 2014]

Autonomous Inspection Of Undersea Structures [Sea Technology]


(Sea Technology Via Acquire Media NewsEdge) Marlin AUV Adapted for 3D Imaging On-the-Fly Frequent risk-based assessment of the condition and integrity of subsea equipment is vital to predicting the life of the equipment and prevention of uncontrolled release of hydrocarbons into the environment. Oil and gas operators must know the state of equipment that is often thousands of meters below the ocean's surface, shrouded in a veil of darkness. Traditionally, equipment inspection is accomplished with visual sensors, such as video or still cameras, mounted on ROVs hardwired to the operators controlling the vehicle from a ship above the inspection site. This general visual inspection (GVI) requires significant topside support equipment and numerous skilled operators on site, along with a large vessel support crew, to control, observe, and maintain the ROV and interpret the images. While image quality has improved with the advent of digital HD sensors, the images are often degraded by camera movement and water turbidity, reducing inspection effectiveness. In addition, the data provided to clients require laborious review of recorded video that must be archived and revisited by experts for interpretation.



With the advent of 3D imaging sonar and 3D lidar sensors, visual images can be augmented or replaced altogether with 3D models of the subsea equipment geolocated in their respective positions on the seabed. These 3D models can then be imported into a variety of third-party software tools and compared digitally with the as-built models of the structure, simplifying engineering analysis. 3D models also form the basis for automated change detection in subsequent inspections.

When these sensors are employed on an AUV, such as the Marlin developed by Lockheed Martin (Bethesda, Maryland), structural inspections can be executed autonomously, reducing the need to deploy specialists and highly trained ROV operators offshore.


Today, the use of 3D sonar and 3D lidar is limited to deployment on tripods or ROVs set on the seabed offering a stable platform. This approach results in a limited field of view, both horizontally and vertically, essentially imaging one portion of the scene at a time. Imaging an entire structure requires the tripod or ROV to be moved incrementally, gradually encompassing the entire structure in the sensor's view. The images are then post-processed into a mosaic revealing only the area that could be covered by the sensors' view- ing field. When mounted to an ROV, the sensors must be stabilized by the ROV fixing itself to a stable structure and/ or sitting on the seabed while measurements are made. Both of these techniques produce limited, incomplete views of the scene, resulting in limited information to the client. This technique also requires multiple repositioning of the sensor and significant post-processing to generate a final image.

Lockheed Martin's Marlin not only carries the sensors, but also autonomously interacts with the sensors and the vehicle's navigation and control system to produce highquality, motion-compensated 3D models within minutes of retrieving the vehicle to the surface. Three-D imaging "onthe-fly" enables users to collect a whole perspective view of the subsea field with accurate 3D models generated for every structure imaged over the course of a data collection mission. These models are not limited to the scanning field of view of a tripod-mounted sensor, and Lockheed Martin's Feature Based Navigation system produces models that are accurate to millimeters or centimeters, depending on the 3D sensor employed.

Lockheed Martin and 3D at Depth LLC (Boulder, Colorado) are incorporating the SL2 3D lidar onto the proven Marlin AUV, resulting in a transformational capability to produce georegistered 3D images of subsea equipment onthe-fly with millimeter resolution.

Challenge Given the precision placement and small diameter of a laser's spot size, the high scan rate, and potential distortion of an image resulting from sensor motion, a tight coupling of the lidar sensor with the Marlin AUV's motion is required to produce accurate 3D models. Our team's goal is to collect high-precision georegistered image points underwater at a rate of 40,000 points per second while traveling at 2 knots, processing the data in real time and building a 3D image on-the-fly.

Approach Using software algorithms developed for lidar mounted on land-based and aerial vehicles, Lockheed Martin engineers produced amazing 3D models from point clouds generated from the CodaOctopus (Edinburgh, Scotland) Echoscope sonar. Lockheed Martin is now adapting the proven sonar software to process the SL2 lidar point clouds to generate 3D models on-the-fly.

Testing conducted by 3D at Depth and their partners has confirmed the SL2 product baseline performance while operating in a number of environments. Integrating the SL2 onto the Marlin is, therefore, less complex and difficult.

Tank Lab and Offshore Testing De-risking of offshore operations starts with a laboratory simulation that incorporates georegistered 3D models of the subsea scene and bathymetry, vehicle motion and trajectory, simulated models of the actual laser performance (transmission and scattering) in the seawater medium, simulated performance of the SL2 3D lidar, and the onboard signal processing used by the Marlin.

3D at Depth and their partners have conducted tests using a first-generation product, INSCAN, against varying targets common to the subsea oil field, including sample wellhead valve panels, and an actual pipeline end termination deployed in a deepwater Gulf of Mexico field.

Based on successful testing of the INSCAN sensor in controlled conditions and subsequent field use, 3D at Depth engineered the SL2 model to match Lockheed Martin's specifications for use on the Marlin AUV.

A series of laboratory simulation test cases was developed to allow the engineers to examine the entire system's performance across a range of varying parameters. Each test run produces 3D models of the subsea field, providing performance confidence before ever going to sea. This same approach was used successfully in Marlin's development using the CodaOctopus Echoscope 3D sonar.

After successfully passing the rigors of laboratory simulation testing, the software was then integrated to the final hardware in February 2014 in our integration lab prior to dockside and local at-sea testing that will be conducted offshore Palm Beach, Florida, during March 2014. This process greatly reduces the development uncertainties encountered at sea and also provides a means of playback of field-generated data for resolution of faults encountered at sea.

Benefits Advances in underwater imaging using lidar's open capabilities to generate high-resolution 3D models of subsea structures are an important benefit. 3D at Depth's SL2 lidar, the Marlin variation of the INSCAN, integrated with the Marlin AUV's proven ability to generate 3D models based on sonar images, now brings the offshore oil and gas industry a powerful new tool.

High-resolution 3D models can be generated on-the-fly using the Marlin as the host platform for the SL2 lidar. Three-D models of subsea structures offer the field operator's engineers an engineering tool versus simply images. The models can be used for metrology (the ability to determine dimensions directly from the model versus extrapolating from still images); CAD modeling, including structural and thermal analysis; rapid assessment of the structure's condition due to damage or installation problems; and automated change detection upon subsequent surveys.

Practical deepwater oil field applications of these new techniques include: measurement of wellhead verticality; accurate and rapid measurement of jumpers that run from a wellhead to a manifold; structural inspection of subsea facilities; volumetric measurements of anodes on pipelines, wellheads and other structures; measurement of external pipeline defects or damage including dents, coating damage, debris and structural deformations (i.e., bends, buckles); mooring chain inspection-pitting, wear, deformation; and volumetric measurements of seabed mounds or holes caused by scour, berms, or intentionally placed rock piles or sleepers.

Each of these measurements produces a 3D model versus point measurement and is accomplished with the AUV moving at up to 2 knots. Integrity management engineers are now provided with physical measurements rather than an image that must be interpreted.

By using a Marlin AUV with 3D laser and 3D sonar, offshore operating companies are provided with a new cost-effective and safe tool that reduces the operational cost of inspections and increases offshore operation safety, while providing superior engineering information to those responsible for assessing the integrity of critical subsea equipment.

Acknowledgments Thanks to Carl Embry of 3D at Depth, who helped to write this article. This work is being conducted with partial funding under a Department of Energy contract administered by the Research Partnership to Secure Energy for America (RPSEA), with direct oversight and inputs from RPSEA Project Manager Donald Richardson.

References For a list of references, contact Dan McLeod at [email protected]. * Dan McLeod is the deputy director of Offshore Systems & Sensors at the Lockheed Martin, Riviera Beach, Florida, Mission Systems & Training Business. He is a key contributor to Lockheed Martin's undersea programs, beginning with Perry Technologies, followed by their acquisition by Lockheed Martin in 1990. His underwater vehicle career spans three decades and includes design development and management of manned submersibles, saturation diving systems, numerous ROV systems, and now AUV systems for military and commercial use.

lohn lacobson is a senior program manager for Lockheed Martin and has more than 30 years of experience in the design and manufacture of underwater systems, including ROVs, AUVs, subsea tooling and manned submersibles. He has held various senior management positions with subsea technology companies, including Perry Tritech, Stolt Offshore, OceanWorks International and Lockheed Martin.

Mark Hardy is the co-founder and subsea lidar evangelist for 3D at Depth. He has held a variety of roles throughout his career in technology, solving mission-critical business problems by leveraging CIS and 3D data sets. These include the founding of two previous start-ups that leveraged 3D and CIS information to provide decision support for utilities, telecommunications and the military. He is originally from the Boston area but found his way to Texas, where he graduated from the University of Texas with a B.S. in mechanical engineering. He resides in Colorado.

(c) 2014 Compass Publications, Inc.

[ Back To TMCnet.com's Homepage ]