Skip to content

The world’s most complete digital twin of Alcatraz

Capturing the biggest set of 3D scans of Alcatraz

The US island prison Alcatraz is a unique environment. The rugged 22.5-acre site of the notorious jail has now been digitally captured in unprecedented 3D detail, involving a world-leading project deploying multiple mapping technologies. Having camped in the jail’s infamous cells for three weeks during the cold San Francisco winter, project head Pete Kelsey and team member Dr Jeremy Sofonia tell us the backstory to this hugely significant endevor.

The Alcatraz tapes: Interview transcripts

Emesent Hovermap and Aura played a key role in the Alcatraz digital twin mapping project. Team lead and project organizer Pete Kelsey, and Emesent’s Jeremy Sofonia, recount the challenges they faced and their key take outs from the historical 3D survey mission.

What was the Alcatraz digital twin mapping project?

PETE KELSEY: The Alcatraz project was for the National Park Service here in the United States. The objective at the outset, at the beginning of the discussion, was to create a baseline survey of the entire island.
All the structures inside and out that could be used as a baseline that all future surveys could be measured against. So, the genesis of the project was really about establishing a baseline survey that could be used for change detection going forward because Alcatraz – it’s a lot of things – but I think what most people don’t understand is that it’s a very dynamic environment.
The Park Service was keen to mention climate change, sea level rise, the effects of over a million visitors per year. It’s right in San Francisco on the San Andreas Fault, so it’s seismically active. There’s a lot of things going on that present challenges to what’s arguably the most notorious prison on earth.
So, they were very keen to get that baseline survey done. From there, the conversation changed into all sorts of interesting and creative ways that this kind of reality capture digital twin type data can be repurposed. That was the Genesis. 
JEREMY SOFONIA: The original idea of the project was to create this 3D model, a virtual tour, for the National Park Service to put content in a digital space online so that people could come and see and visit Alcatraz virtually.
And there are several benefits to that, notwithstanding the ability to get into places that are normally off limits. There are plenty of places, because of the state and the condition of the buildings, that it’s completely impossible to have tours moving through constantly. So this opens up more of Alcatraz to the greater public.

What sort of planning was undertaken for this project?

Emesent's solution delivers an analysis-ready heatmap of time displacement across an entire mine. This can then be easily combined with other geological and geotechnical information to determine the root cause analysis or why that change is occurring, such as lithology, structural interpretations, seismicity data, and numerical modelling results showing stress and plastic strain.

What was it like on Alcatraz during the project?

Currently, the primary method for monitoring change in underground mining is damage mapping, which involves annotating two-dimensional cross-sections of the mine to indicate areas of concern. Although this method allows for broad spatial coverage, it is inherently subjective and lacks precision. In contrast, tape or digital extensometers offer high measurement accuracy at discrete points. However, due to the heterogeneous nature of rock masses—whose properties can vary significantly across tunnels, drives, and cross-sections—these point measurements are not always representative of broader conditions. Advanced tools like total stations and fixed laser sensors provide high accuracy but are limited in spatial coverage.

Each of these traditional methods serves a purpose, yet they also come with trade-offs in terms of scale, frequency, and reliability. As a result, many underground mines struggle to monitor change effectively, potentially compromising both safety and profitability.

How was Emesent Hovermap used in the Alcatraz project?
Integrating Simultaneous Localization and Mapping (SLAM) technology into existing monitoring strategies offers a way to overcome the aforementioned limitations of traditional methods. SLAM enables rapid, large-scale mapping of underground environments and can detect displacement with moderate to high accuracy. This yields more objective and quantitative data than traditional damage mapping.

Moreover, SLAM can inform the targeted placement of extensometers by identifying zones of potential movement, thus enhancing the value of high-precision point measurements. While a total station may detect millimeter-level shifts in key infrastructure – such as a mine entrance – SLAM complements this by enabling broader environmental scans. Similarly, while a fixed laser sensor might track stability in a crusher chamber during stoping, SLAM extends coverage to adjacent areas. In this way, SLAM does not replace traditional tools but enhances them, supporting a more comprehensive, scalable, and proactive monitoring approach.
What were some of the Alcatraz project’s challenges?
While conventional methods all contribute to an effective and robust geotechnical monitoring plan, they require a trade-off between coverage and accuracy. As a result it is difficult to understand where monitoring efforts should be focussed, with the attention placed only on the highest risk and exposure locations. SLAM technology allows the rapid scanning of the entire mine to establish a baseline. The spatial continuity of SLAM data means that now entire levels can be mapped, monitored, and interpreted. Although many mines have implemented SLAM technology into their monitoring plans, Emesent is the first to provide a combined data acquisition through to implementation solution.
How did you go about organizing the huge volumes of data captured on Alcatraz?
Emesent is the first SLAM-based application that provides a Change Detection and Convergence Monitoring solution that combines data acquisition through to implementation. Uniquely, the solution eliminates the need for data transfer between multiple third-party software for the alignment and visualisation tasks necessary for change detection and convergence monitoring.
Were you doing any data processing on Alcatraz Island?
Use the FAQ section of your site to answer those routine questions that always come up and need to be answered. This is a great way to tell us more about what you can offer, fill in some details that might intrigue us, and show us how knowledgeable and helpful you can be.
What did the Alcatraz project teach you about Emesent’s technology?
Use the FAQ section of your site to answer those routine questions that always come up and need to be answered. This is a great way to tell us more about what you can offer, fill in some details that might intrigue us, and show us how knowledgeable and helpful you can be.
What did the Alcatraz project teach you about LiDAR scanning?
Use the FAQ section of your site to answer those routine questions that always come up and need to be answered. This is a great way to tell us more about what you can offer, fill in some details that might intrigue us, and show us how knowledgeable and helpful you can be.

One way to preserve Alcatraz? Capture everything in 3D

New York Times

How mapping experts built the biggest 3D dataset of Alcatraz Island

GIM International