Inversion of 2D Remote Sensing Data to 3D Volumetric Models Using Deep Dimensionality Exchange
Inversion of 2D Remote Sensing Data to 3D Volumetric Models Using Deep Dimensionality Exchange


In a recent experiment, we used an uncommon convolutional architecture to invert multi-channel 2D surface-acquired remote sensing data into 3D volumetric models. The traditional deterministic process to perform this inversion often takes months of compute time. We’re able to decrease it to tens of milliseconds using our deep learning model. This experiment exposed some fascinating analytical methodologies through empirical exploration, namely, an interesting embedding strategy using eigenvector decomposition at feature engineering time, a brute force conversion from 2D to 3D information in latent space, and a clever but exhaustive investigation through several model architectures including generative and fully convolutional models.

Join me for a description of the use case, a detailed technical walkthrough of the methods used to solve the problem, and a demonstration of the system on physically realistic synthetic data. I’ll describe the model architectures which failed, explain the most successful model architecture, and show the process by which we decided on the non-intuitive optimal feature transforms. As this is ongoing work, I’d love to ask the audience about their thoughts on our processes and, through an extended question and answer session, brainstorm about future work to improve accuracy and increase training speed. The application of these methodologies works in any signal processing application where reconstruction of a higher-dimensional space is required; thus, our work will be of consequence to folks in the fields of computer vision, digital signal processing, or volumetric space manipulation.


Dr. Graham heads up the data science department at Expero, a full-stack software consultancy headquartered in Houston, TX. Expero specializes in developing Data Products that sit at the intersection of analytics and product delivery. Building and maintaining successful data products requires collaboration across the disciplines of data science, software engineering, UX design, and product management. As such, Expero’s expertise engaging with multifaceted teams across multiple industry verticals is extensive and unique. Graham’s focus is on deploying these cross-functional teams to build sustainable data products and data product development processes in organizations to continuously deliver value to end-users.

Open Data Science




Open Data Science
One Broadway
Cambridge, MA 02142

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google