Forrest Iandola

PhD in EECS, University of California, Berkeley, 2016.
B.S. in Computer Science, University of Illinois at Urbana-Champaign, 2012.
Illinois Math and Science Academy, 2008.

Forrest Iandola completed a PhD in EECS at UC Berkeley, where his research focused on squeezing deep neural networks onto small devices. As part of his dissertation research, he developed the energy-efficient SqueezeNet neural network. His advances in deep learning led to the founding of DeepScale, which was acquired by Tesla in 2019. He now serves as the Head of Perception at Anduril Industries.

Forrest Iandola

Research and Industry Experience

Anduril Industries
Head of Perception, July 2021 to Present
  • Leading computer vision and AI engineering for Anduril's drones and our counter-drone system.
  • Helped to win a billion-dollar deal with the US Special Operations Command.
  • Why I joined Anduril: (Video)

Anduril Industries
Computer Vision Engineer/Consultant, September 2020 to July 2021
  • Developed & deployed an AI-enabled autofocus system for Anduril's counter-drone system that can see drones in the sky miles away
  • Deployed on real-time computer vision that runs locally on robots in the field.

Tesla, Palo Alto, CA
Sr Staff Machine Learning Scientist, 2019 to 2020
  • Autopilot.

DeepScale, Mountain View, CA
Co-founder and CEO, September 2015 to September 2019
  • Led a team of 30+ people to develop computationally-efficient computer vision and perception software for road vehicles.
  • We recruited some of the world's best engineers in deep learning and high-performance computing.
  • Raised 3 rounds of venture funding.
  • Acquired by Tesla.

University of California, Berkeley, CA
Graduate Student Researcher, August 2012 to December 2016
  • Worked with Kurt Keutzer on resource-efficient deep learning, ranging from training on hundreds of GPUs, to deploying on embedded platforms.
  • Developed the popular SqueezeNet deep neural network architecture.
  • Dissertation topic: Exploring the Design Space of Deep Convolutional Neural Networks at Large Scale

2006 -- 2014: internships at Microsoft Research, NVIDIA, SLAC, LLNL, and Fermilab

Selected Publications

Forrest N. Iandola, Albert E. Shaw, Ravi Krishna, Kurt W. Keutzer
SqueezeBERT: What can computer vision teach NLP about efficient neural networks?
EMNLP SustaiNLP Workshop, 2020 (Paper) (Code in Hugging Face Transformers) (bibtex) (Slides) (Video) (News article in VentureBeat)

Albert Shaw, Daniel Hunter, Forrest Iandola, Sammy Sidhu
SqueezeNAS: Fast neural architecture search for faster semantic segmentation
ICCV Neural Architects Workshop, 2019 (Paper) (Code on GitHub) (bibtex) (News article in EE Times)

Forrest Iandola, Kurt Keutzer
Small Neural Nets Are Beautiful: Enabling Embedded Systems with Small Deep-Neural-Network Architectures
Keynote at ESWEEK, 2017 (Paper) (bibtex)

Bichen Wu, Forrest Iandola, Peter H. Jin, Kurt Keutzer
SqueezeDet: Unified, Small, Low Power Fully Convolutional Neural Networks for Real-Time Object Detection for Autonomous Driving
CVPR Embedded Vision Workshop, 2017 (Paper) (Code on GitHub) (bibtex)

Forrest Iandola
Exploring the Design Space of Deep Convolutional Neural Networks at Large Scale
UC Berkeley PhD Dissertation, 2016. (Dissertation on arXiv) (Slides) (bibtex)

Forrest N. Iandola, Song Han, Matthew W. Moskewicz, Khalid Ashraf, William J. Dally, and Kurt Keutzer
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5MB model size
arXiv technical report, 2016 (Paper) (Code on GitHub) (bibtex)

Forrest N. Iandola, Khalid Ashraf, Matthew W. Moskewicz, and Kurt Keutzer
FireCaffe: near-linear acceleration of deep neural network training on compute clusters
Computer Vision and Pattern Recognition (CVPR), 2016. (Paper)

Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John C. Platt, C. Lawrence Zitnick, Geoffrey Zweig
From Captions to Visual Concepts and Back
Computer Vision and Pattern Recognition (CVPR), 2015. (Paper)

Ross Girshick, Forrest Iandola, Trevor Darrell, and Jitendra Malik
Deformable Part Models are Convolutional Neural Networks
Computer Vision and Pattern Recognition (CVPR), 2015. (Paper) (Code on GitHub)

Ning Zhang, Ryan Farrell, Forrest Iandola, and Trevor Darrell
Deformable Part Descriptors for Fine-grained Recognition and Attribute Prediction
International Conference on Computer Vision (ICCV), 2013. (Paper) (Project Page)

Forrest N. Iandola, David Sheffield, Michael Anderson, Phitchaya Mangpo Phothilimthana, and Kurt Keutzer
Communication-Minimizing 2D Convolution in GPU Registers
IEEE International Conference on Image Processing (ICIP), 2013. (Paper) (Slides) (Code on GitHub)

Selected Talks

Albert Shaw, Daniel Hunter, Sammy Sidhu, Forrest Iandola
Squeezing down the computing requirements of deep neural networks
IEEE Santa Clara Valley Section, 2019 (Slides)

Albert Shaw, Daniel Hunter, Sammy Sidhu, Forrest Iandola
SqueezeNAS: Fast neural architecture search for faster semantic segmentation
CVPR Workshop on Autonomous Driving, 2019 (Invited Talk) (Slides)

Forrest Iandola, Kurt Keutzer, Joseph E. Gonzalez
Survey of Enabling Technologies for Automated Driving
Short Course at AutoSens, 2019 (Slides)

Forrest Iandola, Kurt Keutzer, Joseph E. Gonzalez
Developing Enabling Technologies for Automated Driving
Short Course at Electronic Imaging, 2019 (Slides) (Video)

Forrest Iandola
Tips and Tricks for Developing Smaller Neural Nets
CVPR Workshop on Efficient Deep Learning for Computer Vision, 2018 (Invited Talk) (Slides) (Video)

Forrest Iandola
Scaling the Training of Deep Neural Networks
Guest Lecture in CS267 at UC Berkeley, 2018 (Video)

Forrest Iandola and Kurt Keutzer
Small Deep-Neural-Networks: Their Advantages and Their Design
ICML TinyML Workshop, 2017 (Invited Talk) (Slides) (Video)

Forrest Iandola
Distributed deep neural network training: A measurement study
UC Berkeley CS268 class project, May 2016 (Paper) (Slides)
   

Contact

Email: forrest.dnn@gmail.com

My Blog

My Old Blog

Forrest Iandola on LinkedIn Forrest Iandola on Twitter