Please don’t remove this alert box from this page.
This alert box is placed on all the pages of this website. Although visible in edit mode, it is hidden by custom code.
Machine Learning for Wildlife Conservation with UAVs

Machine Learning for
Wildlife Conservation
with UAVs
Preventing Extinction Using Unmanned Aerial Vehicles (UVAs)

Poaching has increased in the last decade, particularly poaching of elephants and rhinoceroses. Current levels of poaching of elephants and rhinoceroses will lead to their extinction in the next 10 years. Unmanned aerial vehicles (UAVs) can be flown to spot poachers or to locate animals.
Air Shepherd
We are working to automatically detect poachers and animals in thermal infrared images using deep learning techniques. We are also interested in planning UAV patrol routes. We continue to be interested in recruiting students to join us in this project.
Machine Learning Research
We are working to automatically detect poachers and animals in thermal infrared images using deep learning techniques. We are also interested in planning UAV patrol routes. We continue to be interested in recruiting students to join us in this project.
SPOT is a tool that automatically detects poachers in long wave thermal infrared UAV videos. Tests of SPOT have been run by Air Shepherd at a testing site in South Africa, where training exercises take place. This video is sped up 20 times and shows a 30 minute test at the site using Microsoft Azure on a slow internet connection.
Demonstration Of Spot Detecting Poachers In The Airsim-W Africa Environment
A drone is following poachers through the AirSim-W Africa environment. The normal drone view is on the left, and the corresponding thermal infrared simulation is on the right. SPOT is looking for poachers in the simulated thermal infrared image, and poacher detections are shown in blue boxes. Now, we can see how SPOT would work in the field using a simulated environment.
Previous Work
BIRDSAI Dataset
The Benchmarking IR Dataset for Surveillance with Aerial Intelligence (BIRDSAI, pronounced “bird’s-eye”) is the long-wave thermal infrared dataset containing nighttime images of animals and humans in Southern Africa used for this research. The dataset allows for benchmarking of algorithms for automatic detection and tracking of humans and animals with both real and synthetic videos.
More information can be found on the dataset homepage. The data can be downloaded from the Labeled Information Library of Alexandria. We also provide a brief video description.
Strategic Deployment And Signaling
Where should the limited number of conservation drones fly to best protect animals? Can anything be done to deter poaching if park rangers are unable to reach a target quickly? We address these questions using game theory, and show that strategic signaling can deter poaching both theoretically and in simulation.
Project Participants
Teamcore Members
Collaborators
Robert HannafordAir Shepherd
Fei Fang, Carnegie Mellon University
Haifeng Xu, University of Virginia
Undegraduate Students
Ilkin Bayramli
Former students
Venil Loyd Noronha
Donnabell Dmello
Ajay Anand
Ankita Agarwal
Apurva Gandhi
Anthony Nelson
Diane Reed
Lucas Hu
Lauren Potterat
Suraj Swarup
Adithya Bellathur
Zahra Surani
Sponsors
Contact us about being a sponsor for this project
Related Publications
Elizabeth Bondi, Fei Fang, Debarun Kar, Venil Noronha, Donnabell Dmello, Milind Tambe, Arvind Iyer, and Robert Hannaford “VIOLA: Video Labeling Application for Security Domains“
Proceedings of the Eighth Conference on Decision and Game Theory for Security (GameSec), 2017
Elizabeth Bondi, Fei Fang, Mark Hamilton, Debarun Kar, Donnabell Dmello, Jongmoo Choi, Robert Hannaford, Arvind Iyer, Lucas Joppa, Milind Tambe, Ram Nevatia
“SPOT Poachers in Action: Augmenting Conservation Drones with Automatic Detection in Near Real Time“
Proceedings of the Thirtieth Annual Conference on Innovative Applications of Artificial Intelligence (IAAI), 2018
Elizabeth Bondi, Debadeepta Dey, Ashish Kapoor, Jim Piavis, Shital Shah, Fei Fang, Bistra Dilkina, Robert Hannaford, Arvind Iyer, Lucas Joppa, Milind Tambe
“AirSim-W: A Simulation Environment for Wildlife Conservation with UAVs“
Proceedings of the ACM SIGCAS Conference on Computing and Sustainable Societies (COMPASS), 2018
Elizabeth Bondi, Raghav Jain, Palash Aggrawal, Saket Anand, Robert Hannaford, Ashish Kapoor, Jim Piavis, Shital Shah, Lucas Joppa, Bistra Dilkina, Milind Tambe
“BIRDSAI: A Dataset for Detection and Tracking in Aerial Thermal Infrared Videos“
Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), 2020
Elizabeth Bondi, Hoon Oh, Haifeng Xu, Fei Fang, Bistra Dilkina, Milind Tambe
“To Signal or Not To Signal: Exploiting Uncertain Real-Time Information in Signaling Games for Security and Sustainability“
Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), 2020
Become a Harvard Teamcore partner through community projects, funding, volunteering, or research collaboration.
Get Involved