Welcome to the very first of my newsletters on the topic of deep learning applied to satellite and aerial imagery 🛰️ Email is a tried & tested format, and I hope reach a wider audience by embracing it. The material will be curated highlights from my ‘New discovery’ posts, as well as upcoming events and anything else that I think may be of interest. I hope you enjoy this first post! Please note that this edition of the newsletter does not have a sponsor. As a sponsor, you'll receive a shout-out in the opening statement and a dedicated section in the newsletter, reaching a wide audience in the community. If you're interested in gaining visibility for your business or service, sponsoring a future edition of the newsletter is an excellent way to achieve this. For more information on how to sponsor the newsletter, please email me 📧

Earthformer

I was interested to see the publication earthformer-exploring-space-time-transformers-for-earth-system-forecasting from Amazon science, since it is not among the usual topics that I discover material on. The researchers demonstrate state-of-the-art performance on precipitation nowcasting and El Niño/Southern Oscillation (ENSO) forecasting. The Earthformer network derives its name from the Transformer architecture which it uses. The authors note several limitations of the Earthformer, including blurry predictions with a lack of small scale features, and that the model does not take advantage of the physical knowledge of the Earth system. Nevertheless I think the potential of using deep learning in forecasting is significant 🌍

Waterbird monitoring using aerial imagery

In this paper Detectron2 (an open source deep learning platform from Facebook) is used to detect 16 classes of waterbird species that are commonly found in colonial nesting islands along the Texas coast. The authors report that this is one of the largest number of species detected by a single model for UAV-based waterbird monitoring research. I think this is a good demonstration of how meaningful research can be performed without being a pytorch ninja 🥷

• 📖 paper on ArXiv

• 💻 code on Github

Competition: Precision in Building Segmentation

This is an ongoing competition run by The Norwegian Mapping Authority. There are two different tasks to segment buildings, where the first task can only utilize aerial images, while the second must use laser data (LiDAR) with or without aerial images.

• 💰 Cash prizes are available

• 📅 Make your submission by the 25th of November

Satellite cloud generator video

🎥 Mikolaj and I did a video on his cloud generator project on Github