AI & ML interests

ESA’s Φ-lab mission is to accelerate the future of Earth Observation (EO) by means of transformational innovations, i.e. innovations that completely transform or create entire industries via new technologies, with the aim to strengthen the world-leading competitiveness of the European EO industrial and research sectors.

mikonvergence 
posted an update about 2 months ago
view post
Post
397
𝐌𝐚𝐣𝐨𝐫 𝐓𝐎𝐌 ➕ 𝐆𝐨𝐨𝐠𝐥𝐞 𝐃𝐞𝐞𝐩𝐌𝐢𝐧𝐝'𝐬 𝐀𝐥𝐩𝐡𝐚𝐄𝐚𝐫𝐭𝐡 𝐄𝐦𝐛𝐞𝐝𝐝𝐢𝐧𝐠𝐬 𝐚𝐫𝐞 𝐧𝐨𝐰 𝐚𝐯𝐚𝐢𝐥𝐚𝐛𝐥𝐞 ‼️

This is a tiny (about 6 TB of data, but only 62,489 grid cells of ~100 sqkm) prototype dataset that allows to instantly connect existing Major TOM data with AlphaEarth embeddings.

Major-TOM/Core-AlphaEarth-Embeddings

I curated it to support several relevant research projects, but I figured it could help more people in the community to experiment and explore new applications of AlphaEarth.

𝐃𝐢𝐫𝐞𝐜𝐭𝐢𝐨𝐧𝐬 𝐟𝐨𝐫 𝐔𝐬𝐞
Each embedding sample comes from the original annual dataset produced by Google DeepMind. It means that, unlike samples from Sentinel-2 or Sentinel-1, it contains aggregated annual information from a particular year and is not linked to one particular observation. The existing Major TOM samples from physical sensors provide information potentially (and likely) contained in the AlphaEarth embedding sample, but they miss the temporal component represented within AEF embedding fields.

For more information, please check the dataset card on HuggingFace.

⚠️ 𝐖𝐀𝐑𝐍𝐈𝐍𝐆: 𝐄𝐦𝐛𝐞𝐝𝐝𝐢𝐧𝐠𝐬 𝐢𝐧 𝐭𝐡𝐢𝐬 𝐝𝐚𝐭𝐚𝐬𝐞𝐭 𝐝𝐨 𝐧𝐨𝐭 𝐫𝐞𝐩𝐫𝐞𝐬𝐞𝐧𝐭 𝐢𝐧𝐝𝐢𝐯𝐢𝐝𝐮𝐚𝐥 𝐬𝐚𝐦𝐩𝐥𝐞𝐬, 𝐛𝐮𝐭 𝐚 𝐰𝐡𝐨𝐥𝐞 𝐲𝐞𝐚𝐫 𝐨𝐟 𝐦𝐮𝐥𝐭𝐢-𝐦𝐨𝐝𝐚𝐥 𝐨𝐛𝐬𝐞𝐫𝐯𝐚𝐭𝐢𝐨𝐧𝐬. 𝐇𝐚𝐯𝐞 𝐟𝐮𝐧!

🙏 Built on top of fantastic work of
Christopher Brown, Michal Kazmierski, Valerie Pasquarella, Emily Schechter and others at Google DeepMind.
nlongepe 
updated a Space 5 months ago
mikonvergence 
posted an update 6 months ago
view post
Post
820
🔵 𝐂𝐎𝐏-𝐆𝐄𝐍-𝐁𝐞𝐭𝐚: 𝐔𝐧𝐢𝐟𝐢𝐞𝐝 𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐌𝐨𝐝𝐞𝐥𝐥𝐢𝐧𝐠 𝐨𝐟 𝐂𝐎𝐏𝐞𝐫𝐧𝐢𝐜𝐮𝐬 𝐈𝐦𝐚𝐠𝐞𝐫𝐲 𝐓𝐡𝐮𝐦𝐛𝐧𝐚𝐢𝐥𝐬

Today we release a prototype of COP-GEN - a universal generative model for Copernicus data. 𝐂𝐎𝐏-𝐆𝐄𝐍-𝐁𝐞𝐭𝐚 is a model trained globally on the thumbnails of the Major TOM Core datasets, including Sentinel-2 L1C, Sentinel-2 L2A, Sentinel-1 RTC, and COP-DEM GLO-30.

⚖️ 𝐌𝐨𝐝𝐞𝐥 mespinosami/COP-GEN-Beta

📱 𝐃𝐞𝐦𝐨 mikonvergence/COP-GEN-Beta

How is it universal? COP-GEN learns a joint generative process of all modalities, which means that it can reconstruct data from any subset of present observations. 𝐖𝐢𝐭𝐡𝐨𝐮𝐭 𝐭𝐫𝐚𝐢𝐧𝐢𝐧𝐠 𝐬𝐩𝐞𝐜𝐢𝐟𝐢𝐜𝐚𝐥𝐥𝐲 to perform any of these tasks it can be used to approximate:

✅ Sentinel-1 to Sentinel-2 translation

✅ Elevation estimation from Sentinel-2 or Sentinel-1

✅ Atmospheric Correction (L1C to L2A pipeline)

✅ Atmospheric Generation (L2A to L1C)

✅ ...and any other task involving translation between the supported modalities

On its own, the model can be used as a useful prior for estimating the data likelihood distribution for Copernicus data. COP-GEN-Beta learns joint, conditional, and marginal distributions within a single unified backbone, allowing to flexibly sample any modality given any condition.

Why is it Beta? Because thumbnails are a low-cost representation of the data that scales well and we managed to develop this prototype quite fast. We are currently developing the more costly COP-GEN model that supports the original data. For now, we wanted to showcase the prototype and make it available to the community for a test!

🌐 𝐖𝐞𝐛𝐬𝐢𝐭𝐞 https://miquel-espinosa.github.io/cop-gen

💻 𝐂𝐨𝐝𝐞 https://github.com/miquel-espinosa/COP-GEN-Beta

📄 𝐏𝐚𝐩𝐞𝐫 https://arxiv.org/pdf/2504.08548
  • 1 reply
·
mikonvergence 
posted an update 6 months ago
view post
Post
1684
𝐌𝐄𝐒𝐀 🏔️ 𝐓𝐞𝐱𝐭-𝐛𝐚𝐬𝐞𝐝 𝐭𝐞𝐫𝐫𝐚𝐢𝐧 𝐠𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐨𝐧 𝐦𝐨𝐝𝐞𝐥

MESA is a novel generative model based on latent denoising diffusion capable of generating 2.5D representations (co-registered colour and depth maps) of terrains based on text prompt conditioning.

Work developed by Paul Borne–Pons ( @NewtNewt ) during his joint internship at
Adobe & ESA, and in collaboration with asterisk labs.

🏔️ 𝐏𝐫𝐨𝐣𝐞𝐜𝐭 𝐏𝐚𝐠𝐞 : https://paulbornep.github.io/mesa-terrain/

📝 𝐏𝐫𝐞𝐩𝐫𝐢𝐧𝐭 : https://arxiv.org/abs/2504.07210
🤗 𝐌𝐨𝐝𝐞𝐥 𝐖𝐞𝐢𝐠𝐡𝐭𝐬 : NewtNewt/MESA
💾 𝐃𝐚𝐭𝐚𝐬𝐞𝐭 : Major-TOM/Core-DEM
🧑🏻‍💻​𝐂𝐨𝐝𝐞 : https://github.com/PaulBorneP/MESA

𝐇𝐅 𝐒𝐩𝐚𝐜𝐞: mikonvergence/MESA
  • 2 replies
·
mikonvergence 
updated a Space 8 months ago