Lucas Drumetz

In Proceedings of the 31th european signal processing conference (EUSIPCO)

Abstract Over the last few years, massive amounts of satellite multispectral and hyperspectral images covering the Earth’s surface have been made publicly available for scientific purpose, for example through the European Copernicus project. Simultaneously, the development of self-supervised learning (SSL) methods has sparked great interest in the remote sensing community, enabling to learn latent representations from unlabeled data to help treating downstream tasks for which there is few annotated examples, such as interpolation, forecasting or unmixing.

Leveraging neural koopman operators to learn continuous representations of dynamical systems from scarce data

By Anthony Frion, Lucas Drumetz, Mauro Dalla Mura, Guillaume Tochon, Abdeldjalil Aı̈ssa-El-Bey

2023-02-17

In Proceedings of the 48th IEEE international conference on acoustics, speech, and signal processing (ICASSP)

Abstract Over the last few years, several works have proposed deep learning architectures to learn dynamical systems from observation data with no or little knowledge of the underlying physics. A line of work relies on learning representations where the dynamics of the underlying phenomenon can be described by a linear operator, based on the Koopman operator theory. However, despite being able to provide reliable long-term predictions for some dynamical systems in ideal situations, the methods proposed so far have limitations, such as requiring to discretize intrinsically continuous dynamical systems, leading to data loss, especially when handling incomplete or sparsely sampled data.

Assimilation de données variationnelle de séries temporelles d’images sentinel-2 avec un modèle dynamique auto-supervisé

By Anthony Frion, Lucas Drumetz, Mauro Dalla Mura, Guillaume Tochon, Abdeldjalil Aı̈ssa-El-Bey

2022-06-14

In 29e colloque sur le traitement du signal et des images

Abstract Au cours des dernières années, l’apprentissage profond a acquis une importance croissante dans de nombreux domaines scientifiques, notamment en ce qui concerne le traitement d’images, et en particulier pour le traitement des données issues de satellites. Le paradigme le plus courant en ce qui concerne l’apprentissage profond est l’apprentissage supervisé, qui requiert une grande quantité de données annotées représentant la vérité terrain pour la tâche d’intérêt. Or, obtenir des données correctement annotées pose souvent des difficultés financières ou techniques importantes.

Learning Sentinel-2 spectral dynamics for long-run predictions using residual neural networks

By Joaquim Estopinan, Guillaume Tochon, Lucas Drumetz

2021-05-04

In Proceedings of the 29th european signal processing conference (EUSIPCO)

Abstract Making the most of multispectral image time-series is a promising but still relatively under-explored research direction because of the complexity of jointly analyzing spatial, spectral and temporal information. Capturing and characterizing temporal dynamics is one of the important and challenging issues. Our new method paves the way to capture real data dynamics and should eventually benefit applications like unmixing or classification. Dealing with time-series dynamics classically requires the knowledge of a dynamical model and an observation model.

Learning endmember dynamics in multitemporal hyperspectral data using a state-space model formulation

By Lucas Drumetz, Mauro Dalla Mura, Guillaume Tochon, Ronan Fablet

2020-01-24

In Proceedings of the 45th IEEE international conference on acoustics, speech, and signal processing (ICASSP)

Abstract Hyperspectral image unmixing is an inverse problem aiming at recovering the spectral signatures of pure materials of interest (called endmembers) and estimating their proportions (called abundances) in every pixel of the image. However, in spite of a tremendous applicative potential and the avent of new satellite sensors with high temporal resolution, multitemporal hyperspectral unmixing is still a relatively underexplored research avenue in the community, compared to standard image unmixing. In this paper, we propose a new framework for multitemporal unmixing and endmember extraction based on a state-space model, and present a proof of concept on simulated data to show how this representation can be used to inform multitemporal unmixing with external prior knowledge, or on the contrary to learn the dynamics of the quantities involved from data using neural network architectures adapted to the identification of dynamical systems.

Estimating the number of endmembers to use in spectral unmixing of hyperspectral data with collaborative sparsity

By Lucas Drumetz, Guillaume Tochon, Jocelyn Chanussot, Christian Jutten

2016-11-22

In Proceedings of the 13th international conference on latent variable analysis and signal separation (LVA-ICA)

Abstract Spectral Umixing (SU) in hyperspectral remote sensing aims at recovering the signatures of the pure materials in the scene (endmembers) and their abundances in each pixel of the image. The usual SU chain does not take spectral variability (SV) into account, and relies on the estimation of the Intrinsic Dimensionality (ID) of the data, related to the number of endmembers (NOE) to use. However, the ID can be significantly overestimated in difficult scenarios, and sometimes does not correspond to the desired scale and application dependent NOE.

Learning sentinel-2 reflectance dynamics for data-driven assimilation and forecasting

Leveraging neural koopman operators to learn continuous representations of dynamical systems from scarce data

Assimilation de données variationnelle de séries temporelles d’images sentinel-2 avec un modèle dynamique auto-supervisé

Learning Sentinel-2 spectral dynamics for long-run predictions using residual neural networks

Learning endmember dynamics in multitemporal hyperspectral data using a state-space model formulation

Estimating the number of endmembers to use in spectral unmixing of hyperspectral data with collaborative sparsity

Search

Tags