The 50 most-cited articles in Remote Sensing, 2017

Recent research has shown that using spectral–spatial information can considerably improve the performance of hyperspectral image (HSI) classification. HSI data is typically presented in the format of 3D cubes. Thus, 3D spatial filtering naturally offers a simple and effective method for simultaneously extracting the spectral–spatial features within such images. In this paper, a 3D convolutional neural network (3D-CNN) framework is proposed for accurate HSI classification. The proposed method views the HSI cube data altogether without relying on any preprocessing or post-processing, extracting the deep spectral–spatial-combined features effectively. In addition, it requires fewer parameters than other deep learning-based methods. Thus, the model is lighter, less likely to over-fit, and easier to train. For comparison and validation, we test the proposed method along with three other deep learning-based HSI classification methods—namely, stacked autoencoder (SAE), deep brief network (DBN), and 2D-CNN-based methods—on three real-world HSI datasets captured by different sensors.…

Traditional imagery—provided, for example, by RGB and/or NIR sensors—has proven to be useful in many agroforestry applications. However, it lacks the spectral range and precision to profile materials and organisms that only hyperspectral sensors can provide. This kind of high-resolution spectroscopy was firstly used in satellites and later in manned aircraft, which are significantly expensive platforms and extremely restrictive due to availability limitations and/or complex logistics. More recently, UAS have emerged as a very popular and cost-effective remote sensing technology, composed of aerial platforms capable of carrying small-sized and lightweight sensors. Meanwhile, hyperspectral technology developments have been consistently resulting in smaller and lighter sensors that can currently be integrated in UAS for either scientific or commercial purposes. The hyperspectral sensors’ ability for measuring hundreds of bands raises complexity when considering the sheer quantity of acquired data, whose usefulness depends on both calibration and corrective tasks occurring in pre- and…

Combination of different satellite data will provide increased opportunities for more frequent cloud-free surface observations due to variable cloud cover at the different satellite overpass times and dates. Satellite data from the polar-orbiting Landsat-8 (launched 2013), Sentinel-2A (launched 2015) and Sentinel-2B (launched 2017) sensors offer 10 m to 30 m multi-spectral global coverage. Together, they advance the virtual constellation paradigm for mid-resolution land imaging. In this study, a global analysis of Landsat-8, Sentinel-2A and Sentinel-2B metadata obtained from the committee on Earth Observation Satellite (CEOS) Visualization Environment (COVE) tool for 2016 is presented. A global equal area projection grid defined every 0.05° is used considering each sensor and combined together. Histograms, maps and global summary statistics of the temporal revisit intervals (minimum, mean, and maximum) and the number of observations are reported. The temporal observation frequency improvements afforded by sensor combination are shown to be significant. In particular, considering…

UAVs—unmanned aerial vehicles—facilitate data acquisition at temporal and spatial scales that still remain unachievable for traditional remote sensing platforms. However, current legal frameworks that regulate UAVs present significant barriers to research and development. To highlight the importance, impact, and diversity of UAV regulations, this paper provides an exploratory investigation of UAV regulations on the global scale. For this, the methodological approach consists of a research synthesis of UAV regulations, including a thorough literature review and a comparative analysis of national regulatory frameworks. Similarities and contrasting elements in the various national UAV regulations are explored including their statuses from the perspectives of past, present, and future trends. Since the early 2000s, countries have gradually established national legal frameworks. Although all UAV regulations have one common goal—minimizing the risks to other airspace users and to both people and property on the ground—the results reveal distinct variations in all the compared variables.…

As part of the Copernicus programme of the European Commission (EC), the European Space Agency (ESA) has developed and is currently operating the Sentinel-2 mission that is acquiring high spatial resolution optical imagery. This article provides a description of the calibration activities and the status of the mission products validation activities after one year in orbit. Measured performances, from the validation activities, cover both Top-Of-Atmosphere (TOA) and Bottom-Of-Atmosphere (BOA) products. The presented results show the good quality of the mission products both in terms of radiometry and geometry and provide an overview on next mission steps related to data quality aspects.

Land cover classification of Landsat images is one of the most important applications developed from Earth observation satellites. The last four decades were marked by different developments in land cover classification methods of Landsat images. This paper reviews the developments in land cover classification methods for Landsat images from the 1970s to date and highlights key ways to optimize analysis of Landsat images in order to attain the desired results. This review suggests that the development of land cover classification methods grew alongside the launches of a new series of Landsat sensors and advancements in computer science. Most classification methods were initially developed in the 1970s and 1980s; however, many advancements in specific classifiers and algorithms have occurred in the last decade. The first methods of land cover classification to be applied to Landsat images were visual analyses in the early 1970s, followed by unsupervised and supervised pixel-based classification methods using maximum likelihood, K-means and Iterative Self-Organizing Data Analysis…

A detailed and accurate knowledge of land cover is crucial for many scientific and operational applications, and as such, it has been identified as an Essential Climate Variable. This accurate knowledge needs frequent updates. This paper presents a methodology for the fully automatic production of land cover maps at country scale using high resolution optical image time series which is based on supervised classification and uses existing databases as reference data for training and validation. The originality of the approach resides in the use of all available image data, a simple pre-processing step leading to a homogeneous set of acquisition dates over the whole area and the use of a supervised classifier which is robust to errors in the reference data. The produced maps have a kappa coefficient of 0.86 with 17 land cover classes. The processing is efficient, allowing a fast delivery of the maps after the acquisition of the image data, does not need expensive field surveys for model calibration and validation, nor human operators for decision making, and uses open and freely…

Tremendous progress has been made in object recognition with deep convolutional neural networks (CNNs), thanks to the availability of large-scale annotated dataset. With the ability of learning highly hierarchical image feature extractors, deep CNNs are also expected to solve the Synthetic Aperture Radar (SAR) target classification problems. However, the limited labeled SAR target data becomes a handicap to train a deep CNN. To solve this problem, we propose a transfer learning based method, making knowledge learned from sufficient unlabeled SAR scene images transferrable to labeled SAR target data. We design an assembled CNN architecture consisting of a classification pathway and a reconstruction pathway, together with a feedback bypass additionally. Instead of training a deep network with limited dataset from scratch, a large number of unlabeled SAR scene images are used to train the reconstruction pathway with stacked convolutional auto-encoders (SCAE) at first. Then, these pre-trained convolutional layers are reused to transfer knowledge to SAR target classification tasks, with…

The Galician coast (NW Spain) is a region that is strongly influenced by the presence of low pressure systems in the mid-Atlantic Ocean and the periodic passage of storms that give rise to severe sea states. Since its wave climate is one of the most energetic in Europe, the objectives of this paper were twofold. The first objective was to characterize the most extreme wave height events in Galicia over the wintertime of a two-year period (2015–2016) by using reliable high-frequency radar wave parameters in concert with predictions from a regional wave (WAV) forecasting system running operationally in the Iberia-Biscay-Ireland (IBI) area, denominatedIBI-WAV. The second objective was to showcase the application of satellite wave altimetry (in particular, remote-sensed three-hourly wave height estimations) for the daily skill assessment of the IBI-WAV model product. Special attention was focused on monitoring Ophelia—one of the major hurricanes on record in the easternmost Atlantic—during its 3-day track over Ireland and the UK (15–17 October 2017). Overall, the results reveal the…

Small unmanned aerial vehicle (UAV) based remote sensing is a rapidly evolving technology. Novel sensors and methods are entering the market, offering completely new possibilities to carry out remote sensing tasks. Three-dimensional (3D) hyperspectral remote sensing is a novel and powerful technology that has recently become available to small UAVs. This study investigated the performance of UAV-based photogrammetry and hyperspectral imaging in individual tree detection and tree species classification in boreal forests. Eleven test sites with 4151 reference trees representing various tree species and developmental stages were collected in June 2014 using a UAV remote sensing system equipped with a frame format hyperspectral camera and an RGB camera in highly variable weather conditions. Dense point clouds were measured photogrammetrically by automatic image matching using high resolution RGB images with a 5 cm point interval. Spectral features were obtained from the hyperspectral image blocks, the large radiometric variation of which was compensated for by using a novel approach…

A satellite-derived cropland extent map at high spatial resolution (30-m or better) is a must for food and water security analysis. Precise and accurate global cropland extent maps, indicating cropland and non-cropland areas, are starting points to develop higher-level products such as crop watering methods (irrigated or rainfed), cropping intensities (e.g., single, double, or continuous cropping), crop types, cropland fallows, as well as for assessment of cropland productivity (productivity per unit of land), and crop water productivity (productivity per unit of water). Uncertainties associated with the cropland extent map have cascading effects on all higher-level cropland products. However, precise and accurate cropland extent maps at high spatial resolution over large areas (e.g., continents or the globe) are challenging to produce due to the small-holder dominant agricultural systems like those found in most of Africa and Asia. Cloud-based geospatial computing platforms and multi-date, multi-sensor satellite image inventories on Google Earth Engine offer opportunities for…

Soil moisture mapping at a high spatial resolution is very important for several applications in hydrology, agriculture and risk assessment. With the arrival of the free Sentinel data at high spatial and temporal resolutions, the development of soil moisture products that can better meet the needs of users is now possible. In this context, the main objective of the present paper is to develop an operational approach for soil moisture mapping in agricultural areas at a high spatial resolution over bare soils, as well as soils with vegetation cover. The developed approach is based on the synergic use of radar and optical data. A neural network technique was used to develop an operational method for soil moisture estimates. Three inversion SAR (Synthetic Aperture Radar) configurations were tested: (1) VV polarization; (2) VH polarization; and (3) both VV and VH polarization, all in addition to the NDVI information extracted from optical images. Neural networks were developed and validated using synthetic and real databases. The results showed that the use of a priori information on the…

Correct estimation of above-ground biomass (AGB) is necessary for accurate crop growth monitoring and yield prediction. We estimated AGB based on images obtained with a snapshot hyperspectral sensor (UHD 185 firefly, Cubert GmbH, Ulm, Baden-Württemberg, Germany) mounted on an unmanned aerial vehicle (UAV). The UHD 185 images were used to calculate the crop height and hyperspectral reflectance of winter wheat canopies from hyperspectral and panchromatic images. We constructed several single-parameter models for AGB estimation based on spectral parameters, such as specific bands, spectral indices (e.g., Ratio Vegetation Index (RVI), NDVI, Greenness Index (GI) and Wide Dynamic Range VI (WDRVI)) and crop height and several models combined with spectral parameters and crop height. Comparison with experimental results indicated that incorporating crop height into the models improved the accuracy of AGB estimations (the average AGB is 6.45 t/ha). The estimation accuracy of single-parameter models was low (crop height only: R2 = 0.50, RMSE = 1.62 t/ha, MAE = 1.24 t/ha; R670 only: R2 = 0.54,…

As a variant of Convolutional Neural Networks (CNNs) in Deep Learning, the Fully Convolutional Network (FCN) model achieved state-of-the-art performance for natural image semantic segmentation. In this paper, an accurate classification approach for high resolution remote sensing imagery based on the improved FCN model is proposed. Firstly, we improve the density of output class maps by introducing Atrous convolution, and secondly, we design a multi-scale network architecture by adding a skip-layer structure to make it capable for multi-resolution image classification. Finally, we further refine the output class map using Conditional Random Fields (CRFs) post-processing. Our classification model is trained on 70 GF-2 true color images, and tested on the other 4 GF-2 images and 3 IKONOS true color images. We also employ object-oriented classification, patch-based CNN classification, and the FCN-8s approach on the same images for comparison. The experiments show that compared with the existing approaches, our approach has an obvious improvement in accuracy. The average precision,…

Synthetic aperture radar (SAR) ship detection has been playing an increasingly essential role in marine monitoring in recent years. The lack of detailed information about ships in wide swath SAR imagery poses difficulty for traditional methods in exploring effective features for ship discrimination. Being capable of feature representation, deep neural networks have achieved dramatic progress in object detection recently. However, most of them suffer from the missing detection of small-sized targets, which means that few of them are able to be employed directly in SAR ship detection tasks. This paper discloses an elaborately designed deep hierarchical network, namely a contextual region-based convolutional neural network with multilayer fusion, for SAR ship detection, which is composed of a region proposal network (RPN) with high network resolution and an object detection network with contextual features. Instead of using low-resolution feature maps from a single layer for proposal generation in a RPN, the proposed method employs an intermediate layer combined with a downscaled…

This study conducts an exploratory evaluation of the performance of the newly available Sentinel-2A Multispectral Instrument (MSI) imagery for mapping water bodies using the image sharpening approach. Sentinel-2 MSI provides spectral bands with different resolutions, including RGB and Near-Infra-Red (NIR) bands in 10 m and Short-Wavelength InfraRed (SWIR) bands in 20 m, which are closely related to surface water information. It is necessary to define a pan-like band for the Sentinel-2 image sharpening process because of the replacement of the panchromatic band by four high-resolution multi-spectral bands (10 m). This study, which aimed at urban surface water extraction, utilised the Normalised Difference Water Index (NDWI) at 10 m resolution as a high-resolution image to sharpen the 20 m SWIR bands. Then, object-level Modified NDWI (MNDWI) mapping and minimum valley bottom adjustment threshold were applied to extract water maps. The proposed method was compared with the conventional most related band- (between the visible spectrum/NIR and SWIR bands) based and principal component…

Leaf area index (LAI) and chlorophyll content, at leaf and canopy level, are important variables for agricultural applications because of their crucial role in photosynthesis and in plant functioning. The goal of this study was to test the hypothesis that LAI, leaf chlorophyll content (LCC), and canopy chlorophyll content (CCC) of a potato crop can be estimated by vegetation indices for the first time using Sentinel-2 satellite images. In 2016 ten plots of 30 × 30 m were designed in a potato field with different fertilization levels. During the growing season approximately 10 daily radiometric field measurements were used to determine LAI, LCC, and CCC. These radiometric determinations were extensively calibrated against LAI2000 and chlorophyll meter (SPAD, soil plant analysis development) measurements for potato crops grown in the years 2010–2014. Results for Sentinel-2 showed that the weighted difference vegetation index (WDVI) using bands at 10 m spatial resolution can be used for estimating the LAI (R2 of 0.809; root mean square error of prediction (RMSEP) of 0.36). The ratio of…

Hyperspectral images are well-known for their fine spectral resolution to discriminate different materials. However, their spatial resolution is relatively low due to the trade-off in imaging sensor technologies, resulting in limitations in their applications. Inspired by recent achievements in convolutional neural network (CNN) based super-resolution (SR) for natural images, a novel three-dimensional full CNN (3D-FCNN) is constructed for spatial SR of hyperspectral images in this paper. Specifically, 3D convolution is used to exploit both the spatial context of neighboring pixels and spectral correlation of neighboring bands, such that spectral distortion when directly applying traditional CNN based SR algorithms to hyperspectral images in band-wise manners is alleviated. Furthermore, a sensor-specific mode is designed for the proposed 3D-FCNN such that none of the samples from the target scene are required for training. Fine-tuning by a small number of training samples from the target scene can further improve the performance of such a sensor-specific method. Extensive…

The rapid development of high spatial resolution (HSR) remote sensing imagery techniques not only provide a considerable amount of datasets for scene classification tasks but also request an appropriate scene classification choice when facing with finite labeled samples. AlexNet, as a relatively simple convolutional neural network (CNN) architecture, has obtained great success in scene classification tasks and has been proven to be an excellent foundational hierarchical and automatic scene classification technique. However, current HSR remote sensing imagery scene classification datasets always have the characteristics of small quantities and simple categories, where the limited annotated labeling samples easily cause non-convergence. For HSR remote sensing imagery, multi-scale information of the same scenes can represent the scene semantics to a certain extent but lacks an efficient fusion expression manner. Meanwhile, the current pre-trained AlexNet architecture lacks a kind of appropriate supervision for enhancing the performance of this model, which easily causes overfitting. In…

Satellite remote sensing data including Landsat-8 (optical), Sentinel-1, and RADARSAT-2 (synthetic aperture radar (SAR) missions) have recently become routinely available for large scale ice velocity mapping of ice sheets in Greenland and Antarctica. These datasets are too large in size to be processed and calibrated manually as done in the past. Here, we describe a methodology to process the SAR and optical data in a synergistic fashion and automatically calibrate, mosaic, and integrate these data sets together into seamless, ice-sheet-wide, products. We employ this approach to produce annual mosaics of ice motion in Antarctica and Greenland with all available data acquired on a particular year. We find that the precision of a Landsat-8 pair is lower than that of its SAR counterpart, but due to the large number of Landsat-8 acquisitions, combined with the high persistency of optical surface features in the Landsat-8 data, we obtain accurate velocity products from Landsat that integrate well with the SAR-derived velocity products. The resulting pool of remote sensing products is a…

This paper proposes a novel deep learning framework named bidirectional-convolutional long short term memory (Bi-CLSTM) network to automatically learn the spectral-spatial features from hyperspectral images (HSIs). In the network, the issue of spectral feature extraction is considered as a sequence learning problem, and a recurrent connection operator across the spectral domain is used to address it. Meanwhile, inspired from the widely used convolutional neural network (CNN), a convolution operator across the spatial domain is incorporated into the network to extract the spatial feature. In addition, to sufficiently capture the spectral information, a bidirectional recurrent connection is proposed. In the classification phase, the learned features are concatenated into a vector and fed to a Softmax classifier via a fully-connected operator. To validate the effectiveness of the proposed Bi-CLSTM framework, we compare it with six state-of-the-art methods, including the popular 3D-CNN model, on three widely used HSIs (i.e., Indian Pines, Pavia University, and Kennedy Space Center). The…

Modern advances in cloud computing and machine-leaning algorithms are shifting the manner in which Earth-observation (EO) data are used for environmental monitoring, particularly as we settle into the era of free, open-access satellite data streams. Wetland delineation represents a particularly worthy application of this emerging research trend, since wetlands are an ecologically important yet chronically under-represented component of contemporary mapping and monitoring programs, particularly at the regional and national levels. Exploiting Google Earth Engine and R Statistical software, we developed a workflow for predicting the probability of wetland occurrence using a boosted regression tree machine-learning framework applied to digital topographic and EO data. Working in a 13,700 km2 study area in northern Alberta, our best models produced excellent results, with AUC (area under the receiver-operator characteristic curve) values of 0.898 and explained-deviance values of 0.708. Our results demonstrate the central role of high-quality topographic variables for modeling wetland…

This paper presents an automatic solution to the problem of detecting and counting cars in unmanned aerial vehicle (UAV) images. This is a challenging task given the very high spatial resolution of UAV images (on the order of a few centimetres) and the extremely high level of detail, which require suitable automatic analysis methods. Our proposed method begins by segmenting the input image into small homogeneous regions, which can be used as candidate locations for car detection. Next, a window is extracted around each region, and deep learning is used to mine highly descriptive features from these windows. We use a deep convolutional neural network (CNN) system that is already pre-trained on huge auxiliary data as a feature extraction tool, combined with a linear support vector machine (SVM) classifier to classify regions into “car” and “no-car” classes. The final step is devoted to a fine-tuning procedure which performs morphological dilation to smooth the detected regions and fill any holes. In addition, small isolated regions are analysed further using a few sliding rectangular…

Drought is a recurring phenomenon in Ethiopia that significantly impacts the socioeconomic sector and various components of the environment. The overarching goal of this study is to assess the spatial and temporal patterns of meteorological drought using a satellite-derived rainfall product for the Upper Blue Nile Basin (UBN). The satellite rainfall product used in this study was selected through evaluation of five high-resolution products (Climate Hazards Group InfraRed Precipitation with Stations (CHIRPS) v2.0, Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN), African Rainfall Climatology and Time-series (TARCAT) v2.0, Tropical Rainfall Measuring Mission (TRMM) and Africa Rainfall Estimate Climatology version 2 [ARC 2.0]). The statistical performance measuring techniques (i.e., Pearson correlation coefficient (r), mean error (ME), root mean square error (RMSE), and Bias) were used to evaluate the satellite rainfall products with the corresponding ground observation data at ten independent weather stations. The evaluation was…

Plane segmentation is a basic task in the automatic reconstruction of indoor and urban environments from unorganized point clouds acquired by laser scanners. As one of the most common plane-segmentation methods, standard Random Sample Consensus (RANSAC) is often used to continually detect planes one after another. However, it suffers from the spurious-plane problem when noise and outliers exist due to the uncertainty of randomly sampling the minimum subset with 3 points. An improved RANSAC method based on Normal Distribution Transformation (NDT) cells is proposed in this study to avoid spurious planes for 3D point-cloud plane segmentation. A planar NDT cell is selected as a minimal sample in each iteration to ensure the correctness of sampling on the same plane surface. The 3D NDT represents the point cloud with a set of NDT cells and models the observed points with a normal distribution within each cell. The geometric appearances of NDT cells are used to classify the NDT cells into planar and non-planar cells. The proposed method is verified on three indoor scenes. The experimental…

Leaf area index (LAI) is an important indicator of plant growth and yield that can be monitored by remote sensing. Several models were constructed using datasets derived from SRS and STR sampling methods to determine the optimal model for soybean (multiple strains) LAI inversion for the whole crop growth period and a single growth period. Random forest (RF), artificial neural network (ANN), and support vector machine (SVM) regression models were compared with a partial least-squares regression (PLS) model. The RF model yielded the highest precision, accuracy, and stability with V-R2, SDR2, V-RMSE, and SDRMSE values of 0.741, 0.031, 0.106, and 0.005, respectively, over the whole growth period based on STR sampling. The ANN model had the highest precision, accuracy, and stability (0.452, 0.132, 0.086, and 0.009, respectively) over a single growth phase based on STR sampling. The precision, accuracy, and stability of the RF, ANN, and SVM models were improved by inclusion of STR sampling. The RF model is suitable for estimating LAI when sample plots and variation are relatively large…

Satellite derived vegetation indices (VIs) are broadly used in ecological research, ecosystem modeling, and land surface monitoring. The Normalized Difference Vegetation Index (NDVI), perhaps the most utilized VI, has countless applications across ecology, forestry, agriculture, wildlife, biodiversity, and other disciplines. Calculating satellite derived NDVI is not always straight-forward, however, as satellite remote sensing datasets are inherently noisy due to cloud and atmospheric contamination, data processing failures, and instrument malfunction. Readily available NDVI products that account for these complexities are generally at coarse resolution; high resolution NDVI datasets are not conveniently accessible and developing them often presents numerous technical and methodological challenges. We address this deficiency by producing a Landsat derived, high resolution (30 m), long-term (30+ years) NDVI dataset for the conterminous United States. We use Google Earth Engine, a planetary-scale cloud-based geospatial analysis platform, for processing the Landsat data and…

Assessment and monitoring of rice agriculture over large areas has been limited by cloud cover, optical sensor spatial and temporal resolutions, and lack of systematic or open access radar. Dense time series of open access Sentinel-1 C-band data at moderate spatial resolution offers new opportunities for monitoring agriculture. This is especially pertinent in South and Southeast Asia where rice is critical to food security and mostly grown during the rainy seasons when high cloud cover is present. In this research application, time series Sentinel-1A Interferometric Wide images (632) were utilized to map rice extent, crop calendar, inundation, and cropping intensity across Myanmar. An updated (2015) land use land cover map fusing Sentinel-1, Landsat-8 OLI, and PALSAR-2 were integrated and classified using a randomforest algorithm. Time series phenological analyses of the dense Sentinel-1 data were then executed to assess rice information across all of Myanmar. The broad land use land cover map identified 186,701 km2 of cropland across Myanmar with mean out-of-sample kappa of over…

The main goal of the Soil Moisture and Ocean Salinity (SMOS) mission over land surfaces is the production of global maps of soil moisture (SM) and vegetation optical depth (τ) based on multi-angular brightness temperature (TB) measurements at L-band. The operational SMOS Level 2 and Level 3 soil moisture algorithms account for different surface effects, such as vegetation opacity and soil roughness at 4 km resolution, in order to produce global retrievals of SM and τ. In this study, we present an alternative SMOS product that was developed by INRA (Institut National de la Recherche Agronomique) and CESBIO (Centre d’Etudes Spatiales de la BIOsphère). One of the main goals of this SMOS-INRA-CESBIO (SMOS-IC) product is to be as independent as possible from auxiliary data. The SMOS-IC product provides daily SM and τ at the global scale and differs from the operational SMOS Level 3 (SMOSL3) product in the treatment of retrievals over heterogeneous pixels. Specifically, SMOS-IC is much simpler and does not account for corrections associated with the antenna pattern and the complex SMOS…

Accurate measurement and mapping of biomass is a critical component of carbon stock quantification, climate change impact assessment, suitability and location of bio-energy processing plants, assessing fuel for forest fires, and assessing merchandisable timber.[...]

Many soil remote sensing applications rely on narrow-band observations to exploit molecular absorption features. However, broadband sensors are invaluable for soil surveying, agriculture, land management and mineral exploration, amongst others. These sensors provide denser time series compared to high-resolution airborne imaging spectrometers and hold the potential of increasing the observable bare-soil area at the cost of spectral detail. The wealth of data coming along with these applications can be handled using cloud-based processing platforms such as Earth Engine. We present a method for identifying the least-vegetated observation, or so called barest pixel, in a dense time series between January 1985 and March 2017, based on Landsat 5, 7 and 8 observations. We derived a Barest Pixel Composite and Bare Soil Composite for the agricultural area of the Swiss Plateau. We analysed the available data over time and concluded that about five years of Landsat data were needed for a full-coverage composite (90% of the maximum bare soil area). Using the Swiss harmonised soil data, we…

Deep neural networks, such as convolutional neural networks (CNN) and stacked autoencoders, have recently been successfully used to extract deep features for hyperspectral data classification. Recurrent neural networks (RNN) are another type of neural networks, which are widely used for sequence analysis because they are constructed to extract contextual information from sequences by modeling the dependencies between different time steps. In this paper, we study the ability of RNN for hyperspectral data classification by extracting the contextual information from the data. Specifically, hyperspectral data are treated as spectral sequences, and an RNN is used to model the dependencies between different spectral bands. In addition, we propose to use a convolutional recurrent neural network (CRNN) to learn more discriminative features for hyperspectral data classification. In CRNN, a few convolutional layers are first learned to extract middle-level and locally-invariant features from the input data, and the following recurrent layers are then employed to further extract…

Many time-series smoothing methods can be used for reducing noise and extracting plant phenological parameters from remotely-sensed data, but there is still no conclusive evidence in favor of one method over others. Here we use moderate-resolution imaging spectroradiometer (MODIS) derived normalized difference vegetation index (NDVI) to investigate five smoothing methods: Savitzky-Golay fitting (SG), locally weighted regression scatterplot smoothing (LO), spline smoothing (SP), asymmetric Gaussian function fitting (AG), and double logistic function fitting (DL). We use ground tower measured NDVI (10 sites) and gross primary productivity (GPP, 4 sites) to evaluate the smoothed satellite-derived NDVI time-series, and elevation data to evaluate phenology parameters derived from smoothed NDVI. The results indicate that all smoothing methods can reduce noise and improve signal quality, but that no single method always performs better than others. Overall, the local filtering methods (SG and LO) can generate very accurate results if smoothing parameters are optimally calibrated. If local…

Like computer vision before, remote sensing has been radically changed by the introduction of deep learning and, more notably, Convolution Neural Networks. Land cover classification, object detection and scene understanding in aerial images rely more and more on deep networks to achieve new state-of-the-art results. Recent architectures such as Fully Convolutional Networks can even produce pixel level annotations for semantic mapping. In this work, we present a deep-learning based segment-before-detect method for segmentation and subsequent detection and classification of several varieties of wheeled vehicles in high resolution remote sensing images. This allows us to investigate object detection and classification on a complex dataset made up of visually similar classes, and to demonstrate the relevance of such a subclass modeling approach. Especially, we want to show that deep learning is also suitable for object-oriented analysis of Earth Observation data as effective object detection can be obtained as a byproduct of accurate semantic segmentation. First, we train a deep fully…

Geospatial co-registration is a mandatory prerequisite when dealing with remote sensing data. Inter- or intra-sensoral misregistration will negatively affect any subsequent image analysis, specifically when processing multi-sensoral or multi-temporal data. In recent decades, many algorithms have been developed to enable manual, semi- or fully automatic displacement correction. Especially in the context of big data processing and the development of automated processing chains that aim to be applicable to different remote sensing systems, there is a strong need for efficient, accurate and generally usable co-registration. Here, we present AROSICS (Automated and Robust Open-Source Image Co-Registration Software), a Python-based open-source software including an easy-to-use user interface for automatic detection and correction of sub-pixel misalignments between various remote sensing datasets. It is independent of spatial or spectral characteristics and robust against high degrees of cloud coverage and spectral and temporal land cover dynamics. The co-registration is based on phase…

Following an avalanche, one of the factors that affect victims’ chance of survival is the speed with which they are located and dug out. Rescue teams use techniques like trained rescue dogs and electronic transceivers to locate victims. However, the resources and time required to deploy rescue teams are major bottlenecks that decrease a victim’s chance of survival. Advances in the field of Unmanned Aerial Vehicles (UAVs) have enabled the use of flying robots equipped with sensors like optical cameras to assess the damage caused by natural or manmade disasters and locate victims in the debris. In this paper, we propose assisting avalanche search and rescue (SAR) operations with UAVs fitted with vision cameras. The sequence of images of the avalanche debris captured by the UAV is processed with a pre-trained Convolutional Neural Network (CNN) to extract discriminative features. A trained linear Support Vector Machine (SVM) is integrated at the top of the CNN to detect objects of interest. Moreover, we introduce a pre-processing method to increase the detection rate and a…

The evaluation of satellite precipitation products (SPPs) at regional and local scales is essential in improving satellite-based algorithms and sensors, as well as in providing valuable guidance when choosing alternative precipitation data for the local community. The Tropical Rainfall Measuring Mission (TRMM) has made significant contributions to the development of various SPPs since its launch in 1997. The Global Precipitation Measurement (GPM) mission launched in 2014 and is expected to continue the success of TRMM. During the transition from the TRMM era to the GPM era, it is necessary to assess GPM products and make comparisons with TRMM products in different regions to achieve a global view of the performance of GPM products. To this end, this study aims to assess the capability of the latest Integrated Multi-satellite Retrievals for GPM (IMERG) and two TRMM Multisatellite Precipitation Analysis (TMPA) products (TMPA 3B42 and TMPA 3B42RT) in estimating precipitation over Singapore that represents a typical tropical region. The evaluation was conducted at daily, monthly,…

The use of Unmanned Aerial Vehicles (UAV) for photogrammetric surveying has recently gained enormous popularity. Images taken from UAVs are used for generating Digital Surface Models (DSMs) and orthorectified images. In the glaciological context, these can serve for quantifying ice volume change or glacier motion. This study focuses on the accuracy of UAV-derived DSMs. In particular, we analyze the influence of the number and disposition of Ground Control Points (GCPs) needed for georeferencing the derived products. A total of 1321 different DSMs were generated from eight surveys distributed on three glaciers in the Swiss Alps during winter, summer and autumn. The vertical and horizontal accuracy was assessed by cross-validation with thousands of validation points measured with a Global Positioning System. Our results show that the accuracy increases asymptotically with increasing number of GCPs until a certain density of GCPs is reached. We call this the optimal GCP density. The results indicate that DSMs built with this optimal GCP density have a vertical (horizontal) accuracy…

This study explores the estimation of land surface temperature (LST) for the globe from Landsat 5, 7 and 8 thermal infrared sensors, using different surface emissivity sources. A single channel algorithm is used for consistency among the estimated LST products, whereas the option of using emissivity from different sources provides flexibility for the algorithm’s implementation to any area of interest. The Google Earth Engine (GEE), an advanced earth science data and analysis platform, allows the estimation of LST products for the globe, covering the time period from 1984 to present. To evaluate the method, the estimated LST products were compared against two reference datasets: (a) LST products derived from ASTER (Advanced Spaceborne Thermal Emission and Reflection Radiometer), as higher-level products based on the temperature-emissivity separation approach; (b) Landsat LST data that have been independently produced, using different approaches. An overall RMSE (root mean square error) of 1.52 °C was observed and it was confirmed that the accuracy of the LST product is dependent on…

Satellite data provide the only viable means for extensive monitoring of remote and large freshwater systems, such as the Amazon floodplain lakes. However, an accurate atmospheric correction is required to retrieve water constituents based on surface water reflectance ( R W ). In this paper, we assessed three atmospheric correction methods (Second Simulation of a Satellite Signal in the Solar Spectrum (6SV), ACOLITE and Sen2Cor) applied to an image acquired by the MultiSpectral Instrument (MSI) on-board of the European Space Agency’s Sentinel-2A platform using concurrent in-situ measurements over four Amazon floodplain lakes in Brazil. In addition, we evaluated the correction of forest adjacency effects based on the linear spectral unmixing model, and performed a temporal evaluation of atmospheric constituents from Multi-Angle Implementation of Atmospheric Correction (MAIAC) products. The validation of MAIAC aerosol optical depth (AOD) indicated satisfactory retrievals over the Amazon region, with a correlation coefficient (R) of ~0.7 and 0.85 for Terra and Aqua products,…

In a perspective to develop an inversion approach for estimating surface soil moisture of crop fields from Sentinel-1/2 data (radar and optical sensors), the Water Cloud Model (WCM) was calibrated from C-band Synthetic Aperture Radar (SAR) data and Normalized Difference Vegetation Index (NDVI) values collected over crops fields and grasslands. The soil contribution that depends on soil moisture and surface roughness (in addition to SAR instrumental parameters) was simulated using the physical backscattering model IEM (Integral Equation Model). The vegetation descriptor used in the WCM is the NDVI because it can be directly calculated from optical images. A large dataset consisting of radar backscattered signal in Vertical transmit and Vertical receive (VV) and Vertical transmit and Horizontal receive (VH) polarizations with wide range of incidence angle, soil moisture, surface roughness, and NDVI-values was used. It was collected over two agricultural study sites. Results show that the soil contribution to the total radar backscattered signal is lower in VH than in VV because VH is…

Applications of remote sensing using unmanned aerial vehicle (UAV) in agriculture has proved to be an effective and efficient way of obtaining field information. In this study, we validated the feasibility of utilizing multi-temporal color images acquired from a low altitude UAV-camera system to monitor real-time wheat growth status and to map within-field spatial variations of wheat yield for smallholder wheat growers, which could serve as references for site-specific operations. Firstly, eight orthomosaic images covering a small winter wheat field were generated to monitor wheat growth status from heading stage to ripening stage in Hokkaido, Japan. Multi-temporal orthomosaic images indicated straightforward sense of canopy color changes and spatial variations of tiller densities. Besides, the last two orthomosaic images taken from about two weeks prior to harvesting also notified the occurrence of lodging by visual inspection, which could be used to generate navigation maps guiding drivers or autonomous harvesting vehicles to adjust operation speed according to specific lodging…

Recent deployments of CubeSat imagers by companies such as Planet may advance hydrological remote sensing by providing an unprecedented combination of high temporal and high spatial resolution imagery at the global scale. With approximately 170 CubeSats orbiting at full operational capacity, the Planet CubeSat constellation currently offers an average revisit time of <1 day for the Arctic and near-daily revisit time globally at 3 m spatial resolution. Such data have numerous potential applications for water resource monitoring, hydrologic modeling and hydrologic research. Here we evaluate Planet CubeSat imaging capabilities and potential scientific utility for surface water studies in the Yukon Flats, a large sub-Arctic wetland in north central Alaska. We find that surface water areas delineated from Planet imagery have a normalized root mean square error (NRMSE) of <11% and geolocation accuracy of <10 m as compared with manual delineations from high resolution (0.3–0.5 m) WorldView-2/3 panchromatic satellite imagery. For a 625 km2 subarea of the Yukon Flats, our time series…

The accurate measurement of suspended particulate matter (SPM) concentrations in coastal waters is of crucial importance for ecosystem studies, sediment transport monitoring, and assessment of anthropogenic impacts in the coastal ocean. Ocean color remote sensing is an efficient tool to monitor SPM spatio-temporal variability in coastal waters. However, near-shore satellite images are complex to correct for atmospheric effects due to the proximity of land and to the high level of reflectance caused by high SPM concentrations in the visible and near-infrared spectral regions. The water reflectance signal (ρw) tends to saturate at short visible wavelengths when the SPM concentration increases. Using a comprehensive dataset of high-resolution satellite imagery and in situ SPM and water reflectance data, this study presents (i) an assessment of existing atmospheric correction (AC) algorithms developed for turbid coastal waters; and (ii) a switching method that automatically selects the most sensitive SPM vs. ρw relationship, to avoid saturation effects when computing the SPM…

Supervised classification systems used for land cover mapping require accurate reference databases. These reference data come generally from different sources such as field measurements, thematic maps, or aerial photographs. Due to misregistration, update delay, or land cover complexity, they may contain class label noise, i.e., a wrong label assignment. This study aims at evaluating the impact of mislabeled training data on classification performances for land cover mapping. Particularly, it addresses the random and systematic label noise problem for the classification of high resolution satellite image time series. Experiments are carried out on synthetic and real datasets with two traditional classifiers: Support Vector Machines (SVM) and Random Forests (RF). A synthetic dataset has been designed for this study, simulating vegetation profiles over one year. The real dataset is composed of Landsat-8 and SPOT-4 images acquired during one year in the south of France. The results show that both classifiers are little influenced for low random noise levels up to 25%–30%, but their…

Sentinel-2 images are expected to improve global crop monitoring even in challenging tropical small agricultural systems that are characterized by high intra- and inter-field spatial variability and where satellite observations are disturbed by the presence of clouds. To overcome these constraints, we analyzed and optimized the performance of a combined Random Forest (RF) classifier/object-based approach and applied it to multisource satellite data to produce land use maps of a smallholder agricultural zone in Madagascar at five different nomenclature levels. The RF classifier was first optimized by reducing the number of input variables. Experiments were then carried out to (i) test cropland masking prior to the classification of more detailed nomenclature levels, (ii) analyze the importance of each data source (a high spatial resolution (HSR) time series, a very high spatial resolution (VHSR) coverage and a digital elevation model (DEM)) and data type (spectral, textural or other), and (iii) quantify their contributions to classification accuracy levels. The results show that RF…

Flavescence dorée is a grapevine disease affecting European vineyards which has severe economic consequences and containing its spread is therefore considered as a major challenge for viticulture. Flavescence dorée is subject to mandatory pest control including removal of the infected vines and, in this context, automatic detection of Flavescence dorée symptomatic vines by unmanned aerial vehicle (UAV) remote sensing could constitute a key diagnosis instrument for growers. The objective of this paper is to evaluate the feasibility of discriminating the Flavescence dorée symptoms in red and white cultivars from healthy vine vegetation using UAV multispectral imagery. Exhaustive ground truth data and UAV multispectral imagery (visible and near-infrared domain) have been acquired in September 2015 over four selected vineyards in Southwest France. Spectral signatures of healthy and symptomatic plants were studied with a set of 20 variables computed from the UAV images (spectral bands, vegetation indices and biophysical parameters) using univariate and multivariate classification…

Semantic segmentation is a fundamental task in remote sensing image processing. The large appearance variations of ground objects make this task quite challenging. Recently, deep convolutional neural networks (DCNNs) have shown outstanding performance in this task. A common strategy of these methods (e.g., SegNet) for performance improvement is to combine the feature maps learned at different DCNN layers. However, such a combination is usually implemented via feature map summation or concatenation, indicating that the features are considered indiscriminately. In fact, features at different positions contribute differently to the final performance. It is advantageous to automatically select adaptive features when merging different-layer feature maps. To achieve this goal, we propose a gated convolutional neural network to fulfill this task. Specifically, we explore the relationship between the information entropy of the feature maps and the label-error map, and then a gate mechanism is embedded to integrate the feature maps more effectively. The gate is implemented by the entropy…

Learning powerful feature representations for image retrieval has always been a challenging task in the field of remote sensing. Traditional methods focus on extracting low-level hand-crafted features which are not only time-consuming but also tend to achieve unsatisfactory performance due to the complexity of remote sensing images. In this paper, we investigate how to extract deep feature representations based on convolutional neural networks (CNNs) for high-resolution remote sensing image retrieval (HRRSIR). To this end, several effective schemes are proposed to generate powerful feature representations for HRRSIR. In the first scheme, a CNN pre-trained on a different problem is treated as a feature extractor since there are no sufficiently-sized remote sensing datasets to train a CNN from scratch. In the second scheme, we investigate learning features that are specific to our problem by first fine-tuning the pre-trained CNN on a remote sensing dataset and then proposing a novel CNN architecture based on convolutional layers and a three-layer perceptron. The novel CNN has fewer…

Recently, several methods have been introduced and applied to estimate daily air surface temperature (Ta) using MODIS land surface temperature data (MODIS LST). Among these methods, the most common used method is statistical modeling, and the most applied algorithms are linear/multiple linear regression models (LM). There are only a handful of studies using machine learning algorithm models such as random forest (RF) or cubist regression (CB). In particular, there is no study comparing different combinations of four MODIS LST datasets with or without auxiliary data using different algorithms such as multiple linear regression, random forest, and cubist regression for daily Ta-max, Ta-min, and Ta-mean estimation. Our study examines the mentioned combinations of four MODIS-LST datasets and shows that different combinations and differently applied algorithms produce various Ta estimation accuracies. Additional analysis of daily data from three climate stations in the mountain area of North West of Vietnam for the period of five years (2009 to 2013) with four MODIS LST datasets (AQUA…