The 100 most-cited articles in Remote Sensing, 2018

The surface urban heat island (SUHI), which represents the difference of land surface temperature (LST) in urban relativity to neighboring non-urban surfaces, is usually measured using satellite LST data. Over the last few decades, advancements of remote sensing along with spatial science have considerably increased the number and quality of SUHI studies that form the major body of the urban heat island (UHI) literature. This paper provides a systematic review of satellite-based SUHI studies, from their origin in 1972 to the present. We find an exponentially increasing trend of SUHI research since 2005, with clear preferences for geographic areas, time of day, seasons, research foci, and platforms/sensors. The most frequently studied region and time period of research are China and summer daytime, respectively. Nearly two-thirds of the studies focus on the SUHI/LST variability at a local scale. The Landsat Thematic Mapper (TM)/Enhanced Thematic Mapper (ETM+)/Thermal Infrared Sensor (TIRS) and Terra/Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) are the two most…

Environmental monitoring plays a central role in diagnosing climate and management impacts on natural and agricultural systems, enhancing the understanding hydrological processes, optimizing the allocation and distribution of water resources, and assessing, forecasting and even preventing natural disasters. Nowadays, most monitoring and data collection systems are based upon a combination of ground-based measurements, manned airborne sensors or satellite observations. These data are utilized in describing both small and large scale processes, but have spatiotemporal constraints inherent to each respective collection system. Bridging the unique spatial and temporal divides that limit current monitoring platforms is key to improving our understanding of environmental systems. In this context, Unmanned Aerial Systems (UAS) have considerable potential to radically evolve environmental monitoring. UAS-mounted sensors offer an extraordinary opportunity to bridge the existing gap between field observations and traditional air- and space-borne remote sensing, by providing not just high…

The Google Earth Engine (GEE) portal provides enhanced opportunities for undertaking earth observation studies. Established towards the end of 2010, it provides access to satellite and other ancillary data, cloud computing, and algorithms for processing large amounts of data with relative ease. However, the uptake and usage of the opportunity remains varied and unclear. This study was undertaken to investigate the usage patterns of the Google Earth Engine platform and whether researchers in developing countries were making use of the opportunity. Analysis of published literature showed that a total of 300 journal papers were published between 2011 and June 2017 that used GEE in their research, spread across 158 journals. The highest number of papers were in the journal Remote Sensing, followed by Remote Sensing of Environment. There were also a number of papers in premium journals such as Nature and Science. The application areas were quite varied, ranging from forest and vegetation studies to medical fields such as malaria. Landsat was the most widely used dataset; it is the…

This study presents a new global baseline of mangrove extent for 2010 and has been released as the first output of the Global Mangrove Watch (GMW) initiative. This is the first study to apply a globally consistent and automated method for mapping mangroves, identifying a global extent of 137,600 km 2 . The overall accuracy for mangrove extent was 94.0% with a 99% likelihood that the true value is between 93.6–94.5%, using 53,878 accuracy points across 20 sites distributed globally. Using the geographic regions of the Ramsar Convention on Wetlands, Asia has the highest proportion of mangroves with 38.7% of the global total, while Latin America and the Caribbean have 20.3%, Africa has 20.0%, Oceania has 11.9%, North America has 8.4% and the European Overseas Territories have 0.7%. The methodology developed is primarily based on the classification of ALOS PALSAR and Landsat sensor data, where a habitat mask was first generated, within which the classification of mangrove was undertaken using the Extremely Randomized Trees classifier. This new globally consistent baseline will also form…

In the last 10 years, development in robotics, computer vision, and sensor technology has provided new spectral remote sensing tools to capture unprecedented ultra-high spatial and high spectral resolution with unmanned aerial vehicles (UAVs). This development has led to a revolution in geospatial data collection in which not only few specialist data providers collect and deliver remotely sensed data, but a whole diverse community is potentially able to gather geospatial data that fit their needs. However, the diversification of sensing systems and user applications challenges the common application of good practice procedures that ensure the quality of the data. This challenge can only be met by establishing and communicating common procedures that have had demonstrated success in scientific experiments and operational demonstrations. In this review, we evaluate the state-of-the-art methods in UAV spectral remote sensing and discuss sensor technology, measurement procedures, geometric processing, and radiometric calibration based on the literature and more than a decade of…

The LandTrendr (LT) algorithm has been used widely for analysis of change in Landsat spectral time series data, but requires significant pre-processing, data management, and computational resources, and is only accessible to the community in a proprietary programming language (IDL). Here, we introduce LT for the Google Earth Engine (GEE) platform. The GEE platform simplifies pre-processing steps, allowing focus on the translation of the core temporal segmentation algorithm. Temporal segmentation involved a series of repeated random access calls to each pixel’s time series, resulting in a set of breakpoints (“vertices”) that bound straight-line segments. The translation of the algorithm into GEE included both transliteration and code analysis, resulting in improvement and logic error fixes. At six study areas representing diverse land cover types across the U.S., we conducted a direct comparison of the new LT-GEE code against the heritage code (LT-IDL). The algorithms agreed in most cases, and where disagreements occurred, they were largely attributable to logic error fixes in the…

Ship detection has been playing a significant role in the field of remote sensing for a long time, but it is still full of challenges. The main limitations of traditional ship detection methods usually lie in the complexity of application scenarios, the difficulty of intensive object detection, and the redundancy of the detection region. In order to solve these problems above, we propose a framework called Rotation Dense Feature Pyramid Networks (R-DFPN) which can effectively detect ships in different scenes including ocean and port. Specifically, we put forward the Dense Feature Pyramid Network (DFPN), which is aimed at solving problems resulting from the narrow width of the ship. Compared with previous multiscale detectors such as Feature Pyramid Network (FPN), DFPN builds high-level semantic feature-maps for all scales by means of dense connections, through which feature propagation is enhanced and feature reuse is encouraged. Additionally, in the case of ship rotation and dense arrangement, we design a rotation anchor strategy to predict the minimum circumscribed rectangle of…

Satellite time series with high spatial resolution is critical for monitoring land surface dynamics in heterogeneous landscapes. Although remote sensing technologies have experienced rapid development in recent years, data acquired from a single satellite sensor are often unable to satisfy our demand. As a result, integrated use of data from different sensors has become increasingly popular in the past decade. Many spatiotemporal data fusion methods have been developed to produce synthesized images with both high spatial and temporal resolutions from two types of satellite images, frequent coarse-resolution images, and sparse fine-resolution images. These methods were designed based on different principles and strategies, and therefore show different strengths and limitations. This diversity brings difficulties for users to choose an appropriate method for their specific applications and data sets. To this end, this review paper investigates literature on current spatiotemporal data fusion methods, categorizes existing methods, discusses the principal laws underlying these methods,…

To improve the detection ability of infrared small targets in complex backgrounds, a novel method based on non-convex rank approximation minimization joint l2,1 norm (NRAM) was proposed. Due to the defects of the nuclear norm and l1 norm, the state-of-the-art infrared image-patch (IPI) model usually leaves background residuals in the target image. To fix this problem, a non-convex, tighter rank surrogate and weighted l1 norm are instead utilized, which can suppress the background better while preserving the target efficiently. Considering that many state-of-the-art methods are still unable to fully suppress sparse strong edges, the structured l2,1 norm was introduced to wipe out the strong residuals. Furthermore, with the help of exploiting the structured norm and tighter rank surrogate, the proposed model was more robust when facing various complex or blurry scenes. To solve this non-convex model, an efficient optimization algorithm based on alternating direction method of multipliers (ADMM) plus difference of convex (DC) programming was designed. Extensive experimental results…

Data that have been processed to allow analysis with a minimum of additional user effort are often referred to as Analysis Ready Data (ARD). The ability to perform large scale Landsat analysis relies on the ability to access observations that are geometrically and radiometrically consistent, and have had non-target features (clouds) and poor quality observations flagged so that they can be excluded. The United States Geological Survey (USGS) has processed all of the Landsat 4 and 5 Thematic Mapper (TM), Landsat 7 Enhanced Thematic Mapper Plus (ETM+), Landsat 8 Operational Land Imager (OLI) and Thermal Infrared Sensor (TIRS) archive over the conterminous United States (CONUS), Alaska, and Hawaii, into Landsat ARD. The ARD are available to significantly reduce the burden of pre-processing on users of Landsat data. Provision of pre-prepared ARD is intended to make it easier for users to produce Landsat-based maps of land cover and land-cover change and other derived geophysical and biophysical products. The ARD are provided as tiled, georegistered, top of atmosphere and atmospherically…

Very high resolution (VHR) remote sensing imagery has been used for land cover classification, and it tends to a transition from land-use classification to pixel-level semantic segmentation. Inspired by the recent success of deep learning and the filter method in computer vision, this work provides a segmentation model, which designs an image segmentation neural network based on the deep residual networks and uses a guided filter to extract buildings in remote sensing imagery. Our method includes the following steps: first, the VHR remote sensing imagery is preprocessed and some hand-crafted features are calculated. Second, a designed deep network architecture is trained with the urban district remote sensing image to extract buildings at the pixel level. Third, a guided filter is employed to optimize the classification map produced by deep learning; at the same time, some salt-and-pepper noise is removed. Experimental results based on the Vaihingen and Potsdam datasets demonstrate that our method, which benefits from neural networks and guided filtering, achieves a higher overall…

For agronomic, environmental, and economic reasons, the need for spatialized information about agricultural practices is expected to rapidly increase. In this context, we reviewed the literature on remote sensing for mapping cropping practices. The reviewed studies were grouped into three categories of practices: crop succession (crop rotation and fallowing), cropping pattern (single tree crop planting pattern, sequential cropping, and intercropping/agroforestry), and cropping techniques (irrigation, soil tillage, harvest and post-harvest practices, crop varieties, and agro-ecological infrastructures). We observed that the majority of the studies were exploratory investigations, tested on a local scale with a high dependence on ground data, and used only one type of remote sensing sensor. Furthermore, to be correctly implemented, most of the methods relied heavily on local knowledge on the management practices, the environment, and the biological material. These limitations point to future research directions, such as the use of land stratification, multi-sensor data combination,…

Despite recent advances of deep Convolutional Neural Networks (CNNs) in various computer vision tasks, their potential for classification of multispectral remote sensing images has not been thoroughly explored. In particular, the applications of deep CNNs using optical remote sensing data have focused on the classification of very high-resolution aerial and satellite data, owing to the similarity of these data to the large datasets in computer vision. Accordingly, this study presents a detailed investigation of state-of-the-art deep learning tools for classification of complex wetland classes using multispectral RapidEye optical imagery. Specifically, we examine the capacity of seven well-known deep convnets, namely DenseNet121, InceptionV3, VGG16, VGG19, Xception, ResNet50, and InceptionResNetV2, for wetland mapping in Canada. In addition, the classification results obtained from deep CNNs are compared with those based on conventional machine learning tools, including Random Forest and Support Vector Machine, to further evaluate the efficiency of the former to classify wetlands.…

The geometrical accuracy of georeferenced digital surface models (DTM) obtained from images captured by micro-UAVs and processed by using structure from motion (SfM) photogrammetry depends on several factors, including flight design, camera quality, camera calibration, SfM algorithms and georeferencing strategy. This paper focusses on the critical role of the number and location of ground control points (GCP) used during the georeferencing stage. A challenging case study involving an area of 1200+ ha, 100+ GCP and 2500+ photos was used. Three thousand, four hundred and sixty-five different combinations of control points were introduced in the bundle adjustment, whilst the accuracy of the model was evaluated using both control points and independent check points. The analysis demonstrates how much the accuracy improves as the number of GCP points increases, as well as the importance of an even distribution, how much the accuracy is overestimated when it is quantified only using control points rather than independent check points, and how the ground sample distance (GSD) of a project…

Crop monitoring is of great importance for e.g., yield prediction and increasing water use efficiency. The Copernicus Sentinel-1 mission operated by the European Space Agency provides the opportunity to monitor Earth’s surface using radar at high spatial and temporal resolution. Sentinel-1’s Synthetic Aperture Radar provides co- and cross-polarized backscatter, enabling the calculation of microwave indices. In this study, we assess the potential of Sentinel-1 VV and VH backscatter and their ratio VH/VV, the cross ratio (CR), to monitor crop conditions. A quantitative assessment is provided based on in situ reference data of vegetation variables for different crops under varying meteorological conditions. Vegetation Water Content (VWC), biomass, Leaf Area Index (LAI) and height are measured in situ for oilseed-rape, corn and winter cereals at different fields during two growing seasons. To quantify the sensitivity of backscatter and microwave indices to vegetation dynamics, linear and exponential models and machine learning methods have been applied to the Sentinel-1 data and in situ…

This study describes a novel three-dimensional (3D) convolutional neural networks (CNN) based method that automatically classifies crops from spatio-temporal remote sensing images. First, 3D kernel is designed according to the structure of multi-spectral multi-temporal remote sensing data. Secondly, the 3D CNN framework with fine-tuned parameters is designed for training 3D crop samples and learning spatio-temporal discriminative representations, with the full crop growth cycles being preserved. In addition, we introduce an active learning strategy to the CNN model to improve labelling accuracy up to a required threshold with the most efficiency. Finally, experiments are carried out to test the advantage of the 3D CNN, in comparison to the two-dimensional (2D) CNN and other conventional methods. Our experiments show that the 3D CNN is especially suitable in characterizing the dynamics of crop growth and outperformed the other mainstream methods.

Recent research shows that deep-learning-derived methods based on a deep convolutional neural network have high accuracy when applied to hyperspectral image (HSI) classification, but long training times. To reduce the training time and improve accuracy, in this paper we propose an end-to-end fast dense spectral–spatial convolution (FDSSC) framework for HSI classification. The FDSSC framework uses different convolutional kernel sizes to extract spectral and spatial features separately, and the “valid” convolution method to reduce the high dimensions. Densely-connected structures—the input of each convolution consisting of the output of all previous convolution layers—was used for deep learning of features, leading to extremely accurate classification. To increase speed and prevent overfitting, the FDSSC framework uses a dynamic learning rate, parametric rectified linear units, batch normalization, and dropout layers. These attributes enable the FDSSC framework to achieve accuracy within as few as 80 epochs. The experimental results show that with the Indian Pines, Kennedy Space…

Hyperspectral remote sensing is based on measuring the scattered and reflected electromagnetic signals from the Earth’s surface emitted by the Sun. The received radiance at the sensor is usually degraded by atmospheric effects and instrumental (sensor) noises which include thermal (Johnson) noise, quantization noise, and shot (photon) noise. Noise reduction is often considered as a preprocessing step for hyperspectral imagery. In the past decade, hyperspectral noise reduction techniques have evolved substantially from two dimensional bandwise techniques to three dimensional ones, and varieties of low-rank methods have been forwarded to improve the signal to noise ratio of the observed data. Despite all the developments and advances, there is a lack of a comprehensive overview of these techniques and their impact on hyperspectral imagery applications. In this paper, we address the following two main issues; (1) Providing an overview of the techniques developed in the past decade for hyperspectral image noise reduction; (2) Discussing the performance of these techniques by applying…

A timely inventory of agricultural areas and crop types is an essential requirement for ensuring global food security. Satellite remote sensing has proven to be an increasingly more reliable tool to identify crop types. With the Copernicus program and its Sentinel satellites, a growing source of satellite remote sensing data is publicly available at no charge. Here we use joint Sentinel-1 radar and Sentinel-2 optical imagery to create a crop map for Belgium. To ensure homogenous radar and optical input across the country, Sentinel-1 12-day backscatter composites were created after incidence angle normalization, and Sentinel-2 NDVI images were smoothed to yield dekadal cloud-free composites. An optimized random forest classifier predicted the 8 crop types with a maximum accuracy of 82% and a kappa coefficient of 0.77. We found that a combination of radar and optical imagery always outperformed a classification based on single-sensor inputs, and that classification performance increased throughout the season until July, when differences between crop types are largest. Furthermore we…

The Gravity Recovery and Climate Experiment (GRACE) satellite mission, which was in operation from March 2002 to June 2017, was the first remote sensing mission to provide temporal variations of Terrestrial Water Storage (TWS), which is the sum of the water masses that were contained in the soil column (i.e., snow, surface water, soil moisture, and groundwater), at a spatial resolution of a few hundred kilometers. As in situ level measurements are generally not sufficiently available for monitoring groundwater changes at the regional-scale, this unique dataset, combined with external information, is widely used to quantify the interannual variations of groundwater storage in the world’s major aquifers. GRACE-based groundwater changes revealed significant aquifer depletion over large regions, such as the Middle East, the northwest India aquifer, the North China Plain aquifer, the Murray-Darling Basin in Australia, the High Plains, and the California Central Valley aquifers in the United States of America (USA), but were also used to estimate groundwater-related parameters such as the…

Upcoming satellite hyperspectral sensors require powerful and robust methodologies for making optimum use of the rich spectral data. This paper reviews the widely applied coupled PROSPECT and SAIL radiative transfer models (PROSAIL), regarding their suitability for the retrieval of biophysical and biochemical variables in the context of agricultural crop monitoring. Evaluation was carried out using a systematic literature review of 281 scientific publications with regard to their (i) spectral exploitation, (ii) vegetation type analyzed, (iii) variables retrieved, and (iv) choice of retrieval methods. From the analysis, current trends were derived, and problems identified and discussed. Our analysis clearly shows that the PROSAIL model is well suited for the analysis of imaging spectrometer data from future satellite missions and that the model should be integrated in appropriate software tools that are being developed in this context for agricultural applications. The review supports the decision of potential users to employ PROSAIL for their specific data analysis and provides…

Wetlands are one of the most important ecosystems that provide a desirable habitat for a great variety of flora and fauna. Wetland mapping and modeling using Earth Observation (EO) data are essential for natural resource management at both regional and national levels. However, accurate wetland mapping is challenging, especially on a large scale, given their heterogeneous and fragmented landscape, as well as the spectral similarity of differing wetland classes. Currently, precise, consistent, and comprehensive wetland inventories on a national- or provincial-scale are lacking globally, with most studies focused on the generation of local-scale maps from limited remote sensing data. Leveraging the Google Earth Engine (GEE) computational power and the availability of high spatial resolution remote sensing data collected by Copernicus Sentinels, this study introduces the first detailed, provincial-scale wetland inventory map of one of the richest Canadian provinces in terms of wetland extent. In particular, multi-year summer Synthetic Aperture Radar (SAR) Sentinel-1 and optical…

In recent years, weeds have been responsible for most agricultural yield losses. To deal with this threat, farmers resort to spraying the fields uniformly with herbicides. This method not only requires huge quantities of herbicides but impacts the environment and human health. One way to reduce the cost and environmental impact is to allocate the right doses of herbicide to the right place and at the right time (precision agriculture). Nowadays, unmanned aerial vehicles (UAVs) are becoming an interesting acquisition system for weed localization and management due to their ability to obtain images of the entire agricultural field with a very high spatial resolution and at a low cost. However, despite significant advances in UAV acquisition systems, the automatic detection of weeds remains a challenging problem because of their strong similarity to the crops. Recently, a deep learning approach has shown impressive results in different complex classification problems. However, this approach needs a certain amount of training data, and creating large agricultural datasets with…

The ability to automatically monitor agricultural fields is an important capability in precision farming, enabling steps towards more sustainable agriculture. Precise, high-resolution monitoring is a key prerequisite for targeted intervention and the selective application of agro-chemicals. The main goal of this paper is developing a novel crop/weed segmentation and mapping framework that processes multispectral images obtained from an unmanned aerial vehicle (UAV) using a deep neural network (DNN). Most studies on crop/weed semantic segmentation only consider single images for processing and classification. Images taken by UAVs often cover only a few hundred square meters with either color only or color and near-infrared (NIR) channels. Although a map can be generated by processing single segmented images incrementally, this requires additional complex information fusion techniques which struggle to handle high fidelity maps due to their computational costs and problems in ensuring global consistency. Moreover, computing a single large and accurate vegetation map (e.g., crop/weed)…

In the last few decades, researchers have developed a plethora of hyperspectral Earth Observation (EO) remote sensing techniques, analysis and applications. While hyperspectral exploratory sensors are demonstrating their potential, Sentinel-2 multispectral satellite remote sensing is now providing free, open, global and systematic high resolution visible and infrared imagery at a short revisit time. Its recent launch suggests potential synergies between multi- and hyper-spectral data. This study, therefore, reviews 20 years of research and applications in satellite hyperspectral remote sensing through the analysis of Earth observation hyperspectral sensors’ publications that cover the Sentinel-2 spectrum range: Hyperion, TianGong-1, PRISMA, HISUI, EnMAP, Shalom, HyspIRI and HypXIM. More specifically, this study (i) brings face to face past and future hyperspectral sensors’ applications with Sentinel-2’s and (ii) analyzes the applications’ requirements in terms of spatial and temporal resolutions. Eight main application topics were analyzed including vegetation, agriculture, soil,…

The road network plays an important role in the modern traffic system; as development occurs, the road structure changes frequently. Owing to the advancements in the field of high-resolution remote sensing, and the success of semantic segmentation success using deep learning in computer version, extracting the road network from high-resolution remote sensing imagery is becoming increasingly popular, and has become a new tool to update the geospatial database. Considering that the training dataset of the deep convolutional neural network will be clipped to a fixed size, which lead to the roads run through each sample, and that different kinds of road types have different widths, this work provides a segmentation model that was designed based on densely connected convolutional networks (DenseNet) and introduces the local and global attention units. The aim of this work is to propose a novel road extraction method that can efficiently extract the road network from remote sensing imagery with local and global information. A dataset from Google Earth was used to validate the method, and…

Grapevine wood fungal diseases such as esca are among the biggest threats in vineyards nowadays. The lack of very efficient preventive (best results using commercial products report 20% efficiency) and curative means induces huge economic losses. The study presented in this paper is centered around the in-field detection of foliar esca symptoms during summer, exhibiting a typical “striped” pattern. Indeed, in-field disease detection has shown great potential for commercial applications and has been successfully used for other agricultural needs such as yield estimation. Differentiation with foliar symptoms caused by other diseases or abiotic stresses was also considered. Two vineyards from the Bordeaux region (France, Aquitaine) were chosen as the basis for the experiment. Pictures of diseased and healthy vine plants were acquired during summer 2017 and labeled at the leaf scale, resulting in a patch database of around 6000 images (224 × 224 pixels) divided into red cultivar and white cultivar samples. Then, we tackled the classification part of the problem comparing…

While deforestation rates decline globally they are rising in the Western Amazon. Artisanal-scale gold mining (ASGM) is a large cause of this deforestation and brings with it extensive environmental, social, governance, and public health impacts, including large carbon emissions and mercury pollution. Underlying ASGM is a broad network of factors that influence its growth, distribution, and practices such as poverty, flows of legal and illegal capital, conflicting governance, and global economic trends. Despite its central role in land use and land cover change in the Western Amazon and the severity of its social and environmental impacts, it is relatively poorly studied. While ASGM in Southeastern Peru has been quantified previously, doing so is difficult due to the heterogeneous nature of the resulting landscape. Using a novel approach to classify mining that relies on a fusion of CLASlite and the Global Forest Change dataset, two Landsat-based deforestation detection tools, we sought to quantify ASGM-caused deforestation in the period 1984–2017 in the southern Peruvian Amazon and…

Accurate and timely detection of weeds between and within crop rows in the early growth stage is considered one of the main challenges in site-specific weed management (SSWM). In this context, a robust and innovative automatic object-based image analysis (OBIA) algorithm was developed on Unmanned Aerial Vehicle (UAV) images to design early post-emergence prescription maps. This novel algorithm makes the major contribution. The OBIA algorithm combined Digital Surface Models (DSMs), orthomosaics and machine learning techniques (Random Forest, RF). OBIA-based plant heights were accurately estimated and used as a feature in the automatic sample selection by the RF classifier; this was the second research contribution. RF randomly selected a class balanced training set, obtained the optimum features values and classified the image, requiring no manual training, making this procedure time-efficient and more accurate, since it removes errors due to a subjective manual task. The ability to discriminate weeds was significantly affected by the imagery spatial resolution and weed density,…

The development and improvement of methods to map agricultural land cover are currently major challenges, especially for radar images. This is due to the speckle noise nature of radar, leading to a less intensive use of radar rather than optical images. The European Space Agency Sentinel-1 constellation, which recently became operational, is a satellite system providing global coverage of Synthetic Aperture Radar (SAR) with a 6-days revisit period at a high spatial resolution of about 20 m. These data are valuable, as they provide spatial information on agricultural crops. The aim of this paper is to provide a better understanding of the capabilities of Sentinel-1 radar images for agricultural land cover mapping through the use of deep learning techniques. The analysis is carried out on multitemporal Sentinel-1 data over an area in Camargue, France. The data set was processed in order to produce an intensity radar data stack from May 2017 to September 2017. We improved this radar time series dataset by exploiting temporal filtering to reduce noise, while retaining as much as…

The main objective of this research is to investigate the potential combination of Sentinel-2A and ALOS-2 PALSAR-2 (Advanced Land Observing Satellite -2 Phased Array type L-band Synthetic Aperture Radar-2) imagery for improving the accuracy of the Aboveground Biomass (AGB) measurement. According to the current literature, this kind of investigation has rarely been conducted. The Hyrcanian forest area (Iran) is selected as the case study. For this purpose, a total of 149 sample plots for the study area were documented through fieldwork. Using the imagery, three datasets were generated including the Sentinel-2A dataset, the ALOS-2 PALSAR-2 dataset, and the combination of the Sentinel-2A dataset and the ALOS-2 PALSAR-2 dataset (Sentinel-ALOS). Because the accuracy of the AGB estimation is dependent on the method used, in this research, four machine learning techniques were selected and compared, namely Random Forests (RF), Support Vector Regression (SVR), Multi-Layer Perceptron Neural Networks (MPL Neural Nets), and Gaussian Processes (GP). The performance of these AGB models was…

High-resolution Digital Surface Models (DSMs) from unmanned aerial vehicles (UAVs) imagery with accuracy better than 10 cm open new possibilities in geosciences and engineering. The accuracy of such DSMs depends on the number and distribution of ground control points (GCPs). Placing and measuring GCPs are often the most time-consuming on-site tasks in a UAV project. Safety or accessibility concerns may impede their proper placement, so either costlier techniques must be used, or a less accurate DSM is obtained. Photogrammetric blocks flown by drones with on-board receivers capable of RTK (real-time kinematic) positioning do not need GCPs, as camera stations at exposure time can be determined with cm-level accuracy, and used to georeference the block and control its deformations. This paper presents an experimental investigation on the repeatability of DSM generation from several blocks acquired with a RTK-enabled drone, where differential corrections were sent from a local master station or a network of Continuously Operating Reference Stations (CORS). Four different flights for…

Interest in statistical analysis of remote sensing data to produce measurements of environment, agriculture, and sustainable development is established and continues to increase, and this is leading to a growing interaction between the earth science and statistical domains. With this in mind, we reviewed the literature on statistical machine learning methods commonly applied to remote sensing data. We focus particularly on applications related to the United Nations World Bank Sustainable Development Goals, including agriculture (food security), forests (life on land), and water (water quality). We provide a review of useful statistical machine learning methods, how they work in a remote sensing context, and examples of their application to these types of data in the literature. Rather than prescribing particular methods for specific applications, we provide guidance, examples, and case studies from the literature for the remote sensing practitioner and applied statistician. In the supplementary material, we also describe the necessary steps pre and post analysis for remote sensing…

Mangroves are one of the most important coastal wetland ecosystems, and the compositions and distributions of mangrove species are essential for conservation and restoration efforts. Many studies have explored this topic using remote sensing images that were obtained by satellite-borne and airborne sensors, which are known to be efficient for monitoring the mangrove ecosystem. With improvements in carrier platforms and sensor technology, unmanned aerial vehicles (UAVs) with high-resolution hyperspectral images in both spectral and spatial domains have been used to monitor crops, forests, and other landscapes of interest. This study aims to classify mangrove species on Qi’ao Island using object-based image analysis techniques based on UAV hyperspectral images obtained from a commercial hyperspectral imaging sensor (UHD 185) onboard a UAV platform. First, the image objects were obtained by segmenting the UAV hyperspectral image and the UAV-derived digital surface model (DSM) data. Second, spectral features, textural features, and vegetation indices (VIs) were extracted from the UAV…

The Sentinel-2 program provides the opportunity to monitor terrestrial ecosystems with a high temporal and spectral resolution. In this study, a multi-temporal Sentinel-2 data set was used to classify common tree species over a mature forest in central Sweden. The tree species to be classified were Norway spruce (Picea abies), Scots pine (Pinus silvestris), Hybrid larch (Larix × marschlinsii), Birch (Betula sp.) and Pedunculate oak (Quercus robur). Four Sentinel-2 images from spring (7 April and 27 May), summer (9 July) and fall (19 October) of 2017 were used along with the Random Forest (RF) classifier. A variable selection approach was implemented to find fewer and uncorrelated bands resulting in the best model for tree species identification. The final model resulting in the highest overall accuracy (88.2%) came from using all bands from the four image dates. The single image that gave the most accurate classification result (80.5%) was the late spring image (27 May); the 27 May image was always included in subsequent image combinations that gave the highest overall accuracy. The…

The European Parliament and The Council of the European Union have established the Water Framework Directive (2000/60/EC) for all European Union member states to achieve, at least, “good” ecological status of all water bodies larger than 50 hectares in Europe. The MultiSpectral Instrument onboard European Space Agency satellite Sentinel-2 has suitable 10, 20, 60 m spatial resolution to monitor most of the Estonian lakes as required by the Water Framework Directive. The study aims to analyze the suitability of Sentinel-2 MultiSpectral Instrument data to monitor water quality in inland waters. This consists of testing various atmospheric correction processors to remove the influence of atmosphere and comparing and developing chlorophyll a algorithms to estimate the ecological status of water in Estonian lakes. This study shows that the Sentinel-2 MultiSpectral Instrument is suitable for estimating chlorophyll a in water bodies and tracking the spatial and temporal dynamics in the lakes. However, atmospheric corrections are sensitive to surrounding land and often fail in narrow and…

We estimate global terrestrial gross primary production (GPP) based on models that use satellite data within a simplified light-use efficiency framework that does not rely upon other meteorological inputs. Satellite-based geometry-adjusted reflectances are from the MODerate-resolution Imaging Spectroradiometer (MODIS) and provide information about vegetation structure and chlorophyll content at both high temporal (daily to monthly) and spatial (∼1 km) resolution. We use satellite-derived solar-induced fluorescence (SIF) to identify regions of high productivity crops and also evaluate the use of downscaled SIF to estimate GPP. We calibrate a set of our satellite-based models with GPP estimates from a subset of distributed eddy covariance flux towers (FLUXNET 2015). The results of the trained models are evaluated using an independent subset of FLUXNET 2015 GPP data. We show that variations in light-use efficiency (LUE) with incident PAR are important and can be easily incorporated into the models. Unlike many LUE-based models, our satellite-based GPP estimates do not use an explicit…

Satellite remote sensing is a powerful tool to map flooded areas. In recent years, the availability of free satellite data significantly increased in terms of type and frequency, allowing the production of flood maps at low cost around the world. In this work, we propose a semi-automatic method for flood mapping, based only on free satellite images and open-source software. The proposed methods are suitable to be applied by the community involved in flood hazard management, not necessarily experts in remote sensing processing. As case studies, we selected three flood events that recently occurred in Spain and Italy. Multispectral satellite data acquired by MODIS, Proba-V, Landsat, and Sentinel-2 and synthetic aperture radar (SAR) data collected by Sentinel-1 were used to detect flooded areas using different methodologies (e.g., Modified Normalized Difference Water Index, SAR backscattering variation, and supervised classification). Then, we improved and manually refined the automatic mapping using free ancillary data such as the digital elevation model-based water depth model and…

Efforts are increasingly being made to classify the world’s wetland resources, an important ecosystem and habitat that is diminishing in abundance. There are multiple remote sensing classification methods, including a suite of nonparametric classifiers such as decision-tree (DT), rule-based (RB), and random forest (RF). High-resolution satellite imagery can provide more specificity to the classified end product, and ancillary data layers such as the Normalized Difference Vegetation Index, and hydrogeomorphic layers such as distance-to-a-stream can be coupled to improve overall accuracy (OA) in wetland studies. In this paper, we contrast three nonparametric machine-learning algorithms (DT, RB, and RF) using a large field-based dataset (n = 228) from the Selenga River Delta of Lake Baikal, Russia. We also explore the use of ancillary data layers selected to improve OA, with a goal of providing end users with a recommended classifier to use and the most parsimonious suite of input parameters for classifying wetland-dominated landscapes. Though all classifiers appeared suitable, the RF…

In this paper, to break the limit of the traditional linear models for synthetic aperture radar (SAR) image despeckling, we propose a novel deep learning approach by learning a non-linear end-to-end mapping between the noisy and clean SAR images with a dilated residual network (SAR-DRN). SAR-DRN is based on dilated convolutions, which can both enlarge the receptive field and maintain the filter size and layer depth with a lightweight structure. In addition, skip connections and a residual learning strategy are added to the despeckling model to maintain the image details and reduce the vanishing gradient problem. Compared with the traditional despeckling methods, the proposed method shows a superior performance over the state-of-the-art methods in both quantitative and visual assessments, especially for strong speckle noise.

Accurately quantifying surface water extent in wetlands is critical to understanding their role in ecosystem processes. However, current regional- to global-scale surface water products lack the spatial or temporal resolution necessary to characterize heterogeneous or variable wetlands. Here, we proposed a fully automatic classification tree approach to classify surface water extent using Sentinel-1 synthetic aperture radar (SAR) data and training datasets derived from prior class masks. Prior classes of water and non-water were generated from the Shuttle Radar Topography Mission (SRTM) water body dataset (SWBD) or composited dynamic surface water extent (cDSWE) class probabilities. Classification maps of water and non-water were derived over two distinct wetlandscapes: the Delmarva Peninsula and the Prairie Pothole Region. Overall classification accuracy ranged from 79% to 93% when compared to high-resolution images in the Prairie Pothole Region site. Using cDSWE class probabilities reduced omission errors among water bodies by 10% and commission errors among non-water class by 4%…

Reliable information about the spatial distribution of surface waters is critically important in various scientific disciplines. Synthetic Aperture Radar (SAR) is an effective way to detect floods and monitor water bodies over large areas. Sentinel-1 is a new available SAR and its spatial resolution and short temporal baselines have the potential to facilitate the monitoring of surface water changes, which are dynamic in space and time. While several methods and tools for flood detection and surface water extraction already exist, they often comprise a significant manual user interaction and do not specifically target the exploitation of Sentinel-1 data. The existing methods commonly rely on thresholding at the level of individual pixels, ignoring the correlation among nearby pixels. Thus, in this paper, we propose a fully automatic processing chain for rapid flood and surface water mapping with smooth labeling based on Sentinel-1 amplitude data. The method is applied to three different sites submitted to recent flooding events. The quantitative evaluation shows relevant results…

Bathymetry mapping forms the basis of understanding physical, economic, and ecological processes in the vastly biodiverse coastal fringes of our planet which are subjected to constant anthropogenic pressure. Here, we pair recent advances in cloud computing using the geospatial platform of the Google Earth Engine (GEE) with optical remote sensing technology using the open Sentinel-2 archive, obtaining low-cost in situ collected data to develop an empirical preprocessing workflow for estimating satellite-derived bathymetry (SDB). The workflow implements widely used and well-established algorithms, including cloud, atmospheric, and sun glint corrections, image composition and radiometric normalisation to address intra- and inter-image interferences before training, and validation of four SDB algorithms in three sites of the Aegean Sea in the Eastern Mediterranean. Best accuracy values for training and validation were R2 = 0.79, RMSE = 1.39 m, and R2 = 0.9, RMSE = 1.67 m, respectively. The increased accuracy highlights the importance of the radiometric normalisation given spatially…

The Atmospheric Correction Inter-comparison eXercise (ACIX) is an international initiative with the aim to analyse the Surface Reflectance (SR) products of various state-of-the-art atmospheric correction (AC) processors. The Aerosol Optical Thickness (AOT) and Water Vapour (WV) are also examined in ACIX as additional outputs of an AC processing. In this paper, the general ACIX framework is discussed; special mention is made of the motivation to initiate this challenge, the inter-comparison protocol and the principal results. ACIX is free and open and every developer was welcome to participate. Eventually, 12 participants applied their approaches to various Landsat-8 and Sentinel-2 image datasets acquired over sites around the world. The current results diverge depending on the sensors, products and sites, indicating their strengths and weaknesses. Indeed, this first implementation of processor inter-comparison was proven to be a good lesson for the developers to learn the advantages and limitations of their approaches. Various algorithm improvements are expected, if not already…

Triggered by earthquakes, rainfall, or anthropogenic activities, landslides represent widespread and problematic geohazards worldwide. In recent years, multiple remote sensing techniques, including synthetic aperture radar, optical, and light detection and ranging measurements from spaceborne, airborne, and ground-based platforms, have been widely applied for the analysis of landslide processes. Current techniques include landslide detection, inventory mapping, surface deformation monitoring, trigger factor analysis and mechanism inversion. In addition, landslide susceptibility modelling, hazard assessment, and risk evaluation can be further analyzed using a synergic fusion of multiple remote sensing data and other factors affecting landslides. We summarize the 19 articles collected in this special issue of Remote Sensing of Landslide, in the terms of data, methods and applications used in the papers.

The mobile laser scanning (MLS) technique has attracted considerable attention for providing high-density, high-accuracy, unstructured, three-dimensional (3D) geo-referenced point-cloud coverage of the road environment. Recently, there has been an increasing number of applications of MLS in the detection and extraction of urban objects. This paper presents a systematic review of existing MLS related literature. This paper consists of three parts. Part 1 presents a brief overview of the state-of-the-art commercial MLS systems. Part 2 provides a detailed analysis of on-road and off-road information inventory methods, including the detection and extraction of on-road objects (e.g., road surface, road markings, driving lines, and road crack) and off-road objects (e.g., pole-like objects and power lines). Part 3 presents a refined integrated analysis of challenges and future trends. Our review shows that MLS technology is well proven in urban object detection and extraction, since the improvement of hardware and software accelerate the efficiency and accuracy of data collection and…

Enhancing the spatial resolution of hyperspectral image (HSI) is of significance for applications. Fusing HSI with a high resolution (HR) multispectral image (MSI) is an important technology for HSI enhancement. Inspired by the success of deep learning in image enhancement, in this paper, we propose a HSI-MSI fusion method by designing a deep convolutional neural network (CNN) with two branches which are devoted to features of HSI and MSI. In order to exploit spectral correlation and fuse the MSI, we extract the features from the spectrum of each pixel in low resolution HSI, and its corresponding spatial neighborhood in MSI, with the two CNN branches. The extracted features are then concatenated and fed to fully connected (FC) layers, where the information of HSI and MSI could be fully fused. The output of the FC layers is the spectrum of the expected HR HSI. In the experiment, we evaluate the proposed method on Airborne Visible Infrared Imaging Spectrometer (AVIRIS), and Environmental Mapping and Analysis Program (EnMAP) data. We also apply it to real Hyperion-Sentinel data fusion.…

The main purpose of this study was to produce landslide susceptibility maps using various ensemble-based machine learning models (i.e., the AdaBoost, LogitBoost, Multiclass Classifier, and Bagging models) for the Sacheon-myeon area of South Korea. A landslide inventory map including a total of 762 landslides was compiled based on reports and aerial photograph interpretations. The landslides were randomly separated into two datasets: 70% of landslides were selected for the model establishment and 30% were used for validation purposes. Additionally, 20 landslide condition factors divided into five categories (topographic factors, hydrological factors, soil map, geological map, and forest map) were considered in the landslide susceptibility mapping. The relationships among landslide occurrence and landslide conditioning factors were analyzed and the landslide susceptibility maps were calculated and drawn using the AdaBoost, LogitBoost, Multiclass Classifier, and Bagging models. Finally, the maps were validated using the area under the curve (AUC) method. The Multiclass Classifier…

In this paper, we review the use of satellite-based remote sensing in combination with in situ data to inform Earth surface modelling. This involves verification and optimization methods that can handle both random and systematic errors and result in effective model improvement for both surface monitoring and prediction applications. The reasons for diverse remote sensing data and products include (i) their complementary areal and temporal coverage, (ii) their diverse and covariant information content, and (iii) their ability to complement in situ observations, which are often sparse and only locally representative. To improve our understanding of the complex behavior of the Earth system at the surface and sub-surface, we need large volumes of data from high-resolution modelling and remote sensing, since the Earth surface exhibits a high degree of heterogeneity and discontinuities in space and time. The spatial and temporal variability of the biosphere, hydrosphere, cryosphere and anthroposphere calls for an increased use of Earth observation (EO) data attaining volumes previously…

Nowadays, emerging technologies, such as long-range transmitters, increasingly miniaturized components for positioning, and enhanced imaging sensors, have led to an upsurge in the availability of new ecological applications for remote sensing based on unmanned aerial vehicles (UAVs), sometimes referred to as “drones”. In fact, structure-from-motion (SfM) photogrammetry coupled with imagery acquired by UAVs offers a rapid and inexpensive tool to produce high-resolution orthomosaics, giving ecologists a new way for responsive, timely, and cost-effective monitoring of ecological processes. Here, we adopted a lightweight quadcopter as an aerial survey tool and object-based image analysis (OBIA) workflow to demonstrate the strength of such methods in producing very high spatial resolution maps of sensitive marine habitats. Therefore, three different coastal environments were mapped using the autonomous flight capability of a lightweight UAV equipped with a fully stabilized consumer-grade RGB digital camera. In particular we investigated a Posidonia oceanica seagrass meadow, a rocky coast…

Unmanned aerial system (UAS)-based remote sensing is one promising technique for precision crop management, but few studies have reported the applications of such systems on nitrogen (N) estimation with multiple sensors in rice (Oryza sativa L.). This study aims to evaluate three sensors (RGB, color-infrared (CIR) and multispectral (MS) cameras) onboard UAS for the estimation of N status at individual stages and their combination with the field data collected from a two-year rice experiment. The experiments were conducted in 2015 and 2016, involving different N rates, planting densities and rice cultivars, with three replicates. An Oktokopter UAS was used to acquire aerial photography at early growth stages (from tillering to booting) and field samplings were taken at a near date. Two color indices (normalized excess green index (NExG), and normalized green red difference index (NGRDI)), two near infrared vegetation indices (green normalized difference vegetation index (GNDVI), and enhanced NDVI (ENDVI)) and two red edge vegetation indices (red edge chlorophyll index (CIred edge),…

Groundwater plays a critical role in the global water cycle and is the drinking source for almost half of the world’s population. However, exact quantification of its storage change remains elusive due primarily to limited ground observations in space and time. The Gravity Recovery and Climate Experiment (GRACE) twin-satellite data have provided global observations of water storage variations at monthly sampling for over a decade and a half, and is enable to estimate changes in groundwater storage (GWS) after removing other water storage components using auxiliary datasets and models. In this paper, we present an overview of GWS changes in three main aquifers within China using GRACE data, and conduct a comprehensive accuracy assessment using in situ ground well observations and hydrological models. GRACE detects a significant GWS depletion rate of 7.2 ± 1.1 km3/yr in the North China Plain (NCP) during 2002–2014, consistent with ground well observations and model predictions. The Liaohe River Basin (LRB) experienced a pronounced GWS decline during 2005–2009, at a depletion rate of…

In the last few decades the magnitude and impacts of planetary urban transformations have become increasingly evident to scientists and policymakers. The ability to understand these processes remained limited in terms of territorial scope and comparative capacity for a long time: data availability and harmonization were among the main constraints. Contemporary technological assets, such as remote sensing and machine learning, allow for analyzing global changes in the settlement process with unprecedented detail. The Global Human Settlement Layer (GHSL) project set out to produce detailed datasets to analyze and monitor the spatial footprint of human settlements and their population, which are key indicators for the global policy commitments of the 2030 Development Agenda. In the GHSL, Earth Observation plays a key role in the detection of built-up areas from the Landsat imagery upon which population distribution is modelled. The combination of remote sensing imagery and population modelling allows for generating globally consistent and detailed information about the spatial…

Precipitation is the main component of global water cycle. At present, satellite quantitative precipitation estimates (QPEs) are widely applied in the scientific community. However, the evaluations of satellite QPEs have some limitations in terms of the deficiency in observation, evaluation methodology, the selection of time windows for evaluation and short periods for evaluation. The objective of this work is to make some improvements by evaluating the spatio-temporal pattern of the long-terms Climate Hazard Group InfraRed Precipitation Satellite’s (CHIRPS’s) QPEs over mainland China. In this study, we compared the daily precipitation estimates from CHIRPS with 2480 rain gauges across China and gridded observation using several statistical metrics in the long-term period of 1981–2014. The results show that there is significant difference between point evaluation and grid evaluation for CHIRPS. CHIRPS has better performance for a large amount of precipitation than it does for arid and semi-arid land. The change in good performance zones has strong relationship with monsoon’s…

Seagrasses are traversing the epoch of intense anthropogenic impacts that significantly decrease their coverage and invaluable ecosystem services, necessitating accurate and adaptable, global-scale mapping and monitoring solutions. Here, we combine the cloud computing power of Google Earth Engine with the freely available Copernicus Sentinel-2 multispectral image archive, image composition, and machine learning approaches to develop a methodological workflow for large-scale, high spatiotemporal mapping and monitoring of seagrass habitats. The present workflow can be easily tuned to space, time and data input; here, we show its potential, mapping 2510.1 km2 of P. oceanica seagrasses in an area of 40,951 km2 between 0 and 40 m of depth in the Aegean and Ionian Seas (Greek territorial waters) after applying support vector machines to a composite of 1045 Sentinel-2 tiles at 10-m resolution. The overall accuracy of P. oceanica seagrass habitats features an overall accuracy of 72% following validation by an independent field data set to reduce bias. We envision that the introduced…

Automatic building segmentation from aerial imagery is an important and challenging task because of the variety of backgrounds, building textures and imaging conditions. Currently, research using variant types of fully convolutional networks (FCNs) has largely improved the performance of this task. However, pursuing more accurate segmentation results is still critical for further applications such as automatic mapping. In this study, a multi-constraint fully convolutional network (MC–FCN) model is proposed to perform end-to-end building segmentation. Our MC–FCN model consists of a bottom-up/top-down fully convolutional architecture and multi-constraints that are computed between the binary cross entropy of prediction and the corresponding ground truth. Since more constraints are applied to optimize the parameters of the intermediate layers, the multi-scale feature representation of the model is further enhanced, and hence higher performance can be achieved. The experiments on a very-high-resolution aerial image dataset covering 18 km 2 and more than 17,000 buildings indicate that…

Remote sensing–based forest aboveground biomass (AGB) estimation has been extensively explored in the past three decades, but how to effectively combine different sensor data and modeling algorithms is still poorly understood. This research conducted a comparative analysis of different datasets (e.g., Landsat Thematic Mapper (TM), ALOS PALSAR L-band data, and their combinations) and modeling algorithms (e.g., artificial neural network (ANN), support vector regression (SVR), Random Forest (RF), k-nearest neighbor (kNN), and linear regression (LR)) for AGB estimation in a subtropical region under non-stratification and stratification of forest types. The results show the following: (1) Landsat TM imagery provides more accurate AGB estimates (root mean squared error (RMSE) values in 27.7–29.3 Mg/ha) than ALOS PALSAR (RMSE values in 30.3–33.7 Mg/ha). The combination of TM and PALSAR data has similar performance for ANN and SVR, worse performance for RF and KNN, and slightly improved performance for LR. (2) Overestimation for small AGB values and underestimation for large AGB values are…

Plant invasion imposes significant threats to biodiversity and ecosystem function. Thus, monitoring the spatial pattern of invasive plants is vital for effective ecosystem management. Spartina alterniflora (S. alterniflora) has been one of the most prevalent invasive plants along the China coast, and its spread has had severe ecological consequences. Here, we provide new observation from Landsat operational land imager (OLI) images. Specifically, 43 Landsat-8 OLI images from 2014 to 2016, a combination of object-based image analysis (OBIA) and support vector machine (SVM) methods, and field surveys covering the whole coast were used to construct an up-to-date dataset for 2015 and investigate the spatial variability of S. alterniflora in the coastal zone of mainland China. The classification results achieved good estimation, with a kappa coefficient of 0.86 and 96% overall accuracy. Our results revealed that there was approximately 545.80 km2 of S. alterniflora distributed in the coastal zone of mainland China in 2015, from Hebei to Guangxi provinces. Nearly 92% of the total area of…

Above-ground biomass (AGB) provides a vital link between solar energy consumption and yield, so its correct estimation is crucial to accurately monitor crop growth and predict yield. In this work, we estimate AGB by using 54 vegetation indexes (e.g., Normalized Difference Vegetation Index, Soil-Adjusted Vegetation Index) and eight statistical regression techniques: artificial neural network (ANN), multivariable linear regression (MLR), decision-tree regression (DT), boosted binary regression tree (BBRT), partial least squares regression (PLSR), random forest regression (RF), support vector machine regression (SVM), and principal component regression (PCR), which are used to analyze hyperspectral data acquired by using a field spectrophotometer. The vegetation indexes (VIs) determined from the spectra were first used to train regression techniques for modeling and validation to select the best VI input, and then summed with white Gaussian noise to study how remote sensing errors affect the regression techniques. Next, the VIs were divided into groups of different sizes by using…

Mapping mangrove extent and species is important for understanding their response to environmental changes and for observing their integrity for providing goods and services. However, accurately mapping mangrove extent and species are ongoing challenges in remote sensing. The newly-launched and freely-available Sentinel-2 (S2) sensor offers a new opportunity for these challenges. This study presents the first study dedicated to the examination of the potential of original bands, spectral indices, and texture information of S2 in mapping mangrove extent and species in the first National Nature Reserve for mangroves in Dongzhaigang, China. To map mangrove extent and species, a three-level hierarchical structure based on the spatial structure of a mangrove ecosystem and geographic object-based image analysis is utilized and modified. During the experiments, to conquer the challenge of optimizing high-dimension and correlated feature space, the recursive feature elimination (RFE) algorithm is introduced. Finally, the selected features from RFE are employed in mangrove species…

The Aquarius end-of-mission (Version 5) salinity data set was released in December 2017. This article gives a comprehensive overview of the main steps of the Level 2 salinity retrieval algorithm. In particular, we will discuss the corrections for wind induced surface roughness, atmospheric oxygen absorption, reflected galactic radiation and side-lobe intrusion from land surfaces. Most of these corrections have undergone major updates from previous versions, which has helped mitigating temporal and zonal biases. Our article also discusses the ocean target calibration for Aquarius Version 5. We show how formal error estimates for the Aquarius retrievals can be obtained by perturbing the input to the algorithm. The performance of the Aquarius Version 5 salinity retrievals is evaluated against salinity measurements from the ARGO network and the HYCOM model. When stratified as function of sea surface temperature or sea surface wind speed, the difference between Aquarius Version 5 and ARGO is within ±0.1 psu. The estimated global RMS uncertainty for monthly 100 km averages is 0.128 psu…

Classification of healthy and diseased wheat heads in a rapid and non-destructive manner for the early diagnosis of Fusarium head blight disease research is difficult. Our work applies a deep neural network classification algorithm to the pixels of hyperspectral image to accurately discern the disease area. The spectra of hyperspectral image pixels in a manually selected region of interest are preprocessed via mean removal to eliminate interference, due to the time interval and the environment. The generalization of the classification model is considered, and two improvements are made to the model framework. First, the pixel spectra data are reshaped into a two-dimensional data structure for the input layer of a Convolutional Neural Network (CNN). After training two types of CNNs, the assessment shows that a two-dimensional CNN model is more efficient than a one-dimensional CNN. Second, a hybrid neural network with a convolutional layer and bidirectional recurrent layer is reconstructed to improve the generalization of the model. When considering the characteristics of the dataset…

Benchmark datasets are essential for developing and evaluating remote sensing image retrieval (RSIR) approaches. However, most of the existing datasets are single-labeled, with each image in these datasets being annotated by a single label representing the most significant semantic content of the image. This is sufficient for simple problems, such as distinguishing between a building and a beach, but multiple labels and sometimes even dense (pixel) labels are required for more complex problems, such as RSIR and semantic segmentation.We therefore extended the existing multi-labeled dataset collected for multi-label RSIR and presented a dense labeling remote sensing dataset termed "DLRSD". DLRSD contained a total of 17 classes, and the pixels of each image were assigned with 17 pre-defined labels. We used DLRSD to evaluate the performance of RSIR methods ranging from traditional handcrafted feature-based methods to deep learning-based ones. More specifically, we evaluated the performances of RSIR methods from both single-label and multi-label perspectives. These results demonstrated…

Airplane detection in remote sensing images remains a challenging problem due to the complexity of backgrounds. In recent years, with the development of deep learning, object detection has also obtained great breakthroughs. For object detection tasks in natural images, such as the PASCAL (Pattern Analysis, Statistical Modelling and Computational Learning) VOC (Visual Object Classes) Challenge, the major trend of current development is to use a large amount of labeled classification data to pre-train the deep neural network as a base network, and then use a small amount of annotated detection data to fine-tune the network for detection. In this paper, we use object detection technology based on deep learning for airplane detection in remote sensing images. In addition to using some characteristics of remote sensing images, some new data augmentation techniques have been proposed. We also use transfer learning and adopt a single deep convolutional neural network and limited training samples to implement end-to-end trainable airplane detection. Classification and positioning are no…

Hyperspectral change detection (CD) can be effectively performed using deep-learning networks. Although these approaches require qualified training samples, it is difficult to obtain ground-truth data in the real world. Preserving spatial information during training is difficult due to structural limitations. To solve such problems, our study proposed a novel CD method for hyperspectral images (HSIs), including sample generation and a deep-learning network, called the recurrent three-dimensional (3D) fully convolutional network (Re3FCN), which merged the advantages of a 3D fully convolutional network (FCN) and a convolutional long short-term memory (ConvLSTM). Principal component analysis (PCA) and the spectral correlation angle (SCA) were used to generate training samples with high probabilities of being changed or unchanged. The strategy assisted in training fewer samples of representative feature expression. The Re3FCN was mainly comprised of spectral–spatial and temporal modules. Particularly, a spectral–spatial module with a 3D convolutional layer extracts the spectral–spatial…

Land surface temperature (LST) is one of the sources of input data for modeling land surface processes. The Landsat satellite series is the only operational mission with more than 30 years of archived thermal infrared imagery from which we can retrieve LST. Unfortunately, stray light artifacts were observed in Landsat-8 TIRS data, mostly affecting Band 11, currently making the split-window technique impractical for retrieving surface temperature without requiring atmospheric data. In this study, a single-channel methodology to retrieve surface temperature from Landsat TM and ETM+ was improved to retrieve LST from Landsat-8 TIRS Band 10 using near-surface air temperature (Ta) and integrated atmospheric column water vapor (w) as input data. This improved methodology was parameterized and successfully evaluated with simulated data from a global and robust radiosonde database and validated with in situ data from four flux tower sites under different types of vegetation and snow cover in 44 Landsat-8 scenes. Evaluation results using simulated data showed that the inclusion of Ta together…

Floods are considered one of the most disastrous hazards all over the world and cause serious casualties and property damage. Therefore, the assessment and regionalization of flood disasters are becoming increasingly important and urgent. To predict the probability of a flood, an essential step is to map flood susceptibility. The main objective of this work is to investigate the use a novel hybrid technique by integrating multi-criteria decision analysis and geographic information system to evaluate flood susceptibility mapping (FSM), which is constructed by ensemble of decision making trial and evaluation laboratory (DEMATEL), analytic network process, weighted linear combinations (WLC) and interval rough numbers (IRN) techniques in the case study at Shangyou County, China. Specifically, we improve the DEMATEL method by applying IRN to determine connections in the network structure based on criteria and to accept imprecisions during collective decision making. The application of IRN can eliminate the necessity of additional information to define uncertain number intervals.…

Convolutional neural networks (CNNs) have been extended to hyperspectral imagery (HSI) classification due to its better feature representation and high performance, whereas multiple feature learning has shown its effectiveness in computer vision areas. This paper proposes a novel framework that takes advantage of both CNNs and multiple feature learning to better predict the class labels for HSI pixels. We built a novel CNN architecture with various features extracted from the raw imagery as input. The network generates the corresponding relevant feature maps for the input, and the generated feature maps are fed into a concatenating layer to form a joint feature map. The obtained joint feature map is then input to the subsequent layers to predict the final labels for each hyperspectral pixel. The proposed method not only takes advantage of enhanced feature extraction from CNNs, but also fully exploits the spectral and spatial information jointly. The effectiveness of the proposed method is tested with three benchmark data sets, and the results show that the CNN-based multi-feature…

This paper presents a technique for the mapping of soil moisture and irrigation, at the scale of agricultural fields, based on the synergistic interpretation of multi-temporal optical and Synthetic Aperture Radar (SAR) data (Sentinel-2 and Sentinel-1). The Kairouan plain, a semi-arid region in central Tunisia (North Africa), was selected as a test area for this study. Firstly, an algorithm for the direct inversion of the Water Cloud Model (WCM) was developed for the spatialization of the soil water content between 2015 and 2017. The soil moisture retrieved from these observations was first validated using ground measurements, recorded over 20 reference fields of cereal crops. A second method, based on the use of neural networks, was also used to confirm the initial validation. The results reported here show that the soil moisture products retrieved from remotely sensed data are accurate, with a Root Mean Square Error (RMSE) of less than 5% between the two moisture products. In addition, the analysis of soil moisture and Normalized Difference Vegetation Index (NDVI) products over…

Timely and accurate estimates of crop parameters are crucial for agriculture management. Unmanned aerial vehicles (UAVs) carrying sophisticated cameras are very pertinent for this work because they can obtain remote-sensing images with higher temporal, spatial, and ground resolution than satellites. In this study, we evaluated (i) the performance of crop parameters estimates using a near-surface spectroscopy (350~2500 nm, 3 nm at 700 nm, 8.5 nm at 1400 nm, 6.5 nm at 2100 nm), a UAV-mounted snapshot hyperspectral sensor (450~950 nm, 8 nm at 532 nm) and a high-definition digital camera (Visible, R, G, B); (ii) the crop surface models (CSMs), RGB-based vegetation indices (VIs), hyperspectral-based VIs, and methods combined therefrom to make multi-temporal estimates of crop parameters and to map the parameters. The estimated leaf area index (LAI) and above-ground biomass (AGB) are obtained by using linear and exponential equations, random forest (RF) regression, and partial least squares regression (PLSR) to combine the UAV based spectral VIs and crop heights (from the CSMs). The…

Landsat-based fire severity datasets are an invaluable resource for monitoring and research purposes. These gridded fire severity datasets are generally produced with pre- and post-fire imagery to estimate the degree of fire-induced ecological change. Here, we introduce methods to produce three Landsat-based fire severity metrics using the Google Earth Engine (GEE) platform: The delta normalized burn ratio (dNBR), the relativized delta normalized burn ratio (RdNBR), and the relativized burn ratio (RBR). Our methods do not rely on time-consuming a priori scene selection but instead use a mean compositing approach in which all valid pixels (e.g., cloud-free) over a pre-specified date range (pre- and post-fire) are stacked and the mean value for each pixel over each stack is used to produce the resulting fire severity datasets. This approach demonstrates that fire severity datasets can be produced with relative ease and speed compared to the standard approach in which one pre-fire and one post-fire scene are judiciously identified and used to produce fire severity datasets. We also…

Fanjinshan National Nature Reserve (FNNR) is a biodiversity hotspot in China that is part of a larger, multi-use landscape where farming, grazing, tourism, and other human activities occur. The steep terrain and persistent cloud cover pose challenges to robust vegetation and land use mapping. Our objective is to develop satellite image classification techniques that can reliably map forest cover and land use while minimizing the cloud and terrain issues, and provide the basis for long-term monitoring. Multi-seasonal Landsat image composites and elevation ancillary layers effectively minimize the persistent cloud cover and terrain issues. Spectral vegetation index (SVI) products and shade/illumination normalization approaches yield significantly higher mapping accuracies, compared to non-normalized spectral bands. Advanced machine learning image classification routines are implemented through the cloud-based Google Earth Engine platform. Optimal classifier parameters (e.g., number of trees and number of features for random forest classifiers) were achieved by using tuning techniques.…

This paper evaluates the accuracy of shoreline positions obtained from the infrared (IR) bands of Landsat 7, Landsat 8, and Sentinel-2 imagery on natural beaches. A workflow for sub-pixel shoreline extraction, already tested on seawalls, is used. The present work analyzes the behavior of that workflow and resultant shorelines on a micro-tidal (<20 cm) sandy beach and makes a comparison with other more accurate sets of shorelines. These other sets were obtained using differential GNSS surveys and terrestrial photogrammetry techniques through the C-Pro monitoring system. 21 sub-pixel shorelines and their respective high-precision lines served for the evaluation. The results prove that NIR bands can easily confuse the shoreline with whitewater, whereas SWIR bands are more reliable in this respect. Moreover, it verifies that shorelines obtained from bands 11 and 12 of Sentinel-2 are very similar to those obtained with bands 6 and 7 of Landsat 8 (−0.75 ± 2.5 m; negative sign indicates landward bias). The variability of the brightness in the terrestrial zone influences shoreline…

This study presents a comparison between the use of wearable laser scanning (WLS) and terrestrial laser scanning (TLS) devices for automatic tree detection with an estimation of two dendrometric variables: diameter at breast height (DBH) and total tree height (TH). Operative processes for data collection and automatic forest inventory are described in detail. The approach used is based on the clustering of points belonging to each individual tree, the isolation of the trunks, the iterative fitting of circles for the DBH calculation and the computation of the TH of each tree. TLS and WLS point clouds were compared by the statistical analysis of both estimated forest dendrometric parameters and the possible presence of bias. Results show that the apparent differences in point density and relative precision between both 3D forest models do not affect tree detection and DBH estimation. Nevertheless, tree height estimation using WLS appears to be affected by the limited scanning range of the WLS used in this study. TH estimations for trees below a certain height are equivalent using WLS…

Sensitivity to weather conditions, and specially to clouds, is a severe limiting factor to the use of optical remote sensing for Earth monitoring applications. A possible alternative, is to resort to weather-insensitive synthetic aperture radar (SAR) images. However, in many real-world applications, critical decisions are made based on some informative spectral features, such as water, vegetation or soil indices, which cannot be extracted from SAR images. In the absence of optical sources, these data must be estimated. The current practice is to perform linear interpolation between data available at temporally close time instants. In this work, we propose to estimate missing spectral features through data fusion and deep-learning. Several sources of information are taken into account - optical sequences, SAR sequences, DEM - so as to exploit both temporal and cross-sensor dependencies. Based on these data, and a tiny cloud-free fraction of the target image, a compact convolutional neural network (CNN) is trained to perform the desired estimation. To validate the proposed approach,…

Forest biophysical variables derived from remote sensing observations are vital for climate research. The combination of structurally and radiometrically accurate 3D “virtual” forests with radiative transfer (RT) models creates a powerful tool to facilitate the calibration and validation of remote sensing data and derived biophysical products by helping us understand the assumptions made in data processing algorithms. We present a workflow that uses highly detailed 3D terrestrial laser scanning (TLS) data to generate virtual forests for RT model simulations. Our approach to forest stand reconstruction from a co-registered point cloud is unique as it models each tree individually. Our approach follows three steps: (1) tree segmentation; (2) tree structure modelling and (3) leaf addition. To demonstrate this approach, we present the measurement and construction of a one hectare model of the deciduous forest in Wytham Woods (Oxford, UK). The model contains 559 individual trees. We matched the TLS data with traditional census data to determine the species of each individual tree and…

Detection of senescence’s dynamics in crop breeding is time consuming and needs considerable details regarding its rate of progression and intensity. Normalized difference red-edge index (NDREI) along with four other spectral vegetative indices (SVIs) derived from unmanned aerial vehicle (UAV) based spatial imagery, were evaluated for rapid and accurate prediction of senescence. For this, 32 selected winter wheat genotypes were planted under full and limited irrigation treatments. Significant variations for all five SVIs: green normalize difference vegetation index (GNDVI), simple ratio (SR), green chlorophyll index (GCI), red-edge chlorophyll index (RECI), and normalized difference red-edge index (NDREI) among genotypes and between treatments, were observed from heading to late grain filling stages. The SVIs showed strong relationship (R2 = 0.69 to 0.78) with handheld measurements of chlorophyll and leaf area index (LAI), while negatively correlated (R2 = 0.75 to 0.77) with canopy temperature (CT) across the treatments. NDREI as a new SVI showed higher correlations with ground data…

Satellite earth observation is being increasingly used to monitor forests across the world. Freely available Landsat data stretching back four decades, coupled with advances in computer processing capabilities, has enabled new time-series techniques for analyzing forest change. Typically, these methods track individual pixel values over time, through the use of various spectral indices. This study examines the utility of eight spectral indices for characterizing fire disturbance and recovery in sclerophyll forests, in order to determine their relative merits in the context of Landsat time-series. Although existing research into Landsat indices is comprehensive, this study presents a new approach, by comparing the distributions of pre and post-fire pixels using Glass’s delta, for evaluating indices without the need of detailed field information. Our results show that in the sclerophyll forests of southeast Australia, common indices, such as the Normalized Difference Vegetation Index (NDVI) and the Normalized Burn Ratio (NBR), both accurately capture wildfire disturbance in a…

This paper assesses the potential of Synthetic Aperture Radar (SAR) in the C and L bands to penetrate into the canopy cover of wheat, maize and grasslands. For wheat and grasslands, the sensitivity of the C and L bands to in situ surface soil moisture (SSM) was first studied according to three levels of the Normalized Difference Vegetation Index (NDVI < 0.4, 0.4 < NDVI < 0.7, and NDVI > 0.7). Next, the temporal evolution of the SAR signal in the C and L bands was analyzed according to SSM and the NDVI. For wheat and grasslands, the results showed that the L-band in HH polarization penetrates the canopy even when the canopy is well-developed (NDVI > 0.7), whereas the penetration of the C-band into the canopy is limited for an NDVI < 0.7. For an NDVI less than 0.7, the sensitivity of the radar signal to SSM is approximately 0.27 dB/vol.% for the L-band in HH polarization and approximately 0.12 dB/vol.% for the C-band (in both VV and VH polarizations). For highly developed wheat and grassland cover (NDVI > 0.7), the sensitivity of the L-band in HH polarization to SSM is approximately…

Floods are among the top-ranking natural disasters in terms of annual cost in insured and uninsured losses. Since high-impact events often cover spatial scales that are beyond traditional regional monitoring operations, remote sensing, in particular from satellites, presents an attractive approach. Since the 1970s, there have been many studies in the scientific literature about mapping and monitoring of floods using data from various sensors onboard different satellites. The field has now matured and hence there is a general consensus among space agencies, numerous organizations, scientists, and end-users to strengthen the support that satellite missions can offer, particularly in assisting flood disaster response activities. This has stimulated more research in this area, and significant progress has been achieved in recent years in fostering our understanding of the ways in which remote sensing can support flood monitoring and assist emergency response activities. This paper reviews the products and services that currently exist to deliver actionable information about an ongoing…

Knowledge of the distribution of tree species within a forest is key for multiple economic and ecological applications. This information is traditionally acquired through time-consuming and thereby expensive field work. Our study evaluates the suitability of a visible to near-infrared (VNIR) hyperspectral dataset with a spatial resolution of 0.4 m for the classification of 13 tree species (8 broadleaf, 5 coniferous) on an individual tree crown level in the UNESCO Biosphere Reserve ‘Wienerwald’, a temperate Austrian forest. The study also assesses the automation potential for the delineation of tree crowns using a mean shift segmentation algorithm in order to permit model application over large areas. Object-based Random Forest classification was carried out on variables that were derived from 699 manually delineated as well as automatically segmented reference trees. The models were trained separately for two strata: small and/or conifer stands and high broadleaf forests. The two strata were delineated beforehand using CHM-based tree height and NDVI. The predictor variables…

Dynamics of surface water is of great significance to understand the impacts of global changes and human activities on water resources. Remote sensing provides many advantages in monitoring surface water; however, in large scale, the efficiency of traditional remote sensing methods is extremely low because these methods consume a high amount of manpower, storage, and computing resources. In this paper, we propose a new method for quickly determining what the annual maximal and minimal surface water extent is. The maximal and minimal water extent in the year of 1990, 2000, 2010 and 2017 in the Middle Yangtze River Basin in China were calculated on the Google Earth Engine platform. This approach takes full advantage of the data and computing advantages of the Google Earth Engine’s cloud platform, processed 2343 scenes of Landsat images. Firstly, based on the estimated value of cloud cover for each pixel, the high cloud covered pixels were removed to eliminate the cloud interference and improve the calculation efficiency. Secondly, the annual greenest and wettest images were mosaiced…

Daily acquisition of large amounts of aerial and satellite images has facilitated subsequent automatic interpretations of these images. One such interpretation is object detection. Despite the great progress made in this domain, the detection of multi-scale objects, especially small objects in high resolution satellite (HRS) images, has not been adequately explored. As a result, the detection performance turns out to be poor. To address this problem, we first propose a unified multi-scale convolutional neural network (CNN) for geospatial object detection in HRS images. It consists of a multi-scale object proposal network and a multi-scale object detection network, both of which share a multi-scale base network. The base network can produce feature maps with different receptive fields to be responsible for objects with different scales. Then, we use the multi-scale object proposal network to generate high quality object proposals from the feature maps. Finally, we use these object proposals with the multi-scale object detection network to train a good object detector. Comprehensive…

The automatic classification of ships from aerial images is a considerable challenge. Previous works have usually applied image processing and computer vision techniques to extract meaningful features from visible spectrum images in order to use them as the input for traditional supervised classifiers. We present a method for determining if an aerial image of visible spectrum contains a ship or not. The proposed architecture is based on Convolutional Neural Networks (CNN), and it combines neural codes extracted from a CNN with a k-Nearest Neighbor method so as to improve performance. The kNN results are compared to those obtained with the CNN Softmax output. Several CNN models have been configured and evaluated in order to seek the best hyperparameters, and the most suitable setting for this task was found by using transfer learning at different levels. A new dataset (named MASATI) composed of aerial imagery with more than 6000 samples has also been created to train and evaluate our architecture. The experimentation shows a success rate of over 99% for our approach, in contrast with…

Following a targeted campaign of violence by Myanmar military, police, and local militias, more than half a million Rohingya refugees have fled to neighboring Bangladesh since August 2017, joining thousands of others living in overcrowded settlement camps in Teknaf. To accommodate this mass influx of refugees, forestland is razed to build spontaneous settlements, resulting in an enormous threat to wildlife habitats, biodiversity, and entire ecosystems in the region. Although reports indicate that this rapid and vast expansion of refugee camps in Teknaf is causing large scale environmental destruction and degradation of forestlands, no study to date has quantified the camp expansion extent or forest cover loss. Using remotely sensed Sentinel-2A and -2B imagery and a random forest (RF) machine learning algorithm with ground observation data, we quantified the territorial expansion of refugee settlements and resulting degradation of the ecological resources surrounding the three largest concentrations of refugee camps—Kutupalong–Balukhali, Nayapara–Leda and Unchiprang—that developed…

Rugged terrain, including mountains, hills, and some high lands are typical land surfaces around the world. As a physical parameter for characterizing the anisotropic reflectance of the land surface, the importance of the bidirectional reflectance distribution function (BRDF) has been gradually recognized in the remote sensing community, and great efforts have been dedicated to build BRDF models over various terrain types. However, on rugged terrain, the topography intensely affects the shape and magnitude of the BRDF and creates challenges in modeling the BRDF. In this paper, after a brief introduction of the theoretical background of the BRDF over rugged terrain, the status of estimating land surface BRDF properties over rugged terrain is comprehensively reviewed from a historical perspective and summarized in two categories: BRDFs describing solo slopes and those describing composite slopes. The discussion focuses on land surface reflectance retrieval over mountainous areas, the difference in solo slope and composite slope BRDF models, and suggested future research to improve the…

Since landslide detection using the combination of AIRSAR data and GIS-based susceptibility mapping has been rarely conducted in tropical environments, the aim of this study is to compare and validate support vector machine (SVM) and index of entropy (IOE) methods for landslide susceptibility assessment in Cameron Highlands area, Malaysia. For this purpose, ten conditioning factors and observed landslides were detected by AIRSAR data, WorldView-1 and SPOT 5 satellite images. A spatial database was generated including a total of 92 landslide locations encompassing the same number of observed and detected landslides, which was divided into training (80%; 74 landslide locations) and validation (20%; 18 landslide locations) datasets. Results of the difference between observed and detected landslides using root mean square error (RMSE) indicated that only 16.3% error exists, which is fairly acceptable. The validation process was performed using statistical-based measures and the area under the receiver operating characteristic (AUROC) curves. Results of validation process indicated that…

The recently launched Sentinel-1 satellite with a Synthetic Aperture Radar (SAR) sensor onboard offers a powerful tool for irrigation monitoring under various weather conditions, with high spatial and temporal resolution. This research discusses the potential of different metrics calculated from the Sentinel-1 time series for mapping irrigated fields. A methodology for irrigation mapping using SAR data is proposed. The study is performed using VV (vertical–vertical) and VH (vertical–horizontal) polarizations over an agricultural site in Urgell, Catalunya (Spain). With field segmentation information from SIGPAC (the Geographic Information System for Agricultural Parcels), the backscatter intensities are averaged within each field. From the Sentinel-1 time series for each field, the statistics and metrics, including the mean value, the variance of the signal, the correlation length, and the fractal dimension, are analyzed. With the Support Vector Machine (SVM), the classification of irrigated crops, irrigated trees, and non-irrigated fields is performed with the metrics vector. The…

Being an important economic crop that contributes 35% of the total consumption of vegetable oil, remote sensing-based quantitative detection of oil palm trees has long been a key research direction for both agriculture and environmental purposes. While existing methods already demonstrate satisfactory effectiveness for small regions, performing the detection for a large region with satisfactory accuracy is still challenging. In this study, we proposed a two-stage convolutional neural network (TS-CNN)-based oil palm detection method using high-resolution satellite images (i.e. Quickbird) in a large-scale study area of Malaysia. The TS-CNN consists of one CNN for land cover classification and one CNN for object classification. The two CNNs were trained and optimized independently based on 20,000 samples collected through human interpretation. For the large-scale oil palm detection for an area of 55 km2, we proposed an effective workflow that consists of an overlapping partitioning method for large-scale image division, a multi-scale sliding window method for oil palm coordinate…

Urban land use is key to rational urban planning and management. Traditional land use classification methods rely heavily on domain experts, which is both expensive and inefficient. In this paper, deep neural network-based approaches are presented to label urban land use at pixel level using high-resolution aerial images and ground-level street view images. We use a deep neural network to extract semantic features from sparsely distributed street view images and interpolate them in the spatial domain to match the spatial resolution of the aerial images, which are then fused together through a deep neural network for classifying land use categories. Our methods are tested on a large publicly available aerial and street view images dataset of New York City, and the results show that using aerial images alone can achieve relatively high classification accuracy, the ground-level street view images contain useful information for urban land use classification, and fusing street image features with aerial images can improve classification accuracy. Moreover, we present experimental studies…

We use freely available Sentinel-2 data and forest inventory data to evaluate the potential of different machine-learning approaches to classify tree species in two forest regions in Bavaria, Germany. Atmospheric correction was applied to the level 1C data, resulting in true surface reflectance or bottom of atmosphere (BOA) output. We developed a semiautomatic workflow for the classification of deciduous (mainly spruce trees), beech and oak trees by evaluating different classification algorithms (object- and pixel-based) in an architecture optimized for distributed processing. A hierarchical approach was used to evaluate different band combinations and algorithms (Support Vector Machines (SVM) and Random Forest (RF)) for the separation of broad-leaved vs. coniferous trees. The Ebersberger forest was the main project region and the Freisinger forest was used in a transferability study. Accuracy assessment and training of the algorithms was based on inventory data, validation was conducted using an independent dataset. A confusion matrix, with User´s and Producer´s Accuracies, as well…

The timely estimation of crop biomass and nitrogen content is a crucial step in various tasks in precision agriculture, for example in fertilization optimization. Remote sensing using drones and aircrafts offers a feasible tool to carry out this task. Our objective was to develop and assess a methodology for crop biomass and nitrogen estimation, integrating spectral and 3D features that can be extracted using airborne miniaturized multispectral, hyperspectral and colour (RGB) cameras. We used the Random Forest (RF) as the estimator, and in addition Simple Linear Regression (SLR) was used to validate the consistency of the RF results. The method was assessed with empirical datasets captured of a barley field and a grass silage trial site using a hyperspectral camera based on the Fabry-Pérot interferometer (FPI) and a regular RGB camera onboard a drone and an aircraft. Agricultural reference measurements included fresh yield (FY), dry matter yield (DMY) and amount of nitrogen. In DMY estimation of barley, the Pearson Correlation Coefficient (PCC) and the normalized Root Mean Square…

Soil moisture is considered a key variable to assess crop and drought conditions. However, readily available soil moisture datasets developed for monitoring agricultural drought conditions are uncommon. The aim of this work is to examine two global soil moisture data sets and a set of soil moisture web-based processing tools developed to demonstrate the value of the soil moisture data for drought monitoring and crop forecasting using Google Earth Engine (GEE). The two global soil moisture data sets discussed in the paper are generated by integrating Soil Moisture Ocean Salinity (SMOS) and Soil Moisture Active Passive (SMAP) satellite-derived observations into the modified two-layer Palmer model using a 1-D Ensemble Kalman Filter (EnKF) data assimilation approach. The web-based tools are designed to explore soil moisture variability as a function of land cover change and to easily estimate drought characteristics such as drought duration and intensity using soil moisture anomalies, and to inter-compare them against alternative drought indicators. To demonstrate the utility of these…

Synthetic aperture radar automatic target recognition (SAR-ATR) has made great progress in recent years. Most of the established recognition methods are supervised, which have strong dependence on image labels. However, obtaining the labels of radar images is expensive and time-consuming. In this paper, we present a semi-supervised learning method that is based on the standard deep convolutional generative adversarial networks (DCGANs). We double the discriminator that is used in DCGANs and utilize the two discriminators for joint training. In this process, we introduce a noisy data learning theory to reduce the negative impact of the incorrectly labeled samples on the performance of the networks. We replace the last layer of the classic discriminators with the standard softmax function to output a vector of class probabilities so that we can recognize multiple objects. We subsequently modify the loss function in order to adapt to the revised network structure. In our model, the two discriminators share the same generator, and we take the average value of them when computing the…

NASA’s Gravity Recovery and Climate Experiment (GRACE) has already proven to be a powerful data source for regional groundwater assessments in many areas around the world. However, the applicability of GRACE data products to more localized studies and their utility to water management authorities have been constrained by their limited spatial resolution (~200,000 km2). Researchers have begun to address these shortcomings with data assimilation approaches that integrate GRACE-derived total water storage estimates into complex regional models, producing higher-resolution estimates of hydrologic variables (~2500 km2). Here we take those approaches one step further by developing an empirically based model capable of downscaling GRACE data to a high-resolution (~16 km2) dataset of groundwater storage changes over a portion of California’s Central Valley. The model utilizes an artificial neural network to generate a series of high-resolution maps of groundwater storage change from 2002 to 2010 using GRACE estimates of variations in total water storage and a series of widely available…

The efficient use of nitrogen fertilizer is a crucial problem in modern agriculture. Fertilization has to be minimized to reduce environmental impacts but done so optimally without negatively affecting yield. In June 2017, a controlled experiment with eight different nitrogen treatments was applied to winter wheat plants and investigated with the UAV-based hyperspectral pushbroom camera Resonon Pika-L (400–1000 nm). The system, in combination with an accurate inertial measurement unit (IMU) and precise gimbal, was very stable and capable of acquiring hyperspectral imagery of high spectral and spatial quality. Additionally, in situ measurements of 48 samples (leaf area index (LAI), chlorophyll (CHL), and reflectance spectra) were taken in the field, which were equally distributed across the different nitrogen treatments. These measurements were used to predict grain yield, since the parameter itself had no direct effect on the spectral reflection of plants. Therefore, we present an indirect approach based on LAI and chlorophyll estimations from the acquired hyperspectral image data…

Satellite precipitation products provide alternative precipitation data in mountain areas. This study aimed to assess the performance of the latest Global Precipitation Measurement (GPM) Integrated Multi-satellite Retrievals for GPM (IMERG) version 5 (IMERG V5) and Global Satellite Mapping of Precipitation version 7 (GSMaP V7) products and their hydrological utilities over the Tibetan Plateau (TP). Here, two IMERG Final Run products (uncalibrated IMERG (IMERG-UC) and gauge-calibrated IMERG (IMEEG-C)) and two GSMaP products (GSMaP Moving Vector with Kalman Filter (GSMaP-MVK) and gauge-adjusted GSMaP (GSMaP-Gauge)) were evaluated from April 2014 to March 2017. Results show that all four satellite precipitation products could generally capture the spatial patterns of precipitation over the TP. The two gauge-adjusted products were more consistent with the ground measurements than the satellite-only products in terms of statistical assessment. For hydrological simulation, IMERG-UC and GSMaP-MVK showed unsatisfactory performance for hydrological utility, while GSMaP-Gauge demonstrated…

Carbon sink estimation and ecological assessment of forests require accurate forest type mapping. The traditional survey method is time consuming and labor intensive, and the remote sensing method with high-resolution, multi-spectral commercial satellite images has high cost and low availability. In this study, we explore and evaluate the potential of freely-available multi-source imagery to identify forest types with an object-based random forest algorithm. These datasets included Sentinel-2A (S2), Sentinel-1A (S1) in dual polarization, one-arc-second Shuttle Radar Topographic Mission Digital Elevation (DEM) and multi-temporal Landsat-8 images (L8). We tested seven different sets of explanatory variables for classifying eight forest types in Wuhan, China. The results indicate that single-sensor (S2) or single-day data (L8) cannot obtain satisfactory results; the overall accuracy was 54.31% and 50.00%, respectively. Compared with the classification using only Sentinel-2 data, the overall accuracy increased by approximately 15.23% and 22.51%, respectively, by adding DEM and…

Himalayan glaciers, in general, are shrinking and glacial lakes are evolving and growing rapidly in number and size as a result of climate change. This study presents the latest remote sensing-based inventory (2017) of glacial lakes (size ≥0.0036 km2) across the Nepal Himalaya using optical satellite data. Furthermore, this study traces the decadal glacial lake dynamics from 1977 to 2017 in the Nepal Himalaya. The decadal mapping of glacial lakes (both glacial-fed and nonglacial-fed) across the Nepal Himalaya reveals an increase in the number and area of lakes from 1977 to 2017, with 606 (55.53 ± 16.52 km2), 1137 (64.56 ± 11.64 km2), 1228 (68.87 ± 12.18 km2), 1489 (74.2 ± 14.22 km2), and 1541 (80.95 ± 15.25 km2) glacial lakes being mapped in 1977, 1987, 1997, 2007, and 2017, respectively. Glacial lakes show heterogeneous rates of expansion in different river basins and elevation zones of Nepal, with apparent decadal emergences and disappearances. Overall, the glacial lakes exhibited ~25% expansion of surface areas from 1987 to 2017. For the period from 1987 to 2017, proglacial lakes…

Remote estimation of flower number in oilseed rape under different nitrogen (N) treatments is imperative in precision agriculture and field remote sensing, which can help to predict the yield of oilseed rape. In this study, an unmanned aerial vehicle (UAV) equipped with Red Green Blue (RGB) and multispectral cameras was used to acquire a series of field images at the flowering stage, and the flower number was manually counted as a reference. Images of the rape field were first classified using K-means method based on Commission Internationale de l’Éclairage (CIE) L*a*b* space, and the result showed that classified flower coverage area (FCA) possessed a high correlation with the flower number (r2 = 0.89). The relationships between ten commonly used vegetation indices (VIs) extracted from UAV-based RGB and multispectral images and the flower number were investigated, and the VIs of Normalized Green Red Difference Index (NGRDI), Red Green Ratio Index (RGRI) and Modified Green Red Vegetation Index (MGRVI) exhibited the highest correlation to the flower number with the absolute…