This research aims to monitor abnormal climate changes and supervise Air Quality (AQ), especially in Morocco. This study aims to contribute to finding a solution to the AQ degradation and climate change issues by using Remote Sensing (RS) techniques. RSBD in NRT is collected from six sources: the MDEO ground station of EUMETSAT data, the EOSDIS data of NASA, the NESDIS data of NOAA, and the Copernicus platform, some MGS data, and the Raspberry PI sensors data. The current manuscript explains the different aspects of the used satellite data, proving that satellite data could be regarded as Big Data (BD). Accordingly, this research has proposed a Hadoop BD architecture and explained how to efficiently process RS environmental data. This architecture comprises six main layers: the data sources, data ingestion, data storage, data processing, data visualization, and the monitoring layer. The aforementioned architecture automatically collects filters, extracts, and stores data into the HDFS. This proposed model would be beneficial in managing adverse climate conditions and prevent natural disasters.
Reference
K. R. Smith, N. Bruce, K. Balakrishnan, H. Adair-Rohani, J. Balmes, Z. Chafe, M. Dherani, H. D. Hosgood, S. Mehta, D. Pope et al., “Millions dead: How do we know and what does it mean? Methods used in the comparative risk assessment of house-hold air pollution,” Annual Review of Public Health, vol. 35, pp. 185–206, 2014. doi: https://doi.org/10.1146/annurev-publhealth-032013-182356
Z.-X. Wang and J.-M. Lin, “Application of the green’s function in attenuation factor to solve the status of human health on the earth,” International Journal of Technology and Engineering Studies, vol. 4, no. 1, pp. 32–41, 2018. doi: https://doi.org/10.20469/ijtes.4.10005-1
E. Chuvieco and R. G. Congalton, “Application of remote sensing and geographic information systems to forest fire hazard mapping,” Remote Sensing of Environment, vol. 29, no. 2, pp. 147–159, 1989. doi: https://doi.org/10.1016/0034-4257(89)90023-0
Y. X. Lee and Z. W. Zhong, “A study of the relation-ship between adverse weather conditions and flight delay,” Journal of Advances in Technology and Engi-neering Research, vol. 2, no. 4, pp. 113–117, 2016. doi: https://doi.org/10.20474/jater-2.4.2
R. J. Boain, AB-Cs of sun-synchronous orbit mission design. Pasadena, CA: Jet Propulsion Laboratory, National Aeronautics and Space., 2004.
G. Chijioke, “Satellite remote sensing technology in spatial modeling process: Technique and proce-dures,” International Journal of Science and Technology, vol. 2, no. 5, pp. 309–315, 2012.
S. Gupta. (2018) Active and passive remote sensing. [Online]. Available: https://bit.ly/2GfIFi6
L. Zhu, J. Suomalainen, J. Liu, J. Hyyppä, H. Kaarti-nen, and H. Haggren, “A review: Remote sensing sensors,” in Multi-purposeful Application of Geospatial Data, R. B. Rustamov, S. Hasanova, and M. H. Zeynalova, Eds. London, UK: IntechOpen, 2018.
C. El Amrani, G. L. Rochon, T. El-Ghazawi, G. Al-tay, and T. Rachidi, “Development of a real-time urban remote sensing initiative in the mediterranean region for early warning and mitigation of disas-ters,” in IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany, 2012, pp. 2782–2785.
C. L. Parkinson, A. Ward, and M. D. King, Earth science reference handbook: A guide to NASA’s earth science program and earth observing satellite missions. Washigton, DC, WA: National Aeronautics and Space Administration, 2006.
A. Garcia-de Prado, G. Ortiz, J. Boubeta-Puig, and D. Corral-Plaza, “Air4people: A smart air quality monitoring and context-aware notification system,” Journal of Universal Computer Science, vol. 24, no. 7, pp. 846–863, 2018.
V. Karhila and A. Hernandez-Carrascal, “BUFR: Ameteorological code for the 21st century,” in EU-METSAT Meteorological Satellite Conference, Cordoba, Spain, 2010.
L. Gosink, J. Shalf, K. Stockinger, K. Wu, and W. Bethel, “HDF5-fastquery: Accelerating complex queries on HDF datasets using fast bitmap indices,” in 18th International Conference on Scientific and Statistical Database Management (SSDBM’06), Vienna, Austria, 2006, pp. 149–158.
R. Rew and G. Davis, “NetCDF: An interface for scientific data access,” IEEE Computer Graphics and Applications, vol. 10, no. 4, pp. 76–82, 1990. doi: https://doi.org/10.1109/38.56302
Y. Ma, H. Wu, L. Wang, B. Huang, R. Ranjan, A. Zomaya, and W. Jie, “Remote sensing big data computing: Challenges and opportunities,” Future Generation Computer Systems, vol. 51, pp. 47–60, 2015. doi: https://doi.org/10.1016/j.future.2014.10.029
R. Showstack, “Sentinel satellites initiate new era in earth observation,” Eos, Transactions American Geophysical Union, vol. 95, no. 26, pp. 239–240, 2014. doi: https://doi.org/10.1002/2014eo260003
R. Youssra and R. Sara, “Big data and big dataanalytics: Concepts, types and technologies,” International Journal of Research and Engineering, vol. 5, no. 9, pp. 524–528, 2018. doi: https://doi.org/10.21276/ijre.2018.5.9.5
T. Lyons, J. Kenworthy, C. Moy, and F. Dos Santos, “An international urban air pollution model for the transportation sector,” Transportation Research Part D: Transport and Environment, vol. 8, no. 3, pp. 159–167, 2003. doi: https://doi.org/10.1016/s1361-9209(02)00047-0
H.-D. Lee, J.-W. Yoo, M.-K. Kang, J.-S. Kang, J.-H. Jung, and K.-J. Oh, “Evaluation of concentrations and source contribution of PM10 and SO2 emitted from industrial complexes in Ulsan, Korea: Interfacing of the WRF–CALPUFF modeling tools,” Atmospheric Pollution Research, vol. 5, no. 4, pp. 664–676, 2014. doi: https://doi.org/10.5094/apr.2014.076
M. A. Zaytar and C. El Amrani, “Ozonet: Atmospheric ozone interpolation with deep convolutional neural networks,” Geoscientific Instrumentation, Methods and Data Systems Discussions, pp. 1–16, 2019. doi: https://doi.org/10.5194/gi-2018-53
B.-R. B. Semlali, C. El Amrani, and S. Denys, “Development of a java-based application for environmental remote sensing data processing,” International Journal of Electrical and Computer Engineering, vol. 9, no. 3, pp. 1978–1986, 2019. doi: https://doi.org/10.11591/ijece.v9i3.pp1978-1986
J. Schulz, P. Albert, H.-D. Behr, D. Caprion, H. Deneke, S. Dewitte, B. Durr, P. Fuchs, A. Gratzki, P. Hechler et al., “Operational climate monitoring from space: The EUMETSAT satellite application facility on climate monitoring (CM-SAF),”Atmospheric Chemistry and Physics, vol. 9, no. 5, pp. 1687–1709, 2009. doi: https://doi.org/10.5194/acp-9-1687-2009
B. B. Semlali and E. A. C., “Towards remote sensing datasets collection and processing,” International Journal of Embedded and Real-Time Communication Systems (IJERTCS), vol. 10, no. 3, pp. 49–67, 2019. doi: https://doi.org/10.4018/ijertcs.2019070104
M. A. Zaytar and C. E. Amrani, “Metop satellites data processing for air pollution monitoring in morocco,” International Journal of Electrical & Computer Engineering, vol. 8, no. 6, pp. 4584-4592, 2018. doi: https://doi.org/10.11591/ijece.v8i6.pp4584-4592
National Oceanic and Atmospheric Administration. (2019) NOAA National Environmental Satellite, Data, and Information Service (NESDIS). [Online]. Available: https://bit.ly/310aTXX
C. Wang, F. Hu, X. Hu, S. Zhao, W. Wen, and C. Yang, “A hadoop-based distributed framework for efficient managing and processing big remote sensing images,” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 2, no. 4, p. 63, 2015. doi: https://doi.org/10.5194/isprsannals-ii-4-w2-63-2015
B. S. B. E. and E. A. C., “Towards remote sensing datasets collection and processing,” in Transactions on Large-Scale Data- and Knowledge-Centered Systems XLI, H. A, W. R, and D. TK, Eds. Berlin, Heidelberg: Springer, 2019.
C. Clerbaux, A. Boynard, L. Clarisse, M. George,J. Hadji-Lazaro, H. Herbin, D. J. Hurtmans, M. Pommier, A. Razavi, S. Turquety et al., “Monitoring of atmospheric composition using the thermal infrarediasi/metop sounder,” vol. 9, no. 16, pp. 6041–6054, 2009. doi: https://doi.org/10.5194/acp-9-6041-2009
A. Hassini and A. H. Belbachir, “Thermal infrared geostationary satellite sensor data application for prediction and monitoring earthquake in Algeria,”International Journal of Information Technology and Management, vol. 15, no. 4, pp. 293–312, 2016. doi: https://doi.org/10.1504/ijitm.2016.079600
M. M. U. Rathore, A. Paul, A. Ahmad, B.-W. Chen, B. Huang, and W. Ji, “Real-time big data analytical architecture for remote sensing application,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 8, no. 10, pp. 4610–4621, 2015. doi: https://doi.org/10.1109/jstars.2015.2424683
To Cite this article
B.-E. B. Semlali, C. E. Amrani, and G. Ortiz, “Adopting the Hadoop architecture to process satellite pollution big data,” International Journal of Technology and Engineering Studies, vol. 5, no. 2, pp. 30-39, 2019. doi: https://dx.doi.org/10.20469/ijtes.5.40001-2