Deborah A. Agarwal

Biographical Sketch
As the Director of the Scientific Data Division, Dr. Agarwal's focus has been on expanding the division's already robust research portfolio to include emerging data science topics of importance to DOE science. Data topics typically focus on extreme scale and complex data challenges in topics including: machine learning, artificial intelligence, data processing workflows, user experience, data integration, computational science, and a wide array of data management and repository related topics. The division's research also focuses on scientific tools which enable sharing of scientific experiments, advanced networking infrastructure to support sharing of scientific data, data analysis support infrastructure for science, and cybersecurity infrastructure to secure collaborative environments in collaboration with a wide array of DOE science disciplines.
Dr. Agarwal also leads teams developing data server infrastructure to significantly enhance data browsing and analysis capabilities and enable eco-science synthesis at the watershed-scale to understand hydrologic and conservation questions and at the global-scale to understand carbon flux. Some of the projects Dr. Agarwal is working on include: Enviromental Systems Science Digital Infrastructure for a Virtual Ecosystem (ESS-DIVE), AmeriFlux Management Project, FLUXNET. Dr. Agarwal is also a Research Affiliate at the Berkeley Institute for Data science and a Board member of the Computing Research Association's Committee on Widening Participation. Dr. Agarwal received her Ph.D. in electrical and computer engineering from University of California, Santa Barbara and a B.S. in Mechanical Engineering from Purdue University.
Journal Articles
D. A. Agarwal, J. Damerow, C. Varadharajan, D. S. Christianson, G. Z. Pastorello, Y.-W. Cheah, L. Ramakrishnan, "Balancing the needs of consumers and producers for scientific data collections", Ecological Informatics, 2021, 62:101251, doi: 10.1016/j.ecoinf.2021.101251
G. Z. Pastorello, C. Trotta, E. Canfora, H. Chu, D. Christianson, Y.-W. Cheah, C. Poindexter, J. Chen, A. Elbashandy, M. Humphrey, P. Isaac, D. Polidori, M. Reichstein, A. Ribeca, C. van Ingen, N. Vuichard, L. Zhang, B. Amiro, C. Ammann, M. A. Arain, J. Ardö, T. Arkebauer, S. K. Arndt, N. Arriga, M. Aubinet, M. Aurela, D. Baldocchi, A. Barr, E. Beamesderfer, L. B. Marchesini, O. Bergeron, J. Beringer, C. Bernhofer, D. Berveiller, D. Billesbach, T. A. Black, P. D. Blanken, G. Bohrer, J. Boike, P. V. Bol stad, D. Bonal, J.-M. Bonnefond, D. R. Bowling, R. Bracho, J. Brodeur, C. Brümmer, N. Buchmann, B. Burban, S. P. Burns, P. Buysse, P. Cale, M. Cavagna, P. Cellier, S. Chen, I. Chini, T. R. Chris tensen, J. Cleverly, A. Collalti, C. Consalvo, B. D. Cook, D. Cook, C. Coursolle, E. Cremonese, P. S. Curtis, E. D’Andrea, H. da Rocha, X. Dai, K. J. Davis, B. D. Cinti, A. de Grandcourt, A. D. Ligne, R. C. D. Oliveira, N. Delpierre, A. R. Desai, C. M. D. Bella, P. di Tommasi, H. Dolman, F. Domingo, G. Dong, S. Dore, P. Duce, E. Dufrêne, A. Dunn, J. Dušek, D. Eamus, U. Eichelmann, H. A. M. ElKhidir, W. Eugster, C. M. Ewenz, B. Ewers, D. Famulari, S. Fares, I. Feigenwinter, A. Feitz, R. Fensholt, G. Fil ippa, M. Fischer, J. Frank, M. Galvagno, M. Gharun, D. Gianelle, B. Gielen, B. Gioli, A. Gitelson, I. Goded, M. Goeckede, A. H. Goldstein, C. M. Gough, M. L. Goulden, A. Graf, A. Griebel, C. Gruening, T. Grünwald, A. Hammerle, S. Han, X. Han, B. U. Hansen, C. Hanson, J. Hatakka, Y. He, M. Hehn, B. Heinesch, N. Hinko-Najera, L. Hörtnagl, L. Hutley, A. Ibrom, H. Ikawa, M. Jackowicz-Korczynski, D. Janouš, W. Jans, R. Jassal, S. Jiang, T. Kato, M. Khomik, J. Klatt, A. Knohl, S. Knox, H. Kobayashi, G. Koerber, O. Kolle, Y. Kosugi, A. Kotani, A. Kowalski, B. Kruijt, J. Kurbatova, W. L. Kutsch, H. Kwon, S. Launiainen, T. Laurila, B. Law, R. Leuning, Y. Li, M. Liddell, J.-M. Limousin, M. Lion, A. J. Liska, A. Lohila, A. López-Ballesteros, E. López-Blanco, B. Loubet, D. Loustau, A. Lucas-Moffat, J. Lüers, S. Ma, C. Macfarlane, V. Magliulo, R. Maier, I. Mammarella, G. Manca, B. Marcolla, H. A. Margolis, S. Mar ras, W. Massman, M. Mastepanov, R. Matamala, J. H. Matthes, F. Mazzenga, H. McCaughey, I. McHugh, A. M. S. McMillan, L. Merbold, W. Meyer, T. Meyers, S. D. Miller, S. Minerbi, U. Moderow, R. K. Monson, L. Montagnani, C. E. Moore, E. Moors, V. Moreaux, C. Moureaux, J. W. Munger, T. Nakai, J. Neirynck, Z. Nesic, G. Nicolini, A. Noormets, M. Northwood, M. Nosetto, Y. Nouvellon, K. Novick, W. Oechel, J. E. Olesen, J.-M. Ourcival, S. A. Papuga, F.-J. Parmentier, E. Paul-Limoges, M. Pavelka, M. Peichl, E. Pendall, R. P. Phillips, K. Pilegaard, N. Pirk, G. Posse, T. Powell, H. Prasse, S. M. Prober, S. Ram bal, U. Rannik, N. Raz-Yaseef, D. Reed, V. R. de Dios, N. Restrepo-Coupe, B. R. Reverter, M. Roland, S. Sabbatini, T. Sachs, S. R. Saleska, E. P. S.-C. nete, Z. M. Sanchez-Mejia, H. P. Schmid, M. Schmidt, K. Schneider, F. Schrader, I. Schroder, R. L. Scott, P. Sedlák, P. Serrano-Ortíz, C. Shao, P. Shi, I. Shironya, L. Siebicke, L. Šigut, R. Silberstein, C. Sirca, D. Spano, R. Steinbrecher, R. M. Stevens, C. Sturtevant, A. Suyker, T. Tagesson, S. Takanashi, Y. Tang, N. Tapper, J. Thom, F. Tiedemann, M. Tomassucci, J.-P. Tuovinen, S. Urbanski, R. Valentini, M. van der Molen, E. van Gorsel, K. van Huissteden, A. Varlagin, J. Verfaillie, T. Vesala, C. Vincke, D. Vitale, N. Vygodskaya, J. P. Walker, E. Walter-Shea, H. Wang, R. Weber, S. Westermann, C. Wille, S. Wofsy, G. Wohlfahrt, S. Wolf, W. Woodgate, Y. Li, R. Zampedri, J. Zhang, G. Zhou, D. Zona, D. Agarwal, S. Biraud, M. Torn, D. Papale, "The FLUXNET2015 dataset and the ONEFlux processing pipeline for eddy covariance data", Scientific Data, 2020, 7:225, doi: 10.1038/s41597-020-0534-3
C Varadharajan, S Cholia, C Snavely, V Hendrix, C Procopiou, D Swantek, W Riley, D Agarwal, "Launching an Accessible Archive of Environmental Data", Eos, January 1, 2019, 100, doi: 10.1029/2019eo111263
DC Miller, JD Siirola, D Agarwal, AP Burgard, A Lee, JC Eslick, B Nicholson, C Laird, LT Biegler, D Bhattacharyya, NV Sahinidis, IE Grossmann, CE Gounaris, D Gunter, "Next Generation Multi-Scale Process Systems Engineering Framework", Computer Aided Chemical Engineering, 2018, 44:2209--2214, doi: 10.1016/B978-0-444-64241-7.50363-3
Gilberto Z. Pastorello, Dario Papale, Housen Chu, Carlo Trotta, Deb A. Agarwal, Eleonora Canfora, Dennis D. Baldocchi, M. S. Torn, "A new data set to keep a sharper eye on land-air exchanges", Eos, 2017, 98:28-32, doi: 10.1029/2017EO071597
Danielle S. Christianson, Charuleka Varadharajan, Bradley Christoffersen, Matteo Detto, Faybishenko, Bruno O. Gimenez, Val C. Hendrix, Kolby J. Jardine, Robinson Negron-Juarez, Z. Pastorello, Thomas L. Powell, Megha Sandesh, Jeffrey M. Warren, Brett T. Wolfe, Jeffrey Q. Chambers, Lara M. Kueppers, Nathan G. McDowell, Deborah A. Agarwal, "A metadata reporting framework (FRAMES) for synthesis of ecohydrological observations", Ecological Informatics, 2017, 42:148-158, doi: 10.1016/j.ecoinf.2017.06.002
Deborah A Agarwal, Boris Faybishenko, Vicky L Freedman, Harinarayan Krishnan, Gary Kushner, Carina Lansing, Ellen Porter, Alexandru Romosan, Arie Shoshani, Haruko Wainwright, others, "A science data gateway for environmental management", Concurrency and Computation: Practice and Experience, 2016, 28:1994--2004,
DC Miller, D Agarwal, D Bhattacharyya, J Boverhof, YW Cheah, Y Chen, J Eslick, J Leek, J Ma, P Mahapatra, B Ng, NV Sahinidis, C Tong, SE Zitney, "Innovative computational tools and models for the design, optimization and control of carbon capture processes", Computer Aided Chemical Engineering, 2016, 38:2391--2396, doi: 10.1016/B978-0-444-63428-3.50403-3
V Hendrix, L Ramakrishnan, Y Ryu, C Van Ingen, KR Jackson, D Agarwal, "CAMP: Community access MODIS pipeline", Future Generation Computer Systems, 2014, 36:418--429, doi: 10.1016/j.future.2013.09.023
DC Miller, M Syamlal, DS Mebane, C Storlie, D Bhattacharyya, NV Sahinidis, D Agarwal, C Tong, SE Zitney, A Sarkar, X Sun, S Sundaresan, E Ryan, D Engel, C Dale, "Carbon capture simulation initiative: A case study in multiscale modeling and new challenges", Annual Review of Chemical and Biomolecular Engineering, 2014, 5:301--323, doi: 10.1146/annurev-chembioeng-060713-040321
D Agarwal, YW Cheah, D Fay, J Fay, D Guo, T Hey, M Humphrey, K Jackson, Jie Li, C Poulain, Y Ryu, C Van Ingen, "Data-intensive science: The Terapixel and MODISAzure projects", International Journal of High Performance Computing Applications, 2011, 25:304--316, doi: 10.1177/1094342011414746
D. Agarwal, M. Humphrey,N., Beekwilder, K. Jackson, M. Goode, and C. van Ingen, "A Data Centered Collaboration Portal to Support Global Carbon-Flux Analysis", Concurrency and Computation: Practice and Experience - Successes in Furthering Scientific Discovery, June 2010, LBNL 1827E,
DA Agarwal, M Humphrey, NF Beekwilder, KR Jackson, MM Goode, C Van Ingen, "A data-centered collaboration portal to support global carbon-flux analysis", Concurrency Computation Practice and Experience, 2010, 22:2323--2334, doi: 10.1002/cpe.1600
Y Amir, LE Moser, PM Melliar-Smith, DA Agarwal, P Ciarfella, "The Totem Single-Ring Ordering and Membership Protocol", ACM Transactions on Computer Systems (TOCS), 1995, 13:311--342, doi: 10.1145/210223.210224
Conference Papers
Payton A Linton, William M Melodia, Alina Lazar, Deborah Agarwal, Ludovico Bianchi, Devarshi Ghoshal, Kesheng Wu, Gilberto Pastorello, Lavanya Ramakrishnan, "Identifying Time Series Similarity in Large-Scale Earth System Datasets", 2019,
D Ghoshal, L Ramakrishnan, D Agarwal, "Dac-Man: Data Change Management for Scientific Datasets on HPC Systems", SC ’18, Piscataway, NJ, USA, IEEE Press, 2018, 72:1--72:1,
D Guyon, AC Orgerie, C Morin, D Agarwal, "How Much Energy Can Green HPC Cloud Users Save?", Proceedings - 2017 25th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2017, 2017, 416--420, doi: 10.1109/PDP.2017.62
YW Cheah, J Boverhof, A Elbashandy, D Agarwal, J Leek, T Epperly, J Eslick, D Miller, "Data management and simulation support accelerating carbon capture through computing", Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016, 2017, 389--398, doi: 10.1109/eScience.2016.7870924
Gilberto Z. Pastorello, Dan K. Gunter, Housen Chu, Danielle S. Christianson, Carlo Trotta, Eleonora Canfora, Boris Faybishenko, You-Wei Cheah, Norm Beekwilder, Stephen W. Chan, Sigrid Dengel, Trevor Keenan, Fianna O Brien, Abderahman Elbashandy, Cristina M. Poindexter, Marty Humphrey, Dario Papale, Deb A. Agarwal, "Hunting Data Rogues at Scale: Data Quality Control for Observational Data in Research Infrastructures", Proceedings of the 13th IEEE International Conference on e-Science (e-Science 2017), Auckland, New Zealand, 2017, doi: 10.1109/eScience.2017.64
Gilberto Z. Pastorello, Deb A. Agarwal, Taghrid Samak, Dario Papale, Trotta, Alessio Ribeca, Cristina M. Poindexter, Boris Faybishenko, Dan K. Gunter, Rachel Hollowgrass, Eleonora Canfora, "Observational data patterns for time series data quality assessment", Proceedings of the 10th IEEE International Conference on e-Science (e-Science 2014), Guaruja, Brazil, 2014, doi: 10.1109/eScience.2014.45
Lavanya Ramakrishnan, Sarah S. Poon, Val C. Hendrix, Dan K. Gunter, Gilberto Z. Pastorello, Deb A. Agarwal, "Experiences with User-Centered Design for the Tigres Workflow API", Proceedings of the 10th IEEE International Conference on e-Science (e-Science 2014), Guaruja, Brazil, 2014, doi: 10.1109/eScience.2014.56
JR Balderrama, M Simonin, L Ramakrishnan, V Hendrix, C Morin, D Agarwal, C Tedeschi, "Combining workflow templates with a shared space-based execution model", Proceedings of WORKS 2014: The 9th Workshop on Workflows in Support of Large-Scale Science - held in conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis, 2014, 50--58, doi: 10.1109/WORKS.2014.14
Karen L. Schuchardt, Deborah A. Agarwal, Stefan A. Finsterle, Carl W. Gable, Ian Gorton, Luke J. Gosink, Elizabeth H. Keating, Carina S. Lansing, Joerg Meyer, William A.M. Moeglein, George S.H. Pau, Ellen A. Porter, Sumit Purohit, Mark L. Rockhold, Arie Shoshani, and Chandrika Sivaramakrishnan, Akuna, "Integrated Toolsets Supporting Advanced Subsurface Flow and Transport Simulations for Environmental Management", XIX International Conference on Computational Methods in Water Resources (CMWR 2012), University of Illinois at Urbana-Champaign, June 2012,
- Download File: CMWR-2012.pdf (pdf: 1.9 MB)