2 results
5 - Large-Scale Data Management Techniques in Cloud Computing Platforms
-
- By Sherif Sakr, National ICT Australia (NICTA), University of New SouthWales, Anna Liu, National ICT Australia (NICTA), University of New South Wales
- Edited by Ian Gorton, Deborah K. Gracio
-
- Book:
- Data-Intensive Computing
- Published online:
- 05 December 2012
- Print publication:
- 29 October 2012, pp 85-123
-
- Chapter
- Export citation
-
Summary
Introduction
In the last two decades, the continuous increase of computational power has produced an overwhelming flow of data, which called for a paradigm shift in the computing architecture and large scale data processing mechanisms. In a speech given just a few weeks before he was lost at sea off the California coast in January 2007, Jim Gray, a database software pioneer and a Microsoft researcher, called the shift a “fourth paradigm” [32]. The first three paradigms were experimental, theoretical and, more recently, computational science. Gray argued that the only way to cope with this paradigm is to develop a new generation of computing tools to manage, visualize, and analyze the data flood. In general, the current computer architectures are increasingly imbalanced where the latency gap between multicore CPUs and mechanical hard disks is growing every year, which makes the challenges of data-intensive computing harder to overcome [6]. Therefore, there is a crucial need for a systematic and generic approach to tackle these problems with an architecture that can also scale into the foreseeable future. In response, Gray argued that the new trend should instead focus on supporting cheaper clusters of computers to manage and process all this data instead of focusing on having the biggest and fastest single computer. Figure 5.1 illustrates an example of the explosion in scientific data, which creates major challenges for cutting-edge scientific projects. For example, modern high-energy physics experiments, such as DZero, typically generate more than one terabyte of data per day.
Contributors
-
- By Basem Abdelmalak, Joseph Abdelmalak, Alaa A. Abd-Elsayed, David L. Adams, Eric E. Adelman, Maged Argalious, Endrit Bala, Gene H. Barnett, Sheron Beltran, Andrew Bielaczyc, William Bingaman, James M. Blum, Alina Bodas, Vera Borzova, Richard Bowers, Adam Brown, Chad M. Brummett, Alexandra S. Bullough, James F. Burke, Juan P. Cata, Neeraj Chaudhary, Michael J. Claybon, Miguel Cruz, Milind Deogaonkar, Vikram Dhawan, Thomas Didier, D. John Doyle, Zeyd Ebrahim, Hesham Elsharkawy, Wael Ali Sakr Esa, Ehab Farag, Ryen D. Fons, Joseph J. Gemmete, Matt Giles, Phil Gillen, Goodarz Golmirzaie, Marcos Gomes, Lisa Grilly, Maged Guirguis, David W. Healy, Heather Hervey-Jumper, Shawn L. Hervey-Jumper, Paul E. Hilliard, Samuel A. Irefin, George K. Istaphanous, Teresa L. Jacobs, Ellen Janke, Greta Jo, James W. Jones, Rami Karroum, Allen Keebler, Stephen J. Kimatian, Colleen G. Koch, Robert Scott Kriss, Andrea Kurz, Jia Lin, Michael D. Maile, Negmeldeen F. Mamoun, Mariel Manlapaz, Edward Manno, Donn Marciniak, Piyush Mathur, Nicholas F. Marko, Matthew Martin, George A. Mashour, Marco Maurtua, Scott T. McCardle, Julie McClelland, Uma Menon, Paul S. Moor, Laurel E. Moore, Ruairi Moulding, Dileep R. Nair, Todd Nelson, Julie Niezgoda, Edward Noguera, Jerome O’Hara, Aditya S. Pandey, Mauricio Perilla, Paul Picton, Marc J. Popovich, J. Javier Provencio, Venkatakrishna Rajajee, Mohit Rastogi, Stacy Ritzman, Lauryn R. Rochlen, Leif Saager, Vivek Sabharwal, Oren Sagher, Kenneth Saliba, Milad Sharifpour, Lesli E. Skolarus, Paul Smythe, Wolf H. Stapelfeldt, William R. Stetler, Peter Stiles, Vijay Tarnal, Khoi D. Than, B. Gregory Thompson, Alparslan Turan, Christopher R. Turner, Justin Upp, Sumeet Vadera, Jennifer Vance, Anthony C. Wang, Robert J. Weil, Marnie B. Welch, Karen K. Wilkins, Erin S. Williams, George N. Youssef, Asma Zakaria, Sherif S. Zaky, Andrew Zura
- Edited by George A. Mashour, Ehab Farag
-
- Book:
- Case Studies in Neuroanesthesia and Neurocritical Care
- Published online:
- 03 May 2011
- Print publication:
- 03 February 2011, pp x-xvi
-
- Chapter
- Export citation