The course is organized around reading important papers from conferences and journals. The instructor will lead the lecture. Students are required to read the papers well before the class and send their impressions on the paper via email. These comments will be collated and distributed to the class. Active participation of the students (during the class lectures) is required.

Lecture Schedule

Aug 23	Introduction and course logistics Additional reading (Browse these publications): How much information 2003? (5 exabytes in 2002) Internet Archive (~1 petabyte?) Sanger Institute (~2 TB/wk	Lecture1.ppt Lecture1.pdf
Aug 25	Levy, E. and Silberschatz, A. 1990. Distributed file systems: concepts and examples. ACM Comput. Surv. 22, 4 (Dec. 1990), 321-374. DOI=http://doi.acm.org/10.1145/98163.98169 More info: Birrell, A. D., Levin, R., Schroeder, M. D., and Needham, R. M. 1982. Grapevine: an exercise in distributed computing. Commun. ACM 25, 4 (Apr. 1982), 260-274. DOI=http://doi.acm.org/10.1145/358468.358487 Schroeder, M. D., Birrell, A. D., and Needham, R. M. 1984. Experience with Grapevine: the growth of a distributed system. ACM Trans. Comput. Syst. 2, 1 (Feb. 1984), 3-23. DOI= http://doi.acm.org/10.1145/2080.2081 Gifford, D. K., Needham, R. M., and Schroeder, M. D. 1988. The Cedar file system. Commun. ACM 31, 3 (Mar. 1988), 288-298. DOI= http://doi.acm.org/10.1145/42392.42398	Reviews Lecture2.ppt Lecture2.pdf
	Naming and location
Aug 30	Aug 30: Oppen, D. C. and Dalal, Y. K. 1983. The clearinghouse: a decentralized agent for locating named objects in a distributed environment. ACM Trans. Inf. Syst. 1, 3 (Jul. 1983), 230-253. DOI=http://doi.acm.org/10.1145/357436.357439	Reviews (External review) Lecture3.pdf Lecture3.ppt
Sep 1	Pike, R., Presotto, D., Thompson, K., Trickey, H., and Winterbottom, P. 1993. The use of name spaces in Plan 9. SIGOPS Oper. Syst. Rev. 27, 2 (Apr. 1993), 72-76. DOI=http://doi.acm.org/10.1145/155848.155861	Reviews Lecture4.pdf Lecture4.ppt
Sep 6	Gifford, D. K., Jouvelot, P., Sheldon, M. A., and O'Toole, J. W. 1991. Semantic file systems. In Proceedings of the Thirteenth ACM Symposium on Operating Systems Principles (Pacific Grove, California, United States, October 13 - 16, 1991). SOSP '91. ACM Press, New York, NY, 16-25. DOI=http://doi.acm.org/10.1145/121132.121138	Reviews Lecture5.pdf Lecture5.ppt
Sep 8	Course project "Goals and Objectives" presentation (5 minutes per group) Adjie-Winoto, W., Schwartz, E., Balakrishnan, H., and Lilley, J. 1999. The design and implementation of an intentional naming system. In Proceedings of the Seventeenth ACM Symposium on Operating Systems Principles (Charleston, South Carolina, United States, December 12 - 15, 1999). SOSP '99. ACM Press, New York, NY, 186-201. DOI=http://doi.acm.org/10.1145/319151.319164	Reviews Lecture6.pdf
	Consistency and Replication
Sep 13	Saito, Y. and Shapiro, M. 2005. Optimistic replication. ACM Comput. Surv. 37, 1 (Mar. 2005), 42-81. DOI=http://doi.acm.org/10.1145/1057977.1057980 More info: Demers, A., Greene, D., Hauser, C., Irish, W., Larson, J., Shenker, S., Sturgis, H., Swinehart, D., and Terry, D. 1987. Epidemic algorithms for replicated database maintenance. In Proceedings of the Sixth Annual ACM Symposium on Principles of Distributed Computing (Vancouver, British Columbia, Canada, August 10 - 12, 1987). F. B. Schneider, Ed. PODC '87. ACM Press, New York, NY, 1-12. DOI=http://doi.acm.org/10.1145/41840.41841	Reviews Lecture7.pdf
Sep 15	Richard G. Guy, John S. Heidemann, Wai Mak, Thomas W. Page, Jr., Gerald J. Popek, and Dieter Rothmeier. Implementation of the Ficus Replicated File System. In USENIX Conference Proceedings, pp. 63-71. Anaheim, CA, USENIX. June, 1990. (http://www.isi.edu/~johnh/PAPERS/Guy90b.html)	Reviews Lecture8.ppt Lecture8.ppt
Sep 20	Terry, D. B., Theimer, M. M., Petersen, K., Demers, A. J., Spreitzer, M. J., and Hauser, C. H. 1995. Managing update conflicts in Bayou, a weakly connected replicated storage system. In Proceedings of the Fifteenth ACM Symposium on Operating Systems Principles (Copper Mountain, Colorado, United States, December 03 - 06, 1995). M. B. Jones, Ed. SOSP '95. ACM Press, New York, NY, 172-182. DOI=http://doi.acm.org/10.1145/224056.224070	Reviews Lecture9.pdf
Sep 22	Yu, H. and Vahdat, A. 2002. Design and evaluation of a conit-based continuous consistency model for replicated services. ACM Trans. Comput. Syst. 20, 3 (Aug. 2002), 239-282. DOI=http://doi.acm.org/10.1145/566340.566342	Reviews Lecture10.pdf
	Distributed Storage Management
Sep 27	Out of town to IEEE Secon. Guest lecture - Prof. Ashish Gehani
Sep 29	Wilkes, J., Golding, R., Staelin, C., and Sullivan, T. 1996. The HP AutoRAID hierarchical storage system. ACM Trans. Comput. Syst. 14, 1 (Feb. 1996), 108-136. DOI=http://doi.acm.org/10.1145/225535.225539	Reviews
Oct 4	Alvarez, G. A., Borowsky, E., Go, S., Romer, T. H., Becker-Szendy, R., Golding, R., Merchant, A., Spasojevic, M., Veitch, A., and Wilkes, J. 2001. Minerva: An automated resource provisioning tool for large-scale storage systems. ACM Trans. Comput. Syst. 19, 4 (Nov. 2001), 483-518. DOI=http://doi.acm.org/10.1145/502912.502915	Reviews
Oct 6	Out of town to broadnets: Tentatively - work on course project
Oct 11	Gregory R. Ganger, John D. Strunk, Andrew J. Klosterman. Self-* Storage: Brick-based Storage with Automated Administration. Published as Carnegie Mellon University Technical Report, CMU-CS-03-178, August 2003. (Report)	Reviews
Oct 13	Santry, D. S., Feeley, M. J., Hutchinson, N. C., Veitch, A. C., Carton, R. W., and Ofir, J. 1999. Deciding when to forget in the Elephant file system. In Proceedings of the Seventeenth ACM Symposium on Operating Systems Principles (Charleston, South Carolina, United States, December 12 - 15, 1999). SOSP '99. ACM Press, New York, NY, 110-123. DOI=http://doi.acm.org/10.1145/319151.319159	Reviews
Fall break (Oct 15-23)
Oct 24	Mid-project report due Oct 24 at 23:59:59 EST. Email report as PDF document to surendar@nd.edu
	Security
Oct 25	Oct 25: Out of town to SOSP: Guest Lecture Mazières, D., Kaminsky, M., Kaashoek, M. F., and Witchel, E. 1999. Separating key management from file system security. In Proceedings of the Seventeenth ACM Symposium on Operating Systems Principles (Charleston, South Carolina, United States, December 12 - 15, 1999). SOSP '99. ACM Press, New York, NY, 124-139. DOI=http://doi.acm.org/10.1145/319151.319160	Reviews
Oct 27	Kaminsky, M., Savvides, G., Mazieres, D., and Kaashoek, M. F. 2003. Decentralized user authentication in a global file system. In Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles (Bolton Landing, NY, USA, October 19 - 22, 2003). SOSP '03. ACM Press, New York, NY, 60-73. DOI=http://doi.acm.org/10.1145/945445.945452	Reviews
Nov 1	Gibson, G. A., Nagle, D. F., Amiri, K., Butler, J., Chang, F. W., Gobioff, H., Hardin, C., Riedel, E., Rochberg, D., and Zelenka, J. 1998. A cost-effective, high-bandwidth storage architecture. In Proceedings of the Eighth international Conference on Architectural Support For Programming Languages and Operating Systems (San Jose, California, United States, October 02 - 07, 1998). ASPLOS-VIII. ACM Press, New York, NY, 92-103. DOI= http://doi.acm.org/10.1145/291069.291029 More info: Gibson, G. A., Nagle, D. F., Amiri, K., Chang, F. W., Feinberg, E. M., Gobioff, H., Lee, C., Ozceri, B., Riedel, E., Rochberg, D., and Zelenka, J. 1997. File server scaling with network-attached secure disks. In Proceedings of the 1997 ACM SIGMETRICS international Conference on Measurement and Modeling of Computer Systems (Seattle, Washington, United States, June 15 - 18, 1997). S. Leutenegger, Ed. SIGMETRICS '97. ACM Press, New York, NY, 272-284. DOI= http://doi.acm.org/10.1145/258612.258696	Reviews
Nov 3	Jonathan Ledlie, Chaki Ng, David A. Holland, Kiran-Kumar Muniswamy-Reddy, Uri Braun, and Margo Seltzer. Provenance-Aware Sensor Data Storage (PDF). In Proceedings of NetDB 2005, Tokyo, Japan, April 2005	Reviews
	Peer-to-peer and sensor storage
Nov 8	Adya, A., Bolosky, W. J., Castro, M., Cermak, G., Chaiken, R., Douceur, J. R., Howell, J., Lorch, J. R., Theimer, M., and Wattenhofer, R. P. 2002. Farsite: federated, available, and reliable storage for an incompletely trusted environment. SIGOPS Oper. Syst. Rev. 36, SI (Dec. 2002), 1-14. DOI=http://doi.acm.org/10.1145/844128.844130	Reviews
Nov 10	Beck, M., Moore, T., and Plank, J. S. 2002. An end-to-end approach to globally scalable network storage. In Proceedings of the 2002 Conference on Applications, Technologies, Architectures, and Protocols For Computer Communications (Pittsburgh, Pennsylvania, USA, August 19 - 23, 2002). SIGCOMM '02. ACM Press, New York, NY, 339-346. DOI=http://doi.acm.org/10.1145/633025.633058	Reviews
Nov 15	Maniatis, P., Roussopoulos, M., Giuli, T. J., Rosenthal, D. S., and Baker, M. 2005. The LOCKSS peer-to-peer digital preservation system. ACM Trans. Comput. Syst. 23, 1 (Feb. 2005), 2-50. DOI=http://doi.acm.org/10.1145/1047915.1047917	Reviews
Nov 17	Ganesan, D., Greenstein, B., Perelyubskiy, D., Estrin, D., and Heidemann, J. 2003. An evaluation of multi-resolution storage for sensor networks. In Proceedings of the 1st international Conference on Embedded Networked Sensor Systems (Los Angeles, California, USA, November 05 - 07, 2003). SenSys '03. ACM Press, New York, NY, 89-102. DOI=http://doi.acm.org/10.1145/958491.958502	Reviews
Nov 22	Ghemawat, S., Gobioff, H., and Leung, S. 2003. The Google file system. In Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles (Bolton Landing, NY, USA, October 19 - 22, 2003). SOSP '03. ACM Press, New York, NY, 29-43. DOI= http://doi.acm.org/10.1145/945445.945450	Reviews
Nov 24	Thanksgiving
Nov 29	Rowstron, A. and Druschel, P. 2001. Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. In Proceedings of the Eighteenth ACM Symposium on Operating Systems Principles (Banff, Alberta, Canada, October 21 - 24, 2001). SOSP '01. ACM Press, New York, NY, 188-201. DOI=http://doi.acm.org/10.1145/502034.502053	Reviews
	Energy management
Dec 01	Qingbo Zhu, Zhifeng Chen, Lin Tan, Yuanyuan Zhou, Kimberley Keeton and John Wilkes. "Hibernator: Helping disk array sleep through the winter". To appear in the 20th ACM Symposium on Operating Systems Principles (SOSP'05), October 2005 (DOI=http://doi.acm.org/10.1145/1095810.1095828)	Reviews
Dec 06	Project presentations
Dec 10	Final paper report due

 

Great papers, wish we can discuss them in class

1. Colarelli, D. and Grunwald, D. 2002. Massive arrays of idle disks for storage archives. In Proceedings of the 2002 ACM/IEEE Conference on Supercomputing (Baltimore, Maryland). Conference on High Performance Networking and Computing. IEEE Computer Society Press, Los Alamitos, CA, 1-11 (PDF)
2. Kubiatowicz, J., Bindel, D., Chen, Y., Czerwinski, S., Eaton, P., Geels, D., Gummadi, R., Rhea, S., Weatherspoon, H., Wells, C., and Zhao, B. 2000. OceanStore: an architecture for global-scale persistent storage. In Proceedings of the Ninth international Conference on Architectural Support For Programming Languages and Operating Systems (Cambridge, Massachusetts, United States). ASPLOS-IX. ACM Press, New York, NY, 190-201. DOI= http://doi.acm.org/10.1145/378993.379239
3. Muthitacharoen, A., Morris, R., Gil, T. M., and Chen, B. 2002. Ivy: a read/write peer-to-peer file system. SIGOPS Oper. Syst. Rev. 36, SI (Dec. 2002), 31-44. DOI= http://doi.acm.org/10.1145/844128.844132
4. Magoutis, K., Addetia, S., Fedorova, A., Seltzer, M. I., Chase, J. S., Gallatin, A. J., Kisley, R., Wickremesinghe, R., and Gabber, E. 2002. Structure and Performance of the Direct Access File System. In Proceedings of the General Track: 2002 USENIX Annual Technical Conference (June 10 - 15, 2002). C. S. Ellis, Ed. USENIX Association, Berkeley, CA, 1-14 (PDF)
5. L. Huston, R. Sukthankar, R. Wickremesinghe, M. Satyanarayanan, G.R. Ganger, E. Riedel, and A. Ailamaki. Diamond: A Storage Architecture for Early Discard in Interactive Search Proceedings of Usenix File and Storage Technologies (FAST), April, 2004. (PDF)
6. Pillai, P., Ke, Y., and Campbell, J. 2004. Multi-fidelity storage. In Proceedings of the ACM 2nd international Workshop on Video Surveillance & Sensor Networks (New York, NY, USA, October 15 - 15, 2004). VSSN '04. ACM Press, New York, NY, 72-79. DOI= http://doi.acm.org/10.1145/1026799.1026812
7. Saito, Y., Karamanolis, C., Karlsson, M., and Mahalingam, M. 2002. Taming aggressive replication in the Pangaea wide-area file system. SIGOPS Oper. Syst. Rev. 36, SI (Dec. 2002), 15-30. DOI= http://doi.acm.org/10.1145/844128.844131
8. Lee, E. K. and Thekkath, C. A. 1996. Petal: distributed virtual disks. In Proceedings of the Seventh international Conference on Architectural Support For Programming Languages and Operating Systems (Cambridge, Massachusetts, United States, October 01 - 04, 1996). ASPLOS-VII. ACM Press, New York, NY, 84-92. DOI= http://doi.acm.org/10.1145/237090.237157
• Thekkath, C. A., Mann, T., and Lee, E. K. 1997. Frangipani: a scalable distributed file system. In Proceedings of the Sixteenth ACM Symposium on Operating Systems Principles (Saint Malo, France, October 05 - 08, 1997). W. M. Waite, Ed. SOSP '97. ACM Press, New York, NY, 224-237. DOI= http://doi.acm.org/10.1145/268998.266694
9. Cox, L. P. and Noble, B. D. 2003. Samsara: honor among thieves in peer-to-peer storage. In Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles (Bolton Landing, NY, USA, October 19 - 22, 2003). SOSP '03. ACM Press, New York, NY, 120-132. DOI= http://doi.acm.org/10.1145/945445.945458
10. Hartman, J. H. and Ousterhout, J. K. 1995. The Zebra striped network file system. ACM Trans. Comput. Syst. 13, 3 (Aug. 1995), 274-310. DOI= http://doi.acm.org/10.1145/210126.210131
11. Sumeet Sobti, Nitin Garg, Fengzhou Zheng, Junwen Lai, Yilei Shao, Chi Zhang, Elisha Ziskind, Arvind Krishnamurthy, and Randolph Y. Wang. Segank: A Distributed Mobile Storage System. Proc. Third Conference on File and Storage Technologies. March 2004. (PDF)
12. Lumb, C. R. and Golding, R. 2004. D-SPTF: decentralized request distribution in brick-based storage systems. In Proceedings of the 11th international Conference on Architectural Support For Programming Languages and Operating Systems (Boston, MA, USA, October 07 - 13, 2004). ASPLOS-XI. ACM Press, New York, NY, 37-47. DOI= http://doi.acm.org/10.1145/1024393.1024399
13. Edmund B. Nightingale, Peter M. Chen, and Jason Flinn Speculative Execution in a Distributed File System. To appear in the 20th ACM Symposium on Operating Systems Principles (SOSP'05), October 2005 (PDF)

---