Distributed big data storage in optical wireless networks

doi:10.1017/CBO9781316162750.007

6 - Distributed big data storage in optical wireless networks

from Part II - Big data over cyber networks

Published online by Cambridge University Press: 18 December 2015

Chen Gong ,

Zhengyuan Xu and

Xiaodong Wang

Edited by

Shuguang Cui ,

Alfred O. Hero, III ,

Zhi-Quan Luo and

José M. F. Moura

Show author details

Chen Gong: Affiliation:
University of Science and Technology of China, China
Zhengyuan Xu: Affiliation:
University of Science and Technology of China, China
Xiaodong Wang: Affiliation:
Columbia University, USA
Shuguang Cui: Affiliation:
Texas A & M University
Alfred O. Hero, III: Affiliation:
University of Michigan, Ann Arbor
Zhi-Quan Luo: Affiliation:
University of Minnesota
José M. F. Moura: Affiliation:
Carnegie Mellon University, Pennsylvania

Book contents

Get access

Summary

We consider a distributed storage system employing some existing regenerate codes where the storage nodes are scattered in an optical wireless network. The data collector (DC) connects to the storage nodes via orthogonal channels and downloads data symbols from these nodes. In the existing data reconstruction schemes for distributed storage systems, the data collector downloads all symbols from a subset of the storage nodes. Such a full downloading approach becomes inefficient in wireless networks since due to fading, the wireless channels may not offer sufficient bandwidths for full downloading. Moreover, full downloading is also less power efficient than partial downloading. Given a coding scheme employed by the wireless distributed storage system, we propose a partial downloading scheme that allows downloading a portion of the symbols from any storage node. We formulate a cross-layer wireless resource allocation problem for data reconstruction in distributed storage systems employing such partial downloading. To derive the fundamental properties of partial downloading as well as to reduce the complexity of wireless resource allocation, we derive necessary and sufficient conditions for data reconstructability for partial downloading, in terms of the numbers of downloaded symbols from the storage nodes.We also propose channel and power allocation schemes for partial downloading in wireless distributed storage systems.

Introduction

The purpose of distributed storage is to store a data file in a distributed manner where the individual storage nodes may be unreliable. This has attracted significant research interests in both communication and computer science fields. The original data file is firstly encoded into multiple coded symbols,which are stored into various storage nodes. Note that, encoded by advanced coding schemes, the original data can be reconstructed if the number of collected data symbols is no less than the number of original data symbols.

Recently, two data encoding schemes for distributed data storage have been proposed, based on rateless coding and network coding [1, 2]. A criterion for distributed data storage is the transmission bandwidth for the reconstruction of the original data file and the repair of a failed storage node. For data reconstruction, a data collector (DC) downloads the symbols in some storage nodes to reconstruct the data. For node regeneration, assuming that a storage node has failed, a new storage node downloads the symbols from some other storage nodes to regenerate the symbols in the failed node.

Information

Type: Chapter
Information: Big Data over Networks , pp. 161 - 179

DOI: https://doi.org/10.1017/CBO9781316162750.007 [Opens in a new window]

Publisher: Cambridge University Press

Print publication year: 2016

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Book purchase

Temporarily unavailable

References

[1] A. G., Dimakis, P. B., Godfrey, Y., Wu, M. J., Wainwright, and K., Ramchandran, “Network coding for distributed storage systems,” IEEE Trans. Info. Theory, vol. 56, no. 9, pp. 4539–4551, September 2010.Google Scholar

[2] Y., Wu, “Existence and construction of capacity-achieving network codes for distributed storage,” IEEE J. Sel. Areas Commun., vol. 28, no. 2, pp. 277–288, February 2010.Google Scholar

[3] C., Gong and X., Wang, “On partial downloading for wireless distributed storage networks,” IEEE Trans. Signal Process., vol. 60, no. 6, pp. 3278–3288, June 2012.Google Scholar

[4] S., Hranilovic and F. R., Kschischang, “Capacity bounds for power-and band-limited optical intensity channels corrupted by Gaussian noise,” IEEE Trans. Info. Theory, vol. 50, no. 5, pp. 784–795, May 2004.Google Scholar

[5] J., Armstrong and A., Lowery, “Power efficient optical OFDM,” Electron. Lett., vol. 42, no. 6, pp. 370–372, 2006.Google Scholar

[6] S., Dissanayake, K., Panta, and J., Armstrong, “A novel technique to simultaneously transmit ACO-OFDM and DCO-OFDM in IM/DD systems,” in 2011 IEEE GLOBECOM OWC Workshops, IEEE, 2011, pp. 782–786.Google Scholar

[7] S. C. J., Lee, S., Randel, F., Breyer, and A. M., Koonen, “PAM-DMT for intensity-modulated and direct-detection optical communication systems,” IEEE Photonics Technol. Lett., vol. 21, no. 23, pp. 1749–1751, 2009.Google Scholar

[8] D., Tsonev, S., Sinanovic, and H., Haas, “Novel unipolar orthogonal frequency division multiplexing (U-OFDM) for optical wireless,” in 2012 IEEE 75th Vehicular Technology Conference (VTC Spring), IEEE, 2012, pp. 1–5.Google Scholar

[9] N.|Fernando, Y.|Hong, and E.|Viterbo, “Flip-OFDM for optical wireless communications,” in 2011 IEEE Information Theory Workshop (ITW), IEEE, 2011, pp. 5–9.

[10] A., Shokrollahi, “Raptor codes,” IEEE Trans. Inform. Theory, vol. 62, no. 6, pp. 2551–2567, June 2006.Google Scholar

[11] M., Luby, “LT codes,” in Proceedings 43rd Annual IEEE Symposium on Foundations of Computer Science, November 2002, pp. 271–282.

[12] Z., Kong, S. A., Aly, and E., Soljanin, “Decentralized coding algorithms for distributed storage in wireless sensor networks,” IEEE J. Sel. Areas Commun., vol. 28, no. 2, pp. 261–267, February 2010.Google Scholar

[13] C., Suh and K., Ramchandran, “Exact-repair MDS code construction using interference alignment,” IEEE Trans. Info. Theory, vol. 57, no. 3, pp. 1425–1442, March 2011.Google Scholar

[14] Y., Wu and A. G., Dimakis, “Reducing repair traffic for erasure coding-based storage via interference alignment,” in 2009 IEEE International Symposium Information Theory (ISIT), Seoul, Korea, June 28–July 3, 2009, pp. 2276–2280.Google Scholar

[15] C., Suh and K., Ramchandran, “Exact-repairMDScodes for distributed storage using interference alignment,” in 2010 IEEE International Symposium Information Theory (ISIT), Austin, Texas, June 2010, pp. 161–165.Google Scholar

[16] K. V., Rashmi, N. B., Shah, P. V., Kumar, and K., Ramchandran, “Explicit and optimal exactregenerating codes for the minimum-bandwidth point in distributed storage,” in 2010 IEEE International Symposium Information Theory (ISIT), Austin, Texas, June 2010, pp. 1938–1942.Google Scholar

[17] N. B., Shah, K. V., Rashmi, and P. V., Kumar, “Flexible class of regenerating codes for distributed storage,” in 2010 IEEE International Symposium Information Theory (ISIT), Austin, Texas, June 2010, pp. 1943–1947.Google Scholar

[18] V. R., Cadambe, S. A., Jafar, and H., Maleki, “Minimum repair bandwidth for exact regeneration in distributed storage,” in 2010 Wireless Network Coding Workshop (WiNC), Boston, Massachusetts, June 2010, pp. 1–6.Google Scholar

[19] K. V., Rashmi, N. B., Shah, P. V., Kumar, and K., Ramchandran, “Explicit construction of optimal exact regenerating codes for distributed storage,” in 2009 Allerton Communication, Control, and Computing (Allerton), October 2009, pp. 1243–1249.Google Scholar

[20] N. B., Shah, K. V., Rashmi, P. V., Kumar, and K., Ramchandran, “Explicit codes minimizing repair bandwidth for distributed storage,” arXiv:0908.2984v2 [cs.IT] 5, September 2009.

[21] K. V., Rashmi, N. B., Shah, and P. V., Kumar, “Optimal exact-regenerating codes for distributed storage at the msr and mbr points via a product-matrix construction,” arXiv:1005.4178v1 [cs.IT] 23, May. 2010.

[22] R., Koetter, M., Effros, and M., Medard, “On a theory of network equivalence,” in 2009 IEEE Information Theory Workshop (ITW), Volos, Greece, June 2009, pp. 326–330.Google Scholar

Accessibility standard: Unknown

Why this information is here

This section outlines the accessibility features of this content - including support for screen readers, full keyboard navigation and high-contrast display options. This may not be relevant for you.

Accessibility Information

Accessibility compliance for the PDF of this chapter is currently unknown and may be updated in the future.