Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-5b777bbd6c-cp4x8 Total loading time: 0 Render date: 2025-06-18T17:39:22.677Z Has data issue: false hasContentIssue false

6 - Visualization and debugging

from Part II - Application development

Published online by Cambridge University Press:  05 March 2014

Henrique C. M. Andrade ,
Buğra Gedik  and
Deepak S. Turaga
Henrique C. M. Andrade
Affiliation:
J. P. Morgan
Buğra Gedik
Affiliation:
Bilkent University, Ankara
Deepak S. Turaga
Affiliation:
IBM Thomas J. Watson Research Center, New York
Get access

Summary

Overview

In this chapter, we examine visualization and debugging as well as the relationship of these services and the infrastructure provided by a SPS. Visualization and debugging tools help developers and analysts to inspect and to understand the current state of an application and the data flow between its components, thus mitigating the cognitive and software engineering challenges associated with developing, optimizing, deploying, and managing SPAs, particularly the large-scale distributed ones.

On the one hand, visualization techniques are important at development time, where the ability to picture the application layout and its live data flows can aid in refining its design.

On the other hand, debugging techniques and tools, which are sometimes integrated with visualization tools, are important because the continuous and critical nature of some SPAs requires the ability to effectively diagnose and address problems before and after they reach a production stage, where disruptions can have serious consequences.

This chapter starts with a discussion of software visualization techniques for SPAs (Section 6.2), including the mechanisms to produce effective visual representations of an application's data flow graph topology, its performance metrics, and its live status.

Debugging is intimately related to visualization. Hence, the second half of this chapter focuses on the different types of debugging tasks used in stream processing (Section 6.3).

Visualization

Comprehensive visualization infrastructure is a fundamental tool to support the development, understanding, debugging, and optimization of SPAs.

Type
Chapter
Information
Fundamentals of Stream Processing
Application Design, Systems, and Analytics
 , pp. 178 - 200
Publisher: Cambridge University Press
Print publication year: 2014

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Book purchase

Temporarily unavailable

References

[1] De Pauw, W, Andrade, H. Visualizing large-scale streaming applications. Information Visualization. 2009;8(2):87–106.CrossRefGoogle Scholar
[2] Yau, N. Visualize This: The FlowingData Guide to Design, Visualization, and Statistics. John Wiley & Sons, Inc.; 2011.Google Scholar
[3] Few, S. Now You See It: Simple Visualization Techniques for Quantitative Analysis. Analytic Press; 2009.Google Scholar
[4] Steele, J, Iliinsky, N, editors. Beautiful Visualization: Looking at Data through the Eyes of Experts (Theory in Practice). O'Reilly Media; 2010.
[5] Telea, AC. Data Visualization. A K Peters, Ltd; 2007.Google Scholar
[6] Ward, MO, Grinstein, G, Keim, D. Interactive Data Visualization: Foundations, Techniques, and Applications. A K Peters, Ltd; 2010.Google Scholar
[7] Wong, DM. The Wall Street Journal Guide to Information Graphics: The Dos and Don'ts of Presenting Data, Facts, and Figures. W. W. Norton & Company; 2010.Google Scholar
[8] Adobe. Using Adobe Flex 4.6. Adobe Systems; 2011.
[9] TIBCO Spotfire; retrieved in September 2012. http://spotfire.tibco.com.
[10] Janert, PK. Gnuplot in Action: Understanding Data with Graphs. Manning Publications; 2009.Google Scholar
[11] Geist, A, Beguelin, A, Dongarra, J, Jiang, W, Mancheck, R, Sunderam, V. PVM: Parallel Virtual Machine. A Users' Guide and Tutorial for Networked Parallel Computing. MIT Press; 1994.Google Scholar
[12] Gropp, W, Lusk, E, Skjellum, A. Using MPI: Portable Parallel Programming with Message-Passing Interface. MIT Press; 1999.Google Scholar
[13] Gedik, B, Andrade, H, Frenkiel, A, De Pauw, W, Pfeifer, M, Allen, P, et al.Debugging tools and strategies for distributed stream processing applications. Software: Practice & Experience. 2009;39(16):1347–1376.Google Scholar
[14] De Pauw, W, Letia, M, Gedik, B, Andrade, H, Frenkiel, A, Pfeifer, M, et al.Visual debugging for stream processing applications. In: Proceedings of the International Conference on Runtime Verification (RV). St Julians, Malta; 2010. pp. 18–35.Google Scholar
[15] Stallman, RM, CygnusSupport. Debugging with GDB – The GNU Source-Level Debugger. Free Software Foundation; 1996.Google Scholar
[16] Park, Y, King, R, Nathan, S, Most, W, Andrade, H. Evaluation of a high-volume, low-latency market data processing sytem implemented with IBM middleware. Software: Practice & Experience. 2012;42(1):37–56.Google Scholar
[17] Sobeih, A, Hack, M, Liu, Z, Zhang, L. Almost peer-to-peer clock synchronization. In: Proceedings of the IEEE International Conference on Parallel and Distributed Processing Systems (IPDPS). Long Beach, CA; 2007. pp. 1–10.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×