search menu icon-carat-right cmu-wordmark

BI/Big Data Reference Architectures and Case Studies

May 2014 Presentation
Serhiy Haziyev (SoftServe, Inc.), Olha Hrytsay (SoftServe, Inc.)

Presentation at SATURN 2014. Presenters explore reference architectures that address the challenges of Big Data.

Publisher:

Software Engineering Institute

This presentation was created for a conference series or symposium and does not necessarily reflect the positions and views of the Software Engineering Institute.

Abstract

If data were equated to temperature in physical analogy, according to the second law of thermodynamics its accumulation would lead to the heat death of the universe. In fact, 90% of the world’s data has been generated during the last two years. Fortunately, business intelligence (BI) architectures and technologies are evolving rapidly to keep up with the exponential rise of data and project complexity. An almost 30-year era of dominance for the relational database management system (RDBMS) ended, and there is no one-size-fits-all solution that solves all of today’s Big Data challenges. BI architecture drivers must change to satisfy new requirements in format, volume, latency, hosting, analysis, reporting, and visualization. In this session, we expose a number of reference architectures that address these challenges and speed up the design and implementation process, making it more predictable and economical:

  • traditional architecture based on an RDMBS data warehouse but modernized with column-based storage to handle a high load and capacity
  • NoSQL-based architectures that address Big Data batch and stream-based processing and use popular NoSQL and complex event-processing solutions
  • hybrid architecture that combines traditional and NoSQL approaches to achieve completeness that would not be possible with either alone

The architectures are accompanied by real-life projects and case studies that the presenters have performed for multiple companies, including Fortune 100 and start-ups.