Lambda Architecture

Lambda Architecture

This is a data processing architecture and framework designed to address robustness of the scalability and fault tolerance of big data systems. A Lambda Architecture also makes a balance between latency and accuracy of the system. This consists of three layers i.e. Batch Layer, Speed layer and Serving layer.

Why Lambda

This architecture is called Lambda Architecture because it has to two producing layers i.e. batch and speed, which represents two legs/branches of the Lambda symbol.

Batch Layer

  • Holds the master data
  • Immutable data
  • Holds the truth
  • Provides input to the batch views on the serving layer

Speed Layer

  • Temporal in nature
  • Get Speed at cost of accuracy
  • Provides near real time (micro batch) views on the serving layer

Serving Layer

  • You get the view of both batch and speed layers