Chapter 1

Parallel Programming Models

Shared memory models and OpenMP API

medium • 1 min read

Message passing models and MPI programming

medium • 2 min read

Data parallel programming models

medium • 3 min read

Task parallelism and thread libraries

medium • 4 min read

Performance metrics: Speedup, Efficiency, Amdahl's Law

medium • 5 min read

Chapter 2

Parallel Algorithms

Parallel sorting (Bitonic sort, Parallel quicksort)

medium • 1 min read

Parallel graph algorithms (BFS, shortest paths)

medium • 2 min read

Parallel matrix multiplication and linear algebra

medium • 3 min read

Prefix sum and scan operations

medium • 4 min read

Load balancing techniques in parallel algorithms

medium • 5 min read

Chapter 3

Distributed System Fundamentals

System models and theoretical foundations

medium • 1 min read

Logical clocks (Lamport, Vector clocks)

medium • 2 min read

Global state recording (Chandy-Lamport algorithm)

medium • 3 min read

Election algorithms (Bully, Ring)

medium • 4 min read

Distributed mutual exclusion algorithms

medium • 5 min read

Chapter 4

Distributed File Systems and Storage

NFS and AFS architectures

medium • 1 min read

Distributed hash tables (Chord, Kademlia)

medium • 2 min read

Replication, consistency models, and Quorum protocols

medium • 3 min read

HDFS architecture and Hadoop ecosystem

medium • 4 min read

Object storage systems and fault tolerance

medium • 5 min read

Chapter 5

Cloud and Edge Distributed Computing

MapReduce programming model and Spark

medium • 1 min read

Stream processing (Apache Kafka, Flink)

medium • 2 min read

Microservices architecture and distributed tracing

medium • 3 min read

Edge and Fog computing paradigms

medium • 4 min read

Blockchain fundamentals and distributed ledgers

medium • 5 min read