Rahul Pradeep·May 29, 2023Weekend experiments with Generative AI — Part 1Generative AI has been blowing everyone’s mind. I am no exception. Like many others, I do my daily conversations with ChatGPT or Bard…
Rahul Pradeep·Jul 29, 2022Capacity estimation for compute heavy web applicationsEstimating the number of cores, memory and disk your application needs is pivotal to ensuring optimal resource usage and minimising cost…
Rahul Pradeep·Oct 25, 2021Spark Streaming — the Good, the Bad and the UglyStream processing systems have become increasingly popular in the last decade. It found its usage in a variety of real time systems across…
Rahul Pradeep·Oct 20, 2021The “I” in ACID — Weak Isolation LevelsACID is an acronym for Atomicity, Consistency, Isolation and Durability. ACID compliant databases provides
Rahul Pradeep·Jul 7, 2021Amazon Dynamo — a conceptual overview (Part 3)In Part 1 and Part 2 of the series, I talked about all the cool concepts used in Amazon Dynamo. The key aspect of the system is the…
Rahul Pradeep·Jul 6, 2021Amazon Dynamo — a conceptual overview (Part 2)In Part 1 of this series, we saw the various techniques that Amazon Dynamo employs to achieve high availability for write requests. In…A response icon1A response icon1
Rahul Pradeep·Jul 5, 2021Amazon Dynamo — a conceptual overview (Part 1)I happened to read the Amazon Dynamo paper recently. I had read it before but not intently as this time around. Its architecture manages…
Rahul Pradeep·Jun 22, 2021Thundering Herd and Stale Set OperationsIn the Internet, a lot of content is consumed on a daily basis. For global services like Google, Facebook, Netflix, etc serving this data…
Rahul Pradeep·Jun 22, 2021Materialising de-normalised views from a relational datasetAs the name suggests, Relation Databases are used to store entities and the relationships between them in a normalised manner. Addition to…A response icon1A response icon1
Rahul Pradeep·Jun 21, 2021SSTables and LSM TreesSSTables and LSM-Trees are techniques which are used to efficiently store and retrieve data. In this post, we will limit our discussion to…A response icon4A response icon4