Weekend experiments with Generative AI — Part 1Generative AI has been blowing everyone’s mind. I am no exception. Like many others, I do my daily conversations with ChatGPT or Bard…May 29, 2023May 29, 2023
Capacity estimation for compute heavy web applicationsEstimating the number of cores, memory and disk your application needs is pivotal to ensuring optimal resource usage and minimising cost…Jul 29, 2022Jul 29, 2022
Spark Streaming — the Good, the Bad and the UglyStream processing systems have become increasingly popular in the last decade. It found its usage in a variety of real time systems across…Oct 25, 2021Oct 25, 2021
The “I” in ACID — Weak Isolation LevelsACID is an acronym for Atomicity, Consistency, Isolation and Durability. ACID compliant databases providesOct 20, 2021Oct 20, 2021
Amazon Dynamo — a conceptual overview (Part 3)In Part 1 and Part 2 of the series, I talked about all the cool concepts used in Amazon Dynamo. The key aspect of the system is the…Jul 7, 2021Jul 7, 2021
Amazon Dynamo — a conceptual overview (Part 2)In Part 1 of this series, we saw the various techniques that Amazon Dynamo employs to achieve high availability for write requests. In…Jul 6, 20211Jul 6, 20211
Amazon Dynamo — a conceptual overview (Part 1)I happened to read the Amazon Dynamo paper recently. I had read it before but not intently as this time around. Its architecture manages…Jul 5, 2021Jul 5, 2021
Thundering Herd and Stale Set OperationsIn the Internet, a lot of content is consumed on a daily basis. For global services like Google, Facebook, Netflix, etc serving this data…Jun 22, 2021Jun 22, 2021
Materialising de-normalised views from a relational datasetAs the name suggests, Relation Databases are used to store entities and the relationships between them in a normalised manner. Addition to…Jun 22, 20211Jun 22, 20211
SSTables and LSM TreesSSTables and LSM-Trees are techniques which are used to efficiently store and retrieve data. In this post, we will limit our discussion to…Jun 21, 20214Jun 21, 20214