From OLTP to Lakehouse : An engineering problem-solution chronicle Sep 18, 2025 Period 0 - Codd's Relational Model (1970s-1980s) In the 1960s and 1970s, as industries like banking, airlines, and retail became increasingly computerized, they faced a problem: the need for systems t... Read more
Data Science and Agile: a love-hate relationship ? Oct 6, 2024 I shall perhaps start this article by distinguishing (albeit in a broad manner) between a discipline and a philosophy. A discipline is a branch of knowledge, a field of study, or an area of expertise.... agile datascience engineering product management Read more
Prompt Engineering Sep 15, 2023 LLMs are sophisticated next-word predictors. An LLM looks at all the words it has been given so far, then calculates the statistical probability of what the very next word should be. This statistical ... Language-Models NLP Prompting Read more
How We Built Our Own ML Infrastructure Jun 10, 2022 As our team’s data science projects’ scope grew, the need for streamlined pipelines and workflows grew. We moved from a collection of ad hoc initiatives to defined projects that require an architectur... dataops devops engineering infrastructure mlops Read more
Lessons Learnt As a Life-Long Student Of Engineering Feb 4, 2022 While pursuing my degree in engineering, my classmates and I would have endless discussions about what makes a good engineer. We would compare engineering curricula, between engineering fields and eng... engineering Read more