Navigating Nested Loops and Memory Challenges for Seamless Performance using Python Photo by Kevin Canlas on UnsplashIn this exploration of Python code optimization, we look at common issues that impede performance resulting in overheads. We analyze two issues here- one related to nested loops, and the other related to memory/allocation issues caused by reading huge…

You can start your data science journey at any time; expanding your skill set should be an ongoing, yearlong process. Still, even those of us who are skeptical of new year’s resolutions can’t deny the sense of excitement and opportunity that comes with a whole, blank-slate year on the horizon. What better time to take…

Photo by Jon Tyson on UnsplashLet us consider a nonlinear function f(x), where x is a continuous variable. We would like to find the minimum value of this function f(x) by changing our decision variable x. The optimization problem can mathematically be formulated in the following manner: In most cases, the user comes across some…

There exist publicly accessible data which describe the socio-economic characteristics of a geographic location. In Australia where I reside, the Government through the Australian Bureau of Statistics (ABS) collects and publishes individual and household data on a regular basis in respect of income, occupation, education, employment and housing at an area level. Some examples of…

Photo by Mathew Schwartz on UnsplashIn the previous article, we discussed the surprising behavior of data in higher dimensions. We found that volume tends to accumulate in the corners of spaces in a strange way, and we simulated a hypersphere inscribed inside a hypercube to investigate this, observing an interesting decrease in their volume ratio…

Understand batch processing from business and technical perspective Photo by Dannie Sorum on UnsplashWe live in a world where every human interaction becomes an event in the system, whether it’s purchasing clothes online or in-store, scrolling social media, or taking an Uber. Unsurprisingly, all these events are processed in one way or the other.…

Gain intuition behind acceleration training techniques in neural networks D eep learning made a gigantic step in the world of artificial intelligence. At the current moment, neural networks outperform other types of algorithms on non-tabular data: images, videos, audio, etc. Deep learning models usually have a strong complexity and come up with millions or even…

What it is and How to apply it to a real-world scenario Photo by Google DeepMind on UnsplashThis year, my resolution is to go back to the basics of data science. I work with data every day, but it’s easy to forget how some of the core algorithms function if you’re completing repetitive tasks. I’m…

Exploring the Transformer’s Decoder Architecture: Masked Multi-Head Attention, Encoder-Decoder Attention, and Practical Implementation This post was co-authored with Rafael Nardi. In this article, we delve into the decoder component of the transformer architecture, focusing on its differences and similarities with the encoder. The decoder’s unique feature is its loop-like, iterative nature, which contrasts with the…

Turn a government PDF into a financial planning tool Photo by Robert Murray on Unsplash!Hierarchical data is a data model where items are linked to each other in parent-child relationships, forming a tree structure. Some obvious examples are family trees and corporate organization charts. A treemap is a diagram that represents hierarchical data using nested…