Four Apache Airflow internals you might have missed Image generated via DALL-EI have been working with Airflow for more than three years now and overall, I am quite confident with it. It’s a powerful orchestrator that helps me build data pipelines quickly and in a scalable fashion while for most things I am looking to…
Image generated with Segmind SSD-1B model
Given how competitive the tech job market is right now, you should constantly upskill and improve your technical chops. For any role in data and software engineering, the interview process typically starts with a round or two of coding interviews.
While projects and technical expertise will help…
Insights after two years in the industry Example of an encoder and a graph in the latent space (image by author)The scenario: a high-speed production line is producing thousands of products. Two cameras are installed to continuously control the quality of each product. The goal: develop an algorithm that can check each product as fast…
Image by Author
Diving into the world of data science and machine learning, one of the fundamental skills you'll encounter is the art of reading data. If you have already some experience with it, you're probably familiar with JSON (JavaScript Object Notation) - a popular format for both storing and exchanging data.
Think…
If you have been experimenting with large language models (LLMs) for search and retrieval tasks, you have likely come across retrieval augmented generation (RAG) as a technique to add relevant contextual information to LLM generated responses. By connecting an LLM to private data, RAG can enable a better response by feeding relevant data in the…
Image by Author
In this tutorial, we will learn how to set up and use the OpenAI API for various use cases. The tutorial is designed to be easy to follow, even for those with limited knowledge of Python programming. We'll explore how anyone can generate responses and access high-quality large language models.…
Image generated by MidjourneyAnd 5 ways to use it in data science and machine learning @property is my favorite decorator in Python. I have been using Python for many years now, and with each passing year, my expertise and comfort level with the language gradually grows. Among all the techniques and tricks that I’ve learned…
Artificial intelligence (AI) is rapidly gaining momentum as people explore how it might make their lives easier by saving time, reducing errors and improving outcomes. One emerging possibility is to use the technology to handle chemistry experiments.
Although running experiments to learn new things in the lab is an important part of helping chemists…
Image by Editor
The world is moving fast. Real fast and sometimes it’s hard to keep up with what’s going on, what’s new, how things work and what we should expect. Podcasts are a great way to constantly stay tuned with all these updates - especially when you’re on the go.
I have…
Transformers have found widespread application in diverse tasks spanning text classification, map construction, object detection, point cloud analysis, and audio spectrogram recognition. Their versatility extends to multimodal tasks, exemplified by CLIP’s use of image-text pairs for superior image recognition. This underscores transformers’ efficacy in establishing universal sequence-to-sequence modeling, creating embeddings that unify data representation across…