Python Enthusiast and Data Engineer

Nils Braun

Query your (big) data with the power of python, dask and SQL

This post will describe what an SQL query engine is and how you can use dask-sql to analyze your data quickly and easily and also call complex algorithms, such as machine learning, from SQL.

Real-Time Feature Extraction with tsfresh and streamz

In this post, we will built a real-time feature extraction pipeline for time series data.

Writing a GitHub Action in TypeScript from Scratch

We will build a small GitHub action with TypeScript in this post!

Measuring tsfresh's execution time

This blog post will describe how to measure the execution times of applying tsfresh’s feature extraction on various different time series and discuss the results.

tsfresh on Large Data Samples - Part II

In the last post we have explored how tsfresh automatically extracts many time series features from your input data. We have also discussed two possibilities to speed up your feature extraction calculation: using multiple cores on your local machine (which is already tuned on by default) or distributing the calculation over a cluster of machines.

Time Series Feature Extraction on (Really) Large Data Samples

Time Series data is everywhere today. From stock market trends to EEG measurements, from Industry 4.0 production lines to IoT sensors - temporarily annotated data hides in a lot of places. It comes in many flavours, sizes and complexities.

Lambda IV: Use the Power of Lambda

In my last post in this series, we have developed all the building blogs for our data science application - we only miss the parallelisation setup.

Lambda III: Data Science with Amazon Lambda

After we have done the basic setup in the last post we are now ready to add some real data science application and fully use the parallelisation of Lambda. We will write a very simple map-framework for this.

Lambda II: Simple map framework for Amazon Lambda using zappa

This blog will walk you through the basic setup to develop applications with Amazon Lambdas and zappa - including registration, basic setup and your first website.

Why you should use Amazon Lambda for your data science application

Have you ever thought about writing your own data science application/platform in the cloud? But you do not know where to start and with which technologies? This post will talk about Amazon Lambda and why it will help you develop data science applications quickly.

Welcome to my blog!

On these sites, I will blog on software development for high energy physics (my PhD thesis), data science and python (my hobby) and everything related to this.