Data Engineering

Energy price scraping and monitoring for German utilities

Python-based scraping and monitoring tool for electricity and gas tariffs from multiple German energy providers, with both CLI and Streamlit UI for fast checks.

I designed and built a reusable scraping pipeline that systematically collects electricity and gas tariff data from German energy provider websites, normalizes the results, and writes them to structured CSV outputs for analysis and reporting. The system can be run via a command-line interface for scheduled batch jobs and through a Streamlit web app for interactive exploration, quick comparisons, and ad-hoc checks of current prices. The project was delivered as part of my self-employment for a large Berlin-based energy company and demonstrates how to turn fragmented public tariff information into an internal monitoring tool.

Dashboard-style visualization of electricity and gas price charts for German utilities on a dark background

Architecture and Stack

PythonRequestsBeautifulSouplxmlhtml5libpandasNumPyStreamlitPlotlyCLI