Somto Afudoh

Data
Engineer

Building scalable data pipelines and automated ETL workflows with Python, SQL, Apache Airflow, and cloud technologies.

Continue
Featured project · Resilient data engineering

Project RISING

Resilient Intelligent Surveillance & Integrated Next-Generation Healthcare

Project RISING data flow from ASEAN health facilities and simulated weather events through unreliable connectivity, retry recovery, checkpoint-based deduplication, validation, PostgreSQL storage, and dead-letter routing.

Project RISING keeps public-health data flowing through unreliable connectivity. It combines a tested ASEAN health-data batch pipeline with a simulated weather-event stream, retry recovery, checkpoint-based deduplication, dead-letter routing, and a PostgreSQL warehouse.

0trusted records lost
6events preserved
1failure recovered
1invalid event isolated
  • Python
  • Pandas
  • Pandera
  • Pytest
  • PostgreSQL
  • Docker
  • Streamlit

Reliable data, built for impact

I’m a results-driven Data Engineer who builds scalable ETL pipelines, optimizes cloud data architectures, and automates complex workflows. With experience across Python, SQL, Apache Airflow, AWS, and Azure—and a strong foundation in quality assurance and data validation—I create dependable data solutions that improve accuracy, efficiency, and decision-making.

My work focuses on turning complex data environments into high-performing systems, from reducing storage costs and improving processing efficiency to delivering analytics-ready datasets and interactive dashboards.

Skills & technologies

Data engineering

Python · SQL · Apache Airflow · Apache Spark · Apache Kafka · Apache Hadoop

Cloud & databases

AWS · Microsoft Azure · Google Cloud Platform · PostgreSQL · MySQL

Quality & analytics

Data cleaning and validation · Test automation · Quality assurance · Data analysis and visualization

Additional

Java · Troubleshooting and systems support · A/B testing fundamentals · Applied machine learning fundamentals · Active Directory