Skip to content
View hussein-awala's full-sized avatar

Organizations

@apache @VoodooTeam

Block or report hussein-awala

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
hussein-awala/README.md

Hi there, I'm Hussein

About Myself:

  • πŸ‘¨πŸΌβ€πŸ’» I'm a Senior Data Engineer within the Ads Network team at Voodoo in Paris, and an Apache committer and PMC member at Apache Airflow
  • πŸ’‘ I design, develop and maintain data platforms, especially the modern lakehouse architectures and the stream processing applications
  • πŸ”¬ I am responsible for serving and improving the performance of the ML models and the feature store
  • πŸ”’ I ensure the security of user data on the data platform, in compliance with the regulations in force (GDPR, e-privacy)
  • 🀝🏻 I contribute to different popular open-source projects (Airflow, Iceberg, Hudi, ...) and my own open-source projects (spark-on-k8s, airflow-duckdb, and async-batcher)
  • ⚑ Fun fact: I am always seeking new opportunities to learn. Also, I love to cook, swim and watch movies or TV series.
Projects I am working on currently:

  • Improving the performance of a real-time bidding system by implementing a batching mechanism to reduce the resource consumption and the latency, and by optimizing the feature store structure and data freshness
  • Designing and developing a new lakehouse architecture using spark, iceberg, airflow, dbt and S3, to store the company data in a modern and cheap data store respecting the GDPR
Some frameworks I am working with currently πŸ’»:

Airflow Spark Iceberg Hudi Kubernetes Python Java Docker Argo Workflows
Some of my GitHub Stats:

Connect with me:

husseinawala | LinkedIn

hussein-awala

Pinned Loading

  1. spark-on-k8s spark-on-k8s Public

    A Python package to submit and manage Apache Spark applications on Kubernetes.

    Python 41 6

  2. async-batcher async-batcher Public

    A service to batch the http requests.

    Python 23 3

  3. airflow-duckdb airflow-duckdb Public

    A package to run DuckDB queries from Apache Airflow.

    Python 16 3

  4. airflow-server airflow-server Public

    Docker configuration for airflow server with Localexecutor

    Python 4 6