- Current Stats
- Data Engineer at TogetherCrew
- Volunteer work
- Built Cassandra Group during Masters degree
- Aiming to share about AI staff
- Web page: https://cass-ai.github.io/
- Youtube page: https://www.youtube.com/@cassandraai
- GitHub Page: https://github.com/cass-ai
- Stats:
- Two phases of article reading were done with each having 5 meetings.
- A conference on 29th and 30th of May 2022 was taken place
Developed a RAG pipeline that ingests data from various platforms and generates responses based on the data. Listened on a message broker to receive messages, performed RAG operations on the data, and sent the responses to another microservice via the broker. Link to codes
A set of ETL scripts to embed raw data For RAG pipeline. The scripts were written on Apache Airflow service and they included both raw data processing and summary data. Link to codes
Multiple sets of ETL scripts written as Apache Airflow DAGs to transform any platform data to a general data structure that could be used for many tasks such as Analytics, Text Classification, and Embedding ETLs. Link to codes
Fine-tuned a Large Language Model (LLM) to classify text messages for detecting violations. Developed pipelines to prompt the fine-tuned model for message labeling and to fire violation reports to another microservice via a broker. Link to codes
Developed a Python library for custom analytics on data from various platforms. The library categorized members based on their community activity and performed graph analytics. Link to codes
- Python
- PostgreSql, Neo4j, MongoDB databases
- RabbitMQ
- Apache Airflow
- Docker
- Flask
- Latex
- Git
- Mail: [email protected]
- LinkedIn: linkedin.com/in/mramin22/
- Discord: mramin22#1669
- Twitter: @mramin22
After Everything, what is left is kindness, So don't hesitate to help others. 🙂