Welcome to my GitHub profile! I'm a passionate Data Engineer in the healthcare industry hadling finance data, specializing in building scalable data pipelines and cloud-native solutions.
- 🏦 Finance Industry: 3.5 years of hands-on experience in financial data engineering
- ☁️ Cloud-Native Solutions: Designing and implementing data solutions on AWS
- 📊 Data Pipeline Architecture: Building robust ETL/ELT pipelines for financial data processing
- 🔄 Agile Practitioner: Working in collaborative, fast-paced agile environments
AWS Data Services:
- AWS Glue (ETL)
- Amazon S3
- AWS Lambda
- Amazon Redshift
- Amazon Athena
- AWS Step Functions
- Amazon EMR
- AWS Lake Formation
Additional Platforms:
- Databricks (Spark, Delta Lake)
- Python
- SQL
- Scala
- Apache Spark: Large-scale data processing (Databricks, EMR)
- Pandas & NumPy: Data manipulation and analysis
- Pytest: Testing framework for Python applications
Version Control & Collaboration:
- Git & GitHub
- Bitbucket
- Azure Pipelines
- GitHub Actions
Atlassian Suite:
- Jira (Agile/Scrum)
- Bitbucket
- Confluence
- 📊 Design and build scalable data pipelines for financial data processing
- ☁️ Architect cloud-native solutions on AWS and Azure
- 🔧 Develop ETL/ELT workflows using AWS Glue, Python, and Spark
- 📈 Implement data quality frameworks and monitoring solutions
- 🤝 Collaborate in agile teams using Jira and Scrum methodologies
- 🚀 Work with version control systems (Git, Bitbucket, GitHub) and CI/CD tools
- 🌱 Deepening expertise in Python, SQL, and Scala
- 📚 Exploring advanced Apache Spark optimization techniques
- 🔍 Exploring Snowflake for modern cloud data warehousing
- 📊 Learning Tableau, Power BI, and Alteryx for data analytics and visualization
- ☁️ AWS Certified Data Engineer - Associate
- 🏅 AWS Certified Cloud Practitioner
- 🏗️ Data engineering projects (ETL pipelines, data warehousing)
- ☁️ Cloud-native data solutions (AWS, Azure)
- 📊 Open-source data tools and frameworks
- 🤝 Finance domain data projects
- 🧪 Python libraries for data engineering
- 📧 Email: [Your Email]
- 💼 LinkedIn: [Your LinkedIn Profile]
- 🐦 Twitter: [Your Twitter Handle] (optional)
- 🌐 Portfolio: [Your Website] (optional)
Note: Most of my professional work (3.5 years) has been in private company repositories (Bitbucket and enterprise GitHub). My public GitHub contains personal learning projects and experiments.
- 🏦 Financial Data Pipelines: Production ETL pipelines processing millions of transactions daily
- ☁️ AWS Glue Jobs: Serverless data transformation workflows for financial reporting
- 📊 Data Warehousing: Redshift-based analytics platforms with complex data models
- 🔄 CI/CD Automation: Azure Pipelines for automated testing and deployment
- 📈 Data Quality Frameworks: Automated validation and monitoring systems