[Remote] Data Engineer Azure Cloud
Note: The job is a remote job and is open to candidates in USA. Diverse Lynx is seeking a Data Engineer with strong hands-on experience in Azure Cloud technologies. The ideal candidate will design, develop, and optimize scalable data pipelines and cloud-based data solutions while collaborating effectively with cross-functional teams and business stakeholders.
Responsibilities
- Designing, developing, and optimizing scalable data pipelines and cloud-based data solutions
- Expertise in ETL/ELT processing, data modeling, performance tuning, and data governance
- Proficiency in Python, SQL, GitHub, and CI/CD practices
- Working with large-scale datasets in enterprise environments
- Strong analytical and problem-solving skills
- Ability to work independently
- Ownership of end-to-end solution delivery
- Collaborating effectively with cross-functional teams and business stakeholders
Skills
- Strong hands-on experience in Azure Cloud
- Azure Databricks
- PySpark
- Azure Data Factory (ADF)
- Delta Lake
- Unity Catalog
- Designing, developing, and optimizing scalable data pipelines and cloud-based data solutions
- Expertise in ETL/ELT processing
- Data modeling
- Performance tuning
- Data governance
- Proficiency in Python
- Proficiency in SQL
- Proficiency in GitHub
- Proficiency in CI/CD practices
- Experience working with large-scale datasets in enterprise environments
- Strong analytical and problem-solving skills
- Ability to work independently
- Ownership of end-to-end solution delivery
- Collaborating effectively with cross-functional teams and business stakeholders
- Strong experience building REST or GraphQL APIs
- Experience with Kubernetes (AKS preferred) for API deployment
- Understanding of API security, contracts, error handling, and performance
- Strong understanding of data governance, security, and CI/CD practices
- Experience working on large-scale, cloud-native data platforms (Azure preferred)
- Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)
Company Overview
Company H1B Sponsorship