Azure Data Engineer

Responsibilities:

• Design, implement, and maintain Azure infrastructure using Terraform and Azure Resource Manager (ARM) templates.

• Configure and manage Azure Active Directory (AD), including setting up and maintaining AD services, Azure AD Application Proxy, Azure AD Pass-Through Authentication (PTA), and Federated Identity Management (FIM).

• Provision and manage Azure Data Factory and Azure Databricks, ensuring efficient data integration and processing workflows.

• Implement and manage identity and access management (IAM) for Azure subscriptions, ensuring secure and efficient access control.

• Collaborate with development and operations teams to set up Azure DevOps pipelines for continuous integration and continuous deployment (CI/CD).

• Support deployment activities using Azure ARM templates, Terraform, and PowerShell scripts.

• Troubleshoot and resolve issues related to AD domain migrations, ensuring minimal downtime and data integrity.

• Provide best practice recommendations for infrastructure and platform management on Azure.

• Monitor and optimize the performance, reliability, and security of Azure environments.

• Document infrastructure setups, processes, and best practices for knowledge sharing and future reference.

Requirements:

• Proven experience as an Azure Infrastructure/Platform Engineer or similar role.

• Strong proficiency in Azure services, particularly Azure DevOps, Azure AD, Azure Data Factory, and Azure Databricks.

• Hands-on experience with Terraform and Azure Resource Manager (ARM) templates.

• Proficiency in scripting languages such as PowerShell.

• Solid understanding of identity and access management (IAM) and Active Directory (AD) services.

• Experience with Azure AD Application Proxy, Azure AD PTA, Federated Identity Management (FIM), and Active Directory Federation Services (ADFS).

• Strong troubleshooting skills, particularly with AD domain migrations.

• Excellent problem-solving abilities and attention to detail.

• Strong communication and collaboration skills.

Preferred Qualifications:

• Microsoft Certified: Azure Administrator Associate or Azure Solutions Architect Expert.

• Experience with Azure AD B2C and Azure AD Identity Protection.

• Familiarity with other infrastructure as code (IaC) tools such as Ansible.

• Experience with containerization and orchestration technologies like Docker and Kubernetes.

• Knowledge of network security best practices in an Azure environment.

‍