Senior Python Data Engineer (Azure ML & DAG Pipelines) Job at Buzzclan, Texas

b2p6VmJseCtNZnQ3S3VQeTlGZWJzcWpOL1E9PQ==
  • Buzzclan
  • Texas

Job Description

Job Title: Senior Python Data Engineer (Azure ML & DAG Pipelines)

Job Location : DFW Area - Hybrid

We're seeking a Senior Python Data Engineer with deep expertise in Azure Machine Learning and DAG-based workflow orchestration to design and optimize our data pipelines. You'll architect scalable solutions that power our analytics and ML systems.

Core Responsibilities:

Design and implement DAG-based data pipelines using Airflow/Luigi/Prefect
Develop Azure ML pipelines for model training and deployment
Optimize ETL/ELT processes for performance and reliability
Implement IaC (Terraform/Bicep) for cloud resource provisioning
Build monitoring and alerting systems for data workflows
Collaborate with data scientists to productionize ML models

Must-Have Skills:

Expert-level Python (decorators, generators, async/await)
10+ years with Azure ML and DAG orchestration tools
Strong experience with Airflow, Luigi, or Prefect
Proficiency in PySpark/Databricks for big data processing
Deep understanding of data modeling and warehousing concepts
Experience with CI/CD pipelines for data systems

Nice-to-Have:

Knowledge of Kubernetes for workflow scaling
Experience with real-time streaming (Kafka, Event Hubs)
Familiarity with MLOps practices

Job Tags

Similar Jobs

Roblox

3D Artist Job at Roblox

 ...Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences all created by our global...  ...This role requires an expert eye for composition, lighting, and rendering to produce high-end visuals that serve as the visual heartbeat of... 

Domino's Franchise

Delivery Driver - 5220 US-1 Job at Domino's Franchise

 ...ambassadors of Domino's, from fresh out of the oven to the customers door, our drivers make it happen. Our delivery experts are paid cash daily from earned tips and mileage reimbursement. That is money in your pocket every shift, and in addition, you will also earn an... 

BGSF

Chief Building Engineer Job at BGSF

Job Title: Chief Building EngineerJob Type: Contract to HireLocation: Lake JacksonSalary: $115,000-$125,000About the Role...  ...authorized to work in the United States without the need for visa sponsorship now or in the future.~This position may require after-hours... 

McClain Bros

Generac Certified Generator Field Technician Job at McClain Bros

 ...insurance ~ Vision insurance We are looking a skilled Generator Technician in the power generator industry, with excellent mechanical...  ...! Our 70 + employees provide installation and preventative maintenance along with emergency services. In order to support our growth,... 

DS Enterprises

Experienced CDL Drivers Job at DS Enterprises

URGENT HIRING IMMEDIATE STARTS AVAILABLE Experienced CDL-A Doubles & Triples Drivers Home EVERY Single Day Sparks, NV Tired of being gone for weeks and missing everything that matters? Were a tight-knit, driver-respectful operation out of Sparks, NV and...