Job description
We are seeking a highly experienced and motivated Senior Data Engineer to lead the design development and optimization of data pipelines and architectures This role is critical in enabling scalable data solutions that support analytics reporting and machine learning initiatives across the organization
Key Responsibilities
Design build and maintain robust scalable and efficient data pipelines using tools such as Azure Data Factory Databricks and Apache Spark
Develop and optimize ETLELT workflows to ingest transform and store structured and unstructured data from various sources
Collaborate with data scientists analysts and business stakeholders to understand data requirements and deliver highquality datasets
Implement data governance quality and security best practices across all data engineering processes
Lead the integration of cloudnative data services eg Azure Synapse ADLS Azure SQL Cosmos DB into enterprise data platforms
Monitor and troubleshoot data pipelines and infrastructure to ensure reliability and performance
Mentor junior engineers and contribute to architectural decisions and code reviews
Participate in Agile ceremonies and contribute to sprint planning and delivery
Required Skills
Strong programming skills in Python SQL and Spark
Handson experience with Azure data services ADF Synapse Databricks ADLS and Azure DevOps
Deep understanding of data modeling warehousing and distributed computing
Experience with CICD pipelines and version control systems Git GitHub Actions
Familiarity with data lakehouse architecture and modern data stack principles
Strong problemsolving and communication skills
Preferred Qualifications
Bachelors or Masters degree in Computer Science Engineering or related field
Microsoft Certified Azure Data Engineer Associate or equivalent
Experience with MLOps Power BI and realtime data streaming Kafka Event Hubs
Exposure to data cataloging tools and metadata management
...Licensed Practical Nurse (LPN) Contract Location: Elkins, WV Job Type: Contract (9 Weeks) Shift: Day Shift (7:00 AM 7:00 PM) Start Date: ASAP Job Description We are seeking a dedicated and compassionate Licensed Practical Nurse (LPN) for a contract...
We would love to hear from anyone with a love for caregiving, as long as you are in the USA, authorized to work in the USA, or have a US Work Visa. This is because of the difficulty of obtaining a US Work Visa. If you know of a quick way of getting a US Work Visa, then ...
...PR/MarCom team! Schedule : Monday Friday between the hours of 9:00 AM 6:00 PM (1-hour unpaid meal break) optional work from home Fridays Assignment Length: 3-months with the potential to extend/potential foot-in-door Duties : Using the 12-month...
...At BMW of Nashville , a Sonic Automotive family dealership, you'll find the opportunities, resources, and support you need to grow and develop professionally. Our 100+ dealerships are concerned with more than moving inventory; they're committed to your success and...
...With a staff of highly recognized animal control and humane officers, Inland Valley Humane Society & S.P.C.A. (IVHS & SPCA) answers the... ...humane treatment of animals including local wildlife, proper pet care and how to be a responsible pet owner. Equally important is IVHS...