We are seeking a talented and experienced Cloud Data Engineer to join our dynamic team. As a key member of our Engineering department, you will be responsible for understanding various data types and sets, storing, securing, interacting with, and manipulating data to deliver actionable insights and drive business value for various clients. The ideal candidate will have a strong background in Azure cloud technologies, data engineering, and a passion for leveraging data to solve complex business challenges.
Responsibilities:
- Design, develop, migrate, and maintain scalable data pipelines and ETL processes on Microsoft Fabric and utilizing Azure data & analytics resources.
- Design and implement data integration processes to extract, transform, and load (ETL) data from various sources both on-prem, external 3rd party applications, and other cloud providers.
- Create data processing workflows and pipelines to support data analytics, machine learning, and other analytic-driven applications.
- Implement CI/CD pipelines for automating data engineering processes using Azure DevOps or GitHub.
- Collaborate with cross-functional teams to understand data requirements and implement effective data integration solutions.
- Set up monitoring solutions using Azure Monitor, Azure Log Analytics, Fabric Data Activator, and other Azure solutions to track the performance of data pipelines or analytics workflows to ensure data quality, integrity, and performance.
- Set up and configure various Microsoft security solutions such as Purview and Sentinel to monitor and alert security and compliance best practices throughout the data & analytics lifecycle.
- Conduct thorough testing and validation of data solutions to ensure the accuracy, completeness, and reliability of the delivered data products.
- Implement, optimize, and maintain cost-effective data & analytics solutions by leveraging Azure Cost Management tools and best practices.
- Stay updated on industry regulations and implement necessary changes to maintain compliance.
- Other duties, as assigned.
Qualifications:
- 3+ years of experience with data engineering, particularly in Azure and/or Microsoft Fabric.
- Proficiency in Azure cloud services, including Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and Azure Blob Storage.
- Experience with Microsoft SQL Server tools (SSIS, SSRS, and SSAS).
- Experience with data engineering processes using Apache Spark, Python, R, T-SQL, or KQL.
- Experience with generating Semantic Models.
- Familiarity with Microsoft Power BI for data visualization.
- Passion for staying updated on industry trends and emerging data engineering and cloud computing technologies.
- Strong communication skills and the ability to collaborate effectively with cross-functional teams.
Preferred Skills and Experience:
- Microsoft Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert).
- Experience with big data technologies such as Hadoop, Snowflake, or DataLakes.
- Experience with real-time analytics technologies such as Azure IoT Hub, Fabric Real-Time Analytics, or Kafka.
- Bachelor’s degree in Computer Science, Data Engineering, or related field.
APPLY