About the Role
We are seeking an experienced and motivated Azure Data Engineer to join our team. As a mid-level professional, you will play a critical role in designing, building, and optimizing our data solutions using Microsoft Azure's advanced tools and services.
In this role, you will collaborate with cross-functional teams to develop data pipelines, enable seamless data integration, and ensure the reliability and scalability of our data infrastructure. If you thrive in a data-driven environment and have a passion for cloud-based data solutions, we would love to have you on board!
Key Responsibilities:
Data Pipeline Development: Design, build, and maintain robust, scalable, and efficient data pipelines using Azure Data Factory, Databricks, and other Azure services.
Data Integration: Integrate structured and unstructured data from diverse sources into Azure-based data platforms.
Data Modeling: Develop and maintain data models to support analytical and reporting requirements.
Optimization: Monitor and optimize data pipelines for performance, scalability, and cost-efficiency.
Database Management: Administer and manage Azure Synapse Analytics, Azure SQL Database, and other database solutions.
ETL Processes: Design and implement Extract, Transform, Load (ETL) processes to transform raw data into actionable insights.
Collaboration: Work closely with data analysts, business teams, and other stakeholders to understand data needs and deliver effective solutions.
Security and Compliance: Ensure data solutions align with organizational security policies and industry regulations.
Documentation: Create and maintain comprehensive documentation for data workflows, architectures, and processes.
Qualifications:
Education:
Bachelor’s degree in Computer Science, Data Engineering, Information Technology, or a related field (or equivalent experience).
Technical Skills:
Strong proficiency in Azure Data Services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Storage.
Experience with big data technologies such as Spark and Hadoop.
Proficiency in SQL for querying and managing relational databases.
Familiarity with NoSQL databases, such as Cosmos DB or MongoDB.
Strong understanding of data integration and transformation using ETL/ELT methodologies.
Hands-on experience with programming languages such as Python, Scala, or Java.
Knowledge of data visualization tools like Power BI is a plus.
Experience with Data Lake architecture and design.
Understanding of security and governance in Azure, including RBAC and Azure Key Vault.
Experience:
3–5 years of experience in data engineering or a similar role.
Experience working with large datasets and optimizing data pipelines in cloud environments.
Hands-on experience in implementing end-to-end data solutions on Azure.
Soft Skills:
Excellent problem-solving and analytical skills.
Strong written and verbal communication abilities.
Team player with the ability to work collaboratively and independently.
About the Company
Datamaze is a dynamic company specializing in AI, Data, and Analytics consulting services. We are dedicated to transforming businesses by leveraging the power of data and artificial intelligence. With a team of industry experts in technology, business strategy, and data science, Datamaze offers a range of services including data strategy development, AI model creation, advanced analytics, and data visualization. Our approach is client-centric, focusing on creating customized solutions that address unique business challenges and objectives. The team, comprising data scientists, AI experts, strategists, and engineers, is committed to continuous learning and innovation.
Datamaze positions itself as a trusted partner for businesses looking to navigate the complex data and AI landscape, aiming to optimize operations, inform decision-making, and maintain a competitive edge.