Data Engineer

Required Skills and Qualifications 

• 7+ years of hands-on experience as a Data Engineer, with a strong portfolio of successful projects delivering robust, scalable, and reliable data solutions. 

• Strong proficiency in Microsoft SQL Server and Structured Query Language (SQL), including query optimization and advanced data querying. 

• Experience with scripting and programming languages, including PowerShell, Python, 

• Solid experience leveraging technologies such as Snowflake, Azure Data Factory (ADF), Azure Data Lake Storage Gen2, , Apache Spark (PySpark), and Azure Synapse for handling large-scale distributed data processing. 

• Proven expertise in designing, building, and maintaining ETL/ELT pipelines, including extracting data from diverse sources, transforming, and loading into data warehouses using tools such as Azure Data Factory (ADF), Microsoft Fabric, and Apache Airflow. 

• Experience structuring and maintaining enterprise-level integrations using platforms such as Snowflake, Azure Synapse, Azure SQL, and SQL Server. 

• Experience with real-time data streaming and processing using Apache Kafka and Azure Event Hubs for handling high-volume data flows. 

• Strong analytical, problem-solving, and troubleshooting skills with the ability to communicate effectively across teams and resolve complex data or infrastructure issues. 

• Exposure to Databricks will be a plus