Required Skills

MS fabric data, SQL, Microsoft Fabric Data Pipelines

Job Description

We are looking for an experienced MS Fabric Data and SQL Engineer with strong expertise in Microsoft Fabric, data pipeline development, PySpark, Spark SQL, and MS SQL Server. The ideal candidate should have hands-on experience developing and orchestrating data pipelines, working with legacy SQL Server environments, and optimizing complex SQL queries.

The candidate should also possess strong analytical and documentation skills, with the ability to translate technical SQL logic into clear functional documentation.

Key Responsibilities

1. Develop, maintain, and orchestrate data pipelines using Microsoft Fabric Data Pipelines.
2. Build and manage PySpark and Spark SQL notebooks for data processing and transformation.
3. Work with Dataflows Gen2 and API integrations.
4. Develop, maintain, and optimize SQL queries, stored procedures, functions, views, and triggers.
5. Work with MS SQL Server 2016, including on-premises and legacy systems.
6. Analyze complex SQL logic, joins, and CTEs to improve query performance.
7. Troubleshoot data pipeline and SQL-related issues.
8. Translate technical SQL logic into functional documentation.
9. Collaborate with cross-functional teams to support Agile delivery.

Mandatory Skills

1. Hands-on experience with Microsoft Fabric Data Pipelines.
2. Strong knowledge of PySpark and Spark SQL notebooks.
3. Experience with Dataflows Gen2 and API integration.
4. Strong expertise in MS SQL Server 2016 (On-Premises and Legacy Systems).
5. Advanced T-SQL skills, including:
6. Stored Procedures
7. Functions
8. Views
9. Triggers
10. Complex Joins and CTEs
11. Query Optimization and Performance Tuning
12. Excellent analytical, problem-solving, and documentation skills.
13. Ability to translate complex SQL logic into functional documentation.

Good-to-Have Skills

1. Knowledge of .NET.
2. Experience with SSIS.
3. Working knowledge of Power BI.
4. Experience working in Agile development environments.

Requirements

Mandatory Skills

1. Hands-on experience with Microsoft Fabric Data Pipelines.
2. Strong knowledge of PySpark and Spark SQL notebooks.
3. Experience with Dataflows Gen2 and API integration.
4. Strong expertise in MS SQL Server 2016 (On-Premises and Legacy Systems).
5. Advanced T-SQL skills, including:
6. Stored Procedures
7. Functions
8. Views
9. Triggers
10. Complex Joins and CTEs
11. Query Optimization and Performance Tuning
12. Excellent analytical, problem-solving, and documentation skills.
13. Ability to translate complex SQL logic into functional documentation.

Good-to-Have Skills

1. Knowledge of .NET.
2. Experience with SSIS.
3. Working knowledge of Power BI.
4. Experience working in Agile development environments.