Senior Data Consultant (Microsoft Fabric)
Trility Consulting· Technology
RemoteFTE or 1099Posted 1w ago
About the role
Senior data consultant focusing on modernizing Azure Synapse data platform and migrating workloads to Microsoft Fabric, with emphasis on metadata-driven ingestion, CI/CD for Fabric artifacts, and AI-assisted development using Claude Code.
Responsibilities
- Evaluate and refine the existing Microsoft Fabric architecture, including metadata structures, table-level event triggering, and reusable ingestion patterns
- Design and implement a metadata-driven ingestion framework that allows new tables and sources to be onboarded through configuration rather than custom development
- Migrate prioritized data sources and workloads from Azure Synapse into Microsoft Fabric
- Develop and orchestrate Fabric data pipelines and Spark notebooks using PySpark and Spark SQL
- Analyze existing Azure Synapse pipelines to understand dependencies and translate processing logic into Fabric solutions
- Build data validation and reconciliation processes to verify migration accuracy, including duplicate detection, key alignment, and record-level comparisons between Synapse and Fabric
- Analyze source-specific loading requirements and recommend full-load, incremental, or CDC patterns
- Implement Git-based CI/CD and automated environment promotion for Fabric artifacts using GitHub Actions, Azure DevOps, or similar tooling
- Leverage Claude Code to define implementation specs, accelerate development, and review AI-generated code for quality and maintainability
- Evaluate data dictionary, metadata, and lineage requirements, including catalog solutions like Microsoft Purview
- Collaborate with client engineers through paired development, code reviews, and knowledge-sharing to establish sustainable engineering standards
- Apply data engineering best practices related to performance, testing, monitoring, documentation, security, and operational support
Qualifications
- 5+ years of experience with Azure Data Services, including Microsoft Fabric, Azure Data Factory, Databricks, or Synapse
- Hands-on Microsoft Fabric production experience (lakehouses, pipelines, notebooks, medallion architecture, workspaces, capacity management)
- Experience building and maintaining production ETL/ELT pipelines and reusable data ingestion frameworks
- Experience designing and implementing a metadata-driven ingestion framework with configuration-based onboarding
- Experience developing Spark notebooks and data transformation workflows using PySpark and Spark SQL
- Strong SQL skills for data transformation, validation, and performance tuning, including reading existing T-SQL logic
- Experience working with Azure Synapse and analyzing existing pipelines with complex dependencies
- Experience implementing medallion architecture patterns (Bronze, Silver, Gold)
- Experience designing and implementing Git-based CI/CD workflows for data platform artifacts (GitHub Actions, Azure DevOps)
- Hands-on experience using Claude Code for AI-assisted software development
- Experience validating data migrations and ensuring data quality across source and target systems
- Experience integrating data from REST APIs, relational databases, and structured or semi-structured data sources
- Familiarity with data governance, lineage, metadata management, and data catalog concepts
- Ability to collaborate with technical teams, engage in client-facing technical discussions, and communicate effectively
Skills
Required:Azure Data ServicesMicrosoft FabricETL/ELT pipelinesMetadata-driven ingestion frameworkPySpark / Spark SQLSQLAzure SynapseMedallion architectureCI/CD for data artifactsClaude Code
Benefits
- Work remotely anywhere in the United States with flexible work hours
- Paid time-off, company holidays, and floating holidays
- Comprehensive benefits with contributions toward premiums
- 401(k) plan
- Sponsored and supported learning opportunities
Last updated Oct 14, 2026. Interested? Apply on the company site.
About Trility Consulting
A partner for your journey
Business and AI-driven consulting firm helping mid-market to enterprise-sized companies define, design, and deliver integrated, end-to-end technology solutions that solve high-consequence problems.
AIConsultingData IntelligenceCloud EngineeringAdvisory ServicesDevOps & MLOps
More open roles at Trility Consulting
- Client Partner (Columbus Metro)4w agoHybrid (Columbus, OH), Remote · Strategy, Marketing and Sales
- Client Partner (Denver Metro)1mo agoHybrid (Denver Metro) · Strategy, Marketing and Sales
- General Application11mo agoHybrid (United States)