Position Summary
CRDF Global is hiring a Senior Data Platform Engineer to own our enterprise data platform in Microsoft Fabric.
The role owns the platform end to end: the architecture and standards it runs on, the pipelines and models built on top of it, and the ongoing support of the teams that report from it. Scope will continue to expand as additional systems are brought in, so this is a long-term ownership role rather than a one-time project.
Responsibilities
Platform Engineering
- Own the architecture of CRDF Global’s data platform in Microsoft Fabric, including lakehouse structure, workspace layout, and bronze, silver, and gold layers.
- Set technical standards for the platform and review designs before they are implemented.
- Provide technical direction to others contributing to the platform and review their work against those standards.
- Establish source control, environment strategy, and deployment pipelines for Fabric artifacts so changes are repeatable and reviewable.
- Manage capacity, performance, and cost. Monitor pipeline reliability and set up alerting for failures and data freshness.
- Define platform security, including workspace roles, row-level security, and sensitivity labeling.
- Operate and support the platform, including issue triage, root cause analysis, and escalation.
- Maintain platform documentation, runbooks, and architecture decisions.
Data Integration
- Build, operate, and extend ingestion pipelines from Deltek Costpoint, Salesforce, Microsoft 365 and SharePoint, Smartsheet, Fluxx, Concur, and Formstack.
- Implement incremental loads and change tracking, and reconcile loaded data against source systems.
- Handle API authentication, rate limits, schema drift, and failure recovery so pipelines run unattended.
Modeling & Governance
- Own the gold-layer models that reporting runs on, including conformed dimensions for project, contract, award, organization, and employee.
- Establish common enterprise identifiers so financial, program, grant, and CRM data can be joined reliably.
- Build and maintain the Power BI semantic models that sit on top of the platform.
- Document lineage, data definitions, and quality rules, and implement automated data quality checks.
Working with the Business
- Work directly with Finance, Contracts, Programs, and Operations to define requirements and agree on shared data definitions.
- Add new sources, models, and features as business needs change.
Qualifications
Required
- Minimum 8 years of professional experience in data engineering, data platform engineering, or enterprise data integration.
- Hands-on experience building and operating a cloud data platform such as Microsoft Fabric, Azure Synapse, Databricks, or Snowflake.
- Strong SQL and Python or PySpark for data transformation.
- Experience designing lakehouse or dimensional data models, including medallion architecture, star schemas, and slowly changing dimensions.
- Experience integrating ERP, CRM, or financial systems through APIs, REST and JSON, and incremental extract patterns.
- Experience with orchestration, source control, and CI/CD for data pipelines using Azure DevOps or GitHub Actions.
- Experience setting technical standards and reviewing the work of engineers or analysts who do not report to you.
- Experience working directly with finance or program staff to turn business questions into data models.
Preferred
- Familiarity with Deltek Costpoint data structures and project accounting.
- Experience with the Salesforce data model and APIs.
- Power BI semantic modeling, DAX, and dataset performance tuning.
- Microsoft Purview or a comparable data catalog and governance tool.
- Azure Data Factory, Synapse, Logic Apps, or Event Hubs.
- dbt or a similar transformation framework.
- Experience in a federal contracting or grant-funded environment.
- Microsoft certification DP-600 or DP-700.
- Position Summary
- CRDF Global is hiring a Senior Data Platform Engineer to own our enterprise data platform in Microsoft Fabric.
- The role owns the platform end to end: the architecture and standards it runs on, the pipelines and models built on top of it, and the ongoing support of the teams that report from it. Scope will continue to expand as additional systems are brought in, so this is a long-term ownership role rather than a one-time project.
- Responsibilities
- Platform Engineering
- Own the architecture of CRDF Global’s data platform in Microsoft Fabric, including lakehouse structure, workspace layout, and bronze, silver, and gold layers.
- Set technical standards for the platform and review designs before they are implemented.
- Provide technical direction to others contributing to the platform and review their work against those standards.
- Establish source control, environment strategy, and deployment pipelines for Fabric artifacts so changes are repeatable and reviewable.
- Manage capacity, performance, and cost. Monitor pipeline reliability and set up alerting for failures and data freshness.
- Define platform security, including workspace roles, row-level security, and sensitivity labeling.
- Operate and support the platform, including issue triage, root cause analysis, and escalation.
- Maintain platform documentation, runbooks, and architecture decisions.
- Data Integration
- Build, operate, and extend ingestion pipelines from Deltek Costpoint, Salesforce, Microsoft 365 and SharePoint, Smartsheet, Fluxx, Concur, and Formstack.
- Implement incremental loads and change tracking, and reconcile loaded data against source systems.
- Handle API authentication, rate limits, schema drift, and failure recovery so pipelines run unattended.
- Modeling & Governance
- Own the gold-layer models that reporting runs on, including conformed dimensions for project, contract, award, organization, and employee.
- Establish common enterprise identifiers so financial, program, grant, and CRM data can be joined reliably.
- Build and maintain the Power BI semantic models that sit on top of the platform.
- Document lineage, data definitions, and quality rules, and implement automated data quality checks.
- Working with the Business
- Work directly with Finance, Contracts, Programs, and Operations to define requirements and agree on shared data definitions.
- Add new sources, models, and features as business needs change.
- Qualifications
- Required
- Minimum 8 years of professional experience in data engineering, data platform engineering, or enterprise data integration.
- Hands-on experience building and operating a cloud data platform such as Microsoft Fabric, Azure Synapse, Databricks, or Snowflake.
- Strong SQL and Python or PySpark for data transformation.
- Experience designing lakehouse or dimensional data models, including medallion architecture, star schemas, and slowly changing dimensions.
- Experience integrating ERP, CRM, or financial systems through APIs, REST and JSON, and incremental extract patterns.
- Experience with orchestration, source control, and CI/CD for data pipelines using Azure DevOps or GitHub Actions.
- Experience setting technical standards and reviewing the work of engineers or analysts who do not report to you.
- Experience working directly with finance or program staff to turn business questions into data models.
- Preferred
- Familiarity with Deltek Costpoint data structures and project accounting.
- Experience with the Salesforce data model and APIs.
- Power BI semantic modeling, DAX, and dataset performance tuning.
- Microsoft Purview or a comparable data catalog and governance tool.
- Azure Data Factory, Synapse, Logic Apps, or Event Hubs.
- dbt or a similar transformation framework.
- Experience in a federal contracting or grant-funded environment.
- Microsoft certification DP-600 or DP-700.
CRDF Global is an Equal Opportunity Employer (EOE). CRDF Global provides equal employment opportunities to all qualified applicants without regard to race, ethnicity, religion, sex, sexual orientation, gender identity, national origin, protected veteran, age, or disability status.
