You will lead discovery, design secure app permissions, build reliable extract/transform/load pipelines, and deliver production-ready integrations with documentation and handoff. Seeking a hands-on SME who can scope, plan, and execute the end-to-end extraction of Microsoft 365 data via Microsoft Graph (and related APIs) and integrate it into a proprietary data warehousing system.
Responsibilities
• Discovery and Planning
• Conduct stakeholder interviews and data inventory across M365 workloads (SharePoint Online, OneDrive, Teams, Exchange Online, Entra ID/Azure AD).
• Define scope, data models, mapping, and success criteria; produce a project plan with milestones, risks, and estimates.
• Architecture and Security
• Design the extraction architecture using Microsoft Graph and related services (Graph SDKs, delta queries, subscriptions/webhooks, Graph Data Connect where appropriate).
• Implement Azure AD app registrations, OAuth 2.0 flows, and least-privilege permissions (delegated vs. application) aligned with Conditional Access and tenant policies.
• Data Extraction and Integration
• Build robust pipelines to extract content and metadata (e.g., SharePoint lists/libraries, sites/drives/items, OneDrive, Teams channels/files, mailbox metadata, directory objects, audit/usage reports).
• Handle throttling, pagination, retries, delta sync, change tracking, and idempotent upserts.
• Transform and map data to target schemas; stage data (e.g., files/JSON/CSV/Parquet) and load into the proprietary data warehouse via APIs, connectors, or batch loads.
• Compliance and Governance
• Respect data residency, retention, MIP sensitivity labels, DLP, eDiscovery, and auditing requirements.
• Navigate protected endpoints (e.g., Teams messages export) and approval processes; propose compliant alternatives when needed.
Skills
• 5+ years building integrations with Microsoft 365, including advanced use of Microsoft Graph API.
• Proven delivery of data pipelines/ETL from M365 workloads:
• SharePoint Online and OneDrive (sites, lists, libraries, drives/files, permissions).
• Teams (channels, files; familiarity with protected chat/meeting export APIs and compliance boundaries).
• Exchange Online (mailbox and message metadata, calendars) and directory objects in Entra ID (Azure AD). Strong expertise in:
• OAuth 2.0, Azure AD app registrations, permissions consent, service principals, Conditional Access impacts.
• Graph SDKs and REST (C#/.NET or Python preferred); PowerShell for automation; Graph Explorer/Postman.
• Handling Graph constraints: throttling, batching, pagination, delta queries, webhooks/subscriptions.
• Data modeling and transformation; SQL; schema evolution; metadata and lineage.
• Experience integrating with custom/proprietary data warehouses (API-based or batch ingestion), including building connectors or staging layers.
• Solid understanding of M365 security, compliance, and governance (retention, labels, DLP, eDiscovery/audit).
• Self-starter who can operate independently in a part-time capacity; excellent communication and documentation.
• Experience with Azure services (Functions, Logic Apps, Data Factory, Storage) for orchestration and staging.
• Familiarity with Graph Data Connect, SharePoint REST/CSOM, Exchange Web Services deprecation nuances.
• CI/CD (GitHub Actions/Azure DevOps), containerization, and IaC (Bicep/Terraform).
• Background in performance tuning for large tenants (rate-limit strategy, parallelization, backoff).
