
Senior Staff Forward Deployed Engineer - Data & ML
Posted 3 days ago
The role in short
Embed with client teams to design, build, and maintain production-scale data lakehouse architectures, ML pipelines, and AI agent interfaces.
Confiz is seeking a Sr. Staff Forward Deployed Engineer - Data & ML who brings a fully hands-on delivery mindset, deep technical expertise, and customer-first ownership.
We are looking for individuals who embed directly within a client's engineering and business teams, own systems end to end, and are measured on what runs in production. At the Sr. Staff level, you will also set the technical direction for the data platform on the account, working closely with business and product teams to understand the business domain and use cases, identify relevant data, and partner with engineering and data engineers to drive delivery.
Work Location: Scottsdale, AZ – Hybrid
Employment Type: Full-time
Responsibilities:
- Embed directly within the client's engineering and business teams to drive hands-on, end-to-end delivery of production-scale data and ML systems.
- Set the technical direction for the customer's data platform, defining data strategies and building the foundational data layer for organization-wide data orchestration across diverse consumers.
- Partner closely with business and product teams to understand the business domain, define use cases, and identify relevant data sources.
- Collaborate with engineering and data engineering teams to drive execution and take accountability for system uptime in production.
- Design, build, and manage lakehouse architectures using Databricks (Spark, Delta, Unity Catalog), Databricks Genie, and hands-on ownership of bronze, silver, and gold data layers.
- Architect and maintain scalable ingestion and streaming pipelines (Kafka, ETL/ELT at scale, blob storage) with self-healing and automated alerting capabilities.
- Build and optimize operational data stores, including production PostgreSQL, pgVector, embeddings, vector databases, and Redis caching strategies.
- Design and tune search and retrieval solutions using Azure AI Search, covering index and schema design, indexers, hybrid retrieval, semantic reranking, and freshness/relevance tuning.
- Develop semantic models and BI solutions leveraging Microsoft Fabric and Power BI.
- Deliver machine learning models in production, owning the lifecycle from classifier training through serving, evaluation, drift detection, and retraining.
- Build document intelligence and multi-modal RAG pipelines capable of extracting and grounding information across unstructured, scanned, text, table, and image sources.
- Establish MLOps and reliability practices, including CI/CD for data and models, observability, monitoring, alerting, and on-call ownership.
- Lead live platform migrations, moving data architectures from one platform to another with zero disruption to active consumers.
- Manage Azure cloud infrastructure at depth, driving active cloud and data platform cost optimization.
- Build query interfaces for AI agents, including Model Context Protocol (MCP) servers and text-to-SQL tooling over governed data.
Requirements
- 12+ years of hands-on engineering experience building and maintaining production-scale systems with direct accountability for uptime.
- Proven ability to define data strategies and build foundational data layers from the ground up for organization-wide orchestration.
- Concrete, hands-on experience across most of the following technical areas:
- Lakehouse & Processing: Databricks (Spark, Delta, Unity Catalog), Databricks Genie, and ownership of bronze, silver, and gold layers.
- Ingestion & Streaming: Kafka, ETL/ELT at scale, blob storage, and self-healing, automated ingestion pipelines with alerting.
- Operational Data Stores: Production PostgreSQL, pgVector, embeddings, vector databases, and Redis caching strategies.
- Search & Retrieval: Azure AI Search (index and schema design, indexers, hybrid retrieval, semantic reranking, freshness and relevance tuning).
- Semantics & BI: Microsoft Fabric, semantic modeling, and Power BI.
- ML in Production: End-to-end classifiers from training through serving, evaluation, drift detection, and retraining.
- Document Intelligence & Multi-Modal RAG: Extraction from unstructured and scanned sources, grounded over mixed text, table, and image content.
- MLOps & Reliability: CI/CD for data and models, observability, monitoring, alerting, and on-call ownership.
- Platform Migration: Hands-on experience migrating data architectures between platforms with live consumers.
- Cloud & Cost Management: Deep Azure expertise paired with active cloud and data platform cost management.
- Query Interfaces for Agents: Building MCP servers and text-to-SQL tooling over governed data.
- Willingness and ability to work in a hybrid model in Scottsdale, AZ.
Qualifications:
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, Data Science, or a related field.
- 12+ years of hands-on software, data, or machine learning engineering experience in production environments.
Good to Have:
- Agentic AI & Orchestration: Familiarity with agentic AI patterns and orchestration engines such as LangGraph or equivalent frameworks, understanding how downstream agents consume data and ML platforms.
- Advanced RAG Architecture: Deep understanding of retrieval strategies, grounding, context assembly, and failure modes beyond basic implementations.
- Workflow Architecture: Ability to determine where deterministic workflows vs. non-deterministic agentic workflows are appropriate and maintain clean boundaries between them.
- AI System Evaluation: Experience with offline and online evaluations, golden datasets, regression suites, and evaluating output quality where there is no single right answer.
- Domain Experience: Previous experience working within the retail or grocery domain.
We have a global team of amazing individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast growth fintech, and multiple Silicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM) and ISO 14001:2015 (EMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz visit https://www.linkedin.com/company/confiz/
Prep for this interview
5 questions likely to come up at Confiz, each matched to a line in this posting.
- 1Data and SQL
They wrote: “Ingestion & Streaming: Kafka, ETL/ELT at scale, blob storage, and self-healing, automated ingestion pipelines with alerting.”
How would you design a daily pipeline that feeds customer data into our product?
How to answer
Why they ask: Tests basic data engineering: scheduling, failures, re-runs and monitoring.
- Extract with timestamps or change tracking, not full dumps, when possible
- Transform in steps you can re-run without creating duplicates
- Validate row counts and key fields before loading
- Alert a person on failure, with enough detail to fix it
Tip: Make re-running safe (same input, same result) and say how you'd know it failed.
- 2Integrations and APIs
They wrote: “Architect and maintain scalable ingestion and streaming pipelines (Kafka, ETL/ELT at scale, blob storage) with self-healing and automated alerting capabilities.”
A customer's API starts returning errors in production at 2am. What do you do?
How to answer
Why they ask: FDEs often own production for their customers. This tests incident handling and communication.
- Check your side first: logs, recent deploys, retries piling up
- Stop the damage (pause jobs, queue requests, turn off the feature)
- Tell the customer what you see and what you've done, in plain words
- Afterwards: add a check that would have caught it, and write a short report
Tip: Split the answer into the first hour and the week after.
- 3LLMs, RAG and agents
They wrote: “Build document intelligence and multi-modal RAG pipelines capable of extracting and grounding information across unstructured, scanned, text, table, and image sources.”
A customer wants a chatbot over their internal documents. How do you build it?
How to answer
Why they ask: RAG is the most common first project. They want the whole path, from messy files to answers people trust.
- Collect and clean the documents; handle permissions per user
- Split them into chunks, embed, and store with source links
- Retrieve, then answer with citations; say “I don't know” when retrieval is weak
- Build a test set of real questions with expected answers before launch
Tip: Spend more time on the data and on testing than on the model.
- 4Cloud, deployment and security
They wrote: “Design and tune search and retrieval solutions using Azure AI Search, covering index and schema design, indexers, hybrid retrieval, semantic reranking, and freshness/relevance tuning.”
How would you debug a deployment that works in staging but fails at the customer's site?
How to answer
Why they ask: Customer environments differ in ways you can't see. This tests method under pressure.
- Compare versions, config and environment variables
- Check network rules, proxies and certificates (common in enterprise)
- Look at resource limits and permissions
- Add the missing check to your install steps afterwards
Tip: List the usual suspects and how you'd check each without full access.
- 5Ownership and working with customers
They wrote: “Confiz is seeking a Sr. Staff Forward Deployed Engineer - Data & ML who brings a fully hands-on delivery mindset, deep technical expertise, and customer-first ownership.”
Why FDE and not a regular software engineering role?
How to answer
Why they ask: They want people who like customer work, not engineers who'll tolerate it.
- A moment when working directly with users changed what you built
- What you like about the mix of engineering and customer work
- Why this company's customers or product interest you
- The part you'll miss, and why it's worth it
Tip: Be specific about what you enjoy: seeing your code used, solving messy real problems, travel.
Not the one? Get the next one by email
New roles land here every day. Pick what you want to hear about.
Want the job, not just the posting? Learn how FDEs work.
FDE Info is our free weekly newsletter for forward deployed engineers: tools, field notes from real deployments, and how FDE teams hire and pay.
Free. One email a week. Unsubscribe in one click.

