← databricks / Staff Product Manager, AI Platform
brief / art_v4088Bng3Xk
role
model
anthropic/claude-sonnet-4.6
created
2026-06-12T18:26
Company snapshot
Databricks is the data and AI company founded by the original creators of Apache Spark, Delta Lake, and MLflow, serving 10,000+ organizations including over 50% of the Fortune 500. The company's core product is the Data Intelligence Platform, a unified Lakehouse architecture combining data engineering, analytics, and AI/ML workloads. In the last 12–24 months Databricks has aggressively expanded its AI portfolio — acquiring MosaicML (LLM training infrastructure), launching DBRX (open-source LLM), and deepening Unity Catalog governance across ML assets. The company is widely regarded as having a strong engineering culture with deep roots in open-source and distributed systems research. Exact recent headcount, revenue figures, or internal roadmap details are not confirmed here.
Team stack
Based on the JD and public signals, the AI Platform team likely runs: Python as the primary ML/data language; MLflow (open-source, Databricks-native) for experiment tracking and model registry; Delta Lake / Unity Catalog for governed feature and model storage; Spark for distributed feature engineering and large-scale training orchestration; Model Serving infrastructure likely built on Ray Serve or proprietary serving layer (based on JD mention of real-time inference); Vector Search likely built on ANN indexes (HNSW/IVF, likely); LLM infrastructure referencing vLLM or TGI patterns (inferred from industry norms, not confirmed); Feature Store with point-in-time correct joins; Kubernetes/cloud-native infra on AWS/Azure/GCP (multi-cloud, based on JD); Go or Java for platform microservices (uncertain); React/TypeScript for UI surfaces (likely, based on JD UI/UX mention). All inferences marked uncertain unless sourced from JD.
Likely questions (10)
| area | question | why |
|---|---|---|
| system_design | Walk us through how you would design a real-time model serving system that needs to handle millions of inference requests per second with sub-100ms latency SLAs, while also supporting A/B testing of model versions and canary rollouts. | JD explicitly calls out 'real-time inference' and 'large-scale distributed training' as core team domains; the role requires making 'deeply technical decisions about ML infrastructure.' |
| system_design | How would you architect a feature store that supports both batch (offline) and real-time (online) feature retrieval, ensuring point-in-time correctness for training and low-latency serving for inference? | Feature stores are explicitly named in the JD as a core AI Platform product area; this tests depth in ML infrastructure design. |
| domain | The JD mentions the full ML lifecycle — from feature engineering to model monitoring. How do you think about the biggest gaps enterprises face operationalizing ML in production today, and how would you prioritize which gaps to close first on the Databricks platform? | The role owns the roadmap for AI platform areas and must translate enterprise ML pain points into platform capabilities; this tests strategic prioritization judgment. |
| domain | You've benchmarked GRPO, DPO, PPO, and other RL algorithms across TRL, VeRL, OpenRLHF, and NeMo RL. How would you translate that hands-on RL post-training experience into a product roadmap for LLM fine-tuning infrastructure on Databricks? | JD calls out LLM infrastructure as a core area; candidate's RL Workbench is directly relevant and interviewers will probe whether the hands-on depth translates to product thinking. |
| coding | Given a stream of model inference logs (latency, input tokens, output tokens, model version, customer ID), write a SQL or PySpark query to detect model performance degradation — specifically p99 latency regression — across model versions over a rolling 24-hour window. | JD mentions model monitoring; Databricks is a SQL/Spark-native platform; the role requires credibility with ML engineers and comfort with data tooling. |
| behavioral | Tell me about a time you had to make a deeply technical product decision — one where you had to go deep on system architecture — and how you navigated disagreement with engineering on the right approach. | JD explicitly states the PM must 'make deeply technical decisions about ML infrastructure' and 'engage credibly with world-class ML engineers'; this probes technical credibility under pressure. |
| behavioral | Describe a platform product you shipped that had both internal developer customers and external enterprise customers. How did you balance their competing needs, and how did you measure success? | The role spans internal ML teams and enterprise B2B customers; candidate's Intuit ICE platform experience is directly relevant and will be probed for depth. |
| behavioral | At Intuit you drove 275% YoY growth in ICE engagements to 675M+. Walk us through the specific levers you pulled — what was the strategy, what did you personally own, and what would you do differently? | JD calls out 'grow end-user engagement' and 'identify adoption bottlenecks'; this is the candidate's strongest quantified platform growth signal and will be stress-tested. |
| culture | Databricks was founded by engineers and is deeply customer-obsessed. How do you stay technically current enough to earn the trust of world-class ML researchers and engineers, and can you give a concrete recent example? | JD emphasizes 'founded by engineers' culture and requires a PM who can go deep technically; the candidate's self-built RL workbench and aeval platform are the answer here. |
| domain | How would you define the pricing and packaging strategy for a new vector search capability on Databricks — what dimensions would you charge on, how would you think about the competitive landscape (Pinecone, Weaviate, pgvector), and how would you validate the model with field teams? | JD explicitly lists 'define pricing, packaging, and commercialization strategy' as a core responsibility; vector search is named as a product area. |
Talking points
- RL post-training workbench at production depth: Built a 3-phase RLHF/DPO workbench implementing 12 algorithms (PPO, GRPO, DAPO, DPO, SimPO, KTO, ORPO, and more) with live SSE metric streaming, cross-framework benchmarking (TRL, VeRL, OpenRLHF, NeMo RL), and GPU Docker passthrough — directly maps to Databricks' LLM infrastructure and model training product areas.
- Platform growth at Intuit scale: As Staff PM for Developer Frameworks & Platform Infrastructure, drove 275% YoY growth in ICE engagements to 675M+ in FY23, scaled throughput from 6K to 50K TPS via rSocket migration supporting ~1.5M concurrent connections at sub-25ms TP99 — directly demonstrates the enterprise platform adoption and infrastructure scaling the JD requires.
- Developer onboarding and SDK product ownership: Delivered ICE Self-Service platform (DevPortal, GitOps config, ICE Playground) reducing developer onboarding from 2–3 weeks to minutes; extended Java and Python SDK Starter Kits with scaffolding, CI/CD, and testing frameworks — mirrors Databricks' mission of making it 'radically easier for enterprises to put AI into production.'
- AI evaluation infrastructure built from scratch: Built aeval, a local-first model evaluation platform with 5 eval types, adversarial safety testing, bootstrap confidence intervals, Welch's t-test, Cohen's d effect size, and CI/CD regression detection (FastAPI, TimescaleDB, Redis, Ollama) — directly relevant to Databricks' model monitoring and MLflow evaluation roadmap.
- NeurIPS-published ML researcher with 20-year arc from C++ BPTT to 8B-parameter PyTorch: Original 2004 hand-coded neural network in C++ with custom backpropagation through time, NeurIPS 2014 publication on protein structure prediction, and 2026 rewrite spanning 413 to 8B parameters — establishes the rare combination of deep ML research credibility and enterprise PM execution that the JD's 'engage credibly with world-class ML engineers' requirement demands.