Principal Software Engineer, Global Public Sector
Posted 15 days ago
The role in short
Embed with public sector clients to define technical approaches, build and deploy production AI agents and integrations, and mentor engineering teams.
Scale’s rapidly growing Global Public Sector team is focused on using AI to address critical challenges facing the public sector around the world. Our core work consists of:
- Creating custom AI applications that will impact millions of citizens
- Generating high-quality training data for national LLMs
- Upskilling and advisory services to spread the impact of AI
We are hiring a Principal Engineer to join a small team of our most senior engineers who take on the problems no one else can. You will work at the earliest stage of our engagements: shaping the technical approach with clients, defining the technology we build on, and turning ideas into working prototypes fast. You will step in when a project is stuck or a problem is unusually hard, and turn what you learn in the field into shared capabilities every team can build on.
This is a very senior, hands-on role. Our engineering organisation is young, so mentoring is a core part of the job: you will raise the bar for how we design, build and deliver, and grow the next generation of technical leaders around you. The role is based in London.
At Scale, we’re not just building AI solutions, we are building repeatable blocks to enable the public sector to transform their operations and better serve citizens through cutting-edge technology. If you’re ready to shape the future of AI in the public sector and be a member of our rapidly expanding team, we’d love to hear from you.
You will:
- Take on the hardest technical problems across our programs, stepping in where projects are stuck or the path forward is unclear
- Lead the technical side of early engagements: work with clients to scope problems, shape proofs of concept and keep the scope needed to prove value as small as possible
- Build working prototypes quickly, from AI agents and evaluation pipelines to data and knowledge systems, and take the most promising ones to production
- Define the technology and architecture our solutions are built on, keeping them cohesive, secure and reusable across clients
- Mentor engineers across a young organisation through pairing, design and code reviews, and set the bar for engineering excellence
- Partner with Directors, VPs and client executives to navigate high-stakes business and technical trade-offs, including travel to client sites as engagements require
- Turn patterns from the field into reusable capabilities, contributing components back to our core platform so every engagement starts further ahead
- Lead from the front on agentic engineering, both in the AI systems we build and in how our teams use coding agents day to day, and push the boundaries of what’s possible with AI
Ideally you’d have:
- A strong engineering background, with a Bachelor’s degree in Computer Science, Mathematics or a related quantitative field (or equivalent practical experience)
- 10+ years of post-graduation engineering experience, with demonstrated proficiency in languages such as Python, TypeScript/JavaScript, Java, or C++
- 5+ years of experience applying AI/ML in production environments, such as building generative/agentic AI applications, RAG systems or evaluation pipelines
- Strong problem-solving skills, with a track record of taking ambiguous, early-stage problems from a blank page to a working prototype and into production
- Deep expertise in system design and architecture, including experience with cloud-based machine learning tools and platforms (e.g. AWS, GCP, Azure)
- Experience mentoring engineers and raising the technical bar of a team or organisation
- Comfort working directly with clients, from their engineering teams to senior executives
- Excellent written and verbal communication skills to collaborate effectively in a cross-functional environment
Nice to haves:
- Past experience in a forward deployed engineering role
- Experience working at a startup, particularly as a founding engineer
- Experience building and deploying large-scale AI solutions
- Experience delivering technology programs for governments or regulated industries
- Experience deploying solutions on-prem or in customer-controlled environments
- Current or previous UK government security clearance (e.g. SC or DV)
PLEASE NOTE: Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.
About Us:
At Scale, our mission is to develop reliable AI systems for the world’s most important decisions. Our products provide the high-quality data and full-stack technologies that power the world’s leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst & Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. We are expanding our team to accelerate the development of AI applications.
We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status.
We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at accommodations@scale.com. Please see the United States Department of Labor's Know Your Rights poster for additional information.
We comply with the United States Department of Labor's Pay Transparency provision.
PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with our internal policies and programs designed to protect personal data. Please see our privacy policy for additional information.
***PLEASE NOTE:***Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.
About Us:
At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst& Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. We are expanding our team to accelerate the development of AI applications.
We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status.
We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at accommodations@scale.com. Please see the United States Department of Labor's Know Your Rights poster for additional information.
We comply with the United States Department of Labor's Pay Transparency provision.
PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with our internal policies and programs designed to protect personal data. Please see our privacy policy for additional information.
Prep for this interview
5 questions likely to come up at Scale AI, each matched to a line in this posting.
- 1Cloud, deployment and security
They wrote: “Deep expertise in system design and architecture, including experience with cloud-based machine learning tools and platforms (e.g. AWS, GCP, Azure)”
A bank wants our product inside their own cloud account, with no data leaving it. How do you approach it?
How to answer
Why they ask: Self-hosted and private-cloud deployments are common in regulated industries.
- Learn their rules early: network limits, approved services, review process
- Package the product so it installs the same way each time (containers, Terraform)
- Plan how you'll get logs and updates without touching their data
- Run a test install with them before the real one
Tip: Talk about the conversation with their security team as much as the setup.
- 2Coding
They wrote: “10+ years of post-graduation engineering experience, with demonstrated proficiency in languages such as Python, TypeScript/JavaScript, Java, or C++”
Here's a CSV export from a customer. Write a script that cleans it and loads it into our API.
How to answer
Why they ask: Very close to real FDE work. They watch how you handle bad rows and failures.
- Read with a proper CSV parser; check the header first
- Validate each row and collect errors, not crash on the first one
- Send in batches with retries and a clear report at the end
- Write one or two quick tests for the parsing
Tip: Talk through edge cases out loud: encodings, missing fields, duplicates, rate limits.
- 3Discovery and scoping
They wrote: “Lead the technical side of early engagements: work with clients to scope problems, shape proofs of concept and keep the scope needed to prove value as small as possible”
How do you decide what to build first when a customer wants ten things?
How to answer
Why they ask: FDEs have limited weeks per customer. This tests judgment about value, effort and risk.
- Score each request by business value and by effort, with the customer in the room
- Pick one item that proves value fast and unblocks later work
- Write down what's out of scope so it doesn't creep back in
- Revisit the list after the first release, with real usage data
Tip: Show a simple way to rank the list and name what you'd leave out on purpose.
- 4LLMs, RAG and agents
They wrote: “Generating high-quality training data for national LLMs”
How do you know an LLM feature is good enough to ship?
How to answer
Why they ask: Evals are what separate a demo from production. Many roles list them by name.
- Write 50–200 real examples with expected outcomes, with customer experts
- Agree on a pass bar and the errors that are never acceptable
- Score automatically where possible; review a sample by hand
- Re-run on every prompt or model change, and watch live traffic after launch
Tip: Describe a test set built with the customer, a pass bar agreed up front, and checks that run on every change.
- 5Ownership and working with customers
They wrote: “Strong problem-solving skills, with a track record of taking ambiguous, early-stage problems from a blank page to a working prototype and into production”
Tell me about a project where the requirements kept changing. What did you do?
How to answer
Why they ask: Ambiguity is the norm. They want proof you can keep moving without a clear spec.
- The project and why requirements kept moving
- What you did to pin them down (short demos, written decisions)
- The trade-offs you made to keep shipping
- The result, with a number if you have one
Tip: Show how you reduced the change, beyond how you coped with it.
Not the one? Get the next one by email
New roles land here every day. Pick what you want to hear about.
Want the job, not just the posting? Learn how FDEs work.
FDE Info is our free weekly newsletter for forward deployed engineers: tools, field notes from real deployments, and how FDE teams hire and pay.
Free. One email a week. Unsubscribe in one click.

