Descripción de la vacante
FirstIgnite
Spain, Castro
Senior AI Agent Engineer en Castro, España is listed on Jobeax. Browse 80,000+ vacancies available.
About FirstIgnite
FirstIgnite makes software for university tech transfer offices. Those are the people who take research
coming out of a university lab and get it patented, licensed, or spun out into a company.
The role
We're hiring a Senior AI Agent Engineer. You'll build the agents in our product, and you'll build the
evals that tell us whether each change made them better or worse.
The work is document-heavy rather than chat. The agents run multi-step, call tools, read long and
inconsistently formatted source material, check it against existing records, and produce output that a
person reviews before anything happens with it.
Accuracy matters more here than speed or novelty. Most of the engineering effort goes into precision,
traceability, and getting the agent to hand off to a human at the right moment.
You'll report to the Head of Engineering and work with product and the full-stack team. If you've
shipped agents before, you've probably had the experience of changing a prompt and having no idea
whether you improved anything. That problem is most of this job.
What you'll do
• Design and ship long-running, multi-step, tool-using agents on various AI SDKs and tooling,
included but not limited to the OpenAI Agents SDK, the Anthropic Agent SDK, the Vercel AI SDK,
LangGraph, MCP, and Temporal Cloud.
• Wrap our APIs and our partners' APIs as tools an agent can call over MCP. Some of those systems
are old, single-tenant, and outside our control, so a fair amount of the work is translation.
• Get structured data out of long documents and match it against records that already exist. Expect
entity resolution and fuzzy matching, and expect much of it to run in batch.
• Stand up eval suites using various evaluation frameworks and tooling, included but not limited to
Promptfoo, Braintrust, LangSmith, DeepEval, LLM-as-judge methods, and custom harnesses.
Measure tool-use correctness, trajectory quality, and whether the agent finished the task.
• Every agent here produces a draft that a person signs off on. Build the citations and confidence
signals that make that review fast, and give the agent a clear way to escalate.
• Sit with product and domain experts and turn vague quality goals into something measurable.
Sometimes the only dataset available for that is tiny, or confidential, or both.
• Instrument production traffic, turn real customer interactions into golden datasets, and run them as
regression tests.
• Compare models against each other (OpenAI, Anthropic, open-weight), along with prompt
strategies and agent designs, and know what each option costs in latency and quality.
• Bootstrap quality signal for features that have no production traffic yet. That usually means
generating synthetic documents and test cases, including the ugly edge cases real customers will
eventually send us, and knowing where synthetic data stops being a good proxy.
• Write the templates, docs, and tooling the rest of the team needs to run evals without coming to
you.
Required Qualifications:
• 3+ years of engineering experience, including hands-on work on LLM or agent systems that real
users touched.
• You've evaluated agents, not only models, and you know why single-turn accuracy says little about
a multi-step run.
• You've integrated against APIs you don't own, including old ones with bad documentation, and
turned them into something an agent can call reliably.
• You're comfortable with document pipelines: pulling data out, normalizing it, and checking it against
a structured source of truth.
• You've used at least one LLM evaluation framework, in-house tooling included.
• You know how LLM-as-judge methods break down (position bias, verbosity bias, judge drift) and
what to do about it.
• You can tell a real regression from noise, and design an experiment that answers the question
being asked instead of a nearby one.
• You can read a customer call transcript, work out which failures matter, and ship a fix and an eval
for them.
• You write clearly. Engineers won't act on eval results they don't read or don't trust.
• You're based somewhere between New York time (ET) and Western European time. Italy is the
furthest east we can go.
You might currently be titled
AI Agent Engineer · Agentic AI Engineer · Senior AI Engineer · AI Systems Engineer · Lead AI
Developer · AI Solutions Architect · AI Integration Specialist · Senior Data Scientist, AI
Titles are all over the place in this space. If the work above matches what you already do, apply. We'll
go on what you've shipped.
Preferred Qualifications:
• You've evaluated retrieval systems: RAG, hybrid search, reranking.
• You've worked with agent orchestration frameworks like Temporal, LangGraph, or the OpenAI
Agents SDK, and you know how long-running tool use goes wrong.
• You have a background in information retrieval or search relevance.
• You've worked somewhere an agent's output carried financial or compliance consequences.
• You've built internal tooling that non-engineers used on their own to label and review model output.
This is a fully remote, full-time permanent position available to candidates located within the New York (ET) through Western Europe time zones, with flexible working hours to support collaboration across regions.
Vacantes similares
Hybrid
... orchestrating AI agents using LangGraph or comparable agent frameworks • Experience with AI evaluation, observability and CI/CD practices for production-grade AI systems. You will be responsible for designing, building and operating an enterprise conversational analytics agent for governed clinical operations data. You ...
Spain
... regulated financial firms. The value of AI is capped by the data its agents can reach: if an agent cannot find, interpret, trace or be correctly permissioned against data, the capability is useless, or worse, unsafe. Your job is to close that gap. This is a hands-on senior role for an excellent Python engineer with strong ...
Spain
Full-time hours
About the role We are looking for mobile engineer to build KIRA's AI Finance Agent across Android and iOS. This role is for strong mobile builders who can ship clean, reliable and intuitive mobile experiences, whether their main strength is Android, iOS or both. What you'll do - Build and ship mobile features for Android ...
Spain
Up to US$262,500 a year
... accepted. remote About the company & team Creator (Writer) Hiring process How it works Apply → Pass qualification(s) → Join a project → Complete tasks → Get paidEffort estimate What this is NOT - Not data labeling - Not prompt engineering - Not writing code from scratch - the agent writes most of the code; you guide and ...
Spain
Fully remote
... AI/ML applications OR 9 years of software engineering experience, with exposure to AI/ML applications. - Programming: Strong hands-on experience with Python for AI/LLM application development. - Agentic AI: Hands-on experience designing and building AI agents / Agentic AI solutions. - LLM APIs: Experience integrating and ...
Spain
Fully remote
... scalable, and dependable customer experiences. About the role As a Senior AI Engineer at Typeform, you will design, build, and operate the systems behind our AI products. Your work will span generative AI applications, enterprise RAG systems, agentic workflows, model evaluation, machine learning pipelines, and the infrastructure ...
Spain
Barcelona Supercomputing Center
... Collaborate with the data team to curate high-quality instruction datasets for task-oriented dialogue and function execution. Reference AI Agent & Tool-Use Engineer (RE2) About BSC The Barcelona Supercomputing Center - Centro Nacional de Supercomputación (BSC-CNS) is the leading supercomputing center in Spain. It houses ...
Spain, Barcelona
Fully remote
... enforcement model hands-on • AWS AgentCore Runtime multi-agent invocation patterns • Enterprise A2A governance standard authoring • LangGraph or CrewAI multi-agent orchestration experience Skills • AWS AgentCore Gateway (A2A protocol — agent card registration, routing, enforcement) • Python backend engineering (AgentCore ...
Spain
Barcelona Supercomputing Center
... Contribute to the scientific community through high-quality publications in top-tier conferences like NeurIPS, ICLR or ACL and Open Source projects. Job title Senior AI Agent & Systems Architect (RE3) About BSC The Barcelona Supercomputing Center - Centro Nacional de Supercomputación (BSC-CNS) is the leading supercomputing ...
Spain, Barcelona
Permanent contract
... Confidential Computing, Trusted Execution Environments, AI infrastructure, and hardware/software co-design , this is your opportunity to shape technology that protects AI models, data, and workloads at scale. As a Senior Secure AI Engineer , you'll be at the intersection of AI, security, cloud-native technologies, and next-generation ...
Spain
Fully remote
... makes it the perfect place to integrate AI tools that can augment user workflows. Our vision is that in Notebooks users can collaborate with each other and with AI agents seamlessly. We are looking for a product-oriented Senior Software Engineer to help build the AI-assisted workflows that are becoming central to how customers ...
Spain
The BIG Jobsite
€270 EUR - €300 EUR
SEEKING : Senior AI/Platform Engineer We are looking for a Senior AI/Platform Engineer GOAL : - Engage with project delivery teams during planning and execution to build architecture recommendations Productize Mosaic AI into a governed, multi-tenant, self-service platform - Shipping golden paths, SDK/CLI/templates, and ...
Spain, Vitoria
€270 EUR - €300 EUR
SEEKING : Senior AI/Platform Engineer We are looking for a Senior AI/Platform Engineer GOAL : ► Engage with project delivery teams during planning and execution to build architecture recommendations Productize Mosaic AI into a governed, multi-tenant, self-service platform ► Shipping golden paths, SDK/CLI/templates, and ...
Spain
€270 EUR - €300 EUR
SEEKING : Senior AI/Platform Engineer We are looking for a Senior AI/Platform Engineer GOAL : ► Engage with project delivery teams during planning and execution to build architecture recommendations Productize Mosaic AI into a governed, multi-tenant, self-service platform ► Shipping golden paths, SDK/CLI/templates, and ...
Spain, Castro
€270 EUR - €300 EUR
SEEKING : Senior AI/Platform Engineer We are looking for a Senior AI/Platform Engineer GOAL : ► Engage with project delivery teams during planning and execution to build architecture recommendations Productize Mosaic AI into a governed, multi-tenant, self-service platform ► Shipping golden paths, SDK/CLI/templates, and ...
Spain, Valencia
Orbio seeks an AI Agent Engineer to build, operate, and scale reliable agentic AI systems in production. You will focus on how agents behave, decide, fail, recover, and scale within enterprise environments and ensure observability, cost efficiency, and trustworthiness across workflows. You will help craft an end-to-end ...
Spain, España
... AI Engineer, Growth, you will be the second builder on this engine. Working alongside our lead architect, you execute — building, shipping, and iterating the agent orchestrations, automated workflows, and system integrations that power every growth work-stream: paid growth, lifecycle, organic search, CRO, incentives, referrals, ...
Spain, España
Blu Selection
60k - 70k / year
... data-driven products across their international ecosystem. You'll be jumping right into the heart of their digital transformation journey!And your role in this?As the Senior AI & ML Engineer, you are the technical backbone of the end-to-end machine learning lifecycle. You’ll sit right at the core of the digital and data team, applying ...
Spain, Barcelona
Empresa Confidencial
... inmersa en un proceso de transformación digital, busca incorporar talento técnico para impulsar su estrategia de inteligencia artificial. El rol Incorporamos un/a Senior Backend AI Engineer para construir e integrar funcionalidades de IA en productos que ya están en producción y, cuando sea necesario, desarrollar nuevos productos ...
Spain, Castro