Job Description

Senior Software Engineer (TypeScript / React / LLM Systems) • AI Infrastructure • $250,000 • Hybrid (2 days/week) • New York, NY

Must be based in NYC & the role requires US Citizenship due to regulatory constraints. No sponsorship/visas/Green Card.

About the Role

We’re hiring a Senior Software Engineer to help build production-grade LLM-powered systems used in high-impact, real-world workflows.

This is a true SWE + ML role. You’ll sit at the intersection of frontend UX, backend systems, and applied machine learning - owning features end to end. That includes React-heavy user interfaces, TypeScript services, and the pipelines that power LLM reasoning, retrieval and fine-tuning behind the scenes.

You’ll work closely with product, design and ML engineers to ship tools where reliability, clarity and user experience matter just as much as model quality.

Why You’ll Love It:

Own real systems: From UX flows to LLM pipelines running in production.

Engineering-first culture: Practical ML, not research theatre. Everything ships.

High-impact UX: Build interfaces used daily by technical and non-technical users.

Move fast: Small teams, short cycles, minimal process overhead.

Serious problems: Latency, hallucination control, evaluation, observability and scale.

What You’ll Do

• Design and build TypeScript services that power LLM workflows including RAG pipelines, prompt orchestration and fine-tuning flows.
• Develop rich, intuitive React interfaces for AI-driven products - heavy focus on UX, clarity and usability.
• Implement retrieval systems using vector databases, hybrid search and structured data sources.
• Work hands-on with LLM APIs and open-source models (OpenAI, Anthropic, open-weight models).
• Collaborate with ML engineers on evaluation, fine-tuning strategies and production rollout.
• Own backend architecture across Node.js services, async pipelines and model-facing APIs.
• Improve system reliability through logging, monitoring, tracing and failure handling.
• Mentor engineers and contribute to design and architecture decisions across the platform.

Tech Stack

Frontend: React, TypeScript, Next.js, Tailwind CSS, Storybook

Backend: Node.js, TypeScript, REST, GraphQL

LLM Systems: RAG pipelines, fine-tuning workflows, prompt orchestration

Data & Retrieval: PostgreSQL, Vector DBs (Pinecone, Weaviate, pgvector), Redis

Infrastructure: AWS, Docker, Kubernetes, Terraform

Observability: OpenTelemetry, Prometheus, Grafana, Sentry

Nice to Have

• Experience building production LLM systems beyond prototypes
• Hands-on fine-tuning experience (LoRA, adapters, evaluation pipelines)
• Background in ML engineering or applied NLP
• Experience designing complex frontend UX for data-heavy or AI-driven products
• Familiarity with model evaluation, guardrails and hallucination mitigation

Interview Process

1. Intro Call with Open Talent (30 mins)
2. Technical Deep-Dive (TypeScript / React + LLM systems, 60 mins)
3. System Design & Architecture (45 mins)
4. Leadership Chat with CTO (30 mins) → Offer

What We Offer

Comp: $160K-$240K W-2 (+ meaningful equity)

Benefits: Health, dental, vision, 401(k)

Time Off: Flexible PTO + company holidays

Growth: Conference budget, learning allowance

Environment: Hybrid (2 days NYC office), flexible notice period

Equal Opportunity

We're hiring for an Equal Opportunity Employer.

Due to strong market interest, please apply early or email sufy@opentalent.uk to avoid missing out.

All NYC roles posted here first:

linkedin.com/in/sufyanbashir/

Job Tags

Similar Jobs