AI Senior Engineer - $220k-$280k
AI Senior Engineer - $220k-$280k
Build production LLM systems, including RAG pipelines, agent/tool-calling workflows, evaluation frameworks, and monitoring; requires 5+ years backend/systems experience, strong Python, cloud/MLOps, and U.S. work authorization without sponsorship. Onsite with unlimited PTO, Wellhub Platinum, and health, dental, and vision.
Senior AI Engineer - LLM Systems
We are building production-grade AI products that tackle complex, high-stakes problems in (fintech / accounting / legaltech), and we need a senior engineer who can take LLM-powered systems from prototype all the way to reliable, monitored, production services - not just demos.
What you'll do
Design and ship end-to-end LLM-driven features and services using clean-code, CI/CD, and observability best practices
Architect and build retrieval-augmented generation (RAG) pipelines and vector retrieval systems that stay accurate, low-latency, and fresh
Develop agent frameworks and tool-calling pipelines that coordinate multiple models and external systems for complex multi-step workflows
Define and run evaluation frameworks - automated evals, human-in-the-loop annotation, and regression suites - to measure accuracy, safety, and bias
Instrument production models with monitoring, alerting, and A/B testing to catch regressions before users do
Partner with product, design, security, and domain experts to translate business requirements into actionable technical specs
Mentor engineers through code reviews and establish best practices for model development, deployment, and post-deployment maintenance
What you need
5+ years of production backend or systems engineering experience; strong Python and modern practices (testing, CI/CD, containerization)
Hands-on experience with LLMs and transformer architectures including fine-tuning, prompt engineering, or adapting foundation models for production
Demonstrated experience designing and integrating retrieval systems (vector databases, dense/sparse retrieval, similarity search) with LLMs
Practical experience building agent and tool-calling pipelines with multi-step orchestration and state management
Experience with cloud platforms (AWS, GCP, or Azure), MLOps tooling, and cost-effective inference scaling
Nice to have
Domain experience in fintech, accounting, audit, or legaltech - especially regulatory, privacy, or compliance considerations
Familiarity with specific tooling: LangChain, LlamaIndex, Weaviate, FAISS, Pinecone, Ray, or MLflow
Experience designing human annotation workflows and managing eval suites at scale
Background collaborating with security and privacy teams to implement guardrails and access controls in regulated environments
Pay & benefits
$220k-$280k base - $300k-$600k Equity
Location & schedule
Manhattan, NY - Onsite
Benefits
Benefits
Unlimited PTO
Wellhub Platinum membership
Comprehensive health, dental, and vision coverage
Free company dinner every day
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity or expression, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, status as a crime victim, disability, protected veteran status, or any other characteristic protected by law. Our hiring process includes AI screening for keywords and minimum qualifications, and a virtual recruiter as part of the application process. A human recruiter reviews all results. Click here for details on our virtual recruiter . Everforth CyberCoders will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable state and local law, including but not limited to the Los Angeles County Fair Chance Ordinance, the San Francisco Fair Chance Ordinance, and the California Fair Chance Act. Everforth CyberCoders is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. Individuals needing special assistance or an accommodation while seeking employment can contact a member of our Human Resources team at Benefits@CyberCoders.com to make arrangements.
Salary
$220000 - $280000 USD per year