jobify_logo ×
  • User
  • Login/Register
  • Home
  • About Us
  • Contact us
  • Terms of use and Privacy Policy
  • Accessibility Statement
jobify_logo
דילוג לתוכן

Still looking for a job in search engines? It's time to upgrade!

Instead of searching through hundreds of ads on your own - let Jobify analyze your resume and present only opportunities that are truly worth your time. Free, fast, personalized.

Submit a resume through Jobify

Software Engineer - AI Infrastructure

Assembled

Submit a resume through Jobify

Assembled Assembled

  • New York
  • LinkedIn
LinkedIn

Software Engineer - AI Infrastructure

Assembled

Submit a resume through Jobify

Assembled Assembled

  • New York
  • LinkedIn
LinkedIn

Assembled builds the infrastructure that underpins exceptional customer support, empowering companies like CashApp, Etsy, and Robinhood to deliver faster, better service at scale. With solutions for workforce management, BPO collaboration, and AI-powered issue resolution, Assembled simplifies the complexities of modern support operations by uniting in-house, outsourced, and AI-powered agents in a single operating system. Backed by $70M in funding from NEA, Emergence Capital, and Stripe, and driven by a team of experts passionate about problem-solving, we’re at the forefront of support operations technology.

The Role

We’re looking for a software engineer to join our Infrastructure team—building and operating the core systems that power Assist, our rapidly growing AI agent platform for customer support. Assist automates support workflows across email, chat, and voice, and has grown from $0 to $1M in ARR in just 3 months. As adoption accelerates, we’re investing deeply in scaling its infrastructure to meet increasing demand and security expectations from enterprise customers.

As part of the AI Infrastructure team, you’ll be responsible for the systems that enable Assist to be fast, reliable, and secure. You’ll work on foundational platform components that power real-time LLM usage at scale, while also exploring how AI can be leveraged internally to make our engineering team more productive. This team is highly cross-functional, working closely with the AI, security, and product engineering teams.

This is a high-ownership role for someone who’s excited by 0-to-1 building and shaping the infrastructure backbone of our AI products.

Some projects owned by the Infrastructure team

  • Agent service reliability and scaling: We manage and scale the infrastructure that serves LLM-powered agents across chat, email, and voice. This includes selecting inference strategies, integrating with model providers (e.g. OpenAI, Anthropic), and dynamically routing traffic for performance and cost efficiency.
  • Prompt and embedding storage systems: Assist relies heavily on dynamically generated prompts and semantic search across support content. The team owns highly-available, fast-access storage and indexing layers optimized for real-time AI interactions.
  • Privacy and security: Enterprises expect strict guardrails around AI use. We’re building systems like network-level intrusion detection (IDS/IPS), audit logging, and LLM usage policy enforcement to meet these expectations and unlock new sales channels.
  • Observability and usage analytics: We operate systems that surface key metrics—token usage, latency, cost per response, and quality signals—so the Assist team can continuously improve Assist’s performance and accuracy.
  • AI-powered developer tools: We are beginning to explore and evangelize the use of AI to accelerate internal engineering workflows—through internal chat agents, pair programming tools, and intelligent automation for deployment, debugging, and on-call. Our goal is to empower engineers across the company to build faster and more confidently with AI.

About You

  • Have 6+ years of engineering experience, with past ownership of high-scale, production-critical infrastructure
  • Have experience with distributed systems and container orchestration (especially Kubernetes)
  • Have worked with AI/ML platforms or are excited to build foundational infrastructure for LLM-based applications
  • Thrive in fast-paced environments with shifting requirements and ambiguous problem spaces
  • Are motivated by impact, enjoy deep technical challenges, and want to work cross-functionally across security, AI, and product
  • Have strong familiarity with one or more parts of our tech stack:
  • Cloud provider: AWS
  • Orchestration: Kubernetes + Karpenter
  • LLM integration: Experience with OpenAI, Anthropic, or open-source model serving (e.g., vLLM, HuggingFace TGI, Ray Serve)
  • Prompt & embedding infrastructure: Vector databases (e.g., Pinecone, Weaviate, PGVector), semantic search, prompt templating systems
  • Datastores: Postgres + PgBouncer, Snowflake, Redis
  • Languages: Go and Python
  • Monitoring & CI/CD: Datadog, Mezmo, CloudWatch, Buildkite, CircleCI

The estimated salary range for this role is $135,000-$280,000 per year. The base pay offered may vary depending on location, job-related knowledge, skills, and experience. Stock options are provided as part of the compensation package, in addition to a full range of medical, financial, and/or other benefits, dependent on the position offered.

Our U.S. benefits

  • Generous medical, dental, and vision benefits
  • Paid company holidays, sick time, and unlimited time off
  • Monthly credits to spend on each: professional development, general wellness, Assembled customers, and commuting
  • Paid parental leave
  • Hybrid work model with catered lunches everyday (M-F), snacks, and beverages in our SF & NY offices
  • 401(k) plan enrollment


Want to see more suitable jobs? Jobify analyzes your professional experience and presents you with current jobs - for free!

Submit a resume through Jobify
Other recommended jobs for you
  • Wishlist

    Software Engineer – Veterinary AI

    • map_icon New York
    Schwarzman Animal Medical Center>
                                                            <p class=Schwarzman Animal Medical Center

  • Wishlist

    Sr. Software Engineer (AI)

    • map_icon New York
    Jobot>
                                                            <p class=Jobot

  • Wishlist

    AI Software Engineer

    • map_icon New York
    Aegis Ventures>
                                                            <p class=Aegis Ventures

  • Wishlist

    Advanced AI Software Engineer Associate Director

    • map_icon New York City
    Accenture>
                                                            <p class=Accenture

  • Wishlist

    Software Developer

    • map_icon New York
    ManpowerGroup>
                                                            <p class=ManpowerGroup

  • Wishlist

    Software Engineer - AI Search

    • map_icon New York
    Orbis Group>
                                                            <p class=Orbis Group

The job has been added to your favorites list. You can view the jobs you marked at any stage under the main menu in the 'Jobs I Liked' category.

Provides jobs from NYC’S largest job boards.

2025 jobify All right reserved

Let's start!

Working on it...

Our system learns about your skills and experience
and will offer you personalized roles and positions
In addition, we will present you with relevant professional training
that will pave the way for you to your next position

Sorry, we couldn't successfully analyze the data you entered.
Please try entering again or upload a resume if you have one.
Good luck!

You have reached the daily limit of three personal profile updates per day

loader

Your request has been successfully sent!

You can get a personal consultation free of charge from the placement center

You can send a request for a free personal consultation

  • Technical problem

  • Assistance in writing a resume or preparing for a job interview

  • Adjustment of jobs

  • other:

Your request has been successfully sent. A representative from the Nachi Chahal organization will contact you as soon as possible