CAST AI Logo

CAST AI

Senior Software Engineer | Kimchi (API Platform Team)

Posted One Month Ago
Be an Early Applicant
Remote
Hiring Remotely in Ireland, IRL
Senior level
Remote
Hiring Remotely in Ireland, IRL
Senior level
Build and operate the inference API platform powering AI services at global scale. Own distributed systems, datastores, observability, analytics, billing, usage metering, role-based controls, and CI/CD. Diagnose performance issues using query profiling and flame graphs, optimize reliability and latency, and deliver features end-to-end from design through production rollout. Collaborate directly with product and engineering teams in a fast-paced, ambiguous startup environment.
The summary above was generated by AI
Why Kimchi?

Kimchi is the AI platform inside CAST AI. We started by helping companies run LLMs on their own Kubernetes clusters and now we're providing a managed variant of those same capabilities.

Our Infrastructure today

Multi-model inference (MiniMax, Kimi, GLM-5, Nemotron, DeepSeek) with intelligent routing, an OpenAI-compatible API and deployment ranging from our GPUs to your own VPC. The inference layer is the foundation and the API is what sits in front of it as the primary channel for broadly and reliably distributing our AI services and powers our own Kimchi harness.

As a Senior Software Engineer, you will have the opportunity to work on different key features of our product. All of these are high-agency roles across multiple parts of the tech stack that minimize process friction that would otherwise prevent you from shipping.

In every team you will own features end-to-end: design, implementation, testing, production rollout. Most projects ship in 1-4 weeks. You'll work directly with product and other engineering teams on problems that don't have textbook solutions.

We are currently hiring Senior Software Engineers for the API Platform Team:

Owns the inference API responsible for delivering our AI services across the world while making sure it's reliable and capable to scale in tandem with our company's growing ambitions, as well as our analytical platform, billing and role-based controls that enable our users to monitor and control their usage with ease - be it as a solo developer or a large enterprise. You'll own our infrastructure, datastores, analytics, observability and CI/CD pipeline.

Responsibilities:
  • Develop with observability in mind, identify bottlenecks and optimize for performance. When p99 latency climbs, you find the cause through query profiles and flame graphs instead of raising the alert threshold.
  • Design the datastores and distributed systems behind the inference API, and keep them reliable as usage scales from a solo developer to a large enterprise.
  • Build the billing, usage metering, and role-based controls that let users monitor and govern their own consumption. Catch correctness problems where a wrong number costs you trust.
Requirements
  • Production experience with Go or Typescript is strongly preferred; candidates without either should demonstrate strong systems programming skills in a comparable language.
  • Strong debugging, optimization, and performance-tuning skills – including query profiling, index design, and database performance tuning beyond ORM usage.
  • Hands-on experience with cloud platforms (AWS, GCP, or Azure) and Kubernetes is a strong plus
  • Observability tooling (Prometheus, Grafana, OpenTelemetry), CI/CD and DevOps practices experience.
  • Startup mindset: adaptable, proactive, and comfortable with ambiguity.
  • Strong English skills, both verbal and written.
  • You've personally driven a complex project end-to-end.
What’s in it for you?
  • Competitive salary (€6,500 - €9,000 gross, depending on the level of experience).
  • Enjoy a flexible, remote-first global environment.
  • Collaborate with a global team of cloud experts and innovators, passionate about pushing the boundaries of Kubernetes technology
  • Equity options.
  • Get quick feedback with a fast-paced workflow. Most feature projects are completed in 1 to 4 weeks.
  • Spend 10% of your work time on personal projects or self-improvement. 
  • Learning budget for professional and personal development - including access to international conferences and courses that elevate your skills.
  • Annual hackathon to spark new ideas and strengthen team bonds.
  • Team-building budget and company events to connect with your colleagues.
  • Equipment budget to ensure you have everything you need.
  • Extra days off to help maintain a healthy work-life balance.
Hiring process
  • Screening call with Recruiter
  • Hiring Manager interview
  • Technical interview (system design)
  • Live coding
  • Culture Check interview with an executive

As part of our standard hiring process, we would like to inform you that a background check may be conducted at the final stage of recruitment through our third-party provider, Checkr.
Please note that Cast AI does not provide any form of visa sponsorship/work permit.

#LI-Remote


Similar Jobs

3 Days Ago
In-Office or Remote
Ireland, IRL
Senior level
Senior level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Build and own evaluation infrastructure, observability tooling, datasets, annotation workflows, and diagnostic systems for production AI agents. Lead experiments across prompts, models, routing, caching, cost, and latency. Diagnose failures across planning, tool use, and agent execution, while partnering with AI Core engineering. Manage and grow the AI Quality team as a hands-on player-coach, contributing directly to production code and technical direction.
Top Skills: Ai AgentsAnnotation WorkflowsBraintrustCachingCi/CdEvaluation FrameworksLangsmithLlmsModel RoutingObservability ToolingPythonRuby On Rails
4 Days Ago
Easy Apply
Remote or Hybrid
Ireland, IRL
Easy Apply
Senior level
Senior level
Enterprise Web • Hardware • Internet of Things • Software
Manage a portfolio of life sciences customer accounts, driving adoption, utilization, operational digitization, measurable ROI, renewals, and commercial expansion. Serve as the internal customer champion and trusted advisor while coordinating Sales, Product, Engineering, Support, Professional Services, and partners. Build executive relationships, lead stakeholder presentations, guide GxP manufacturing change management, and improve Customer Success processes. The role requires life sciences industry experience, enterprise collaboration, and up to 15% travel across the EMEA region.
Top Skills: AITulip
4 Days Ago
In-Office or Remote
Ireland, IRL
Senior level
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Leads Pfizer’s medical channel excellence team and develops global omnichannel strategies for scientific engagement across therapeutic areas. Oversees audience journeys, digital and social channels, paid media, vendor relationships, budgets, regulatory alignment, and channel performance. Partners with Medical Affairs, R&D, Evidence Generation, legal, compliance, and global teams to disseminate scientific content to healthcare professionals. Provides strategic leadership, manages resources, develops channel infrastructure, and drives innovation in personalized medical communications.
Top Skills: Digital PlatformsOmnichannel Engagement PlatformsScientific Content Dissemination ToolsSocial Media ChannelsThird-Party Digital Platforms

What you need to know about the Dublin Tech Scene

From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account