HubSpot Engineering

Latest posts

Writing lately

Mesos, HubSpot, and the Singularity

Apache Mesos is one of the core pieces of infrastructure that helps HubSpot developers deploy 300 times a day. In this talk, Tom Petr (@tpetr) explains HubSpot's deployment infrastructure and the benefits that Mesos provides. Specifically, he showcases two open source projects: Singularity, a home-grown Mesos framework, and Baragon, an API for manipulating load balancers.

Mesos, HubSpot, and the SingularityYouTube

Make sure you check out Singularity and Baragon on GitHub!

Newsletter

For Agents

View Markdown

Share

More posts

Hedging Erasure-Coded Reads in HDFS

Erasure coding halves the disk our HBase data needs, but every byte lives on one DataNode. Hedging slow reads by rebuilding the slow cell from its stripe's parity cut slow-read host-minutes on our case-study cluster by 98%.

Building Observable Access Control at Scale: A Rule Engine Approach to JITA

Discover how HubSpot transformed its access control system with a parallel rule engine, enhancing security and observability while managing thousands of daily requests.

Building the AI Retrieval Infrastructure Behind 20 Billion+ Vectors at HubSpot

Discover how HubSpot built a scalable AI retrieval infrastructure, managing over 20 billion vectors with Qdrant, to enhance semantic search and support diverse applications.