HubSpot Engineering

Latest posts

Writing lately

New Open Source Nagios Plugin for Checking JSON Web Services

We're starting to release some of the Nagios plugins we've written or modified internally for wider use. The first one is a handy tool for checking JSON web services response values via Python 2.4+ utilizing the simplejson module. It's faily simple at the moment but expect threshold and timestamp matching to come in the next few weeks. Follow the updates on our GitHub repository: https://github.com/HubSpot/HubSpot-Nagios-Plugins

This plugin was a fork of work previously done by Peter Kropf, and is hosted at https://github.com/pkropf/Nagio-Plugins/tree/master/json

The main use for this was to create useful status checks on our existing JSON API's (check out docs.hubapi.com for more info on those) through the actual mechanisms they use to deliver normal responses. Other Nagios plugins offer you the ability to check for strings or regular expressions, which does part of the job, but we wanted to make sure the status returned was properly serialized JSON and that it used the same code that serves data to non-monitoring requests. Future improvements mean we can monitor error rates and timing information from the service directly and not have to add circuitous checks on logs or other items through slower aggregation techniques. And of course, better monitioring means better information which leads to better quality software which ultimately leads us to happier customers!

Newsletter

For Agents

View Markdown

Share

More posts

Hedging Erasure-Coded Reads in HDFS

Erasure coding halves the disk our HBase data needs, but every byte lives on one DataNode. Hedging slow reads by rebuilding the slow cell from its stripe's parity cut slow-read host-minutes on our case-study cluster by 98%.

Building Observable Access Control at Scale: A Rule Engine Approach to JITA

Discover how HubSpot transformed its access control system with a parallel rule engine, enhancing security and observability while managing thousands of daily requests.

Building the AI Retrieval Infrastructure Behind 20 Billion+ Vectors at HubSpot

Discover how HubSpot built a scalable AI retrieval infrastructure, managing over 20 billion vectors with Qdrant, to enhance semantic search and support diverse applications.