How Replicate transformed their webhooks infrastructure using Svix · Svix

Our easy-to-use webhook API equips you to deliver a top-tier webhook experience.
Robust products for sending, receiving, and testing webhooks.
Join the Svix community and get support.
Svix is used by a variety of industries for different use cases.
Replicate as an AI and machine learning platform that enables people to run machine learning models in the cloud. Replicate customers can run and train models on the Replicate platform for anything from development and research, and all the way to powering their production applications.
Replicate supports all available AI workloads including generative AI workloads like image generation (e.g. stable fusion) as well as large language models (LLMs).
Replicate is one of the most exciting AI infrastructure companies around, with more than 30,000 paying customers, including some of the world's leading AI companies and brands such as: BuzzFeed, Character.ai, and Unsplash.
Svix's platform is reliable, fast, and makes our lives easier by handling the complexities of webhooks, allowing us to deliver a better experience for our users.
Many AI workloads are inherently asynchronous: you trigger an inference or training, and you want to get notified when it's queued, succeeds, fails, and other such lifecycle updates. Once these are done, you want to take actions like sending it to the next step in your AI data pipeline.
Webhooks enable Replicate and their customers to interact with complex AI models like they would interact with any other API. Making Replicate a core part of their workflows without necessarily having deep AI knowledge.
One common example is fine-tuned training (e.g LoRa). Let's say you want to create a service that lets customers upload a set of images to set the stylistic tone, and then be able to transform images to that same style. We'll call that service Painter for the sake of example.
The Painter UI will let a customer upload a set of images with the wanted style, and the image they would like to transform. In the background, Painter will then send Replicate the set of images to fine-tune the model. Once done, Replicate will trigger a webhook to let Painter know, and at that point Painter will send the image to transform to Replicate to run through the model. Once that's done, Replicate will send another webhook to let Painter know, who can then notify the customer.
Essentially, webhooks enable Replicate and its customers to build single and multi-step AI workflows that operate in real-time with minimal code and operational complexity.
Before discovering Svix, Replicate had a different webhook sending system that they built in house. The kept running into the many known limitations in their internal webhook sender, and they felt like the customer experience could be much better.
Webhooks are not an easy thing to build. You can do an OK or even decent job, but doing webhooks great is a real challenge.
Replicate was initially planning to invest time and resources into fixing some of the issues they were experiencing in they webhook system. Though as they said: if you build your own webhook system you may be able to send webhooks, but getting actionable data back to customers in terms of webhooks observability is a another challenge; referring to the Svix webhook management and observability utilities.
Being such a large and flexible platform as they are, they were also facing challenges with noisy-neighbors: essentially when one customer would send too much data or start failing too much, webhook deliveries for all of their customers will start to suffer.
Replicate eventually started looking around for what options there are available and saw that: Svix was the best platform out there. It had a rich SDK, a very nice API and platform, you could see all of the additional benefits that we could get, and the added observability is a great addition. They further added: With just a little bit of additional work we also had custom components in our UI that present information about webhooks to our customers. We now have graphs, logs and everything that customers love. They can also diagnose and solve issues on their own..
In addition to increasing the reliability, delivery rates, and durability of their platform, Replicate also gained deeper visibility and understanding into the webhooks they were sending. Catching potential mistakes as they were happening and fixing them, an area that they didn't have much visibility into in the past.
We now felt confident with our webhooks system, and could trivially start sending more types of webhooks.
Another unexpected benefit that they noticed is that webhook delivery is now significantly faster and have a more consistent latency. So webhooks are not only delivered faster, but they variability in the delivery time is much lower causing for a better experience for their customers and their workflows.
Switching to Svix was relatively low effort for them. It took them two weeks to go from deciding to use Svix to going to production, with very little of it spent coding, and most of it spent on verification and end-to-end testing to make sure there were no differences compared to their previous implementation.
We have customers that absolutely rely on webhooks, and they were unhappy with the current system. We had to fix it, and with Svix it was a relatively low effort to fix a very visible piece of poor experience in our platform.
One of the main things that Replicate were hoping to achieve by switching to Svix is once it's out of our system, it's going to be delivered. They have customers that rely on their webhooks so reliability is key. Svix has delivered that and more.
We would sometimes have some suggestions for improvements to the product to make things even more ergonomic for us. We would suggest them to Svix in our shared Slack channel, and most of the time it would magically show in the product the next day, or at most the next week. It's an amazing experience.
Svix also lets its customers consume