TMCnet News

Redpanda Acquires Benthos to Deliver a Complete, End-to-End Streaming Data Platform
[May 30, 2024]

Redpanda Acquires Benthos to Deliver a Complete, End-to-End Streaming Data Platform


Streaming data pioneer Redpanda today announced its acquisition of London-based Benthos, the popular open-source stream processing platform that enables enterprises to move, integrate, and perform transformations on streams of data flowing between systems and data sources. The acquisition completes Redpanda as a unified, end-to-end streaming data platform built close to the hardware to be more performant, simpler to deploy and easier to operate, with greater enterprise reliability versus the combination of Apache Kafka and Kafka Connect.

"Our users can now go from anywhere to anywhere. Redpanda Connect - through our Benthos acquisition - is now the most complete connectivity framework for the Kafka ecosystem," said Alex Gallego, founder and CEO of Redpanda. "There simply does not exist a more complete, end-to-end platform for streaming your data - one that spans every single form factor from embedded IoT devices to the largest cloud workloads. Gone are the days of suffering through multiple projects that manually stitch data from your streams to your data warehouse or operational database. We are super proud to bring the simplest connectivity and ecosystem to the Redpanda family."

Benthos, which is now called Redpanda Connect, utilizes the modern, cloud-native design of Go to deliver optimized performance for an ecosystem of more than 220 pre-built connectors. It lets engineers quickly build connectivity to streaming sources, transforming data pipelines to power real-time data products. Benthos is used widely by hundreds of leading brands, powering robust 50GB/s applications while providing deep observability with developer tooling from CLI and SDKs, to config validation, debugging, and tracing. Like Redpanda, the newly acquired Redpanda Connect technology is resource efficient, requiring 3x less compute resources than Kafka Connect.

"The combination of Redpanda and Benthos brings a new world of connectivity to the Zafin Integrate & Orchestrate (IO) platform," said Shahir Daya, CTO of fintech leader Zafin. "Zafin IO is a foundational technology platform that provides data and application integration capabilities to facilitate core modernization efforts at banks. With Redpanda Connect's ease of use and extensibility, we can now effortlessly ingest data from our banking customers' many diverse core systems of record, process it in real-time, and deliver valuable insights back to them - all within a single, unified platform."

"The addition of Benthos to the Redanda platform is great news for us at ShareChat," said Shubham Dhal, Tech Lead at ShareChat. "We've used Benthos for a number of use cases, from simple stateless processing to writing transformation jobs. We've found it to be amazingly performant, easily scalable both vertically and horizontally, and requiring little to no infra set-up. Combining these capabilities with Redpanda opens up a whole new set of possibilities for us. We welcome Redpanda Connect."



The former Benthos team has joined Redpanda as part of the acquisition. "The combination of our streaming connectivity technology and Redpanda is a game-changer to the industry," said Ashley Jeffs, founder of Benthos. "We're ushering in a new era of real-time data autonomy - developers can now ingest, process and land data from any source through a simple, unified platform with levels of efficiency and power that were never before possible."

An Extensible Redpanda Ecosystem


With Redpanda Connect, the Redpanda streaming data platform easily connects with a wealth of AI systems, databases, data warehouses, applications and files to streamline and simplify the creation of composable data products. Example integrations include: Meroxa to bridge data sources and destinations, Ockam to enable zero-trust across the entire Redpanda ecosystem, and PeerDB for native Postgres change data capture.

"Meroxa is excited to partner with Redpanda to bring multi-language SDK support for the Redpanda Connect ecosystem via our popular open source project Conduit," said DeVaris Brown, founder and CEO of Meroxa. "As an existing Redpanda customer, we are excited to deepen our partnership to bring to the world the best developer experience for the connector ecosystem with Meroxa and Redpanda Connect."

"Redpanda Connect with Ockam is the world's first end-to-end, zero-trust streaming data platform," said Matthew Gregory, Ockam's CEO. "Other enterprise Kafka product vendors defer zero-trust implementation details to their customers. Redpanda Connect with Ockam empowers a single developer to easily create end-to-end encrypted streaming pipelines across enterprise-scale infrastructure. Redpanda Connect with Ockam is secure-by-design so you can stream data across your enterprise with scale, performance, security, privacy, integrity, and trust."

"PeerDB is excited to partner with Redpanda to deliver the most performant change data capture system for the Redpanda Connect ecosystem," said PeerDB CTO and co-founder Kaushik Iska. "Our goal has always been to make CDC as simple as possible and we are excited about our partnership with Redpanda. Native Postgres CDC is a new fundamental building block for decoupling databases and allowing for larger-scale operational workloads from every single trigger in your PostgreSQL database."

Available Today

Redpanda Connect is now available and fully integrated with Redpanda Enterprise and Redpanda Community editions. Users can download it from the Redpanda GitHub repo. Visit redpanda.com or join the Redpanda Community slack with any questions.

Redpanda Connect Launch Stream

On June 27th at 9am PDT Redpanda will host a live launch event for Redpanda Connect that will include an update from Redpanda founder Alex Gallego, a live demo, customer roundtable and Q&A. To register for the event or to sign-up for an on-demand recording, please save your spot today.

About Redpanda

Redpanda is the end-to-end streaming data platform for developers. API-compatible with Apache Kafka, Redpanda introduces a breakthrough architecture and disruptive capabilities that make it an easy, fast, scalable, and cost-effective engine of record for both real-time and historical enterprise data. Innovators like ShareChat, Jump Trading, Vodafone, Moody's, Hotels Network and Alpaca rely on Redpanda to process hundreds of terabytes of data a day. Backed by premier venture investors Lightspeed, GV and Haystack VC, Redpanda is a diverse, people-first organization with teams distributed around the globe. To learn more, visit our website at redpanda.com and follow us on X (formerly Twitter) at @redpandadata.


[ Back To TMCnet.com's Homepage ]