Kafka: Building a Data Pipeline
Scott is going cover how Kafka is used at SoFi as an event bus backbone for decoupled microservices. This presentation will also cover the motivation to use Kafka, and how specific requirements impacted adoption. The presentation will share the overall architecture, benefits to the company, and include specific use cases. Those use cases include decoupling of microservices, development of a stream processing BI platform, and reducing our reliance on batch jobs in favor of real time data updates.
Scott is a Senior Software Engineer at SoFi, leading the efforts for Kafka adoption and development of various microservices. I have 18 years of software development experience, concentrating on Java and related technologies.