Golang Microservices: Events Streaming using Apache Kafka

Let’s add support for Apache Kafka! Apache Kafka is an event streaming platform that allows you to:

* Publish and subscribe to streams of events,
* Store streams of events for as long as you want, and
* Process streams of events as they occur.

In Go to interact with Kafka, we can use:

* https://github.com/confluentinc/confluent-kafka-go OR
* https://github.com/Shopify/sarama

I personally prefer using Confluent’s package because they are the one behind the scenes providing commercial support for Kafka.

Learning Kafka takes some time and even if you’re familiar with the tools I highly encourage you to take advantage of managed services like Amazon Managed Streaming for Apache Kafka (Amazon MSK) it will simplify your live when working with Kafka clusters!

—

* Example code: https://github.com/MarioCarrion/todo-api-microservice-example/tree/8f7d667a2136c66ad2f893c7802edf46cafd6f35
* Blog: https://mariocarrion.com/2021/06/03/golang-microservices-events-streaming-kafka.html

* Previous Episode: “Golang Microservices: Golang Microservices: Events and Background Jobs using RabbitMQ”: https://youtu.be/L0yJxCKrkIY
* Playlist “Building Microservices in Go/Golang”: https://www.youtube.com/playlist?list=PL7yAAGMOat_Fn8sAXIk0WyBfK_sT1pohu
* Playlist “Golang Tools and Packages”: https://www.youtube.com/playlist?list=PL7yAAGMOat_HEEOvH99agDs_5g51A0Ls3
* Playlist “Testing in Go”: https://www.youtube.com/playlist?list=PL7yAAGMOat_HSeW4zF0uRL9EaHadE4ZZq

00:00 Start
00:12 What is Apache Kafka?
01:30 How does Apache Kafka work?
03:46 Apache Kafka + Golang Demo starts
10:00 Conclusions

—

Who am I:

Hello👋🏼! I’m Mario, a Hands-on Software Architect and Lead Backend Engineer with more than 16 years of professional experience building all kinds of software including on-premise Industrial Automation Systems, Linux Accessibility Desktop and Browser Components as well as Distributed Advertising Microservices.

Every week I will share with you different topics I’ve learned while working for small startups and large companies including the processes I’ve followed over the years for successfully delivering complex enterprise systems from start to end.

Subscribe if you like Software Development, Software Architecture and Systems Design!

Keep it up. Don’t give up!

#golang #microservices #programming

— Our affiliate links below

Shop our favorite products → https://www.amazon.com/shop/rubycarrion
Vlogging setup → https://rubycarrion.com/camerasforvlogging/
Get a 30 day FREE trial of Epidemic Sound → https://www.epidemicsound.com/referral/szx441/
Try Amazon Prime 30-Day FREE trial → https://amzn.to/3s0el1R
I love getting Cash Back and think you will too! Join for free and get $20 when you spend $20 → https://www.rakuten.com/r/RUBYRA132?eeid=28187
Sign up to start using vidIQ to grow your YouTube channel for FREE → https://vidiq.com/rubycarrion

— Our Vlog Channel

https://www.youtube.com/c/RubyCarrion/videos