Installing and Testing Kafka on MacBook M1

Kafka is a powerful open-source event streaming platform that enables efficient data pipeline and analytics.

### Installing and Testing Apache Kafka on MacBook M1
* 💻 Today, I will guide you through the installation of Apache Kafka on a MacBook M1, starting with an introduction to Kafka as an **open-source distributed event streaming platform** used by many companies for **high-performance data pipeline streaming analytics**.
* 🔗 To begin, you can visit the official Apache Kafka site by searching for "**Kafka Apache**" on Google, where you can find resources to download Kafka, including **basic and enterprise versions** like **Confluent Kafka**.
* 📥 For installation, you can download the desired version, such as the **G format**, and once downloaded, unzip it to your preferred folder, navigating to the **binary folder** to access the necessary scripts to run the **Kafka ecosystem**.
* ⚙ After downloading, you will need to configure the `server.properties` file by **uncommenting specific lines** and setting the appropriate **IP address for local use**, as well as setting the **home path for Confluent** in your terminal.
* ☕ Ensure you are using JDK versions **1.8 or 11**, as higher versions like Java 15 are **not supported**; switching to Java 11 may be necessary for **successful operation**.
* 🛠 Once Java is set correctly, you can start the Kafka services using the command `confluent local services start`, which will initiate **Zookeeper, Kafka, and other components of the ecosystem**.
* 📊 After starting the services, you can access the control center at `localhost:9021` to **create a test topic and verify functionality** by producing and consuming messages, confirming that your installation is **successful**.
* 🧹 Finally, remember to **stop all services and clean up any created topics** to maintain a tidy environment, ensuring a **smooth Kafka experience** on your MacBook M1.

How to install Confluent Kafka in mac m1

Shri Krishna Sankirtanam

Kafka is an open-source distributed event streaming platform used for high-performance data pipeline and analytics.

The enterprise version, Confluent Kafka, offers additional components and requires a license for download.

After downloading and unzipping Kafka, the binary folder contains scripts to run the Kafka ecosystem locally, including commands for starting Kafka and producing/consuming messages.

You need to uncomment specific lines in the configuration to set the IP address and protocol for Zookeeper and Kafka.

Set the home path for Confluent Kafka and include the binaries in the path.

11, as higher versions are not supported, and run the Kafka startup commands with the correct architecture flag.

Switching to Java 11 and Starting Kafka Services

The process involves switching to Java 11 and using the terminal's Rosetta setup for Intel architecture.

After setting Java 11, the command "confluent local services start" is run to initiate all Kafka services, including Zookeeper and the Control Center.

The setup is for local development, with a license required for production use.

Testing Kafka: Creating a Topic and Messaging

Kafka is running on port 9021, and the ecosystem automatically creates brokers, partitions, and replicas.

A test topic named "test" is created with a default partition.

Messages are produced and consumed using Kafka's console producer and consumer commands, with messages being exchanged instantly.

Kafka setup is complete, with both producer and consumer services running.

To stop the services, a command is used to shut them down one by one.

Finally, a command is provided to clean up any created topics.