How Do You Fix Apache Kafka when It Hangs?

0 Comments

Problem scenario
You try to start the Apache Kafka service. You get this:

[2021-07-25 12:15:36,687] INFO [Group Metadata Manager on Broker 1]: Finished loading offsets from [__consumer_offsets,24] in 123456789 milliseconds.

GroupMetadataManager…Finished loading offsets and group metadata from __consumer_offsets…seconds spent in the scheduler. (kafka.coordinator.group.GroupMetadataManager)

It just hangs and will not progress. What do you do?

Solution
Whenever a command hangs that is supposed to start a service,

…

Continue reading “How Do You Fix Apache Kafka when It Hangs?”

What Does MSK Stand For in I.T./DevOps?

0 Comments

Question
You have seen “MSK” in an article on the public cloud. Does the “K” stand for “Key”? What does MSK stand for?

Answer
MSK stands for “Managed Streaming for Kafka”. It is an Amazon product.

“Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed service that enables you to build and run applications that use Apache Kafka to process streaming data.

…

Continue reading “What Does MSK Stand For in I.T./DevOps?”

How Do You List the Kafka Topics when You Cannot Find the kafka-topics.sh File?

0 Comments

Problem scenario
You cannot find kafka-topics.sh. But you want to list the Kafka topics. What should you do?

Solution
Find the kafka-topics binary file. Use something like this (but replace “localhost” with the server name of Zookeeper and “2181” with the TCP port number):

kafka-topics –list –zookeeper localhost:2181

(This was adapted from https://stackoverflow.com/questions/44405663/list-all-kafka-topics.)

…

Continue reading “How Do You List the Kafka Topics when You Cannot Find the kafka-topics.sh File?”

How Do You Install and Configure Apache Camel on a Linux Server?

0 Comments

Problem scenario
You want to install and configure Apache Camel from source on any distribution of Linux. What do you do?

Solution
You cannot. But there is a way to use Apache Camel as a test.

Background: It is not something that is can be purely installed-and-configured like other applications. Camel is a framework for integrating messaging solutions or microservice architecture.

…

Continue reading “How Do You Install and Configure Apache Camel on a Linux Server?”

How Do You Troubleshoot the ActiveMQ Build Failure “No plugin found for prefix ‘activemq-perf'”?

0 Comments

Problem scenario
You run this command:

sudo /opt/maven/bin/mvn activemq-perf:broker -Durl=broker:tcp://localhost:61616

You get this result:

[INFO] Scanning for projects…
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-metadata.xml
Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/mojo/maven-metadata.xml
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-metadata.xml (14 kB at 17 kB/s)
Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/mojo/maven-metadata.xml (20 kB at 25 kB/s)
[INFO] ————————————————————————
[INFO] BUILD FAILURE
[INFO] ————————————————————————
[INFO] Total time: 1.815 s
[INFO] Finished at: 2020-04-28T15:33:05Z
[INFO] ————————————————————————
[ERROR] No plugin found for prefix ‘activemq-perf’ in the current project and in the plugin groups [org.apache.maven.plugins, …

Continue reading “How Do You Troubleshoot the ActiveMQ Build Failure “No plugin found for prefix ‘activemq-perf’”?”

How Do You Set Up Apache Kafka on Any Distribution of Linux?

0 Comments

Problem scenario
You want to set up Apache Kafka with a single broker just to test out. How do you do this on any distribution of Linux?

Prerequisite
You must install Zookeeper. If you need assistance, see this posting.

You may want to install screen because this solution will rely on it; you could open duplicate terminals instead of using the screen command.

…

Continue reading “How Do You Set Up Apache Kafka on Any Distribution of Linux?”

How Do You Use Amazon Simple Queue Service?

0 Comments

Problem scenario
You want to use Amazon SQS. How do you use this in AWS?

Solution

  1. Log into the AWS console.
  2. Go here: https://console.aws.amazon.com/sqs/
  3. Click “Get Started”
  4. Enter a queue name (e.g., contintqueue)
  5. Click “Quick-Create Queue”
  6. Click the radio button associated with the queue. Then click “Queue Actions” (the button near the top left).

…

Continue reading “How Do You Use Amazon Simple Queue Service?”

How Do You Troubleshoot the Message “ImportError: cannot import name ‘pubsub_v1′”?

0 Comments

Problem scenario
From the Python command prompt or when running a Python program, you receive this message “ImportError: cannot import name ‘pubsub_v1′”. What should you do?

Solution
Possible Solution #1
Try to run the program as sudo: sudo python nameOfProg.py

Possible Solution #2
Prerequisite
This assumes that pip has been installed.

…

Continue reading “How Do You Troubleshoot the Message “ImportError: cannot import name ‘pubsub_v1′”?”

How Do You Troubleshoot the Message “ImportError: No module named ‘google'”?

0 Comments

Problem scenario
From the Python command prompt or when running a Python program, you receive this message “ImportError: No module named ‘google'”. What should you do?

Solution
Possible Solution #1
Try to run the program as sudo: sudo python nameOfProg.py

Possible Solution #2
Prerequisite
This assumes that pip has been installed.

…

Continue reading “How Do You Troubleshoot the Message “ImportError: No module named ‘google’”?”

A List of Books on Message Queuing Solutions: ActiveMQ, AMQP, WebSphere and ZeroMQ

0 Comments

This is a list of books focusing on message queuing solutions other than RabbitMQ.  For RabbitMQ, see this link.

AMQP PREDICTIVE ANALYTICS REPORT by Gerard Blokdijk
ActiveMQ in Action by Bruce Snyder, Dejan Bosanac and Rob Davies
Code Connected Volume 1: Learning ZeroMQ by Pieter Hintjens
Programming WebSphere MQ with JAVA by Kunal Jaggi
ZeroMQ: Messaging for Many Applications  by Faruk Akgul
ZeroMQ: Messaging for Many Applications by Pieter Hintjens

[Sassy_Social_Share]