A Technical I.T./DevOps Blog
Problem scenario
You have Maven installed. You want to know if it has the plugin for Apache Parquet from the Linux terminal. You do not want to use the Maven GUI. What do you do?
Solution
1. sudo find / -name pom.xml
2. Change to the directory of the pom.xml with Apache Parquet.
3. Run this command:
mvn help:effective-pom | grep -i parquet
…
Continue reading “How Do You Know If Maven Has a Plugin for Apache Parquet?”
Problem scenario
You want to use Maven’s Apache Parquet plugin with Hadoop. How do you use these Apache technologies together?
Solution
1. Install HDFS. See this link if you are using Ubuntu. See this link if you are using a RedHat distribution of Linux. If you have more than one server and want a multi-node cluster of Hadoop, see this link for directions on how to deploy and configure it.
…
Continue reading “How Do You Configure Maven to Use an Apache Parquet Plugin?”
Problem scenario
You are using a RedHat derivative distribution of Linux (e.g., CentOS/RHEL/Fedora). To eliminate a Hadoop error, you need to install a variety of packages. How do you install Maven, openjdk, libssl-Dev, build-Essential, and pkgconf?
Solution
To install Maven, see this article.
For the rest of the packages, run these commands:
sudo yum -y install java-1.8.0-openjdk-devel openssl-devel cmake protobuf
sudo yum -y groupinstall ‘Development Tools’
curl ftp://rpmfind.net/linux/fedora/linux/updates/25/x86_64/p/pkgconf-1.3.7-1.fc25.x86_64.rpm pkgconf-1.3.7-1.fc25.x86_64.rpm
curl ftp://rpmfind.net/linux/fedora/linux/updates/25/x86_64/l/libpkgconf-1.3.7-1.fc25.x86_64.rpm libpkgconf-1.3.7-1.fc25.x86_64.rpm
sudo rpm -ivh *.rpm …
Problem scenario
You need to use this following command on a CentOS/RedHat/Fedora Linux server in a /home/hadoop/ directory:
mvn package -Pdist,native -DskipTests -Dtar
The Maven build is failing. When you run the command with the “-e” flag for verbosity you see this:
[INFO] BUILD FAILURE
…
[WARNING] The requested profile “dist” could not be activated because it does not exist.
[WARNING] The requested profile “native” could not be activated because it does not exist.
…
Continue reading “How Do You Troubleshoot the Maven Build Failure of No “POM in this directory”?”
Problem scenario
You are using Red Hat Enterprise Linux in AWS. You need to install an older version of Ansible — not the newest. The pip command and other supported ways of deploying Ansible automatically use the newest version. You also want to install Maven.
Solution
Run this script with “sudo”. (You could run it as root, but that is not recommended.) The server must be in a Security Group with access to the internet.
…
Problem scenario
You are using RedHat Enterprise Linux 7.x or 8.x in AWS. How do you install Maven?
Solution
Prerequisite
Make sure Java has been installed. See this link if you need assistance.
Procedures
1. Create a file named maven.sh with this as the content:
version=3.6.2
curl http://ftp.wayne.edu/apache/maven/maven-3/$version/binaries/apache-maven-$version-bin.tar.gz /bin/apache-maven-$version-bin.tar.gz
md=$(md5sum /bin/apache-maven-$version-bin.tar.gz | awk ‘{print $1}’)
if [ $md -ne ’35c39251d2af99b6624d40d801f6ff02′ ]
then
echo “Installation of Maven has failed. …
Continue reading “How Do You Install Maven on an AWS Instance of RHEL?”
“Documentation plays a great role in the maintenance of a project.” (Page 19, Learn Apache Ant, Tutorialspoint.com, 2014)
The open source movement is no exception. As much as we admire The Apache Software Foundation, we are disappointed that they don’t correct errors. We’ve submitted the first two errors below to them. However, mistakes remain. Here are some errors to help other people who may be confused:
#1 was corrected.
…
Continue reading “Apache Software Foundation Has Imperfect Websites”