How to Install Hadoop on an AWS Instance of RedHat Linux or an Azure Instance of CentOS

Updated 1/5/18

THESE DIRECTIONS ARE OUTDATED.  They are here as a reference for legacy purposes only.  For directions on how to install Hadoop on a RedHat or CentOS server, see this article.

Problem scenario
You want to install an open source version on a RedHat derivative distribution of Linux in a public cloud.  How do you do this?

Solution
These directions will allow you install Hadoop on a RedHat derivative (e.g.,

How to Install Suricata on an AWS Instance of SUSE Linux

These “directions” to install Suricata on SUSE Linux include a script and how to run it.  The script was designed to install Suricata 3.1dev on an AWS instance of SUSE 12 SP1.  This script was based on these here. This script requires that your AWS SUSE Linux server is in a security group that has access to the Internet.  The script takes approximately five minutes to run.  But bandwidth and resources on your instance may vary.

How To Get Hadoop Installed on Ubuntu When There Is a Java Error

Problem scenario:  On Ubuntu, after installing Hadoop, when you enter the command ‘/usr/local/hadoop/bin/hadoop namenode -format’ and you get this error:

“Error: JAVA_HOME is not set and could not be found.”

Solution:  Verify Java is installed (‘java -version’).  If it is not installed, you can use ‘apt-get install -y default-jre’.

Next, go to hadoop-env.sh.  Find the export JAVA_HOME stanza.  Change the ‘${JAVA_HOME}’ value to ‘/usr’ with no quotes.

How Do You Get All the Security Updates and OS Updates for Your Ubuntu Server to Be Applied?

Problem scenario
When you log into Ubuntu, you see a message like this:

8 packages can be updated.
5 updates are security updates.

You run this: sudo apt-get -y update

This completes.  But next time you log in, you see the same message about 8 packages can be updated.  What do you do?

Solution
Run this command:  sudo apt-get -y upgrade

If you are looking for deploying Hadoop to Ubuntu,

How to Install Suricata on an AWS Instance of Ubuntu Linux

Updated on 11/28/17

Problem scenario
You want to install Suricata on Ubuntu Linux.  How do you do this?

Solution
These directions to install Suricata include a script and how to run it.   The optional script in 2.c was based on these here.  The optional script in 2.c script requires that your AWS Ubuntu Linux server is in a security group that has access to the Internet. 

How to Use Ant (when You Receive an Error about build.xml Not Existing)

Problem Scenario:  You want to use Ant to invoke your customized build.xml file.  But when you run it, you get “
Target “build.xml” does not exist in the project …”
Solution:  Call ant with no other variables.  Do not use “ant build.xml”.  Use “ant” by itself.
Miscellaneous:  Most CentOS/RedHat repositories will have Ant available.  As root, the command “yum install ant” should get it installed. 

What Are the Minimum Packages Necessary for Kerberos on CentOS?

Question 1:  What are the packages that must be installed on a CentOS server to have it serve as the Kerberos server?

Answer 1: These three packages: krb5-server krb5-libs krb5-auth-dialog

Question 2:  What are the packages that must be installed on a CentOS server to have it serve as the Kerberos client?

Answer 2: 

How Can Jenkins Invoke PsExec?

Problem scenario:  When using Jenkins, PsExec never seems to work when called as a batch command in a .bat file or PowerShell script.  Jenkins logs an error about the PsExec command not being found.

Solution / workaround:  PsExec seems to never work if called by a PowerShell script or a batch script via Jenkins.  The only exception seems to be if a Scheduled Task calls a .bat file or PowerShell script that uses PsExec. 

How to Install Suricata on an AWS Instance of RedHat Enterprise Linux Server

Updated 11/29/17

These directions will allow you to install Suricata.  The script in step 2 was designed to install Suricata 4.0.1 on an AWS instance of RHEL 7.4.  This script requires that your AWS RedHat Enterprise Linux server is in a security group that has access to the internet.  You do not need a subscription to RedHat packages. 

Step #1  Log into the Red Hat Enterprise Linux server. 

How To Install PsExec on Windows Server

Not all directions are clear.  Here is an example where Microsoft has less than perfect directions:

“Installation

Just copy PsExec onto your executable path. Typing “psexec” displays its usage syntax.”

First off, psexec won’t display usage syntax until after the installation. If you are like me you are asking what is the executable path?

The answer can be found by opening PowerShell and typing this:

Get-ChildItem Env:Path | ft -wrap -AutoSize

Any of those semi-colon delimited results can be the destination of the files inside the PsTools.zip file.