A Technical I.T./DevOps Blog
Question
What is Apache Parquet?
Answer
Apache Parquet is columnar data representation/manipulation tool for a Hadoop ecosystem. Data in a given column is largely uniform (e.g., a long string of characters, a single character, or an integer) in that it repeats a specific type and format of data as opposed to two cells in the same row (which may be very dissimilar types of data).
…
Problem scenario
You want to install Apache Parquet on the Hadoop namenode. What do you do?
Solution
Prerequisite
This assumes that you have installed Hadoop. For directions, see this posting.
Procedure
Run these commands:
sudo su –
apt-get -y install pip
pip install thriftpy
pip install snappy
exit
sudo apt-get -y install libsnappy-dev thrift-compiler
curl https://pypi.python.org/packages/74/b5/bc459aab0566fc3cf3397467922c37411ab6e3361bab9e0ca165e1089ce8/parquet-1.2.tar.gz#md5=05aacec0620ac63ecd7dd77bf7fb9fee >
…
Problem scenario
You want to install Snort on a Red Hat Enterprise Linux server. How do you do this?
Solution
1. Log into the server.
2. Create a file /tmp/snortinstaller.sh with the following content:
yum -y install libdnet
yum -y install https://www.snort.org/downloads/snort/daq-2.0.6-1.f21.x86_64.rpm
curl https://rpmfind.net/linux/fedora/linux/development/rawhide/Everything/x86_64/os/Packages/l/libnghttp2-1.28.0-1.fc28.x86_64.rpm libnghttp2-1.28.0-1.fc28.x86_64.rpm
rpm -ivh libnghttp2-1.28.0-1.fc28.x86_64.rpm
yum -y install https://www.snort.org/downloads/snort/snort-2.9.11-1.f25.x86_64.rpm
ln -s /usr/lib64/libdnet.so.1.0.1 /usr/lib64/libdnet.1
3.
…
Problem scenario
You want to test out UiPath’s abilities to see how RPA works. You want UiPath to automatically log into a website that challenges the human for a username and password.
Solution
Prerequisite #1
This assumes that UiPath Studio has been installed. If you do not know how, see this posting.
Prerequisite #2 (specific to this example only)
For this example we will set up an automation to open a web browser,
…
Continue reading “How Do You Use UiPath Studio CE to Log into a Website?”
Problem scenario
You have a Linux server, and you want to install Snort use its basic functionality. How do you do this?
Background
It is advisable to place Snort on every machine (Upguard). This way if one server is compromised, you have Snort’s features on all other servers. When alerting but not logging, running Snort usually consumes a negligible amount of resources (RAM,
…
Continue reading “How Do You Get Snort Working to Test It Out?”
Problem scenario
You want to install Boost C++ libraries and related development files. How do you do this?
Solution
Run this command:
sudo apt-get install automake bison flex g++ git libboost1.*-all-dev libevent-dev libssl-dev libtool make pkg-config
…
Continue reading “How Do You Install Boost C++ Libraries and Related Development Files?”
Problem scenario
When you completed configuring Kubernetes, you were provided with a URL. But this web page looks minimalistic with no graphics and a white background. The web UI is not complete or polished and looks like a YAML file. How do you get to the regular Kubernetes dashboard that looks like this picture?
Possible Solution #1
1. From the command prompt you set up Kubernetes with,
…
Continue reading “How Do You Log into the Kubernetes Dashboard?”
Problem scenario
When you use docker login from a client server and you are challenged for credentials. But after you enter the password and press enter you get this error: “Error response from daemon: Get https://: x509: certificate signed by unknown authority”
You do not login to the Docker registry. How do you get around this problem so you can log into the Docker registry?
Solution
Use one solution
…
Continue reading “How Do You Solve the Docker Error “x509 certificate signed by unknown authority”?”
Problem scenario
You do not want to rely on internet-available Docker registries. You want to have your own private Docker registry in your own AWS network. You want to share Docker images (to build containers) with your team. You think that installing/deploying a Docker registry will help you. What do you do to build and configure (or just set up) your own Docker registry with an Ubuntu 16.x server?
Solution
These directions were tested to work with Ubuntu 16.x in AWS and Azure.
…
Continue reading “How Do You Create a Docker Registry in Ubuntu Linux?”
Problem scenario
You get an error about a certificate not working with your host/server name. One of the following apply to your situation:
When you use “docker login” you get this message:
“Error response from daemon: x509: certificate is not valid for your server”
OR
When you try to use curl to the Docker registry server you get this error:
curl: (51) SSL: certificate subject name
…