Kerberos and Java

I have worked on a kerberos smoke test for my team. I learned a few tips in the process. The useTicketCache is a preferred use in case the java process dies while the KDC is down. HBase Canary Testing runs on a kerberos enabled cluster using hbase canaryhttp://hbase.apache.org/book.html#trouble.client If you are port forwarding over SSH, […]

Forwarding DGram in node.js

For a project I am working on I needed to rewrite a DGram port. I moved the ports around and found a few quick tests. Testing with NC my-machine:~$ echo -n “data-message” | nc -v -4u -w1 localhost 88found 0 associationsfound 1 connections:1: flags=82<CONNECTED,PREFERRED> outif (null) src 127.0.0.1 port 53862 dst 127.0.0.1 port 88 rank […]

COS and Hadoop FS issue

I ran into this issue with Python and IBM Cloud Object Storage. I applied a quick fix: pyspark –packages com.ibm.stocator:stocator:1.0.24 https://github.com/ibm-watson-data-lab/ibmos2spark/tree/master/python https://github.com/ibm-watson-data-lab/ibmos2spark/tree/master/pythonhttps://blog.sicara.com/get-started-pyspark-jupyter-guide-tutorial-ae2fe84f594f https://stackoverflow.com/questions/46011671/no-filesystem-for-scheme-cos

Kafka, Zookeeper… and Kerberos

My team runs a Kafka service for data ingestion, we ran across a rare timeout when our main Key Distribution Center (KDC) went down. When the zookeeper service restarted, zookeeper worked flawlessly. I checked the services with the zookeeper four-letter commands. However, the kafka-broker/zookeeper startup and authentication failed and the brokers went down. We checked […]

Tracking down RPM install dates/reasons/who

I had to find the date of an RPM install to track the lineage of an RPM. I found two very helpful commands. The “rpm -q basesystem –qf ‘%{installtime:date}\n’”, which I found thanks to StackExchange, was exceptionally helpful for placing the date/time of an installed RPM. The rpm -qi basesystem also provided some excellent additional […]

Jupyter Notebook: Email Analysis to a Lotus Notes View

I wanted to do an analysis of my emails since I joined IBM, and see the flow of messages in-and-out of my inbox. With my preferences for Jupyter Notebooks, I built a small notebook for analysis. StepsOpen IBM Lotus Notes Rich Client Open the Notes Database with the View you want to analyze. Select the […]

VIM – JOIN Conditions with Unicode and ASCII

JOIN Conditions with Unicode and ASCII I cannot stress the dangers of copying data from Excel or HTML and assuming that it’s ASCII. For example U+0040 is the unicode version of @. We ingested the unicode version and couldn’t see why a JOIN condition on the data table wasn’t working. I looked at the source […]