Lightweight HBase Client

As many developers know, HBase’s default client has everything, netting 10s of Megabytes of size. Lilyproject reduces this to a more manageable and useful size. https://github.com/NGDATA/lilyproject/blob/master/global/hbase-client/pom.xml <dependency> <groupId>org.lilyproject</groupId> <artifactId>lily-hbase-client</artifactId> <version>2.6.1</version> </dependency>

Ambari All Sorts of Messed Up

My team and I run Ambari and Ambari agents which controls our HDFS/HBase and general HADOOP/Apache ecosystem machines.  Our bare metal machines hung, and we could not get anything restarted. In the logs, we had: {‘msg’: ‘Unable to read structured output from /var/lib/ambari-agent/data/structured-out-status.json’} We found a link at https://community.hortonworks.com/content/supportkb/49517/services-are-running-but-ambari-reports-them-faile.html and the fix. Remove /var/lib/ambari-agent/data/structured-out-status.json Restart […]

HBase Metadata – How to Scan

I learned this tip from a colleague.  You can easily scan the hbase:meta to find the timestamp an hbase table was created.  Details on the metadata can be found on the O’Reilly website. sudo su – hbase /usr/bin/kinit -kt /etc/security/keytabs/<KEYTAB FILE> $(/usr/bin/klist -kt /etc/security/keytabs/hbase.headless.keytab | tail -n 1 | awk ‘{print $NF}’) cat << EOF […]