COS and Hadoop FS issue

I ran into this issue with Python and IBM Cloud Object Storage. I applied a quick fix: pyspark –packages com.ibm.stocator:stocator:1.0.24 https://github.com/ibm-watson-data-lab/ibmos2spark/tree/master/python https://github.com/ibm-watson-data-lab/ibmos2spark/tree/master/pythonhttps://blog.sicara.com/get-started-pyspark-jupyter-guide-tutorial-ae2fe84f594f https://stackoverflow.com/questions/46011671/no-filesystem-for-scheme-cos

Kafka, Zookeeper… and Kerberos

My team runs a Kafka service for data ingestion, we ran across a rare timeout when our main Key Distribution Center (KDC) went down. When the zookeeper service restarted, zookeeper worked flawlessly. I checked the services with the zookeeper four-letter commands. However, the kafka-broker/zookeeper startup and authentication failed and the brokers went down. We checked […]