Hadoop KMS Ranger API – Tips and cURLs

I use Hadoop KMS Ranger in one environment. Some sample rest api calls are below, along with two tips. versionName is used in multiple queries. When not using kerberos – set ?user.name=hdfs on the URL   References https://hadoop.apache.org/docs/current/hadoop-kms/index.html#KMS_HTTP_REST_API https://hadoop.apache.org/docs/current/hadoop-kms/index.html#Get_Key_Names https://stackoverflow.com/questions/37601763/authentication-issue-with-kms-hadoop

Primer: Tips for using Random Test Files

On Mac and Linux, create a random file (https://stackoverflow.com/questions/257844/quickly-create-a-large-file-on-a-linux-system) dd if=/dev/urandom of=random-test-file-100m bs=1024k count=100 Example: $ dd if=/dev/urandom of=random-test-file-100m bs=1024k count=100 100+0 records in 100+0 records out 102400000 bytes transferred in 10.143507 secs (10095128 bytes/sec) This is a random file. You should also use shasum -A 256 and make sure the file you are using […]

Maven Tips

Here are some tips for Maven Java Projects in Eclipse. #1 If you pom.xml is missing maven-compiler-plugin, Eclipse (when you do Maven > Update Project), defaults the compiler level for the project to 1.5. <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <version>2.0.2</version> <configuration> <source>1.7</source> <target>1.7</target> </configuration> </plugin> Now, it gets even more tricky… if your project has defined features […]

OAuth Tips

For developers that are beginning to investigate oAuth and IBM Connections Cloud, you’ll find two interesting things about the oAuth 1.0a web flows and the oAuth 2.0 web flows. 1- The flows don’t support extra on the flow – for instance the state parameter. state=XYZ123 2- The oAuth 2.0 flow expects callback_uri, not the common […]

A Few OAuth Notes

While I was working with a fellow developer building an integration for IBM Connections on premises, I found out about a couple of key items with the OAuth Provider. 1 – You can see a JSON Array of the Current User Tokens, when logged in as that user. Navigate to¬†https://sbdev.server:444/oauth2/authzMgmt/connectionsProvider Login to IBM Connections Look […]