How to Install Latest Version of Go on the Raspberry Pi 5

Introduction So finally I got my hands on the latest version of Raspberry Pi 5 and after the initial setup decided to build an Air Quality Monitor using it. For some reason decided to write the interface using Go. Installing the latest version of go should be as simple as apt install but unfortunately the Read More

Securing Hadoop Big Data Landscape with Apache Knox Gateway and Keycloak: Part 4 (Configuring Knox to Authenticate with Keycloak)

Prerequisites As both Keycloak and Knox are Java based application, the only prerequisite is to have Java installed and JAVA_HOME environment variable set . I have tested the application with Java 8. Setting up Keycloak Getting started with Keycloak is as easy as downloading the latest version of Keycloak Server from the download section of Read More

Securing Hadoop Big Data Landscape with Apache Knox Gateway and Keycloak: Part 3(Reference Architecture for Securing Hadoop Landscape)

The sample problem In a typical enterprise environment we will have a Hadoop distribution, that will require Kerberos Authentication. The problem with Kerberos is its complicated and will require special clients if we want to access them. Also you might have a heterogeneous application architecture, that interfaces with variety of authentication mechanism(like OAuth, SAML etc.), Read More

Securing Hadoop Big Data Landscape with Apache Knox Gateway and Keycloak: Part 2(Introduction to Apache Knox)

This this one we will formally introduce Apache Knox Gateway and touch upon some of the problems it tries to solve. Introduction to Apache Knox In the simplest of terms Knox is a reverse proxy for Hadoop deployments. The Knox Gateway provides a single access point for all REST and HTTP interactions with Apache Hadoop Read More

Securing Hadoop Big Data Landscape with Apache Knox Gateway and Keycloak: Part 1(Keycloak’s introduction)

In this post we will cover the topic of securing your Hadoop infrastructure using Apache Knox and Keycloak. We will start with a general introduction of the projects involved and the will look at a sample configuration of both. Keycloak’s introduction Keycloak is an open source Identity and Access Management solution aimed at modern applications Read More

Putting SQL back in NoSQL and Hadoop with Apache Phoenix

phoenix-logo-trans

By now most of you might have guessed that things like Hadoop and HBase(and others) and big data in general are going to be in the everywhere. With all the power comes a lot of complexity. Most of you will agree that event the most seasoned Java developers will find performing stuff like Joins quite hard in the bare bones Map-Reduce world, Pig and Hive does come to rescue but still is not quite that easy as in the SQL world. So what’s the solution?

Read More

How does classloading works in a Java Application(J2SE)

Class loading is one of the most important aspects of Java and most of the times its abstracted away from us when we use IDEs and dependency management tools like Maven. For most of the part its ok until one fine day you stumble upon something a  NoClassDefFoundError and have to bite the bullet to figure out How does actually class loading works in Java?

Read More

Converting VirtualBox .vdi diskfiles to Hyper-V .vhd files

If you are using Oracle Virtual Box with .vdi format for the disk image and want to move your virtual machine to Microsoft Hyper -V there is a small migration required as currently Hyper-V doesn’t read the .vdi file. The good part is that its extremely easy as well as Virtual Box also comes with Read More

Things to know about MPEG-DASH for HTML 5

MPEG-DASH ( Dynamic Adaptive Streaming over HTTP) is the latest addition to HTML 5 video streaming state. It adds some major and previously left out features, to HTML 5 video streaming without using any third party plugins. Some of which are: Adaptive Streaming Historically speaking if we wanted to view an video online we had to Read More

Apache web server tips and tricks

There are may small and big features in Apache that make it one of the easiest web server to configure and administrate.In this post I am posting some of the tips and tricks that I found incredibly useful. Finding request serving time as an extra header in Apache 2.4 This one is especially useful if Read More

1 2