Securing Hadoop Big Data Landscape with Apache Knox Gateway and Keycloak: Part 4 (Configuring Knox to Authenticate with Keycloak)
Prerequisites As both Keycloak and Knox are Java based application, the only prerequisite is to have Java installed and JAVA_HOME environment variable set . I have tested the application with Java 8. Setting up Keycloak Getting started with Keycloak is as easy as downloading the latest version of Keycloak Server from the download section of Read More
Securing Hadoop Big Data Landscape with Apache Knox Gateway and Keycloak: Part 3(Reference Architecture for Securing Hadoop Landscape)
The sample problem In a typical enterprise environment we will have a Hadoop distribution, that will require Kerberos Authentication. The problem with Kerberos is its complicated and will require special clients if we want to access them. Also you might have a heterogeneous application architecture, that interfaces with variety of authentication mechanism(like OAuth, SAML etc.), Read More
Securing Hadoop Big Data Landscape with Apache Knox Gateway and Keycloak: Part 2(Introduction to Apache Knox)
This this one we will formally introduce Apache Knox Gateway and touch upon some of the problems it tries to solve. Introduction to Apache Knox In the simplest of terms Knox is a reverse proxy for Hadoop deployments. The Knox Gateway provides a single access point for all REST and HTTP interactions with Apache Hadoop Read More
Securing Hadoop Big Data Landscape with Apache Knox Gateway and Keycloak: Part 1(Keycloak’s introduction)
In this post we will cover the topic of securing your Hadoop infrastructure using Apache Knox and Keycloak. We will start with a general introduction of the projects involved and the will look at a sample configuration of both. Keycloak’s introduction Keycloak is an open source Identity and Access Management solution aimed at modern applications Read More
Before going into the details of DevSecOps. We need to understand how is it different from DevOps. Lets have a brief introduction for both of them. What is DevOps? I know many of you are already familiar with the concept of DevOps. DevOps is a combination of two words, Development as “Dev” and Operations as Read More
By now most of you might have guessed that things like Hadoop and HBase(and others) and big data in general are going to be in the everywhere. With all the power comes a lot of complexity. Most of you will agree that event the most seasoned Java developers will find performing stuff like Joins quite hard in the bare bones Map-Reduce world, Pig and Hive does come to rescue but still is not quite that easy as in the SQL world. So what’s the solution?
Golang, also referred as Go, is an open source programming language developed by Google in 2007. It is a compiled, statically typed language somewhat similar to C. Two major implementations of this language is:
- Google’s Go compiler, “gc”, is developed as open source software
- Targets various platforms including Linux, OS X, Windows, various BSD and Unix versions and smartphones.
Comparison of Golang with Java:
Class loading is one of the most important aspects of Java and most of the times its abstracted away from us when we use IDEs and dependency management tools like Maven. For most of the part its ok until one fine day you stumble upon something a NoClassDefFoundError and have to bite the bullet to figure out How does actually class loading works in Java?
Li-Fi, or Light Fidelity, is suddenly in the news these days because an Estonian company called Velmenni conducted a real-world test where it was able to transfer data between devices at 1 Gbps, which is roughly 100 times faster than Wi-Fi in the real world. How Li-fi Works- The Internet and router/server is hooked to Read More
If you are using Oracle Virtual Box with .vdi format for the disk image and want to move your virtual machine to Microsoft Hyper -V there is a small migration required as currently Hyper-V doesn’t read the .vdi file. The good part is that its extremely easy as well as Virtual Box also comes with Read More