I have a 32 bit machine with windows 7, I need to install hadoop and try it out, I checked Cloudera distribution and it is for linux, VMWare images with 64 bit processor.

This post is about installing Single Node Cluster Hadoop 2.5.1 (latest stable version) on Windows 7 Operating Systems.Hadoop was primarily designed for Linux platform. Hadoop supports for windows from its version 2.2, but we need prepare our platform binaries. Hadoop official website recommend Windows developers to use this build for development environment and not on production, since it is not completely tested success on Windows platform.

This post describes the procedure for generating the Hadoop build for Windows platform. Generating Hadoop Build For Windows Platform Step 1:Install Microsoft Windows SDK 7.1 • In my case, I have used Windows 7 64 bit Operating System. Download Microsoft Windows SDK 7.1 from and install it. • While installing Windows SDK,I have faced problem like C++ 2010 Redistribution is already installed.

This problem will happen only if we have installed C++ 2010 Redistribution of higher version compared to the Windows SDK. • We can solve this issue by either not installing the C++ 2010 Redistribution by unchecked the Windows SDK on custom component selection or uninstalling from Control Panel and reinstalling the C++ 2010 Redistribution via Windows SDK again. Step 6: Install cmake 3.0.2 • Download the latest cmake from its and install it normally. Step 7: Configure “Platform” Environment Varibale. • Add the “Platform” environment variable with the value of either “x64” or “Win32” for buildin on 64-bit or 32-bit system.(Case-sensitive) Step 8:Create Hadoop Build • Download the latest stable version of Hadoop source from its and extract it to “C: hdc”. Now we can generate Hadoop Windows Build by executing the following command on Windows SDK Command Prompt.

Mvn package -Pdist,native-win -DskipTests -Dtar. • The above command will run for approx 30 min and output the Hadoop Windows build at C: hdc hadoop-dist target” directory.

Configuring Hadoop for Single Node(Pseudo Distributed) Cluster Step 1:Extract Hadoop • Copy the Hadoop Windows Build tar.gz file from “ C: hdc hadoop-dist target” and extract at “ C: hadoop”. Step 2: Configure hadoop-env.cmd • Edit the “ C: hadoop etc hadoop hadoop-env.cmd” file and add the following lines at the end of the file. The following lines will configure the Hadoop and Yarn Configuration Directories. Set HADOOP_PREFIX=c: deploy set HADOOP_CONF_DIR=%HADOOP_PREFIX% etc hadoop set YARN_CONF_DIR=%HADOOP_CONF_DIR% set PATH=%PATH%;%HADOOP_PREFIX% bin Step 3: Configure core-site.xml • Edit the “ C: hadoop etc hadoop core-site.xml” file and configure the following property. Fs.default.name hdfs:// Djvu Software Free Download For Windows 7. 0.0.0.0:19000 Step 4: Configure hdfs-site.xml • Edit the “ C: hadoop etc hadoop hdfs-site.xml” file and configure the following property.

Dfs.replication 1 Step 5: Configure mapred-site. Adobe Photoshop 0.7 Software Free Download. xml • Edit the “ C: hadoop etc hadoop mapred-site.xml” file and configure the following property. Mapred.job.tracker localhost:54311 Step 5: Create tmp directory • Create a tmp directory as “ C: tmp”, where “C: tmp” is the default temperory directory for Hadoop. Step 6: Execute hadoop-env.cmd • Execute the “ C: hadoop etc hadoop hadoop-env.cmd” file from the Command Prompt to set the Environment Varibales. Step 7: Format File System • Format the file sytem by executing the following command before first time usage.%HADOOP_PREFIX% bin hdfs namenode -format Step 8: Start HDFS • Execute the following command to start the HDFS.%HADOOP_PREFIX% sbin start-dfs.cmd Step 9: Check via Web-browser • Open the browser with address, this page will display the currently running nodes and we can browse the HDFS also on this portal. Hey thanks for the guide really helped me a lot!

I still encountered some problems, so I thought I should share my solutions. 1) '[ERROR] Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.8.1:jar (module-javadocs)' Since the error is with the javadoc plugin I skipped it by specifying -Dmaven.javadoc.skip=true 2) In the 'Configuring Hadoop for Single Node' step 2 the line 'set HADOOP_PREFIX=c: deploy' should probably be 'set HADOOP_PREFIX=c: hadoop'. 3) in the same Step as above be careful to not just copy and past the text from the guide the blank characters in the end of each line prevented me from executing '%HADOOP_PREFIX% bin hdfs namenode -format '. Hi Friends, This post is about installing Spring Tool Suite (STS) on Ubuntu. Step 1:Download the latest Spring Tool Suite for Linux from STS official website: Step 2:Extract into any folder which you prefer.

My extracted Spring Tool Suite locations is /home/harishshan/springsource Step 3:Create the Menu icon for quick access sudo nano /usr/share/applications/STS.desktop Step 4:Enter the following content [Desktop Entry] Name=SpringSource Tool Suite Comment=SpringSource Tool Suite Exec=/home/harishshan/springsource/sts-3.4.0-RELEASE/STS Icon=/home/harishshan/springsource/sts-3.4.0-RELEASE/icon.xpm StartupNotify=true Terminal=false Type=Application Categories=Development;IDE;Java; Step 5: Now you can check from Quick Menu by typing ' Spring'. Hi Friends, This is post is about how to create a Kafka topic dynamically through Java.In one of my project, we(me and my friend Jaya Ananthram) were required to create dynamic Kafka topic through Java.

Since there is no documentation on Kafka official documentation we are struggled to create dynamic Kafka topic through Java. Then After a long search,we found this solution for creating the Kafka topic through Java. Import java.util.Properties; import kafka.admin.AdminUtils; import kafka.utils.ZKStringSerializer$; import kafka.utils.ZkUtils; import org.I0Itec.zkclient.ZkClient; import org.I0Itec.zkclient.ZkConnection; public class KafkaTopicCreationInJava { public static void main(String[] args) throws Exception { ZkClient zkClient = null; ZkUtils zkUtils = null; try { String zookeeperHosts = 'localhost:2181'; // If multiple zookeeper then ->String zookeeperHosts = '192.168.1.1:2181,192.168.1.2:2181'.

About this paper Want to get even more value from your Hadoop implementation? Hadoop is an open-source software framework for running applications on large clusters of commodity hardware. As a result, it delivers fast processing and the ability to handle virtually limitless concurrent tasks and jobs, making it a remarkably low-cost complement to a traditional enterprise data infrastructure. This white paper presents the SAS portfolio of solutions that enable you to bring the full power of business analytics to Hadoop. These solutions span the entire analytic life cycle – from data management to data exploration, model development and deployment.