This document helps to configure Hadoop cluster with help of Cloudera vm in pseudo mode, using Vmware player on a user machine for there practice.
Step 1: Download the “VMware player” from the link shown and install it as shown in the images.
Url to download VMware Player(Non-commercial use):
Step 2: Download the “Cloudera Setup File” from the given url and extract that zipped file onto your hard drive.
Url to download Cloudera VM :
Step 3: Start VMPlayer and click “Open a Virtual Machine”.
Browse the extracted folder and select .vmx file as shown.
By clicking on Play virtual machine button, It will start the VM in a couple of minutes, but sometimes you may get this issue “This host does not support Intet VT-x”
There are two reasons why you are getting this error:
1. Your CPU doesn’t support it.
2. Your CPU does support it, but you have it disabled in the BIOS
Enabling Virtualization extensions in the BIOS
1. Reboot the computer and open the system’s BIOS menu. This can usually be done by pressing the delete key, the F1 key or Alt and F4 keys depending on the system.
2. Enabling the Virtualization extensions in the BIOS
Many of the steps below may vary depending on your motherboard, processor type, chipset and OEM. Refer to your system’s accompanying documentation for the correct information on configuring your system.
a. Open the Processor submenu The processor settings menu may be hidden in the Chipset, Advanced CPU Configuration or Northbridge.
b. Enable Intel Virtualization Technology (also known as Intel VT-x). AMD-V extensions cannot be disabled in the BIOS and should already be enabled. The Virtualization extensions may be labeled Virtualization Extensions, Vanderpool or various other names depending on the OEM and system BIOS.
c. Enable Intel VT-d or AMD IOMMU, if the options are available. Intel VT-d and AMD IOMMU are used for PCI device assignment.
d. Select Save & Exit.
3. Reboot the machine.
By following this steps this problem should be solved.
Login credentials:
Machine Login credentials are:
a. Username – cloudera
b. Password – cloudera
Cloudera Manager Credentials are:
a. Username – admin
b. Password – admin
Click on the black box shown below in the image to start a terminal.
Step 4: Checking your Hadoop Cluster
• Type: sudo jps to see if all nodes are running (if you see an error, wait for some time and then try again, your threads are not started yet)
• Type: sudo su hdfs
• Execute your command ie – hadoop fs –ls /
Step 5: Download the list of Hadoop commands for reference from the given URL.