Category Archives: Powershell

Change Nutanix CVM RAM with PowerCLI

August 1, 2014 Josh Sinclair 3 Comments

*Update – story behind the script*
Finally I have a few minutes to write the story behind this script.

One of our VMware View environments was experiencing performance problems. The CPUs on our VMs would constantly spike to 100% after they were powered on. Our admins relayed back to engineering that they were having density issues. We reached out to Nutanix who recommended that we increase the cache size to be able to absorb more IOPS. To increase the cache size on Nutanix you simply need to power off the controller virtual machine (CVM) on a host, increase RAM, and power it back on. While is a non disruptive process if you power the CVMs on and off one at a time, it becomes a very disruptive process if someone makes a mistake and powers off more than one CVM at a time. It is also very time intensive because you must check that the CVM services are completely back up before you perform the procedure on the next CVM. With 120 hosts in our environment, and averaging 10 minutes per manual CVM procedure, it looked like it was going to take about 20 hours to perform this task. For us this means 3-4 days in maintenance windows!

I figured there has to be a way to automate this and eliminate the human component so we could perform this maintenance task all in one maintenance window. Well a couple hours of fiddling with powerCLI and trying to figure out which service is the last CVM service to power on, and running the script in our test environment to work out the bugs and we were ready to run it in production. In our environment the average run time per CVM was about 5 minutes, but the best part is that it really saves hours of admin time. An admin only needs to babysit the script while it is running instead of needing to perform an intensive manual process. This shows the huge benefit of Software Defined Storage. Imagine trying to update cache on a traditional SAN without any downtime… isn’t going to happen.

It later turned out that the issue in our environment was a classic VMware View admin mistake of installing updates and then shutting down immediately and recomposing the pool. The updates needed to finish installing after reboot, so they finished installing on all of the linked clones when they powered on. Combined with refresh on logoff which occurs multiple times per day and it was a sure way to test max performance of our equipment!

#Nutanix CVM RAM Add Script
#This script leverages The SSH.NET powershell module from http://www.powershelladmin.com/wiki/SSH_from_PowerShell_using_the_SSH.NET_library
#Download it at: http://www.powershelladmin.com/w/images/a/a5/SSH-SessionsPSv3.zip

Import-Module SSH-Sessions

#This script records the time to collect metrics on how long it takes to perform the memory upgrade.
$scriptStart = (Get-Date)

#Connect to the vCenter Servers
connect-viserver vc01.test.com

#Find all of the Nutanix CVMs that have less than 24GB RAM
$vms = Get-VM -name NTNX* | Where MemoryGB -lt 24

#Sort the CVMs by IP address (just to watch the CVMs be done in order)
$vms = $vms | Sort-Object guest.IPAddress[0]

#Loop though the CVMs and upgrade them one at a time
foreach ($vm in $vms) {

   #Use the IP address of the CVM to connect to it with SSH
   $CVM = $vm.guest.IPAddress[0]

   #Using the default user/pass
   New-SshSession -ComputerName $CVM -Username 'nutanix' -Password 'nutanix/4u'

   #Check to make sure that the CVMs in the cluster are all up.  If a CVM is not UP it will be in DOWN state.
   $result = Invoke-SshCommand -ComputerName $CVM -Command '/home/nutanix/cluster/bin/cluster status | grep Down'
   Remove-SshSession -RemoveAll

   #Perform memory upgrade if there are no CVMs DOWN and SSH connection was successful   
   If ($result -NotLike '*Down*' -and $result -notlike "*No SSH session found*")  {
      write-host "Shutting down $CVM"
      Shutdown-VMGuest $vm -Confirm:$false

      #Wait a period of time to make sure the CVM is shutdown before changing settings
      sleep 60

      #Set CVM memory
      write-host "Setting $CVM Memory"
      Set-VM $vm -MemoryGB 24 -Confirm:$false

      #Power-on CVM
      write-host "Starting $CVM"
      Start-VM $vm -Confirm:$false
    
      #Wait for CVM to start before checking that it is UP
      sleep 60
      write-host "Checking $CVM state"

      #Check that the services are started on the CVM before performing the upgrade on the next CVM.  From what I could tell by watching the services start, alert_manager is the last service to start.

      Do {
         New-SshSession -ComputerName $CVM -Username 'nutanix' -Password 'nutanix/4u'
         $result = Invoke-SshCommand -ComputerName $CVM -Command "/home/nutanix/cluster/bin/genesis status | grep alert_manager"
         Remove-SshSession -RemoveAll

         #If the services are not started yet they will have a status of []
         If ($result -contains 'alert_manager: []') {write-host "$CVM Down"}
         #Wait before attempting to make another SSH connection
         sleep 5
      }  
      #If the service is started there will be port numbers in the brackets.  Check to see if the brackets are empty.  Make sure to escape the [] characters with `.
      Until ($result -notlike '*`[`]*' -and $result -notlike "*No SSH session found*")  
      write-host "$CVM Up"
      $scriptEnd = (Get-Date)

      #Calculate the timespans
      $totalTime = New-Timespan -Start $scriptStart -End $scriptEnd

      #Write a time summary
      write-host "Total Script Time"
      write-host $totalTime
   }
   Else { 
   #If a CVM is down at the beginning of the script, just end the script.
   write-host "Cluster not ready."
   Disconnect-VIServer -Confirm:$false   
   Break
   }
}
Disconnect-VIServer -Confirm:$false

#Nutanix CVM RAM Add Script

#This script leverages The SSH.NET powershell module from http://www.powershelladmin.com/wiki/SSH_from_PowerShell_using_the_SSH.NET_library

#Download it at: http://www.powershelladmin.com/w/images/a/a5/SSH-SessionsPSv3.zip

Import-Module SSH-Sessions

#This script records the time to collect metrics on how long it takes to perform the memory upgrade.

$scriptStart = (Get-Date)

#Connect to the vCenter Servers

connect-viserver vc01.test.com

#Find all of the Nutanix CVMs that have less than 24GB RAM

$vms = Get-VM -name NTNX* | Where MemoryGB -lt 24

#Sort the CVMs by IP address (just to watch the CVMs be done in order)

$vms = $vms | Sort-Object guest.IPAddress[0]

#Loop though the CVMs and upgrade them one at a time

foreach ($vm in $vms) {

#Use the IP address of the CVM to connect to it with SSH

$CVM = $vm.guest.IPAddress[0]

#Using the default user/pass

New-SshSession -ComputerName $CVM -Username 'nutanix' -Password 'nutanix/4u'

#Check to make sure that the CVMs in the cluster are all up. If a CVM is not UP it will be in DOWN state.

$result = Invoke-SshCommand -ComputerName $CVM -Command '/home/nutanix/cluster/bin/cluster status | grep Down'

Remove-SshSession -RemoveAll

#Perform memory upgrade if there are no CVMs DOWN and SSH connection was successful

If ($result -NotLike '*Down*' -and $result -notlike "*No SSH session found*") {

write-host "Shutting down $CVM"

Shutdown-VMGuest $vm -Confirm:$false

#Wait a period of time to make sure the CVM is shutdown before changing settings

sleep 60

#Set CVM memory

write-host "Setting $CVM Memory"

Set-VM $vm -MemoryGB 24 -Confirm:$false

#Power-on CVM

write-host "Starting $CVM"

Start-VM $vm -Confirm:$false

#Wait for CVM to start before checking that it is UP

sleep 60

write-host "Checking $CVM state"

#Check that the services are started on the CVM before performing the upgrade on the next CVM. From what I could tell by watching the services start, alert_manager is the last service to start.

Do {

New-SshSession -ComputerName $CVM -Username 'nutanix' -Password 'nutanix/4u'

$result = Invoke-SshCommand -ComputerName $CVM -Command "/home/nutanix/cluster/bin/genesis status | grep alert_manager"

Remove-SshSession -RemoveAll

#If the services are not started yet they will have a status of []

If ($result -contains 'alert_manager: []') {write-host "$CVM Down"}

#Wait before attempting to make another SSH connection

sleep 5

}

#If the service is started there will be port numbers in the brackets. Check to see if the brackets are empty. Make sure to escape the [] characters with `.

Until ($result -notlike '*`[`]*' -and $result -notlike "*No SSH session found*")

write-host "$CVM Up"

$scriptEnd = (Get-Date)

#Calculate the timespans

$totalTime = New-Timespan -Start $scriptStart -End $scriptEnd

#Write a time summary

write-host "Total Script Time"

write-host $totalTime

}

Else {

#If a CVM is down at the beginning of the script, just end the script.

write-host "Cluster not ready."

Disconnect-VIServer -Confirm:$false

Break

}

Disconnect-VIServer -Confirm:$false

Nutanix, Powershell, VMware

Nutanix and VMware vSphere Host Profiles

March 29, 2014 Josh Sinclair Leave a comment

Host profiles seem like a great idea… Make sure that all of your hosts are configured consistently and enforce compliance. However, when it comes to actually applying a host profile the caveat is that you need to put the host in maintenance mode to apply it. This means that you have to vMotion any running VMs to another host and then enter maintenance mode… A process that could take quite a while depending on the number of VMs you have running.

On Nutanix there is the pesky issue that there is one VM that you can not vMotion to another host… the CVM! The CVM (Controller Virtual Machine) is the storage controller that lives on the host. The physical disks are presented to the VM through VMDirectPath. Since Virtual Machines that are tied to physical devices on the host can not be vMotioned the host will fail to enter maintenance mode. It is possible to shut down a CVM on one node, then put that host into maintenance mode, apply the host profile, exit maintenance mode, power on the CVM, then SSH into the CVM to make sure it is back into the storage cluster before you rinse and repeat for all of your hosts. However, that is a very manual process! It would be bearable to perform on one block (four Nutanix hosts), but if you have hundreds of hosts it will take weeks and a small army of dedicated sys admins to complete the task.

It’s too bad that VMware couldn’t have host profiles distinguish between minor and major changes when dealing with applying host profiles. For example adding a port group would be a minor change, not requiring entering into maintenance mode, while attaching a vSwitch to a vNIC would be a major change requiring maintenance mode because of its potential to disrupt traffic for all of the VMs on that host.

Do we really need host profiles? Nutanix is trying to market the idea that infrastructure should be web-scale. I don’t really like the term web-scale because I think it implies that you’re trying to build some kind of internet service, but that’s beside the point… What they are trying to say is that it should be easy to massively scale infrastructure. This includes having to manually configure a bunch of settings. Putting all of the hosts in your environment into maintenance mode just to apply some settings definitely isn’t scalable. There is no reason to do it!

Every change that a host profile makes can be accomplished through PowerCLI without putting your host into maintenance mode. My recommendation for Nutanix hosts is to use PowerCLI to make any changes to your hosts that you want to be consistent throughout your environment, and then maintain your PowerCLI script and apply it to new hosts that you add to your environment.

You could also make a script that checks the settings on the hosts to monitor for compliance, for example to make sure that no one has added a vLAN to just one host. If you are using vCloud in your environment VMware includes VCM (vCenter Configuration Manager) which accomplishes the same task, with the added component of generating automated compliance reports.

Of course I’m implying that your hosts are running VMware, Nutanix also supports running Hyper-V and KVM where it’s almost inherently implied that you are going to need scripts to maintain consistency in the environment.

Nutanix, Powershell, VMware

Export Nutanix Configuration to CSV through Powershell and REST API

March 21, 2014 Josh Sinclair 1 Comment

What do you do when you have over 100 Nutanix nodes scattered across multiple datacenters and need to audit the configurations, or record the configurations for documentation?

Write a powershell script that queries the REST API of course!

In this instance I needed a known starting point. I didn’t have all of the IP addresses of the CVMs, hosts, etc in a format that I could query. What I did have was all of the hosts in vCenter along with all of their CVMs. So this script starts by connecting to all of the vCenters in the Datacenters and getting a list of all of the CVMs and their IP addresses. It then runs REST API queries against the CVM IPs.

#This script requires the VMware PowerCLI modules as well at least Powershell 3.0 for the Invoke-RestMethod

#Connect to all of the vCenters
connect-viserver datacenter01-vc01.example.com -force
connect-viserver datacenter02-vc01.example.com -force
connect-viserver datacenter03-vc01.example.com -force
connect-viserver datacenter04-vc01.example.com -force
connect-viserver datacenter05-vc01.example.com -force

#Accept self signed certs
add-type @"
    using System.Net;
    using System.Security.Cryptography.X509Certificates;
    public class TrustAllCertsPolicy : ICertificatePolicy {
        public bool CheckValidationResult(
            ServicePoint srvPoint, X509Certificate certificate,
            WebRequest request, int certificateProblem) {
            return true;
        }
    }
"@
[System.Net.ServicePointManager]::CertificatePolicy = New-Object TrustAllCertsPolicy


#Create the call to the REST API and pass authentication
$username = "admin"
$password = "admin"
$Header = @{"Authorization" = "Basic "+[System.Convert]::ToBase64String([System.Text.Encoding]::UTF8.GetBytes($username+":"+$password ))}


#Query the connected viservers and get all of the CVMs, their IP addreses, vSphere Clusters, and vSphere Datacenters
$cvms = get-VM -Name NTNX* | Select Name, @{N="cvmIP";E={@($_.guest.IPAddress[0])}}, @{N="vCluster";E={($_ | Get-Cluster)}}, @{N="vDatacenter";E={($_ | Get-Datacenter)}}


#Create a node hash table, assign properties to a node and create one node for each CVM
$nodes = @()
for ($i=0; $i -lt $cvms.cvmIP.count; $i++)  {
   $node = New-Object PSObject -Property @{
        block            = @{}	
		position         = @{}
		model            = @{}  
		cvmName          = $cvms[$i].Name
		hostname         = @{}
		cvmIP            = $cvms[$i].cvmIP
		hostIP           = @{}
		ipmiIP           = @{}
		vSphereCluster   = $cvms[$i].vCluster
		datacenter       = $cvms[$i].vDatacenter 
		datastores       = @{}
		containers       = @{}
		storagePool      = @{}
		nutanixCluster   = @{}
		nosVersion       = @{}
   }
   $nodes += $node
}


#Querying the REST API returns a hash table (array).  Instantiate hash tables for hosts, clusters, containers, and storage pools.
#In a future version hopefully Nutanix publishes the filterCritera for REST API calls so we don't have to iterate through these
#arrays, but can retrieve the specific objects that we want.
$hosts = @{}
$clusters = @{}
$containers = @{}
$storagePools = @{}

for ($i=0; $i -lt $cvms.cvmIP.count; $i++) {
   $hosts[$i] = (Invoke-RestMethod -Method Get -Uri "https://$($cvms.cvmIP[$i]):9440/PrismGateway/services/rest/v1/hosts/" -Headers $Header)
 
   for ($j=0;$j -lt $hosts[$i].entities.count; $j++)  {
      if ($hosts[$i].entities[$j].serviceVMExternalIP -eq $cvms.cvmIP[$i])   {
	  $nodes[$i].block    = $hosts[$i].entities[$j].blockSerial
	  $nodes[$i].model    = $hosts[$i].entities[$j].blockModel
	  $nodes[$i].position = $hosts[$i].entities[$j].position.name
	  $nodes[$i].hostIP   = $hosts[$i].entities[$j].hypervisorAddress
	  $nodes[$i].ipmiIP   = $hosts[$i].entities[$j].ipmiAddress
	  $nodes[$i].hostname = $hosts[$i].entities[$j].name
      }
   }
   
   $clusters[$i] = (Invoke-RestMethod -Method Get -Uri "https://$($cvms.cvmIP[$i]):9440/PrismGateway/services/rest/v1/cluster/" -Headers $Header)
   for ($j=0;$j -lt $hosts[$i].entities.count; $j++)  {
      if ($hosts[$i].entities[$j].serviceVMExternalIP -eq $cvms.cvmIP[$i])   {
	  $nodes[$i].nutanixCluster = $clusters[$i].name
	  $nodes[$i].nosVersion = $clusters[$i].version
      }
   }
   
   $containers[$i] = (Invoke-RestMethod -Method Get -Uri "https://$($cvms.cvmIP[$i]):9440/PrismGateway/services/rest/v1/containers/" -Headers $Header)
   for ($j=0;$j -lt $hosts[$i].entities.count; $j++)  {
      if ($hosts[$i].entities[$j].serviceVMExternalIP -eq $cvms.cvmIP[$i])   {
	  $nodes[$i].containers = $containers[$i].entities.name
	  $nodes[$i].datastores = $containers[$i].entities.vstoreNameList
      }
   }
   
   
   $storagePools[$i] = (Invoke-RestMethod -Method Get -Uri "https://$($cvms.cvmIP[$i]):9440/PrismGateway/services/rest/v1/storage_pools/" -Headers $Header)
   for ($j=0;$j -lt $hosts[$i].entities.count; $j++)  {
      if ($hosts[$i].entities[$j].serviceVMExternalIP -eq $cvms.cvmIP[$i])   {
	  $nodes[$i].storagePool = $storagePools[$i].entities.name
      }
   }
}

#Export the node objects to CSV
$nodes | Select (
@{Expression={$_.hostname};Label="hostname"}, 
@{Expression={$_.hostIP};Label="hostIP"}, 
@{Expression={$_.cvmIP};Label="CVMIP"}, 
@{Expression={$_.ipmiIP};Label="IPMI"}, 
@{Expression={$_.cvmName};Label="CVM Name"}, 
@{Expression={$_.nutanixCluster};Label="Nutanix Cluster"},
@{Expression={$_.storagePool};Label="Storage Pool"},
@{Expression={$_.containers};Label="Containers"},
@{Expression={$_.datacenter};Label="Datacenter"},
@{Expression={$_.vSphereCluster};Label="vSphereCluster"},
@{Expression={$_.datastores};Label="Datastores"},
@{Expression={$_.model};Label="Model"},
@{Expression={$_.block};Label="Block"},
@{Expression={$_.position};Label="Position"},
@{Expression={$_.nosVersion};Label="NOS Version"}
) | Sort hostname, CVMIP | Export-CSV Nutanix_info.csv -NoTypeInformation

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

#This script requires the VMware PowerCLI modules as well at least Powershell 3.0 for the Invoke-RestMethod

#Connect to all of the vCenters

connect-viserver datacenter01-vc01.example.com -force

connect-viserver datacenter02-vc01.example.com -force

connect-viserver datacenter03-vc01.example.com -force

connect-viserver datacenter04-vc01.example.com -force

connect-viserver datacenter05-vc01.example.com -force

#Accept self signed certs

add-type @"

using System.Net;

using System.Security.Cryptography.X509Certificates;

public class TrustAllCertsPolicy : ICertificatePolicy {

public bool CheckValidationResult(

ServicePoint srvPoint, X509Certificate certificate,

WebRequest request, int certificateProblem) {

return true;

}

[System.Net.ServicePointManager]::CertificatePolicy = New-Object TrustAllCertsPolicy

#Create the call to the REST API and pass authentication

$username = "admin"

$password = "admin"

$Header = @{"Authorization" = "Basic "+[System.Convert]::ToBase64String([System.Text.Encoding]::UTF8.GetBytes($username+":"+$password ))}

#Query the connected viservers and get all of the CVMs, their IP addreses, vSphere Clusters, and vSphere Datacenters

$cvms = get-VM -Name NTNX* | Select Name, @{N="cvmIP";E={@($_.guest.IPAddress[0])}}, @{N="vCluster";E={($_ | Get-Cluster)}}, @{N="vDatacenter";E={($_ | Get-Datacenter)}}

#Create a node hash table, assign properties to a node and create one node for each CVM

$nodes = @()

for ($i=0; $i -lt $cvms.cvmIP.count; $i++) {

$node = New-Object PSObject -Property @{

block = @{}

position = @{}

model = @{}

cvmName = $cvms[$i].Name

hostname = @{}

cvmIP = $cvms[$i].cvmIP

hostIP = @{}

ipmiIP = @{}

vSphereCluster = $cvms[$i].vCluster

datacenter = $cvms[$i].vDatacenter

datastores = @{}

containers = @{}

storagePool = @{}

nutanixCluster = @{}

nosVersion = @{}

}

$nodes += $node

}

#Querying the REST API returns a hash table (array). Instantiate hash tables for hosts, clusters, containers, and storage pools.

#In a future version hopefully Nutanix publishes the filterCritera for REST API calls so we don't have to iterate through these

#arrays, but can retrieve the specific objects that we want.

$hosts = @{}

$clusters = @{}

$containers = @{}

$storagePools = @{}

for ($i=0; $i -lt $cvms.cvmIP.count; $i++) {

$hosts[$i] = (Invoke-RestMethod -Method Get -Uri "https://$($cvms.cvmIP[$i]):9440/PrismGateway/services/rest/v1/hosts/" -Headers $Header)

for ($j=0;$j -lt $hosts[$i].entities.count; $j++) {

if ($hosts[$i].entities[$j].serviceVMExternalIP -eq $cvms.cvmIP[$i]) {

$nodes[$i].block = $hosts[$i].entities[$j].blockSerial

$nodes[$i].model = $hosts[$i].entities[$j].blockModel

$nodes[$i].position = $hosts[$i].entities[$j].position.name

$nodes[$i].hostIP = $hosts[$i].entities[$j].hypervisorAddress

$nodes[$i].ipmiIP = $hosts[$i].entities[$j].ipmiAddress

$nodes[$i].hostname = $hosts[$i].entities[$j].name

}

$clusters[$i] = (Invoke-RestMethod -Method Get -Uri "https://$($cvms.cvmIP[$i]):9440/PrismGateway/services/rest/v1/cluster/" -Headers $Header)

for ($j=0;$j -lt $hosts[$i].entities.count; $j++) {

if ($hosts[$i].entities[$j].serviceVMExternalIP -eq $cvms.cvmIP[$i]) {

$nodes[$i].nutanixCluster = $clusters[$i].name

$nodes[$i].nosVersion = $clusters[$i].version

}

$containers[$i] = (Invoke-RestMethod -Method Get -Uri "https://$($cvms.cvmIP[$i]):9440/PrismGateway/services/rest/v1/containers/" -Headers $Header)

for ($j=0;$j -lt $hosts[$i].entities.count; $j++) {

if ($hosts[$i].entities[$j].serviceVMExternalIP -eq $cvms.cvmIP[$i]) {

$nodes[$i].containers = $containers[$i].entities.name

$nodes[$i].datastores = $containers[$i].entities.vstoreNameList

}

$storagePools[$i] = (Invoke-RestMethod -Method Get -Uri "https://$($cvms.cvmIP[$i]):9440/PrismGateway/services/rest/v1/storage_pools/" -Headers $Header)

for ($j=0;$j -lt $hosts[$i].entities.count; $j++) {

if ($hosts[$i].entities[$j].serviceVMExternalIP -eq $cvms.cvmIP[$i]) {

$nodes[$i].storagePool = $storagePools[$i].entities.name

}

#Export the node objects to CSV

$nodes | Select (

@{Expression={$_.hostname};Label="hostname"},

@{Expression={$_.hostIP};Label="hostIP"},

@{Expression={$_.cvmIP};Label="CVMIP"},

@{Expression={$_.ipmiIP};Label="IPMI"},

@{Expression={$_.cvmName};Label="CVM Name"},

@{Expression={$_.nutanixCluster};Label="Nutanix Cluster"},

@{Expression={$_.storagePool};Label="Storage Pool"},

@{Expression={$_.containers};Label="Containers"},

@{Expression={$_.datacenter};Label="Datacenter"},

@{Expression={$_.vSphereCluster};Label="vSphereCluster"},

@{Expression={$_.datastores};Label="Datastores"},

@{Expression={$_.model};Label="Model"},

@{Expression={$_.block};Label="Block"},

@{Expression={$_.position};Label="Position"},

@{Expression={$_.nosVersion};Label="NOS Version"}

) | Sort hostname, CVMIP | Export-CSV Nutanix_info.csv -NoTypeInformation

Here’s what the output looks like when opened in Excel (and scrubbed of proprietary information):

Any blocks that are not configured yet, or are not running a version of NOS that has the REST API, or do not have network connectivity will return System.Collections.Hashtable values as you can see below.

Nutanix, Powershell

Nutanix Block Startup / Shutdown Powershell Scripts

March 9, 2014 Josh Sinclair 1 Comment

Anyone who has Nutanix lab blocks that need to be started / stopped frequently may appreciate these scripts.

#Nutanix Startup Script

#This script leverages The SSH.NET powershell module from http://www.powershelladmin.com/wiki/SSH_from_PowerShell_using_the_SSH.NET_library
#Download it at: http://www.powershelladmin.com/w/images/a/a5/SSH-SessionsPSv3.zip

Import-Module SSH-Sessions

#This script records the time to collect metrics on how long it takes to start up the different elements
$scriptStart = (Get-Date)

#Define all the IP addresses in your cluster.
$cvmIPs  = "10.0.0.71", "10.0.0.72", "10.0.0.73"
$ipmiIPs = "10.0.0.81", "10.0.0.82", "10.0.0.83"
$hostIPs = "10.0.0.91", "10.0.0.92", "10.0.0.93"

#Install ipmiutil in a direcrory that is included in the PATH variable or run the script in the same directory
#I installed ipmiutil in c:\windows\system32\

#Use ipmiutil to power on the hosts
foreach ($ipmiIP in $ipmiIPs) {ipmiutil reset -u -N $ipmiIP -U ADMIN -P ADMIN}

write-host "Starting Hosts"

#Ping the hosts until they are online
$ping = new-object System.Net.Networkinformation.Ping
foreach ($hostIP in $hostIPs) {
   do{$result = $ping.send("$hostIP");write-host "." -NoNewline; sleep 1} Until($result.status -eq "Success")
      write-host "$hostIP ONLINE"
}

#Log the startup time for the ESXi hosts
$hostsStarted = (Get-Date)

#Wait until CVMs are booted
foreach ($cvmIP in $cvmIPs) {
   do{$result = $ping.send("$cvmIP");write-host "." -NoNewline; sleep 1} Until($result.status -eq "Success")
      write-host "$cvmIP ONLINE"
}	  

#Log the startup time for the CVMs
$cvmStarted = (Get-Date)
sleep 10

#Log into a CVM and do a cluster start
New-SshSession -ComputerName $cvmIP -Username 'nutanix' -Password 'nutanix/4u'
$result = Invoke-SshCommand -ComputerName $cvmIP -Command '/home/nutanix/cluster/bin/cluster status | grep state'
If ($result -eq 'The state of the cluster: stop')  {Invoke-SshCommand -ComputerName $cvmIP -Command '/home/nutanix/cluster/bin/cluster start'}
sleep 5
Remove-SshSession -RemoveAll

#Log the end time
$scriptEnd = (Get-Date)

#Calculate the timespans
$hostStartTime = New-Timespan -Start $ScriptStart -End $hostsStarted
$cvmStartTime = New-Timespan -Start $hostsStarted -End $cvmStarted
$storageStartTime = New-Timespan -Start $cvmStarted -End $scriptEnd
$totalTime = New-Timespan -Start $scriptStart -End $scriptEnd

#Write a time summary
write-host "ESXi Boot Time"
write-host $hostStartTime
write-host "CVM Startup Time"
write-host $cvmStartTime
write-host "Storage Startup Time"
write-host $storageStartTime
write-host "Total Script Time"
write-host $totalTime

#Nutanix Startup Script

#This script leverages The SSH.NET powershell module from http://www.powershelladmin.com/wiki/SSH_from_PowerShell_using_the_SSH.NET_library

#Download it at: http://www.powershelladmin.com/w/images/a/a5/SSH-SessionsPSv3.zip

Import-Module SSH-Sessions

#This script records the time to collect metrics on how long it takes to start up the different elements

$scriptStart = (Get-Date)

#Define all the IP addresses in your cluster.

$cvmIPs = "10.0.0.71", "10.0.0.72", "10.0.0.73"

$ipmiIPs = "10.0.0.81", "10.0.0.82", "10.0.0.83"

$hostIPs = "10.0.0.91", "10.0.0.92", "10.0.0.93"

#Install ipmiutil in a direcrory that is included in the PATH variable or run the script in the same directory

#I installed ipmiutil in c:\windows\system32\

#Use ipmiutil to power on the hosts

foreach ($ipmiIP in $ipmiIPs) {ipmiutil reset -u -N $ipmiIP -U ADMIN -P ADMIN}

write-host "Starting Hosts"

#Ping the hosts until they are online

$ping = new-object System.Net.Networkinformation.Ping

foreach ($hostIP in $hostIPs) {

do{$result = $ping.send("$hostIP");write-host "." -NoNewline; sleep 1} Until($result.status -eq "Success")

write-host "$hostIP ONLINE"

}

#Log the startup time for the ESXi hosts

$hostsStarted = (Get-Date)

#Wait until CVMs are booted

foreach ($cvmIP in $cvmIPs) {

do{$result = $ping.send("$cvmIP");write-host "." -NoNewline; sleep 1} Until($result.status -eq "Success")

write-host "$cvmIP ONLINE"

}

#Log the startup time for the CVMs

$cvmStarted = (Get-Date)

sleep 10

#Log into a CVM and do a cluster start

New-SshSession -ComputerName $cvmIP -Username 'nutanix' -Password 'nutanix/4u'

$result = Invoke-SshCommand -ComputerName $cvmIP -Command '/home/nutanix/cluster/bin/cluster status | grep state'

If ($result -eq 'The state of the cluster: stop') {Invoke-SshCommand -ComputerName $cvmIP -Command '/home/nutanix/cluster/bin/cluster start'}

sleep 5

Remove-SshSession -RemoveAll

#Log the end time

$scriptEnd = (Get-Date)

#Calculate the timespans

$hostStartTime = New-Timespan -Start $ScriptStart -End $hostsStarted

$cvmStartTime = New-Timespan -Start $hostsStarted -End $cvmStarted

$storageStartTime = New-Timespan -Start $cvmStarted -End $scriptEnd

$totalTime = New-Timespan -Start $scriptStart -End $scriptEnd

#Write a time summary

write-host "ESXi Boot Time"

write-host $hostStartTime

write-host "CVM Startup Time"

write-host $cvmStartTime

write-host "Storage Startup Time"

write-host $storageStartTime

write-host "Total Script Time"

write-host $totalTime

#Nutanix Shutdown Script
#Add all of the IPs to arrays
$cvmIPs = "10.0.0.71", "10.0.0.72", "10.0.0.73"
$ipmiIPs  = "10.0.0.81", "10.0.0.82", "10.0.0.83"
$hostIPs = "10.0.0.91", "10.0.0.92", "10.0.0.93"

#Get script start time so we can see how long it takes for the scripts to run
$scriptStart = (Get-Date)

#This script leverages The SSH.NET powershell module from http://www.powershelladmin.com/wiki/SSH_from_PowerShell_using_the_SSH.NET_library
#Download it at: http://www.powershelladmin.com/w/images/a/a5/SSH-SessionsPSv3.zip

New-SshSession -ComputerName $cvmIPs[0] -Username 'nutanix' -Password 'nutanix/4u'
$result = Invoke-SshCommand -ComputerName $cvmIPs[0] -Command '/home/nutanix/cluster/bin/cluster status | grep state'
If ($result -eq 'The state of the cluster: start')  {Invoke-SshCommand -ComputerName $cvmIPs[0] -Command '/home/nutanix/cluster/bin/cluster stop'}
sleep 10
$result = Invoke-SshCommand -ComputerName $cvmIPs[0] -Command '/home/nutanix/cluster/bin/cluster status | grep state'
Remove-SshSession -RemoveAll

If ($result -eq 'The state of the cluster: stop') {
   foreach ($cvmIP in $cvmIPs) {New-SshSession -ComputerName $cvmIP -Username 'nutanix' -Password 'nutanix/4u';Invoke-SshCommand -ComputerName $cvmIP -Command 'sudo /sbin/shutdown -h 0'}
}
Remove-SshSession -RemoveAll


#Ping the CVMs until they are shutdown
$ping = new-object System.Net.Networkinformation.Ping
write-host "Shutting down CVMs"
foreach ($cvmIP in $cvmIPs) {do{$pingResult = $ping.send($cvmIP);write-host "." -NoNewline; sleep 1} Until($pingResult.status -ne "Success")}

#Shutdown the hosts
write-host "Shutting down hosts"
foreach ($ipmiIP in $ipmiIPs) {If ($result -eq 'The state of the cluster: stop') {ipmiutil reset -D -N $ipmiIP -U ADMIN -P ADMIN}}

foreach ($hostIP in $hostIPs)  {do{$pingResult = $ping.send($hostIP);write-host "." -NoNewline; sleep 1} Until($pingResult.status -ne "Success")}

#Print how long the script took to run
$scriptEnd = (Get-Date)
$runTime = New-Timespan -Start $scriptStart -End $scriptEnd
write-host `n"Script Run Time:" `n $runtime

#Nutanix Shutdown Script

#Add all of the IPs to arrays

$cvmIPs = "10.0.0.71", "10.0.0.72", "10.0.0.73"

$ipmiIPs = "10.0.0.81", "10.0.0.82", "10.0.0.83"

$hostIPs = "10.0.0.91", "10.0.0.92", "10.0.0.93"

#Get script start time so we can see how long it takes for the scripts to run

$scriptStart = (Get-Date)

#This script leverages The SSH.NET powershell module from http://www.powershelladmin.com/wiki/SSH_from_PowerShell_using_the_SSH.NET_library

#Download it at: http://www.powershelladmin.com/w/images/a/a5/SSH-SessionsPSv3.zip

New-SshSession -ComputerName $cvmIPs[0] -Username 'nutanix' -Password 'nutanix/4u'

$result = Invoke-SshCommand -ComputerName $cvmIPs[0] -Command '/home/nutanix/cluster/bin/cluster status | grep state'

If ($result -eq 'The state of the cluster: start') {Invoke-SshCommand -ComputerName $cvmIPs[0] -Command '/home/nutanix/cluster/bin/cluster stop'}

sleep 10

$result = Invoke-SshCommand -ComputerName $cvmIPs[0] -Command '/home/nutanix/cluster/bin/cluster status | grep state'

Remove-SshSession -RemoveAll

If ($result -eq 'The state of the cluster: stop') {

foreach ($cvmIP in $cvmIPs) {New-SshSession -ComputerName $cvmIP -Username 'nutanix' -Password 'nutanix/4u';Invoke-SshCommand -ComputerName $cvmIP -Command 'sudo /sbin/shutdown -h 0'}

}

Remove-SshSession -RemoveAll

#Ping the CVMs until they are shutdown

$ping = new-object System.Net.Networkinformation.Ping

write-host "Shutting down CVMs"

foreach ($cvmIP in $cvmIPs) {do{$pingResult = $ping.send($cvmIP);write-host "." -NoNewline; sleep 1} Until($pingResult.status -ne "Success")}

#Shutdown the hosts

write-host "Shutting down hosts"

foreach ($ipmiIP in $ipmiIPs) {If ($result -eq 'The state of the cluster: stop') {ipmiutil reset -D -N $ipmiIP -U ADMIN -P ADMIN}}

foreach ($hostIP in $hostIPs) {do{$pingResult = $ping.send($hostIP);write-host "." -NoNewline; sleep 1} Until($pingResult.status -ne "Success")}

#Print how long the script took to run

$scriptEnd = (Get-Date)

$runTime = New-Timespan -Start $scriptStart -End $scriptEnd

write-host `n"Script Run Time:" `n $runtime

Technologist