Cross Post - Ran out of space on HD - hyper-v 2008r2 vm stopped running - primary server down
-
From Here
I have a server 2008r2 host running Hyper-V, my primary server, which is now the only data on the HD stopped running after I turned off the VM to allow it to merge with 2 avhd files.
server.vhd - 211GB
guid old.avhd - 222GB
guid newer.avhd- 42GBI tried moving the contents to another new drive that has plenty of space, I could not export due to merge in process. I shut down the vmms services and copied the entire contents of the vm to the new HD. After several hours I opened the existing vm information and changed the vhd location and snapshot location to the new drive and attempted to start the server...It began to start up then gave me an error that stated it could not start and it shut down. I then tried to do a manual merge of the avhd files into the vhd and it started the process and errord out at 90% stating a merge was in process. It has now been a full 36 hrs with no change in the file sizes or status.
I have a second folder on the large drive where I restore the previous nights backup and attempted to create a new vm using the restored vhd's but it came up with a "No Active Server" error. I am stumped and not really sure where to go from here.
I have available hardware:
PE 720 server (56GB RAM/32 usable, just installed pre-upgrade) running server 2008r2
PE 110 II server 16GB ram running server 2012Backups:
Have Acronis running nightly backups and can access prior backups to restore if neededThey are set up to move vm's from 2008r2 to 2012 to 2012r2. The last step would be a live migration. I have 4 vm's that will need to migrate and then get back to the PE720 after I flatten it and install Server 2012r2.
My one brain is frazzled and confused on where to go and how to try and get this server working again. I am almost to the point of having a couple of stiff drinks and its only 9 am! Oh and it is also my email server......
Thanks,
Greg
-
I'm assuming by primary server you mean Primary Domain Controller or File Server.
Is that correct, or is the Hypervisor the issue here?
-
Sounds like he let snapshots go out of control. Nothing you can reliably do except let it finish the merge. With no space it will take hours if not days.
Speaking from painful experience there. Did my normal , snapshot, apply Windows Updates, reboot, delete snapshot routine at a client, but apparently missed the confirmation dialog box and about a month later drive full. Took 30 hours to merge.
-
@JaredBusch So sit and wait and hopes it finishes, which means the business could be down for a long time.
Or restore from backups, and repair any issues that exist.
At this point he's been down 3 days and counting, shouldn't restoring from backup be the go-to solution?
-
@DustinB3403 said in Cross Post - Ran out of space on HD - hyper-v 2008r2 vm stopped running - primary server down:
@JaredBusch So sit and wait and hopes it finishes, which means the business could be down for a long time.
Or restore from backups, and repair any issues that exist.
At this point he's been down 3 days and counting, shouldn't restoring from backup be the go-to solution?
I did not catch the 3 days bit. If it is not nearing merge completion, then yeah, nuke it and restore. Likely Hyper-V will not let him delete though because it is busy merging. Probably going to have to force things.
-
So then restore from backup on a host that has enough capacity, and just kill the power to the other host.
Of course, having your DC and email server inside the same VM will be more problematic than just being one or the other...
