Powered by System Center
// Main banner ad on homepage
Posts tagged Storage
Dell Compellent and Offloaded Data Transfer (ODX)
Mar 20th
I just finished a remote support session for a customer in New York. My task was to check a Windows Server 2012 cluster using PowerEdge M620 blades with 4x10GbE connected to a Dell Compellent (6.3.1 firmware).
I just had a small window of opportunity to create a fixed sized VHDX (25GB and 250GB).
new-vhd -path C:\ClusterStorage\volume1\25GB.vhdx -size 25GB –fixed
new-vhd -path C:\ClusterStorage\volume2\250GB.vhdx -size 250GB –fixed
Both completed in under 3 seconds. Wow!!!
ODX in its purest form.
So let me reiterate my advice to new SAN array buyers. The first question you should ask your SAN vendor. Does it support ODX? If the answer is negative or if they promise ODX in their next release, just tell them to take a hike and move on to a capable SAN vendor.
|
|
MS Christmas present: SMI-S Storage Provider for iSCSI Target Server
Dec 26th
It is only several days since Microsoft made the final bits of System Center 2012 SP1 available, although for a relatively limited audience. If you have a TechNet or MSDN subscription, you have access to SP1 now. All others have to wait till general availability in the course of January 2013.
One of my fellow MVP’s in the Cloud and Datacenter Management department, Graham Davies, raised my interest by claiming there was something in VMM 2012 SP1 that had gone unnoticed: a brand-new SMI-S storage provider for the onboard iSCSI Target Server role in Windows Server 2012! People using the iSCSI Target Server for both demo/test/development and production will get quite excited if they discover how well this software storage solution is integrated, not only in Windows but now also in System Center 2012 SP1.
Back in March 2011, I wrote several blogs about the new Fabric concept in Virtual Machine Manager 2012 which was still in its early beta. One blog focused on deep storage integration using a SNIA standard called Storage Management Initiative Specification (SMI-S). When I was contributing my Fabric chapters for the Microsoft Private Cloud Computing book, there was only a limited number of usually very expensive storage arrays to really dig into this subject. I had access to some HP and NetApp storage to test SMI-S integration which was still very limited at the time. When we saw how the iSCSI Target Server, which was previously a separate install on Windows Server 2008 R2, developed and became included as a role in Windows Server 2012, we begged the product managers responsible for storage in System Center 2012 to also provide SMI-S support. Well guys … here it is!
Fast forwarding about two years, a lot has happened in the storage space and most storage vendors have introduced SMI-S support for their most important storage products. I now consider storage that does not support SMI-S (and some of the other cool technology such as ODX and Unmap/Trim), as a sign that these products are on that vendor’s death list and will soon be obsolete.
HP Storage Platforms and Windows Server 2012
Dec 12th
[Updated: see 
]
HP bought 3PAR several years ago and as I expected the recently announced HP 3PAR StoreServ 7000 series are intended to replace HP EVA. There is even a data migration solution to make the migration as easy as possible. Of course I looked at what 3PAR has to offer in terms of features in Windows Server 2012 and integration with Hyper-V and System Center Virtual Machine Manager 2012.
The 3PAR StoreServ 7000 datasheet tells us this:
In Windows® Server 2012 environments, built-in, fine-grained virtualization, system-wide striping, and support for multi-tenancy give you the ability to consolidate mixed workloads onto a single HP 3PAR StoreServ 7000 system. With Windows Server 2012 Offload Data Transfer (ODX) and the HP 3PAR StoreServ 7000, you can migrate large files—such as databases or video files—up to seven times faster with near-zero network impact due to zerodetection capability integrated into the HP 3PAR ASIC. HP 3PAR Thin Technologies and Windows Server 2012 automatic reclamation of storage automate storage growth and shrinkage, while HP 3PAR Adaptive Optimization Software delivers the right QoS to the right data at the right time in Windows Server 2012 environments.
Not only does the new 3PAR StoreServ 7000 support Offloaded Data Transfer (ODX) but also Storage Management Initiative Specification (SMI-S) and a new Web Services API. SMI-S is what Microsoft has promoted vigorously and nobody seemed to believe in. At the end of the day most storage vendors finally comply with this SNIA standard. In our Microsoft Private Cloud Computing book, a good part of the storage fabric chapter is devoted to SMI-S integration in System Center Virtual Machine Manager 2012.
Lower end and non-comparable storage systems such as Dell’s EqualLogic only promise 2x improvement on file copy with ODX. The 7x promise with 3PAR’s ODX capability sounds good but of course we have to verify this in practice. At TechEd we were shown video’s comparing a 10GB regular copy (in about 3 minutes at 80-90MB/sec) versus a 10 second copy with ODX. I’m not sure if Microsoft used NetApp or EMC for the demo.
HP’s P4500 requires SANiQ v10.0 which is finally available and at a minimum will support Windows Server 2012. Many customers who invested in this platform and plan to upgrade to Windows Server 2012 Hyper-V will no doubt be very disappointed to learn that there is no ODX, no SMI-S, no UNMAP, no Dedupe. At least I cannot find any references to these important integrations for Windows Server 2012, Hyper-V and System Center. A 60-day trial for HP StoreVirtual VSA and documentation can be obtained here:
See an older blog on ODX:
http://www.hyper-v.nu/archives/hvredevoort/2012/04/windows-8-storage-hyper-v-part-4-offload-data-transfer-odx/
And on SMI-S:
http://www.hyper-v.nu/archives/hvredevoort/2011/03/vmm-2012-fabric-deep-storage-integration/
@WorkingHardInIT pointed out that the Dell EqualLogic number for ODX might even be 5x the speed of a regular non-offloaded copy. I based my number on a demo I had seen. In a Dell Techcenter blog on Windows Server 2012 and EqualLogic an increase in copy time of 5x is mentioned. As I stated for the 3PAR number, it is always best to verify these numbers in your own practice.
The Experts Conference US 2012
May 24th
VKernel’s Mattias Sundling discusses The Expert Conference event with MVPs Hans Vredevoort and Anil Desai. Topics include highlights of the technical sessions presented by Microsoft, Quest and industry experts as well as updates and highlights of Windows Server 2012 and Hyper-V3 advances.
Youtube: http://www.youtube.com/watch?v=mQF6Gguwb8M
VKernel’s Mattias Sundling discusses The Expert Conference event with MVPs Hans Vredevoort and Anil Desai. Topics include highlights of the technical sessions presented by Microsoft, Quest and industry experts as well as updates and highlights of Windows Server 2012 and Hyper-V3 advances.
http://www.vkernel.com/podreader/items/top-features-hyper-v-3-windows-server-2012
Jump Starting Windows Server 2012
May 24th
With a new operating system around the corner there is an awful lot to learn. The release candidate of Windows Server 2012 that is expected in the first week of June contains a wealth of new features you have most likely already heard about. I have been able to test a large number of very rich features including Hyper-V, File & Storage and Networking. It is very hard to touch everything in a short period.
Therefore I strongly advise you to register for this Windows Server 2012 Jumpstart which is a two day live virtual class presented by Rick Claus and Corey Hynes.
Day One
Morning | Beyond Virtualization
• Game changers in the next release of the Hyper-V role on Windows Server 2012
• Massive scale increases, networking improvements, replication and disaster recovery is all in the box
Afternoon | Manageability
• Learn how you can manage a few systems up to a hundred – all from one console
• Server Core installs scaring you off? Learn about all your installation and management options
• Windows PowerShell automation and management at scale – all with built in tools
• Clustering—Cluster-aware updating
• Networking, Network Teaming, network configuration, SMB MultiChannel and RDMA
Day Two
Morning | Storage
• Learn how Continuous Availability of File Services improves workload reliability and performance
• Storage groups, disk provisioning, iSCSI and SAN integration
Afternoon | Remote Users
• Remote connectivity options for your workforce (DA)
• VDI and Remote Desktop Services deployment and changes
You can find more details here:
http://borntolearn.mslearn.net/btl/b/weblog/archive/2012/05/23/new-jump-start-who-s-ready-for-windows-2012-register-now.aspx
Speaking at The Experts Conference 2012 in San Diego
Apr 20th
Having presented at TEC2011 in Frankfurt for the first time was a good experience and I was very pleased to be asked to speak again. This time in San Diego in the US.
Join us for The Experts Conference for Virtualization 2012, April 29-May 2 in San Diego! TEC is the leading advanced training conference for Microsoft technologies, and this year brings even more sessions on Windows Server 2012 / Hyper-V 3.0, including Hot Storage Tricks, Capacity Management and Performance Analytics, SCVMM 2012 and Best Practices for Virtualizing Mission Critical Applications, and many more key topics.
Some of the internationally known speakers at TEC 2012 include:
- Brian Madden, Virtualization Expert at Tech Target as keynote presenter
- Mattias Sundling, Virtualization Track Facilitator/vExpert/Evangelist at Quest
- Stephen Baron, Senior Program Manager at Microsoft
- Christopher Kusek, vExpert/Technology Evangelist at EMC
- Dung K. Hoang, Principal Engineer at HP
- Hans Vredevoort, MVP/Consultant at Inovativ
- Rob Nottoli, System Architect at Microsoft.
- Greg Shields, MVP/vExpert/Senior Partner at Concentrated Technology
Check out the TEC website to see the full lineup.
TEC is for the experts by the experts and, as such, the sessions are highly technical (300-400 level) and include both presentations and demonstrations led by some of the world’s top technologists. Don’t miss your chance to learn from the best. TEC also provides really good networking opportunities! Meet the speakers, experts, product managers from Quest and Microsoft.
For more information about TEC and to signup, visit TEC website. We offer special discount for user groups and bloggers. Please contact stella.lowe@quest.com for further inquiries.
Windows 8 Storage & Hyper-V Part 5 – SMB 3.0 and ODX in NetApp
Apr 17th
http://www.youtube.com/watch?v=nUqqLkojCMw&feature=youtu.be[Update: Since I wrote this blog the version of SMB has been updated from 2.2 to 3.0 to reflect the vast amount of changes in the protocol]
Today was my first day at MMS2012 in Las Vegas. It is the event for Microsoft System Center and the new 2012 version of the product is inseparable from Hyper-V and Private Cloud. Despite the hard economic times we live in, the event is sold out of all 5500 seats and is clearly sizzling with expectations. Just after I walked out of the two beta Private Cloud exams this afternoon, the expo floor opened. The very first thing I noticed was a mini theatre in the back of the hall. The introductory slide that was held up before the presentation started looked very promising to me. In fact it was the ideal follow up for my previous blog that dealt with Offload Data Transfer or ODX in Windows Server 8 that would rock your socks off. The primary focus is on file based storage and Hyper-V VM’s on network shares using the immensely improved SMB 3.0 protocol.
I recorded an ultra cool presentation by Alex Jauch who is a Microsoft Technical Architect working for NetApp. It lasted only 12 minutes or so but it exactly defined what makes file based storage so appealing in Windows Server 8 and how Hyper-V will hugely benefit from this. You will see SMB 3.0 and ODX in action using Hyper-V VM’s on Network Attached Strorage.
After the presentation I stood in line waiting to chat with the presenter. Before me stood Eric Gray who is a VMware employee. Eric has a blog called VCritical and as the name implies he has been fairly critical of Hyper-V. As a result he has been in some fierce debates. Nevertheless our chat was professional and friendly. He now seems to recognize the huge improvements in storage, networking and Hyper-V appearing in the upcoming version of Windows Server 8.
Thanks to Alex Jauch who kindly allowed me to publish the video.
The video can be downloaded here: http://sdrv.ms/MPabCI or you can click on the image to start the video via Youtube
Windows 8 Storage & Hyper-V part 4 – Offload Data Transfer (ODX)
Apr 11th
This is another installment in my series on Windows 8 Storage & Hyper-V. Previous blogs in the series can be found here:
Part 3 – The Art of Creating a VHD
Another promising new storage functionality that can be found in Windows Server 8 is the new transparent fast copy feature called Offload Data Transfer or ODX. If you know VMware’s vStorage API for Array Integration (VAAI), you probably know where to place ODX because it is more or less in the same league.
What’s the Challenge?
If you have a large Hyper-V guest with multi-Terabyte VHDX files, it depends on the amount of memory, the activity of the VM and the available bandwidth how long it takes to Live Migrate that VM to another node in your Hyper-V cluster. However, it is an entirely different story if you also need to move these very large VHDX files from one disk to another, from one array to another, from one cluster to another or even from one cloud to another. It would take ages doing this the classic way. Every read and every write including its confirmation would have to go through the sending server and the receiving server. Even if there would only be one Hyper-V server involved (copying between two CSV’s on the same server) this is highly inefficient. After all the VHD(X) is already on the storage array. Why let the data travel all the way from CSV1 through server A to server B and then back to CSV2 again? Why would the data have to leave the storage array at all?
Windows 8 Storage and Hyper-V – Part 3: The Art of Creating a VHD
Apr 10th
In the last blog in my series on Windows 8 storage I already touched upon creating a VHDX with PowerShell 3.0 in Windows Server 8. In this blog I will focus on the subject a little bit more, showing the myriad ways of creating VHDs and show you some powerful commands to create multiple VHD files in Windows Server 8.
Here are a number of methods for creating a VHD:
-
WMI
-
Diskpart
-
Disk2VHD
-
VHD Tool
-
Disk Management
-
Hyper-V Manager
-
PowerShell 3.0
The WMI Method
Three years ago Taylor Brown in his blog “Hyper-V WMI Using PowerShell Scripts” demonstrated how we could create a VHD using a Hyper-V WMI method. Back then we did not have a Hyper-V PowerShell module as we now have in Windows 8. Borrowing from his work this is how we could accomplish our goal:
Windows 8 Storage and Hyper-V – Part 2: VHDX and PowerShell
Jan 24th
This blog is part of a series that started with Windows 8 Storage and Hyper-V Part 1 – Introduction:
http://www.hyper-v.nu/archives/hvredevoort/2012/01/windows-8-storage-and-hyper-v-part-1-introduction/
VHD HISTORY
If you have been working with any of the Microsoft virtualization products, you are familiar with the Virtual Hard Disk format. VHD was introduced with Microsoft’s acquisition of Connectix and their Virtual PC product in 2003. Seven years ago Microsoft decided to make the VHD Image Format Specification available to third parties under the Microsoft Open Specification Promise.
In June 2005 Microsoft promised that the VHD file format would have a future well beyond the then prevalent virtualization products ….. and boy did they keep their promise!
The Microsoft VHD file format specifies a virtual machine hard disk that can reside on a native host file system encapsulated within a single file. The format is used by Virtual PC 2007, Virtual Server 2005 R2 and Hyper-V and the format will be used by future versions of Microsoft Windows Server that includes hypervisor-based virtualization technology. Beyond that, the VHD format is broadly applicable, because it is agnostic to the virtualization technology, host operating system, or guest operating system with which it is used.
Customers and partners who invest the VHD file format will have a clear path forward to future Windows virtualization technologies. In addition, Microsoft plans to design its systems management tools around the VHD file format for improved patching and manageability.
Since the release of Windows 7 and Windows Server 2008 R2, the VHD format became even more versatile when Microsoft promised not only to standardize the variety of container files, but also introduced native VHD. This technology made it very easy to boot from VHD and have multiple operating systems on one machine. Since then VHD’s could not only be created via the Hyper-V manager but also via the inbox Disk Manager and Diskpart. Because the VHD format was opened up a multitude of VHD tools surfaced (vhdtool, disk2vhd, wim2vhd and many more). There was no easy way to just mount the VHD from the command line so 3rd parties jumped on this as well. I should not forget to mention James O’Neill’s awesome Hyper-V PowerShell Management Library which he created when he still worked for Microsoft.
The VHD related commands in that library are:
Get-VHDDefaultPath, Get-VHDInfo, New-VHD, Compact-VHD, Test-VHD, Convert-VHD, Merge-VHD, Mount-VHD, Unmount-VHD
VHDX
During the \\build conference we learnt that Microsoft will introduce a new advanced version of the Virtual Hard Disk format called VHDX in Windows 8 (both client and server). What do we currently know about this VHDX?
Twitter
RSS