3 - download.microsoft.com

3 - download.microsoft.com

2012 R2 Storage Michael Faden Technology Solution Professional Datacenter File System Data going huge Decimal prefix Binary prefix Name (Symbol) Description Description Kilobyte (kB) 103 Byte = 1.000 Byte 210 Byte = 1.024 Byte Megabyte (MB) 106 Byte = 1.000.000 Byte 220 Byte = 1.048.576 Byte Gigabyte (GB) 109 Byte = Byte

230 Byte = 1.073.741.824 Byte Terabyte (TB) 1012 Byte = Byte 240 Byte = 1.099.511.627.776 Byte Petabyte (PB) 1015 Byte = Byte 250 Byte = 1.125.899.906.842.624 Byte Exabyte (EB) 1018 Byte = Byte 260 Byte = 1.152.921.504.606.846.976 Byte Zettabyte (ZB) 1021 Byte = Byte 270 Byte = 1.180.591.620.717.411.303.424 Byte Yottabyte (YB) 1024 Byte = Byte 280 Byte = 1.208.925.819.614.629.174.706.176 Byte Platform Storage Local File System

New Storage Capabilities with Resilient File System (ReFS) Scale to PetaByte + ReFS File System Greater compatibility with SATA standards Resilience against power outage corruption Online corruption recovery Implements ondisk structures, such as the Master File Table, to represent files and directories. CONTINUOUS APPLICATION AVAILABILITY File system enhancements Resilient File System (ReFS) CHKDSK NTFS improvements

Seconds to fix corrupted data Rapid recovery from file system corruption without affecting No offlineavailability time when used with CSV Rapid recovery from file system corruption Disk scanning separated from repairallocate-on Data corruptionprocess virtually eliminated through Resilient against power outage corruption Online checksum scanning with volume Period validation ofand file offline systemrepair meta-data Periodic checksum validation of file system 400 Seamless data integrity protection

350 Improved data integrity protection 300 Ideal for file server volumes 250 without affecting availability metadata process write 200 150 100 50 0 Source: Microsoft Internal Testing" Windows Server 2008 R2 100 Million Files 200 Million Files 300 Million Files Storage Performanc e

Short Explanation on IOPS IOPS (Input/Output Operations Per Second, pronounced eye-ops) is a common performance measurement used to benchmark computer storage devices like hard disk drives (HDD), solid state drives (SSD), and storage area networks (SAN). SEQUENTIAL Access RANDOM Access Hyper-V: Over 1 Millions IOPs from a Single VM Industry Leading IO Performance VM storage performance on par with native Performance scales linearly with increase in virtual processors Windows Server 2012 Hyper-V can virtualize over 99% of the worlds SQL Server. Windows Server 2008 R2 Windows Server 2012 250,000 IOPs 1,000,000+ IOPs

Hardware Configuration Industry Standard 4 Socket Server 80 Logical Processors (10 cores + SMT) 256 GB of physical memory Direct Attached Storage 5 LSI HBA with 40 SSDs VM configured with: 64 Virtual Processors 64 GB of memory IOmeter 4k, Random IO, Queue Depth =32, 40 concurrent threads Storage Deployment Approaches Performan ce Optimized 144Gbps Shared SAS Links 1.45 Million IOPS 12GB/s Throughput Extreme Performance Greatest

throughput, highest IOPS Storage Spaces ENTERPRISE-CLASS FEATURES ON LESS EXPENSIVE HARDWARE Storage Spaces Windows Application Server or File Server with Storage Pools and Storage Spaces Physical or virtualized deployments Integrated with other Windows Server 2012 capabilities Storage resilience and File Server Administration Console Failover Clustering Cluster Shared Volume

Windows Virtualized Storage Virtualization of storage Storage Space Hyper-V SMB Multichannel availability with commodity hardware Resiliency and data NTFS SMB Direct NFS Windows Storage Mgmt. Storage Space Storage Space redundancy through n-way mirroring (clustered or unclustered) or parity mode (unclustered) Utilization optimized

through thin and trim provisioning and enclosure awareness Integration with other Storage Pool Storage Pool Physical Storage Windows Server 2012 capabilities Serial Attached SCSI (SAS) and Serial AT Attachment (SATA) interconnects (Shared) SAS or SATA Storage Spaces - Capabilities Overview Pooling of disks Storage Spaces Flexible resilient storage spaces Mirror Space

Mirror Space Mirror Space Parity Space Native data striping maximizes performance Data Copy 1 Data Copy 2 Physical Disks from Shared SAS JBODs Enclosure awareness with certified hardware Parallelized rebuild utilizes spare pool capacity Storage Pool Storage Spaces Resiliency Options SIMPLE SPACE

2-Way MIRROR SPACE PARITY SPACE STORAGE POOL Simple Space 2-Way Mirror Space 3-Way Mirror Space Parity Space Dual Parity Space Number of data copies 1 2 3 2 + Parity 3 + Parity

Number of columns (default) # Disks # Disks / 2 # Disks / 2 # Disks # Disks Interleafe (default) 256KB 256KB 256KB 256KB 256KB Reduced Mean Time To Recovery Mirror Spaces Rebuild Parallelized Recovery Increased Throughput Optimized Disk Utilization Utilization of spare capacity Hot Spare no longer necessary in R2

Storage Space Performance improvements to radically reduce MTTR Rebuild Metric Measuremen t Data Rebuilt 2,400 GB Time Taken 49 min Rebuild 3TB HDDs, 2-way, 4-column> 800 Mirror Space MB/s Source: Internal Testing, No Foreground Activity Throughput Data Deduplicati on Efficient storage through Data Deduplication Maximize capacity by removing duplicate data

VHD Library 2:1 with file shares, 20:1 with virtual storage Less data to back up, archive, and migrate Software Deployment Share General File Share Increased scale and performance Low CPU and memory impact Configurable compression schedule Transparent to primary server workload User Home Folder (My Docs) Improved reliability and integrity 0% 20% 40% 60% 80% 100% Average savings with Data Deduplication by workload type Source: Microsoft Internal Testing"

ENTERPRISE-CLASS FEATURES ON LESS EXPENSIVE HARDWARE Redundant metadata and critical data Checksums and integrity checks Increase availability through redundancy Faster file download times with BranchCache Performance and Scalability Data Access Zero impact on new written files No impact on access to user documents (e.g. office) 1-1.5x time to copy 1 large file (e.g. VHDs) <1x time to copy multiple large files (e.g. VHDs) with high duplication Deduplication Data optimized at ~100GB/hour for a single 2TB volume/disk using a single CPU core and <1GB of RAM Scales out: Multiple volumes can be processed in parallel with additional CPU, memory and disk resources Demo Evaluating Deduplication

Evaluating Deduplication Storage tiering Storage Tiering Optimized Data Placement Pool consists of both SSDs and HDDs Tiers within a Storage Space Hot Data (SSDs), Cold Data (HDDs) Sub-File-Level Data Movement Complements write-back caching Administrative Controlled Pinning Pin hot files to faster SSD tier Example: VDI Pooled VMs VHD Tiered Storage Spaces provides persistent performance improvement for hot data The best of both worlds: SSD Performance & HDD Capacity Virtual Machines

SSD Tier Hot Data HDD Tier 400GB EMLC SAS SSD Cold Data 4TB 7200RPM SAS HDD Storage Space Write-Back Cache Random Disk Access Virtual Machines Inherent to storage access patterns with virtualized deployments SSDs provide higher IOPs for random access Improved performance for real-world workloads SSDs absorb random writes at high IOPS levels Seamless integration and familiar management Windows Server 2012 R2 maximizes performance and capacity The Spaces Write-Back Cache absorbs spikes in random write activity

SSD Tier & WBC 400GB EMLC SAS SSD Hot Data HDD Tier Cold Data 4TB 7200RPM SAS HDD Storage Space Storage Deployment Approaches How to build a deployment with: 16 TB Capacity 180,000 IOPS (4k, random) ? HDD Only Deployment Meet Capacity with 6 HDDs Miss IOPS by 179,100 SSD Only Deployment

Miss Capacity by 12.8 TB Meet IOPS with 4 SSDs Balanced Mix of HDD & SSD High Capacity HDDs High Performance SSDs Best IOPS/$ Balanced Deployment: Meet Capacity with 6 HDDs Meet IOPS with 4 SSDs Option SSD Only (20) Mixed (6 + 4) Capaci ty IOPS Cost 16 TB

1,000,00 0 $60,00 0 21.2 TB 200,90 0 $14,10 0 3TB SAS HDDs, 150 IOPS, $350 MSRP 800GB SAS SSDs, 50,000 IOPS, $3,000 MSRP Write-Back Caching Write-Back Caching (WBC) Complements Tiering Tiering Balances capacity & performance WBC Short-term absorption of I/O bursts Seamless Integration & Management Utilizes available SSD capacity from pool WBC enabled by default Configurable through PowerShell Hyper-V Compute Nodes

S Int eam eg les ra s tio n Reads/Writes Accumulates Data Activity SSD Tier & WBC Hot Data HDD Tier 400GB EMLC SAS SSD Cold Data 4TB 7200RPM SAS HDD Storage Space Demo Storage tiering Component Overview Component Overview Industry standard commodity storage hardware Shared SAS JBOD arrays with power and data-path redundancy Dual-Port SAS drives

Sampling of available Spaces Certified Hardware See www.windowsservercatalog.com under the Storage Spaces Category Windows File Server Cluster Continuously Hyper-V Compute Nodes Available Storage Platform Supports VM migrations Storage moves with VMs Resiliency to disk, link, controller, power, JBOD, and node failure SMB \\SRV\ DB Mirror Cluster Shared SMB \\SRV\ VDI_Mktg Mirror 768Gb/s

Volume \\SRV\ Ops Mirror Shared SAS Dual Parity Links Unified namespace scales linearly as deployment grows 60-bay SAS Array 60-bay SAS Array 60-bay SAS Array 60-bay SAS Array Scaling the Windows File Server Cluster Physical or Virtualized

Workloads Hyper-V Compute Nodes High Speed Network (10GbE/InfiniBand) Unified Namespace (CSV) Clustered Storage Spaces Mirr or Mirr or SMB SMB SMB \\SRV\DB \\SRV\VDI_Mktg \\SRV\Ops Mirr or

Mirr or Mirr or Mirr or Mirr or Mirr or Clustered File Servers with 10GbE/InfiniBand 768Gbps Shared SAS Links 768Gbps Shared SAS Links 768Gbps Shared SAS Links

768Gbps Shared SAS Links 60-bay Shared SAS JBOD Arrays 0.96P 0.96P 0.96P 0.96P Server Message Block (SMB) 3.0 SMB 3.0 Direct-attached storage (DAS) Equivalence Top-to-bottom performance SQL TPC-C transactions/second analysis and tuning SMB server optimization New tracing instrumentation to identify bottlenecks Substantial refactoring of SBM2 client as well Windows Server 2012 at 98% of

DAS transactional perf Identical servers and storage 1Gbps Ethernet v. 4Gbps FC 28 x 10KRPM HDD 4270 4500 4315 4000 3500 3000 2500 2000 1500 1175 1000 500 0 SMB SMB + DAS Network fault tolerance with SMB Multichannel Automatic detection and use of multiple network connections between SMB client

and server Helps server applications be resilient to network failure Transparent Failover with recovery of network failure if another connection is unavailable Improved throughput Bandwidth aggregation through NIC Teaming Multiple nodes/CPUs for network processing with RSS-capable network adapters Automatic configuration with very little administrative overhead SMB client Network NIC CONTINUOUS APPLICATION AVAILABILITY SMB server NIC File copy File copy NIC

NIC Improved network performance through SMB Direct (RDMA*) ENTERPRISE-CLASS FEATURES ON LESS EXPENSIVE HARDWARE Higher performance Without With RDMA RDMA File Client File Server App Buffer Application SMB Buffer SMB Client OS Buffer Transport

Protocol Driver Drive r Buffer through offloading of network I/O processing onto network adapter High throughput with NIC Driver SMB Server SMB Buffer Transport Protocol Driver OS Buffer NIC Driver Drive r Buffer low latency and ability to take advantage of highspeed networks (such

as InfiniBand and iWARP) Remote storage at the speed of direct storage Transfer rate of Adapter Buffer NIC rNIC* *Remote Direct Memory Access iWARP InfiniBand rNIC* NIC Adapter Buffer around 50 Gbs on a single NIC port Compatible with SMB Multichannel for load balancing and failover *e.g. Intel NetEffect Server Cluster Adapter Family

ENTERPRISE-CLASS FEATURES ON LESS EXPENSIVE HARDWARE Application storage support SMB 3.0 Highly available, Microsoft SQL Server Hyper-V Cluster SMB Single Logical Server \\Foo\ Share Increased flexibility, and easier provisioning and management File Server Cluster Ability to take advantage of existing network infrastructure Single File System Namespace No application

Cluster Shared Volumes Windows Virtualized Storage RAIDSpace Storage Array Storage Pool Physica l Storage SAN shared data store for SQL Server databases and Hyper-V workloads StorageRAID Space Array Storage Space RAID Storage Pool Array downtime for planned maintenance or

unplanned failures with failover clustering Highly available scale- out file server Built-in encryption support CONTINUOUS APPLICATION AVAILABILITY SMB Transparent Failover SQL Server \\foo\share 2 Failover transparent to server applications with zero downtime and with only a small I/O delay Support for planned moves, load balancing, operating system restart, unplanned failures, and client redirection (scale-out only) Resilient for file and directory operations All servers involved should have Windows Server 2012 Normal operation

3 Failover share connections and handles lost, temporary stall of I/O Connections and handles autorecovered Application I/O continues with no errors Windows Server file server cluster High-performance, continually available fileshares for business critical applications 1 \\foo1\share1 \\foo2\share1 SMB Direct Performance Enhancements(R2) Hyper-V 50% improvement for small IO workloads with SMB over RDMA Performanc e Increased 8KB IOPs from ~300K IOPS to

~450K IOPS per interface Increased efficiency and density of hosting workloads with small I/Os such as OLTP database in a VM Efficiency SMB Direct Scale-out File Server Optimizes 40Gbps Ethernet and 56Gbps InfiniBand 50% improvement for small IO workloads VHD Optimized Rebalancing of Scale-out File Server Scale-Out File Server clients are now redirected to the best node for access Avoids unnecessary redirection traffic Driven by ownership of Cluster Shared Volumes SMB connections managed per share Hyper-V host \\SOFS\Share2 SMB

No longer per file server Dynamically moves as CSV volume ownership changes Clustering is now also balancing CSV volumes Share1 Share2 Share1 Share2 automatically Automatic behavior, no administrator action CSV and SMB shares automatically rebalanced Improved network efficiency through drastically reducing redirection traffic Storage Spaces File Server 1 Scale-out File Server

File Server 2 Offloaded Data Transfer (ODX) Offloaded Data Transfer (ODX) IMPROVED PERFORMANC E,MORE CHOICE Offloaded Data Transfer (ODX) Token-based data transfer between intelligent storage arrays Benefits Rapid virtual machine provisioning and migration Faster transfers on large files Minimized latency Maximized array throughput Less CPU and network use Performance not limited by network throughput or server use Improved datacenter capacity and scale Offload Copy Reque

st Write Request Token Token Successful Write Result External Intelligent Storage Array Actual Toke n Data Virtual Disk Virtual Disk Windows Storage Server 2012 Windows Storage Server 2012 IMPROVED PERFORMANC E,MORE CHOICE Workgroup

Standard Entry level 50 users Scale up Continuous availability X64 32 GB X64 2 TB Active Directory Lightweight Directory Services Yes Yes CPU sockets/virtual machines 1+0 2+2 Yes Yes 6, No external SAS Unlimited NAS Segments

Windows Server for NAS appliances that are preconfigured and enterprise ready Architecture/maximum memory Ideal file-based storage solution that is fault tolerant, continuously available, scalable, and cost effective Hardware RAID iSCSI Software Target Yes Yes Workgroup and Standard editions File sharing (SMB/NFS) Yes Yes Microsoft BitLocker Yes Yes Data Deduplication

No Yes Hyper-V No Yes BranchCache Hosted Cache No Yes Clustering No Yes DHCP, DNS, and WINS No Yes Active Directory DC, Certificate, Federation, Rights Management, Application Server, Network Policy, Terminal Services, WDS, Fax Server No

No Multiple vendors Disks Growing ecosystem of hardware partners Windows Cluster in a Box ODX IMPROVED PERFORMANC E,MORE CHOICE SMB Direct Quanta Computer Fujitsu Dell EqualLogic EMC Mellanox HP Intel HP

Fujitsu Intel Wiwynn LSI IBM Hitachi Violin Memory HA-DAS.com NetApp NEC Xio Xyratex Chelsio Windows Storage Server 2012 DELL Western Digital Compellent Pivot 3


AREA CM Broadberry ABERDEEN Storageflex Fujitsu SIEMENS Windows File Server Cluster Solution Partners Certified Storage Spaces Hardware High-Performance Servers and Storage http://www.dataonstorage.com/ http://www.raidinc.com/ http:// http://windowsservercatalog.com/results.aspx? http:// www.fujitsu.com/fts/ http:// 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Recently Viewed Presentations