White Papers
Table Of Contents
- Executive Summary (updated May 2011)
- 1. Introduction
- 2. Dell NFS Storage Solution Technical Overview
- 3. NFS Storage Solution with High Availability
- 4. Evaluation
- 5. Performance Benchmark Results (updated May 2011)
- 6. Comparison of the NSS Solution Offerings
- 7. Conclusion
- 8. References
- Appendix A: NSS-HA Recipe (updated May 2011)
- A.1. Pre-install preparation
- A.2. Server side hardware set-up
- A.3. Initial software configuration on each PowerEdge R710
- A.4. Performance tuning on the server
- A.5. Storage hardware set-up
- A.6. Storage Configuration
- A.7. NSS HA Cluster setup
- A.8. Quick test of HA set-up
- A.9. Useful commands and references
- A.10. Performance tuning on clients (updated May 2011)
- A.11. Example scripts and configuration files
- Appendix B: Medium to Large Configuration Upgrade
- Appendix C: Benchmarks and Test Tools
Dell HPC NFS Storage Solution - High Availability Configurations
Page 37
Make a backup of /etc/sysconfig/nfs and change the number of threads
# cp /etc/sysconfig/nfs{,.orig}
# sed -i 's/#RPCNFSDCOUNT=8/RPCNFSDCOUNT=256/' /etc/sysconfig/nfs
Restart the NFS service.
service nfs restart
Reference -
http://i.dell.com/sites/content/business/solutions/whitepapers/en/Documents/hpc-
pv-md1200-nfs.pdf
3) On both the active and the passive server, change the OS I/O scheduler to “deadline”.
To the end of the kernel line in /etc/grub.conf, add elevator=deadline
Reboot the server for this to take effect.
A.5. Storage hardware set-up
1) Cable the MD3200 to the SAS 6 Gbps card on servers as shown in Figure 3.
Do not cable storage to R710 before OS install.
Reference: http://support.dell.com/support/edocs/systems/md3200/en/DG/PDF/DG.pdf
, Section
“Dual Controller Configurations”
2) Cable MD1200 to MD3200
Reference: http://support.dell.com/support/edocs/systems/md3200/en/index.htm
A.6. Storage Configuration
1) Launch the MDSM management GUI on one R710. Discover the attached storage array via in-band
management and add the storage array to the management GUI.
2) Create a host group and add the active and passive servers to the group.
3) Create LUNS on storage using MDSM GUI
For each array, create a disk group and a virtual disk that contains all 12 disks in a 10+2
RAID6 with a segment size of 512k. For the NSS-HA Medium configuration, this is a total of
two LUNS. For NSS-HA Large, this is a total of four LUNS.
Enable read cache, write cache, write cache mirroring and dynamic cache read prefetch
for each virtual disk.
Enable the high performance tier on the MD3200.
Set the cache block size to 32k.
For instruction on how to configure the storage array, use reference:
http://support.dell.com/support/edocs/systems/md3200/en/OM/PDF/MD3200.pdf
4) Map all the virtual disks to this host group that contains the active and passive servers.
Reference: http://support.dell.com/support/edocs/systems/md3200/en/index.htm
5) On each R710, run the command rescan_dm_devs