White Papers
Dell HPC NFS Storage Solution - High Availability (NSS-HA) Configuration with Dell PowerVault
MD3260/MD3060e Storage Arrays
25
Start the cluster service on the server.
Mount NFS Share on clients.
Metadata file and directory creation test:
# mpirun -np 32 --nolocal --hostfile ./hosts /nfs/share/mdtest -d
/nfs/share/filedir -i 6 -b 320 -z 1 -L -I 3000 -y -u -t -C
Metadata file and directory stat test:
# mpirun -np 32 --nolocal --hostfile ./hosts /nfs/share/mdtest -d
/nfs/share/filedir -i 6 -b 320 -z 1 -L -I 3000 -y -u -t -R -T
Metadata file and directory removal test:
# mpirun -np 32 --nolocal --hostfile ./hosts /nfs/share/mdtest -d
/nfs/share/filedir -i 6 -b 320 -z 1 -L -I 3000 -y -u -t -r
A.3. Checkstream
The checkstream utility is available at http://sourceforge.net/projects/checkstream/. Version 1.0
was installed and compiled on the NFS servers and used for these tests.
First, a large file was created using the genstream utility. This file was copied to and from the NFS
share by each client using dd to mimic write and read operations. Failures were simulated during the
file copy process and the NFS service was failed over from one server to another. The resultant output
files were checked using the checkstream utility to test for data correctness and ensure that there
was no data corruption.
Below is a sample output of a successful test with no data corruption.
checkstream[genstream.file.100G]: ------------------------------------------------
checkstream[genstream.file.100G]: valid data for 107374182400 bytes at offset 0
checkstream[genstream.file.100G]: ------------------------------------------------
checkstream[genstream.file.100G]: end of file summary
checkstream[genstream.file.100G]: [valid data] 1 valid extents in 261.205032
seconds (0.00382841 err/sec)
checkstream[genstream.file.100G]: [valid data] 107374182400/107374182400 bytes (100
GiB/100 GiB)
checkstream[genstream.file.100G]: read 26214400 blocks 107374182400 bytes in
261.205032 seconds (401438 KiB/sec), no errors
For comparison, here is an example of a failing test with data corruption in the copied file. For
example, if the file system is exported via the NFS async operation and there is an HA service failover
during a write operation, data corruption is likely to occur.
checkstream[compute-00-10]: ------------------------------------------------
checkstream[compute-00-10]: valid data for 51087769600 bytes at offset 45548994560
checkstream[compute-00-10]:
checkstream[compute-00-10]: ------------------------------------------------
checkstream[compute-00-10]: end of file summary