Open Source Object Storage for Unstructured Data: Ceph on HP ProLiant SL4540 Gen8 Servers
Table Of Contents
- Executive summary
- Introduction
- Overview
- Solution components
- Workload testing
- Configuration guidance
- Bill of materials
- Summary
- Appendix A: Sample Reference Ceph Configuration File
- Appendix B: Sample Reference Pool Configuration
- Appendix C: Syntactical Conventions for command samples
- Appendix D: Server Preparation
- Appendix E: Cluster Installation
- Naming Conventions
- Ceph Deploy Setup
- Ceph Node Setup
- Create a Cluster
- Add Object Gateways
- Apache/FastCGI W/100-Continue
- Configure Apache/FastCGI
- Enable SSL
- Install Ceph Object Gateway
- Add gateway configuration to Ceph
- Redeploy Ceph Configuration
- Create Data Directory
- Create Gateway Configuration
- Enable the Configuration
- Add Ceph Object Gateway Script
- Generate Keyring and Key for the Gateway
- Restart Services and Start the Gateway
- Create a Gateway User
- Appendix F: Newer Ceph Features
- Appendix G: Helpful Commands
- Appendix H: Workload Tool Detail
- Glossary
- For more information
Reference Architecture| Ceph on HP ProLiant SL4540 Gen8 Servers
• --iodepth=<units in flight>: Number of IO units to keep in flight against the file. A depth of 8 was used for testing.
• --name <job name>: In this context, used /dev/rbd1 to specify job name and the device file being targeted.
• --rwmixwrite=<% mix writes>: Percentage of mixed workload to make writes. The mix test used 30.
• --rwmixread=<% mix reads>: Percentage of mixed workload to make reads. The mix test used 70.
Collectl
Installing
Written by Mark Seger (the author of getput), collectl is available as a standard distribution package.
sudo apt-get install collectl
Test Parameters
Collectl has an extensive list of parameters to capture and play back information. CPU, Disk and Network data are captured
by default, so the only parameter added during capture was –f for redirecting playback output to a file.
Playback of the results used these parameters, and was then post-processed to get average data:
• -s <subsystem>: This field controls which subsystem data is to be collected or played back for. A subsystem of ‘c’
specifies playing back CPU data.
• -p <Filename>: Read data from the specified playback file(s).
HAProxy
Installing
Under Ubuntu, haproxy can be fetched as a standard package.
sudo apt-get install haproxy
Configuration
This is a minimal configuration that forwards 80 and 443 to the monitor/gateway boxes and uses source balancing to keep
a best-effort client/server affinity.
#this config needs haproxy-1.1.28 or haproxy-1.2.1
global
log 127.0.0.1 local0
log 127.0.0.1 local1 notice
#log loghost local0 info
maxconn 4096
#chroot /usr/share/haproxy
user haproxy
group haproxy
daemon
#debug
#quiet
defaults
log global
mode http
option dontlognull
retries 3
option redispatch
maxconn 2000
contimeout 5000
clitimeout 50000
srvtimeout 50000
listen http_proxy :80
option httplog
mode http
balance source
server hp-cephmon01 192.168.0.10 check
server hp-cephmon02 192.168.0.11 check
server hp-cephmon03 192.168.0.12 check
52