Open Source Object Storage for Unstructured Data: Ceph on HP ProLiant SL4540 Gen8 Servers
Table Of Contents
- Executive summary
- Introduction
- Overview
- Solution components
- Workload testing
- Configuration guidance
- Bill of materials
- Summary
- Appendix A: Sample Reference Ceph Configuration File
- Appendix B: Sample Reference Pool Configuration
- Appendix C: Syntactical Conventions for command samples
- Appendix D: Server Preparation
- Appendix E: Cluster Installation
- Naming Conventions
- Ceph Deploy Setup
- Ceph Node Setup
- Create a Cluster
- Add Object Gateways
- Apache/FastCGI W/100-Continue
- Configure Apache/FastCGI
- Enable SSL
- Install Ceph Object Gateway
- Add gateway configuration to Ceph
- Redeploy Ceph Configuration
- Create Data Directory
- Create Gateway Configuration
- Enable the Configuration
- Add Ceph Object Gateway Script
- Generate Keyring and Key for the Gateway
- Restart Services and Start the Gateway
- Create a Gateway User
- Appendix F: Newer Ceph Features
- Appendix G: Helpful Commands
- Appendix H: Workload Tool Detail
- Glossary
- For more information
Reference Architecture| Ceph on HP ProLiant SL4540 Gen8 Servers
create the default pool here so object gateway install doesn’t create one sub-optimal default placement group settings.
Remember to balance object gateway usage with amount of rbd storage required.
sudo ceph osd pool create .rgw.buckets <pg_count>
Add Object Gateways
The ceph-deploy package does not support object gateways, but changes to the configuration are driven from the staging
directory created in the above cluster installation step. If testing involves redoing the cluster from scratch frequently, this is
manual enough that it is worth scripting or otherwise orchestrating. For the sample reference configuration, object
gateways are installed on all of the monitors and load balanced.
All of the steps below are performed on the target system directly, except for the push of the ceph.conf which occurs on the
staging system (in this case hp-cephmon01). Installation must be performed and individually tailored for each system
performing the object gateway role.
Apache/FastCGI W/100-Continue
The Ceph community provides a slightly optimized version of the apache2 and fastcgi packages. The material difference is
that the Ceph packages are optimized for the 100-continue HTTP response, where the server determines if it will accept the
request by first evaluating the request header. If there are specific apache requirements, it may be possible to run with the
stock server.
Add ceph-apache.list file to APT sources.
echo deb http://gitbuilder.ceph.com/apache2-deb-$(lsb_release -sc)-x86_64-basic/ref/master $(lsb_release -sc) main |
sudo tee /etc/apt/sources.list.d/ceph-apache.list
Add ceph-fastcgi.list file to APT sources.
echo deb http://gitbuilder.ceph.com/libapache-mod-fastcgi-deb-$(lsb_release -sc)-x86_64-basic/ref/master $(lsb_release
-sc) main | sudo tee /etc/apt/sources.list.d/ceph-fastcgi.list
Update repository and install Apache and FastCGI.
sudo apt-get update && sudo apt-get install apache2 libapache2-mod-fastcgi
Configure Apache/FastCGI
Open the apache2.conf file:
sudo vim /etc/apache2/apache2.conf
Add a line for the server name in the Apache configuration file. Provide the fully qualified domain name of the server
machine.
Edit /etc/apache2/apache2.conf:
ServerName <fully qualified domain name>
Enable the URL rewrite modules for Apache and FastCGI
sudo a2enmod rewrite
sudo a2enmod fastcgi
Restart Apache so that the foregoing changes take effect.
sudo service apache2 restart
Enable SSL
Because this sample configuration is targeted at enterprise customers, SSL is configured.
Ensure dependencies are installed.
sudo apt-get install openssl ssl-cert
Enable the SSL module.
sudo a2enmod ssl
Generate a Certificate
sudo mkdir /etc/apache2/ssl
sudo openssl req -x509 -nodes -days 365 -newkey rsa:2048 -keyout /etc/apache2/ssl/apache.key -out
/etc/apache2/ssl/apache.crt
44