How to Configure AWS CLI for Ceph Object Gateway Storage

 How can I configure AWS s3 CLI for Ceph Storage?. The Ceph Object Gateway is an object storage interface built on top of librados to provide applications with a RESTful gateway to Ceph Storage Clusters. The Ceph Object Gateway daemon (radosgw) is an HTTP server for interacting with a Ceph Storage Cluster. It provides interfaces compatible with both OpenStack Swift and Amazon S3 and has embedded user management.

Ceph Object Storage has support for two interfaces.

1. S3-compatible: Provides object storage functionality with an interface that is compatible with a large subset of the Amazon S3 RESTful API.
2. Swift-compatible: Provides object storage functionality with an interface that is compatible with a large subset of the OpenStack Swift API.

In this guide, we’ll focus on configuring Amazon S3 CLI to work with Ceph Object Storage cluster. This will be helpful for automated personal backups and pushing your Server data & configurations to Ceph Object store.

Step 1: Install AWS CLI

We need to install the AWS CLI on the server or machine where access to Ceph Object Gateway will be done.

Follow our guide below to install AWS CLI:

Verify installation: $ aws --version

Step 2: Create Object Store User for S3 Access

A user should be created on the Ceph Object Store backend. This will generate S3 API credentials that we’ll configure AWS S3 CLI to use.

Run the commands in one of your Ceph cluster nodes with access to the cluster for administration.

Where:

• cephuser is the name of the user to be created.
• ceph S3User is the user display names

This is the sample output from the command.

Take note of the access_key and the secret_key.

Step 3: Using AWS CLI for Accessing Ceph Object Storage

Before you can start using AWS CLI tool to interact with AWS services, you need to configure it by running the aws configure command.

Paste the access key and Secret key you copied in previous step. The credentials are written to file ~/.aws/credentials.

Configuration file is located in ~/.aws/config.

You need to have the IP address of one of your Rados Gateway nodes or equivalent DNS name configured. Get a list of rgw servers using the command:

In my setup, I have three rgw servers. I’ll use one of them – servera.rgw0, whose URL is http://10.9.204.225:8080

The command will create a bucket called test. The creation can be confirmed using the command radosgw-admin.

You can list the buckets created with the command:

Copy a test file to the bucket:

Confirm if the file has been uploaded.

You can confirm the same from the Ceph Dashboard under Object Gateway > Buckets section.