Minio Cluster: Amazon S3 Compatible Object Storage with Unispace PaaS

By 28. 7. 2018 Containers

Minio is a cost-effective object storage, fully compatible with Amazon S3 (Simple Storage Service). This solution is best suited for storing unstructured data, such as photos, videos, log files, etc. It can be used to support a wide range of use cases, including data archiving, big data analytics, backup and disaster recovery.

Minio implements a microstorage architecture to create a cluster (by provisioning a large number of small interconnected storage instances) and ensure its scalability and high availability. Alongside with this, integration of the commonly used within mass storage systems Reed-Solomon error correction coding mechanism allows to maintain cluster operability and ensures full data restoration even in a case the half of available Minio instances fail.

Below, we provide a step-by-step guide on how such clustered storage solution can be installed within Unispace Cloud in just a few clicks due to the embedded possibility of the advanced processes automation. Also, we’ll show how to manage Minio via both user-friendly web interface and through the dedicated console application, ending up with a brief exploration of the presented solution cost-efficiency.

So, without further ado, let’s get started!

Minio Cloud Storage Cluster Installation

With the help of specially developed Jelastic one-click installation Minio Cluster package, you are able to create the required number of Minio docker containers all at once, with them being automatically interconnected into a reliable S3-compatible storage. This way, all you need to do in order to get your own object storage cluster up and running inside the cloud, is to execute a few simple steps, described below.

1. So, enter your Unispace dashboard at the chosen platform and click Marketplace at the top tools pane to find the Minio Cluster solution.

Click on the Install button to proceed.

2. In a few seconds, you’ll be shown the corresponding installation form.

Here you need to specify the required parameters for your clustered data storage through filling in the following fields:

  • Number of nodes – specify the required cluster size by choosing among the predefined options to create 1 (for development), 4, 8 or 16 Minio nodes – each of them will be handled in a separate container, which are distributed across available hardware servers to gain high availability
  • Environment – type in the preferred name for your Minio storage cluster (which, together with your platform domain, will constitute an internal environment name)
  • Display Name – optionally, add an alias name to be displayed for the environment in the dashboard

When ready, Install the package by clicking on the same-named button at the bottom-right corner.

3. Wait a few minutes for Unispace to automatically create and set up your cluster. Once this operation is completed, the system will inform you about the successful installation by displaying the corresponding pop-up frame.

Here, you’ll see the Admin Panel access URL (click Open in browser for a quick redirect) and automatically generated credentials (Access Key and Secret Key), which will be needed for further authentication.

4. Upon referring to the environment start page, a new tab will be opened, where you need to specify your Access and Secret keys for entrance.

Note: In case you’ve occasionally closed the success pop-up without copying the keys, both of them can be found in the .minio > config.json file or within the appropriate email notification, received after the package deployment.

5. Now, you can manage your files with the help of a user-friendly web interface. For example, use the + button at the bottom-right corner to create a new bucket and upload the needed files to the storage.

Note: The default cluster settings assume that connection to your Minio cluster is established via Jelastic Shared Load Balancer. Within the majority of Jelastic platforms, this infrastructure element has a restriction on the uploaded file size – up to 512 MB. So, in order to operate with larger files, you’ll need to attach a Public IP address to at least one of your cluster nodes:

Herewith, adding Public IP provides some extra possibilities – for example, you can bound a custom domain name to the received address and secure connection to your cluster by generating and attaching the appropriate domain-associated custom SSL certificate.

That’s it! Now your reliable storage cluster is up and ready-to-work.

Leave a Reply