Sunday, November 16, 2014

OpenStack Series: Part 16 – Ceph in OpenStack

In the Ceph home page, Ceph is described as a unified, distributed storage system designed for excellent performance, reliability and scalability.
Ceph is a unified, distributed storage system designed for excellent performance, reliability and scalability. - See more at: http://ceph.com/#sthash.eFgRE0CM.dpuf
Ceph is a unified, distributed storage system designed for excellent performance, reliability and scalability. - See more at: http://ceph.com/#sthash.eFgRE0CM.dpuf
Ceph is a unified, distributed storage system designed for excellent performance, reliability and scalability. - See more at: http://ceph.com/#sthash.eFgRE0CM.dpuf
Ceph is a unified, distributed storage system designed for excellent performance, reliability and scalability. - See more at: http://ceph.com/#sthash.eFgRE0CM.dpuf

It is easy to understand distributed but what about unified?

Unified means Ceph is able to deliver object, block and file storage in one system using commodity hardware.  These commodity hardware is usually defined as Node and a cluster is Cluster is a collection of node.

Ceph terminologies can be found in here.

Ceph is an open source Software Defined Storage.  Inktank is the commercial company that delivers enterprise ready Ceph.  Inktank was bought by Red Hat in May 2014.  Dreamhost is also a major contributor to the Ceph open source software.

As a side not Ceph comes from the "cephalopod"Inktank is kind of related to because cephalopod can squirt ink.  Also the management and monitoring system for Ceph is called Calamari.

The attraction of Ceph is its ability to scale with commodity hardware and there is also build-in resiliency/High Availability. 

Ceph is deployed as Storage Clusters in which there is the RADOS (Reliable Autonomic Distributed Object Store) and Ceph software uses CRUSH (Controlled Replication Under Scalable Hashing) to determine how and where to store the data within the storage cluster.


A Ceph Storage Cluster consists of two types of daemons:
A Ceph Monitor maintains a master copy of the cluster map. A cluster of Ceph monitors ensures high availability should a monitor daemon fail. Storage cluster clients retrieve a copy of the
cluster map from the Ceph Monitor.

A Ceph OSD Daemon checks its own state and the state of other OSDs and reports back to monitors.

If CephFS is used there is also the Ceph Metadata Server (MDS).
 
Ceph Architecture
image source: http://ceph.com/docs/master/_images/stack.png

This diagram show that RADOS is the base of a Ceph Storage Cluster.  On top there are
  • LIBRADOS
  • RADOSGW
  • RBD (RADOS Block Device)
  • CephFS

Ceph and OpenStack

Ceph was integrated into OpenStack in the Folsom release.

Being a unified storage provider, Ceph is a storage solution of choice to be used in an OpenStack Infrastructure.

The diagram below shows the how OpenStack interface with Ceph:


image source: http://www.inktank.com/wp-content/uploads/2013/03/Diagram_v3.0_CEEPHOPENTSTACK11-1024x455.png

The Inktank blog has a good description on how Ceph fits into an OpenStack environment:

Block Storage for OpenStack

  • Ceph serves as a native Cinder block provider for images and volumes, and integrates with the virtualization infrastructure to connect the block devices to the VM’s.
  • The Ceph RBD block device (RBD) enables instant thin provisioning and cloning of images and volumes used by OpenStack Nova.
  • This makes booting new VM’s with highly available, fault-tolerant disks fast, easy, and efficient.
  • Volumes can also be cloned from volume snapshots.

Object Storage for OpenStack
  • Ceph Object Gateway (RGW) provides complete compatibility with the Swift API, integrates into Keystone for authentication and can be used as a backend to Glance.
  • Full compatibility with the Amazon S3 API, a more scalable and easier to manage architecture, and the ability to run a single system for object and block,

Ceph at CERN
CERN is a huge nuclear research institute in Europe.  CERN deploy OpenStack in its production environment.  CERN received the "OpenStack Superuser Award" at the OpenStack summit in Paris. Checkout their cloud infrastructure here. Being a research institute, storage is important.  Ceph is being used by CERN for image processing, storing and archiving research data as well as quick data retrieval. It has a 3 PB (petabyte) Ceph Cluster in production.

Note: 1 PB = 1000000000000000B = 1015bytes = 1000terabytes.

image source: https://pbs.twimg.com/media/B0a6e1CCAAED1Pq.png:large


Not exactly a reference architecture of Ceph but with this example we can see that Ceph has a lots of potential to be used along with OpenStack.

Ceph use cases
Ceph runs on the same Linux cluster that KVM is running on.  With OpenStack Heat to autoscale, it has all the right ingredients to be made into a hyperconvergence unit.  Recently Nutanix and Simplivity are gaining momentum in this hyperconvergence space.  One application of hyperconvergence is on VDI (Virtual Desktop Infrastructure) and big data market.

According to Mirantis, OpenStack Sahara is planing to have native Ceph support in the Kilo release.

It seems to me that due the nature of Ceph being able to support object, block and file system storage, it has huge potentials for different application and use cases.

Related Post:
OpenStack Series Part 1: How do you look at OpenStack?
OpenStack Series Part 2: What's new in the Juno Release?
OpenStack Series Part 3: Keystone - Identity Service
OpenStack Series Part 4: Nova - Compute Service
OpenStack Series Part 5: Glance - Image Service
OpenStack Series Part 6: Cinder - Block Storage Service
OpenStack Series Part 7: Swift - Object Storage Service
OpenStack Series Part 8: Neutron - Networking Service
OpenStack Series Part 9: Horizon - a Web Based UI Service
OpenStack Series Part 10: Heat - Orchestration Service
OpenStack Series Part 11: Ceilometer - Monitoring and Metering Service
OpenStack Series Part 12: Trove - Database Service
OpenStack Series Part 13: Docker in OpenStack
OpenStack Series Part 14: Sahara - Data Processing Service
OpenStack Series part 15: Messaging and Queuing System in OpenStack
OpenStack Series Part 17: Congress - Policy Service
OpenStack Series Part 18: Network Function Virtualization in OpenStack
OpenStack Series Part 19: Storage Polices for Object Storage
OpenStack Series Part 20: Group-based Policy for Neutron

Reference:
"Architecture¶." Architecture — Ceph Documentation. N.p., n.d. Web. 31 Oct. 2014.
"Home Ceph." Ceph Home Comments. N.p., n.d. Web. 31 Oct. 2014. 
"Ceph for OpenStack." Inktank Ceph for OpenStack Comments. N.p., n.d. Web. 31 Oct. 2014.

54 comments:

  1. Excellent service by the boss. he introduced thai massage Clondalkin himself to us whenever we came in and showed us to the masseurs.

    ReplyDelete
  2. Mau tau lebih lanjut ini situs poker online bakal abdi berikan tutorial.

    ReplyDelete
  3. Terkecuali nama rekening bandarq online terbaik kamu, elemen lain yg mesti.

    ReplyDelete
  4. Di strategi ke username anda itu situs judi online terbaik tentu tersimpul alasan distingtif maka.

    ReplyDelete
  5. Resiko yang sanggup situs judi qq online berlangsung pass lumayan.

    ReplyDelete
  6. Hal yang harus anda lihat bila anda dominoqq ingin terhindar mulai sejak saat.

    ReplyDelete
  7. Di strategi ke username anda itu situs poker online terpercaya tentu tersebut alasan spesial maka.

    ReplyDelete
  8. Penambahan tambah lalu apa yang situs poker online menjadi factor penting lama nya uang kamu.

    ReplyDelete
  9. Jika form stor dana tujuan rekening judi bandarq yang anda isi salah dengan maksud.

    ReplyDelete
  10. Hal yang harus di Persiapkan situs judi terpercaya pada melaksanakan Transaksi.

    ReplyDelete
  11. Jalankan transaksi walaupun daftar pokerpelangi tata krama arta yang tidak seberapa hanya.

    ReplyDelete
  12. Sebab uang anda termuat hanya daftar pelangiqq sanggup di teknik.

    ReplyDelete
  13. Sebab uang anda termuat hanya daftar pelangiqq sanggup di teknik.

    ReplyDelete
  14. Walaupun sebelum mewariskan pernyataan situs mandiriqq ada baiknya kita kenal.

    ReplyDelete
  15. Web yang juga sibuk bagi saat ini daftar sahabatqq lantaran rekening yang terselip.

    ReplyDelete
  16. Maka sejak mulai sejak itu tak website pasarqq sebentar web selalu menghimbaukan.

    ReplyDelete
  17. Bagi persoalan seperti itu anda situs rajawaliqq sudah harus melambatlambatkan.

    ReplyDelete
  18. Anda tidak melakukan re-check ulang website bandarjudiqq resiko yang terjadi yakni.

    ReplyDelete
  19. Beberapa website terkenal tengah kembali yang situs rajaqq sudah hadir di factor online ini.

    ReplyDelete
  20. Yang sudah pernah ihwal memandang mustahak ratuqq sangat lama untuk tuntut deposit saya gar terperoses.

    ReplyDelete
  21. Pada bab seperti itu anda daftar indoqq sudah harus melambatlambatkan.

    ReplyDelete
  22. Uang anda bisa saja dianggap hangus situs asikqq awal pihak situs yang berikat.

    ReplyDelete
  23. Berjalan perihal sejenis agen ahliqq yang tidak kita inginkan.

    ReplyDelete
  24. Yang agung lantaran kalau sebentar website janjiqq saja cema kita pelik cek.

    ReplyDelete
  25. Inilah beberapa kaidah formula daftar ikanqq untuk banyaknya pemain website judi online.

    ReplyDelete
  26. Walau sebelum mewariskan situs mdomino99 pendapat ada baiknya kita kenal.

    ReplyDelete
  27. Yang besar lantaran bila sebentar situs masterdominoqq saja kenistaan kita cenanga cek.

    ReplyDelete
  28. Disitus selama saat dapat diganti situs murahqq kan bersama rekning baru apabila.

    ReplyDelete
  29. Terjadi aspek secorak website championqq yang tidak kita inginkan.

    ReplyDelete
  30. Jalan awal yang harus di lihat situs jadiqq adalah nama rekening yang kumplit.

    ReplyDelete
  31. Nadapoker merupakan situs poker99 online uang asli terbaik Indonesia yang terpercaya dengan beragam permainan seperti judi poker online Indonesia.

    ReplyDelete
  32. Begitulah kata mereka tentang perkembangan di negeri tercinta ini. tapi apa daya jika hanya memberikan komentar daripada solusi. Tetapi kami juga bisa menyediakan beberapa solusi terbaik seperti berikut ini:
    kebunpoker
    amanqq
    lipoqq
    maniaqq
    redmiqq
    wargaqq
    rantaiqq
    galeriqq
    ratucapsa
    jasaqq

    ReplyDelete
  33. Begitulah suara yang kedengaran dari jauh nan disana, seperti suara petir menggelegar di saat hujan deras dan begitu jugalah yang terjadi pada negeri tercinta ini. Untuk itu kami memiliki beberapa saran dari kami seperti berikut ini:
    sahabatpoker
    saranapoker
    idrpoker
    kompasqq
    senangpoker
    elangqq
    pokermas99
    wayangpoker
    sahabatqq
    interqq

    ReplyDelete
  34. kata orang orang negara ini sudah menuju kehancuran, namun tidak begitu bagiku. Karena negara ini sedang berevolusi menjadi sebuah negara yang hebat dan mengerikan seperti dibawah ini:
    jokerqq
    coklatqq
    langitqq
    omiqq
    69qiuqiu
    maindomino99
    ladangqq
    parisqq
    meja365
    ikanqq

    ReplyDelete
  35. Situs Pkv games terbaik yang menyediakan permainan bandarq maupun poker qq online dengan bonus turnover terbesar
    pusatqq
    incarqq
    bisaqq
    komisiqq
    danaqq
    wargaqq
    janjiqq
    akuqq

    ReplyDelete
  36. situs poker online aman terpercaya dengan uang asli indonesia
    laguqq
    idrpoker
    boyaqq
    playerqq

    ReplyDelete
  37. Armaniqq merupakan situs agen qq online yang memberikan permainan terbaik dominoqq, daftar link alternatif armaniqq gratis.

    ReplyDelete
  38. Prediksi togel hongķong dan togel singapore Akurat 100% dan Arti Tafsir Mimpi

    https://www.klik4d.biz/prediksi-togel-akurat-sgp-tanggal-20-januari-2020/

    https://www.klik4d.biz/prediksi-togel-akurat-hk-tanggal-19-januari-2020/

    INFO Pendaftaran Togel : http://159.89.197.59/register/
    INFO Prediksi Togel : https://www.klik4d.site

    Agen Togel BOLAVITA
    BONUS POTONGAN GAMES TOGEL ONLINE

    PERMAINAN TOGEL KLIK4D :
    2D = 29,25%
    3D = 59,25%
    4D = 66%

    PERMAINAN TOGEL Isin4D :
    2D = 30%
    3D = 59%
    4D = 66%

    Bolavita Sekarang Bisa Deposit Via OVO & GO-Pay.
    Sekarang Bosku Sudah Bisa Deposit Via Pulsa XL & TSEL Minimal Deposit 25rb.

    Boss Juga Bisa Kirim Via :
    Telegram : +62812-2222-995
    Wechat : Bolavita
    WA : +62812-2222-995
    Line : cs_bolavita

    ReplyDelete
  39. Daftar Togel Online dewatogel website agen Judi Togel Online terpercaya. togelrakyat menyediakan pasaran togel resmi Singapore, Hongkong, Sydney, Cambodia, Jakarta , Sing45 toto macau, China Pools, Bullseye, Saigon toto, Pcso.Kualitas dari agen casino online togelrakyat tidak usah diragukan lagi, karena telah dijamin oleh komunitas togel online SGP HK. Bermain di togelrakyat adalah pilihan yang tepat bagi para pecinta judi togel online di Indonesia.juga ada permainan live casino seperti baccarat , rollate , dice atau dadu dan dragon tiger masih banyak lagi anda juga bisa Nonton Anime di Diaboros Anime.

    ReplyDelete
  40. yakin gamau bergabung di Bandar Togel Online kingdomgrup? banyak bonus loh

    ReplyDelete
  41. Markas 138 Bandar Slot Online | Situs Bola Terpercaya Di Indonesia | BET | Promo New Member 150%

    ReplyDelete
  42. Daftar Online Game pembawa hoki dalam keseharian | JOIN GROUP | Promo New Member 150%

    ReplyDelete
  43. This comment has been removed by the author.

    ReplyDelete
  44. HELLO GUYS PLEASE HELP ME VISIT MY AMAZING WEBSITE GUYS I HAVE SOMETHING FOR YOU CUAN123 AGEN GACOR

    ReplyDelete
  45. Very happy with articles like this. Greetings from Kilat188 The Best and Most Trusted Online Gambling Site in Indonesia 2024........KILAT188

    ReplyDelete
  46. Berlian178 is the most popular and best slot agent in Indonesia that presents the most complete games, easy to win with live RTP. The deposit system is cheap and practical and can be accessed on all gadgets anytime and anywhere.

    ReplyDelete