Sunday, November 16, 2014

OpenStack Series: Part 16 – Ceph in OpenStack

In the Ceph home page, Ceph is described as a unified, distributed storage system designed for excellent performance, reliability and scalability.
Ceph is a unified, distributed storage system designed for excellent performance, reliability and scalability. - See more at: http://ceph.com/#sthash.eFgRE0CM.dpuf
Ceph is a unified, distributed storage system designed for excellent performance, reliability and scalability. - See more at: http://ceph.com/#sthash.eFgRE0CM.dpuf
Ceph is a unified, distributed storage system designed for excellent performance, reliability and scalability. - See more at: http://ceph.com/#sthash.eFgRE0CM.dpuf
Ceph is a unified, distributed storage system designed for excellent performance, reliability and scalability. - See more at: http://ceph.com/#sthash.eFgRE0CM.dpuf

It is easy to understand distributed but what about unified?

Unified means Ceph is able to deliver object, block and file storage in one system using commodity hardware.  These commodity hardware is usually defined as Node and a cluster is Cluster is a collection of node.

Ceph terminologies can be found in here.

Ceph is an open source Software Defined Storage.  Inktank is the commercial company that delivers enterprise ready Ceph.  Inktank was bought by Red Hat in May 2014.  Dreamhost is also a major contributor to the Ceph open source software.

As a side not Ceph comes from the "cephalopod"Inktank is kind of related to because cephalopod can squirt ink.  Also the management and monitoring system for Ceph is called Calamari.

The attraction of Ceph is its ability to scale with commodity hardware and there is also build-in resiliency/High Availability. 

Ceph is deployed as Storage Clusters in which there is the RADOS (Reliable Autonomic Distributed Object Store) and Ceph software uses CRUSH (Controlled Replication Under Scalable Hashing) to determine how and where to store the data within the storage cluster.


A Ceph Storage Cluster consists of two types of daemons:
A Ceph Monitor maintains a master copy of the cluster map. A cluster of Ceph monitors ensures high availability should a monitor daemon fail. Storage cluster clients retrieve a copy of the
cluster map from the Ceph Monitor.

A Ceph OSD Daemon checks its own state and the state of other OSDs and reports back to monitors.

If CephFS is used there is also the Ceph Metadata Server (MDS).
 
Ceph Architecture
image source: http://ceph.com/docs/master/_images/stack.png

This diagram show that RADOS is the base of a Ceph Storage Cluster.  On top there are
  • LIBRADOS
  • RADOSGW
  • RBD (RADOS Block Device)
  • CephFS

Ceph and OpenStack

Ceph was integrated into OpenStack in the Folsom release.

Being a unified storage provider, Ceph is a storage solution of choice to be used in an OpenStack Infrastructure.

The diagram below shows the how OpenStack interface with Ceph:


image source: http://www.inktank.com/wp-content/uploads/2013/03/Diagram_v3.0_CEEPHOPENTSTACK11-1024x455.png

The Inktank blog has a good description on how Ceph fits into an OpenStack environment:

Block Storage for OpenStack

  • Ceph serves as a native Cinder block provider for images and volumes, and integrates with the virtualization infrastructure to connect the block devices to the VM’s.
  • The Ceph RBD block device (RBD) enables instant thin provisioning and cloning of images and volumes used by OpenStack Nova.
  • This makes booting new VM’s with highly available, fault-tolerant disks fast, easy, and efficient.
  • Volumes can also be cloned from volume snapshots.

Object Storage for OpenStack
  • Ceph Object Gateway (RGW) provides complete compatibility with the Swift API, integrates into Keystone for authentication and can be used as a backend to Glance.
  • Full compatibility with the Amazon S3 API, a more scalable and easier to manage architecture, and the ability to run a single system for object and block,

Ceph at CERN
CERN is a huge nuclear research institute in Europe.  CERN deploy OpenStack in its production environment.  CERN received the "OpenStack Superuser Award" at the OpenStack summit in Paris. Checkout their cloud infrastructure here. Being a research institute, storage is important.  Ceph is being used by CERN for image processing, storing and archiving research data as well as quick data retrieval. It has a 3 PB (petabyte) Ceph Cluster in production.

Note: 1 PB = 1000000000000000B = 1015bytes = 1000terabytes.

image source: https://pbs.twimg.com/media/B0a6e1CCAAED1Pq.png:large


Not exactly a reference architecture of Ceph but with this example we can see that Ceph has a lots of potential to be used along with OpenStack.

Ceph use cases
Ceph runs on the same Linux cluster that KVM is running on.  With OpenStack Heat to autoscale, it has all the right ingredients to be made into a hyperconvergence unit.  Recently Nutanix and Simplivity are gaining momentum in this hyperconvergence space.  One application of hyperconvergence is on VDI (Virtual Desktop Infrastructure) and big data market.

According to Mirantis, OpenStack Sahara is planing to have native Ceph support in the Kilo release.

It seems to me that due the nature of Ceph being able to support object, block and file system storage, it has huge potentials for different application and use cases.

Related Post:
OpenStack Series Part 1: How do you look at OpenStack?
OpenStack Series Part 2: What's new in the Juno Release?
OpenStack Series Part 3: Keystone - Identity Service
OpenStack Series Part 4: Nova - Compute Service
OpenStack Series Part 5: Glance - Image Service
OpenStack Series Part 6: Cinder - Block Storage Service
OpenStack Series Part 7: Swift - Object Storage Service
OpenStack Series Part 8: Neutron - Networking Service
OpenStack Series Part 9: Horizon - a Web Based UI Service
OpenStack Series Part 10: Heat - Orchestration Service
OpenStack Series Part 11: Ceilometer - Monitoring and Metering Service
OpenStack Series Part 12: Trove - Database Service
OpenStack Series Part 13: Docker in OpenStack
OpenStack Series Part 14: Sahara - Data Processing Service
OpenStack Series part 15: Messaging and Queuing System in OpenStack
OpenStack Series Part 17: Congress - Policy Service
OpenStack Series Part 18: Network Function Virtualization in OpenStack
OpenStack Series Part 19: Storage Polices for Object Storage
OpenStack Series Part 20: Group-based Policy for Neutron

Reference:
"Architecture¶." Architecture — Ceph Documentation. N.p., n.d. Web. 31 Oct. 2014.
"Home Ceph." Ceph Home Comments. N.p., n.d. Web. 31 Oct. 2014. 
"Ceph for OpenStack." Inktank Ceph for OpenStack Comments. N.p., n.d. Web. 31 Oct. 2014.

96 comments:

  1. BlueHost is ultimately the best hosting provider with plans for all of your hosting requirements.

    ReplyDelete
  2. Great info. I love all the posts, I really enjoyed, I would like more information about this, because it is very nice., Thanks for sharing...
    AWS Cloud Support in Delhi

    ReplyDelete
  3. Excellent service by the boss. he introduced thai massage Clondalkin himself to us whenever we came in and showed us to the masseurs.

    ReplyDelete
  4. Mau tau lebih lanjut ini situs poker online bakal abdi berikan tutorial.

    ReplyDelete
  5. Terkecuali nama rekening bandarq online terbaik kamu, elemen lain yg mesti.

    ReplyDelete
  6. Di strategi ke username anda itu situs judi online terbaik tentu tersimpul alasan distingtif maka.

    ReplyDelete
  7. Resiko yang sanggup situs judi qq online berlangsung pass lumayan.

    ReplyDelete
  8. Hal yang harus anda lihat bila anda dominoqq ingin terhindar mulai sejak saat.

    ReplyDelete
  9. Di strategi ke username anda itu situs poker online terpercaya tentu tersebut alasan spesial maka.

    ReplyDelete
  10. Penambahan tambah lalu apa yang situs poker online menjadi factor penting lama nya uang kamu.

    ReplyDelete
  11. Jika form stor dana tujuan rekening judi bandarq yang anda isi salah dengan maksud.

    ReplyDelete
  12. Hal yang harus di Persiapkan situs judi terpercaya pada melaksanakan Transaksi.

    ReplyDelete
  13. Jalankan transaksi walaupun daftar pokerpelangi tata krama arta yang tidak seberapa hanya.

    ReplyDelete
  14. Sebab uang anda termuat hanya daftar pelangiqq sanggup di teknik.

    ReplyDelete
  15. Sebab uang anda termuat hanya daftar pelangiqq sanggup di teknik.

    ReplyDelete
  16. Walaupun sebelum mewariskan pernyataan situs mandiriqq ada baiknya kita kenal.

    ReplyDelete
  17. Web yang juga sibuk bagi saat ini daftar sahabatqq lantaran rekening yang terselip.

    ReplyDelete
  18. Maka sejak mulai sejak itu tak website pasarqq sebentar web selalu menghimbaukan.

    ReplyDelete
  19. Bagi persoalan seperti itu anda situs rajawaliqq sudah harus melambatlambatkan.

    ReplyDelete
  20. Anda tidak melakukan re-check ulang website bandarjudiqq resiko yang terjadi yakni.

    ReplyDelete
  21. Beberapa website terkenal tengah kembali yang situs rajaqq sudah hadir di factor online ini.

    ReplyDelete
  22. Yang sudah pernah ihwal memandang mustahak ratuqq sangat lama untuk tuntut deposit saya gar terperoses.

    ReplyDelete
  23. Pada bab seperti itu anda daftar indoqq sudah harus melambatlambatkan.

    ReplyDelete
  24. Uang anda bisa saja dianggap hangus situs asikqq awal pihak situs yang berikat.

    ReplyDelete
  25. Berjalan perihal sejenis agen ahliqq yang tidak kita inginkan.

    ReplyDelete
  26. Yang agung lantaran kalau sebentar website janjiqq saja cema kita pelik cek.

    ReplyDelete
  27. Inilah beberapa kaidah formula daftar ikanqq untuk banyaknya pemain website judi online.

    ReplyDelete
  28. Walau sebelum mewariskan situs mdomino99 pendapat ada baiknya kita kenal.

    ReplyDelete
  29. Yang besar lantaran bila sebentar situs masterdominoqq saja kenistaan kita cenanga cek.

    ReplyDelete
  30. Disitus selama saat dapat diganti situs murahqq kan bersama rekning baru apabila.

    ReplyDelete
  31. Terjadi aspek secorak website championqq yang tidak kita inginkan.

    ReplyDelete
  32. Jalan awal yang harus di lihat situs jadiqq adalah nama rekening yang kumplit.

    ReplyDelete
  33. Looking for a reliable printer service provider, dial the toll-free number of Epson printer customer support. The technicians will provide you with assistance for all technical issues related to the Epson printer.
    daftar mejaqq
    daftar rajaqq
    daftar kristalpoker
    daftar qiuqiu99
    daftar taipanqq
    daftar nagaqq
    daftar jaguarqq
    daftar sahabatpoker
    daftar hondaqq
    daftar bcaqq

    ReplyDelete
  34. Nadapoker merupakan situs poker99 online uang asli terbaik Indonesia yang terpercaya dengan beragam permainan seperti judi poker online Indonesia.

    ReplyDelete
  35. ICN Group: Situs Judi Online terbaik dan terlengkap dengan permainan Sportbook, Live Casino, Slot Machine. IDN POKER dan IDN LIVE

    Situs Judi Online
    Daftar Situs Judi Online
    Poker Online
    Agen Bola Terpercaya
    Judi Online Terpercaya
    Situs Judi Online Terbaik

    Situs Poker online terbaik yang memiliki permainan Texas Hold'em Ceme, Ceme Keliling, Capsa, Super 10, Omaha

    Poker Online Indonesia
    Poker Online
    Domino
    Ceme Keliling
    Capsa
    Super 10
    Omaha
    Daftar Poker Online
    Agen Poker Terpercaya

    Situs Togel Online terpercaya yang lengkap dengan prediksi yang dapat membantu anda dalam menuju Jackpot

    4D/3D/2D
    Colok Bebas
    Colok Naga
    Colok Jitu
    Tengah Tepi
    Kombinasi
    Dasar
    50-50
    Shio
    Silang Homo
    Kembang Kempis
    24D
    Roulette
    Sicbo
    12D Games
    Head&Tail
    Oglok
    Dice 6
    Red/White
    Billiards
    Poker Dice
    Gong Ball
    Suwit
    Monopoly

    ICNPRODUK
    EpicBigWin

    ReplyDelete
  36. Begitulah kata paling popular saat ini, dimana saat ini memang dibutuhkan adanya semangat kehidupan yang mengairahkan seperti contoh-contoh dibawah ini:
    lapakqq
    mainqq
    indoqq
    rajacapsa
    megapoker99
    janjiqq
    jempolqq
    hebatqq
    agenqq
    intanqq

    ReplyDelete
  37. Begitulah kata mereka tentang perkembangan di negeri tercinta ini. tapi apa daya jika hanya memberikan komentar daripada solusi. Tetapi kami juga bisa menyediakan beberapa solusi terbaik seperti berikut ini:
    kebunpoker
    amanqq
    lipoqq
    maniaqq
    redmiqq
    wargaqq
    rantaiqq
    galeriqq
    ratucapsa
    jasaqq

    ReplyDelete
  38. Begitulah suara yang kedengaran dari jauh nan disana, seperti suara petir menggelegar di saat hujan deras dan begitu jugalah yang terjadi pada negeri tercinta ini. Untuk itu kami memiliki beberapa saran dari kami seperti berikut ini:
    sahabatpoker
    saranapoker
    idrpoker
    kompasqq
    senangpoker
    elangqq
    pokermas99
    wayangpoker
    sahabatqq
    interqq

    ReplyDelete
  39. kata orang orang negara ini sudah menuju kehancuran, namun tidak begitu bagiku. Karena negara ini sedang berevolusi menjadi sebuah negara yang hebat dan mengerikan seperti dibawah ini:
    jokerqq
    coklatqq
    langitqq
    omiqq
    69qiuqiu
    maindomino99
    ladangqq
    parisqq
    meja365
    ikanqq

    ReplyDelete
  40. Situs Judi Online Terpercaya Yang Ada Sejak Tahun 2015 Memberikan Berbagai Kenyamanan Dan Menjadi situs yang terpercaya
    zumaqq
    galeriqq
    cdrqq
    nagaqq
    kompasqq
    taipanqq
    daftar boyaqq

    ReplyDelete
  41. Situs Pkv games terbaik yang menyediakan permainan bandarq maupun poker qq online dengan bonus turnover terbesar
    pusatqq
    incarqq
    bisaqq
    komisiqq
    danaqq
    wargaqq
    janjiqq
    akuqq

    ReplyDelete
  42. situs poker online aman terpercaya dengan uang asli indonesia
    laguqq
    idrpoker
    boyaqq
    playerqq

    ReplyDelete
  43. Armaniqq merupakan situs agen qq online yang memberikan permainan terbaik dominoqq, daftar link alternatif armaniqq gratis.

    ReplyDelete
  44. Prediksi togel hongķong dan togel singapore Akurat 100% dan Arti Tafsir Mimpi

    https://www.klik4d.biz/prediksi-togel-akurat-sgp-tanggal-20-januari-2020/

    https://www.klik4d.biz/prediksi-togel-akurat-hk-tanggal-19-januari-2020/

    INFO Pendaftaran Togel : http://159.89.197.59/register/
    INFO Prediksi Togel : https://www.klik4d.site

    Agen Togel BOLAVITA
    BONUS POTONGAN GAMES TOGEL ONLINE

    PERMAINAN TOGEL KLIK4D :
    2D = 29,25%
    3D = 59,25%
    4D = 66%

    PERMAINAN TOGEL Isin4D :
    2D = 30%
    3D = 59%
    4D = 66%

    Bolavita Sekarang Bisa Deposit Via OVO & GO-Pay.
    Sekarang Bosku Sudah Bisa Deposit Via Pulsa XL & TSEL Minimal Deposit 25rb.

    Boss Juga Bisa Kirim Via :
    Telegram : +62812-2222-995
    Wechat : Bolavita
    WA : +62812-2222-995
    Line : cs_bolavita

    ReplyDelete
  45. Daftar Togel Online dewatogel website agen Judi Togel Online terpercaya. togelrakyat menyediakan pasaran togel resmi Singapore, Hongkong, Sydney, Cambodia, Jakarta , Sing45 toto macau, China Pools, Bullseye, Saigon toto, Pcso.Kualitas dari agen casino online togelrakyat tidak usah diragukan lagi, karena telah dijamin oleh komunitas togel online SGP HK. Bermain di togelrakyat adalah pilihan yang tepat bagi para pecinta judi togel online di Indonesia.juga ada permainan live casino seperti baccarat , rollate , dice atau dadu dan dragon tiger masih banyak lagi anda juga bisa Nonton Anime di Diaboros Anime.

    ReplyDelete
  46. PERMAINAN ONLINE TERBESAR DI INDONESIA

    Website paling ternama dan paling terpercaya di Asia ^^
    Sistem pelayanan 24 Jam Non-Stop bersama dengan CS Berpengalaman respon tercepat :)
    Memiliki 9 Jenis game yang sangat digemari oleh seluruh peminat poker / domino

    Permainan Judi online yang menggunakan uang asli dan mendapatkan uang asli ^^
    * Minimal Deposit : 20.000
    * Minimal Withdraw : 20.000
    * Deposit dan Withdraw 24 jam Non stop ( Kecuali Bank offline / gangguan )
    * Bonus REFFERAL 15 % Seumur hidup tanpa syarat
    * Bonus ROLLINGAN 0.3 % Dibagikan 5 hari 1 kali
    * Proses Deposit & Withdraw PALING CEPAT
    * Sistem keamanan Terbaru & Terjamin
    * Poker Online Terpercaya
    * Live chat yang Responsive
    * Support lebih banyak bank LOKAL


    Contact Us

    Website : SahabatQQ
    WA 1 : +85515769793
    WA 2 : +855972076840
    LINE : SAHABATQQ
    FACEBOOK : SahabatQQ Reborn
    TWITTER : SahabatQQ
    Blog : Artikel SahabatQQ
    Daftar SahabatQQ

    ReplyDelete
  47. AGENS128 Adalah Situs Judi Online Taruhan Sepak Bola, Casino, Sabung Ayam, Tangkas, Togel & Poker Terpopuler di Indonesia
    Pasang Taruhan Online Melalui Agen Judi Terpercaya Indonesia Agens128, Proses Cepat, Banyak Bonus, Online 24 Jam dan Pasti Bayar!
    Sabung ayam
    sbobet online
    casino online
    tembak ikan
    daftar bisa langsung ke:
    LINE : agens1288
    WhatsApp : 085222555128

    ReplyDelete
  48. situs terpercaya poker online PKV GAMES terbaru dan terpercaya serta gampang menang. buruan gabung dengan jutaan Jackpot sudah menanti

    ReplyDelete
  49. Situs Deposit Pulsa menyediakan support deposit pulsa via XL, Telkomsel dan Axis. Jadi bagi yang memiliki janis kartu tersebut bisa digunakan bermain di dalam situs poker online MiyaQQ.

    ReplyDelete
  50. Mau Dapatkan Uang Dengan Mudah...
    Yuk join bersama Rajabandarq Situs Bandarq, DominoQQ, Poker Online terbaik di asia dengan 9 game yang paling seru...

    Buruan Daftar Disini >>> Daftar Rajabandarq
    Klik Disini : Situs BandarQ
    Klik Disini : Poker Online

    Baca juga :

    - Blogger : 24berita harian
    - Blogger : Kisahselebindo
    - Blogger : myrenew22
    - Blogger : Panduan Bermain Game Judi Online
    - Blogger : Seputar Dunia

    ReplyDelete
  51. MEJAQQ: AGEN JUDI POKER DOMINOQQ BANDARQ ONLINE TERBESAR DI ASIA

    Yang Merupakan Agen Judi Poker DominoQQ BandarQ Online Terbesar di Asia Hadir Untuk Anda Semua Dengan Games dan Bonus Yang Menarik!

    Bonus yang Kami Berikan di MEJAQQ :
    * Bonus Rollingan 0.5% Kali 2
    * Bonus Referral 10% + 10% Seumur Hidup (X-tra Untuk Para Pencari Bonus Referral di Indonesia)
    * Dan Masih Banyak Bonus Menarik Lainnya yang Bisa Anda Dapatkan di MEJAQQ!
    *Dan Kami Juga Menyediakan Deposit Pulsa Tanpa Adanya Potongan Pulsa!
    Buruan Kunjungi Sekarang Juga ^^

    9 Games Yang di Hadirkan MEJAQQ:
    *- POKER
    *- DOMINO QQ
    *- CAPSA SUSUN
    *- BANDAR POKER
    *- BANDAR Q
    *- BANDAR 66
    *- SAKONG
    *- ADU Q
    *- PERANG BACCARAT

    Info Lebih lanjut Kunjungi :
    Website : Mejayes(.)org
    Line : Mejaqq_official
    WA 1 : +85515620767
    TELEGRAM : +85515620767

    Kunjungi Juga situs kami di :
    MEJAQQ
    MEJAYES
    BANDARQ ONLINE
    QQ ONLINE
    Informasi Terbaru
    SITUS BANDARQ

    ReplyDelete
  52. Mau Dapatkan Uang Dengan Mudah...
    Yuk join bersama Rajabandarq Situs Bandarq, DominoQQ, Poker Online terbaik di asia dengan 9 game yang paling seru...

    Buruan Daftar Disini >>> Daftar Rajabandarq
    Klik Disini : Situs BandarQ
    Klik Disini : Poker Online

    Baca juga :

    - Blogger : 24berita harian
    - Blogger : Kisahselebindo
    - Blogger : myrenew22
    - Blogger : Panduan Bermain Game Judi Online
    - Blogger : Seputar Dunia

    ReplyDelete
  53. SahabatQQ: Agen DominoQQ Agen Domino99 dan Poker Online Aman dan Terpercaya
    Website SahabatQQ
    WA 1 : +855887159498
    WA 2 : +855972076840
    Telegram 1 :+85515769793
    Telegram 2 : +855972076840
    LINE : SAHABATQQWIN
    FACEBOOK : SahabatQQ Reborn
    Agen Domino99

    ReplyDelete
  54. yakin gamau bergabung di Bandar Togel Online kingdomgrup? banyak bonus loh

    ReplyDelete
  55. Idn89 merupakan situs tempat bagi para penggemar yang ingin bermain Slot Online Deposit Pulsa Tanpa Potongan yang tentunya bisa dimainkan dengan sangat mudah dan dimanapun kapanpun kalian inginkan hanya dengan smartphone yang sudah didukung dengan android & IOS bisa langsung mengunjungi situs Slot Pulsa Tanpa Potongan yang sudah terpercaya melalui link https://188.166.252.208

    ReplyDelete
  56. Markas 138 Bandar Slot Online | Situs Bola Terpercaya Di Indonesia | BET | Promo New Member 150%

    ReplyDelete
  57. Daftar Online Game pembawa hoki dalam keseharian | JOIN GROUP | Promo New Member 150%

    ReplyDelete
  58. Gebyar123 adalah situs betting online terbaik dan terpercaya yang terbukti mudah menang.

    ReplyDelete
  59. This comment has been removed by the author.

    ReplyDelete
  60. PLEASE VISIT MY WEBSITE GUYS I HAVE SOMETHING FOR YOU CUAN123

    ReplyDelete
  61. HELLO GUYS PLEASE HELP ME VISIT MY AMAZING WEBSITE GUYS I HAVE SOMETHING FOR YOU CUAN123 AGEN GACOR

    ReplyDelete