第2回NHNテクノロジーカンファレンスで発表した資料ですー。 References: LINE Storage: Storing billions of rows in Sharded-Redis and HBase per Month (http://tech.naver.jp/blog/?p=1420), I posted this entry in 2012.3.
![HBase at LINE](https://cdn-ak-scissors.b.st-hatena.com/image/square/455cc317ff524308dfe945f0ed95d448c3ee10d3/height=288;version=1;width=512/https%3A%2F%2Fcdn.slidesharecdn.com%2Fss_thumbnails%2Fhbaseatline-120818085611-phpapp01-thumbnail.jpg%3Fwidth%3D640%26height%3D640%26fit%3Dbounds)
Even if the Yfrog presentation on their usage of HBase has only 9 slides, you’ll find some very interesting notes in there. Here’s a couple that caught my eyes: 10k concurrent requests/second4 HBase clusters ranging from 50TB to 1PBHaving more smaller nodes is better than having less faster bigger nodesWe use sub $1k desktop grade servers, they work great![1]Inexpensive 2TB Hitachi disks (~$100) w
1 Yahoo! Cloud Serving Benchmark Overview and results - January 29, 2010 Brian F. Cooper cooperb@yahoo-inc.com Joint work with Adam Silberstein, Erwin Tam, Raghu Ramakrishnan and Russell Sears System setup and tuning assistance from members of the Cassandra and HBase committers, and the Sherpa engineering team 2 Motivation • There are many “cloud DB” and “nosql” systems out there – Sherpa/PNUTS –
Hadoop and HBase vs RDBMSの超適当翻訳メモ Hadoop/HBase vs. RDBMS December CTO Forum Jonathan Gray Streamy.com プロフィール ・Streamy.comの共同創業者 ・経歴(経験):コンピュータエンジニアリング、分散/耐障害性アプリケーション、リレーショナルデータベース、Linux ・2008年6月にStreamy.comのバックエンドをPostgreSQL からHadoop/Hbaseに移行に成功 なぜHadoop/Hbaseなのか ・データがペタバイトまで大きくなった ・従来のデータベースは拡張するのにお金がかかるし、本質的に分散化が難しい ・一般的なハードウェアは安くてパワフル - 1000ドル(?)で4core/4GB/1TB - 300GB 15k RPM SAS が500ドルぐらい ・ラン
We are marching along in our integration of HBase with the Socorro Crash Stats project, but I wanted to take a minute away from that to talk about a separate project the Metrics team has also been involved with. Mozilla Labs Test Pilot is a project to experiment and analyze data from real world Firefox users to discover quantifiable ways to improve our user experience. I was very interested and e
Distributed, scalable databases are desperately needed these days. From building massive data warehouses at a social media startup, to protein folding analysis at a biotech company, “Big Data” is becoming more important every day. While Hadoop has emerged as the de facto standard for handling big data problems, there are still quite a few distributed databases out there and each has their unique s
Hi folks, We have been conducting a performance study comparing Cassandra and HBase (and Yahoo! PNUTS and MySQL) on identical hardware under identical workloads. Our focus has been on serving workloads (e.g. read and write individual records, rather than scan a whole table for MapReduce.) This is part of a larger effort to develop a benchmark for these kinds of systems (which we are calling YCSB,
Occasionally useful posts about RIAs, Web scale computing & miscellanea My team is currently working on a brand new product – the forthcoming MMO www.FightMyMonster.com. This has given us the luxury of building against a NOSQL database, which means we can put the horrors of MySQL sharding and expensive scalability behind us. Recently a few people have been asking why we seem to have changed our pr
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
処理を実行中です
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く