I’ve been having a great week so far at OSCON. Excellent talks from Riak, Facebook, 10gen, DataStax, Acunu, StumbleUpon, etc….
Uploading slides from my talk here..
OSCON Data 2011 — NoSQL @ Netflix, Part 2 View more presentations from Sid Anand
]
For some workloads, they achieve 2 orders of magnitude better latency results relative to a vanilla Cassandra distribution. This is achieved through a combination of SSDs and a new data structure (Stratified B-tree).
Acunu White paper. http://bit.ly/jQc423
Short Blog entries on Cassandra performance
http://bit.ly/mUqWLO Cassandra under heavy write load, Part 1
http://bit.ly/mMT0Ts Cassandra under heavy write load, Part 2
Remembering B-trees http://bit.ly/lH8fwh
http://bit.ly/lryYbf Copy-on-Write B-tree beaten by Stratified B-tree
http://bit.ly/iJg01H A summary of the above paper
http://bit.ly/jV5j1x More on why Fractal-tree DBs scale better on SSDs. Cache oblivious Fractal Trees
http://slidesha.re/jIRkYj More on streaming data structures : doubling array, fractional cascading, and stratified doubling arrays explained (presentation) <—- V. Good
Netflix will be sponsoring DataStax SF 2011 on Monday, July 11. Though Netflix does not often sponsor events or recruit at conferences, we hope to engage with others active in the Cassandra and Distributed Systems community.
Stop by our booth to learn about what we are working on! Bring your resume as well!
Sid, Cloud Systems, Netflix
Hi Folks!
As many of you know, Netflix has been expanding its video streaming offering throughout the US and the world. We have been successful thanks to our move to Amazon Web Services’ cloud and our adoption of NoSQL solutions.
-s
Hi Folks!
I had a great time this past Thursday (Feb 17, 2011) speaking at the Silicon Valley Cloud Computing Group Meetup at Facebook. The talk covered Netflix’s move from RDBMS to NoSQL, specifically SimpleDB. Subsequent parts will provide our experiences with Cassandra, HBase, and other technologies.
Video is now available. The first 10 minutes are from sponsors, VMWare, RackSpace, and Scalr!
-s
Hi Folks!
I’ll be giving a 2-part lecture on NoSQL @ Netflix at the Silicon Valley Cloud Computing Meetup in Mountain View on Feb 17. The lectures will be a month apart.
I will detail the challenges involved in going from an RDBMS in our Data Center to AWS’s SimpleDB and S3 in the Cloud. I was intimately involved in this transition. Now, my team at Netflix is investing in Cassandra (and to a lesser extent in HBase). How are we using these different storage options? Come to the meetup to find out!
As a separate note, I am excited to be heading to London in early March to meet engineers in London and to deliver 2 talks
I will also be giving 2 QCon London talks in early March in both Floyd Marinescu’s Architectures You’ve Always Wondered About and Alex Popescu’s NoSQL : Where and How tracks. In the first lecture, I’ll describe Netflix’s Cloud-based data infrastructure. In the second (i.e. the NoSQL Track), I will dive into our NoSQL.
If you happen to be in town, please drop by!
-s
Below, you will find 2 sets of questions and answers regarding Cassandra’s (now v0.7) Row Cache and Memtable. These were answered by Matthew Dennis at Riptano, a company that is actively developing both Cassandra and a management suite known as RipCord.
Questions
Hi!
I have a super column family. Writes either modify a column within a super column or add a super column to the super column family. I wonder how the row cache works.
A. How do writes interact with the Row Cache entries?
1. Do you update the row cache entry in place in order to keep it consistent with the SSTable?
2. Do you update it when the memtable is updated or when the memtable is flushed to the SSTable?
B. Also, is the Memtable appended to an SSTable when it is flushed or does it become its own SSTable?
nosql
sharadag
boredandroid