Hi Folks!
I had a great time this past Thursday (Feb 17, 2011) speaking at the Silicon Valley Cloud Computing Group Meetup at Facebook. The talk covered Netflix’s move from RDBMS to NoSQL, specifically SimpleDB. Subsequent parts will provide our experiences with Cassandra, HBase, and other technologies.
Video is now available. The first 10 minutes are from sponsors, VMWare, RackSpace, and Scalr!
-s
Hi Folks!
I’ll be giving a 2-part lecture on NoSQL @ Netflix at the Silicon Valley Cloud Computing Meetup in Mountain View on Feb 17. The lectures will be a month apart.
I will detail the challenges involved in going from an RDBMS in our Data Center to AWS’s SimpleDB and S3 in the Cloud. I was intimately involved in this transition. Now, my team at Netflix is investing in Cassandra (and to a lesser extent in HBase). How are we using these different storage options? Come to the meetup to find out!
As a separate note, I am excited to be heading to London in early March to meet engineers in London and to deliver 2 talks
I will also be giving 2 QCon London talks in early March in both Floyd Marinescu’s Architectures You’ve Always Wondered About and Alex Popescu’s NoSQL : Where and How tracks. In the first lecture, I’ll describe Netflix’s Cloud-based data infrastructure. In the second (i.e. the NoSQL Track), I will dive into our NoSQL.
If you happen to be in town, please drop by!
-s
Below, you will find 2 sets of questions and answers regarding Cassandra’s (now v0.7) Row Cache and Memtable. These were answered by Matthew Dennis at Riptano, a company that is actively developing both Cassandra and a management suite known as RipCord.
Questions
Hi!
I have a super column family. Writes either modify a column within a super column or add a super column to the super column family. I wonder how the row cache works.
A. How do writes interact with the Row Cache entries?
1. Do you update the row cache entry in place in order to keep it consistent with the SSTable?
2. Do you update it when the memtable is updated or when the memtable is flushed to the SSTable?
B. Also, is the Memtable appended to an SSTable when it is flushed or does it become its own SSTable?
I presented at QCon SF (2010) yesterday on Netlflix’s transition to high-availability storage. The slides are on slideshare.
I expect that the presentation will be available on the QCon SF site in a few days. It’s (loosely) based on my previous white paper of the same title - see this post.
I just published a white paper titled Netflix’s Transition to High-Availability Storage Systems
Feel free to email me your thoughts at siddharthanand@yahoo.com
To download this paper as PDF, click on this .
nosql
sharadag
boredandroid