Netflix will be sponsoring DataStax SF 2011 on Monday, July 11. Though Netflix does not often sponsor events or recruit at conferences, we hope to engage with others active in the Cassandra and Distributed Systems community.
Stop by our booth to learn about what we are working on! Bring your resume as well!
Sid, Cloud Systems, Netflix
Last week, I attended Intuit’s annual CTOF (Create The OFfering) conference in San Diego. The focus this year was on mobile best practices. I was happy to represent Netflix at this venue and learn from other companies with a foot in either mobile, the cloud, or both.
Netflix is an example of both with support on several mobile platforms (e.g. iOS, Android, Windows Mobile) and traffic served from Amazon’s Cloud.
Intuit CTOF 2011 - Netflix for Mobile in the Cloud View more presentations from Sid Anand
If you are interested in positions at Netflix, working on either the Cloud or mobile, we are hiring!
If you are just stopping by for your Calvin and Hobbes fix, enjoy!
Hi Folks!
As many of you know, Netflix has been expanding its video streaming offering throughout the US and the world. We have been successful thanks to our move to Amazon Web Services’ cloud and our adoption of NoSQL solutions.
-s
I thought that I would put up a list of previous and upcoming talks that I will be giving. These talks will tend to focus on my work in Distributed “Cloud” Computing and NoSQL.
Recent & Upcoming Speaking Appearances
White papers
Magazine Articles
Videos
NoSQL @ Netflix talk at Facebook (Feb 2011)
Structure 2011 Guru Panel (June 2011)
Hi Folks!
I had a great time this past Thursday (Feb 17, 2011) speaking at the Silicon Valley Cloud Computing Group Meetup at Facebook. The talk covered Netflix’s move from RDBMS to NoSQL, specifically SimpleDB. Subsequent parts will provide our experiences with Cassandra, HBase, and other technologies.
Video is now available. The first 10 minutes are from sponsors, VMWare, RackSpace, and Scalr!
-s
Hi Folks!
I’ll be giving a 2-part lecture on NoSQL @ Netflix at the Silicon Valley Cloud Computing Meetup in Mountain View on Feb 17. The lectures will be a month apart.
I will detail the challenges involved in going from an RDBMS in our Data Center to AWS’s SimpleDB and S3 in the Cloud. I was intimately involved in this transition. Now, my team at Netflix is investing in Cassandra (and to a lesser extent in HBase). How are we using these different storage options? Come to the meetup to find out!
As a separate note, I am excited to be heading to London in early March to meet engineers in London and to deliver 2 talks
I will also be giving 2 QCon London talks in early March in both Floyd Marinescu’s Architectures You’ve Always Wondered About and Alex Popescu’s NoSQL : Where and How tracks. In the first lecture, I’ll describe Netflix’s Cloud-based data infrastructure. In the second (i.e. the NoSQL Track), I will dive into our NoSQL.
If you happen to be in town, please drop by!
-s
For the past few weeks, we have been wrestling with an interesting bug in Oracle 11g at Netflix.
We are seeing high CPU attributed with a high number of wait events for the following:
I was perplexed as to why waits would result in high CPU so I hopped on to Google. I didn’t find an answer for 11g, but I did find something reported in 10.2 and reportedly fixed in 11g.
In Oracle 10.2, on Operating Systems (e.g. AIX, HPUX, etc..) that support process priority decay (e.g. fair round robin, default on AIX 5), priority inversion can cause “blocked threads” to burn CPU. Ignore the fact that this mentions “cursor pin s” waits instead of “cursor mutex s” waits, the pattern is the same.
http://blog.tanelpoder.com/2010/04/21/cursor-pin-s-waits-sporadic-cpu-spikes-and-systematic-troubleshooting/
In Oracle 10.2, latches cause waits, while mutexes cause CPU spins.
Below, you will find 2 sets of questions and answers regarding Cassandra’s (now v0.7) Row Cache and Memtable. These were answered by Matthew Dennis at Riptano, a company that is actively developing both Cassandra and a management suite known as RipCord.
Questions
Hi!
I have a super column family. Writes either modify a column within a super column or add a super column to the super column family. I wonder how the row cache works.
A. How do writes interact with the Row Cache entries?
1. Do you update the row cache entry in place in order to keep it consistent with the SSTable?
2. Do you update it when the memtable is updated or when the memtable is flushed to the SSTable?
B. Also, is the Memtable appended to an SSTable when it is flushed or does it become its own SSTable?
vivimetaliun