Hadoop and Pig with Alan Gates from Yahoo
Episode 4 of our Podcast is with Alan Gates, Senior Software Engineer @ Yahoo! and Pig committer. Click here to listen.
Hadoop is a really important part of Yahoo’s infrastructure because processing and analyzing big data is increasingly important for their business. Hadoop allows Yahoo to connect their consumer products with their advertisers and users for a better user experience. They have been involved with Hadoop for many years now and have their own distribution. Yahoo also sponsors/hosts a user group meeting which has grown to hundreds of attendees every month.
We talked about what Pig is now, the future of Pig and other projects like Oozie http://github.com/tucu00/oozie1 which Yahoo uses (and is open source) for workflow of MapReduce & Pig script automation. We also talked about Zebra http://wiki.apache.org/pig/zebra, Owl http://wiki.apache.org/pig/owl, and Elephant Bird http://github.com/kevinweil/elephant-bird
[tweetmeme http://wp.me/pTu1i-4A%5D
/*
Joe Stein
http://www.linkedin.com/in/charmalloc
*/
All Things Hadoop Podcast
- Tips And Tricks To Your First ClusterTips And Tricks to setting up your first Hadoop cluster and running your first map reduce jobs with real data.
- Hadoop, BigData and Cassandra with Jonathan EllisHadoop, BigData and Cassandra with Jonathan Ellis
- Ruby Streaming with Wukong, Guest Flip KromerRuby Streaming with Wukong, Guest Flip Kromer
- Hadoop and Pig with Alan Gates from YahooHadoop and Pig with Alan Gates from Yahoo
- Hadoop Development Tools with Shevek from KarmasphereHadoop Development Tools with Shevek from Karmasphere
- NoSQL HBase and Hadoop with Todd Lipcon from ClouderaNoSQL HBase and Hadoop with Todd Lipcon from Cloudera
- Unified analytics and large scale machine learning with Milind BhandarkarUnified analytics and large scale machine learning with Milind Bhandarkar
- Hortonworks HDP1, Apache Hadoop 2.0, NextGen MapReduce (YARN), HDFS Federation and the future of Hadoop with Arun C. MurthyHortonworks HDP1, Apache Hadoop 2.0, NextGen MapReduce (YARN), HDFS Federation and the future of Hadoop with Arun C. Murthy
- Hadoop, Mesos, Cascading, Scalding, Cascalog and Data Science with Paco NathanHadoop, Mesos, Cascading, Scalding, Cascalog and Data Science with Paco Nathan
- Hadoop, The Cloudera Development Kit, Parquet, Apache BigTop and more with Tom WhiteHadoop, The Cloudera Development Kit, Parquet, Apache BigTop and more with Tom White
