Howdy Folks!!
Long time again since I blogged. My bad!
I keep wondering, how can a guy make same mistakes over and over again. Then I see my blog. I realize how!! :(
Grad school is keeping me busy and lazy in strict alternation ( I know! too much of OS Course ). Busy with assignments/projects and lazy otherwise. Awesome combination to keep me from writing :-|
An Interesting FFT -- "food for thought"( term courtesy our prof in college who writes this in the mails for math club ) thats what this post leaves you with.
This was a discussion that ensued between few geeks from Yahoo! and myself in the Hadoop workshop @ IMSAA ( in IIITB, dec 2010 ).
Wow! Dec 2010?? YES!! Discussion then, blogging now :)
After an elephantine 4 hour long session on Hadoop, I struck a conversation with the blokes who presented the seminar hoping to get some tips n tricks to get started with Hadoop. Okie! it has been so long since I spoke to them, I don't remember any of their names :(
My first question "Hey! can we set up Hadoop on commodity hardware?"
Bloke1: "Absolutely, we run all our Hadoop installations on commodity - off - the - shelf hardware."
For those of you who are wondering what is commodity hardware, here it is.
I got even more excited, the very thought of installing Hadoop on my lappy (ohhh! yesss she will be cursing me for abusing her sooo much! sorry baby :D)
This follows the fact that, just a day before I attended "Large data processing using Dryad LiNQ" @ Microsoft Research India office. I was disappointed there for the reason that, Dryad framework needs extremely chic systems to run on :( More on this sometime later. Like some texts state "Not in the scope of this discussion"
Before my next question, Bloke2 pitches in "what is your definition of commodity hardware?"
Me: "Err, my laptop?"
Bloke2: "Oh! actually, we can run Hadoop off a laptop, but it should be sufficiently powerful system."
Then came a list of "suggested requirements". Topping the list was : 2 quad core CPU doing a good 2.5Ghz. Woah!! where do I get it from???
Me: "Woah!! Ain't that some huge server?"
Bloke2: "Well, yeah, but we bought it off the shelf from market, which makes it commodity for us!!!!"
Here is one post which I liked for the 1st line. Paraphrasing it, I can write it as "my definition of commodity hardware is different from your's DUDE!!"
If you look at the recommended specification in the same page, ( please don't faint I want you to complete reading this ;-) ) its gotta be quite a big Momma machine :O
The later discussions with those Blokes from Yahoo! only discouraged me from installing Hadoop on my lappy ( sweetie-pie you are saved :P ) and hence, I am not even going to quote it here. ( clarification: I remember the discussion, even after Dec 2010 to March 2011 gap :) )
I was left wondering, does commodity hardware really mean commodity hardware for common man?
Me thinks, this IS some food for thought! What do you think??
Ps:
I hope to leave now, only to return soon!
C ya folks :)
Long time again since I blogged. My bad!
I keep wondering, how can a guy make same mistakes over and over again. Then I see my blog. I realize how!! :(
Grad school is keeping me busy and lazy in strict alternation ( I know! too much of OS Course ). Busy with assignments/projects and lazy otherwise. Awesome combination to keep me from writing :-|
An Interesting FFT -- "food for thought"( term courtesy our prof in college who writes this in the mails for math club ) thats what this post leaves you with.
This was a discussion that ensued between few geeks from Yahoo! and myself in the Hadoop workshop @ IMSAA ( in IIITB, dec 2010 ).
Wow! Dec 2010?? YES!! Discussion then, blogging now :)
After an elephantine 4 hour long session on Hadoop, I struck a conversation with the blokes who presented the seminar hoping to get some tips n tricks to get started with Hadoop. Okie! it has been so long since I spoke to them, I don't remember any of their names :(
My first question "Hey! can we set up Hadoop on commodity hardware?"
Bloke1: "Absolutely, we run all our Hadoop installations on commodity - off - the - shelf hardware."
For those of you who are wondering what is commodity hardware, here it is.
I got even more excited, the very thought of installing Hadoop on my lappy (ohhh! yesss she will be cursing me for abusing her sooo much! sorry baby :D)
This follows the fact that, just a day before I attended "Large data processing using Dryad LiNQ" @ Microsoft Research India office. I was disappointed there for the reason that, Dryad framework needs extremely chic systems to run on :( More on this sometime later. Like some texts state "Not in the scope of this discussion"
Before my next question, Bloke2 pitches in "what is your definition of commodity hardware?"
Me: "Err, my laptop?"
Bloke2: "Oh! actually, we can run Hadoop off a laptop, but it should be sufficiently powerful system."
Then came a list of "suggested requirements". Topping the list was : 2 quad core CPU doing a good 2.5Ghz. Woah!! where do I get it from???
Me: "Woah!! Ain't that some huge server?"
Bloke2: "Well, yeah, but we bought it off the shelf from market, which makes it commodity for us!!!!"
Here is one post which I liked for the 1st line. Paraphrasing it, I can write it as "my definition of commodity hardware is different from your's DUDE!!"
If you look at the recommended specification in the same page, ( please don't faint I want you to complete reading this ;-) ) its gotta be quite a big Momma machine :O
The later discussions with those Blokes from Yahoo! only discouraged me from installing Hadoop on my lappy ( sweetie-pie you are saved :P ) and hence, I am not even going to quote it here. ( clarification: I remember the discussion, even after Dec 2010 to March 2011 gap :) )
I was left wondering, does commodity hardware really mean commodity hardware for common man?
Me thinks, this IS some food for thought! What do you think??
Ps:
I hope to leave now, only to return soon!
C ya folks :)
1 comment:
That aint commodity hardware. who told so.... :(
Post a Comment