An interesting talk on how Facebook uses Hadoop and Hive for their data warehousing and data processing jobs.

Rethinking the Data Warehouse with Hadoop and Hive – Ashish Thusoo from Cloudera on Vimeo.

Show me more… »

Tags: Data Processing,Data Warehousing,facebook,hadoop
Categories: Technology
No Comments »

Ok, so anyone who knows me, knows that I’m a hacker at heart.  I love hacking out new projects, and learning a few lessons from them.  Then I usually start tweaking them, lose interest, and move onto something else (e.g. Biographiki, College-Ink, My various attempts at timesharing router labs…)

So here are my technology ideas:

erlang – Yes, Liron – I am finally coming around and I’ll admit that erlang is pretty awesome.  Its massively scalable and who doesnt love functional programming…  Erlyweb seems like the framework to use, ErlyDB is probably my best bet too.  Maybe something p2p.

oCaml – Its the best ML .  Once again, who doesn’t love functional programming…

python – Its fast enough, and really fast to code in.  I like how indentation actually matters.  I’ve heard good things about django, and can run it on Google’s App Engine.  (I’m getting sick of hearing the word app though, Apple ruined it)

Show me more… »

Tags: Amazon,erlang,hacking,hadoop,Ocaml,projects,software engineering
Categories: Technology
No Comments »