Developer Aspirations

YAPB - Yet Another Programming Blog




January 2010

Client Side Map-Reduce with Javascript

by Colin Miller, on JavaScript, MapReduce, Performance, Scalability

I've been doing a lot of scalability research lately. The High Scalability website has been fairly valuable to this end. I've been thinking of alternate approaches to my application designs, mostly based on services. There was an interesting article about's architecture that describes a little bit on how they put services together. I started thinking about an application that I work on and how it would work if…



November 2009

Dynamic Offline Reports

by Colin Miller, on Clojure, Erlang, Hadoop, MapReduce, Scala, Scalability

Many applications have the primary concern of storing and retrieving data. The raw data by itself is often not very useful, so an additional process is put into place to turn that data into useful information. Many applications generate these reports from the data quickly at the user's request through either a narrow SQL select statement, in application data processing, or both. However, in larger applications where the data is…