Developer Aspirations

YAPB - Yet Another Programming Blog

Scalability

Tuesday

14

September 2010

Amazon Web Services First Impressions

by Colin Miller, on Amazon Web Services, development, Musings, Scalability, Virtualization, work

First thing's first, my blog is now at a new location. I've decided to move it to a more narcissistic address: http://colintmiller.com/. It may later change to http://colintmiller.com/blog/ or something, and I'll make a note of it if that happens. The old address will still have my old posts, and I may cross post a few times, but mostly I'll be using the new location…

Thursday

18

February 2010

Remote Datasources

by Colin Miller, on Design, development, Ramblings, Reusable Code, SaaS, Scalability

Almost all applications today deal with persisted data. The only rare exceptions are usually not very complicated such as a calculator, unit conversion tool, or minor utility. Let us assume that any application we're working on is going to have some sort of persistant state that must be kept between executions of the application. Typically the state is stored in either a file or a database. File access is useful…

Monday

08

February 2010

Scalability Testing with Virtual Machines

by Colin Miller, on development, Scalability, Virtual Machines

Making a service based, distributed application is a good way to help your scalability goals. If you can compartmentalize the different aspects of your application into separate processes that can host services through either web services or plain sockets, you'll gain the ability to make asynchronous and parallel calls between services. When you're developing an application you generally use a single development machine. You can run into problems when trying…

Friday

29

January 2010

Client Side Map-Reduce with Javascript

by Colin Miller, on JavaScript, MapReduce, Performance, Scalability

I've been doing a lot of scalability research lately. The High Scalability website has been fairly valuable to this end. I've been thinking of alternate approaches to my application designs, mostly based on services. There was an interesting article about Amazon.com's architecture that describes a little bit on how they put services together. I started thinking about an application that I work on and how it would work if…

Friday

22

January 2010

Breaking a monolithic applicaiton into Services

by Colin Miller, on Performance, SaaS, Scalability, SOA

Today I shall be tackling Service Oriented Architecture. I think that that particular buzz phrase has annoyed me a lot in the past. CTOs and middle management talk about how the read in a magazine something about SoA or SaaS (Software As A Service) as being the next big thing and that we should switch all of our stuff to that! Meanwhile there isn't a very good explanation of how…

Wednesday

13

January 2010

Two Databases, One Hibernate

by Colin Miller, on development, Hibernate, Scalability

Hibernate is a very interesting ORM product that hides the SQL behind mapping your objects to your database. In general it works pretty well at making it easier to deal with database objects. Unfortunately, there seems to be some lack of flexibility. For instance, utilizing two databases for the same dataset in Hibernate. Here's my issue: I have a MySQL database that acts as a primary master. There is a…