Why the big data matters

This first post requires some perspective, so here you go. Why start this blog?

For the past decade I have been working on scalable systems. Six years ago I set up GridwiseTech, a knowledge company addressing scalability challenges for corporations and goverments worldwide. I was soon joined by a team of excellent experts. Together, we have built collective knowledge on designing and building distributed, robust, and scalable IT systems, capable of handling large volumes of data and large processing.

A system is scalable when it can grow together with business. A challenge of any successful corporation is the growing amount of data. In this article (2007) I explained why this is natural and inevitable.
Corporations building scalable systems are often stuck at the level of database, data provisioning and data processing. In our experience with buidling scalable systems, designing scalability at the data level is the least trivial task. There are numerous ways to address the problem and the devil is in the detail.

Over the years, we came up with our own methodology for database scalability. As the technology progressed, we learned to live with it and systematically evaluate new solutions with each new project.

This research often goes beyond the project need. Some of the findings and thoughts never see daylight. I thought we could share some of these.

That's really it. I hope this altogether will be useful to people. Next months will show.