Largest database you data mined?

editor · Posted: Tue May 30, 2006 6:12 am Post subject: Largest database you data mined?

NSA was reported to have a database of hundreds of terabytes.
What is the largest database you analyzed ?
What were some of the difficulties in dealing with very large data?

TimManns · Posted: Sun Oct 08, 2006 8:38 pm Post subject: largest database analysed

I don't know about byte size, but in terms of number of rows some of our analysis occiasionally involves selecting and summarising customer mobile phone call data for a prior three month period (common churn analysis). The tables we work with contain in excess if 45 million rows per month.

This would be summarised to an account/customer level, containing maybe a million rows for any particular analysis.

We have a Teradata system with 20 or so terabytes (i think). As a data miner / analyst, I find this database works very well and we are able to process data within a practical timeframe (a working day).

Tim

Riverside · Joined: 03 May 2007 Posts: 1

We works for tele and banking industry in Chinese market.

China Mobile is the largest mobile company in the world. some 300 million subscribers use their service and average 6-8 calls one day per subscriber.

Last year we work for the datawarehouse project, and 2 billion record of CDR treated.

We also worked for a bank with 30 million accounts (nearly 1.5 customers). We mining for credit scoring in a transaction table with about 900 million records