The Super Database Computer (SDC): system architecture, algorithm and preliminary evaluation

SDC is designed to exhibit very powerful performance under heavy SQL query processing environment such as Information Mining and Knowledge Discovery. The business data processing application is now entering the area of SIS (Strategic Information System), where large amount of database is mined and mined taking a very long time. At present high-end mainframe computers are used for such application. The authors propose an architecture for a SQL server to support such environment. The key feature of SDC is its employment of novel bucket spreading hash algorithm, so SDC is very robust for data skew and can attain linear performance increases for system expansion. The hardware architecture of SDC is presented. Automatic load balancing Omega network which interconnects the modules is explained with examples. The software structure of SDC is also described. The authors have now completed development of the pilot system consisting of two modules. Its preliminary performance evaluation results are given