Title :
Chain-block algorithm to RVM on large scale problems
Author :
GangLi ; Shu-BaoXing ; Xue, Hui-Feng
Author_Institution :
Coll. of Autom., Northwestern Polytech. Univ., Xian, China
Abstract :
RVM enables sparse classification and regression functions to be obtained by linearly-weighting a small number of fixed basis functions from a large dictionary of potential candidates.TOA on RVM has O(M3) time and O(M2) space complexity, where M is the training set size. It is thus computationally infeasible on very large data sets. We propose CBA . it decomposed large datasets to subdata blocks by sampled homogeneously and getted solution by chain iteration taking TOA as basis algorithm. Regression experiments with synthetical large sbenchmark data set demonstrates CBA yielded state-of-the-art performance: its time complexity is linear in M and space complexity is independent of M, keeping high accuracy and sparsity at the same time. Document shows that CBA is also much better than TFA on time complexity and sparsity.
Keywords :
computational complexity; database theory; support vector machines; very large databases; chain iteration; chain-block algorithm; regression analysis; regression functions; relevance vector machine; space complexity; sparse classification; time complexity; very large data sets; Automation; Basis algorithms; Bayesian methods; Dictionaries; Educational institutions; Large-scale systems; Management training; Predictive models; Space technology; Technology management; CBA; RVM; machine learning; regression;
Conference_Titel :
Computer Science and Information Technology, 2009. ICCSIT 2009. 2nd IEEE International Conference on
Conference_Location :
Beijing
Print_ISBN :
978-1-4244-4519-6
Electronic_ISBN :
978-1-4244-4520-2
DOI :
10.1109/ICCSIT.2009.5234817