Class KRR implements Kernel Ridge Regression - a regularized least square method for classification and regression.
It is similar to support vector machines (cf. CSVM). However in contrast to SVMs a different objective is optimized that leads to a dense solution (thus not only a few support vectors are active in the end but all training examples). This makes it only applicable to rather few (a couple of thousand) training examples. In case a linear kernel is used RR is closely related to Fishers Linear Discriminant (cf. LDA).
Internally (for linear kernels) it is solved via minimizing the following system
which is boils down to solving a linear system
and in the kernel case
where K is the kernel matrix and y the vector of labels. The expressed solution can again be written as a linear combination of kernels (cf. CKernelMachine) with bias .
公有成员 | |
CKRR () | |
CKRR (float64_t tau, CKernel *k, CLabels *lab) | |
virtual | ~CKRR () |
void | set_tau (float64_t t) |
virtual bool | train (CFeatures *data=NULL) |
virtual CLabels * | classify () |
virtual float64_t | classify_example (int32_t num) |
virtual CLabels * | classify (CFeatures *data) |
virtual bool | load (FILE *srcfile) |
virtual bool | save (FILE *dstfile) |
virtual EClassifierType | get_classifier_type () |
virtual const char * | get_name () const |
CLabels * classify | ( | ) | [virtual] |
classify objects
data | (test)data to be classified |
float64_t classify_example | ( | int32_t | num ) | [virtual] |
classify one example
num | which example to classify |
virtual EClassifierType get_classifier_type | ( | ) | [virtual] |
bool load | ( | FILE * | srcfile ) | [virtual] |
bool save | ( | FILE * | dstfile ) | [virtual] |
bool train | ( | CFeatures * | data = NULL ) |
[virtual] |
train regression
data | training data (parameter can be avoided if distance or kernel-based regressors are used and distance/kernels are initialized with train data) |
重载CClassifier。