An integrated method for cancer classification and rule extraction from microarray data

1423-0127-16-25 1423-0127 Research An integrated method for cancer classification and rule extraction from microarray data Huang Liang-Tsung larry@mdu.edu.tw

Department of Computer Science and Information Engineering, Mingdao University, Changhua 523, Taiwan

Journal of Biomedical Science 1423-0127 2009 16 1 25 http://www.jbiomedsci.com/content/16/1/25 1927219210.1186/1423-0127-16-25 08 9 2008 24 2 2009 24 2 2009 2009 Huang; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Different microarray techniques recently have been successfully used to investigate useful information for cancer diagnosis at the gene expression level due to their ability to measure thousands of gene expression levels in a massively parallel way. One important issue is to improve classification performance of microarray data. However, it would be ideal that influential genes and even interpretable rules can be explored at the same time to offer biological insight.

Introducing the concepts of system design in software engineering, this paper has presented an integrated and effective method (named X-AI) for accurate cancer classification and the acquisition of knowledge from DNA microarray data. This method included a feature selector to systematically extract the relative important genes so as to reduce the dimension and retain as much as possible of the class discriminatory information. Next, diagonal quadratic discriminant analysis (DQDA) was combined to classify tumors, and generalized rule induction (GRI) was integrated to establish association rules which can give an understanding of the relationships between cancer classes and related genes.

Two non-redundant datasets of acute leukemia were used to validate the proposed X-AI, showing significantly high accuracy for discriminating different classes. On the other hand, I have presented the abilities of X-AI to extract relevant genes, as well as to develop interpretable rules. Further, a web server has been established for cancer classification and it is freely available at http://bioinformatics.myweb.hinet.net/xai.htm.

Background

The challenge of cancer treatment is to develop specific therapies based on distinct tumor types, to maximize efficacy and minimize toxicity. Hence, improvements in cancer classification have been paid more and more attention. Recently, microarray gene expression data has been successfully used to investigate useful information for cancer classification at the gene expression level. One of the earliest methods for cancer classification is the weighted voting machine which is based on a linear model 1. Other methods includes hierarchical clustering 2, machining learning 34, compound covariate 5, shrunken centroids 6, partial least square 7, principal component analysis disjoint models 8, factor mixture models 9, consensus analysis of multiple classifiers using non-repetitive variables 10 etc. On the whole, these methods are mostly concentrated in the improvement of accuracy rather than other issues.

In addition to classification, another challenge is to extract relevant genes, even creditable and interpretable rules from microarray gene expression data to offer biological insight between genes. Several kinds of rules have been successfully developed in different subjects of molecular biology. In our earlier studies, decision rules based on decision tree algorithms have been effectively extracted from the thermodynamic database of proteins and mutants to explore potential knowledge of protein stability prediction 111213. On the other hand, association rule techniques can also reveal relevant associations between different items. Borgelt and Berthold 14 presented an algorithm to find fragments in a set of molecules that help to discriminate between different classes of activity in a drug discovery context. Oyama et al. 15 proposed a data mining method to discover association rules related to protein-protein interactions. Moreover, association rules which demonstrate diverse mutations and chemical treatments have been reported from 300 gene expression profiles of yeast 16. Carmona-Saez et al. 17 have offered an approach which integrates gene annotations and expression data to discover intrinsic associations.

Typically, a classification system may achieve high accuracy by non-linear models, but these models are hard to provide rules. In contrast, a rule extraction system is necessary to consider the model interpretability which can provide a pathway to explore underlying relationships among data; however, this restriction often affects the system performance in classification. Hence, a learning model which can provide accurate classification, as well as useful rules, would be ideal. Even so, a relatively few attempts have been made to integrate the two types of systems on microarray gene expression data. In earlier reports, Li et al. 18 has proposed a classifier named PCL (prediction by collective likelihoods) which is based on the concept of emerging patterns and can provide the rules describing the microarray gene expression data. Tan et al. 19 have introduced a new classifier named TSP (top scoring pair) which is based on relative expression reversals and can generate accurate decision rules. These studies also revealed the phenomenon of trade-off between credibility and comprehensibility in such a hybrid system. For that reason, I have made attempts to design an integrated and effective framework with less interaction between cancer classification and rule extraction functions.

In this paper, I have presented an integrated method (named X-AI) which is based on a three-tiered architecture from the viewpoint of system design of software engineering. Different tests have been carried out on two leukemia datasets for evaluating the performance of X-AI. The obtained results indicated that X-AI is able to perform well on both functions of classification and rule extraction in microarray analysis.

Materials and methods

Datasets and pre-processing

I used two different leukemia datasets for the following reasons: (i) both datasets have been analyzed and discussed in many literatures, which is helpful to compare with their results; (ii) the rules extracted from the similar cancer type of datasets could be compared to each other; (iii) the robustness of classification system could be observed by the datasets that are obtained from different experiments; and (iv) the two datasets represent the nature of the binary classification and multi-class problems, which is useful to evaluate the effectiveness of the proposed method for different classification problems.

The first acute leukemia data (named L1) of Golub et al. 1 is composed of 72 samples from two different types of acute leukemia, acute lymphoblastic leukemia (ALL) and acute myeloid leukemia (AML). The training set has 38 bone marrow samples (27 ALL and 11 AML) and the test set consists of 24 bone marrow and 10 peripheral blood samples (20 ALL and 14 AML). Bone marrow mononuclear cells were collected by Ficoll sedimentation in the training set and RNA was hybridized to Affymetrix oligonucleotide microarrays, by which each sample has expression patterns of 7129 probes measured. The second acute leukemia data (named L2) of Armstrong et al. 20 includes 12582 gene expression values for 57 peripheral blood or bone marrow samples. The training set contains 57 leukemia samples (20 ALL, 17 MLL (mixed lineage leukemia) and 20 AML) and the test set contains 15 samples (4 ALL, 3 MLL and 8 AML). For microarray data, pre-processing is of critical importance in downstream analyses. In order to equalize expression values for each sample and avoid the bias against samples, all values in a sample have been re-scaled by a multiplicative factor which is determined by linear regression of genes with present calls. All multiplicative factors are available on the established web server. Duoit et al. 21 applied thresholding, filtering and logarithmic transformation steps before analyzing the leukemia dataset. Accordingly, the expression values were limited by both upper and lower bounds. Since it could be easy to neglect information leakage effects during pre-processing of the proteomic profiling on mass spectrometry data as well as the microarray expression data 22, the upper bound is lifted to 24000 and the lower bound -800, which can increase the changes of finding relevant genes due to a larger search space. Further, I tried to perform the feature selection function instead of a simple filter to systematically reduce the number of genes. The mechanism is described in the following section.

More details of datasets can be found on the web server and in Broad Institute http://www.broad.mit.edu which evolved from research collaborations in the MIT and Harvard communities and made the generated data available to the scientific community.

X-AI Method

From the viewpoint of system design in software engineering, Yourdon and Constantine 23 made a major contribution to the development of structured design methods by defining a series of criteria that can be used in separating systems into appropriate modules. Modules with tight cohesion and loose coupling are the goal of design. Tight cohesion means that a module should capture one abstraction, while loose coupling means that modules should have little dependency on each other. Introducing the concepts, I adopted a three-tiered architecture (see Figure 1) for the integrated system and each layer includes one or more specific functions: (i) The data management layer comprises the functions required at all stages of data pre-processing issues in microarray analysis. This is consistent with the report of Tinker et al. 24, describing the data management is necessary for the pre-processing which is an important part of microarray experimentation. (ii) The data reduction layer corresponds to the feature selection function, which is mainly to reflect the fact that not all genes measured from a microarray are relevant to a particular cancer; moreover, the data reduction can also help to reduce computational complexity. (iii) The data mining layer satisfies the functions of different kinds of analysis, and here is partitioned into two functions of classification and rule extraction. The two functions based on the same lower layer are loosely coupled and each delivers a coherent group of services, conforming to the design principle mentioned above.

Figure 1

A three-tiered architecture applied to microarray gene expression data to integrate the tasks of data analysis from the pre-processing to the data mining

A three-tiered architecture applied to microarray gene expression data to integrate the tasks of data analysis from the pre-processing to the data mining.

The three-tiered architecture integrates the tasks of microarray data analysis from the pre-processing to the data mining including classification and rule extraction. Each function layer with independency can be changed internally without affecting other layers. Therefore, this architecture can provide the consistency of data to different components of the same layer, and reduce the interaction between layers as well as between the components of the same layer.

The proposed X-AI method primarily implemented the data mining and the data reduction layers of the architecture, and integrated three functions: (i) feature selection, (ii) cancer classification, and (iii) associate rule development (see Figure 2). Although there are many algorithms for these functions, I included three common algorithms so as to observe how well the integrated architecture can perform. Nevertheless, it is optional that replacing these algorithms with others which conform to these functions. Here, Chi2 algorithm serves as the selector to systematically extract the relative important genes so as to reduce the dimension and retain as much as possible of the class discriminatory information. This selector can also provide the consistency of data to the other functions, the input data flows of which come from the output data flows of the selector. Subsequently, diagonal quadratic discriminant analysis (DQDA) was combined to discriminate tumor classes. And generalized rule induction (GRI) was integrated to establish association rules which can give an understanding of the relationship between cancer classes and influence genes. In addition, the outcomes obtained from the three functions of selector, classification and rule development can be referenced by each other. For example, an accurate classification reveals the fact that the selected features are effective, which generally makes the developed rules more reliable.

Figure 2

The X-AI framework with dataflow for cancer classification and knowledge acquisition from DNA microarray data

The X-AI framework with dataflow for cancer classification and knowledge acquisition from DNA microarray data.

Chi2 algorithm

The Chi2 algorithm 25 can discretize numeric features and select relevant features according to the chi-squared statistic with respect to the class. The chi-squared value of an attribute is calculated as the following equation,

χ 2 = ∑ i = 1 2 ∑ j = 1 k ( A i j − E i j ) 2 E i j , MathType@MTEF@5@5@+=feaagaart1ev2aqatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeq4Xdm2aaWbaaSqabeaacqaIYaGmaaGccqGH9aqpdaaeWbqaamaaqahajuaGbaWaaSaaaeaacqGGOaakcqWGbbqqdaWgaaqaaiabdMgaPjabdQgaQbqabaGaeyOeI0Iaemyrau0aaSbaaeaacqWGPbqAcqWGQbGAaeqaaiabcMcaPmaaCaaabeqaaiabikdaYaaaaeaacqWGfbqrdaWgaaqaaiabdMgaPjabdQgaQbqabaaaaaWcbaGaemOAaOMaeyypa0JaeGymaedabaGaee4AaSganiabggHiLdaaleaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqaIYaGma0GaeyyeIuoakiabcYcaSaaa@4E78@

where k is the number of classes and A_ijthe number of samples of the j-th class in the i-th interval. E_ijmeans the expected frequency of A_ij, which is calculated by

E i j = R i * C j n , MathType@MTEF@5@5@+=feaagaart1ev2aqatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemyrau0aaSbaaSqaaiabdMgaPjabdQgaQbqabaGccqGH9aqpjuaGdaWcaaqaaiabdkfasnaaBaaabaGaemyAaKgabeaacqGGQaGkcqWGdbWqdaWgaaqaaiabdQgaQbqabaaabaGaemOBa4gaaOGaeiilaWcaaa@3A2A@

where R_iis the number of samples in the i-th interval, C_jthe number of samples in the j-th class, n the total number of samples. The algorithm mainly consists of two phases, named Phase I and II. Phase I comprises the calculation of the chi-squared value for adjacent intervals, and the merge of adjacent intervals under a chi-squared threshold which will be decrementing until an inconsistency rate of data is exceeded; Phase II includes the finer process of Phase I for each feature, and the evaluation of the merge degree which reveals the relevant feature to data. For example, a feature is regarded as an irrelevance for data if it is merged to only one value at the end of Phase II.

In this work, I have applied the algorithm to two different datasets to analyze the relative importance of genes for the discrimination of tumor classes. And it was chiefly carried out from a suit of free open-source software 26, which provides numerous machine learning algorithms from various learning paradigms.

Diaquadratic discriminant analysis (DQDA)

Based on Bayes decision theory, the maximum likelihood (ML) discriminant rule discriminates the class of a feature vector x by assigning the one which yields maximal likelihood 27. For multivariate Gaussian distributions, the likelihood function of ω_iwith respect to x in the l-dimensional feature space is given by

p ( x | ω i )= 1 ( 2 π ) l / 2 | Σ i | 1 / 2 exp ⁡ [ − 1 2 ( x − μ i ) T Σ i − 1 ( x − μ i ) ] , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiCaaNaeiikaGIaemiEaGNaeiiFaWNaeqyYdC3aaSbaaSqaaiabdMgaPbqabaGccqqGPaqkcqqG9aqpjuaGdaWcaaqaaiabigdaXaqaaiabcIcaOiabikdaYiabec8aWjabcMcaPmaaCaaabeqaaiabdYgaSjabc+caViabikdaYaaacqGG8baFcqqHJoWudaWgaaqaaiabdMgaPbqabaGaeiiFaW3aaWbaaeqabaGaeGymaeJaei4la8IaeGOmaidaaaaakiGbcwgaLjabcIha4jabcchaWjabcUfaBjabgkHiTKqbaoaalaaabaGaeGymaedabaGaeGOmaidaaOGaeiikaGIaemiEaGNaeyOeI0IaeqiVd02aaSbaaSqaaiabdMgaPbqabaGccqGGPaqkdaahaaWcbeqaaiabdsfaubaakiabfo6atnaaDaaaleaacqWGPbqAaeaacqGHsislcqaIXaqmaaGccqGGOaakcqWG4baEcqGHsislcqaH8oqBdaWgaaWcbaGaemyAaKgabeaakiabcMcaPiabc2faDjabcYcaSaaa@68F7@

where μ_iis the mean of x for the ω_iclass, Σ_ithe l by l covariance matrix. When the covariance matrices are diagonal, Σi=diag(σi12,...,σil2) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeu4Odm1aaSbaaSqaaiabdMgaPbqabaGccqGH9aqpcqqGKbazcqqGPbqAcqqGHbqycqqGNbWzcqGGOaakcqaHdpWCdaqhaaWcbaGaemyAaKMaeeymaedabaGaeeOmaidaaOGaeiilaWIaeiOla4IaeiOla4IaeiOla4IaeiilaWIaeq4Wdm3aa0baaSqaaiabdMgaPjabdYgaSbqaaiabbkdaYaaakiabcMcaPaaa@461E@, the ML discriminate rule can be written as C(x)=arg⁡min⁡i∑j=1l[(xj−μij)2/σij2+log⁡σij2] MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaem4qamKaeiikaGIaemiEaGNaeiykaKIaeyypa0ZaaCbeaeaacyGGHbqycqGGYbGCcqGGNbWzcyGGTbqBcqGGPbqAcqGGUbGBaSqaaiabdMgaPbqabaGcdaaeWbqaaiabcUfaBjabcIcaOiabdIha4naaBaaaleaacqWGQbGAaeqaaOGaeyOeI0IaeqiVd02aaSbaaSqaaiabdMgaPjabdQgaQbqabaGccqGGPaqkdaahaaWcbeqaaiabikdaYaaakiabc+caViabeo8aZnaaDaaaleaacqWGPbqAcqWGQbGAaeaacqaIYaGmaaGccqGHRaWkcyGGSbaBcqGGVbWBcqGGNbWzcqaHdpWCdaqhaaWcbaGaemyAaKMaemOAaOgabaGaeGOmaidaaOGaeiyxa0faleaacqWGQbGAcqGH9aqpcqaIXaqmaeaacqWGSbaBa0GaeyyeIuoaaaa@60FF@, which is a special case of diagonal quadratic discriminant analysis (DQDA). In practice, μ_iand Σ_iare estimated by corresponding sample quantities. we have effectively utilized it for the analysis of discriminating two- and three-state proteins 28. In this study, the combination of selected genes was used as the feature vector to discriminate tumor classes.

Generalized rule induction (GRI)

Generalized rule induction was proposed by Smyth and Goodman 29, which applies an information theoretic approach to automate rule acquisition. For a rule, if antecedent then consequent, GRI applies J-measure quantifies its information content:

J = p ( a ) [ p ( c | a ) ln ⁡ p ( c | a ) p ( c ) + [ 1 − p ( c | a ) ] ln ⁡ 1 − p ( c | a ) 1 − p ( c ) ] , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemOsaOKaeyypa0JaemiCaaNaeiikaGIaemyyaeMaeiykaKYaamWaaeaacqWGWbaCcqGGOaakcqWGJbWycqGG8baFcqWGHbqycqGGPaqkcyGGSbaBcqGGUbGBjuaGdaWcaaqaaiabdchaWjabcIcaOiabdogaJjabcYha8jabdggaHjabcMcaPaqaaiabdchaWjabcIcaOiabdogaJjabcMcaPaaakiabgUcaRiabcUfaBjabigdaXiabgkHiTiabdchaWjabcIcaOiabdogaJjabcYha8jabdggaHjabcMcaPiabc2faDjGbcYgaSjabc6gaULqbaoaalaaabaGaeGymaeJaeyOeI0IaemiCaaNaeiikaGIaem4yamMaeiiFaWNaemyyaeMaeiykaKcabaGaeGymaeJaeyOeI0IaemiCaaNaeiikaGIaem4yamMaeiykaKcaaaGccaGLBbGaayzxaaGaeiilaWcaaa@6AFB@

where p(a) represents the probability of the observed attribute value of a, as a measure of the coverage of the antecedent; p(c) represents the prior probability of the value of c, as a measure of the common of the observed attribute value of c in the consequent; p(c|a) represents an modified probability of observing this value of c after taking into account the additional information of the value of a. For rules with more than one antecedent, p(a) is regarded as the probability of the conjunction of the variable values in the antecedent. Accordingly, a set of optimal rules was then generated by ITRULE algorithm, which calculates J-measures of rules by employing depth-first search over possible left-hand sides.

Here, the genes selected by Chi2 algorithm were considered as the attributes of the antecedent. And the tumor class was the only attribute of the consequent.

Performance evaluation and test procedure

Prediction accuracy

I considered the classification of the leukemia datasets L1 and L2 as the two-class and three-class problems, respectively. To evaluate the performance of the classification problems, both classification accuracy and misclassified number were calculated along with corresponding number of selected genes.

Support and confidence

The support and confidence measures were defined to reveal the importance of individual association rule. For a particular association rule, support is the proportion of samples in the dataset that contain the rule antecedent:

s u p p o r t = number of samples containing antecedent total number of samples . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaem4CamNaemyDauNaemiCaaNaemiCaaNaem4Ba8MaemOCaiNaemiDaqNaeyypa0tcfa4aaSaaaeaacqqGUbGBcqqG1bqDcqqGTbqBcqqGIbGycqqGLbqzcqqGYbGCcqqGGaaicqqGVbWBcqqGMbGzcqqGGaaicqqGZbWCcqqGHbqycqqGTbqBcqqGWbaCcqqGSbaBcqqGLbqzcqqGZbWCcqqGGaaicqqGJbWycqqGVbWBcqqGUbGBcqqG0baDcqqGHbqycqqGPbqAcqqGUbGBcqqGPbqAcqqGUbGBcqqGNbWzcqqGGaaicqqGHbqycqqGUbGBcqqG0baDcqqGLbqzcqqGJbWycqqGLbqzcqqGKbazcqqGLbqzcqqGUbGBcqqG0baDaeaacqqG0baDcqqGVbWBcqqG0baDcqqGHbqycqqGSbaBcqqGGaaicqqGUbGBcqqG1bqDcqqGTbqBcqqGIbGycqqGLbqzcqqGYbGCcqqGGaaicqqGVbWBcqqGMbGzcqqGGaaicqqGZbWCcqqGHbqycqqGTbqBcqqGWbaCcqqGSbaBcqqGLbqzcqqGZbWCaaGccqGGUaGlaaa@893E@

This measure reveals the comprehensiveness of the rule to the dataset.

Further, confidence of the association rule is a measure of accuracy of the rule:

c o n f i d e n c e = number of samples containing both antecedent and concequent number of samples containing antecedent . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaem4yamMaem4Ba8MaemOBa4MaemOzayMaemyAaKMaemizaqMaemyzauMaemOBa4Maem4yamMaemyzauMaeyypa0tcfa4aaSaaaeaacqqGUbGBcqqG1bqDcqqGTbqBcqqGIbGycqqGLbqzcqqGYbGCcqqGGaaicqqGVbWBcqqGMbGzcqqGGaaicqqGZbWCcqqGHbqycqqGTbqBcqqGWbaCcqqGSbaBcqqGLbqzcqqGZbWCcqqGGaaicqqGJbWycqqGVbWBcqqGUbGBcqqG0baDcqqGHbqycqqGPbqAcqqGUbGBcqqGPbqAcqqGUbGBcqqGNbWzcqqGGaaicqqGIbGycqqGVbWBcqqG0baDcqqGObaAcqqGGaaicqqGHbqycqqGUbGBcqqG0baDcqqGLbqzcqqGJbWycqqGLbqzcqqGKbazcqqGLbqzcqqGUbGBcqqG0baDcqqGGaaicqqGHbqycqqGUbGBcqqGKbazcqqGGaaicqqGJbWycqqGVbWBcqqGUbGBcqqGJbWycqqGLbqzcqqGXbqCcqqG1bqDcqqGLbqzcqqGUbGBcqqG0baDaeaacqqGUbGBcqqG1bqDcqqGTbqBcqqGIbGycqqGLbqzcqqGYbGCcqqGGaaicqqGVbWBcqqGMbGzcqqGGaaicqqGZbWCcqqGHbqycqqGTbqBcqqGWbaCcqqGSbaBcqqGLbqzcqqGZbWCcqqGGaaicqqGJbWycqqGVbWBcqqGUbGBcqqG0baDcqqGHbqycqqGPbqAcqqGUbGBcqqGPbqAcqqGUbGBcqqGNbWzcqqGGaaicqqGHbqycqqGUbGBcqqG0baDcqqGLbqzcqqGJbWycqqGLbqzcqqGKbazcqqGLbqzcqqGUbGBcqqG0baDaaGccqGGUaGlaaa@BB23@

Holdout validation and leave-one-out cross-validation tests

The present method was validated by both holdout validation and leave-one-out cross-validation (LOOCV) tests. Holdout validation derives a predictor from the training set, and uses the blind or independent test set to evaluate the predictor. LOOCV is simple n-fold cross-validation, where n is the number of samples in the dataset. Each sample is left out in turn, and the predictor is trained on all the remaining ones. The procedure is repeated for n times to obtain a mean score.

Results and discussions

Analysis of important genes

X-AI provides a feature selection function to systematically extract the relative important genes for discriminating different classes. In Table 1, the top ten genes for each training set of two datasets are listed according to the order of the chi-squared statistic. The selected genes provide input information to both subsequent functions of classification and rule development, and the small number of selected genes has a low data dimension, as well as low calculation complexity. Nevertheless, the decision of the nmber is flexible and largely depends on the analysis requirement.

In the part of L1, the importance of most genes has been discussed in the study of Golub et al. 1 and in earlier literatures. Further, Wang et al. 30 also presented additional arguments about Zyxin and PTX3, suggesting that the expression level of both plays an important or neglected role in distinguishing between ALL and AML. The selection function of X-AI has also been compared with some other selection algorithms, including information gain and symmetrical uncertainty criteria. It showed an almost the same selection in the top ten genes. In the part of L2, the average of chi-squared values is higher than that in L1. The results indicate that most of genes extracted by the selection function of X-AI agrre with earlier studies, and may be important for the class discrimination.

Table 1

Top ten genes selected by feature selection function of X-AI for two datasets

Dataset

Probe ID

Gene annotation

χ²Score

X95735

Zyxin

38.00

M55150

FAH Fumarylacetoacetate

33.54

M27891

CST3 Cystatin C (amyloid angiopathy and cerebral hemorrhage)

33.31

M31166

PTX3 Pentaxin-related gene, rapidly induced by IL-1 beta

33.31

X70297

CHRNA7 Cholinergic receptor, nicotinic, alpha polypeptide 7

29.77

U46499

GLUTATHIONE S-TRANSFERASE, MICROSOMAL

29.77

L09209_s

APLP2 Amyloid beta (A4) precursor-like protein 2

29.77

M77142

NUCLEOLYSIN TIA-1

29.77

J03930

ALKALINE PHOSPHATASE, INTESTINAL PRECURSOR

29.02

M23197

CD33 CD33 antigen (differentiation antigen)

28.95

36239_at

H. sapiens mRNA for oct-binding factor

91.08

37539_at

Homo sapiens mRNA for KIAA0959 protein, partial cds

84.51

35260_at

Homo sapiens mRNA for KIAA0867 protein, complete cds

83.72

32847_at

Homo sapiens myosin light chain kinase (MLCK) mRNA, complete cds

79.82

35164_at

Homo sapiens transmembrane protein (WFS1) mRNA, complete cds

79.46

1325_at

Homo sapiens TWIK-related acid-sensitive K+ channel (TASK) mRNA, complete cds

78.57

40191_s_at

wg66h09.x1 Homo sapiens cDNA, 3' end

77.22

39318_at

H. sapiens mRNA for Tcell leukemia

76.22

32579_at

Human transcriptional activator (BRG1) mRNA, complete cds

74.97

41715_at

H. sapiens mRNA for phosphoinositide 3-kinase

73.53

L1: the dataset of Golub et al. 1

L2: the dataset of Armstrong et al. 20

Prediction performance of system

Different tests have been applied to verify the accuracy of the classification function of X-AI. For holdout validation test, it shows the accuracy of 96% and 99% on the test sets of L1 and L2, respectively, using the ten genes as input information. I have also carried out the analysis of classification accuracy along with the corresponding number of genes by holdout validation test. Figure 3 illustrates the classification accuracy as a function of the number of selected genes. The genes were one by one included as the input information according to the order of chi-squared statistic. On the test set of dataset L1, X-AI achieves an accuracy of 98.6% using two genes, and increasing the number of genes to 10 did not further improve it. In addition, on the test set of dataset L2, the accuracy can increase to 100% using eight genes. On the one hand, the training and test sets for each dataset were combined to form a complete dataset for LOOCV test. The test yielded the accuracy of 96% and 94% for datasets L1 and L2, respectively.

Figure 3

Prediction performance of X-AI along with different number of genes on the test set of two datasets

Prediction performance of X-AI along with different number of genes on the test set of two datasets. The y-axis represents classification accuracy and the x-axis is the corresponding number of genes which were used as information in classification. L1: for the dataset of Golub et al. 1 L2: for the dataset of Armstrong et al. 20

The results show that the classification function performs well in discriminating these different classes when the input information is provided by the feature selector function of X-AI. Namely, the integration of the both functions can be feasible and effective for the binary classification and three-class problems.

Comparison with other methods

The performance comparison between X-AI and other methods has also been made on different datasets. The results provide an overall view about the performance of different methods. In Figure 4, the prediction performance is tested on dataset L1 by holdout validation. These compared methods include the weighted voting machine, which is based on a linear model 1; support vector machines (SVM) 31; the emerging patterns algorithm 32; maximal margin linear programming (MAMA) 33; four methods that combine the feature selector with machine learning algorithms 30 and six methods which have been discussed in earlier literature 34. The numbers of misclassified samples and of used genes vary from 0 to 5 and 1 to 132, respectively. This analysis shows that other methods can not dominate X-AI simultaneously on the numbers of misclassified samples and of used genes; namely, X-AI has a relatively small number of misclassified samples or used genes.

Figure 4

Comparison of prediction performance between different methods

Comparison of prediction performance between different methods. The y-axis denotes the number of samples which were misclassified by those methods on the test set of L1. The number of used genes is represented in the x-axis. Voting machine 1 SVM 31 Emerging patterns 32 MAMA 33 J48, NB, SMO-CFS, SMO-Wrapper 30 RIRLS, RPLS, RPCR, FPLS, MAVE, k-NN 34

Figure 5 shows the comparison of prediction performance on dataset L2. the classification based on correlation/ordering network 35 showed an accuracy of 100% using information of 40 genes. Other seven compared methods include three TSP-family classifiers and five machine learning methods: C4.5 decision trees (DT), Naïve Bayes (NB), k-nearest neighbor (k-NN), SVM and prediction analysis of microarrays (PAM) 19. The accuracy and the number of used genes vary from 80% to 100% and 2 to 12582, respectively. The analysis reveals that X-AI can achieve a relatively high accuracy using a small number of informative genes when comparing to these methods.

Figure 5

Comparison of prediction performance between different methods

Comparison of prediction performance between different methods. The y-axis denotes the number of samples which were misclassified by those methods on the test set L2. The number of used genes is represented in the x-axis. Classification based on correlation/ordering network 35 HC-TSP, HC-k-TSP, DT, NB, k-NN, SVM, PAM 19

Association rule development

The function of feature selection did not only reduce the number of input genes, but also improve the efficiency of rule development. It also results in a rational and acceptable number of rules. Based on the genes of Table 1, X-AI included all the samples for each dataset to establish association rules.

Tables 2 and 3 list all association rules that developed for each dataset and class. The average confidence is 99% and 97% for datasets L1 and L2, respectively, showing the high accuracy of these rules. In Table 2, the second rule means that if the expression of M23197 (CD33) is larger than 401.5, then the sample is classified as ALL. For dataset L1, 29.17% samples contain the antecedent of this rule and all these samples are correctly classified. This rule efficiently reveals the importance of the gene in discriminating between AML and ALL. This finding is in accord with the results of earlier studies 119. Further, I observed the occurrence of genes among the rules, which may related to their importance. Interestingly, the gene X95735 (Zyxin) has a highest percentage of occurrence (30%) and Wang et al. 30 also gave a detailed discussion about its role in leukemia. In Table 3, the gene 1325_at (TASK) also has a high percentage of occurrence (24%). However, it may need more comparative studies for validation.

Table 2

Two different classes of rules generated from dataset L1

Consequent

Antecedent

Support (%)

Confidence (%)

ALL

L09209_s > 1056.5 & M23197 > 326.0

30.56

100

M23197 > 401.5

29.17

100

M27891 > 2096.5

27.78

100

X95735 > 994.0 & M55150 > 1250.5

27.78

100

X95735 > 994.0

36.11

AML

U46499 < 154.5

59.72

100

L09209_s < 992.5

58.33

100

X95735 < 994.0

63.89

Mean

41.67

Table 3

Three different classes of rules generated from dataset L2

Consequent

Antecedent

Support (%)

Confidence (%)

ALL

32847_at > 147.0

30.56

100

36239_at > 2201.0

27.78

100

AML

39318_at < 1063.0 & 32579_at < 2285.0

34.72

100

1325_at < 1501.5, 39318_at < 1063.0 & 32579_at < 2285.0

34.72

100

1325_at < 1501.5, 36239_at < 214.0 & 40191_s_at < 508.5

33.33

100

36239_at < 214.0 & 40191_s_at < 508.5

33.33

100

39318_at < 1063.0 & 35164_at < -794.5

31.94

100

40191_s_at < 519.0 & 36239_at < 167.0

31.94

100

1325_at < 1501.5, 39318_at < 1063.0 & 35164_at < -794.5

31.94

100

1325_at < 1501.5, 40191_s_at < 519.0 & 36239_at < 167.0

31.94

100

1325_at < 1501.5, 36239_at < 214.0 & 37539_at < -362.0

31.94

100

36239_at < 214.0 & 37539_at < -362.0

31.94

100

37539_at < -725.5

29.17

100

32579_at < 2285.0

36.11

1325_at < 1501.5 & 32579_at < 2285.0

36.11

36239_at < 214.0

40.28

MLL

1325_at < 201.0, 35260_at > 794.5 & 40191_s_at > 1107.5

19.44

100

1325_at < 201.0 & 36239_at > 214.0

23.61

1325_at < 201.0

37.50

Mean

32.02

Web server for cancer classification

I have also developed a web server for classifying tumors of acute leukemia and it is freely available at http://bioinformatics.myweb.hinet.net/xai.htm. The prediction can be made by taking four simple steps (see Figure 6): (i) select "Prediction" from the main page to open an input subpage, (ii) select a set of input genes, (iii) input the expression values for each gene, and (iv) press the "Submit" button to start the service.

Figure 6

Snapshot of the prediction page of web service for cancer classification

Snapshot of the prediction page of web service for cancer classification.

Because X-AI selected two different sets of input genes from two datasets for training the classifiers, it results in two classifiers with different sets of input genes. Users can optionally assign one of both to predict cancer classes. In addition to the cancer classification page, the web server has provided help and reference pages for interested researchers.

Conclusion

In this study, I have proposed an integrated method for accurate cancer classification, relevant gene selection, and the associate rule development from DNA microarray data. Applying the concepts of system design, the modules in the present architecture are tight cohesion and loose coupling.

Through different tests, the method shows high classification accuracy on two leukemia datasets. In addition, the selected genes and the generated rules are in accord with recent studies. The results suggest that the method can effectively integrate these related functions for the analysis of microarray data.

Competing interests

The author declares that they have no competing interests.

Acknowledgements

This work was supported by grant no. NSC97-2221-E-451-013 from the National Science Council, Taiwan, ROC. I would like to thank Dr. Chang-Sheng Wang for critical reading, and reviewers for providing valuable comments to improve the manuscript.

Molecular classification of cancer: class discovery and class prediction by gene expression monitoring Golub TR Slonim DK Tamayo P Huard C Gaasenbeek M Mesirov JP Coller H Loh ML Downing JR Caligiuri MA Bloomfield CD Lander ES Science 1999 286 5439 531 537 10.1126/science.286.5439.531 10521349 Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays Alon U Barkai N Notterman DA Gish K Ybarra S Mack D Levine AJ Proc Natl Acad Sci USA 1999 96 12 6745 6750 21986 10359783 10.1073/pnas.96.12.6745 Recursive partitioning for tumor classification with gene expression microarray data Zhang H Yu CY Singer B Xiong M Proc Natl Acad Sci USA 2001 98 12 6730 6735 34421 11381113 10.1073/pnas.111153698 Deriving quantitative conclusions from microarray expression data Olshen AB Jain AN Bioinformatics 2002 18 7 961 970 10.1093/bioinformatics/18.7.961 12117794 Gene-expression profiles in hereditary breast cancer Hedenfalk I Duggan D Chen Y Radmacher M Bittner M Simon R Meltzer P Gusterson B Esteller M Kallioniemi OP Wilfond B Borg A Trent J Raffeld M Yakhini Z Ben-Dor A Dougherty E Kononen J Bubendorf L Fehrle W Pittaluga S Gruvberger S Loman N Johannsson O Olsson H Sauter G N Engl J Med 2001 344 8 539 548 10.1056/NEJM200102223440801 11207349 Diagnosis of multiple cancer types by shrunken centroids of gene expression Tibshirani R Hastie T Narasimhan B Chu G Proc Natl Acad Sci USA 2002 99 10 6567 6572 124443 12011421 10.1073/pnas.082099299 Linear regression and two-class classification with gene expression data Huang X Pan W Bioinformatics 2003 19 16 2072 2078 10.1093/bioinformatics/btg283 14594712 PCA disjoint models for multiclass cancer analysis using gene expression data Bicciato S Luchini A Di Bello C Bioinformatics 2003 19 5 571 578 10.1093/bioinformatics/btg051 12651714 Classification of microarray data with factor mixture models Martella F Bioinformatics 2006 22 2 202 208 10.1093/bioinformatics/bti779 16287938 Consensus analysis of multiple classifiers using non-repetitive variables: diagnostic application to microarray gene expression data Su Z Hong H Perkins R Shao X Cai W Tong W Comput Biol Chem 2007 31 1 48 56 10.1016/j.compbiolchem.2007.01.001 17303535 Knowledge acquisition and development of accurate rules for predicting protein stability changes Huang LT Gromiha MM Hwang SF Ho SY Comput Biol Chem 2006 30 6 408 415 10.1016/j.compbiolchem.2006.06.004 17000135 Sequence analysis and rule development of predicting protein stability change upon mutation using decision tree model Huang LT Gromiha MM Ho SY Journal of Molecular Modeling 2007 13 8 879 890 10.1007/s00894-007-0197-4 17394029 iPTREE-STAB: interpretable decision tree based method for predicting protein stability changes upon mutations Huang LT Gromiha MM Ho SY Bioinformatics 2007 23 10 1292 1293 10.1093/bioinformatics/btm100 17379687 Mining molecular fragments: finding relevant substructures of molecules Borgelt C Berthold MR The 2002 IEEE international Conference on Data Mining, Washington, DC 2002 51 58 Extraction of knowledge on protein-protein interaction by association rule discovery Oyama T Kitano K Satou K Ito T Bioinformatics 2002 18 5 705 714 10.1093/bioinformatics/18.5.705 12050067 Mining gene expression databases for association rules Creighton C Hanash S Bioinformatics 2003 19 1 79 86 10.1093/bioinformatics/19.1.79 12499296 Integrated analysis of gene expression by Association Rules Discovery Carmona-Saez P Chagoyen M Rodriguez A Trelles O Carazo JM Pascual-Montano A BMC Bioinformatics 2006 7 54 1386712 16464256 10.1186/1471-2105-7-54 Simple rules underlying gene expression profiles of more than six subtypes of acute lymphoblastic leukemia (ALL) patients Li J Liu H Downing JR Yeoh AE Wong L Bioinformatics 2003 19 1 71 78 10.1093/bioinformatics/19.1.71 12499295 Simple decision rules for classifying human cancers from gene expression profiles Tan AC Naiman DQ Xu L Winslow RL Geman D Bioinformatics 2005 21 20 3896 3904 1987374 16105897 10.1093/bioinformatics/bti631 MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia Armstrong SA Staunton JE Silverman LB Pieters R den Boer ML Minden MD Sallan SE Lander ES Golub TR Korsmeyer SJ Nat Genet 2002 30 1 41 47 10.1038/ng765 11731795 Comparison of discrimination methods for the classification of tumors using gene expression data Dudoit S Fridlyand J Speed T Technical Report 576, Statistics Dept, UC Berkeley 2000 Machine learning methods for predictive proteomics Barla A Jurman G Riccadonna S Merler S Chierici M Furlanello C Brief Bioinform 2008 9 2 119 128 10.1093/bib/bbn008 18310105 Structured design: fundamentals of a discipline of computer program and systems design Yourdon E Constantine LL Englewood Cliffs, N.J., Prentice Hall 1979 A practical approach to microarray data analysis Berrar DP Dubitzky W Granzow M Boston, MA, Kluwer Academic Publishers 2003 12603013 Chi2: Feature Selection and Discretization of Numeric Attributes Huan L Rudy S Seventh International Conference on Tools with Artificial Intelligence (ICTAI) 1995 388 Data Mining: Practical machine learning tools and techniques Witten IH Frank E San Francisco, Morgan Kaufmann 2 2005 Theodoridis S Koutroumbas K Pattern recognition Amsterdam; Boston, Elsevier/Academic Press 3 2006 Analysis and prediction of protein folding rates using quadratic response surface models Huang LT Gromiha MM Journal of Computational Chemistry 2008 29 10 1675 1683 10.1002/jcc.20925 18351617 An information theoretic approach to rule induction from databases Smyth P Goodman RM Knowledge and Data Engineering, IEEE Transactions on 1992 4 4 301 316 10.1109/69.149926 Gene selection from microarray data for cancer classification – a machine learning approach Wang Y Tetko IV Hall MA Frank E Facius A Mayer KF Mewes HW Comput Biol Chem 2005 29 1 37 46 10.1016/j.compbiolchem.2004.11.001 15680584 Support vector machine classification and validation of cancer tissue samples using microarray expression data Furey TS Cristianini N Duffy N Bednarski DW Schummer M Haussler D Bioinformatics 2000 16 10 906 914 10.1093/bioinformatics/16.10.906 11120680 Identifying good diagnostic gene groups from gene expression profiles using the concept of emerging patterns Li J Wong L Bioinformatics 2002 18 5 725 734 10.1093/bioinformatics/18.5.725 12050069 Optimization models for cancer classification: extracting gene interaction information from microarray expression data Antonov AV Tetko IV Mader MT Budczies J Mewes HW Bioinformatics 2004 20 5 644 652 10.1093/bioinformatics/btg462 15033871 Classification using partial least squares with penalized logistic regression Fort G Lambert-Lacroix S Bioinformatics 2005 21 7 1104 1111 10.1093/bioinformatics/bti114 15531609 Topology-based cancer classification and related pathway mining using microarray data Liu CC Chen WS Lin CC Liu HC Chen HY Yang PC Chang PC Chen JJ Nucleic Acids Res 2006 34 14 4069 4080 1557825 16914437 10.1093/nar/gkl583