Data Mining Orange program

Data Mining Orange program Objective The purpose of this project is to familiarize you with the process of data mining using a modern programming toolkit to apply numerous data mining strategies. Tools This project uses Orange, a suite of data mining tools interfaced via C++, Python or through GUI widgets. Deliverables This project will require you to do five things: 1. Read and briefly summarize all documents on the reading list. • Summarize the following • What is data mining • Orange as a Data mining tool • Basic Data Manipulation and Preparation • Visualization • Data modeling • Evaluation of model performance 2. Using the tutorial and documentation examples as a guide, complete your own data mining process against a dataset of your choosing. Your Own Data Mining Process After you've completed step 1 above, you should have a good understanding of what tools are available to you in Orange. Now it's time to try some of these approaches on a dataset of your own choosing. For this part of the project, you must: • Choose and explore a dataset. You can use any of the ones provided in orange or import your own dataset. • Select at least 3 data mining strategies and apply them to the dataset. • Describe your intent, approach and results. • Lastly, did you discover anything meaningful or surprising? If so, document your findings. If not, describe what you might do next to refine your process or choose different/improved mining strategies. Your data mining process doesn't have to be perfect, or even yield incredibly interesting results; the important thing is the process. So don't be afraid to try something fun even if it may not yield amazing results. 3. Submit complete documentation of items 1 and 2 above. Reading List Data Mining, Material for lectures on Data mining, at Kyoto University, Dept. of Health Informatics: http://eprints.fri.uni-lj.si/1150/1/DataMining-Kyoto.pdf A Data Mining Tutorial: http://maths-people.anu.edu.au/~steve/pdcn.pdf Functional Genomics Workshop http://docs.orange.biolab.si/_downloads/bio-tutorial.pdf Data Mining OrangeHeart DiseaseDataset 1 ProblemDescription Thedatasetusedinthisexerciseistheheartdiseasedatasetavailableinheart_disease.tabobtained from the Orange datasets repository. This dataset describesriskfactorsforheartdisease.Theattributediameter narowingrepresentsthe(binary)classattribute: class 1 means there is diameter narrowing; class 0 indicates no diameter narrowing. The main aim of this exercise is to predict heart disease in terms of diameter narrowing from the otherattributesinthedataset.Obviously,thisisaclassificationproblem.ThesoftwaretobeusedisOrange.However,feelfreetotryanyideasyoumayhavetotackletheproblemwithanyothersoftware. The description of this exercise is stepwise. Therefore, I hope you can getabetterunderstandingofthevariousaspectsandquestionsinvolvedintheKDD(Knowledge Discovery in Databases) process. 1.1 DataUnderstanding The first step in approaching the problem is to get acquainted with thedata.Answeringthefollowingquestionswillhelpyoutobetterunderstandthedata.Thedatafileheart_disease.tabcontainssomeinformationaboutthedatastoredin it. Load the data file inOrange. 1. Foreachattributefindthefollowinginformation. (a) The attribute type, e.g. nominal, ordinal,numeric. (b) Percentageofmissingvaluesinthedata. (c) Max, min, mean, standarddeviation. (d) Arethereanyrecordsthathaveavaluefortheattributethatnoother recordhas? (e) Study the histogram at the lower right and informally describehowtheattributeseemstoinfluencetheriskforheartdisease.Whatdoesitmeanthepop-upmessagesthatappearwhendraggingthemouseover thegraphic? (f) Are there any outliers for the attribute underconsideration? i. InvestigatethepossibilityofusingtheOrange widgetsto detectoutliers. 2. Use Visualize widgets to visualize 2D-scatter plots for each pair of attributes. (a) Which attributes seem to be the most/least linked to heartdisease?Summarize in a table your findings concerning the predictivevalueof eachattribute. (b) Does any pair of attributes seem to be correlated? 3. Investigate also possible multivariate associations of attributes with the class attribute, i.e. study scatter plots of two attributes X and Y and try to identify possible ”dense” heart disease areas (if any). (a) Ifyoufind”dense”heartdiseaseareasinanyscatterplotthenquantifytheheartdiseaserateintheseareaswithrespecttotheentire dataset. 1.2 Data Preprocessing The second step is to preprocess the data such that the transformed data isinamoresuitableformfortheminingalgorithms. 1. Attributeselection. Investigate the possibility of using the widget AttributeSelectionfor selecting a subset of attributes with good predicting capability.Then,describebrieflythewidgetyouusedandcomparetheresultsyouobtainedwiththeconclusionsyouobtainedintheprevioussection. 2. Handling missing values. Consider the following methods for handling missing values and investigate each possibility within Orange. Note that, as rule of thumb, if an attribute has more than 5% missing values then the records should not be deleted and it is advisable to impute values where data is missing, using a suitable method. (a) Replace the missing values by the attribute mean, if the attributeis numeric. Otherwise, replace missing values by attribute mode(ifthe attribute is categorical). Save the dataset you obtainedwithoutmissing values in the file heart-disease2.tab. (b) Investigate the possibility of using (linear) regression to estimate the missing values for each attribute. Save the dataset you obtained without missing values in the file heart_disease3.tab 3. Eliminating outliers. (a) Eliminate the outlier records and save the dataset you obtained without outliers in the file heart_disease4.tab 1.3 Mining the Data The third step is to use some classifier algorithms available in Orange to discover hidden patterns in the data. You should repeat the steps described below for each of the datasets you created during preprocessing, besides using also the original dataset (if possible). 1. Use more than one classifier (Decision Tree, SVM, K Nearest Neighbor) (a) What can you conclude? Compare your conclusions with your previous conclusions obtained in section 1.1. (b) Compare the accuracy of the classifier on the training set with the accuracy estimation obtained through 10 fold-cross validation. How do you explain the difference (if any)? (b) Describe the patterns you obtained and compare with your previous conclusions. 1.4 Clustering Tendency Investigate whether there is a clustering tendency in the dataset. You may start by clustering the data with K Means Clustering algorithm. 1. Do not use the class attribute, diameter narrowing for clustering. 2. Find a suitable value for k, i.e. the number of clusters you are going to build. Justify your choice of k. 1.5 Predicting Performance In the previous step you have built several models. Finally, you need to compare the different models and describe your final conclusions. 1. Orange outputs several performance measures. Choose some of the performance measures and motivate your choice. 2. Summarize in a table the performance measures for each classifier and each dataset. 3. What can you conclude? 1.6 Conclusions Describe your final conclusions and indicate which risk factors for heart disease have you found in the data.