Regular Expressions

Always helpful when R user groups put their presentations online and I find regular expressions very useful for data munging.

regex-presentation_ed_goodwin

Common Statistical Errors

Check out this journal article  (pdf) on common statistical errors in medical experiments. Don't worry this is only the medical research that's meant to keep you alive and the statistical tests that prove its effectiveness are often not up to scratch. Anyway below are the errors that they identified. 

Statistical errors and deficiencies related to the design of a study

• Study aims and primary outcome measures not clearly stated or unclear

• Failure to report number of participants or observations (sample size)

• Failure to report withdrawals from the study

• No a priori sample size calculation/effect-size estimation (power calculation)

• No clear a priori statement or description of the Null-Hypothesis under investigation

• Failure to use and report randomisation

• Method of randomisation not clearly stated

• Failure to use and report blinding if possible

• Failure to report initial equality of baseline characteristics and comparability of study groups

• Use of an inappropriate control group

• Inappropriate testing for equality of baseline characteristics

Statistical errors and deficiencies related to data analysis

• Use of wrong statistical tests

• Incompatibility of statistical test with type of data examined

• Unpaired tests for paired data or vice versa     

• Inappropriate use of parametric methods

• Use of an inappropriate test for the hypothesis under investigation

• Inflation of Type I error

• Failure to include a multiple-comparison correction

• Inappropriate post-hoc Subgroup analysis

• Typical errors with Student’s t-test

• Failure to prove test assumptions

• Unequal sample sizes for paired t-test

• Improper multiple pair-wise comparisons of more than two groups

• Use of an unpaired t-test for paired data or vice versa

• Typical errors with chi-square-tests

• No Yates-continuity correction reported if small numbers

• Use of chi-square when expected numbers in a cell are <5

• No explicit statement of the tested Null-Hypotheses

• Failure to use multivariate techniques to adjust for confounding factors 

Errors related to the documentation of statistical methods applied

• Failure to specify/define all tests used clear and correctly

• Failure to state number of tails

• Failure to state if test was paired or unpaired

• Wrong names for statistical tests

• Referring to unusual or obscure methods without explanation or reference

• Failure to specify which test was applied on a given set of data if more than one test was done

• “Where appropriate” statement

Statistical errors and deficiencies related to the presentation of study data

• Inadequate graphical or numerical description of basic data

• Mean but no indication of variability of the data

• Giving SE instead of SD to describe data

• Use of mean (SD) to describe non-normal data

• Failure to define ± notion for describing variability or use of unlabeled error bars

• Inappropriate and poor reporting of results

• Results given only as p-values, no confidence intervals given

• Confidence intervals given for each group rather than for contrasts

• “p = NS”, “p <0.05” or other arbitrary thresholds instead of reporting exact p-values

• Numerical information given to an unrealistic level of precision

Statistical errors and deficiencies related to the interpretation of study findings

• Wrong interpretation of results

• “non significant” interpreted as “no effect”, or “no difference”

• Drawing conclusions not supported by the study data

• Significance claimed without data analysis or statistical test mentioned

• Poor interpretation of results

• Disregard for Type II error when reporting non-significant results

• Missing discussion of the problem of multiple significance testing if done

• Failure to discuss sources of potential bias and confounding factors

Pick a number any number

I was looking at GDP per person the other day on the UN HDI website and I thought the data was quite interesting. Not least because there were lots of incomplete data for the 1980 figure compared to the the 2010 one. This appeared partly because they didn't have the data for whatever reason but also because there have been a lot of  new countries created since 1980.

Anyway I thought it would be good to analyze the data to see which countries had done well or not so well economically over the last 30 or so years. The results were in themselves interesting, more on which in another post but I did notice a particularly striking finding.

> cor(Y1980, newgdp, method = "pearson")
[1] 0.7785629
> cor(Y1980, newgdp, method = "spearman")
[1] 0.9456404
> cor(Y1980, newgdp, method = "kendall")
[1] 0.8039875

With the type of data I had. Two continuous variables I needed to do a test of correlation on them. I actually had a look at all three tests Pearson, Spearman and Kendall as you can see above and the difference in the results on the same data did suprise me somewhat. So getting the statistical test right is important as the differences can be large.

4 Ways

Plotting the data by country rather than by point is informative but is bunched in the bottom left.

One potential way to solve the problem of overcrowding is to facet the data by region.

The use of points here solves the problem of overcrowding but it makes it far too hard to compare the slope of the regression line.

 

I think this is the most effective implementation as having the regression lines for each region shows effectively the rise of Asia, the unchanging poverty of Africa and the malaise in the Middle East.

Here's the code

# 1st plot
 
E <- ggplot(wecon30, aes (A1980, B2010))
+ geom_smooth(method=lm, se=FALSE)
+ xlab("1980 GDP per person US dollars purchasing power parity")
+ ylab("2010 GDP per person US dollars ppp")
+ opts(title = "GDP per person 1980 & 2010")
+ geom_text(aes(label=Economy, x = A1980, y = B2010),colour="black", size=3)
 
 
# 2nd plot
 
E + facet_grid(continent ~ .)
 
 
# 4th plot
 
F <- ggplot(wecon30, aes (A1980, B2010, color=Continent))
+ geom_smooth(method=lm, se=FALSE)
+ xlab("1980 GDP per person US dollars purchasing power parity")
+ ylab("2010 GDP per person US dollars ppp")
+ opts(title = "GDP per person 1980 & 2010")
+ geom_point(pch=19)
 
 
# 3rd plot
 
F + facet_grid(Continent ~ .)

Created by Pretty R at inside-R.org


More on this tomorrow...

#Rstats code that makes you go YES!

In an ideal world we would get all the data we need in exactly the right format. But this is not an ideal world. Data is often put together for purposes different from what you want to use it for or it might just be messy. There are people in this world who want to put footnote numbers in all the cells of your data and yes they are free to roam the streets and do this.

So when I found out how to use a regular expression to obliterate their legacy it felt great. Data providers please note it's not helpful to have a number in a spreadsheet for arguments sake 2389 and then add a digit of white space and the number one after to create the monster that is 2389 1.

My solution  below uses gsub which covers all instances or sub if you just want to change the first one . It works with the pattern you want to find first, then the replacement  and finally the name of the data.  I thought it could remove all the 1's at the start of main numbers I wanted to keep but it didn't. Phew!

> gsub( " 1"," " , MyData$variablename)

Being able to remove one object is something you learn early on. Later on you want to have a clear out and then you find out how to obliterate everything. That will carry you so far but what I have been hankering after for a bit is something to remove everything except the object you're still interested in working on.

 
> rm(list=setdiff(ls(), "MyData"))

Working with categorical data I wanted a way to easily count the number of each category in a single variable. Indeed there should be a function called count but there isn't. For instance if you wanted to know from a gender variable  how many men and women there were. Still there is summary that still does the job if you put the data frame and variable name  

>summary(MyData$variablename)

Basic Matrices in R

> # create a 4x3 matrix 
> a=matrix(c(1,2,3,4,5,6,7,8,9,10,11,12), nrow=4)
> a
     [,1] [,2] [,3]
[1,]    1    5    9
[2,]    2    6   10
[3,]    3    7   11
[4,]    4    8   12
> #arrange the numbers by row
> a=matrix(c(1,2,3,4,5,6,7,8,9,10,11,12), nrow=4, byrow=T)
> a
     [,1] [,2] [,3]
[1,]    1    2    3
[2,]    4    5    6
[3,]    7    8    9
[4,]   10   11   12
> # Combine 2x2 matrix by row and column
> e = matrix(c(1,2,3,4),nrow=2)
> f = matrix(c(5,6,7,8),nrow=2)
> e
     [,1] [,2]
[1,]    1    3
[2,]    2    4
> f
     [,1] [,2]
[1,]    5    7
[2,]    6    8
> cbind(e,f)
     [,1] [,2] [,3] [,4]
[1,]    1    3    5    7
[2,]    2    4    6    8
> rbind(e,f)
     [,1] [,2]
[1,]    1    3
[2,]    2    4
[3,]    5    7
[4,]    6    8
> # Take a single digit subset from Matrix a Row 3 Column 2
> a[3,2]
[1] 8
> # Take a 2x3 subset of Matrix a, change the numbers and then combine back in to the original.
> a[c(3,4),c(1,2,3)]
     [,1] [,2] [,3]
[1,]    7    8    9
[2,]   10   11   12
> a[c(3,4),c(1,2,3)] = matrix(c(1,2,3,4,5,6),nrow=2)
> a
     [,1] [,2] [,3]
[1,]    1    2    3
[2,]    4    5    6
[3,]    1    3    5
[4,]    2    4    6

Created by Pretty R at inside-R.org

More here