Data Analysis Basics
There are a variety of ways data can be analyzed. Choosing appropriate methods is important. Presenting (displaying) and reporting (interpreting) data properly is also essential.
Descriptive Statistics
Descriptive statistic are used to summarize information obtained from the sample without making any direct claims about the population. Descriptive statistics are used to present the sample data in more meaningful ways, which helps us understand and interpret the data later. While descriptive statistics are meant to summarize and present survey results, you may want to point out interesting aspects or patterns in the findings, but you don’t make explicit inferences or generalizations about the population yet. Common visualizations of survey results include bar chart, frequency distributions, or a pie chart. Tables can also be useful for displaying descriptive data.
Inferential Statistics
Inferential statistics are used to draw conclusions (inferences or generalizations) about the population from which a sample was drawn. Statistical techniques will use confidence intervals (margin of error), regressions (predictions), or hypothesis testing (involving statistical and practical significance) to estimate something about the population based on the sample.
Statistical significance and Practical significance are determined to provide evidence that the result has some importance. Statistical significance refers to the probability that observations in the sample may have occurred due to chance. Given a large enough sample, despite seemingly insubstantial results, one might still find a satisfatory level of statistical significance. Practical significance, on the other hand, looks at whether the magnitude of the observation is large enough to be of considered substantial. For example, when considering the difference between the mean of two groups, you might find that a difference of 1% is statistically significant (e.g., has only a 5% chance of occuring due to chance) but realize that the magnitude of this difference has no practical significance (i.e., the difference is not really that difference in practical terms).
Types of Data
Prior to conducting your data analysis, you need to make sure you understand the type of data you have so you can select appropriate statistical methods. For certain types of data it is inappropriate to use some statistical analysis.
There are four basic types of data although many statistical programs combine interval and ratio data (calling it scale data) as the statistical methods used with these types of data tend to be the same.
Nominal data might best be described as categorical. It is the most basic type of information you might collect in a survey. Rules are used to specify membership in a category. Frequency (group size, counting) and proportional information (percentages) are used to report these types of data. These types of data are also commonly used to disaggregate data when comparing groups. However, when making group comparisons, it is best that group memberships rules make it so that groups are mutually exclusive (i.e., no individual is a member of both groups being compared).
Ordinal data has some sense of order, but the intervals between point on these types of scales are not equidistance. For example, placement results or preference (i.e., 1^{st}, 2^{nd}, and 3^{rd}) have an order, but differences between various points on the scale are not consistent (first and second choices may be close but both might be far more preferred than anything that comes next). Computing the mean and standard deviation for ordinal data is discouraged and, in most cases, inappropriate (although some researchers regularly compute averages for results obtain from Likert scales); frequencies (mode) and proportions (percentages) are best used when describing results based on this type of data along with ranking results. When making inferences, some nonparametric statistical procedures might also be appropriate.
Scale Data (Interval and Ratio) has all the properties of nominal and ordinal data but also has the characteristic of equal intervals; and in the case of ratio level data, a true zero point. This means the distance between each point on the numeric scale being used is the same regardless of where on the scale you look. For ratio level data, this also means that comparisons can be made about differences in magnitude (e.g., twice as much). It is appropriate to calculate the mean and standard deviation of scale level data. You can add and subtract interval level data; but you can also multiply and divide ratio level data. With scale data, in addition to means and standard deviations, inferential statistics can be used including t-tests, correlations, regression analysis.
Type and Characteristic |
Typical Applications |
Scale Characteristics Possessed |
|||
Identity |
Order |
Distance |
Origin |
||
Nominal – identification or classification |
Gender School number Geographical location |
⊗ | |||
Ordinal - specifies order or rank |
Brand preference Placement Agreement (Likert scales) |
⊗ | ⊗ | ||
Interval – specifies order based on equidistant intervals (implies equal increments of measurement) |
IQ, test scores Degree F° and C° Time of day |
⊗ | ⊗ | ⊗ | |
Ratio – interval data with a zero point denoting an absence of the characteristic being measured. |
# correct, Units sold Distance, Time (amount) Height, Weight, Age Degrees K° |
⊗ | ⊗ | ⊗ | ⊗ |
Data Visualization
How you present results is important. Primarily used with descriptive statistics, tables, graphs and charts are used to summarize information in a readable format. These presentation methods not only organized large amounts of information, they can also help focus readers attention to patterns and important findings. They are often the basis from which inferential statistics are calculated. While this course does not elaborate the data visualization theories and practices, several resources can be found to help develop data visualization skills (see references for some examples).
Chapter Summary
- Descriptive Statistics are used to summarize survey results.
- Inferential Statistics provide evidence used to support conclusions (inferences or generalizations).
- Data obtained from a survey will fall into various data types (Nominal, Ordinal, Interval or Ratio).
- The appropriatenss of the statistical analyiss used is determined by the characteristics of the data (i.e., type of data).
- In survey research, perhaps the most controversial statistical issue pertains to whether data obtained from Likert scales can be used as interval level data (i.e., assinging numbers to responses and averaging the findings).
- Data visualization theory and practices are extremely important for presenting descriptive statistics effectively.
References
Evergreen, S. D. H. (2018) Presenting Data Effectively, 2nd Edition. Sage Publishing.
Evergreen, S. D. H. (2019) effective Data Visualization: the right chart for the right data, 2nd Edition.Sage Publishing.
Data Visualization Presentation: Choosing Charts
Knaflic, C. N. (2015). Storytelling with Data: a data visualization guide for buisness professionals. Wiley Publishing.
End-of-Chapter Survey
: How would you rate the overall quality of this chapter?- Very Low Quality
- Low Quality
- Moderate Quality
- High Quality
- Very High Quality