8/07/2015

Meaningful Data


This article has been dedicated to and is inspired by Robina Towers to whom I owe a debt of gratitude...

So, meaningful data... WOW... this is a huge area to explore in one article but will become a boring read if I write more than one article... here goes...

What is meaningful data?

While the term meaningful has different meanings to different people, this phrase pertains to that data which supports (defends) the conclusion(s) one has drawn.

Sounds relatively simple doesn't it?

And, therein lies its deception.

In 1966, when I attended college, we did not have computers or the internet and relied on the Library (Now referred to as an LRC) in which to conduct our research. When we found a piece of data (in the form of a quote or sentence) in order to prove its credibility, we needed to find it in 3 additional reference books.

What is interestingly silly to me is that once we found this same data in 3 other sources then it became “common knowledge” and there was no need (technically) to reference that material with citations; however, our over-zealous professors wanted to make sure that we could properly use MLA or APA protocols in case we decided to pursue a PhD in our respective fields of study.

Of course, they were making a huge conclusion about us without in supporting data but we were paying them to make us “WISE.”

It is here that I need to point out that Rabina Towers questioned some of the data in my Joys of Teaching article and in so doing forced me to realized that I had not established the credibility of my source or of the information, thereby drawing on the reader's emotions to support my conclusions.

And, of course, she was right... hence, this article.

Let's shift our focus to the manufacturing sector of our economy as we journey through the storage fields of meaning data.

In manufacturing in a very simplistic way, we build something, inspect it, check it again, and ship it out and that process is costly and time consuming because it is labor intensive.

A few years ago, it was discovered that we could systematically but randomly select 5 or more sequential items that were being manufactured and measure certain parameters to ascertain it they adhered to specification and if they did, we could then predict that your production would remain the same for the next, maybe two, and in some cases maybe 4 hours.

This process substantially reduced out costs.

However, the blue collar worker, who was the one who took these measurements saw this as something extra he/she had to do without getting any additional pay; therefore, he paid attention and soon realized or had a general idea of what management was looking for, so instead of measuring anymore, he/she simply recorded numbers that were in the expected range, not really knowing if they were that way or not.

Management would then look at the data that had been collected and statistically presented to them and drew important conclusions that were totally predicated upon that data... which in many cases were simply wrong.

This is an example of data that is not meaningful.

Let's move from this field of meaningful data to an educational field of meaningful data, shall we?

It is common practice in Higher Education for each School/Department Dean to administer a Student Survey to its students at the conclusion of each semester.

Sadly, students have to almost be threatened with not getting their final grades to get them to fill out this survey.

WHY? And, why is an IMPORTANT question here...

Because nothing ever changes and the same bad professors that we complain about are still teaching... so, why take the time to complete the survey, they tell me? When forced, they simply circle/check indicating everything was fine.

Deans who get this information and actually read this information (which is rare) call all the faculty members together for a special meeting telling everyone the results, congratulating us on those results, saying each of us deserve a pat on the back.

In some cases, Deans use this information to grant tenure and to secure raises for some faculty members.

These PhDs never stop to consider that the data might not be meaningful...

When I was Dean of several Proprietary Colleges where surveys were the “ritual” to follow at the end of each semester or quarter, I would also visit classes and watch my instructors teach for 30-60 minutes at a time.

For new instructors, I would visit every month the first quarter, then every quarter for as long as they taught for me.

Why did I do this?

Because I wanted to see what my money bought me... and no, I did not base my decision to keep them on the payroll as a result of student surveys.

And yes, it took me an enormous amount of time each quarter to conduct those in-class observations but I saw that as an integral part of my job even though it was not listed as part of my duties.

You, the reader, might find this interesting... or, maybe not so much, but for the last 3 years of my career I taught at Carson-Newman University which is a respected Christian University but not once during those 3 years, did anyone visit my class for any type of observations to determine what kind of instructor I was.

However, they did base their decision to terminate me based upon the email of ONE student who complained that I was being too negative about my employer. Incidentally, the unemployment agency that processed me to receive/not receive unemployment insurance found NO EVIDENCE to support a claim of misconduct when Carson-Newman University tried to defend their decision.

This is an example of not having meaningful data on which to make decisions.

When I taught classes to business and industry in the area of Statistical Problem Solving using SPC charts or Statistical Process Control charts, I would show them how reviewers of data could determine if the data was accurate or not... meaning the employee had “fudged” the data or had not been properly trained.

In short, SPC looks at the average of the data collected, then creates limits of control based upon +/- 3 standard deviations which captures 99.7% of the possible data variation. If they were to conduct what is called ZONE ANALYSIS which breaks down each of the 3 standard deviations, only 68% of the data should fall within the limits of the first +/- standard deviation.

If there is more, then the data has typically been fudged by the employee for whatever reason.

This analysis of meaningful data can take place in manufacturing as well as: non manufacturing, education, healthcare, service, travel, tourism, government, military, transportation, agriculture, legal, CPAs, etc.

In short, it applies EVERYWHERE.

And, since it applies everywhere, there is going to be an everywhere need to make sure the data that is being collected is meaningful...


No comments: