CS 6023 Research Methods and Presentations
Chapter 4
Copyright 1996, 1997, 1998, 1999
Richard Halstead-Nussloch
All Rights Reserved
Agenda
Gathering data and findings--the basics
Data, findings, information, and knowledge
Reading as secondary research
Measuring as primary research
Measurement
Proposals
Reporting, logs, and study plans
Gathering Data and Findings--The Basics
Pivot time
Chapter--Add measuring to reading
Activity--Scientific consumers to producers
Scientists
Set information goals
Read
Measure
Data, Findings, Information, and Knowledge
It all starts with an Information Goal
Data
Produced through measurement and analysis
Used through reading and re-analysis
Findings
Produced through reading others’ data
Used through re-analysis and re-interpretation
Data, Findings, Information, and Knowledge
It all starts with an Information Goal
Information (little-r research product pg 8)
Developed through information model
Used through reading and applying
Knowledge (Big-R Research product pg 8)
Produced by applying information model to extend the body of scientific knowledge
Used through reading and applying
Reading as Secondary Research
Make reading deep--develop your internal information model
A good way is to write and organize a log
Topic domain (contents)
Application and recommendations
Rhetoric
Research methodology
Measures and scales
Converging, scientific evidence
Exercise Page 56
Update your final project information goals?
Update your methodology?
Secondary
Primary
Measurement
Measurement is the assignment of numbers to represent an object or a property of an object.
Requires an understanding of:
Numbers
Objects and properties
The assignment of numbers to objects and properties
Numbers
Have Structure
Order--1 is before 2 is before 3…
Distance--Differences between numbers are ordered and can represent the distance between two objects on a property
Origin--Numbers have a zero
Objects and Properties
We "know" objects by their properties
Assignment of Numbers to Objects and Properties
When we measure something, we assign a number to one or more of its properties
Types of scales
Kinds of measurements
Types of Scales
Nominal scale or categorical scale
Ordinal scale
Interval scale
Ratio scale
Nominal Scale
Observations put into equivalence classes
Example: Numbers on ball players
Measurement purists do not see nominal scale as a bona fide scale because it gives no empirical meaning to the numbers
Permissible operations: Equality
Permissible statistics: Number of cases, mode, & contingency correlation
Ordinal Scale
A rule for arranging observations in order
Example: User preference of DOS, Unix, Windows 3.1, Windows 95, OS/2 and Mac
Numbers used in the ordering can not be reliably interpreted with empirical meaning
Permissible operations: Greater or less
Permissible statistics: Median and percentiles
Interval Scale
Rule for ordering and providing distance between objects on a common property
Example: Temperature
Empirical meaning: order & distance
Permissible operations: Equality of intervals and distances
Permissible statistics: Mean, standard deviation, rank-order & product moment correlations
Ratio Scale
Rule that has interval scale properties, and also a true zero or origin.
Example: Geographical distance
Empirical meaning: order, distance, origin
Permissible operations: All arithmetic, equality ratios
Permissible statistics: All, including coefficient of variation
Kinds of Measurement
Derived measurements
Fiat measurements
Fundamental measurements
Derived Measurements
Obtain meaning through laws relating the property to other properties.
Example: Density (Mass per Volume)
Fiat Measurements
The measurement is done by fiat--arbitrary definition
Depends on presumption or common sense
Often called an indicator
Example: Economic indicator
Fundamental Measurements
Assignment is according to natural laws
No presupposition of other variables
Directly interpretable
Examples: Length, resistance, etc.
Summary--Measurement Assigns Numbers to Objects/Properties
Kinds of Scales
Nominal
Ordinal
Interval
Ratio
Types of measurements
Derived
Fiat
Fundamental
Proposals
Lifeblood to applied sciences
Have
Beginning
Middle
End
Proposals - Beginning
Title - Meaningful and expressive
Introduction - Set the stage
Information Goal (problem statement)
Significance of the goal/solution
Relation to other goals, issues, problems
Purpose of this study relative to the goal/problem
Proposals - Middle
Related research - Do not reinvent wheel
Often included in the introduction
Cover your sources and their availability
Include critiques as appropriate
Proposal
Define terms and state assumptions
Articulate/elaborate information goal in terms of business need and/or practical value
Proposals - End
Methods - So that a knowledgeable person can picture or duplicate what you will do
Methods to be used (secondary & primary p 61)
Time frame
Possible results and their implications
Possible results/implications for area and action
Limitations on interpretation
Ability to generalize
References & Bibliography
Reports--Begin writing yours with your proposal
Many outlines and formats
Suggest you use this one in the CS department
Must use it in CS6023
Reports have
Front matter
Beginning, Middle, End
Back matter
Front Matter
Title Page
Meaningful title
Your name
Course, Instructors name, Word Count
Table of Contents - Headings/page numbers
Abstract or Executive Summary
Beginning
Introduction
Information goal
Significance and value/Relation to other issues
Purpose
Terms and Assumptions
Related research and Background (often included in the introduction)
Middle
Method
Describe your research methods so someone can duplicate what you did (though not necessarily what you found)
Include subsections
Results or findings (facts) & Conclusions (Interpretations)
Data trends and graphs and statistical tests
Interpretations and limitations
Summary of result facts and interpretations
End--Discussion and/or Recommendations
Generalizations and abstraction of your interpretations
Implications for your information goal
Suggestions for the next step towards your information goal
Specific recommendations for applying the results and findings of this study
Back Matter
References and Bibliography (include both)
References--specific citations in the report
Bibliography--read, but not specifically cited
Appendices
Final Report Outline
Complete it as the final step of your project proposal
Help is in the exercise on page 62
Logs and Study Plans
Reading log - Do you have?
Project log - Do you have?
Research log - Do you have?
Study plan--do you have one? If you don’t, how do you expect to complete in May?
Milestone schedule is key (p 63 & 64)
Where we are
Articulate ideas in information goals
Collect data through measurement
Use the research findings of others through reading
Develop information
Extend scientific knowledge
Chapter 4 is a Turning Point Chapter
Consumers to producers of science
Reading is critical
Measurement is a distinguishing factor of science. Scientists must pay attention to:
Type of measurement scales
Kind of measurement process
Scientific value of measurement, e.g.,
Validity
Reliability