sample of chapter 4 in research

• How it works

Chapter 4 – Data Analysis and Discussion (example)

Disclaimer: This is not a sample of our professional work. The paper has been produced by a student. You can view samples of our work here . Opinions, suggestions, recommendations and results in this piece are those of the author and should not be taken as our company views.

Type of Academic Paper – Dissertation Chapter

Academic Subject – Marketing

Word Count – 2964 words

Reliability Analysis

Before conducting any analysis on the data, all the data’s reliability was analyzed based on Cronbach’s Alpha value. The reliability analysis was performed on the complete data of the questionnaire. The reliability of the data was found to be (0.922), as shown in the results of the reliability analysis provided below in table 4.1. However, the complete results output of the reliability analysis is given in the appendix.

Reliability Analysis (N=200)

The Cronbach’s Alpha value between (0.7-1.0) is considered to have excellent reliability. The Cronbach’s Alpha value of the data was found to be (0.922); therefore, this indicated that the questionnaire data had excellent reliability. All of the 29 items of the questionnaire had excellent reliability, and if they are taken for further analysis, they can generate results with 92.2% reliability.

Frequency Distribution Analysis

First of all, the frequency distribution analysis was performed on the demographic variables using SPSS to identify the respondents’ demographic composition. Section 1 of the questionnaire had 5 demographic questions to identify; gender, age group, annual income, marital status, and education level of the research sample. The frequency distribution results shown in table 4.2 below indicated that there were 200 respondents in total, out of which 50% were male, and 50% were female. This shows that the research sample was free from gender-based biases as males and females had equal representation in the sample.

Moreover, the frequency distribution analysis suggested three age groups; ‘20-35’, ‘36-60’ and ‘Above 60’. 39% of the respondents belonged to the ‘20-35’ age group, while 56.5% of the respondents belonged to the ‘36-60’ age group and the remaining 4.5% belonged to the age group of ‘Above 60’.

Furthermore, the annual income level was divided into four categories. The income values were in GBP. It was found that 13% of the respondents had income ‘up to 30000’, 27% had income between ‘31000 to 50000’, 52.5% had income between ‘51000 to 100000’, and 7.5% had income ‘Above 100000’. This suggests that most of the respondents had an annual income between ‘31000 to 50000’ GBP.

The frequency distribution analysis indicated that 61% of respondents were single, while 39% were married, as indicated in table 4.2. This means that most of the respondents were single. Based on frequency distribution, it was also found that the education level of the respondents was analyzed using four categories of education level, namely; diploma, graduate, master, and doctorate. The results depicted that 37% of the respondents were diploma holders, 46% were graduates, 16% had master-level education, while only 2% had a doctorate. This suggests that most of the respondents were either graduate or diploma holders.

Frequency Distribution of the Demographic Characteristics of the respondents (N=200)

Multiple Regression Analysis

The hypotheses were tested using linear multiple regression analysis to determine which of the dependent variables had a significant positive effect on the customer loyalty of the five-star hotel brands. The results of the regression analysis are summarized in the following table 4.3. However, the complete SPSS output of the regression analysis is given in the appendix. Table 4.3

Multiple regression analysis showing the predictive values of dependent variables (Brand image, corporate identity, public relation, perceived quality, and trustworthiness) on customer loyalty (N=200)

Predictors: (Constant), Trustworthiness, Public Relation, Brand Image, Corporate Identity, Perceived Quality Dependent Variable: Customer Loyalty

The significance value (p-value) of ANOVA was found to be (0.000) as shown in the above

table, which was less than 0.05. This suggested that the model equation was significantly fitted

on the data. Moreover, the adjusted R-Square value was (0.897), which indicated that the model’s predictors explained 89.7% variation in customer loyalty.

Furthermore, the presence of the significant effect of the 5 predicting variables on customer loyalty was identified based on their sig. Values. The effect of a predicting variable is significant if its sig. Value is less than 0.05 or if its t-Statistics value is greater than 2. It was found that the variable ‘brand image’ had sig. Value (0.046), the variable ‘corporate identity had sig. Value (0.482), the variable ‘public relation’ had sig. Value (0.400), while the variable ‘perceived quality’ had sig. value (0.000), and the variable ‘trustworthiness’ had sig. value (0.652).

Hire an Expert Dissertation Chapter Writer

Orders completed by our expert writers are

• Formally drafted in an academic style
• Free Amendments and 100% Plagiarism Free – or your money back!
• 100% Confidential and Timely Delivery!
• Free anti-plagiarism report
• Appreciated by thousands of clients. Check client reviews

Hypotheses Assessment

Based on the regression analysis, it was found that brand image and perceived quality have a significant positive effect on customer loyalty. In contrast, corporate identity, public relations, and trustworthiness have an insignificant effect on customer loyalty. Therefore the two hypotheses; H1 and H4 were accepted, however the three hypotheses; H2, H3, and H5 were rejected as indicated in table 4.4.

Hypothesis Assessment Summary Table (N=200)

The insignificant variables (corporate identity, public relation and trustworthiness) were excluded from equation 1. After excluding the insignificant variables from the model equation 1, the final equation becomes as follows;

Customer loyalty                 = α + 0.074 (Brand image) + 0.991 (Perceived quality) + €

The above equation suggests that a 1 unit increase in brand image is likely to result in 0.074 units increase customer loyalty. In comparison, 1 unit increase in perceived quality can result in 0.991 units increase in customer loyalty.

Cross Tabulation Analysis

To further explore the results, the demographic variables’ data were cross-tabulated against the respondents’ responses regarding customer loyalty using SPSS. In this regards the five demographic variables; gender, age group, annual income, marital status and education level were cross-tabulated against the five questions regarding customer loyalty to know the difference between the customer loyalty of five-star hotels of UK based on demographic differences. The results of the cross-tabulation analysis are given in the appendix. The results are graphically presented in bar charts too, which are also given in the appendix.

Cross Tabulation of Gender against Customer Loyalty

The gender was cross-tabulated against question 1 to 5 of the questionnaire to identify the gender differences between male and female respondents’ responses regarding customer loyalty of five-star hotels of the UK. The results indicated that out of 100 males, 57% were extremely agreed that they stay at one hotel, while out of 100 females, 80% were extremely agreed they stay at one hotel. This shows that in comparison with a male, females were more agreed that they stayed at one hotel and were found to be more loyal towards their respective hotel brands.

The cross-tabulation results further indicated that out of 100 males, 53% agreed that they always say positive things about their respective hotel brand to other people. In contrast, out of 100 females, 77% were extremely agreed. Based on the results, the females were found to be in more agreement than males that they always say positive things about their respective hotel brand to other people.

It was further found that out of 100 males, 53% were extremely agreed that they recommend their hotel brand to others, however, out of 100 females, 74% were extremely agreed to this statement. This result also suggested that females were more in agreement than males to recommend their hotel brand to others.

Moreover, it was found that out of 100 males, 54% were extremely agreed that they don’t seek alternative hotel brands, while out of 100 females, 79% were extremely agreed to this statement. This result also suggested that females were more agreed than males that they don’t seek alternative hotel brands, and so were found to be more loyal than males.

Furthermore, it was identified that out of 100 male respondents 56% were extremely agreed that they would continue to go to the same hotel irrespective of the prices, however out of 100 females 79% were extremely agreed. Based on this result, it was clear that females were more agreed than males that they would continue to go to the same hotel irrespective of the prices, so females were found to be more loyal than males.

After cross tabulating ‘gender’ against the response of the 5 questions regarding customer loyalty the females were found to be more loyal customers of the five-star hotel brands than males as they were found to be more in agreement than the man that they stay at one hotel, always say positive things about their hotel brand to other people, recommend their hotel brand to others, don’t seek alternative hotel brands and would continue to go to the same hotel irrespective of the prices.

Cross Tabulation of Age Group against Customer Loyalty

Afterward, the second demographic variable, ‘age groups’ was cross-tabulated against questions 1 to 5 of the questionnaire to identify the difference between the customer loyalty of customers of different age groups. The results indicated that out of 78 respondents between 20 to 35 years of age, 61.5% were extremely agreed that they stayed at one hotel. While out of 113 respondents who were between 36 to 60 years of age, 72.6% were extremely agreed that they always stay at one hotel. However, out of 9 respondents who were above 60 years of age, 77.8% agreed that they always stay at one hotel. This indicated that customers of 36-60 and above 60 age groups were more loyal to their hotel brands as they were keener to stay at a respective hotel brand.

Content removed…

Cross Tabulation of Annual Income against Customer Loyalty

The third demographic variable, ‘annual income’ was cross-tabulated against questions 1 to 5 of the questionnaire to identify which of the customers were most loyal based on their respective annual income levels. The results indicated that out of 26 respondents who had annual income up to 30000 GBP, 84.6% were extremely agreed that they always stay at one hotel. However, out of 54 respondents who had annual income from 31000 to 50000 GBP, 98.1% agreed that they always stay at one hotel. Although out of 105 respondents had annual income from 50000 to 100000 GBP, 49.5% were extremely agreed that they always stay at one hotel. While out of 10 respondents who had annual income from 50000 to 1000000 GBP, 66.7% agreed that they always stay at one hotel. This indicated that customers of annual income levels from 31000 to 50000 GBP were more loyal to their hotel brands than the customers having other annual income levels.

Cross Tabulation of Marital Status against Customer Loyalty

Furthermore, the fourth demographic variable the ‘marital status’ was cross-tabulated against questions 1 to 5 of the questionnaire to understand the difference between married and unmarried respondents regarding customer loyalty of five-star hotels of the UK. The cross-tabulation analysis results indicated that out of 122 single respondents, 59.8% were extremely agreed that they stay at one hotel. However, out of 78 married respondents, around 82% of respondents agreed that they stay at one hotel. Thus, the married customers were more loyal to their hotel brands than unmarried customers because, in comparison, married customers prefer to stay at one hotel brand.

To proceed with the cross-tabulation results, out of 122 single respondents, 55.7% were extremely agreed upon always saying positive things about their hotel brands to other people. On the other hand, out of 78 married respondents, 79.5% were extremely agreed. Hence, upon evaluating the results, it can be said that married customers have more customer loyalty as they are in more agreement than singles. They always give positive feedback regarding their respective hotel brand to other people.

Cross Tabulation of Education Level against Customer Loyalty

Subsequently, the fifth demographic variable, ‘education level’ was cross-tabulated against questions 1 to 5 of the questionnaire to identify which of the customers were most loyal based on their respective education levels. The results indicated that out of 50 respondents who were diploma holders, 67.6% were extremely agreed that they always stay at one hotel. While out of 64 respondents who were graduates, 69.6% were extremely agreed that they always stay at one hotel. Although out of 22 respondents who were masters, 68.8% were extremely agreed that they always stay at one hotel. However, out of 2 respondents with doctorates, 50% were extremely agreed to always stay at one hotel. This indicated that customers who were graduates were more loyal than the customers with diplomas, masters, or doctorates.

Moreover, 66.2% of the diploma holders were extremely agreed that they always say positive things about their hotel brand to other people. In comparison, 64.1% of the respondents who were graduates were extremely agreed. However, 65.5% of the respondents who had masters were extremely agreed, and 50% of the respondents who had doctorates agreed with the statement. Based on this result customers having masters were the most loyal customers of their respective five-star hotel brands.

Need a Dissertation Chapter On a Similar Topic?

In this subsection, the findings of this study are compared and contrasted with the literature to identify which of the past research supports the present research findings. This present study based on regression analysis suggested that brand image can have a significant positive effect on the customer loyalty of five-star hotels in the UK. This finding was supported by the research of Heung et al. (1996), who also suggested that the hotel’s brand image can play a vital role in preserving a high ratio of customer loyalty.

Moreover, this present study also suggested that perceived quality was the second factor that was found to have a significant positive effect on customer loyalty. The perceived quality was evaluated based on; service quality, comfort, staff courtesy, customer satisfaction, and service quality expectations. In this regard, Tat and Raymond (2000) research supports the findings of this study. The staff service quality was found to affect customer loyalty and the level of satisfaction. Teas (1994) had also found service quality to affect customer loyalty. However, Teas also found that staff empathy (staff courtesy) towards customers can also affect customer loyalty. The research of Rowley and Dawes (1999) also supports the finding of this present study. The users’ expectations about the quality and nature of the services affect customer loyalty. A study by Oberoi and Hales (1990) was found to agree with the present study’s findings, as they had found the quality of staff service to affect customer loyalty.

Summary of the Findings

• The brand image was found to have a significant positive effect on customer loyalty. Therefore customer loyalty is likely to increase with the increase in brand image.
• The corporate identity was found to have an insignificant effect on customer loyalty. Therefore customer loyalty is not likely to increase with the increase in corporate identity.
• Public relations was found to have an insignificant effect on customer loyalty. Therefore customer loyalty is not likely to increase with the increase in public relations.
• Perceived quality was found to have a significant positive effect on customer loyalty. Therefore customer loyalty is likely to increase with the increase in perceived quality.
• Trustworthiness was found to have an insignificant effect on customer loyalty. Therefore customer loyalty is not likely to increase with the increase in trustworthiness.
• The female customers were found to be more loyal customers of the five-star hotel brands than male customers.
• The customers of age from 36 to 60 years were more loyal to their hotel brands than the customers of age from 20 to 35 and above 60.
• The customers who had annual income from 31000 to 50000 were more loyal customers of their respective hotel brands than those who had an annual income level of less than 31000 or more than 50000.
• The married respondents had more customer loyalty than unmarried customers, towards five-star hotel brands of the UK.

The customers who had bachelor degrees and the customers who had master degrees were more loyal to the customers who had a diploma or doctorate.

Bryman, A., Bell, E., 2015. Business Research Methods. Oxford University Press.

Daum, P., 2013. International Synergy Management: A Strategic Approach for Raising Efficiencies in the Cross-border Interaction Process. Anchor Academic Publishing (aap_verlag).

Dümke, R., 2002. Corporate Reputation and its Importance for Business Success: A European

Perspective and its Implication for Public Relations Consultancies. diplom.de.

Guetterman, T.C., 2015. Descriptions of Sampling Practices Within Five Approaches to Qualitative Research in Education and the Health Sciences. Forum Qualitative Sozialforschung /

Forum: Qualitative Social Research 16.

Haq, M., 2014. A Comparative Analysis of Qualitative and Quantitative Research Methods and a Justification for Adopting Mixed Methods in Social Research (PDF Download Available).

ResearchGate 1–22. doi:http://dx.doi.org/10.13140/RG.2.1.1945.8640

Kelley, ., Clark, B., Brown, V., Sitzia, J., 2003. Good practice in the conduct and reporting of survey research. Int J Qual Health Care 15, 261–266. doi:10.1093/intqhc/mzg031

Lewis, S., 2015. Qualitative Inquiry and Research Design: Choosing Among Five Approaches.

Health Promotion Practice 16, 473–475. doi:10.1177/1524839915580941

Saunders, M., 2003. Research Methods for Business Students. Pearson Education India.

Saunders, M.N.K., Tosey, P., 2015. Handbook of Research Methods on Human Resource

Development. Edward Elgar Publishing.

DMCA / Removal Request

If you are the original writer of this Dissertation Chapter and no longer wish to have it published on the www.ResearchProspect.com then please:

Request The Removal Of This Dissertation Chapter

Frequently Asked Questions

How to write the results chapter of a dissertation.

To write the Results chapter of a dissertation:

• Present findings objectively.
• Use tables, graphs, or charts for clarity.
• Refer to research questions/hypotheses.
• Provide sufficient details.
• Avoid interpretation; save that for the Discussion chapter.

USEFUL LINKS

LEARNING RESOURCES

COMPANY DETAILS

• How It Works

• Chapter Four: Quantitative Methods (Part 1)

Once you have chosen a topic to investigate, you need to decide which type of method is best to study it. This is one of the most important choices you will make on your research journey. Understanding the value of each of the methods described in this textbook to answer different questions allows you to be able to plan your own studies with more confidence, critique the studies others have done, and provide advice to your colleagues and friends on what type of research they should do to answer questions they have. After briefly reviewing quantitative research assumptions, this chapter is organized in three parts or sections. These parts can also be used as a checklist when working through the steps of your study. Specifically, part 1 focuses on planning a quantitative study (collecting data), part two explains the steps involved in doing a quantitative study, and part three discusses how to make sense of your results (organizing and analyzing data).

• Chapter One: Introduction
• Chapter Two: Understanding the distinctions among research methods
• Chapter Three: Ethical research, writing, and creative work
• Chapter Four: Quantitative Methods (Part 2 - Doing Your Study)
• Chapter Four: Quantitative Methods (Part 3 - Making Sense of Your Study)
• Chapter Five: Qualitative Methods (Part 1)
• Chapter Five: Qualitative Data (Part 2)
• Chapter Six: Critical / Rhetorical Methods (Part 1)
• Chapter Six: Critical / Rhetorical Methods (Part 2)
• Chapter Seven: Presenting Your Results

Quantitative Worldview Assumptions: A Review

In chapter 2, you were introduced to the unique assumptions quantitative research holds about knowledge and how it is created, or what the authors referred to in chapter one as "epistemology." Understanding these assumptions can help you better determine whether you need to use quantitative methods for a particular research study in which you are interested.

Quantitative researchers believe there is an objective reality, which can be measured. "Objective" here means that the researcher is not relying on their own perceptions of an event. S/he is attempting to gather "facts" which may be separate from people's feeling or perceptions about the facts. These facts are often conceptualized as "causes" and "effects." When you ask research questions or pose hypotheses with words in them such as "cause," "effect," "difference between," and "predicts," you are operating under assumptions consistent with quantitative methods. The overall goal of quantitative research is to develop generalizations that enable the researcher to better predict, explain, and understand some phenomenon.

Because of trying to prove cause-effect relationships that can be generalized to the population at large, the research process and related procedures are very important for quantitative methods. Research should be consistently and objectively conducted, without bias or error, in order to be considered to be valid (accurate) and reliable (consistent). Perhaps this emphasis on accurate and standardized methods is because the roots of quantitative research are in the natural and physical sciences, both of which have at their base the need to prove hypotheses and theories in order to better understand the world in which we live. When a person goes to a doctor and is prescribed some medicine to treat an illness, that person is glad such research has been done to know what the effects of taking this medicine is on others' bodies, so s/he can trust the doctor's judgment and take the medicines.

As covered in chapters 1 and 2, the questions you are asking should lead you to a certain research method choice. Students sometimes want to avoid doing quantitative research because of fear of math/statistics, but if their questions call for that type of research, they should forge ahead and use it anyway. If a student really wants to understand what the causes or effects are for a particular phenomenon, they need to do quantitative research. If a student is interested in what sorts of things might predict a person's behavior, they need to do quantitative research. If they want to confirm the finding of another researcher, most likely they will need to do quantitative research. If a student wishes to generalize beyond their participant sample to a larger population, they need to be conducting quantitative research.

So, ultimately, your choice of methods really depends on what your research goal is. What do you really want to find out? Do you want to compare two or more groups, look for relationships between certain variables, predict how someone will act or react, or confirm some findings from another study? If so, you want to use quantitative methods.

A topic such as self-esteem can be studied in many ways. Listed below are some example RQs about self-esteem. Which of the following research questions should be answered with quantitative methods?

• Is there a difference between men's and women's level of self- esteem?
• How do college-aged women describe their ups and downs with self-esteem?
• How has "self-esteem" been constructed in popular self-help books over time?
• Is there a relationship between self-esteem levels and communication apprehension?

What are the advantages of approaching a topic like self-esteem using quantitative methods? What are the disadvantages?

For more information, see the following website: Analyse This!!! Learning to analyse quantitative data

Answers:  1 & 4

Quantitative Methods Part One: Planning Your Study

Planning your study is one of the most important steps in the research process when doing quantitative research. As seen in the diagram below, it involves choosing a topic, writing research questions/hypotheses, and designing your study. Each of these topics will be covered in detail in this section of the chapter.

Topic Choice

Decide on topic.

How do you go about choosing a topic for a research project? One of the best ways to do this is to research something about which you would like to know more. Your communication professors will probably also want you to select something that is related to communication and things you are learning about in other communication classes.

When the authors of this textbook select research topics to study, they choose things that pique their interest for a variety of reasons, sometimes personal and sometimes because they see a need for more research in a particular area. For example, April Chatham-Carpenter studies adoption return trips to China because she has two adopted daughters from China and because there is very little research on this topic for Chinese adoptees and their families; she studied home vs. public schooling because her sister home schools, and at the time she started the study very few researchers had considered the social network implications for home schoolers (cf.  http://www.uni.edu/chatham/homeschool.html ).

When you are asked in this class and other classes to select a topic to research, think about topics that you have wondered about, that affect you personally, or that know have gaps in the research. Then start writing down questions you would like to know about this topic. These questions will help you decide whether the goal of your study is to understand something better, explain causes and effects of something, gather the perspectives of others on a topic, or look at how language constructs a certain view of reality.

Review Previous Research

In quantitative research, you do not rely on your conclusions to emerge from the data you collect. Rather, you start out looking for certain things based on what the past research has found. This is consistent with what was called in chapter 2 as a deductive approach (Keyton, 2011), which also leads a quantitative researcher to develop a research question or research problem from reviewing a body of literature, with the previous research framing the study that is being done. So, reviewing previous research done on your topic is an important part of the planning of your study. As seen in chapter 3 and the Appendix, to do an adequate literature review, you need to identify portions of your topic that could have been researched in the past. To do that, you select key terms of concepts related to your topic.

Some people use concept maps to help them identify useful search terms for a literature review. For example, see the following website: Concept Mapping: How to Start Your Term Paper Research .

Narrow Topic to Researchable Area

Once you have selected your topic area and reviewed relevant literature related to your topic, you need to narrow your topic to something that can be researched practically and that will take the research on this topic further. You don't want your research topic to be so broad or large that you are unable to research it. Plus, you want to explain some phenomenon better than has been done before, adding to the literature and theory on a topic. You may want to test out what someone else has found, replicating their study, and therefore building to the body of knowledge already created.

To see how a literature review can be helpful in narrowing your topic, see the following sources.  Narrowing or Broadening Your Research Topic  and  How to Conduct a Literature Review in Social Science

Research Questions & Hypotheses

Write Your Research Questions (RQs) and/or Hypotheses (Hs)

Once you have narrowed your topic based on what you learned from doing your review of literature, you need to formalize your topic area into one or more research questions or hypotheses. If the area you are researching is a relatively new area, and no existing literature or theory can lead you to predict what you might find, then you should write a research question. Take a topic related to social media, for example, which is a relatively new area of study. You might write a research question that asks:

"Is there a difference between how 1st year and 4th year college students use Facebook to communicate with their friends?"

If, however, you are testing out something you think you might find based on the findings of a large amount of previous literature or a well-developed theory, you can write a hypothesis. Researchers often distinguish between  null  and  alternative  hypotheses. The alternative hypothesis is what you are trying to test or prove is true, while the null hypothesis assumes that the alternative hypothesis is not true. For example, if the use of Facebook had been studied a great deal, and there were theories that had been developed on the use of it, then you might develop an alternative hypothesis, such as: "First-year students spend more time on using Facebook to communicate with their friends than fourth-year students do." Your null hypothesis, on the other hand, would be: "First-year students do  not  spend any more time using Facebook to communication with their friends than fourth-year students do." Researchers, however, only state the alternative hypothesis in their studies, and actually call it "hypothesis" rather than "alternative hypothesis."

Process of Writing a Research Question/Hypothesis.

Once you have decided to write a research question (RQ) or hypothesis (H) for your topic, you should go through the following steps to create your RQ or H.

Name the concepts from your overall research topic that you are interested in studying.

RQs and Hs have variables, or concepts that you are interested in studying. Variables can take on different values. For example, in the RQ above, there are at least two variables – year in college and use of Facebook (FB) to communicate. Both of them have a variety of levels within them.

When you look at the concepts you identified, are there any concepts which seem to be related to each other? For example, in our RQ, we are interested in knowing if there is a difference between first-year students and fourth-year students in their use of FB, meaning that we believe there is some connection between our two variables.

• Decide what type of a relationship you would like to study between the variables. Do you think one causes the other? Does a difference in one create a difference in the other? As the value of one changes, does the value of the other change?

Identify which one of these concepts is the independent (or predictor) variable, or the concept that is perceived to be the cause of change in the other variable? Which one is the dependent (criterion) variable, or the one that is affected by changes in the independent variable? In the above example RQ, year in school is the independent variable, and amount of time spent on Facebook communicating with friends is the dependent variable. The amount of time spent on Facebook depends on a person's year in school.

If you're still confused about independent and dependent variables, check out the following site: Independent & Dependent Variables .

Express the relationship between the concepts as a single sentence – in either a hypothesis or a research question.

For example, "is there a difference between international and American students on their perceptions of the basic communication course," where cultural background and perceptions of the course are your two variables. Cultural background would be the independent variable, and perceptions of the course would be your dependent variable. More examples of RQs and Hs are provided in the next section.

APPLICATION: Try the above steps with your topic now. Check with your instructor to see if s/he would like you to send your topic and RQ/H to him/her via e-mail.

Types of Research Questions/Hypotheses

Once you have written your RQ/H, you need to determine what type of research question or hypothesis it is. This will help you later decide what types of statistics you will need to run to answer your question or test your hypothesis. There are three possible types of questions you might ask, and two possible types of hypotheses. The first type of question cannot be written as a hypothesis, but the second and third types can.

Descriptive Question.

The first type of question is a descriptive question. If you have only one variable or concept you are studying, OR if you are not interested in how the variables you are studying are connected or related to each other, then your question is most likely a descriptive question.

This type of question is the closest to looking like a qualitative question, and often starts with a "what" or "how" or "why" or "to what extent" type of wording. What makes it different from a qualitative research question is that the question will be answered using numbers rather than qualitative analysis. Some examples of a descriptive question, using the topic of social media, include the following.

"To what extent are college-aged students using Facebook to communicate with their friends?"

"Why do college-aged students use Facebook to communicate with their friends?"

Notice that neither of these questions has a clear independent or dependent variable, as there is no clear cause or effect being assumed by the question. The question is merely descriptive in nature. It can be answered by summarizing the numbers obtained for each category, such as by providing percentages, averages, or just the raw totals for each type of strategy or organization. This is true also of the following research questions found in a study of online public relations strategies:

"What online public relations strategies are organizations implementing to combat phishing" (Baker, Baker, & Tedesco, 2007, p. 330), and

"Which organizations are doing most and least, according to recommendations from anti- phishing advocacy recommendations, to combat phishing" (Baker, Baker, & Tedesco, 2007, p. 330)

The researchers in this study reported statistics in their results or findings section, making it clearly a quantitative study, but without an independent or dependent variable; therefore, these research questions illustrate the first type of RQ, the descriptive question.

Difference Question/Hypothesis.

The second type of question is a question/hypothesis of difference, and will often have the word "difference" as part of the question. The very first research question in this section, asking if there is a difference between 1st year and 4th year college students' use of Facebook, is an example of this type of question. In this type of question, the independent variable is some type of grouping or categories, such as age. Another example of a question of difference is one April asked in her research on home schooling: "Is there a difference between home vs. public schoolers on the size of their social networks?" In this example, the independent variable is home vs. public schooling (a group being compared), and the dependent variable is size of social networks. Hypotheses can also be difference hypotheses, as the following example on the same topic illustrates: "Public schoolers have a larger social network than home schoolers do."

Relationship/Association Question/Hypothesis.

The third type of question is a relationship/association question or hypothesis, and will often have the word "relate" or "relationship" in it, as the following example does: "There is a relationship between number of television ads for a political candidate and how successful that political candidate is in getting elected." Here the independent (or predictor) variable is number of TV ads, and the dependent (or criterion) variable is the success at getting elected. In this type of question, there is no grouping being compared, but rather the independent variable is continuous (ranges from zero to a certain number) in nature. This type of question can be worded as either a hypothesis or as a research question, as stated earlier.

Test out your knowledge of the above information, by answering the following questions about the RQ/H listed below. (Remember, for a descriptive question there are no clear independent & dependent variables.)

• What is the independent variable (IV)?
• What is the dependent variable (DV)?
• What type of research question/hypothesis is it? (descriptive, difference, relationship/association)
• "Is there a difference on relational satisfaction between those who met their current partner through online dating and those who met their current partner face-to-face?"
• "How do Fortune 500 firms use focus groups to market new products?"
• "There is a relationship between age and amount of time spent online using social media."

Answers: RQ1  is a difference question, with type of dating being the IV and relational satisfaction being the DV. RQ2  is a descriptive question with no IV or DV. RQ3  is a relationship hypothesis with age as the IV and amount of time spent online as the DV.

Design Your Study

The third step in planning your research project, after you have decided on your topic/goal and written your research questions/hypotheses, is to design your study which means to decide how to proceed in gathering data to answer your research question or to test your hypothesis. This step includes six things to do. [NOTE: The terms used in this section will be defined as they are used.]

• Decide type of study design: Experimental, quasi-experimental, non-experimental.
• Decide kind of data to collect: Survey/interview, observation, already existing data.
• Operationalize variables into measurable concepts.
• Determine type of sample: Probability or non-probability.
• Decide how you will collect your data: face-to-face, via e-mail, an online survey, library research, etc.
• Pilot test your methods.

Types of Study Designs

With quantitative research being rooted in the scientific method, traditional research is structured in an experimental fashion. This is especially true in the natural sciences, where they try to prove causes and effects on topics such as successful treatments for cancer. For example, the University of Iowa Hospitals and Clinics regularly conduct clinical trials to test for the effectiveness of certain treatments for medical conditions ( University of Iowa Hospitals & Clinics: Clinical Trials ). They use human participants to conduct such research, regularly recruiting volunteers. However, in communication, true experiments with treatments the researcher controls are less necessary and thus less common. It is important for the researcher to understand which type of study s/he wishes to do, in order to accurately communicate his/her methods to the public when describing the study.

There are three possible types of studies you may choose to do, when embarking on quantitative research: (a) True experiments, (b) quasi-experiments, and (c) non-experiments.

For more information to read on these types of designs, take a look at the following website and related links in it: Types of Designs .

The following flowchart should help you distinguish between the three types of study designs described below.

True Experiments.

The first two types of study designs use difference questions/hypotheses, as the independent variable for true and quasi-experiments is  nominal  or categorical (based on categories or groupings), as you have groups that are being compared. As seen in the flowchart above, what distinguishes a true experiment from the other two designs is a concept called "random assignment." Random assignment means that the researcher controls to which group the participants are assigned. April's study of home vs. public schooling was NOT a true experiment, because she could not control which participants were home schooled and which ones were public schooled, and instead relied on already existing groups.

An example of a true experiment reported in a communication journal is a study investigating the effects of using interest-based contemporary examples in a lecture on the history of public relations, in which the researchers had the following two hypotheses: "Lectures utilizing interest- based examples should result in more interested participants" and "Lectures utilizing interest- based examples should result in participants with higher scores on subsequent tests of cognitive recall" (Weber, Corrigan, Fornash, & Neupauer, 2003, p. 118). In this study, the 122 college student participants were randomly assigned by the researchers to one of two lecture video viewing groups: a video lecture with traditional examples and a video with contemporary examples. (To see the results of the study, look it up using your school's library databases).

A second example of a true experiment in communication is a study of the effects of viewing either a dramatic narrative television show vs. a nonnarrative television show about the consequences of an unexpected teen pregnancy. The researchers randomly assigned their 367 undergraduate participants to view one of the two types of shows.

Moyer-Gusé, E., & Nabi, R. L. (2010). Explaining the effects of narrative in an entertainment television program: Overcoming resistance to persuasion.  Human Communication Research, 36 , 26-52.

A third example of a true experiment done in the field of communication can be found in the following study.

Jensen, J. D. (2008). Scientific uncertainty in news coverage of cancer research: Effects of hedging on scientists' and journalists' credibility.  Human Communication Research, 34,  347-369.

In this study, Jakob Jensen had three independent variables. He randomly assigned his 601 participants to 1 of 20 possible conditions, between his three independent variables, which were (a) a hedged vs. not hedged message, (b) the source of the hedging message (research attributed to primary vs. unaffiliated scientists), and (c) specific news story employed (of which he had five randomly selected news stories about cancer research to choose from). Although this study was pretty complex, it does illustrate the true experiment in our field since the participants were randomly assigned to read a particular news story, with certain characteristics.

Quasi-Experiments.

If the researcher is not able to randomly assign participants to one of the treatment groups (or independent variable), but the participants already belong to one of them (e.g., age; home vs. public schooling), then the design is called a quasi-experiment. Here you still have an independent variable with groups, but the participants already belong to a group before the study starts, and the researcher has no control over which group they belong to.

An example of a hypothesis found in a communication study is the following: "Individuals high in trait aggression will enjoy violent content more than nonviolent content, whereas those low in trait aggression will enjoy violent content less than nonviolent content" (Weaver & Wilson, 2009, p. 448). In this study, the researchers could not assign the participants to a high or low trait aggression group since this is a personality characteristic, so this is a quasi-experiment. It does not have any random assignment of participants to the independent variable groups. Read their study, if you would like to, at the following location.

Weaver, A. J., & Wilson, B. J. (2009). The role of graphic and sanitized violence in the enjoyment of television dramas.  Human Communication Research, 35  (3), 442-463.

Benoit and Hansen (2004) did not choose to randomly assign participants to groups either, in their study of a national presidential election survey, in which they were looking at differences between debate and non-debate viewers, in terms of several dependent variables, such as which candidate viewers supported. If you are interested in discovering the results of this study, take a look at the following article.

Benoit, W. L., & Hansen, G. J. (2004). Presidential debate watching, issue knowledge, character evaluation, and vote choice.  Human Communication Research, 30  (1), 121-144.

Non-Experiments.

The third type of design is the non-experiment. Non-experiments are sometimes called survey designs, because their primary way of collecting data is through surveys. This is not enough to distinguish them from true experiments and quasi-experiments, however, as both of those types of designs may use surveys as well.

What makes a study a non-experiment is that the independent variable is not a grouping or categorical variable. Researchers observe or survey participants in order to describe them as they naturally exist without any experimental intervention. Researchers do not give treatments or observe the effects of a potential natural grouping variable such as age. Descriptive and relationship/association questions are most often used in non-experiments.

Some examples of this type of commonly used design for communication researchers include the following studies.

• Serota, Levine, and Boster (2010) used a national survey of 1,000 adults to determine the prevalence of lying in America (see  Human Communication Research, 36 , pp. 2-25).
• Nabi (2009) surveyed 170 young adults on their perceptions of reality television on cosmetic surgery effects, looking at several things: for example, does viewing cosmetic surgery makeover programs relate to body satisfaction (p. 6), finding no significant relationship between those two variables (see  Human Communication Research, 35 , pp. 1-27).
• Derlega, Winstead, Mathews, and Braitman (2008) collected stories from 238 college students on reasons why they would disclose or not disclose personal information within close relationships (see  Communication Research Reports, 25 , pp. 115-130). They coded the participants' answers into categories so they could count how often specific reasons were mentioned, using a method called  content analysis , to answer the following research questions:

RQ1: What are research participants' attributions for the disclosure and nondisclosure of highly personal information?

RQ2: Do attributions reflect concerns about rewards and costs of disclosure or the tension between openness with another and privacy?

RQ3: How often are particular attributions for disclosure/nondisclosure used in various types of relationships? (p. 117)

All of these non-experimental studies have in common no researcher manipulation of an independent variable or even having an independent variable that has natural groups that are being compared.

Identify which design discussed above should be used for each of the following research questions.

• Is there a difference between generations on how much they use MySpace?
• Is there a relationship between age when a person first started using Facebook and the amount of time they currently spend on Facebook daily?
• Is there a difference between potential customers' perceptions of an organization who are shown an organization's Facebook page and those who are not shown an organization's Facebook page?

[HINT: Try to identify the independent and dependent variable in each question above first, before determining what type of design you would use. Also, try to determine what type of question it is – descriptive, difference, or relationship/association.]

Answers: 1. Quasi-experiment 2. Non-experiment 3. True Experiment

Data Collection Methods

Once you decide the type of quantitative research design you will be using, you will need to determine which of the following types of data you will collect: (a) survey data, (b) observational data, and/or (c) already existing data, as in library research.

Using the survey data collection method means you will talk to people or survey them about their behaviors, attitudes, perceptions, and demographic characteristics (e.g., biological sex, socio-economic status, race). This type of data usually consists of a series of questions related to the concepts you want to study (i.e., your independent and dependent variables). Both of April's studies on home schooling and on taking adopted children on a return trip back to China used survey data.

On a survey, you can have both closed-ended and open-ended questions. Closed-ended questions, can be written in a variety of forms. Some of the most common response options include the following.

Likert responses – for example: for the following statement, ______ do you strongly agree agree neutral disagree strongly disagree

Semantic differential – for example: does the following ______ make you Happy ..................................... Sad

Yes-no answers for example: I use social media daily. Yes / No.

One site to check out for possible response options is  http://www.360degreefeedback.net/media/ResponseScales.pdf .

Researchers often follow up some of their closed-ended questions with an "other" category, in which they ask their participants to "please specify," their response if none of the ones provided are applicable. They may also ask open-ended questions on "why" a participant chose a particular answer or ask participants for more information about a particular topic. If the researcher wants to use the open-ended question responses as part of his/her quantitative study, the answers are usually coded into categories and counted, in terms of the frequency of a certain answer, using a method called  content analysis , which will be discussed when we talk about already-existing artifacts as a source of data.

Surveys can be done face-to-face, by telephone, mail, or online. Each of these methods has its own advantages and disadvantages, primarily in the form of the cost in time and money to do the survey. For example, if you want to survey many people, then online survey tools such as surveygizmo.com and surveymonkey.com are very efficient, but not everyone has access to taking a survey on the computer, so you may not get an adequate sample of the population by doing so. Plus you have to decide how you will recruit people to take your online survey, which can be challenging. There are trade-offs with every method.

For more information on things to consider when selecting your survey method, check out the following website:

Selecting the Survey Method .

There are also many good sources for developing a good survey, such as the following websites. Constructing the Survey Survey Methods Designing Surveys

Observation.

A second type of data collection method is  observation . In this data collection method, you make observations of the phenomenon you are studying and then code your observations, so that you can count what you are studying. This type of data collection method is often called interaction analysis, if you collect data by observing people's behavior. For example, if you want to study the phenomenon of mall-walking, you could go to a mall and count characteristics of mall-walkers. A researcher in the area of health communication could study the occurrence of humor in an operating room, for example, by coding and counting the use of humor in such a setting.

One extended research study using observational data collection methods, which is cited often in interpersonal communication classes, is John Gottman's research, which started out in what is now called "The Love Lab." In this lab, researchers observe interactions between couples, including physiological symptoms, using coders who look for certain items found to predict relationship problems and success.

Take a look at the YouTube video about "The Love Lab" at the following site to learn more about the potential of using observation in collecting data for a research study:  The "Love" Lab .

Already-Existing Artifacts.

The third method of quantitative data collection is the use of  already-existing artifacts . With this method, you choose certain artifacts (e.g., newspaper or magazine articles; television programs; webpages) and code their content, resulting in a count of whatever you are studying. With this data collection method, researchers most often use what is called quantitative  content analysis . Basically, the researcher counts frequencies of something that occurs in an artifact of study, such as the frequency of times something is mentioned on a webpage. Content analysis can also be used in qualitative research, where a researcher identifies and creates text-based themes but does not do a count of the occurrences of these themes. Content analysis can also be used to take open-ended questions from a survey method, and identify countable themes within the questions.

Content analysis is a very common method used in media studies, given researchers are interested in studying already-existing media artifacts. There are many good sources to illustrate how to do content analysis such as are seen in the box below.

See the following sources for more information on content analysis. Writing Guide: Content Analysis A Flowchart for the Typical Process of Content Analysis Research What is Content Analysis?

With content analysis and any method that you use to code something into categories, one key concept you need to remember is  inter-coder or inter-rater reliability , in which there are multiple coders (at least two) trained to code the observations into categories. This check on coding is important because you need to check to make sure that the way you are coding your observations on the open-ended answers is the same way that others would code a particular item. To establish this kind of inter-coder or inter-rater reliability, researchers prepare codebooks (to train their coders on how to code the materials) and coding forms for their coders to use.

To see some examples of actual codebooks used in research, see the following website:  Human Coding--Sample Materials .

There are also online inter-coder reliability calculators some researchers use, such as the following:  ReCal: reliability calculation for the masses .

Regardless of which method of data collection you choose, you need to decide even more specifically how you will measure the variables in your study, which leads us to the next planning step in the design of a study.

Operationalization of Variables into Measurable Concepts

When you look at your research question/s and/or hypotheses, you should know already what your independent and dependent variables are. Both of these need to be measured in some way. We call that way of measuring  operationalizing  a variable. One way to think of it is writing a step by step recipe for how you plan to obtain data on this topic. How you choose to operationalize your variable (or write the recipe) is one all-important decision you have to make, which will make or break your study. In quantitative research, you have to measure your variables in a valid (accurate) and reliable (consistent) manner, which we discuss in this section. You also need to determine the level of measurement you will use for your variables, which will help you later decide what statistical tests you need to run to answer your research question/s or test your hypotheses. We will start with the last topic first.

Level of Measurement

Level of measurement has to do with whether you measure your variables using categories or groupings OR whether you measure your variables using a continuous level of measurement (range of numbers). The level of measurement that is considered to be categorical in nature is called nominal, while the levels of measurement considered to be continuous in nature are ordinal, interval, and ratio. The only ones you really need to know are nominal, ordinal, and interval/ratio.

Nominal  variables are categories that do not have meaningful numbers attached to them but are broader categories, such as male and female, home schooled and public schooled, Caucasian and African-American.  Ordinal  variables do have numbers attached to them, in that the numbers are in a certain order, but there are not equal intervals between the numbers (e.g., such as when you rank a group of 5 items from most to least preferred, where 3 might be highly preferred, and 2 hated).  Interval/ratio  variables have equal intervals between the numbers (e.g., weight, age).

For more information about these levels of measurement, check out one of the following websites. Levels of Measurement Measurement Scales in Social Science Research What is the difference between ordinal, interval and ratio variables? Why should I care?

Validity and Reliability

When developing a scale/measure or survey, you need to be concerned about validity and reliability. Readers of quantitative research expect to see researchers justify their research measures using these two terms in the methods section of an article or paper.

Validity.   Validity  is the extent to which your scale/measure or survey adequately reflects the full meaning of the concept you are measuring. Does it measure what you say it measures? For example, if researchers wanted to develop a scale to measure "servant leadership," the researchers would have to determine what dimensions of servant leadership they wanted to measure, and then create items which would be valid or accurate measures of these dimensions. If they included items related to a different type of leadership, those items would not be a valid measure of servant leadership. When doing so, the researchers are trying to prove their measure has internal validity. Researchers may also be interested in external validity, but that has to do with how generalizable their study is to a larger population (a topic related to sampling, which we will consider in the next section), and has less to do with the validity of the instrument itself.

There are several types of validity you may read about, including face validity, content validity, criterion-related validity, and construct validity. To learn more about these types of validity, read the information at the following link: Validity .

To improve the validity of an instrument, researchers need to fully understand the concept they are trying to measure. This means they know the academic literature surrounding that concept well and write several survey questions on each dimension measured, to make sure the full idea of the concept is being measured. For example, Page and Wong (n.d.) identified four dimensions of servant leadership: character, people-orientation, task-orientation, and process-orientation ( A Conceptual Framework for Measuring Servant-Leadership ). All of these dimensions (and any others identified by other researchers) would need multiple survey items developed if a researcher wanted to create a new scale on servant leadership.

Before you create a new survey, it can be useful to see if one already exists with established validity and reliability. Such measures can be found by seeing what other respected studies have used to measure a concept and then doing a library search to find the scale/measure itself (sometimes found in the reference area of a library in books like those listed below).

Reliability .  Reliability  is the second criterion you will need to address if you choose to develop your own scale or measure. Reliability is concerned with whether a measurement is consistent and reproducible. If you have ever wondered why, when taking a survey, that a question is asked more than once or very similar questions are asked multiple times, it is because the researchers one concerned with proving their study has reliability. Are you, for example, answering all of the similar questions similarly? If so, the measure/scale may have good reliability or consistency over time.

Researchers can use a variety of ways to show their measure/scale is reliable. See the following websites for explanations of some of these ways, which include methods such as the test-retest method, the split-half method, and inter-coder/rater reliability. Types of Reliability Reliability

To understand the relationship between validity and reliability, a nice visual provided below is explained at the following website (Trochim, 2006, para. 2). Reliability & Validity

Self-Quiz/Discussion:

Take a look at one of the surveys found at the following poll reporting sites on a topic which interests you. Critique one of these surveys, using what you have learned about creating surveys so far.

http://www.pewinternet.org/ http://pewresearch.org/ http://www.gallup.com/Home.aspx http://www.kff.org/

One of the things you might have critiqued in the previous self-quiz/discussion may have had less to do with the actual survey itself, but rather with how the researchers got their participants or sample. How participants are recruited is just as important to doing a good study as how valid and reliable a survey is.

Imagine that in the article you chose for the last "self-quiz/discussion" you read the following quote from the Pew Research Center's Internet and American Life Project: "One in three teens sends more than 100 text messages a day, or 3000 texts a month" (Lenhart, 2010, para.5). How would you know whether you could trust this finding to be true? Would you compare it to what you know about texting from your own and your friends' experiences? Would you want to know what types of questions people were asked to determine this statistic, or whether the survey the statistic is based on is valid and reliable? Would you want to know what type of people were surveyed for the study? As a critical consumer of research, you should ask all of these types of questions, rather than just accepting such a statement as undisputable fact. For example, if only people shopping at an Apple Store were surveyed, the results might be skewed high.

In particular, related to the topic of this section, you should ask about the sampling method the researchers did. Often, the researchers will provide information related to the sample, stating how many participants were surveyed (in this case 800 teens, aged 12-17, who were a nationally representative sample of the population) and how much the "margin of error" is (in this case +/- 3.8%). Why do they state such things? It is because they know the importance of a sample in making the case for their findings being legitimate and credible.  Margin of error  is how much we are confident that our findings represent the population at large. The larger the margin of error, the less likely it is that the poll or survey is accurate. Margin of error assumes a 95% confidence level that what we found from our study represents the population at large.

For more information on margin of error, see one of the following websites. Answers.com Margin of Error Stats.org Margin of Error Americanresearchgroup.com Margin of Error [this last site is a margin of error calculator, which shows that margin of error is directly tied to the size of your sample, in relationship to the size of the population, two concepts we will talk about in the next few paragraphs]

In particular, this section focused on sampling will talk about the following topics: (a) the difference between a population vs. a sample; (b) concepts of error and bias, or "it's all about significance"; (c) probability vs. non-probability sampling; and (d) sample size issues.

Population vs. Sample

When doing quantitative studies, such as the study of cell phone usage among teens, you are never able to survey the entire population of teenagers, so you survey a portion of the population. If you study every member of a population, then you are conducting a census such as the United States Government does every 10 years. When, however, this is not possible (because you do not have the money the U.S. government has!), you attempt to get as good a sample as possible.

Characteristics of a population are summarized in numerical form, and technically these numbers are called  parameters . However, numbers which summarize the characteristics of a sample are called  statistics .

Error and Bias

If a sample is not done well, then you may not have confidence in how the study's results can be generalized to the population from which the sample was taken. Your confidence level is often stated as the  margin of error  of the survey. As noted earlier, a study's margin of error refers to the degree to which a sample differs from the total population you are studying. In the Pew survey, they had a margin of error of +/- 3.8%. So, for example, when the Pew survey said 33% of teens send more than 100 texts a day, the margin of error means they were 95% sure that 29.2% - 36.8% of teens send this many texts a day.

Margin of error is tied to  sampling error , which is how much difference there is between your sample's results and what would have been obtained if you had surveyed the whole population. Sample error is linked to a very important concept for quantitative researchers, which is the notion of  significance . Here, significance does not refer to whether some finding is morally or practically significant, it refers to whether a finding is statistically significant, meaning the findings are not due to chance but actually represent something that is found in the population.  Statistical significance  is about how much you, as the researcher, are willing to risk saying you found something important and be wrong.

For the difference between statistical significance and practical significance, see the following YouTube video:  Statistical and Practical Significance .

Scientists set certain arbitrary standards based on the probability they could be wrong in reporting their findings. These are called  significance levels  and are commonly reported in the literature as  p <.05  or  p <.01  or some other probability (or  p ) level.

If an article says a statistical test reported that  p < .05 , it simply means that they are most likely correct in what they are saying, but there is a 5% chance they could be wrong and not find the same results in the population. If p < .01, then there would be only a 1% chance they were wrong and would not find the same results in the population. The lower the probability level, the more certain the results.

When researchers are wrong, or make that kind of decision error, it often implies that either (a) their sample was biased and was not representative of the true population in some way, or (b) that something they did in collecting the data biased the results. There are actually two kinds of sampling error talked about in quantitative research: Type I and Type II error.  Type 1 error  is what happens when you think you found something statistically significant and claim there is a significant difference or relationship, when there really is not in the actual population. So there is something about your sample that made you find something that is not in the actual population. (Type I error is the same as the probability level, or .05, if using the traditional p-level accepted by most researchers.)  Type II error  happens when you don't find a statistically significant difference or relationship, yet there actually is one in the population at large, so once again, your sample is not representative of the population.

For more information on these two types of error, check out the following websites. Hypothesis Testing: Type I Error, Type II Error Type I and Type II Errors - Making Mistakes in the Justice System

Researchers want to select a sample that is representative of the population in order to reduce the likelihood of having a sample that is biased. There are two types of bias particularly troublesome for researchers, in terms of sampling error. The first type is  selection bias , in which each person in the population does not have an equal chance to be chosen for the sample, which happens frequently in communication studies, because we often rely on convenience samples (whoever we can get to complete our surveys). The second type of bias is  response bias , in which those who volunteer for a study have different characteristics than those who did not volunteer for the study, another common challenge for communication researchers. Volunteers for a study may very well be different from persons who choose not to volunteer for a study, so that you have a biased sample by relying just on volunteers, which is not representative of the population from which you are trying to sample.

Probability vs. Non-Probability Sampling

One of the best ways to lower your sampling error and reduce the possibility of bias is to do probability or random sampling. This means that every person in the population has an equal chance of being selected to be in your sample. Another way of looking at this is to attempt to get a  representative  sample, so that the characteristics of your sample closely approximate those of the population. A sample needs to contain essentially the same variations that exist in the population, if possible, especially on the variables or elements that are most important to you (e.g., age, biological sex, race, level of education, socio-economic class).

There are many different ways to draw a probability/random sample from the population. Some of the most common are a  simple random sample , where you use a random numbers table or random number generator to select your sample from the population.

There are several examples of random number generators available online. See the following example of an online random number generator:  http://www.randomizer.org/ .

A  systematic random sample  takes every n-th number from the population, depending on how many people you would like to have in your sample. A  stratified random sample  does random sampling within groups, and a  multi-stage  or  cluster sample  is used when there are multiple groups within a large area and a large population, and the researcher does random sampling in stages.

If you are interested in understanding more about these types of probability/random samples, take a look at the following website: Probability Sampling .

However, many times communication researchers use whoever they can find to participate in their study, such as college students in their classes since these people are easily accessible. Many of the studies in interpersonal communication and relationship development, for example, used this type of sample. This is called a convenience sample. In doing so, they are using a non- probability or non-random sample. In these types of samples, each member of the population does not have an equal opportunity to be selected. For example, if you decide to ask your facebook friends to participate in an online survey you created about how college students in the U.S. use cell phones to text, you are using a non-random type of sample. You are unable to randomly sample the whole population in the U.S. of college students who text, so you attempt to find participants more conveniently. Some common non-random or non-probability samples are:

• accidental/convenience samples, such as the facebook example illustrates
• quota samples, in which you do convenience samples within subgroups of the population, such as biological sex, looking for a certain number of participants in each group being compared
• snowball or network sampling, where you ask current participants to send your survey onto their friends.

For more information on non-probability sampling, see the following website: Nonprobability Sampling .

Researchers, such as communication scholars, often use these types of samples because of the nature of their research. Most research designs used in communication are not true experiments, such as would be required in the medical field where they are trying to prove some cause-effect relationship to cure or alleviate symptoms of a disease. Most communication scholars recognize that human behavior in communication situations is much less predictable, so they do not adhere to the strictest possible worldview related to quantitative methods and are less concerned with having to use probability sampling.

They do recognize, however, that with either probability or non-probability sampling, there is still the possibility of bias and error, although much less with probability sampling. That is why all quantitative researchers, regardless of field, will report statistical significance levels if they are interested in generalizing from their sample to the population at large, to let the readers of their work know how confident they are in their results.

Size of Sample

The larger the sample, the more likely the sample is going to be representative of the population. If there is a lot of variability in the population (e.g., lots of different ethnic groups in the population), a researcher will need a larger sample. If you are interested in detecting small possible differences (e.g., in a close political race), you need a larger sample. However, the bigger your population, the less you have to increase the size of your sample in order to have an adequate sample, as is illustrated by an example sample size calculator such as can be found at  http://www.raosoft.com/samplesize.html .

Using the example sample size calculator, see how you might determine how large of a sample you might need in order to study how college students in the U.S. use texting on their cell phones. You would have to first determine approximately how many college students are in the U.S. According to ANEKI, there are a little over 14,000,000 college students in the U.S. ( Countries with the Most University Students ). When inputting that figure into the sample size calculator below (using no commas for the population size), you would need a sample size of approximately 385 students. If the population size was 20,000, you would need a sample of 377 students. If the population was only 2,000, you would need a sample of 323. For a population of 500, you would need a sample of 218.

It is not enough, however, to just have an adequate or large sample. If there is bias in the sampling, you can have a very bad large sample, one that also does not represent the population at large. So, having an unbiased sample is even more important than having a large sample.

So, what do you do, if you cannot reasonably conduct a probability or random sample? You run statistics which report significance levels, and you report the limitations of your sample in the discussion section of your paper/article.

Pilot Testing Methods

Now that we have talked about the different elements of your study design, you should try out your methods by doing a pilot test of some kind. This means that you try out your procedures with someone to try to catch any mistakes in your design before you start collecting data from actual participants in your study. This will save you time and money in the long run, along with unneeded angst over mistakes you made in your design during data collection. There are several ways you might do this.

You might ask an expert who knows about this topic (such as a faculty member) to try out your experiment or survey and provide feedback on what they think of your design. You might ask some participants who are like your potential sample to take your survey or be a part of your pilot test; then you could ask them which parts were confusing or needed revising. You might have potential participants explain to you what they think your questions mean, to see if they are interpreting them like you intended, or if you need to make some questions clearer.

The main thing is that you do not just assume your methods will work or are the best type of methods to use until you try them out with someone. As you write up your study, in your methods section of your paper, you can then talk about what you did to change your study based on the pilot study you did.

Institutional Review Board (IRB) Approval

The last step of your planning takes place when you take the necessary steps to get your study approved by your institution's review board. As you read in chapter 3, this step is important if you are planning on using the data or results from your study beyond just the requirements for your class project. See chapter 3 for more information on the procedures involved in this step.

Conclusion: Study Design Planning

Once you have decided what topic you want to study, you plan your study. Part 1 of this chapter has covered the following steps you need to follow in this planning process:

• decide what type of study you will do (i.e., experimental, quasi-experimental, non- experimental);
• decide on what data collection method you will use (i.e., survey, observation, or already existing data);
• operationalize your variables into measureable concepts;
• determine what type of sample you will use (probability or non-probability);
• pilot test your methods; and
• get IRB approval.

At that point, you are ready to commence collecting your data, which is the topic of the next section in this chapter.

Best Practice: How to Write a Dissertation or Thesis Quantitative Chapter 4

Statistics Blog

In the first paragraph of your quantitative chapter 4, the results chapter, restate the research questions that will be examined.  This reminds the reader of what you’re going to investigate after having been trough the details of your methodology.  It’s helpful too that the reader knows what the variables are that are going to be analyzed.

Spend a paragraph telling the reader how you’re going to clean the data.  Did you remove univariate or multivariate outlier?  How are you going to treat missing data? What is your final sample size?

The next paragraph should describe the sample using demographics and research variables.  Provide frequencies and percentages for nominal and ordinal level variables and means and standard deviations for the scale level variables.  You can provide this information in figures and tables.

Here’s a sample:

Frequencies and Percentages.  The most frequently observed category of Cardio was Yes ( n  = 41, 72%). The most frequently observed category of Shock was No ( n  = 34, 60%). Frequencies and percentages are presented.

Summary Statistics.  The observations for MiniCog had an average of 25.49 ( SD  = 14.01,  SE M  = 1.87, Min = 2.00, Max = 55.00). The observations for Digital had an average of 29.12 ( SD  = 10.03,  SE M  = 1.33, Min = 15.50, Max = 48.50). Skewness and kurtosis were also calculated. When the skewness is greater than 2 in absolute value, the variable is considered to be asymmetrical about its mean. When the kurtosis is greater than or equal to 3, then the variable’s distribution is markedly different than a normal distribution in its tendency to produce outliers (Westfall & Henning, 2013).

Now that the data is clean and descriptives have been conducted, turn to conducting the statistics and assumptions of those statistics for research question 1.  Provide the assumptions first, then the results of the statistics.  Have a clear accept or reject of the hypothesis statement if you have one.  Here’s an independent samples t-test example:

Introduction.  An two-tailed independent samples  t -test was conducted to examine whether the mean of MiniCog was significantly different between the No and Yes categories of Cardio.

Assumptions.  The assumptions of normality and homogeneity of variance were assessed.

Normality.  A Shapiro-Wilk test was conducted to determine whether MiniCog could have been produced by a normal distribution (Razali & Wah, 2011). The results of the Shapiro-Wilk test were significant,  W  = 0.94,  p  = .007. These results suggest that MiniCog is unlikely to have been produced by a normal distribution; thus normality cannot be assumed. However, the mean of any random variable will be approximately normally distributed as sample size increases according to the Central Limit Theorem (CLT). Therefore, with a sufficiently large sample size ( n  > 50), deviations from normality will have little effect on the results (Stevens, 2009). An alternative way to test the assumption of normality was utilized by plotting the quantiles of the model residuals against the quantiles of a Chi-square distribution, also called a Q-Q scatterplot (DeCarlo, 1997). For the assumption of normality to be met, the quantiles of the residuals must not strongly deviate from the theoretical quantiles. Strong deviations could indicate that the parameter estimates are unreliable. Figure 1 presents a Q-Q scatterplot of MiniCog.

Homogeneity of variance.  Levene’s test for equality of variance was used to assess whether the homogeneity of variance assumption was met (Levene, 1960). The homogeneity of variance assumption requires the variance of the dependent variable be approximately equal in each group. The result of Levene’s test was significant,  F (1, 54) = 18.30,  p  < .001, indicating that the assumption of homogeneity of variance was violated. Consequently, the results may not be reliable or generalizable. Since equal variances cannot be assumed, Welch’s t-test was used instead of the Student’s t-test, which is more reliable when the two samples have unequal variances and unequal sample sizes (Ruxton, 2006).

Results.  The result of the two-tailed independent samples  t -test was significant,  t (46.88) = -4.81,  p  < .001, indicating the null hypothesis can be rejected. This finding suggests the mean of MiniCog was significantly different between the No and Yes categories of Cardio. The mean of MiniCog in the No category of Cardio was significantly lower than the mean of MiniCog in the Yes category. Present the results of the two-tailed independent samples  t -test, and present the means of MiniCog(No) and MiniCog(Yes).

In the next paragraphs, conduct stats and assumptions for your other research questions.  Again, assumptions first, then the results of the statistics with appropriate tables and figures.

Be sure to add all of the in-text citations to your reference section.  Here is a sample of references.

Conover, W. J., & Iman, R. L. (1981). Rank transformations as a bridge between parametric and nonparametric statistics.  The American Statistician, 35 (3), 124-129.

DeCarlo, L. T. (1997). On the meaning and use of kurtosis.  Psychological Methods,  2(3), 292-307.

Levene, H. (1960). Contributions to Probability and Statistics.  Essays in honor of Harold Hotelling,  I. Olkin et al. eds., Stanford University Press, 278-292.

Razali, N. M., & Wah, Y. B. (2011). Power comparisons of Shapiro-Wilk, Kolmogorov-Smirnov, Lilliefors and Anderson-Darling tests.  Journal of Statistical Modeling and Analytics, 2 (1), 21-33.

Ruxton, G. D. (2006). The unequal variance t-test is an underused alternative to Student’s t-test and the Mann-Whitney U test.  Behavioral Ecology, 17 (4), 688-690.

Intellectus Statistics [Online computer software]. (2019). Retrieved from  https://analyze.intellectusstatistics.com/

Stevens, J. P. (2009).  Applied multivariate statistics for the social sciences  (5th ed.). Mahwah, NJ: Routledge Academic.

Westfall, P. H., & Henning, K. S. S. (2013).  Texts in statistical science: Understanding advanced statistical methods.  Boca Raton, FL: Taylor & Francis.

• Welcome to Chapter 4

Quick Guides

Irb data collection closure, data collection and analysis software, chapter 4 webinars.

• Qualtrics Survey Tool
• Statistics Help This link opens in a new window
• Statistics and APA Format This link opens in a new window
• Analysis and Coding Example- Qualitative Data
• Trustworthiness of Qualitative Data
• Hypothesis Testing This link opens in a new window

Jump to DSE Guide

Need help ask us.

• Qualitative Data Analysis Tips and Strategies Students can use this short guide to get started in analyzing qualitative data.
• Quantitative Data Analysis Tips and Strategies Students can use this short guide to get started in analyzing quantitative data.
• Data Collection Verification Form The IRB Study Closure will be submitted in the Doctoral Record after approval from the student’s doctoral committee.
• Data Collection Verification Form Example The sample Data Collection Verification Form can help guide students on how to complete the form before submitting.
• Example Instruments and Tools for Data Collection Students can use this quick list of instruments and tools when considering how to collect and analyze data.
• NVivo Access Instructions for NCUOne Users Students and faculty in NCUOne - Use this job aid to guide you in accessing your free copy of NVivo for qualitative data analysis.
• NVivo FAQs Refer to the NVivo FAQs while installing the software
• SPSS Access Instructions NCUOne students - Use this job aid to guide you in accessing your free copy of SPSS for quantitative data analysis.
• SPSS License Renewal Step-by-step instructions for NCUOne students to renew their license for SPSS.
• SPSS Version Upgrade Instructions Step-by-step instructions for NCUOne students to update to Version 29, the latest version that is now available.

Note: Doctoral students taking courses in NU Brightspace can find directions on how to download NVivo and SPSS in the NU Library Connection . Find the NU Library Connection in your course list and then navigate to the Data Analysis Software for Doctoral Students sub-module within the Research Help module.

• Next: Qualtrics Survey Tool >>
• Last Updated: Apr 19, 2024 3:09 PM
• URL: https://resources.nu.edu/c.php?g=1007180

© Copyright 2024 National University. All Rights Reserved.

Privacy Policy | Consumer Information

CHAPTER FOUR DATA ANALYSIS, INTERRETATION AND DISCUSSIONS 4.1 Introduction

• February 2020

• University of Arusha

Abstract and Figures

Discover the world's research

• 25+ million members
• 160+ million publication pages
• 2.3+ billion citations
• Recruit researchers
• Join for free
• Login Email Tip: Most researchers use their institutional email address as their ResearchGate login Password Forgot password? Keep me logged in Log in or Continue with Google Welcome back! Please log in. Email · Hint Tip: Most researchers use their institutional email address as their ResearchGate login Password Forgot password? Keep me logged in Log in or Continue with Google No account? Sign up

blog @ precision

Presenting your qualitative analysis findings: tables to include in chapter 4.

The earliest stages of developing a doctoral dissertation—most specifically the topic development  and literature review  stages—require that you immerse yourself in a ton of existing research related to your potential topic. If you have begun writing your dissertation proposal, you have undoubtedly reviewed countless results and findings sections of studies in order to help gain an understanding of what is currently known about your topic. 

In this process, we’re guessing that you observed a distinct pattern: Results sections are full of tables. Indeed, the results chapter for your own dissertation will need to be similarly packed with tables. So, if you’re preparing to write up the results of your statistical analysis or qualitative analysis, it will probably help to review your APA editing  manual to brush up on your table formatting skills. But, aside from formatting, how should you develop the tables in your results chapter?

In quantitative studies, tables are a handy way of presenting the variety of statistical analysis results in a form that readers can easily process. You’ve probably noticed that quantitative studies present descriptive results like mean, mode, range, standard deviation, etc., as well the inferential results that indicate whether significant relationships or differences were found through the statistical analysis . These are pretty standard tables that you probably learned about in your pre-dissertation statistics courses.

But, what if you are conducting qualitative analysis? What tables are appropriate for this type of study? This is a question we hear often from our dissertation assistance  clients, and with good reason. University guidelines for results chapters often contain vague instructions that guide you to include “appropriate tables” without specifying what exactly those are. To help clarify on this point, we asked our qualitative analysis experts to share their recommendations for tables to include in your Chapter 4.

Demographics Tables

As with studies using quantitative methods , presenting an overview of your sample demographics is useful in studies that use qualitative research methods. The standard demographics table in a quantitative study provides aggregate information for what are often large samples. In other words, such tables present totals and percentages for demographic categories within the sample that are relevant to the study (e.g., age, gender, job title). 

If conducting qualitative research  for your dissertation, however, you will use a smaller sample and obtain richer data from each participant than in quantitative studies. To enhance thick description—a dimension of trustworthiness—it will help to present sample demographics in a table that includes information on each participant. Remember that ethical standards of research require that all participant information be deidentified, so use participant identification numbers or pseudonyms for each participant, and do not present any personal information that would allow others to identify the participant (Blignault & Ritchie, 2009). Table 1 provides participant demographics for a hypothetical qualitative research study exploring the perspectives of persons who were formerly homeless regarding their experiences of transitioning into stable housing and obtaining employment.

Participant Demographics

Tables to Illustrate Initial Codes

Most of our dissertation consulting clients who are conducting qualitative research choose a form of thematic analysis . Qualitative analysis to identify themes in the data typically involves a progression from (a) identifying surface-level codes to (b) developing themes by combining codes based on shared similarities. As this process is inherently subjective, it is important that readers be able to evaluate the correspondence between the data and your findings (Anfara et al., 2002). This supports confirmability, another dimension of trustworthiness .

A great way to illustrate the trustworthiness of your qualitative analysis is to create a table that displays quotes from the data that exemplify each of your initial codes. Providing a sample quote for each of your codes can help the reader to assess whether your coding was faithful to the meanings in the data, and it can also help to create clarity about each code’s meaning and bring the voices of your participants into your work (Blignault & Ritchie, 2009).

Table 2 is an example of how you might present information regarding initial codes. Depending on your preference or your dissertation committee’s preference, you might also present percentages of the sample that expressed each code. Another common piece of information to include is which actual participants expressed each code. Note that if your qualitative analysis yields a high volume of codes, it may be appropriate to present the table as an appendix.

Initial Codes

Tables to Present the Groups of Codes That Form Each Theme

As noted previously, most of our dissertation assistance clients use a thematic analysis approach, which involves multiple phases of qualitative analysis  that eventually result in themes that answer the dissertation’s research questions. After initial coding is completed, the analysis process involves (a) examining what different codes have in common and then (b) grouping similar codes together in ways that are meaningful given your research questions. In other words, the common threads that you identify across multiple codes become the theme that holds them all together—and that theme answers one of your research questions.

As with initial coding, grouping codes together into themes involves your own subjective interpretations, even when aided by qualitative analysis software such as NVivo  or MAXQDA. In fact, our dissertation assistance clients are often surprised to learn that qualitative analysis software does not complete the analysis in the same ways that statistical analysis software such as SPSS does. While statistical analysis software completes the computations for you, qualitative analysis software does not have such analysis capabilities. Software such as NVivo provides a set of organizational tools that make the qualitative analysis far more convenient, but the analysis itself is still a very human process (Burnard et al., 2008).

Because of the subjective nature of qualitative analysis, it is important to show the underlying logic behind your thematic analysis in tables—such tables help readers to assess the trustworthiness of your analysis. Table 3 provides an example of how to present the codes that were grouped together to create themes, and you can modify the specifics of the table based on your preferences or your dissertation committee’s requirements. For example, this type of table might be presented to illustrate the codes associated with themes that answer each research question. 

Grouping of Initial Codes to Form Themes

Tables to Illustrate the Themes That Answer Each Research Question

Creating alignment throughout your dissertation is an important objective, and to maintain alignment in your results chapter, the themes you present must clearly answer your research questions. Conducting qualitative analysis is an in-depth process of immersion in the data, and many of our dissertation consulting  clients have shared that it’s easy to lose your direction during the process. So, it is important to stay focused on your research questions during the qualitative analysis and also to show the reader exactly which themes—and subthemes, as applicable—answered each of the research questions.

Below, Table 4 provides an example of how to display the thematic findings of your study in table form. Depending on your dissertation committee’s preference or your own, you might present all research questions and all themes and subthemes in a single table. Or, you might provide separate tables to introduce the themes for each research question as you progress through your presentation of the findings in the chapter.

Emergent Themes and Research Questions

Bonus Tip! Figures to Spice Up Your Results

Although dissertation committees most often wish to see tables such as the above in qualitative results chapters, some also like to see figures that illustrate the data. Qualitative software packages such as NVivo offer many options for visualizing your data, such as mind maps, concept maps, charts, and cluster diagrams. A common choice for this type of figure among our dissertation assistance clients is a tree diagram, which shows the connections between specified words and the words or phrases that participants shared most often in the same context. Another common choice of figure is the word cloud, as depicted in Figure 1. The word cloud simply reflects frequencies of words in the data, which may provide an indication of the importance of related concepts for the participants.

As you move forward with your qualitative analysis and development of your results chapter, we hope that this brief overview of useful tables and figures helps you to decide on an ideal presentation to showcase the trustworthiness your findings. Completing a rigorous qualitative analysis for your dissertation requires many hours of careful interpretation of your data, and your end product should be a rich and detailed results presentation that you can be proud of. Reach out if we can help  in any way, as our dissertation coaches would be thrilled to assist as you move through this exciting stage of your dissertation journey!

Anfara Jr., V. A., Brown, K. M., & Mangione, T. L. (2002). Qualitative analysis on stage: Making the research process more public.  Educational Researcher ,  31 (7), 28-38. https://doi.org/10.3102/0013189X031007028

Blignault, I., & Ritchie, J. (2009). Revealing the wood and the trees: Reporting qualitative research.  Health Promotion Journal of Australia ,  20 (2), 140-145. https://doi.org/10.1071/HE09140

Burnard, P., Gill, P., Stewart, K., Treasure, E., & Chadwick, B. (2008). Analysing and presenting qualitative data.  British Dental Journal ,  204 (8), 429-432. https://doi.org/10.1038/sj.bdj.2008.292

Chapter 4 Research Papers: Discussion, Conclusions, Review Papers

• First Online: 17 July 2020

Cite this chapter

• Adrian Wallwork 3 &
• Anna Southern 3  

Part of the book series: English for Academic Research ((EAR))

3279 Accesses

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save.

• Get 10 units per month
• Download Article/Chapter or Ebook
• 1 Unit = 1 Article or 1 Chapter
• Cancel anytime
• Available as EPUB and PDF
• Read on any device
• Instant download
• Own it forever
• Compact, lightweight edition
• Dispatched in 3 to 5 business days
• Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Author information

Authors and affiliations.

English for Academics SAS, Pisa, Italy

Adrian Wallwork & Anna Southern

You can also search for this author in PubMed   Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Wallwork, A., Southern, A. (2020). Chapter 4 Research Papers: Discussion, Conclusions, Review Papers. In: 100 Tips to Avoid Mistakes in Academic Writing and Presenting. English for Academic Research. Springer, Cham. https://doi.org/10.1007/978-3-030-44214-9_4

Download citation

DOI : https://doi.org/10.1007/978-3-030-44214-9_4

Published : 17 July 2020

Publisher Name : Springer, Cham

Print ISBN : 978-3-030-44213-2

Online ISBN : 978-3-030-44214-9

eBook Packages : Social Sciences Social Sciences (R0)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Publish with us

Policies and ethics

• Find a journal
• Track your research