psych studies research methods

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Front Res Metr Anal

The Use of Research Methods in Psychological Research: A Systematised Review

Salomé elizabeth scholtz.

1 Community Psychosocial Research (COMPRES), School of Psychosocial Health, North-West University, Potchefstroom, South Africa

Werner de Klerk

Leon t. de beer.

2 WorkWell Research Institute, North-West University, Potchefstroom, South Africa

Research methods play an imperative role in research quality as well as educating young researchers, however, the application thereof is unclear which can be detrimental to the field of psychology. Therefore, this systematised review aimed to determine what research methods are being used, how these methods are being used and for what topics in the field. Our review of 999 articles from five journals over a period of 5 years indicated that psychology research is conducted in 10 topics via predominantly quantitative research methods. Of these 10 topics, social psychology was the most popular. The remainder of the conducted methodology is described. It was also found that articles lacked rigour and transparency in the used methodology which has implications for replicability. In conclusion this article, provides an overview of all reported methodologies used in a sample of psychology journals. It highlights the popularity and application of methods and designs throughout the article sample as well as an unexpected lack of rigour with regard to most aspects of methodology. Possible sample bias should be considered when interpreting the results of this study. It is recommended that future research should utilise the results of this study to determine the possible impact on the field of psychology as a science and to further investigation into the use of research methods. Results should prompt the following future research into: a lack or rigour and its implication on replication, the use of certain methods above others, publication bias and choice of sampling method.

Introduction

Psychology is an ever-growing and popular field (Gough and Lyons, 2016 ; Clay, 2017 ). Due to this growth and the need for science-based research to base health decisions on (Perestelo-Pérez, 2013 ), the use of research methods in the broad field of psychology is an essential point of investigation (Stangor, 2011 ; Aanstoos, 2014 ). Research methods are therefore viewed as important tools used by researchers to collect data (Nieuwenhuis, 2016 ) and include the following: quantitative, qualitative, mixed method and multi method (Maree, 2016 ). Additionally, researchers also employ various types of literature reviews to address research questions (Grant and Booth, 2009 ). According to literature, what research method is used and why a certain research method is used is complex as it depends on various factors that may include paradigm (O'Neil and Koekemoer, 2016 ), research question (Grix, 2002 ), or the skill and exposure of the researcher (Nind et al., 2015 ). How these research methods are employed is also difficult to discern as research methods are often depicted as having fixed boundaries that are continuously crossed in research (Johnson et al., 2001 ; Sandelowski, 2011 ). Examples of this crossing include adding quantitative aspects to qualitative studies (Sandelowski et al., 2009 ), or stating that a study used a mixed-method design without the study having any characteristics of this design (Truscott et al., 2010 ).

The inappropriate use of research methods affects how students and researchers improve and utilise their research skills (Scott Jones and Goldring, 2015 ), how theories are developed (Ngulube, 2013 ), and the credibility of research results (Levitt et al., 2017 ). This, in turn, can be detrimental to the field (Nind et al., 2015 ), journal publication (Ketchen et al., 2008 ; Ezeh et al., 2010 ), and attempts to address public social issues through psychological research (Dweck, 2017 ). This is especially important given the now well-known replication crisis the field is facing (Earp and Trafimow, 2015 ; Hengartner, 2018 ).

Due to this lack of clarity on method use and the potential impact of inept use of research methods, the aim of this study was to explore the use of research methods in the field of psychology through a review of journal publications. Chaichanasakul et al. ( 2011 ) identify reviewing articles as the opportunity to examine the development, growth and progress of a research area and overall quality of a journal. Studies such as Lee et al. ( 1999 ) as well as Bluhm et al. ( 2011 ) review of qualitative methods has attempted to synthesis the use of research methods and indicated the growth of qualitative research in American and European journals. Research has also focused on the use of research methods in specific sub-disciplines of psychology, for example, in the field of Industrial and Organisational psychology Coetzee and Van Zyl ( 2014 ) found that South African publications tend to consist of cross-sectional quantitative research methods with underrepresented longitudinal studies. Qualitative studies were found to make up 21% of the articles published from 1995 to 2015 in a similar study by O'Neil and Koekemoer ( 2016 ). Other methods in health psychology, such as Mixed methods research have also been reportedly growing in popularity (O'Cathain, 2009 ).

A broad overview of the use of research methods in the field of psychology as a whole is however, not available in the literature. Therefore, our research focused on answering what research methods are being used, how these methods are being used and for what topics in practice (i.e., journal publications) in order to provide a general perspective of method used in psychology publication. We synthesised the collected data into the following format: research topic [areas of scientific discourse in a field or the current needs of a population (Bittermann and Fischer, 2018 )], method [data-gathering tools (Nieuwenhuis, 2016 )], sampling [elements chosen from a population to partake in research (Ritchie et al., 2009 )], data collection [techniques and research strategy (Maree, 2016 )], and data analysis [discovering information by examining bodies of data (Ktepi, 2016 )]. A systematised review of recent articles (2013 to 2017) collected from five different journals in the field of psychological research was conducted.

Grant and Booth ( 2009 ) describe systematised reviews as the review of choice for post-graduate studies, which is employed using some elements of a systematic review and seldom more than one or two databases to catalogue studies after a comprehensive literature search. The aspects used in this systematised review that are similar to that of a systematic review were a full search within the chosen database and data produced in tabular form (Grant and Booth, 2009 ).

Sample sizes and timelines vary in systematised reviews (see Lowe and Moore, 2014 ; Pericall and Taylor, 2014 ; Barr-Walker, 2017 ). With no clear parameters identified in the literature (see Grant and Booth, 2009 ), the sample size of this study was determined by the purpose of the sample (Strydom, 2011 ), and time and cost constraints (Maree and Pietersen, 2016 ). Thus, a non-probability purposive sample (Ritchie et al., 2009 ) of the top five psychology journals from 2013 to 2017 was included in this research study. Per Lee ( 2015 ) American Psychological Association (APA) recommends the use of the most up-to-date sources for data collection with consideration of the context of the research study. As this research study focused on the most recent trends in research methods used in the broad field of psychology, the identified time frame was deemed appropriate.

Psychology journals were only included if they formed part of the top five English journals in the miscellaneous psychology domain of the Scimago Journal and Country Rank (Scimago Journal & Country Rank, 2017 ). The Scimago Journal and Country Rank provides a yearly updated list of publicly accessible journal and country-specific indicators derived from the Scopus® database (Scopus, 2017b ) by means of the Scimago Journal Rank (SJR) indicator developed by Scimago from the algorithm Google PageRank™ (Scimago Journal & Country Rank, 2017 ). Scopus is the largest global database of abstracts and citations from peer-reviewed journals (Scopus, 2017a ). Reasons for the development of the Scimago Journal and Country Rank list was to allow researchers to assess scientific domains, compare country rankings, and compare and analyse journals (Scimago Journal & Country Rank, 2017 ), which supported the aim of this research study. Additionally, the goals of the journals had to focus on topics in psychology in general with no preference to specific research methods and have full-text access to articles.

The following list of top five journals in 2018 fell within the abovementioned inclusion criteria (1) Australian Journal of Psychology, (2) British Journal of Psychology, (3) Europe's Journal of Psychology, (4) International Journal of Psychology and lastly the (5) Journal of Psychology Applied and Interdisciplinary.

Journals were excluded from this systematised review if no full-text versions of their articles were available, if journals explicitly stated a publication preference for certain research methods, or if the journal only published articles in a specific discipline of psychological research (for example, industrial psychology, clinical psychology etc.).

The researchers followed a procedure (see Figure 1 ) adapted from that of Ferreira et al. ( 2016 ) for systematised reviews. Data collection and categorisation commenced on 4 December 2017 and continued until 30 June 2019. All the data was systematically collected and coded manually (Grant and Booth, 2009 ) with an independent person acting as co-coder. Codes of interest included the research topic, method used, the design used, sampling method, and methodology (the method used for data collection and data analysis). These codes were derived from the wording in each article. Themes were created based on the derived codes and checked by the co-coder. Lastly, these themes were catalogued into a table as per the systematised review design.

Systematised review procedure.

According to Johnston et al. ( 2019 ), “literature screening, selection, and data extraction/analyses” (p. 7) are specifically tailored to the aim of a review. Therefore, the steps followed in a systematic review must be reported in a comprehensive and transparent manner. The chosen systematised design adhered to the rigour expected from systematic reviews with regard to full search and data produced in tabular form (Grant and Booth, 2009 ). The rigorous application of the systematic review is, therefore discussed in relation to these two elements.

Firstly, to ensure a comprehensive search, this research study promoted review transparency by following a clear protocol outlined according to each review stage before collecting data (Johnston et al., 2019 ). This protocol was similar to that of Ferreira et al. ( 2016 ) and approved by three research committees/stakeholders and the researchers (Johnston et al., 2019 ). The eligibility criteria for article inclusion was based on the research question and clearly stated, and the process of inclusion was recorded on an electronic spreadsheet to create an evidence trail (Bandara et al., 2015 ; Johnston et al., 2019 ). Microsoft Excel spreadsheets are a popular tool for review studies and can increase the rigour of the review process (Bandara et al., 2015 ). Screening for appropriate articles for inclusion forms an integral part of a systematic review process (Johnston et al., 2019 ). This step was applied to two aspects of this research study: the choice of eligible journals and articles to be included. Suitable journals were selected by the first author and reviewed by the second and third authors. Initially, all articles from the chosen journals were included. Then, by process of elimination, those irrelevant to the research aim, i.e., interview articles or discussions etc., were excluded.

To ensure rigourous data extraction, data was first extracted by one reviewer, and an independent person verified the results for completeness and accuracy (Johnston et al., 2019 ). The research question served as a guide for efficient, organised data extraction (Johnston et al., 2019 ). Data was categorised according to the codes of interest, along with article identifiers for audit trails such as authors, title and aims of articles. The categorised data was based on the aim of the review (Johnston et al., 2019 ) and synthesised in tabular form under methods used, how these methods were used, and for what topics in the field of psychology.

The initial search produced a total of 1,145 articles from the 5 journals identified. Inclusion and exclusion criteria resulted in a final sample of 999 articles ( Figure 2 ). Articles were co-coded into 84 codes, from which 10 themes were derived ( Table 1 ).

Journal article frequency.

Codes used to form themes (research topics).

These 10 themes represent the topic section of our research question ( Figure 3 ). All these topics except, for the final one, psychological practice , were found to concur with the research areas in psychology as identified by Weiten ( 2010 ). These research areas were chosen to represent the derived codes as they provided broad definitions that allowed for clear, concise categorisation of the vast amount of data. Article codes were categorised under particular themes/topics if they adhered to the research area definitions created by Weiten ( 2010 ). It is important to note that these areas of research do not refer to specific disciplines in psychology, such as industrial psychology; but to broader fields that may encompass sub-interests of these disciplines.

Topic frequency (international sample).

In the case of developmental psychology , researchers conduct research into human development from childhood to old age. Social psychology includes research on behaviour governed by social drivers. Researchers in the field of educational psychology study how people learn and the best way to teach them. Health psychology aims to determine the effect of psychological factors on physiological health. Physiological psychology , on the other hand, looks at the influence of physiological aspects on behaviour. Experimental psychology is not the only theme that uses experimental research and focuses on the traditional core topics of psychology (for example, sensation). Cognitive psychology studies the higher mental processes. Psychometrics is concerned with measuring capacity or behaviour. Personality research aims to assess and describe consistency in human behaviour (Weiten, 2010 ). The final theme of psychological practice refers to the experiences, techniques, and interventions employed by practitioners, researchers, and academia in the field of psychology.

Articles under these themes were further subdivided into methodologies: method, sampling, design, data collection, and data analysis. The categorisation was based on information stated in the articles and not inferred by the researchers. Data were compiled into two sets of results presented in this article. The first set addresses the aim of this study from the perspective of the topics identified. The second set of results represents a broad overview of the results from the perspective of the methodology employed. The second set of results are discussed in this article, while the first set is presented in table format. The discussion thus provides a broad overview of methods use in psychology (across all themes), while the table format provides readers with in-depth insight into methods used in the individual themes identified. We believe that presenting the data from both perspectives allow readers a broad understanding of the results. Due a large amount of information that made up our results, we followed Cichocka and Jost ( 2014 ) in simplifying our results. Please note that the numbers indicated in the table in terms of methodology differ from the total number of articles. Some articles employed more than one method/sampling technique/design/data collection method/data analysis in their studies.

What follows is the results for what methods are used, how these methods are used, and which topics in psychology they are applied to . Percentages are reported to the second decimal in order to highlight small differences in the occurrence of methodology.

Firstly, with regard to the research methods used, our results show that researchers are more likely to use quantitative research methods (90.22%) compared to all other research methods. Qualitative research was the second most common research method but only made up about 4.79% of the general method usage. Reviews occurred almost as much as qualitative studies (3.91%), as the third most popular method. Mixed-methods research studies (0.98%) occurred across most themes, whereas multi-method research was indicated in only one study and amounted to 0.10% of the methods identified. The specific use of each method in the topics identified is shown in Table 2 and Figure 4 .

Research methods in psychology.

Research method frequency in topics.

Secondly, in the case of how these research methods are employed , our study indicated the following.

Sampling −78.34% of the studies in the collected articles did not specify a sampling method. From the remainder of the studies, 13 types of sampling methods were identified. These sampling methods included broad categorisation of a sample as, for example, a probability or non-probability sample. General samples of convenience were the methods most likely to be applied (10.34%), followed by random sampling (3.51%), snowball sampling (2.73%), and purposive (1.37%) and cluster sampling (1.27%). The remainder of the sampling methods occurred to a more limited extent (0–1.0%). See Table 3 and Figure 5 for sampling methods employed in each topic.

Sampling use in the field of psychology.

Sampling method frequency in topics.

Designs were categorised based on the articles' statement thereof. Therefore, it is important to note that, in the case of quantitative studies, non-experimental designs (25.55%) were often indicated due to a lack of experiments and any other indication of design, which, according to Laher ( 2016 ), is a reasonable categorisation. Non-experimental designs should thus be compared with experimental designs only in the description of data, as it could include the use of correlational/cross-sectional designs, which were not overtly stated by the authors. For the remainder of the research methods, “not stated” (7.12%) was assigned to articles without design types indicated.

From the 36 identified designs the most popular designs were cross-sectional (23.17%) and experimental (25.64%), which concurred with the high number of quantitative studies. Longitudinal studies (3.80%), the third most popular design, was used in both quantitative and qualitative studies. Qualitative designs consisted of ethnography (0.38%), interpretative phenomenological designs/phenomenology (0.28%), as well as narrative designs (0.28%). Studies that employed the review method were mostly categorised as “not stated,” with the most often stated review designs being systematic reviews (0.57%). The few mixed method studies employed exploratory, explanatory (0.09%), and concurrent designs (0.19%), with some studies referring to separate designs for the qualitative and quantitative methods. The one study that identified itself as a multi-method study used a longitudinal design. Please see how these designs were employed in each specific topic in Table 4 , Figure 6 .

Design use in the field of psychology.

Design frequency in topics.

Data collection and analysis —data collection included 30 methods, with the data collection method most often employed being questionnaires (57.84%). The experimental task (16.56%) was the second most preferred collection method, which included established or unique tasks designed by the researchers. Cognitive ability tests (6.84%) were also regularly used along with various forms of interviewing (7.66%). Table 5 and Figure 7 represent data collection use in the various topics. Data analysis consisted of 3,857 occurrences of data analysis categorised into ±188 various data analysis techniques shown in Table 6 and Figures 1 – 7 . Descriptive statistics were the most commonly used (23.49%) along with correlational analysis (17.19%). When using a qualitative method, researchers generally employed thematic analysis (0.52%) or different forms of analysis that led to coding and the creation of themes. Review studies presented few data analysis methods, with most studies categorising their results. Mixed method and multi-method studies followed the analysis methods identified for the qualitative and quantitative studies included.

Data collection in the field of psychology.

Data collection frequency in topics.

Data analysis in the field of psychology.

Results of the topics researched in psychology can be seen in the tables, as previously stated in this article. It is noteworthy that, of the 10 topics, social psychology accounted for 43.54% of the studies, with cognitive psychology the second most popular research topic at 16.92%. The remainder of the topics only occurred in 4.0–7.0% of the articles considered. A list of the included 999 articles is available under the section “View Articles” on the following website: https://methodgarden.xtrapolate.io/ . This website was created by Scholtz et al. ( 2019 ) to visually present a research framework based on this Article's results.

This systematised review categorised full-length articles from five international journals across the span of 5 years to provide insight into the use of research methods in the field of psychology. Results indicated what methods are used how these methods are being used and for what topics (why) in the included sample of articles. The results should be seen as providing insight into method use and by no means a comprehensive representation of the aforementioned aim due to the limited sample. To our knowledge, this is the first research study to address this topic in this manner. Our discussion attempts to promote a productive way forward in terms of the key results for method use in psychology, especially in the field of academia (Holloway, 2008 ).

With regard to the methods used, our data stayed true to literature, finding only common research methods (Grant and Booth, 2009 ; Maree, 2016 ) that varied in the degree to which they were employed. Quantitative research was found to be the most popular method, as indicated by literature (Breen and Darlaston-Jones, 2010 ; Counsell and Harlow, 2017 ) and previous studies in specific areas of psychology (see Coetzee and Van Zyl, 2014 ). Its long history as the first research method (Leech et al., 2007 ) in the field of psychology as well as researchers' current application of mathematical approaches in their studies (Toomela, 2010 ) might contribute to its popularity today. Whatever the case may be, our results show that, despite the growth in qualitative research (Demuth, 2015 ; Smith and McGannon, 2018 ), quantitative research remains the first choice for article publication in these journals. Despite the included journals indicating openness to articles that apply any research methods. This finding may be due to qualitative research still being seen as a new method (Burman and Whelan, 2011 ) or reviewers' standards being higher for qualitative studies (Bluhm et al., 2011 ). Future research is encouraged into the possible biasness in publication of research methods, additionally further investigation with a different sample into the proclaimed growth of qualitative research may also provide different results.

Review studies were found to surpass that of multi-method and mixed method studies. To this effect Grant and Booth ( 2009 ), state that the increased awareness, journal contribution calls as well as its efficiency in procuring research funds all promote the popularity of reviews. The low frequency of mixed method studies contradicts the view in literature that it's the third most utilised research method (Tashakkori and Teddlie's, 2003 ). Its' low occurrence in this sample could be due to opposing views on mixing methods (Gunasekare, 2015 ) or that authors prefer publishing in mixed method journals, when using this method, or its relative novelty (Ivankova et al., 2016 ). Despite its low occurrence, the application of the mixed methods design in articles was methodologically clear in all cases which were not the case for the remainder of research methods.

Additionally, a substantial number of studies used a combination of methodologies that are not mixed or multi-method studies. Perceived fixed boundaries are according to literature often set aside, as confirmed by this result, in order to investigate the aim of a study, which could create a new and helpful way of understanding the world (Gunasekare, 2015 ). According to Toomela ( 2010 ), this is not unheard of and could be considered a form of “structural systemic science,” as in the case of qualitative methodology (observation) applied in quantitative studies (experimental design) for example. Based on this result, further research into this phenomenon as well as its implications for research methods such as multi and mixed methods is recommended.

Discerning how these research methods were applied, presented some difficulty. In the case of sampling, most studies—regardless of method—did mention some form of inclusion and exclusion criteria, but no definite sampling method. This result, along with the fact that samples often consisted of students from the researchers' own academic institutions, can contribute to literature and debates among academics (Peterson and Merunka, 2014 ; Laher, 2016 ). Samples of convenience and students as participants especially raise questions about the generalisability and applicability of results (Peterson and Merunka, 2014 ). This is because attention to sampling is important as inappropriate sampling can debilitate the legitimacy of interpretations (Onwuegbuzie and Collins, 2017 ). Future investigation into the possible implications of this reported popular use of convenience samples for the field of psychology as well as the reason for this use could provide interesting insight, and is encouraged by this study.

Additionally, and this is indicated in Table 6 , articles seldom report the research designs used, which highlights the pressing aspect of the lack of rigour in the included sample. Rigour with regards to the applied empirical method is imperative in promoting psychology as a science (American Psychological Association, 2020 ). Omitting parts of the research process in publication when it could have been used to inform others' research skills should be questioned, and the influence on the process of replicating results should be considered. Publications are often rejected due to a lack of rigour in the applied method and designs (Fonseca, 2013 ; Laher, 2016 ), calling for increased clarity and knowledge of method application. Replication is a critical part of any field of scientific research and requires the “complete articulation” of the study methods used (Drotar, 2010 , p. 804). The lack of thorough description could be explained by the requirements of certain journals to only report on certain aspects of a research process, especially with regard to the applied design (Laher, 20). However, naming aspects such as sampling and designs, is a requirement according to the APA's Journal Article Reporting Standards (JARS-Quant) (Appelbaum et al., 2018 ). With very little information on how a study was conducted, authors lose a valuable opportunity to enhance research validity, enrich the knowledge of others, and contribute to the growth of psychology and methodology as a whole. In the case of this research study, it also restricted our results to only reported samples and designs, which indicated a preference for certain designs, such as cross-sectional designs for quantitative studies.

Data collection and analysis were for the most part clearly stated. A key result was the versatile use of questionnaires. Researchers would apply a questionnaire in various ways, for example in questionnaire interviews, online surveys, and written questionnaires across most research methods. This may highlight a trend for future research.

With regard to the topics these methods were employed for, our research study found a new field named “psychological practice.” This result may show the growing consciousness of researchers as part of the research process (Denzin and Lincoln, 2003 ), psychological practice, and knowledge generation. The most popular of these topics was social psychology, which is generously covered in journals and by learning societies, as testaments of the institutional support and richness social psychology has in the field of psychology (Chryssochoou, 2015 ). The APA's perspective on 2018 trends in psychology also identifies an increased amount of psychology focus on how social determinants are influencing people's health (Deangelis, 2017 ).

This study was not without limitations and the following should be taken into account. Firstly, this study used a sample of five specific journals to address the aim of the research study, despite general journal aims (as stated on journal websites), this inclusion signified a bias towards the research methods published in these specific journals only and limited generalisability. A broader sample of journals over a different period of time, or a single journal over a longer period of time might provide different results. A second limitation is the use of Excel spreadsheets and an electronic system to log articles, which was a manual process and therefore left room for error (Bandara et al., 2015 ). To address this potential issue, co-coding was performed to reduce error. Lastly, this article categorised data based on the information presented in the article sample; there was no interpretation of what methodology could have been applied or whether the methods stated adhered to the criteria for the methods used. Thus, a large number of articles that did not clearly indicate a research method or design could influence the results of this review. However, this in itself was also a noteworthy result. Future research could review research methods of a broader sample of journals with an interpretive review tool that increases rigour. Additionally, the authors also encourage the future use of systematised review designs as a way to promote a concise procedure in applying this design.

Our research study presented the use of research methods for published articles in the field of psychology as well as recommendations for future research based on these results. Insight into the complex questions identified in literature, regarding what methods are used how these methods are being used and for what topics (why) was gained. This sample preferred quantitative methods, used convenience sampling and presented a lack of rigorous accounts for the remaining methodologies. All methodologies that were clearly indicated in the sample were tabulated to allow researchers insight into the general use of methods and not only the most frequently used methods. The lack of rigorous account of research methods in articles was represented in-depth for each step in the research process and can be of vital importance to address the current replication crisis within the field of psychology. Recommendations for future research aimed to motivate research into the practical implications of the results for psychology, for example, publication bias and the use of convenience samples.

Ethics Statement

This study was cleared by the North-West University Health Research Ethics Committee: NWU-00115-17-S1.

Author Contributions

All authors listed have made a substantial, direct and intellectual contribution to the work, and approved it for publication.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

• Aanstoos C. M. (2014). Psychology . Available online at: http://eds.a.ebscohost.com.nwulib.nwu.ac.za/eds/detail/detail?sid=18de6c5c-2b03-4eac-94890145eb01bc70%40sessionmgr4006&vid$=$1&hid$=$4113&bdata$=$JnNpdGU9ZWRzL~WxpdmU%3d#AN$=$93871882&db$=$ers
• American Psychological Association (2020). Science of Psychology . Available online at: https://www.apa.org/action/science/
• Appelbaum M., Cooper H., Kline R. B., Mayo-Wilson E., Nezu A. M., Rao S. M. (2018). Journal article reporting standards for quantitative research in psychology: the APA Publications and Communications Board task force report . Am. Psychol. 73 :3. 10.1037/amp0000191 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Bandara W., Furtmueller E., Gorbacheva E., Miskon S., Beekhuyzen J. (2015). Achieving rigor in literature reviews: insights from qualitative data analysis and tool-support . Commun. Ass. Inform. Syst. 37 , 154–204. 10.17705/1CAIS.03708 [ CrossRef ] [ Google Scholar ]
• Barr-Walker J. (2017). Evidence-based information needs of public health workers: a systematized review . J. Med. Libr. Assoc. 105 , 69–79. 10.5195/JMLA.2017.109 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Bittermann A., Fischer A. (2018). How to identify hot topics in psychology using topic modeling . Z. Psychol. 226 , 3–13. 10.1027/2151-2604/a000318 [ CrossRef ] [ Google Scholar ]
• Bluhm D. J., Harman W., Lee T. W., Mitchell T. R. (2011). Qualitative research in management: a decade of progress . J. Manage. Stud. 48 , 1866–1891. 10.1111/j.1467-6486.2010.00972.x [ CrossRef ] [ Google Scholar ]
• Breen L. J., Darlaston-Jones D. (2010). Moving beyond the enduring dominance of positivism in psychological research: implications for psychology in Australia . Aust. Psychol. 45 , 67–76. 10.1080/00050060903127481 [ CrossRef ] [ Google Scholar ]
• Burman E., Whelan P. (2011). Problems in / of Qualitative Research . Maidenhead: Open University Press/McGraw Hill. [ Google Scholar ]
• Chaichanasakul A., He Y., Chen H., Allen G. E. K., Khairallah T. S., Ramos K. (2011). Journal of Career Development: a 36-year content analysis (1972–2007) . J. Career. Dev. 38 , 440–455. 10.1177/0894845310380223 [ CrossRef ] [ Google Scholar ]
• Chryssochoou X. (2015). Social Psychology . Inter. Encycl. Soc. Behav. Sci. 22 , 532–537. 10.1016/B978-0-08-097086-8.24095-6 [ CrossRef ] [ Google Scholar ]
• Cichocka A., Jost J. T. (2014). Stripped of illusions? Exploring system justification processes in capitalist and post-Communist societies . Inter. J. Psychol. 49 , 6–29. 10.1002/ijop.12011 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Clay R. A. (2017). Psychology is More Popular Than Ever. Monitor on Psychology: Trends Report . Available online at: https://www.apa.org/monitor/2017/11/trends-popular
• Coetzee M., Van Zyl L. E. (2014). A review of a decade's scholarly publications (2004–2013) in the South African Journal of Industrial Psychology . SA. J. Psychol . 40 , 1–16. 10.4102/sajip.v40i1.1227 [ CrossRef ] [ Google Scholar ]
• Counsell A., Harlow L. (2017). Reporting practices and use of quantitative methods in Canadian journal articles in psychology . Can. Psychol. 58 , 140–147. 10.1037/cap0000074 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Deangelis T. (2017). Targeting Social Factors That Undermine Health. Monitor on Psychology: Trends Report . Available online at: https://www.apa.org/monitor/2017/11/trend-social-factors
• Demuth C. (2015). New directions in qualitative research in psychology . Integr. Psychol. Behav. Sci. 49 , 125–133. 10.1007/s12124-015-9303-9 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Denzin N. K., Lincoln Y. (2003). The Landscape of Qualitative Research: Theories and Issues , 2nd Edn. London: Sage. [ Google Scholar ]
• Drotar D. (2010). A call for replications of research in pediatric psychology and guidance for authors . J. Pediatr. Psychol. 35 , 801–805. 10.1093/jpepsy/jsq049 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Dweck C. S. (2017). Is psychology headed in the right direction? Yes, no, and maybe . Perspect. Psychol. Sci. 12 , 656–659. 10.1177/1745691616687747 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Earp B. D., Trafimow D. (2015). Replication, falsification, and the crisis of confidence in social psychology . Front. Psychol. 6 :621. 10.3389/fpsyg.2015.00621 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Ezeh A. C., Izugbara C. O., Kabiru C. W., Fonn S., Kahn K., Manderson L., et al.. (2010). Building capacity for public and population health research in Africa: the consortium for advanced research training in Africa (CARTA) model . Glob. Health Action 3 :5693. 10.3402/gha.v3i0.5693 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Ferreira A. L. L., Bessa M. M. M., Drezett J., De Abreu L. C. (2016). Quality of life of the woman carrier of endometriosis: systematized review . Reprod. Clim. 31 , 48–54. 10.1016/j.recli.2015.12.002 [ CrossRef ] [ Google Scholar ]
• Fonseca M. (2013). Most Common Reasons for Journal Rejections . Available online at: http://www.editage.com/insights/most-common-reasons-for-journal-rejections
• Gough B., Lyons A. (2016). The future of qualitative research in psychology: accentuating the positive . Integr. Psychol. Behav. Sci. 50 , 234–243. 10.1007/s12124-015-9320-8 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Grant M. J., Booth A. (2009). A typology of reviews: an analysis of 14 review types and associated methodologies . Health Info. Libr. J. 26 , 91–108. 10.1111/j.1471-1842.2009.00848.x [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Grix J. (2002). Introducing students to the generic terminology of social research . Politics 22 , 175–186. 10.1111/1467-9256.00173 [ CrossRef ] [ Google Scholar ]
• Gunasekare U. L. T. P. (2015). Mixed research method as the third research paradigm: a literature review . Int. J. Sci. Res. 4 , 361–368. Available online at: https://ssrn.com/abstract=2735996 [ Google Scholar ]
• Hengartner M. P. (2018). Raising awareness for the replication crisis in clinical psychology by focusing on inconsistencies in psychotherapy Research: how much can we rely on published findings from efficacy trials? Front. Psychol. 9 :256. 10.3389/fpsyg.2018.00256 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Holloway W. (2008). Doing intellectual disagreement differently . Psychoanal. Cult. Soc. 13 , 385–396. 10.1057/pcs.2008.29 [ CrossRef ] [ Google Scholar ]
• Ivankova N. V., Creswell J. W., Plano Clark V. L. (2016). Foundations and Approaches to mixed methods research , in First Steps in Research , 2nd Edn. K. Maree (Pretoria: Van Schaick Publishers; ), 306–335. [ Google Scholar ]
• Johnson M., Long T., White A. (2001). Arguments for British pluralism in qualitative health research . J. Adv. Nurs. 33 , 243–249. 10.1046/j.1365-2648.2001.01659.x [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Johnston A., Kelly S. E., Hsieh S. C., Skidmore B., Wells G. A. (2019). Systematic reviews of clinical practice guidelines: a methodological guide . J. Clin. Epidemiol. 108 , 64–72. 10.1016/j.jclinepi.2018.11.030 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Ketchen D. J., Jr., Boyd B. K., Bergh D. D. (2008). Research methodology in strategic management: past accomplishments and future challenges . Organ. Res. Methods 11 , 643–658. 10.1177/1094428108319843 [ CrossRef ] [ Google Scholar ]
• Ktepi B. (2016). Data Analytics (DA) . Available online at: https://eds-b-ebscohost-com.nwulib.nwu.ac.za/eds/detail/detail?vid=2&sid=24c978f0-6685-4ed8-ad85-fa5bb04669b9%40sessionmgr101&bdata=JnNpdGU9ZWRzLWxpdmU%3d#AN=113931286&db=ers
• Laher S. (2016). Ostinato rigore: establishing methodological rigour in quantitative research . S. Afr. J. Psychol. 46 , 316–327. 10.1177/0081246316649121 [ CrossRef ] [ Google Scholar ]
• Lee C. (2015). The Myth of the Off-Limits Source . Available online at: http://blog.apastyle.org/apastyle/research/
• Lee T. W., Mitchell T. R., Sablynski C. J. (1999). Qualitative research in organizational and vocational psychology, 1979–1999 . J. Vocat. Behav. 55 , 161–187. 10.1006/jvbe.1999.1707 [ CrossRef ] [ Google Scholar ]
• Leech N. L., Anthony J., Onwuegbuzie A. J. (2007). A typology of mixed methods research designs . Sci. Bus. Media B. V Qual. Quant 43 , 265–275. 10.1007/s11135-007-9105-3 [ CrossRef ] [ Google Scholar ]
• Levitt H. M., Motulsky S. L., Wertz F. J., Morrow S. L., Ponterotto J. G. (2017). Recommendations for designing and reviewing qualitative research in psychology: promoting methodological integrity . Qual. Psychol. 4 , 2–22. 10.1037/qup0000082 [ CrossRef ] [ Google Scholar ]
• Lowe S. M., Moore S. (2014). Social networks and female reproductive choices in the developing world: a systematized review . Rep. Health 11 :85. 10.1186/1742-4755-11-85 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Maree K. (2016). Planning a research proposal , in First Steps in Research , 2nd Edn, ed Maree K. (Pretoria: Van Schaik Publishers; ), 49–70. [ Google Scholar ]
• Maree K., Pietersen J. (2016). Sampling , in First Steps in Research, 2nd Edn , ed Maree K. (Pretoria: Van Schaik Publishers; ), 191–202. [ Google Scholar ]
• Ngulube P. (2013). Blending qualitative and quantitative research methods in library and information science in sub-Saharan Africa . ESARBICA J. 32 , 10–23. Available online at: http://hdl.handle.net/10500/22397 . [ Google Scholar ]
• Nieuwenhuis J. (2016). Qualitative research designs and data-gathering techniques , in First Steps in Research , 2nd Edn, ed Maree K. (Pretoria: Van Schaik Publishers; ), 71–102. [ Google Scholar ]
• Nind M., Kilburn D., Wiles R. (2015). Using video and dialogue to generate pedagogic knowledge: teachers, learners and researchers reflecting together on the pedagogy of social research methods . Int. J. Soc. Res. Methodol. 18 , 561–576. 10.1080/13645579.2015.1062628 [ CrossRef ] [ Google Scholar ]
• O'Cathain A. (2009). Editorial: mixed methods research in the health sciences—a quiet revolution . J. Mix. Methods 3 , 1–6. 10.1177/1558689808326272 [ CrossRef ] [ Google Scholar ]
• O'Neil S., Koekemoer E. (2016). Two decades of qualitative research in psychology, industrial and organisational psychology and human resource management within South Africa: a critical review . SA J. Indust. Psychol. 42 , 1–16. 10.4102/sajip.v42i1.1350 [ CrossRef ] [ Google Scholar ]
• Onwuegbuzie A. J., Collins K. M. (2017). The role of sampling in mixed methods research enhancing inference quality . Köln Z Soziol. 2 , 133–156. 10.1007/s11577-017-0455-0 [ CrossRef ] [ Google Scholar ]
• Perestelo-Pérez L. (2013). Standards on how to develop and report systematic reviews in psychology and health . Int. J. Clin. Health Psychol. 13 , 49–57. 10.1016/S1697-2600(13)70007-3 [ CrossRef ] [ Google Scholar ]
• Pericall L. M. T., Taylor E. (2014). Family function and its relationship to injury severity and psychiatric outcome in children with acquired brain injury: a systematized review . Dev. Med. Child Neurol. 56 , 19–30. 10.1111/dmcn.12237 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Peterson R. A., Merunka D. R. (2014). Convenience samples of college students and research reproducibility . J. Bus. Res. 67 , 1035–1041. 10.1016/j.jbusres.2013.08.010 [ CrossRef ] [ Google Scholar ]
• Ritchie J., Lewis J., Elam G. (2009). Designing and selecting samples , in Qualitative Research Practice: A Guide for Social Science Students and Researchers , 2nd Edn, ed Ritchie J., Lewis J. (London: Sage; ), 1–23. [ Google Scholar ]
• Sandelowski M. (2011). When a cigar is not just a cigar: alternative perspectives on data and data analysis . Res. Nurs. Health 34 , 342–352. 10.1002/nur.20437 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Sandelowski M., Voils C. I., Knafl G. (2009). On quantitizing . J. Mix. Methods Res. 3 , 208–222. 10.1177/1558689809334210 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Scholtz S. E., De Klerk W., De Beer L. T. (2019). A data generated research framework for conducting research methods in psychological research .
• Scimago Journal & Country Rank (2017). Available online at: http://www.scimagojr.com/journalrank.php?category=3201&year=2015
• Scopus (2017a). About Scopus . Available online at: https://www.scopus.com/home.uri (accessed February 01, 2017).
• Scopus (2017b). Document Search . Available online at: https://www.scopus.com/home.uri (accessed February 01, 2017).
• Scott Jones J., Goldring J. E. (2015). ‘I' m not a quants person'; key strategies in building competence and confidence in staff who teach quantitative research methods . Int. J. Soc. Res. Methodol. 18 , 479–494. 10.1080/13645579.2015.1062623 [ CrossRef ] [ Google Scholar ]
• Smith B., McGannon K. R. (2018). Developing rigor in quantitative research: problems and opportunities within sport and exercise psychology . Int. Rev. Sport Exerc. Psychol. 11 , 101–121. 10.1080/1750984X.2017.1317357 [ CrossRef ] [ Google Scholar ]
• Stangor C. (2011). Introduction to Psychology . Available online at: http://www.saylor.org/books/
• Strydom H. (2011). Sampling in the quantitative paradigm , in Research at Grass Roots; For the Social Sciences and Human Service Professions , 4th Edn, eds de Vos A. S., Strydom H., Fouché C. B., Delport C. S. L. (Pretoria: Van Schaik Publishers; ), 221–234. [ Google Scholar ]
• Tashakkori A., Teddlie C. (2003). Handbook of Mixed Methods in Social & Behavioural Research . Thousand Oaks, CA: SAGE publications. [ Google Scholar ]
• Toomela A. (2010). Quantitative methods in psychology: inevitable and useless . Front. Psychol. 1 :29. 10.3389/fpsyg.2010.00029 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Truscott D. M., Swars S., Smith S., Thornton-Reid F., Zhao Y., Dooley C., et al.. (2010). A cross-disciplinary examination of the prevalence of mixed methods in educational research: 1995–2005 . Int. J. Soc. Res. Methodol. 13 , 317–328. 10.1080/13645570903097950 [ CrossRef ] [ Google Scholar ]
• Weiten W. (2010). Psychology Themes and Variations . Belmont, CA: Wadsworth. [ Google Scholar ]

Find what you need to study

1.2 Research Methods in Psychology

4 min read • january 5, 2023

Sadiyya Holsey

Jillian Holbrook

Overview of Research Methods

There are various types of research methods in psychology with different purposes, strengths, and weaknesses.

Whenever researchers want to prove or find causation, they would run an experiment.

An experiment you'll learn about in Unit 9 that was run by Solomon Asch investigated the extent to which one would conform to a group's ideas.

Image Courtesy of Wikipedia .

Each person in the room would have to look at these lines above and state which one they thought was of similar length to the original line. The answer was, of course, obvious, but Asch wanted to see if the "real participant" would conform to the views of the rest of the group.

Asch gathered together what we could call "fake participants" and told them not to say line C. The "real participant" would then hear wrong answers, but they did not want to be the odd one out, so they conformed with the rest of the group and represented the majority view.

In this experiment, the "real participant" was the control group , and about 75% of them, over 12 trials, conformed at least once.

Correlational Study

There could be a correlational study between anything. Say you wanted to see if there was an association between the number of hours a teenager sleeps and their grades in high school. If there was a correlation, we cannot say that sleeping a greater number of hours causes higher grades. However, we can determine that they are related to each other. 💤

Remember in psychology that a correlation does not prove causation!

Survey Research

Surveys are used all the time, especially in advertising and marketing. They are often distributed to a large number of people, and the results are returned back to researchers.

Naturalistic Observation

If a student wanted to observe how many people fully stop at a stop sign, they could watch the cars from a distance and record their data. This is a naturalistic observation since the student is in no way influencing the results.

A notable psychological case study is the study of Phineas Gage :

Image Courtesy of Vermont Journal

Phineas Gage was a railroad construction foreman who survived a severe brain injury in 1848. The accident occurred when an iron rod was accidentally driven through Gage's skull, damaging his frontal lobes . Despite the severity of the injury, Gage was able to walk and talk immediately after the accident and appeared to be relatively uninjured.

However, Gage's personality underwent a dramatic change following the injury. He became impulsive, irresponsible, and prone to outbursts of anger, which were completely out of character for him before the accident. Gage's case is famous in the history of psychology because it was one of the first to suggest that damage to the frontal lobes of the brain can have significant effects on personality and behavior.

Key Terms to Review ( 27 )

Association

Case Studies

Cause and Effect

Control Group

Correlational Studies

Cross-Sectional Studies

Cross-Sectional Study

Ethical Issues

Experiments

Frontal Lobes

Generalize Results

Hawthorne Effect

Human Development Stages

Independent Variables

Longitudinal Studies

Naturalistic Observations

Personality Change

Phineas Gage

Research Methods

Response Rates

School Grades

Solomon Asch

Stay Connected

© 2024 Fiveable Inc. All rights reserved.

AP® and SAT® are trademarks registered by the College Board, which is not affiliated with, and does not endorse this website.

Research Methods in Psychology - 4th American Edition

(40 reviews)

Carrie Cuttler, Washington State University

Rajiv S. Jhangiani, Kwantlen Polytechnic University

Dana C. Leighton, Texas A&M University, Texarkana

Copyright Year: 2019

ISBN 13: 9781999198107

Publisher: Kwantlen Polytechnic University

Language: English

Formats Available

Conditions of use.

Learn more about reviews.

Reviewed by Beth Mechlin, Associate Professor of Psychology & Neuroscience, Earlham College on 3/19/24

This is an extremely comprehensive text for an undergraduate psychology course about research methods. It does an excellent job covering the basics of a variety of types of research design. It also includes important topics related to research... read more

Comprehensiveness rating: 5 see less

This is an extremely comprehensive text for an undergraduate psychology course about research methods. It does an excellent job covering the basics of a variety of types of research design. It also includes important topics related to research such as ethics, finding journal articles, and writing reports in APA format.

Content Accuracy rating: 5

I did not notice any errors in this text.

Relevance/Longevity rating: 5

The content is very relevant. It will likely need to be updated over time in order to keep research examples relevant. Additionally, APA formatting guidelines may need to be updated when a new publication manual is released. However, these should be easy updates for the authors to make when the time comes.

Clarity rating: 5

This text is very clear and easy to follow. The explanations are easy for college students to understand. The authors use a lot of examples to help illustrate specific concepts. They also incorporate a variety of relevant outside sources (such as videos) to provide additional examples.

Consistency rating: 5

The text is consistent and flows well from one section to the next. At the end of each large section (similar to a chapter) the authors provide key takeaways and exercises.

Modularity rating: 5

This text is very modular. It is easy to pick and choose which sections you want to use in your course when. Each section can stand alone fairly easily.

Organization/Structure/Flow rating: 5

The text is very well organized. Information flows smoothly from one topic to the next.

Interface rating: 5

The interface is great. The text is easy to navigate and the images display well (I only noticed 1 image in which the formatting was a tad off).

Grammatical Errors rating: 5

I did not notice any grammatical errors.

Cultural Relevance rating: 5

The text is culturally relevant.

This is an excellent text for an undergraduate research methods course in the field of Psychology. I have been using the text for my Research Methods and Statistics course for a few years now. This text focuses on research methods, so I do use another text to cover statistical information. I do highly recommend this text for research methods. It is comprehensive, clear, and easy for students to use.

Reviewed by William Johnson, Lecturer, Old Dominion University on 1/12/24

This textbook covers every topic that I teach in my Research Methods course aside from psychology careers (which I would not really expect it to cover). read more

This textbook covers every topic that I teach in my Research Methods course aside from psychology careers (which I would not really expect it to cover).

I have not noticed any inaccurate information (other than directed students to read Malcolm Gladwell). I appreciate that the textbook includes information on research errors that have not been supported by replication efforts, such as embodied cognition.

Many of the basic concepts of research methods are rather timeless, but I appreciate that the text includes newer research as examples while also including "classic" studies that exemplify different methods.

The writing is clear and simple. The keywords are bolded and reveal a definition when clicked, which students often find very helpful. Many of the figures are very helpful in helping students understand various methods (I really like the ones in the single-subject design subchapter).

The book is very consistent in its terminology and writing style, which I see as a positive compared to other open psychology textbooks where each chapter is written by subject matter experts (such as the NOBA intro textbook).

Modularity rating: 4

I teach this textbook almost entirely in order (except for moving chapters 12 & 13 earlier in the semester to aid students in writing Results sections in their final papers). I think that the organization and consistency of the book reduces its modularity, in that earlier chapters are genuinely helpful for later chapters.

Organization/Structure/Flow rating: 4

I preferred the organization of previous editions, which had "Theory in Research" as its own chapter. If I were organizing the textbook, I am not sure that I would have out descriptive or inferential statistics as the final two chapters (I would have likely put Chapter 11: Presenting Your Research as the final chapter). I also would not have put information about replicability and open science in the inferential statistics section.

The text is easy to read and the formatting is attractive. My only minor complaint is that some of the longer subchapters can be a pretty long scroll, but I understand the desire for their only to be one page per subchapter/topic.

I have not noticed any grammatical errors.

Cultural Relevance rating: 3

I do not think the textbook is insensitive, but there is not much thought given to adapting research instruments across cultures. For instance, talking about how different constructs might have different underlying distributions in different cultures would be useful for students. In the survey methods section, a discussion of back translation or emic personality trait measurement/development for example might be a nice addition.

I choose to use this textbook in my methods classes, but I do miss the organization of the previous American editions. Overall, I recommend this textbook to my colleagues.

Reviewed by Brianna Ewert, Psychology Instructor, Salish Kootenai College on 12/30/22

This text includes the majority of content included in our undergraduate Research Methods in Psychology course. The glossary provides concise definitions of key terms. This text includes most of the background knowledge we expect our students to... read more

Comprehensiveness rating: 4 see less

This text includes the majority of content included in our undergraduate Research Methods in Psychology course. The glossary provides concise definitions of key terms. This text includes most of the background knowledge we expect our students to have as well as skill-based sections that will support them in developing their own research projects.

The content I have read is accurate and error-free.

The content is relevant and up-to-date.

The text is clear and concise. I find it pleasantly readable and anticipate undergraduate students will find it readable and understandable as well.

The terminology appears to be consistent throughout the text.

The modular sections stand alone and lend themselves to alignment with the syllabus of a particular course. I anticipate readily selecting relevant modules to assign in my course.

The book is logically organized with clear and section headings and subheadings. Content on a particular topic is easy to locate.

The text is easy to navigate and the format/design are clean and clear. There are not interface issues, distortions or distracting format in the pdf or online versions.

The text is grammatically correct.

Cultural Relevance rating: 4

I have not found culturally insensitive and offensive language or content in the text. For my courses, I would add examples and supplemental materials that are relevant for students at a Tribal College.

This textbook includes supplemental instructor materials, included slides and worksheets. I plan to adopt this text this year in our Research Methods in Psychology course. I expect it to be a benefit to the course and students.

Reviewed by Sara Peters, Associate Professor of Psychology, Newberry College on 11/3/22

This text serves as an excellent resource for introducing survey research methods topics to undergraduate students. It begins with a background of the science of psychology, the scientific method, and research ethics, before moving into the main... read more

This text serves as an excellent resource for introducing survey research methods topics to undergraduate students. It begins with a background of the science of psychology, the scientific method, and research ethics, before moving into the main types of research. This text covers experimental, non-experimental, survey, and quasi-experimental approaches, among others. It extends to factorial and single subject research, and within each topic is a subset (such as observational research, field studies, etc.) depending on the section.

I could find no accuracy issues with the text, and appreciated the discussions of research and cited studies.

There are revised editions of this textbook (this being the 4th), and the examples are up to date and clear. The inclusion of exercises at the end of each chapter offer potential for students to continue working with material in meaningful ways as they move through the book and (and course).

The prose for this text is well aimed at the undergraduate population. This book can easily be utilized for freshman/sophomore level students. It introduces the scientific terminology surrounding research methods and experimental design in a clear way, and the authors provide extensive examples of different studies and applications.

Terminology is consistent throughout the text. Aligns well with other research methods and statistics sources, so the vocabulary is transferrable beyond the text itself.

Navigating this book is a breeze. There are 13 chapters, and each have subsections that can be assigned. Within each chapter subsection, there is a set of learning objectives, and paragraphs are mixed in with tables and figures for students to have different visuals. Different application assignments within each chapter are highlighted with boxes, so students can think more deeply given a set of constructs as they consider different information. The last subsection in each chapter has key summaries and exercises.

The sections and topics in this text are very straightforward. The authors begin with an introduction of psychology as a science, and move into the scientific method, research ethics, and psychological measurement. They then present multiple different research methodologies that are well known and heavily utilized within the social sciences, before concluding with information on how to present your research, and also analyze your data. The text even provides links throughout to other free resources for a reader.

This book can be navigated either online (using a drop-down menu), or as a pdf download, so students can have an electronic copy if needed. All pictures and text display properly on screen, with no distortions. Very easy to use.

There were no grammatical errors, and nothing distracting within the text.

This book includes inclusive material in the discussion of research ethics, as well as when giving examples of the different types of research approaches. While there is always room for improvement in terms of examples, I was satisfied with the breadth of research the authors presented.

This text provides an overview of both research methods, and a nice introduction to statistics for a social science student. It would be a good choice for a survey research methods class, and if looking to change a statistics class into an open resource class, could also serve as a great resource.

Reviewed by Sharlene Fedorowicz, Adjunct Professor, Bridgewater State University on 6/23/21

The comprehensiveness of this book was appropriate for an introductory undergraduate psychology course. Critical topics are covered that are necessary for psychology students to obtain foundational learning concepts for research. Sections within... read more

The comprehensiveness of this book was appropriate for an introductory undergraduate psychology course. Critical topics are covered that are necessary for psychology students to obtain foundational learning concepts for research. Sections within the text and each chapter provide areas for class discussion with students to dive deeper into key concepts for better learning comprehension. The text covered APA format along with examples of research studies to supplement the learning. The text segues appropriately by introducing the science of psychology, followed by scientific method and ethics before getting into the core of scientific research in the field of psychology. Details are provided in quantitative and qualitative research, correlations, surveys, and research design. Overall, the text is fully comprehensive and necessary introductory research concepts.

The text appears to be accurate with no issues related to content.

Relevance/Longevity rating: 4

The text provided relevant research information to support the learning. The content was up-to-date with a variety of different examples related to the different fields of psychology. However, some topics such as in the pseudoscience section were not very relevant and bordered the line of beliefs. Here, more current or relevant solid examples would provide more relevancy in this part of the text. Bringing in more solid or concrete examples that are more current for students may have been more appropriate such as lack of connection between information found on social media versus real science.

The language and flow of the chapters accompanied by the terms, concepts, and examples of applied research allows for clarity of learning content. Terms were introduced at the appropriate time with the support of concepts and current or classic research. The writing style flows nicely and segues easily from concept to concept. The text is easy for students to understand and grasp the details related to psychological research and science.

The text provides consistency in the outline of each chapter. The beginning section chapter starts objectives as an overview to help students unpack the learning content. Key terms are consistently bolded followed by concept or definition and relevant examples. Research examples are pertinent and provide students with an opportunity to understand application of the contents. Practice exercises are provided with in the chapter and at the and in order for students to integrate learning concepts from within the text.

Sections and subsections are clearly organized and divided appropriately for ease-of-use. The topics are easily discernible and follow the flow of ideal learning routines for students. The sections and subsections are consistently outlined for each concept module. The modularity provides consistency allowing for students to focus on content rather than trying to discern how to pull out the information differently from each chapter or section. In addition, each section and subsection allow for flexibility in learning or expanding concepts within the content area.

The organization of the textbook was easy to follow and each major topic was outlined clearly. However, the chapter on presenting research may be more appropriately placed toward the end of the book rather than in the middle of the chapters related to research and research design. In addition, more information could have been provided upfront around APA format so that students could identify the format of citations within the text as practice for students throughout the book.

The interface of the book lends itself to a nice layout with appropriate examples and links to break up the different sections in the chapters. Examples where appropriate and provided engagement opportunities for the students for each learning module. Images and QR codes or easily viewed and used. Key terms are highlighted in relevant figures, graphs, and tables were appropriately placed. Overall, the interface of the text assisted with the organization and flow of learning material.

No grammatical errors were detected in this book.

The text appears to be culturally sensitive and not offensive. A variety of current and classic research examples are relevant. However, more examples of research from women, minorities, and ethnicities would strengthen the culture of this textbook. Instructors may need to supplement some research in this area to provide additional inclusivity.

Overall, I was impressed by the layout of the textbook and the ease of use. The layout provides a set of expectations for students related to the routine of how the book is laid out and how students will be able to unpack the information. Research examples were relevant, although I see areas where I will supplement information. The book provides opportunities for students to dive deeper into the learning and have rich conversations in the classroom. I plan to start using the psychology textbook for my students starting next year.

Reviewed by Anna Behler, Assistant Professo, North Carolina State University on 6/1/21

The text is very thorough and covers all of the necessary topics for an undergraduate psychology research methods course. There is even coverage of qualitative research, case studies, and the replication crisis which I have not seen in some other... read more

The text is very thorough and covers all of the necessary topics for an undergraduate psychology research methods course. There is even coverage of qualitative research, case studies, and the replication crisis which I have not seen in some other texts.

There were no issues with the accuracy of the text.

The content is very up to date and relevant for a research methods course. The only updates that will likely be necessary in the coming years are updates to examples and modifications to the section on APA formatting.

The clarity of the writing was good, and the chapters were written in a way that was accessible and easy to follow.

I did not note any issues with consistency.

Each chapter is divided into multiple subsections. This makes the chapters even easier to read, as they are broken down into short and easy to navigate sections. These sections make it easy to assign readings as needed depending on which topics are being covered in class.

Organization/Structure/Flow rating: 3

The organization was one of the few areas of weakness, and I felt that the chapters were ordered somewhat oddly. However, this is something that is easily fixed, as chapters (and even subsections) can be assigned in whatever order is needed.

There were no issues of note with the interface, and the PDF of the text was easy to navigate.

The text was well written and there were no grammatical/writing errors of note.

Overall, the book did not contain any notable instances of bias. However, it would probably be appropriate to offer a more thorough discussion of the WEIRD problem in psychology research.

Reviewed by Seth Surgan, Professor, Worcester State University on 5/24/21

Pitched very well for a 200-level Research Methods course. This text provided students with solid basis for class discussion and the further development of their understanding of fundamental concepts. read more

Pitched very well for a 200-level Research Methods course. This text provided students with solid basis for class discussion and the further development of their understanding of fundamental concepts.

No issues with accuracy.

Coverage was on target, relevant, and applicable, with good examples from a variety of subfields within Psychology.

Clearly written -- students often struggle with the dry, technical nature of concepts in Research Methods. Part of the reason I chose this text in the first place was how favorably it compared to other options in terms of clarity.

No problems with inconsistent of shifting language. This is extremely important in Research Methods, where there are many closely related terms. Language was consistent and compatible with other textbook options that were available to my students.

Chapters are broken down into sections that are reasonably sized and conceptually appropriate.

The organization of this textbook fit perfectly with the syllabus I've been using (in one form or another) for 15+ years.

This textbook was easy to navigate and available in a variety of formats.

No problems at all.

Examples show an eye toward inclusivity. I did not detect any insensitive or offensive examples or undertones.

I have used this textbook for a 200-level Research Methods course run over a single summer session. This was my first experience using an OER textbook and I don't plan on going back.

Reviewed by Laura Getz, Assistant Professor, University of San Diego on 4/29/21

The topics covered seemed to be at an appropriate level for beginner undergraduate psychology students; the learning objectives for each subsection and the key takeaways and exercises for each chapter are also very helpful in guiding students’... read more

The topics covered seemed to be at an appropriate level for beginner undergraduate psychology students; the learning objectives for each subsection and the key takeaways and exercises for each chapter are also very helpful in guiding students’ attention to what is most relevant. The glossary is also thorough and a good resource for clear definitions. I would like to see a final chapter on a “big picture” or integrating key ideas of replication, meta-analysis, and open science.

Content Accuracy rating: 4

For the most part, I like the way information is presented. I had a few specific issues with definitions for ordinal variables being quantitative (1st, 2nd, 3rd aren’t really numbers as much as ranked categories), the lack of specificity about different forms of validity (face, content, criterion, and discriminant all just labeled “validity” whereas internal and external validity appear in different sections), and the lack of clear distinction between correlational and quasi-experimental variables (e.g., in some places, country of origin is listed as making a design quasi-experimental, but in other chapters it is defined as correlational).

Some of the specific studies/experiments mentioned do not seem like the best or most relevant for students to learn about the topics, but for the most part, content is up-to-date and can definitely be updated with new studies to illustrate concepts with relative ease.

Besides the few concepts I listed above in “accuracy”, I feel the text was very accessible, provides clear definitions, and many examples to illustrate any potential technical/jargon terms.

I did not notice any issues with inconsistent terms except for terms that do have more than one way of describing the same concept (e.g., 2-sample vs. independent samples t-test)

I assigned the chapters out of order with relative ease, and students did not comment about it being burdensome to navigate.

The order of chapters sometimes did not make sense to me (e.g., Experimental before Non-experimental designs, Quasi-experimental designs separate from other non-experimental designs, waiting until Chapter 11 to talk about writing), but for the most part, the chapter subsections were logical and clear.

Interface rating: 4

I had no issues navigating the online version of the textbook other than taking a while to figure out how to move forward and back within the text itself rather than going back to the table of contents (this might just be a browser issue, but is still worth considering).

No grammatical errors of note.

There was nothing explicitly insensitive or offensive about the text, but there were many places where I felt like more focus on diversity and individual differences could be helpful. For example, ethics and history of psychological testing would definitely be a place to bring in issues of systemic racism and/or sexism and a focus on WEIRD samples (which is mentioned briefly at another point).

I was very satisfied with this free resource overall, and I recommend it for beginning level undergraduate psychology research methods courses.

Reviewed by Laura Stull, Associate Professor, Anderson University on 4/23/21

This book covers essential topics and areas related to conducting introductory psychological research. It covers all critical topics, including the scientific method, research ethics, research designs, and basic descriptive and inferential... read more

This book covers essential topics and areas related to conducting introductory psychological research. It covers all critical topics, including the scientific method, research ethics, research designs, and basic descriptive and inferential statistics. It even goes beyond other texts in terms of offering specific guidance in areas like how to conduct research literature searches and psychological measurement development. The only area that appears slightly lacking is detailed guidance in the mechanics of writing in APA style (though excellent basic information is provided in chapter 11).

All content appears accurate. For example, experimental designs discussed, descriptive and inferential statistical guidance, and critical ethical issues are all accurately addressed, See comment on relevance below regarding some outdated information.

Relevance/Longevity rating: 3

Chapter 11 on APA style does not appear to cover the most current version of the APA style guide (7th edition). While much of the information in Chapter 11 is still current, there are specifics that did change from 6th to 7th edition of the APA manual and so, in order to be current, this information would have to be supplemented with external sources.

The book is extremely well organized, written in language and terms that should be easily understood by undergraduate freshmen, and explains all necessary technical jargon.

The text is consistent throughout in terms of terminology and the organizational framework (which aids in the readability of the text).

The text is divided into intuitive and common units based on basic psychological research methodology. It is clear and easy to follow and is divided in a way that would allow omission of some information if necessary (such as "single subject research") or reorganization of information (such as presenting survey research before experimental research) without disruption to the course as a whole.

As stated previously, the book is organized in a clear and logical fashion. Not only are the chapters presented in a logical order (starting with basic and critical information like overviews of the scientific method and research ethics and progressing to more complex topics like statistical analyses).

No issues with interface were noted. Helpful images/charts/web resources (e.g., Youtube videos) are embedded throughout and are even easy to follow in a print version of the text.

No grammatical issues were noted.

No issues with cultural bias are noted. Examples are included that address topics that are culturally sensitive in nature.

I ordered a print version of the text so that I could also view it as students would who prefer a print version. I am extremely impressed with what is offered. It covers all of the key content that I am currently covering with a (non-open source) textbook in an introduction to research methods course. The only concern I have is that APA style is not completely current and would need to be supplemented with a style guide. However, I consider this a minimal issue given all of the many strengths of the book.

Reviewed by Anika Gearhart, Instructor (TT), Leeward Community College on 4/22/21

Includes the majority of elements you expect from a textbook covering research methods. Some topics that could have been covered in a bit more depth were factorial research designs (no coverage of 3 or more independent variables) and external... read more

Includes the majority of elements you expect from a textbook covering research methods. Some topics that could have been covered in a bit more depth were factorial research designs (no coverage of 3 or more independent variables) and external validity (or the validities in general).

Nothing found that was inaccurate.

Looks like a few updates could be made to chapter 11 to bring it up to date with APA 7. Otherwise, most examples are current.

Very clear, a great fit for those very new to the topic.

The framework is clear and logical, and the learning objectives are very helpful for orienting the reader immediately to the main goals of each section.

Subsections are well-organized and clear. Titles for sections and subsections are clear.

Though I think the flow of this textbook for the most part is excellent, I would make two changes: move chapter 5 down with the other chapters on experimental research and move chapter 11 to the very end. I feel that this would allow for a more logical presentation of content.

The webpage navigation is easy to use and intuitive, the ebook download works as designed, and the page can be embedded directly into a variety of LMS sites or used with a variety of devices.

I found no grammatical errors in this book.

While there were some examples of studies that included participants from several cultures, the book does not touch on ecological validity, an important external validity issue tied to cultural psychology, and there is no mention of the WEIRD culture issue in psychology, which seems somewhat necessary when orienting new psychology students to research methods today.

I currently use and enjoy this textbook in my research methods class. Overall, it has been a great addition to the course, and I am easily able to supplement any areas that I feel aren't covered with enough breadth.

Reviewed by Amy Foley, Instructor/Field & Clinical Placement Coordinator, University of Indianapolis on 3/11/21

This text provides a comprehensive overview of the research process from ideation to proposal. It covers research designs common to psychology and related fields. read more

This text provides a comprehensive overview of the research process from ideation to proposal. It covers research designs common to psychology and related fields.

Accurate information!

This book is current and lines up well with the music therapy research course I teach as a supplemental text for students to understand research designs.

Clear language for psychology and related fields.

The format of the text is consistent. I appreciate the examples, different colored boxes, questions, and links to external sources such as video clips.

It is easy to navigate this text by chapters and smaller units within each chapter. The only confusion that has come from using this text includes the fact that the larger units have roman numerals and the individual chapters have numbers. I have told students to "read unit six" and they only read the small chapter 6, not the entire unit for example.

Flows well!

I have not experienced any interface issues.

I have not found any grammar errors.

Book appears culturally relevant.

This is a great resource for research methods courses in psychology or related fields. I am glad to have used several chapters of this text within the music therapy research course I teach where students learn about research design and then create their own research proposal.

Reviewed by Veronica Howard, Associate Professor, University of Alaska Anchorage on 1/11/21, updated 1/11/21

VERY impressed by the coverage of single subject designs. I would recommend this content to colleagues. read more

VERY impressed by the coverage of single subject designs. I would recommend this content to colleagues.

Content appears accurate.

By expanding to include more contemporary research perspectives, the authors have created a wonderful dynamic that permits the text to be the foundation for many courses as well as revision and remixing for other authors.

Book easy to read, follow.

Consistency rating: 4

Content overall consistent. Only mild inconsistency in writing style between chapters.

Exceptionally modular. All content neatly divided into units with smaller portions. This would be a great book to use in a course that meets bi-weekly, or adapted into other formats.

Content organized in a clear and logical fashion, and would guide students through a semester-long course on research methods, starting with review content, broad overview of procedures (including limitations), then highlighting less common (though relevant) procedures.

Rich variety of formats for use.

No errors found.

I would appreciate more cultural examples.

Reviewed by Greg Mullin, Associate Professor, Bunker Hill Community College on 12/30/20, updated 1/6/21

I was VERY pleased with the comprehensiveness of the text. I believe it actually has an edge over the publisher-based text that I've been using for years. Each major topic was thoroughly covered with more than enough detail on individual concepts. read more

I was VERY pleased with the comprehensiveness of the text. I believe it actually has an edge over the publisher-based text that I've been using for years. Each major topic was thoroughly covered with more than enough detail on individual concepts.

I did not find any errors within the text. The authors provided an unbiased representation of research methods in psychology.

The content connects to classic, timeless examples in the field, but also mixes in a fair amount of more current, relatable examples. I feel like I'll be able to use this version of the text for many years without its age showing.

The authors present a clear and efficient writing style throughout that is rich with relatable examples. The only area that may be a bit much for undergraduate-level student understanding is the topic of statistics. I personally scale back my discussion of statistics in my Intro to Research Methods course, but for those that prefer a deeper dive, the higher-level elements are there.

I did not notice any shifts with the use of terminology or with the structural framework of the text. The text is very consistent and organized in an easily digestible way.

The authors do a fantastic job breaking complex topics down into manageable chunks both as a whole and within chapters. As I was reading, I could easily see how I could align my current approach of teaching Intro to Research Methods with their modulated presentation of the material.

I effortlessly moved through the text given the structural organization. All topics are presented in a logical fashion that allowed each message to be delivered to the reader with ease.

I read the text through the PDF version and found no issue with the interface. All image and text-based material was presented clearly.

I cannot recall coming across any grammatical errors. The text is very well written.

I did not find the text to be culturally insensitive in any way. The authors use inclusive language and even encourage that style of writing in the chapter on Presenting Your Research. I would have liked to see more cross-cultural research examples and more of an extended effort to include the theme of diversity throughout, but at no point did I find the text to be offensive.

This is a fantastic text and I look forward to adopting it for my Intro to Research Methods course in the Spring. :)

Reviewed by Maureen O'Connell, Adjunct Professor, Bunker Hill Community College on 12/15/20, updated 12/18/20

This text edition has covered all ideas and areas of research methods in psychology. It has provided a glossary of terms, sample APA format, and sample research papers.  read more

This text edition has covered all ideas and areas of research methods in psychology. It has provided a glossary of terms, sample APA format, and sample research papers. 

The content is unbiased, accurate, and I did not find any errors in the text. 

The content is current and up-to-date. I found that the text can be added to should material change, the arrangement of the text/content makes it easily accessible to add material, if necessary. 

The text is clear, easy to understand, simplistic writing at times, but I find this text easy for students to comprehend. All text is relevant to the content of behavioral research. 

The text and terminology is consistent. 

The text is organized well and sectioned appropriately. The information is presented in an easy-to-read format, with sections that can be assigned at various points during the semester and the reader can easily locate this. 

The topics in the text are organized in a logical and clear manner. It flows really well. 

The text is presented well, including charts, diagrams, and images. There did not appear to be any confusion with this text. 

The text contains no grammatical errors.

The text was culturally appropriate and not offensive. Clear examples of potential biases were outlined in this text which I found quite helpful for the reader. 

Overall, I found this to be a great edition. Much of the time I spend researching outside material for students has been included in this text. I enjoyed the format, easier to navigate, helpful to students by providing an updated version of discussions and practice assignments, and visually more appealing. 

Reviewed by Brittany Jeye, Assistant Professor of Psychology, Worcester State University on 6/26/20

All of the main topics in a Research Methods course are covered in this textbook (e.g., scientific method, ethics, measurement, experimental design, hypothesis testing, APA style, etc.). Some of these topics are not covered as in-depth as in other... read more

All of the main topics in a Research Methods course are covered in this textbook (e.g., scientific method, ethics, measurement, experimental design, hypothesis testing, APA style, etc.). Some of these topics are not covered as in-depth as in other Research Method textbooks I have used previously, but this actually may be a positive depending on the students and course level (that is, students may only need a solid overview of certain topics without getting overwhelmed with too many details). It also gives the instructor the ability to add content as needed, which helps with flexibility in course design.

I did not note any errors or inaccurate/biasing statements in the text.

For the most part, everything was up to date. There was a good mix of classic research and newer studies presented and/or used as examples, which kept the chapters interesting, topical and relevant. I only noted the section on APA Style in the chapter “Presenting Your Research” which may need some updating to be in line with the new APA 7th edition. However, there should be only minor edits needed (the chapter itself was great overview and introduction to the main points of APA style) and it looks like they should be relatively easy to implement.

The text was very well-written and was presented at an accessible level for undergraduates new to Research Methods. Terms were well-defined with a helpful glossary at the end of the textbook.

The consistent structure of the textbook is huge positive. Each chapter begins with learning objectives and ends with bulleted key takeaways. There are also good exercises and learning activities for students at the end of each chapter. Instructors may need to add their own activities for chapters that do not go into a lot of depth (there are also instructor resources online, which may have more options available).

This is one of the biggest strengths of this textbook, in my opinion. I appreciate how each chapter is broken down into clearly defined subsections. The chapters and the subsections, in particular, are not lengthy, which is great for students’ learning. These subsections could be reorganized and used in a variety of ways to suit the needs of a particular course (or even as standalone subsections).

The topics were presented in a logical manner. As mentioned above, since the textbook is very modular, I feel that you could easily rearrange the chapters to fit your needs (for example, presenting survey design before experimental research or making the presenting your research section a standalone unit).

I downloaded the textbook as an ebook, which was very easy to use/navigate. There were no problems reading any of the text or figures/tables. I also appreciated that you could open the ebook using a variety of apps (Kindle, iBook, etc.) depending on your preference (and this is good for students who have a variety of technical needs).

There were no grammatical errors noted.

The examples were inclusive of races, ethnicity and background and there were not any examples that were culturally insensitive or offensive in any way. In future iterations of the replicability section, it may be beneficial to touch upon the “weird” phenomena in psychology research (that many studies use participants who are western, educated and from industrialized, rich and democratic countries) as a point to engage students in improving psychological practices.

I will definitely consider switching to this textbook in the future for Research Methods.

Reviewed by Alice Frye, Associate Teaching Professor, University of Massachusetts Lowell on 6/22/20

Hits all the necessary marks from ways of knowing to measurement, research designs, and presentation. Comparable in detail and content to other Research Methods texts I have used for teaching. read more

Hits all the necessary marks from ways of knowing to measurement, research designs, and presentation. Comparable in detail and content to other Research Methods texts I have used for teaching.

Correct and to the point. Complex ideas such as internal consistency reliability and discriminant validity are well handled--correct descriptions that are also succinct and articulated simply and with clear examples that are easy for a student reader to grasp.

Seems likely to have good staying power. One area that has changed quickly in the past is the usefulness of various research data bases. So it is possible that portion could become more quickly outdated, but there is no predicting that. The current descriptions are useful.

Very clearly written without being condescending, overly casual or clunky.

Excellent consistency throughout in terms of organization, language usage, level of detail and tone.

Imho this is one of the particular strengths of the text. Chapters are well divided into discrete parts, which seems likely to be a benefit in cohorts of students who are increasingly accustomed to digesting small amounts of information.

Well organized, straightforward structure that is maintained throughout.

No problems with the interface.

The grammar level is another notable strength. Ideas are articulated clearly, and with sophistication, but in a syntactically very straightforward manner.

The text isn't biased or offensive. I wish that to illustrate various points and research designs it had drawn more frequently on research studies that incorporate a specific focus on race and ethnicity.

This is a very good text. As good as any for profit text I have used to teach a research methods course, if not better.

Reviewed by Lauren Mathieu-Frasier, Adjunct Instructor, University of Indianapolis on 1/13/20

As other reviews have mentioned, this textbook provides a comprehensive look at multiple concepts for an introductory course in research methods in psychology. Some of the concepts (i.e., variables, external validity) are briefly described and... read more

As other reviews have mentioned, this textbook provides a comprehensive look at multiple concepts for an introductory course in research methods in psychology. Some of the concepts (i.e., variables, external validity) are briefly described and glossed over that it will take additional information, examples, and reinforcement from instructors in the classroom. Other sections and concepts, like ethics or reporting of research were well-described and thorough.

It appeared that the information was accurate, error-free, and unbiased.

The information is up-to-date. In the section on APA presentation, it looks like the minor adjustments to the APA Publication Manual 7th Edition would need to be included. However, this section gives a good foundation and the instructor can easily implement the changes.

Clarity rating: 4

The text is clearly written written and provides an appropriate context when terminology is used.

There aren't any issues with consistency in the textbook.

The division of smaller sections can be beneficial when reading it and assigning it to classes. The sections are clearly organized based on learning objectives.

The textbook is organized in a logical, clear manner. There may be topics that instructors choose to present in a different manner (non-experimental and survey research prior to experimental). However, this doesn't generally impact the organization and flow of the book.

While reading and utilizing the book, there weren't any navigation issues that could impact the readability of the book. Students could find this textbook easy to use.

Grammatical errors were not noted.

There weren't any issues with cultural sensitivity in the examples of studies used in the textbook.

Reviewed by Tiffany Kindratt, Assistant Professor, University of Texas at Arlington on 1/1/20

The text is comprehensive with an effective glossary of terms at the end. It would be beneficial to include additional examples and exercises for students to better understand concepts covered in Chapter II, Overview of the Scientific Method,... read more

The text is comprehensive with an effective glossary of terms at the end. It would be beneficial to include additional examples and exercises for students to better understand concepts covered in Chapter II, Overview of the Scientific Method, Chapter IV, Psychological Measurement, and Chapter XII Descriptive Statistics.

The text is accurate and there are minimal type/grammatical errors throughout. The verbiage is written in an unbiased manner consistently throughout the textbook.

The content is up-to-date, and examples can be easily updated for future versions. As a public health instructor, I would be interested in seeing examples of community-based examples in future versions. The current examples provided are relevant for undergraduate public health students as well as psychology students.

The text is written in a clear manner. The studies used can be easily understood by undergraduate students in other social science fields, such as public health. More examples and exercises using inferential statistics would be helpful for students to better grasp the concepts.

The framework for each chapter and terminology used are consistent. It is helpful that each section within each chapter begins with learning objectives and the chapter ends with key takeaways and exercises.

The text is clearly divided into sections within each chapter. When I first started reviewing this textbook, I thought each section was actually a very short chapter. I would recommend including a listing of all of the objectives covered in each chapter at the beginning to improve the modularity of the text.

Some of the topics do not follow a logical order. For example, it would be more appropriate to discuss ethics before providing the overview of the scientific method. It would be better to discuss statistics used to determine results before describing how to write manuscripts. However, the text is written in a way that that the chapters could be assigned to students in a different order without impacting the students’ comprehension of the concepts.

I did not encounter any interface issues when reviewing this text. All links worked and there were no distortions of the images or charts that may confuse the reader. There are several data tables throughout the text which are left-aligned and there is a large amount of empty white space next it. I would rearrange the text in future versions to make better use of this space.

The text contains minimal grammatical errors.

The examples are culturally relevant. I did not see any examples that may be considered culturally insensitive or offensive in any way.

As an instructor for an undergraduate public health sciences and methods course, I will consider using some of the content in this text to supplement the current textbook in the future.

Reviewed by Mickey White, Assistant Professor, East Tennessee State University on 10/23/19

The table of contents is well-formatted and comprehensive. Easy to navigate and find exactly what is needed, students would be able to quickly find needed subjects. read more

The table of contents is well-formatted and comprehensive. Easy to navigate and find exactly what is needed, students would be able to quickly find needed subjects.

Content appears to be accurate and up-to-date.

This text is useful and relevant, particularly with regard to expressing and reporting descriptive statistics and results. As APA updates, the text will be easy to edit, as the sections are separated.

Easy to read and engaging.

Chapters were laid out in a consistent manner, which allows readers to know what is coming. The subsections contained a brief overview and terminology was consistent throughout. The glossary added additional information.

Sections and subsections are delineated in a usable format.

The key takeaways were useful, including the exercises at the end of each chapter.

Reading the book online is a little difficult to navigate page-by-page, but e-pub and PDF formats are easy to navigate.

No errors noted.

Would be helpful to have a clearer exploration of cultural factors impacting research, including historical bias in assessment and research outside of research ethics.

Reviewed by Robert Michael, Assistant Professor, University of Louisiana at Lafayette on 10/14/19

Successfully spans the gamut of topics expected in a Research Methods textbook. Some topics are covered in-depth, while others are addressed only at a surface level. Instructors may therefore need to carefully arrange class material for topics in... read more

Successfully spans the gamut of topics expected in a Research Methods textbook. Some topics are covered in-depth, while others are addressed only at a surface level. Instructors may therefore need to carefully arrange class material for topics in which depth of knowledge is an important learning outcome.

The factual content was error-free, according to my reading. I did spot a few grammatical and typographical errors, but they were infrequent and minor.

Great to see nuanced—although limited—discussion of issues with Null Hypothesis Significance Testing, Reproducibility in Psychological Science, and so forth. I expect that these areas are likely to grow in future editions, perhaps supplementing or even replacing more traditional material.

Extremely easy to read with multiple examples throughout to illustrate the principles being covered. Many of these examples are "classics" that students can easily relate to. Plus, who doesn't like XKCD comics?

The textbook is structured sensibly. At times, certain authors' "voices" seemed apparent in the writing, but I suspect this variability is unlikely to be noticed by or even bothersome to the vast majority of readers.

The topics are easily divisible and seem to follow routine expectations. Instructors might find it beneficial and/or necessary to incorporate some of the statistical thinking and learning into various earlier chapters to facilitate student understanding in-the-moment, rather than trying to leave all the statistics to the end.

Sensible and easy-to-follow structure. As per "Modularity", the Statistical sections may benefit from instructors folding in such learning throughout, rather than only at the end.

Beautifully presented, crisp, easy-to-read and navigate. Caveat: I read this online, in a web-browser, on only one device. I haven't tested across multiple platforms.

High quality writing throughout. Only a few minor slip-ups that could be easily fixed.

Includes limited culturally relevant material where appropriate.

Reviewed by Matthew DeCarlo, Assistant Professor, Radford University on 6/26/19

The authors do a great job of simplifying the concepts of research methods and presenting them in a way that is understandable. There is a tradeoff between brevity and depth here. Faculty who adopt this textbook may need to spend more time in... read more

The authors do a great job of simplifying the concepts of research methods and presenting them in a way that is understandable. There is a tradeoff between brevity and depth here. Faculty who adopt this textbook may need to spend more time in class going in depth into concepts, rather than relying on the textbook for all of the information related to key concepts. The text does not cover qualitative methods in detail.

The textbook provides an accurate picture of research methods. The tone is objective and without bias.

The textbook is highly relevant and up to date. Examples are drawn from modern theories and articles.

The writing is a fantastic mix of objective and authoritative while also being approachable.

The book coheres well together. Each chapter and section are uniform.

This book fits very well within a traditional 16 week semester, covering roughly a chapter per week. One could take out specific chapters and assign them individually if research methods is taught in a different way from a standard research textbook.

Content is very well organized. The table of contents is easy to navigate and each chapter is presented in a clear and consistent manner. The use of a two-tier table of contents is particularly helpful.

Standard pressbooks interface, which is great. Uses all of the standard components of Pressbooks well, though the lack of H5P and interactive content is a drawback.

I did not notice any grammar errors.

Cultural Relevance rating: 2

The book does not deal with cultural competence and humility in the research process. Integration of action research and decolonization perspectives would be helpful.

Reviewed by Christopher Garris, Associate Professor, Metropolitan State University of Denver on 5/24/19

Most content areas in this textbook were covered appropriately extensively. Notably, this textbook included some content that is commonly missing in other textbooks (e.g. presenting your research). There were some areas where more elaboration... read more

Most content areas in this textbook were covered appropriately extensively. Notably, this textbook included some content that is commonly missing in other textbooks (e.g. presenting your research). There were some areas where more elaboration and more examples were needed. For example, the section covering measurement validities included all the important concepts, but needed more guidance for student comprehension. Also, the beginning chapters on 'common sense' reasoning and pseudoscience seemed a little too brief.

Overall, this textbook appeared to be free from glaring errors. There were a couple of instances of concern, but were not errors, per se. For example, the cut-off for Cronbach's alpha was stated definitively at .80, while this value likely would be debated among researchers.

This textbook was presented in such a way that seemed protect it from becoming obsolete within the next few years. This is important for continued, consistent use of the book. The authors have revised this book, and those revisions are clearly summarized in the text. Importantly, the APA section of the textbook appears to be up-to-date. Also, the use of QR codes throughout the text is a nice touch that students may appreciate.

Connected to comprehensiveness, there are some important content areas that I felt were lacking in elaboration and examples (e.g. testing the validity of measurement; introduction of experimental design), which inhibits clarity. Overall, however, the topics seemed to be presented in a straightforward, accessible manner. The textbook includes links to informative videos and walk-throughs where appropriate, which seem to be potentially beneficial for student comprehension. The textbook includes tools designed to aid learning, namely "Key Takeaways" and "Exercises" sections at the end of most modules, but not all. "Key Takeaways" seemed valuable, as they were a nice bookend to the learning objectives stated at the beginning of each module. "Exercises" did not appear to be as valuable, especially for the less-motivated student. On their face, these seemed to be more designed for instructors to use as class activities/active learning. Lastly, many modules of the textbook were text-heavy and visually unappealing. While this is superficial, the inclusion of additional graphics, example boxes, or figures in these text-heavy modules might be beneficial.

The textbook appeared to be internally consistent with its approach and use of terminology.

The textbook had a tendency to 'throw out' big concepts very briefly in earlier modules (e.g. sampling, experimental/non-experimental design), and then cover them in more detail in later modules. This would have been less problematic if the text would explicitly inform the student that these concepts would be elaborated upon later. Beyond this issue, the textbook seems to lend itself to being divided up and used on module-by-module basis.

The organization of the chapters did not make intuitive sense to me. The fact that correlation followed experimental research, and that descriptive research was the second-to-last module in the sequence was confusing. That said, textbook is written in such a way that an instructor easily assign the modules in the order that works best for their class.

Overall, the interface worked smoothly and there were few technical issues. Where there were issues (e.g. inconsistent spacing between lines and words), they were negligible.

The text seemed to be free from glaring grammatical problems.

Because this is a methodology textbook, it does not lend itself to too much cultural criticism. That said, the book did not rely on overly controversial examples, but also didn't shy away from important cultural topics (e.g. gender stereotypes, vaccines).

Reviewed by Michel Heijnen, Assistant Professor, University of North Carolina Wilmington on 3/27/18

The book covers all areas related to research methods, not only for the field of psychology, but also to other related fields like exercise science. Topics include ethics, developing a research questions, experimental designs, non-experimental... read more

The book covers all areas related to research methods, not only for the field of psychology, but also to other related fields like exercise science. Topics include ethics, developing a research questions, experimental designs, non-experimental designs, and basic statistics, making this book a great resource for undergraduate research methods classes.

Reviewed content is accurate and seems free of any personal bias.

The topic of research methods in general is not expected to change quickly. It is not expected that this text will become obsolete in the near future. Furthermore, for both the field of psychology as well as other related fields, the examples will continue to have an application to explain certain concepts and will not be outdated soon, even with new research emerging every day.

The text is written so an undergraduate student should be able to understand the concepts. The examples provided in the text greatly contribute to the understanding of the topics and the proposed exercises at the end of each chapter will further apply the knowledge.

The layout and writing style are consistent throughout the text.

Layout of the text is clear, with multiple subsection within each chapter. Each chapter can easily be split into multiple subsection to assign to students. No evidence of self-refers was observed, and individual chapters could be assigned to students without needed to read all preceding chapters. For example, Chapter 4 may not be particularly useful to students outside of psychology, but an instructor can easily reorganize the text and skip this chapter while students can still understand following chapters.

Topics are addressed in a logical manner. Overall, an introduction to research is provided first (including ethics to research), which is followed by different types of research, and concludes with types of analysis.

No images or tables are distorted, making the text easy to read.

No grammatical errors observed in text.

Text is not offensive and does not appear to be culturally insensitive.

I believe that this book is a great resource and, as mentioned previously, can be used for a wider audience than just psychology as the basics of research methods can be applied to various fields, including exercise science.

Reviewed by Chris Koch, Professor of Psychology, George Fox University on 3/27/18

All appropriate areas and topics are covered in the text. In that sense, this book is equivalent to other top texts dealing with research methods in psychology. The appeal of this book is the brevity and clarity. Therefore, some may find that,... read more

All appropriate areas and topics are covered in the text. In that sense, this book is equivalent to other top texts dealing with research methods in psychology. The appeal of this book is the brevity and clarity. Therefore, some may find that, although the topics are covered, topics may not be covered as thoroughly they might like. Overall, the coverage is solid for an introductory course in research methods.

In terms of presentation, this book could be more comprehensive. Each chapter does start with a set of learning objectives and ends with "takeaways" and a short set of exercises. However, it lacks detailed chapter outlines, summaries, and glossaries. Furthermore, an index does not accompany the text.

I found the book to be accurate with content being fairly presented. There was no underlying bias throughout the book.

This is an introductory text for research methods. The basics of research methods have been consistent for some time. The examples used in the text fit the concepts well. Therefore, it should not be quickly dated. It is organized in such a way that sections could be easily modified with more current examples as needed.

The text is easy to read. It is succinct yet engaging. Examples are clear and terminology is adequately defined.

New terms and concepts are dealt with chapter by chapter. However, those things which go across chapters are consistently presented.

The material for each chapter is presented in subsections with each subsection being tied to a particular learning objective. It is possible to use the book by subsection instead of by chapter. In fact, I did that during class by discussing the majority of one chapter, discussing another chapter, and then covering what I previously skipped,

In general, the book follows a "traditional" organization, matching the organization of many competing books. As mentioned in regard to modularity, I did not follow the organization of the book exactly as it was laid out. This may not necessarily reflect poorly on the book, however, since I have never followed the order of any research methods book. My three exams covered chapter 1 through 4, chapters 5, 6, part of 8, and chapters 7, the remainder of 8, 9, and 10. Once we collected data I covered chapters 11 through 13.

Interface rating: 3

The text and images are clear and distortion free. The text is available in several formats including epub, pdf, mobi, odt, and wxr. Unfortunately, the electronic format is not taken full advantage of. The text could be more interactive. As it is, it is just text and images. Therefore, the interface could be improved.

The book appeared to be well written and edited.

I did not find anything in the book that was culturally insensitive or offensive. However, more examples of cross-cultural research could be included.

I was, honestly, surprised by how much I liked the text. The material was presented in easy to follow format that is consistent with how I think about research methods. That made the text extremely easy to use. Students also thought the book was highly accessible Each chapter was relatively short but informative and easy to read.

Reviewed by Kevin White, Assistant Professor, East Carolina University on 2/1/18

This book covers all relevant topics for an introduction to research methods course in the social sciences, including measurement, sampling, basic research design, and ethics. The chapters were long enough to be somewhat comprehensive, but short... read more

This book covers all relevant topics for an introduction to research methods course in the social sciences, including measurement, sampling, basic research design, and ethics. The chapters were long enough to be somewhat comprehensive, but short enough to be digestible for students in an introductory-level class. Student reviews of the book have so far been very positive. The only section of the text for which more detail may be helpful is 2.3 (Reviewing the Research Literature), in which more specific instructions related to literature searches may be helpful to students.

I did not notice any issues related to accuracy. Content appeared to be accurate, error-free, and unbiased.

One advantage of this book is that it is relevant to other applied fields outside of psychology (e.g., social work, counseling, etc.). Also, the exercises at the end of chapter sections are helpful.

The clarity of the text provides students with succinct definitions for research-related concepts, without unnecessary discipline-specific jargon. One suggestion for future editions would be to make the distinctions between different types of non-experimental research a bit more clear for students in introductory classes (e.g., "Correlational Research" in Section 7.2).

Formatting and terminology was consistent throughout this text.

A nice feature of this book is that instructors can select individual sections within chapters, or even jump between sections within chapters. For example, Section 1.4 may not fit for a class that is less clinically-oriented in nature.

The flow of the text was appropriate, with ethics close to the beginning of the book (and an entire chapter devoted to it), and descriptive/inferential statistics at the end.

I did not notice any problems related to interface. I had no trouble accessing or reading the text, and the images were clear.

The text contained no discernible grammatical errors.

The book does not appear to be culturally insensitive in any discernible way, and explicitly addresses prejudice in research (e.g., Section 5.2). However, I think that continuing to add more examples that relate to specific marginalized groups would help improve the text (and especially exercises).

Overall, this book is very useful for an introductory research methods course in psychology or social work, and I highly recommend.

Reviewed by Elizabeth Do, Instructor, Virginia Commonwealth University on 2/1/18

Although this textbook does provide good information regarding introductory concepts necessary for the understanding of correlational designs, and is presented in a logical order. It does not, however, cover qualitative methodologies, or research... read more

Although this textbook does provide good information regarding introductory concepts necessary for the understanding of correlational designs, and is presented in a logical order. It does not, however, cover qualitative methodologies, or research ethics as it relates to other countries outside of the US.

There does not seem to be any errors within the text.

Since this textbook covers a topic that is unlikely to change over the years and it's content is up-to-date, it remains relevant to the field.

The textbook is written at an appropriate level for undergraduate students and is useful in that it does explain important terminology.

There does not seem to be any major inconsistencies within the text.

Overall, the text is very well organized - it is separated into chapters that are divided up into modules and within each module, there are clear learning objectives. It is also helpful that the textbook includes useful exercises for students to practice what they've read about from the text.

The topics covered by this textbook are presented in an order that is logical. The writing is clear and the examples are very useful. However, more information could be provided in some of the chapters and it would be useful to include a table of contents that links to the different chapters within the PDF copy, for reader's ease in navigation when looking for specific terms and/or topics.

Overall, the PDF copy of the textbook made it easy to read; however, there did seem to be a few links that were missing. Additionally, it would be helpful to have some of the graphs printed in color to help with ease of following explanations provided by the text. The inclusion of a table of contents would also be useful for greater ease with navigation.

There does not seem to be any grammatical errors in the textbook. Also, the textbook is written in a clear way, and the information flows nicely.

This textbook focuses primarily on examples from the United States. It does not seem to be culturally insensitive or offensive in anyway and I liked that it included content regarding the avoidance of biased language (chapter 11).

This textbook makes the material very accessible, and it is easy to read/follow examples.

Reviewed by Eric Lindsey, Professor, Penn State University Berks Campus on 2/1/18

The content of the Research Methods in Psychology textbook was very thorough and covered what I would consider to be the important concepts and issues pertaining to research methods. I would judge that the textbook has a comparable coverage of... read more

The content of the Research Methods in Psychology textbook was very thorough and covered what I would consider to be the important concepts and issues pertaining to research methods. I would judge that the textbook has a comparable coverage of information to other textbooks I have reviewed, including the current textbook I am using. The range of scholarly sources included in the textbook was good, with an appropriate balance between older and classic research examples and newer more cutting edge research information. Overall, the textbook provides substantive coverage of the science of conducting research in the field of psychology, supported by good examples, and thoughtful questions.

The textbook adopts a coherent and student-friendly format, and offers a precise introduction to psychological research methodology that includes consideration of a broad range of qualitative and quantitative methods to help students identify and evaluate the best approach for their research needs. The textbook offers a detailed review of the way that psychological researchers approach their craft. The author guides the reader through all aspects of the research process including formulating objectives, choosing research methods, securing research participants, as well as advice on how to effectively collect, analyze and interpret data and disseminate those findings to others through a variety of presentation and publication venues. The textbook offers relevant supplemental information in textboxes that is highly relevant to the material in the accompanying text and should prove helpful to learners. Likewise the graphics and figures that are included are highly relevant and clearly linked to the material presented in the text. The information covered by the textbook reflects an accurate summary of current techniques and methods used in research in the field of psychology. The presentation of information addresses the pros and cons of different research strategies in an objective and evenhanded way.

The range of scholarly sources included in the textbook was good, with an appropriate balance between older, classic research evidence and newer, cutting edge research. Overall, the textbook provides substantive coverage of the science on most topics in research methods of psychology, supported by good case studies, and thoughtful questions. The book is generally up to date, with adequate coverage of basic data collection methods and statistical techniques. Likewise the review of APA style guidelines is reflects the current manual and I like the way the author summarizes changes from the older version of the APA manual. The organization of the textbook does appear to lend itself to editing and adding new information with updates in the future.

I found the textbook chapters to be well written, in a straightforward yet conversational manner. It gives the reader an impression of being taught by a knowledgeable yet approachable expert. The writing style gives the learner a feeling of being guided through the lessons and supported in a very conversational approach. The experience of reading the textbook is less like being taught and more like a colleague sharing information. Furthermore, the style keeps the reader engaged but doesn't detract from its educational purpose. I also appreciate that the writing is appropriately concise. No explanations are so wordy as to overwhelm or lull the reader to sleep, but at the same time the information is not so vague that the reader can't understand the point at all.

The book’s main aim is to enable students to develop their own skills as researchers, so they can generate and advance common knowledge on a variety of psychological topics. The book achieves this objective by introducing its readers, step-by-step, to psychological research design, while maintaining an excellent balance between substance and attention grabbing examples that is uncommon in other research methods textbooks. Its accessible language and easy-to-follow structure and examples lend themselves to encouraging readers to move away from the mere memorization of facts, formulas and techniques towards a more critical evaluation of their own ideas and work – both inside and outside the classroom. The content of the chapters have a very good flow that help the reader to connect information in a progressive manner as they proceed through the textbook.

Each chapter goes into adequate depth in reviewing both past and current research related to the topic that it covers for an undergraduate textbook on research methods in psychology. The information within each chapter flows well from point-to-point, so that the reader comes away feeling like there is a progression in the information presented. The only limitation that I see is that I felt the author could do a little more to let the reader know how information is connected from chapter to chapter. Rather than just drawing the reader’s attention to things that were mentioned in previous chapters, it would be nice to have brief comments about how issues in one chapter relate to topics covered in previous chapters.

In my opinion the chapters are arranged in easily digestible units that are manageable in 30-40 minute reading sessions. In fact, the author designed the chapters of the textbook in a way to make it easy to chunk information, and start and stop to easily pick up where one leaves off from one reading session to another. I also found the flow of information to be appropriate, with chapters containing just the right amount of detail for use in my introductory course in research methods in psychology.

The book is organized into thirteen chapters. The order of the chapters offers a logical progression from a broad overview of information about the principles and theory behind research in psychology, to more specific issues concerning the techniques and mechanics of conducting research. Each chapter ends with a summary of key takeaways from the chapter and exercises that do more than ask for content regurgitation. I find the organization of the textbook to be effective, and matches my approach to the course very well. I would not make any changes to the overall format with the exception of moving chapter 11 on presenting research to the end of the textbook, after the chapters on statistical analysis and interpretation.

I found the quality of the appearance of the textbook to be very good. The textbook features appropriate text and section/header font sizes that allow for an adequate zooming level to read large or smalls sections of text, that will give readers flexibility to match their personal preference. There are learning objectives at the start of each chapter to help students know what to expect. Key terms are highlighted in a separate color that are easily distinguishable in the body of the page. There are very useful visuals in every chapter, including tables, figures, and graphs. Relevant supplemental information is also highlighted in well formatted text boxes that are color coded to indicate what type of information is included. My only criticism is that the photographs included in the text are of low quality, and there are so few in the textbook that I feel it would have been better to just leave them out.

I found no grammatical errors in my review of the textbook. The textbook is generally well written, and the style of writing is at a level that is appropriate for an undergraduate class.

Although the textbook contains no instances of presenting information that is cultural insensitive or offensive, it does not offer an culturally inclusive review of information pertaining to research methods in psychology. I found no inclusion of examples of research conducting with non European American samples included in the summary of studies. Likewise the authors do place much attention on the issue of cultural sensitivity when conducing research. If there is one major weakness of the textbook I would say it is in this area, but based on my experience it is not an uncommon characteristic of textbooks on research methods in psychology.

Reviewed by zehra peynircioglu, Professor, American University on 2/1/18

Short and sweet in most areas. Covers the basic concepts, not very comprehensively but definitely adequately so for a general beginning-level research methods course. For instance, I would liked to have seen a "separate" chapter on correlational... read more

Comprehensiveness rating: 3 see less

Short and sweet in most areas. Covers the basic concepts, not very comprehensively but definitely adequately so for a general beginning-level research methods course. For instance, I would liked to have seen a "separate" chapter on correlational research (there is one on single subject research and one on survey research), a discussion of the importance of providing a theoretical rationale for "getting an idea" (most students are fine with finding interesting and feasible project ideas but cannot give a theoretical rationale) before or after Chapter 4 on Theory, or a chapter on neuroscientific methods, which are becoming more and more popular. Nevertheless, it touches on most traditional areas that are in other books.

I did not find any errors or biases

This is one area where there is not much danger of going obsolete any time soon. The examples might need to be updated periodically (my students tend to not like dated materials, however relevant), but that should be easy.

Very clear and accessible prose. Despite the brevity, the concepts are put forth quite clearly. I like the "not much fluff" mentality. There is also adequate explanations of jargon and technical terminology.

I could not find any inconsistencies. The style and exposition frameworks are also quite consistent.

Yes, the modularity is fine. The chapters follow a logical pattern, so there should not be too much of a need for jumping around. And even if jumping around is needed depending on teaching style, the sections are solid in terms of being able to stand alone (or as an accompaniment to lectures).

Yes, the contents is ordered logically and the high modularity helps with any reorganization that an instructor may favor. In my case, for instance, Ch. 1 is fine, but I would skip it because it's mostly a repetition of what most introductory psychology books also say. I would also discuss non-experimental methods before going into experimental design. But such changes are easy to do, and if someone followed the book's own organization, there would also be a logical flow.

As far as I could see, the text is free of significant interface issues, at least in the pdf version

I could not find any errors.

As far as I could see, the book was culturally relevant.

I loved the short and sweet learning objectives, key takeaway sections, and the exercises. They are not overwhelming and can be used in class discussions, too.

Reviewed by George Woodbury, Graduate Student, Miami University, Ohio on 6/20/17

This text covers the typical areas for an undergraduate psychology course in research design. There is no table of contents included with the downloadable version, although there is a table of contents on the website (which excludes sub-sections... read more

This text covers the typical areas for an undergraduate psychology course in research design. There is no table of contents included with the downloadable version, although there is a table of contents on the website (which excludes sub-sections of chapters). The sections on statistics are not extensive enough to be useful in and of themselves, but they are useful for transitions to a follow-up statistics course. There does not seem to be a glossary of terms, which made it difficult at times for my read through and I assume later for students who decide to print the text. The text is comprehensive without being wordy or tedious.

Relatively minor errors; There does not seem to be explicit cultural or methodological bias in the text.

The content is up-to-date, and examples from the psychology literature are generally within the last 25 years. Barring extensive restructuring in the fundamentals of methodology and design in psychology, any updates will be very easy to implement.

Text will be very clear and easy to read for students fluent in English. There is little jargon/technical terminology used, and the vocabulary that is provided in the text is contemporary

There do not seem to be obvious shifts in the terminology or the framework. The text is internally consistent in that regard.

The text is well divided into chapter and subsections. Each chapter is relatively self-contained, so there are little issues with referring to past material that may have been skipped. The learning objectives at the beginning of the chapter are very useful. Blocks of text are well divided with headings.

As mentioned above, the topics of the text follow the well-established trajectory of undergraduate psychology courses. This makes it very logical and clear.

The lack of a good table of contents made it difficult to navigate the text for my read through. There were links to an outside photo-hosting website (flickr) for some of the stock photos, which contained the photos of the original creators of the photos. This may be distracting or confusing to readers. However, the hyperlinks in general helped with navigation with the PDF.

No more grammatical errors than a standard, edited textbook.

Very few examples explicitly include other races, ethnicities, or backgrounds, however the examples seem to intentionally avoid cultural bias. Overall, the writing seems to be appropriately focused on avoiding culturally insensitive or offensive content.

After having examined several textbooks on research design and methodology related to psychology, this book stands out as superior.

Reviewed by Angela Curl, Assistant Professor, Miami University (Ohio) on 6/20/17

"Research Methods in Psychology" covers most research method topics comprehensively. The author does an excellent job explaining main concepts. The chapter on causation is very detailed and well-written as well as the chapter on research ethics.... read more

"Research Methods in Psychology" covers most research method topics comprehensively. The author does an excellent job explaining main concepts. The chapter on causation is very detailed and well-written as well as the chapter on research ethics. However, the explanations of data analysis seem to address upper level students rather than beginners. For example, in the “Describing Statistical Relationships” chapter, the author does not give detailed enough explanations for key terms. A reader who is not versed in research terminology, in my opinion, would struggle to understand the process. While most topics are covered, there are some large gaps. For example, this textbook has very little content related to qualitative research methods (five pages).

The content appears to be accurate and unbias.

The majority of the content will not become obsolete within a short time period-- many of the information can be used for the coming years, as the information provided is, overall, general in nature. The notably exceptions are the content on APA Code of Ethics and the APA Publication Manual, which both rely heavily on outdated versions, which limits the usefulness of these sections. In addition, it would be helpful to incorporate research studies that have been published after 2011.

The majority of the text is clear, with content that is easy for undergraduate students to read and understand. The key points included in the chapters are helpful, but some chapters seem to be missing key points (i.e., the key points do not accurately represent the overall chapter).

The text seems to be internally consistent in its terminology and organization.

Each chapter is broken into subsections that can be used alone. For example, section 5.2 covers reliability and validity of measurement. This could be extremely helpful for educators to select specific content for assigned readings.

The topics are presented in a logical matter for the most part. However, the PDF version of the book does not include a table of contents, and none of the formats has a glossary or index. This can make it difficult to quickly navigate to specific topics or terms, especially when explanations do not appear where expected. For example, the definitions of independent and dependent variables is provided under the heading “Correlation Does Not Imply Causation” (p. 22).

The text is consistent but needs more visual representations throughout the book, rather than heavily in some chapters and none at all in other chapters. Similarly, the text within the chapters is not easily readable due to the large sections of text with little to no graphics or breaks.

The interface of the text is adequate. However, the formatting of the PDF is sometimes weak. For example, the textbook has a number of pages with large blank spaces and other pages are taken up with large photos or graphics. The number of pages (and cost of printing) could have been reduced, or more graphics added to maximize utility.

I found no grammatical errors.

Text appears to be culturally sensitive. I appreciated the inclusion of the content about avoiding biased language (chapter 11).

Instructors who adopt this book would likely benefit from either selecting certain chapters/modules and/or integrating multiple texts together to address the shortcomings of this text. Further, the sole focus on psychology limits the use of this textbook for introductory research methods for other disciplines (e.g., social work, sociology).

Reviewed by Pramit Nadpara, Assistant Professor, Virginia Commonwealth University on 4/11/17

The text book provides good information in certain areas, while not comprehensive information in other areas. The text provides practical information, especially the section on survey development was good. Additional information on sampling... read more

The text book provides good information in certain areas, while not comprehensive information in other areas. The text provides practical information, especially the section on survey development was good. Additional information on sampling strategies would have been beneficial for the readers.

There are no errors.

Research method is a common topic and the fundamentals of it will not change over the years. Therefore, the book is relevant and will not become obsolete.

Clarity rating: 3

The text in the book is clear. Certain aspects of the text could have been presented more clearly. For example, the section on main effects and interactions are some concepts that students may have difficulty understanding. Those areas could be explained more clearly with an example.

Consistency rating: 3

Graphs in the book lacks titles and variable names. Also, the format of chapter title page needs to be consistent.

At times there were related topics spread across several chapters. This could be corrected for a better read by the audience..

The book text is very clear, and the flow from one topic to the next was adequate. However, having a outline would help the reader.

The PDF copy of the book was a easy read. There were few links that were missing though.

There were no grammatical errors.

The text is not offensive and examples in it are mostly based on historical US based experiments.

I would start of by saying that I am a supporter of the Open Textbook concept. In this day and age, there are a variety of Research Methods book/text available on the market. While this book covers research methods basics, it cannot be recommended in its current form as an acceptable alternative to the standard text. Modifications to the text as recommended by myself and other reviewers might improve the quality of this book in the future.

Reviewed by Meghan Babcock, Instructor, University of Texas at Arlington on 4/11/17

This text includes all important areas that are featured in other Research Methods textbooks and are presented in a logical order. The text includes great examples and provides the references which can be assigned as supplemental readings. In... read more

This text includes all important areas that are featured in other Research Methods textbooks and are presented in a logical order. The text includes great examples and provides the references which can be assigned as supplemental readings. In addition, the chapters end with exercises that can be completed in class or as part of a laboratory assignment. This text would be a great addition to a Research Methods course or an Introductory Statistics course for Psychology majors.

The content is accurate. I did not find any errors and the material is unbiased.

Yes - the content is up to date and would be easy to update if/when necessary.

The text is written at an appropriate level for undergraduate students and explains important terminology. The research studies that the author references are ones that undergraduate psychology majors should be familiar with. The only section that was questionable to me was that on multiple regression in section 8.3 (Complex Correlational Designs). I am unaware of other introductory Research Methods textbooks that cover this analysis, especially without describing simple regression first.

The text is consistent in terms of terminology. The framework is also consistent - the chapters begin with Learning Objectives and ends with Key Takeaways and Exercises.

The text is divisible into smaller reading sections - possibly too many. The sections are brief, and in some instances too brief (e.g., the section on qualitative research). I think that the section headers are helpful for instructors who plan on using this text in conjunction with another text in their course.

The topics were presented in a logical fashion and are similar to other published Research Methods texts. The writing is very clear and great examples are provided. I think that some of the sections are rather brief and more information and examples could be provided.

I did not see any interface issues. All of the links worked properly and the tables and figures were accurate and free of errors. I particularly liked the figures in section 5.2 on reliability of measurement.

There are three comments that I have about the interface, however. First, I was expecting the keywords in blue font to be linked to a glossary, but they were not. I would have appreciated this feature. Second, I read this text as a PDF on an iPad and this version lacking was the Table of Contents (TOC) feature. Although I was able to view the TOC in different versions, I would have appreciated it in the PDF version. Also, it would be nice if the TOC was clickable (i.e., you could click on a section and it automatically directed you to that section). Third, I think the reader of this text would benefit from a glossary at the end of each chapter and/or an index at the end of the text. The "Key Takeaways" sections at the end of each chapter were helpful, but I think that a glossary would be a nice addition as well.

I did not notice any grammatical errors of any kind. The text was easy to read and I think that undergraduate students would agree.

The text was not insensitive or offensive to any races, ethnicities, or backgrounds. I appreciated the section on avoiding biased language when writing manuscripts (e.g., using 'children with learning disabilities' instead of 'special children' or using 'African American' instead of 'minority').

I think that this text would be a nice addition to a Research Methods & Statistics course in psychology. There are some sections that I found particularly helpful: (1) 2.2 and 2.3 - the author gives detailed information about generating research questions and reviewing the literature; (2) 9.2 - this section focuses on constructing survey questionnaires; (3) 11.2 and 11.3 - the author talks about writing a research report and about presenting at conferences. These sections will be great additions to an undergraduate Research Methods course. The brief introduction to APA style was also helpful, but should be supplemented with the most recent APA style manual.

Reviewed by Shannon Layman, Lecturer, University of Texas at Arlington on 4/11/17

The sections in this textbook are overall more brief than in previous Methods texts that I have used. Sometimes this brevity is helpful in terms of getting to the point of the text and moving on. In other cases, some topics could use a bit more... read more

The sections in this textbook are overall more brief than in previous Methods texts that I have used. Sometimes this brevity is helpful in terms of getting to the point of the text and moving on. In other cases, some topics could use a bit more detail to establish a better foundation of the content before moving on to examples and/or the next topic.

I did not find any incorrect information or gross language issues.

Basic statistical and/or methodological texts tend to stay current and up-to-date because the topics in this field have not changed over the decades. Any updated methodologies would be found in a more advanced methods text.

The text is very clear and the ideas are easy to follow/ presented in a logical manner. The most helpful thing about this textbook is that the author arrives at the point of the topic very quickly. Another helpful point about this textbook is the relevancy of the examples used. The examples appear to be accessible to a wide audience and do not require specialization or previous knowledge of other fields of psychology.

I feel this text is very consistent throughout. The ideas build on each other and no terms are discussed in later chapters without being established in previous chapters.

Each chapter had multiple subsections which would allow for smaller reading sections throughout the course. The amount of content in each section and chapter appeared to be less than what I have encountered in other Methods texts.

The organization of the topics in this textbook follows the same or similar organization that I see in other textbooks. As I mentioned previously, the ideas build very well throughout the text.

I did not find any issues with navigation or distortion of the figures in the text.

There were not any obvious and/or egregious grammatical errors that I encountered in this text.

This topic is not really an issue with a Methods textbook as the topics are more so conceptual as opposed to topical. That being said, I did not see an issue with any examples used.

I have no other comments than what I addressed previously.

Reviewed by Sarah Allred, Associate Professor, Rutgers University, Camden on 2/8/17

Mixed. For some topics, there is more (and more practical) information than in most textbooks. I appreciated the very practical advice to students about how to plot data (in statistics chapters). Similarly, there is practical advice about how... read more

Mixed. For some topics, there is more (and more practical) information than in most textbooks. I appreciated the very practical advice to students about how to plot data (in statistics chapters). Similarly, there is practical advice about how to comply with ethical guidelines. The section on item development in surveys was very good.

On the other hand, there is far too little information about some subjects. For example, independent and dependent variables are introduced in passing in an early chapter and then referred to only much later in the text. In my experience, students have a surprisingly difficult time grasping this concept. Another important example is sampling; I would have preferred much more information on types of samples and sampling techniques, and the problems that arise from poor sampling. A third example is the introduction to basic experimental design. Variables, measurement, validity, and reliability are all introduced in one chapter.

I did not see an index or glossary.

I found no errors.

The fundamentals of research methods do not change much. Given the current replication crisis in psychology, it might be helpful to have something about replicability.

Mixed. The text itself is spare and clear. The style of the book is to explain a concept in very few words. There are some excellent aspects of this, but on the other hand, there are some concepts that students have a very difficult time undersatnding if they are not embedded in concrete examples. For example, the section on main effects and interactions shows bar graphs of interactions, but this is presented without variable names or axis titles, and separate from any specific experiment.

Sometimes the chapter stucture is laid out on the title page, and other times it is not. Some graphs lack titles and variable names.

The chapters can be stand alone, but sometimes I found conceptually similar pieces spread across several chapters, and conceptually different pieces in the same chapters.

The individual sentences and paragraphs are always very clear. However, I felt that more tables/outlines of major concepts would have been helpful. For example, perhaps a flow chart of different kinds of experimental designs would be useful. (See section on comprehensiveness for more about organization).

The flow from one topic to the next was adequate.

I read the pdf. Perhaps the interface is more pleasant on other devices, but I found the different formats and fonts in image/captions/main text/figure labels distracting. Many if the instances of apparently hyperlinked (blue) text to do not link to anything.

I found no grammatical errors, and prose is standard academic English.

Like most psychology textbooks available in the US, examples are focused on important experiments in US history.

I really wanted to be happy with this text. I am a supporter of the Open Textbook concept, and I wanted to find this book an acceptable alternative to the variety of Research Methods texts I’ve used. Unfortunately, I cannot recommend this book as superior in quality.

Reviewed by Joel Malin, Assistant Professor, Miami University on 8/21/16

This textbook covers all or nearly all of what I believe are important topics to provide an introduction to research methods in psychology. One minor issue is that the pdf version, which I reviewed, does not include an index or a glossary. As... read more

This textbook covers all or nearly all of what I believe are important topics to provide an introduction to research methods in psychology. One minor issue is that the pdf version, which I reviewed, does not include an index or a glossary. As such, it may be difficult for readers to zero in on material that they need, and/or to get a full sense of what will be covered and in what order.

I did not notice errors.

The book provides a solid overview of key issues related to introductory research methods, many of which are nearly timeless.

The writing is clear and accessible. It was easy and pleasing to read.

Terms are clearly defined and build upon each other as the book progresses.

I believe the text is organized in such a way that it could be easily divided into smaller sections.

The order in which material is presented seems to be well thought out and sensible.

I did not notice any issues with the interface. I reviewed the pdf version and thought the images were very helpful.

The book is written in a culturally relevant manner.

Reviewed by Abbey Dvorak, Assistant Professor, University of Kansas on 8/21/16

The text includes basic, essential information needed for students in an introductory research methods course. In addition, the text includes three chapters (i.e., research ethics, theory, and APA style) that are typically absent from or... read more

The text includes basic, essential information needed for students in an introductory research methods course. In addition, the text includes three chapters (i.e., research ethics, theory, and APA style) that are typically absent from or inadequately covered in similar texts. However, I did have some areas of concern regarding the coverage of qualitative and mixed methods approaches, and nonparametric tests. Although the author advocates for the research question to guide the choice of approach and design, minimal attention is given to the various qualitative designs (e.g., phenomenology, narrative, participatory action, etc.) beyond grounded theory and case studies, with no mention of the different types of mixed methods designs (e.g., concurrent, explanatory, exploratory) that are prevalent today. In addition, common nonparametric tests (e.g., Wilcoxon, Mann-Whitney, etc.) and parametric tests for categorical data (e.g., chi-square, Fisher’s exact, etc.) are not mentioned.

The text overall is accurate and free of errors. I noticed in the qualitative research sub-section, the author describes qualitative research in general, but does not mention common practices associated with qualitative research, such as transcribing interviews, coding data (e.g., different approaches to coding, different types of codes), and data analysis procedures. The information that is included appears accurate.

The text appears up-to-date and includes basic research information and classic examples that rarely change, which may allow the text to be used for many years. However, the author may want to add information about mixed methods research, a growing research approach, in order for the text to stay relevant across time.

The text includes clear, accessible, straightforward language with minimal jargon. When the author introduces a new term, the term is immediately defined and described. The author also provides interesting examples to clarify and expand understanding of terms and concepts throughout the text.

The text is internally consistent and uses similar language and vocabulary throughout. The author uses real-life examples across chapters in order to provide depth and insight into the information. In addition, the vocabulary, concepts, and organization are consistent with other research methods textbooks.

The modules are short, concise, and manageable for students; the material within each module is logically focused and related to each other. I may move the modules and the sub-topics within them into a slightly different order for my class, and add the information mentioned above, but overall, this is very good.

The author presents topics and structures chapters in a logical and organized manner. The epub and online version do not include page numbers in the text, but the pdf does; this may be confusing when referencing the text or answering student questions. The book ends somewhat abruptly after the chapter on inferential statistics; the text may benefit from a concluding chapter to bring everything together, perhaps with a culminating example that walks the reader through creating the research question, choosing a research approach/design, etc., all the way to writing the research report.

I used and compared the pdf, epub, and online versions of the text. The epub and online versions include a clickable table of contents, but the pdf does not. The table format is inconsistent across the three versions; in the epub version (viewed through ibooks), the table data does not always line up correctly, making it difficult to interpret quickly. In the pdf and online versions, the table format looks different, but the data are lined up. No index made it difficult to quickly find areas of interest in the text; however, I could use the Find/Search functions in all three versions to search and find needed items.

As I read through this text, I did not detect any glaring grammatical errors. Overall, I think the text is written quite well in a style that is accessible to students.

The author uses inclusive, person-first language, and the text does not seem to be offensive or insensitive. As I read, I did notice that topics such as diversity and cultural competency are absent.

I enjoyed reading this text and am very excited to have a free research methods text for my students that I may supplement as needed. I wish there was a test question bank and/or flashcards for my students to help them study, but perhaps that could be added in the future. Overall, this is a great resource!

Reviewed by Karen Pikula, Psychology Instructor PhD, Central Lakes College on 1/7/16

The text covers all the areas and ideas of the subject of research methods in psychology for the learner that is just entering the field. The authors cover all of the content of an introductory research methods textbook and use exemplary examples... read more

The text covers all the areas and ideas of the subject of research methods in psychology for the learner that is just entering the field. The authors cover all of the content of an introductory research methods textbook and use exemplary examples that make those concepts relevent to a beginning researcher. As the authors state, the material is presented in such a manner as to encourage learners to not only be effective consumers of current research but also engage as critical thinkers in the many diverse situations one encounters in everyday life.

The content is accurate, error free, and unbiased. It explains both quantiative and qualitative methods in an unbiased manner. It is a bit slim on qualitative. It would be nice to have a bit more information on, for example, creating interview questions, coding, and qualitative data anaylisis.

The text is up to date, having just been revised. This revision was authored by Rajiv Jhangiani (Capilano University, North Vancouver) and includes the addition of a table of contents and cover page that the original text did not have, changes to Chapter 3 (Research Ethics) to include a contemporary example of an ethical breach and to reflect Canadian ethical guidelines and privacy laws, additional information regarding online data collection in Chapter 9 (Survey Research). Jhangiani has correcte of errors in the text and formulae, as well as changing spelling from US to Canadian conventions. The text is also now available in a inexpensive hard copy which students can purchase online or college bookstores can stock. This makes the text current and updates should be minimal.

The text is very easy to read and also very interesting as the authors supplement content with amazing real life examples.

The text is internally consistent in terms of terminology and framework.

This text is easily and readily divisible into smaller reading sections that can be assigned at different points within a course. I am going to use this text in conjunction with the OER OpenStax Psychology text for my Honors Psychology course. I currently use the OER Openstax Psychology textbook for my Positive Psychology course as well as my General Psychology course,

The topics in the text are presented in logical and clear fashion. The way they are presented allows the text to be used in conjuction with other textbooks as a secondary resource.

The text is free of significant interface issues. It is written in a manner that follows the natural process of doing research.

The text contained no noted grammatical errors.

The text is not culturally insensitive or offensive and actually has been revised to accomodate Canadian ethical guidelines as well as those of the APA.

I have to say that I am excited to have found this revised edition. My students will be so happy that there is also a reasonable priced hard coopy for them to purchase. They love the OpenStax Psychology text with the hard copy available from our bookstore. I do wish there were PowerPoints available for the text as well as a test bank. That is always a bonus!

Reviewed by Alyssa Gibbons, Instructor, Colorado State University on 1/7/16

This text covers everything I would consider essential for a first course in research methods, including some areas that are not consistently found in introductory texts (e.g., qualitative research, criticisms of null hypothesis significance... read more

This text covers everything I would consider essential for a first course in research methods, including some areas that are not consistently found in introductory texts (e.g., qualitative research, criticisms of null hypothesis significance testing). The chapters on ethics (Ch. 3) and theory (Ch. 4) are more comprehensive than most I have seen at this level, but not to the extent of information overload; rather, they anticipate and address many questions that undergraduates often have about these issues.

There is no index or table of contents provided in the PDF, and the table of contents on the website is very broad, but the material is well organized and it would not be hard for an instructor to create such a table. Chapter 2.1 is intended to be an introduction to several key terms and ideas (e.g., variable, correlation) that could serve as a sort of glossary.

I found the text to be highly accurate throughout; terms are defined precisely and correctly.

Where there are controversies or differences of opinion in the field, the author presents both sides of the argument in a respectful and unbiased manner. He explicitly discourages students from dismissing any one approach as inherently flawed, discussing not only the advantages and disadvantages of all methods (including nonexperimental ones) but also ways researchers address the disadvantages.

In several places, the textbook explicitly addresses the history and development of various methods (e.g., qualitative research, null hypothesis significance testing) and the ways in which researchers' views have changed. This allows the author to present current thinking and debate in these areas yet still expose students to older ideas they are likely to encounter as they read the research literature. I think this approach sets students up well to encounter future methodological advances; as a field, we refine our methods over time. I think the author could easily integrate new developments in future editions, or instructors could introduce such developments as supplementary material without creating confusion by contradicting the test.

The examples are generally drawn from classic psychological studies that have held up well over time; I think they will appeal to students for some time to come and not appear dated.

The only area in which I did not feel the content was entirely up to date was in the area of psychological measurement; Chapter 5.2 is based on the traditional view and not the more comprehensive modern or holistic view as presented in the 1999 AERA/APA Standards for Educational and Psychological Measurement. However, a comprehensive treatment of measurement validity is probably not necessary for most undergraduates at this stage, and they will certainly encounter the older framework in the research literature.

The textbook does an excellent job of presenting concepts in simple, accessible language without introducing error by oversimplification. The author consistently anticipates common points of confusion, clarifies terms, and even suggests ways for students to remember key distinctions. Terms are clearly and concretely defined when they are introduced. In contrast to many texts I have used, the terms that are highlighted in the text are actually the terms I would want my students to remember and study; the author refrains from using psychological jargon that is not central to the concepts he is discussing.

I noticed no major inconsistencies or gaps.

The division of sections within each chapter is useful; although I liked the overall organization of the text, there were points at which I would likely assign sections in a slightly different order and I felt I could do this easily without loss of continuity. The one place I would have liked more modularity was in the discussion of inferential statistics: t-tests, ANOVA, and Pearson's r are all covered within Chapter 13.2. On the one hand, this enables students to see the relationships and similarities among these tests, but on the other, this is a lot for students to take in at once.

I found the overall organization of the book to be quite logical, mirroring the sequence of steps a researcher would use to develop a research question, design a study, etc. As discussed above, the modularity of the book makes it easy to reorder sections to suit the structure of a particular class (for example, I might have students read the section on APA writing earlier in the semester as they begin drafting their own research proposals). I like the inclusion of ethics very early on in the text, establishing the importance of this topic for all research design choices.

One organizational feature I particularly appreciated was the consistent integration of conceptual and practical ideas; for example, in the discussion of psychological measurement, reliability and validity are discussed alongside the importance of giving clear instructions and making sure participants cannot be identified by their writing implements. This gives students an accurate and honest picture of the research process - some of the choices we make are driven by scientific ideals and some are driven by practical lessons learned. Students often have questions related to these mundane aspects of conducting research and it is helpful to have them so clearly addressed.

Although I didn't encounter any problems per se with the interface, I do think it could be made more user-friendly. For example, references to figures and tables are highlighted in blue, appearing to be hyperlinks, but they were not. Having such links, as well as a linked, easily-navigable and detailed table of contents, would also be helpful (and useful to students who use assistive technology).

I noticed no grammatical errors.

Where necessary, the author uses inclusive language and there is nothing that seems clearly offensive. The examples generally reflect American psychology research, but the focus is on the methods used and not the participants or cultural context. The text could be more intentionally or proactively inclusive, but it is not insensitive or exclusive.

I am generally hard to please when it comes to textbooks, but I found very little to quibble with in this one. It is a very well-written and accessible introduction to research methods that meets students where they are, addressing their common questions, misconceptions, and concerns. Although it's not flashy, the figures, graphics, and extra resources provided are clear, helpful, and relevant.

Reviewed by Moin Syed, Assistant Professor, University of Minnesota on 6/10/15

The text is thorough in terms of covering introductory concepts that are central to experimental and correlational/association designs. I find the general exclusion of qualitative and mixed methods designs hard to defend (despite some researchers’... read more

The text is thorough in terms of covering introductory concepts that are central to experimental and correlational/association designs. I find the general exclusion of qualitative and mixed methods designs hard to defend (despite some researchers’ distaste for the methods). While these approaches were less commonly used in the recent past, they are prevalent in the early years of psychology and are ascending once again. It strikes me as odd to just ignore two whole families of methods that are used within the practice of psychology—definitely not a sustainable approach.

I do very much appreciate the emphasis on those who will both practice and consume psychology, given the wide variety of undergraduate career paths.

One glaring omission is a Table of Contents within the PDF. It would be nice to make this a linked PDF, so that clicking on the entry in a TOC (or cross-references) would jump the reader to the relevant section.

I did not see an errors. The chapter on theory is not as clear as it could be. The section “what is theory” is not very clear, and these are difficulte concepts (difference between theory, hypothesis, etc.). A bit more time spent here could have been good. Also, the discussion of functional, mechanistic, and typological theories leaves out the fourth of Pepper’s metaphors: contextualism. I’m not sure that was intentional and accidental, but it is noticeable!

This is a research methods text focused on experimental and association designs. The basics of these designs do not change a whole lot over time, so there is little likelihood that the main content will become obsolete anytime soon. Some of the examples used are a bit dated, but then again most of them are considered “classics” in the field, which I think are important to retain (and there is at least one “new classic” included in the ethics section, namely the fraudulent research linking autism to the MMR vaccine).

The text is extremely clear and accessible. In fact, it may even be *too* simple for undergraduate use. Then again, students often struggle with methods, so simplicity is good, and the simplicity can also make the book marketable to high school courses (although I doubt many high schools have methods courses).

Yes, quite consistent throughout. Carrying through the same examples into different chapters is a major strength of the text.

I don’ anticipate any problems here.

The book flows well, with brief sections. I do wonder if maybe the sections are too brief? Perhaps too many check-ins? The “key take-aways” usually come after only a few pages. As mentioned above, the book is written at a very basic level, so this brevity is consistent with that approach. It is not a problem, per se, but those considering adopting the text should be aware of this aspect.

No problems here.

I did not detect any grammatical errors. The text flows very well.

The book is fairly typical of American research methods books in that it only focuses on the U.S. context and draws its examples from “mainstream” psychology (e.g., little inclusion of ethnic minority or cross-cultural psychology). However, the text is certainly not insensitive or offensive in any way.

Nice book, thanks for writing it!

Reviewed by Rajiv Jhangiani, Instructor, Capilano University on 10/9/13

The text is well organized and written, integrates excellent pedagogical features, and covers all of the traditional areas of the topic admirably. The final two chapters provide a good bridge between the research methods course and the follow-up... read more

The text is well organized and written, integrates excellent pedagogical features, and covers all of the traditional areas of the topic admirably. The final two chapters provide a good bridge between the research methods course and the follow-up course on behavioural statistics. The text integrates real psychological measures, harnesses students' existing knowledge from introductory psychology, includes well-chosen examples from real life and research, and even includes a very practical chapter on the use of APA style for writing and referencing. On the other hand, it does not include a table of contents or an index, both of which are highly desirable. The one chapter that requires significant revision is Chapter 3 (Research Ethics), which is based on the US codes of ethics (e.g., Federal policy & APA code) and does not include any mention of the Canadian Tri-Council Policy Statement.

The very few errors I found include the following: 1. The text should read "The fact that his F score…" instead of "The fact that his t score…" on page 364 2. Some formulae are missing the line that separates the numerator from the denominator. See pages 306, 311, 315, and 361 3. Table 12.3 on page 310 lists the variance as 288 when it is 28.8

The text is up-to-date and will not soon lose relevance. The only things I would add are a brief discussion of the contemporary case of Diederik Stapel's research fraud in the chapter on Research Ethics, as well as some research concerning the external validity of web-based studies (e.g., Gosling et al.'s 2004 article in American Psychologist).

Overall, the style of writing makes this text highly accessible. The writing flows well, is well organized, and includes excellent, detailed, and clear examples and explanations for concepts. The examples often build on concepts or theories students would have covered in their introductory psychology course. Some constructive criticism: 1. When discussing z scores on page 311 it might have been helpful to point out that the mean and SD for a set of calculated z scores are 0 and 1 respectively. Good students will come to this realization themselves, but it is not a bad thing to point it out nonetheless. 2. The introduction of the concept of multiple regression might be difficult for some students to grasp. 3. The only place where I felt short of an explanation was in the use of a research example to demonstrate the use of a line graph on page 318. In this case the explanation in question does not pertain to the line graph itself but the result of the study used, which is so fascinating that students will wish for the researchers' explanation for it.

The text is internally consistent.

The text is organized very well into chapters, modules within each chapter, and learning objectives within each module. Each module also includes useful exercises that help consolidate learning.

As mentioned earlier, the style of writing makes this text highly accessible. The writing flows well, is well organized, and includes excellent, detailed, and clear examples and explanations for concepts. The examples often build on concepts or theories students would have covered in their introductory psychology course. Only rarely did I feel that the author could have assisted the student by demonstrating the set-by-step calculation of a statistic (e.g., on page 322 for the calculation of Pearson's r)

The images, graphs, and charts are clear. The only serious issues that hamper navigation are the lack of a table of contents and an index. Many of the graphs will need to be printed in colour (or otherwise modified) for the students to follow the explanations provided in the text.

The text is written rather well and is free from grammatical errors. Of course, spellings are in the US convention.

The text is not culturally insensitive or offensive. Of course, it is not a Canadian edition and so many of the examples (all of which are easy to comprehend) come from a US context.

I have covered most of these issues in my earlier comments. The only things left to mention are that the author should have clearly distinguished between mundane and psychological realism, and that, in my opinion, the threats to internal validity could have been grouped together and might have been closer to an exhaustive list. This review originated in the BC Open Textbook Collection and is licensed under CC BY-ND.

Table of Contents

• Chapter 1: The Science of Psychology
• Chapter 2: Overview of the Scientific Method
• Chapter 3: Research Ethics
• Chapter 4: Psychological Measurement
• Chapter 5: Experimental Research
• Chapter 6: Non-experimental Research
• Chapter 7: Survey Research
• Chapter 8: Quasi-Experimental Research
• Chapter 9: Factorial Designs
• Chapter 10: Single-Subject Research
• Chapter 11: Presenting Your Research
• Chapter 12: Descriptive Statistics
• Chapter 13: Inferential Statistics

Ancillary Material

• Kwantlen Polytechnic University

About the Book

This fourth edition (published in 2019) was co-authored by Rajiv S. Jhangiani (Kwantlen Polytechnic University), Carrie Cuttler (Washington State University), and Dana C. Leighton (Texas A&M University—Texarkana) and is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. Revisions throughout the current edition include changing the chapter and section numbering system to better accommodate adaptions that remove or reorder chapters; continued reversion from the Canadian edition; general grammatical edits; replacement of “he/she” to “they” and “his/her” to “their”; removal or update of dead links; embedded videos that were not embedded; moved key takeaways and exercises from the end of each chapter section to the end of each chapter; a new cover design.

About the Contributors

Dr. Carrie Cuttler received her Ph.D. in Psychology from the University of British Columbia. She has been teaching research methods and statistics for over a decade. She is currently an Assistant Professor in the Department of Psychology at Washington State University, where she primarily studies the acute and chronic effects of cannabis on cognition, mental health, and physical health. Dr. Cuttler was also an OER Research Fellow with the Center for Open Education and she conducts research on open educational resources. She has over 50 publications including the following two published books:  A Student Guide for SPSS (1st and 2nd edition)  and  Research Methods in Psychology: Student Lab Guide.  Finally, she edited another OER entitled  Essentials of Abnormal Psychology. In her spare time, she likes to travel, hike, bike, run, and watch movies with her husband and son. You can find her online at @carriecuttler or carriecuttler.com.

Dr. Rajiv Jhangiani is the Associate Vice Provost, Open Education at Kwantlen Polytechnic University in British Columbia. He is an internationally known advocate for open education whose research and practice focuses on open educational resources, student-centered pedagogies, and the scholarship of teaching and learning. Rajiv is a co-founder of the Open Pedagogy Notebook, an Ambassador for the Center for Open Science, and serves on the BC Open Education Advisory Committee. He formerly served as an Open Education Advisor and Senior Open Education Research & Advocacy Fellow with BCcampus, an OER Research Fellow with the Open Education Group, a Faculty Workshop Facilitator with the Open Textbook Network, and a Faculty Fellow with the BC Open Textbook Project. A co-author of three open textbooks in Psychology, his most recent book is  Open: The Philosophy and Practices that are Revolutionizing Education and Science (2017). You can find him online at @thatpsychprof or thatpsychprof.com.

Dr. Dana C. Leighton is Assistant Professor of Psychology in the College of Arts, Science, and Education at Texas A&M University—Texarkana. He earned his Ph.D. from the University of Arkansas, and has 15 years experience teaching across the psychology curriculum at community colleges, liberal arts colleges, and research universities. Dr. Leighton’s social psychology research lab studies intergroup relations, and routinely includes undergraduate students as researchers. He is also Chair of the university’s Institutional Review Board. Recently he has been researching and writing about the use of open science research practices by undergraduate researchers to increase diversity, justice, and sustainability in psychological science. He has published on his teaching methods in eBooks from the Society for the Teaching of Psychology, presented his methods at regional and national conferences, and received grants to develop new teaching methods. His teaching interests are in undergraduate research, writing skills, and online student engagement. For more about Dr. Leighton see http://www.danaleighton.net and http://danaleighton.edublogs.org

Contribute to this Page

The newest release in the APA Handbooks in Psychology ® series

750 First Street NE Washington, DC 20002 www.apa.org | [email protected]

Terms of Use | Privacy Statement ©2023 American Psychological Association. All Rights Reserved.

APA Handbook of Research Methods in Psychology

Please select the collection(s) you would like to receive more information on.

A one-time purchase of any collection provides perpetual access to DRM-free titles to best meet the needs of your institution and users.

Table of Contents

Volume 1 — Foundations, Planning, Measures, and Psychometrics

Part I. Philosophical, Ethical, and Societal Underpinnings of Psychological Research (Chapters 1 – 6) Part II. Planning Research (Chapters 7 – 12) Part III. Measurement Methods (Chapters 13 – 32) Part IV. Psychometrics (Chapters 33 – 38)

Volume 2 — Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological

Part I. Qualitative Research Methods (Chapters 1 – 11) Part II. Working Across Epistemologies, Methodologies, and Methods (Chapters 12 – 15) Part III. Sampling Across People and Time (Chapters 16 – 19) Part IV. Building and Testing Methods (Chapters 20 – 26) Part V. Designs Involving Experimental Manipulations (Chapters 27 – 32) Part VI. Quantitative Research Designs Involving Single Participants or Units (Chapters 33 – 34) Part VII. Designs in Neuropsychology and Biological Psychology (Chapters 35 – 38)

Volume 3 — Data Analysis and Research Publication

Part I. Quantitative Data Analysis (Chapters 1 – 24) Part II. Publishing and the Publication Process (Chapters 25 – 27)

This resource serves as an ideal reference for many different courses, including:

Please complete the form and an APA representative will follow up with access options.

By submitting your information, you agree to receive information about American Psychological Association (APA) products and services. You may unsubscribe at any time. Please review the APA Privacy Policy for more information.

With significant new and updated content across dozens of chapters, the second edition of the APA Handbook of Research Methods in Psychology presents the most exhaustive treatment available of the techniques psychologists and others have developed to help them pursue a shared understanding of why humans think, feel, and behave the way they do. Across three volumes, the chapters in this indispensable handbook address broad, crosscutting issues faced by researchers: the philosophical, ethical, and societal underpinnings of psychological research. Newly written chapters cover topics such as:

• Literature searching
• Workflow and reproducibility
• Research funding
• Neuroimaging
• Data analysis methods
• Navigating the publishing process
• Ethics in scholarly authorship
• Research data management and sharing
• Applied Psychology 
• Clinical Psychology
• Cognitive Psychology
• Developmental Psychology
• Education Psychology
• Human Development
• Neuroscience
• Public health

Harris Cooper, 

Duke University

Marc N. Coutanche, 

University of Pittsburgh

Linda M. McMullen, 

University of Saskatchewan (Canada) A.T. Panter, 

University of North Carolina 

at Chapel Hill ISBN: 978-1-4338-4123-1

• Bipolar Disorder
• Therapy Center
• When To See a Therapist
• Types of Therapy
• Best Online Therapy
• Best Couples Therapy
• Best Family Therapy
• Managing Stress
• Sleep and Dreaming
• Understanding Emotions
• Self-Improvement
• Healthy Relationships
• Student Resources
• Personality Types
• Guided Meditations
• Verywell Mind Insights
• 2023 Verywell Mind 25
• Mental Health in the Classroom
• Editorial Process
• Meet Our Review Board
• Crisis Support

Understanding Methods for Research in Psychology

A Psychology Research Methods Study Guide

Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

Emily is a board-certified science editor who has worked with top digital publishing brands like Voices for Biodiversity, Study.com, GoodTherapy, Vox, and Verywell.

Types of Research in Psychology

• Cross-Sectional vs. Longitudinal Research
• Reliability and Validity

Glossary of Terms

Research in psychology focuses on a variety of topics , ranging from the development of infants to the behavior of social groups. Psychologists use the scientific method to investigate questions both systematically and empirically.

Research in psychology is important because it provides us with valuable information that helps to improve human lives. By learning more about the brain, cognition, behavior, and mental health conditions, researchers are able to solve real-world problems that affect our day-to-day lives.

At a Glance

Knowing more about how research in psychology is conducted can give you a better understanding of what those findings might mean to you. Psychology experiments can range from simple to complex, but there are some basic terms and concepts that all psychology students should understand.

Start your studies by learning more about the different types of research, the basics of experimental design, and the relationships between variables.

Research in Psychology: The Basics

The first step in your review should include a basic introduction to psychology research methods . Psychology research can have a variety of goals. What researchers learn can be used to describe, explain, predict, or change human behavior.

Psychologists use the scientific method to conduct studies and research in psychology. The basic process of conducting psychology research involves asking a question, designing a study, collecting data, analyzing results, reaching conclusions, and sharing the findings.

The Scientific Method in Psychology Research

The steps of the scientific method in psychology research are:

• Make an observation
• Ask a research question and make predictions about what you expect to find
• Test your hypothesis and gather data
• Examine the results and form conclusions
• Report your findings

Research in psychology can take several different forms. It can describe a phenomenon, explore the causes of a phenomenon, or look at relationships between one or more variables. Three of the main types of psychological research focus on:

Descriptive Studies

This type of research can tell us more about what is happening in a specific population. It relies on techniques such as observation, surveys, and case studies.

Correlational Studies

Correlational research is frequently used in psychology to look for relationships between variables. While research look at how variables are related, they do not manipulate any of the variables.

While correlational studies can suggest a relationship between two variables, finding a correlation does not prove that one variable causes a change in another. In other words, correlation does not equal causation.

Experimental Research Methods

Experiments are a research method that can look at whether changes in one variable cause changes in another. The simple experiment is one of the most basic methods of determining if there is a cause-and-effect relationship between two variables.

A simple experiment utilizes a control group of participants who receive no treatment and an experimental group of participants who receive the treatment.

Experimenters then compare the results of the two groups to determine if the treatment had an effect.

Cross-Sectional vs. Longitudinal Research in Psychology

Research in psychology can also involve collecting data at a single point in time, or gathering information at several points over a period of time.

Cross-Sectional Research

In a cross-sectional study , researchers collect data from participants at a single point in time. These are descriptive type of research and cannot be used to determine cause and effect because researchers do not manipulate the independent variables.

However, cross-sectional research does allow researchers to look at the characteristics of the population and explore relationships between different variables at a single point in time.

Longitudinal Research

A longitudinal study is a type of research in psychology that involves looking at the same group of participants over a period of time. Researchers start by collecting initial data that serves as a baseline, and then collect follow-up data at certain intervals. These studies can last days, months, or years. 

The longest longitudinal study in psychology was started in 1921 and the study is planned to continue until the last participant dies or withdraws. As of 2003, more than 200 of the partipants were still alive.

The Reliability and Validity of Research in Psychology

Reliability and validity are two concepts that are also critical in psychology research. In order to trust the results, we need to know if the findings are consistent (reliability) and that we are actually measuring what we think we are measuring (validity).

Reliability

Reliability is a vital component of a valid psychological test. What is reliability? How do we measure it? Simply put, reliability refers to the consistency of a measure. A test is considered reliable if we get the same result repeatedly.

When determining the merits of a psychological test, validity is one of the most important factors to consider. What exactly is validity? One of the greatest concerns when creating a psychological test is whether or not it actually measures what we think it is measuring.

For example, a test might be designed to measure a stable personality trait but instead measures transitory emotions generated by situational or environmental conditions. A valid test ensures that the results accurately reflect the dimension undergoing assessment.

Review some of the key terms that you should know and understand about psychology research methods. Spend some time studying these terms and definitions before your exam. Some key terms that you should know include:

• Correlation
• Demand characteristic
• Dependent variable
• Hawthorne effect
• Independent variable
• Naturalistic observation
• Placebo effect
• Random assignment
• Replication
• Selective attrition

Erol A.  How to conduct scientific research ?  Noro Psikiyatr Ars . 2017;54(2):97-98. doi:10.5152/npa.2017.0120102

Aggarwal R, Ranganathan P. Study designs: Part 2 - Descriptive studies .  Perspect Clin Res . 2019;10(1):34-36. doi:10.4103/picr.PICR_154_18

Curtis EA, Comiskey C, Dempsey O. Importance and use of correlational research .  Nurse Res . 2016;23(6):20-25. doi:10.7748/nr.2016.e1382

Wang X, Cheng Z. Cross-sectional studies: Strengths, weaknesses, and recommendations .  Chest . 2020;158(1S):S65-S71. doi:10.1016/j.chest.2020.03.012

Caruana EJ, Roman M, Hernández-Sánchez J, Solli P. Longitudinal studies .  J Thorac Dis . 2015;7(11):E537-E540. doi:10.3978/j.issn.2072-1439.2015.10.63

Stanford Magazine. The vexing legacy of Lewis Terman .

By Kendra Cherry, MSEd Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

Psychological Research Methods: Types and Tips

Categories Research Methods

Sharing is caring!

Psychological research methods are the techniques used by scientists and researchers to study human behavior and mental processes. These methods are used to gather empirical evidence.

The goal of psychological research methods is to obtain objective and verifiable data collected through scientific experimentation and observation. 

The research methods that are used in psychology are crucial for understanding how and why people behave the way they do, as well as for developing and testing theories about human behavior.

Table of Contents

Reasons to Learn More About Psychological Research Methods

One of the key goals of psychological research is to make sure that the data collected is reliable and valid.

• Reliability means that the data is consistent and can be replicated
• Validity refers to the accuracy of the data collected

Researchers must take great care to ensure that their research methods are reliable and valid, as this is essential for drawing accurate conclusions and making valid claims about human behavior.

High school and college students who are interested in psychology can benefit greatly from learning about research methods. Understanding how psychologists study human behavior and mental processes can help students develop critical thinking skills and a deeper appreciation for the complexity of human behavior.

Having an understanding of these research methods can prepare students for future coursework in psychology, as well as for potential careers in the field.

Quantitative vs. Qualitative Psychological Research Methods

Psychological research methods can be broadly divided into two main types: quantitative and qualitative. These two methods differ in their approach to data collection and analysis.

Quantitative Research Methods

Quantitative research methods involve collecting numerical data through controlled experiments, surveys, and other objective measures.

The goal of quantitative research is to identify patterns and relationships in the data that can be analyzed statistically.

Researchers use statistical methods to test hypotheses, identify significant differences between groups, and make predictions about future behavior.

Qualitative Research Methods

Qualitative research methods, on the other hand, involve collecting non-numerical data through open-ended interviews, observations, and other subjective measures.

Qualitative research aims to understand the subjective experiences and perspectives of individuals and groups.

Researchers use methods such as content analysis and thematic analysis to identify themes and patterns in the data and to develop rich descriptions of the phenomenon under study.

How Quantitative and Qualitative Methods Are Used

While quantitative and qualitative research methods differ in their approach to data collection and analysis, they are often used together to gain a more complete understanding of complex phenomena.

For example, a researcher studying the impact of social media on mental health might use a quantitative survey to gather numerical data on social media use and a qualitative interview to gain insight into participants’ subjective experiences with social media.

Types of Psychological Research Methods

There are several types of research methods used in psychology, including experiments, surveys, case studies, and observational studies. Each method has its strengths and weaknesses, and researchers must choose the most appropriate method based on their research question and the data they hope to collect.

Case Studies

A case study is a research method used in psychology to investigate an individual, group, or event in great detail. In a case study, the researcher gathers information from a variety of sources, including:

• Observation
• Document analysis

These methods allow researchers to gain an in-depth understanding of the case being studied.

Case studies are particularly useful when the phenomenon under investigation is rare or complex, and when it is difficult to replicate in a laboratory setting.

Surveys are a commonly used research method in psychology that involve gathering data from a large number of people about their thoughts, feelings, behaviors, and attitudes.

Surveys can be conducted in a variety of ways, including:

• In-person interviews
• Online questionnaires
• Paper-and-pencil surveys

Surveys are particularly useful when researchers want to study attitudes or behaviors that are difficult to observe directly or when they want to generalize their findings to a larger population.

Experimental Psychological Research Methods

Experimental studies are a research method commonly used in psychology to investigate cause-and-effect relationships between variables. In an experimental study, the researcher manipulates one or more variables to see how they affect another variable, while controlling for other factors that may influence the outcome.

Experimental studies are considered the gold standard for establishing cause-and-effect relationships, as they allow researchers to control for potential confounding variables and to manipulate variables in a systematic way.

Correlational Psychological Research Methods

Correlational research is a research method used in psychology to investigate the relationship between two or more variables without manipulating them. The goal of correlational research is to determine the extent to which changes in one variable are associated with changes in another variable.

In other words, correlational research aims to establish the direction and strength of the relationship between two or more variables.

Naturalistic Observation

Naturalistic observation is a research method used in psychology to study behavior in natural settings, without any interference or manipulation from the researcher.

The goal of naturalistic observation is to gain insight into how people or animals behave in their natural environment without the influence of laboratory conditions.

Meta-Analysis

A meta-analysis is a research method commonly used in psychology to combine and analyze the results of multiple studies on a particular topic.

The goal of a meta-analysis is to provide a comprehensive and quantitative summary of the existing research on a topic, in order to identify patterns and relationships that may not be apparent in individual studies.

Tips for Using Psychological Research Methods

Here are some tips for high school and college students who are interested in using psychological research methods:

Understand the different types of research methods: 

Before conducting any research, it is important to understand the different types of research methods that are available, such as surveys, case studies, experiments, and naturalistic observation.

Each method has its strengths and limitations, and selecting the appropriate method depends on the research question and variables being investigated.

Develop a clear research question: 

A good research question is essential for guiding the research process. It should be specific, clear, and relevant to the field of psychology. It is also important to consider ethical considerations when developing a research question.

Use proper sampling techniques: 

Sampling is the process of selecting participants for a study. It is important to use proper sampling techniques to ensure that the sample is representative of the population being studied.

Random sampling is considered the gold standard for sampling, but other techniques, such as convenience sampling, may also be used depending on the research question.

Use reliable and valid measures:

It is important to use reliable and valid measures to ensure the data collected is accurate and meaningful. This may involve using established measures or developing new measures and testing their reliability and validity.

Consider ethical issues:

It is important to consider ethical considerations when conducting psychological research, such as obtaining informed consent from participants, maintaining confidentiality, and minimizing any potential harm to participants.

In many cases, you will need to submit your study proposal to your school’s institutional review board for approval.

Analyze and interpret the data appropriately : 

After collecting the data, it is important to analyze and interpret the data appropriately. This may involve using statistical techniques to identify patterns and relationships between variables, and using appropriate software tools for analysis.

Communicate findings clearly: 

Finally, it is important to communicate the findings clearly in a way that is understandable to others. This may involve writing a research report, giving a presentation, or publishing a paper in a scholarly journal.

Clear communication is essential for advancing the field of psychology and informing future research.

Frequently Asked Questions

What are the 5 methods of psychological research.

The five main methods of psychological research are:

• Experimental research : This method involves manipulating one or more independent variables to observe their effect on one or more dependent variables while controlling for other variables. The goal is to establish cause-and-effect relationships between variables.
• Correlational research : This method involves examining the relationship between two or more variables, without manipulating them. The goal is to determine whether there is a relationship between the variables and the strength and direction of that relationship.
• Survey research : This method involves gathering information from a sample of participants using questionnaires or interviews. The goal is to collect data on attitudes, opinions, behaviors, or other variables of interest.
• Case study research : This method involves an in-depth analysis of a single individual, group, or event. The goal is to gain insight into specific behaviors, attitudes, or phenomena.
• Naturalistic observation research : This method involves observing and recording behavior in natural settings without any manipulation or interference from the researcher. The goal is to gain insight into how people or animals behave in their natural environment.

What is the most commonly used psychological research method?

The most common research method used in psychology varies depending on the research question and the variables being investigated. However, correlational research is one of the most frequently used methods in psychology.

This is likely because correlational research is useful in studying a wide range of psychological phenomena, and it can be used to examine the relationships between variables that cannot be manipulated or controlled, such as age, gender, and personality traits. 

Experimental research is also a widely used method in psychology, particularly in the areas of cognitive psychology , social psychology , and developmental psychology .

Other methods, such as survey research, case study research, and naturalistic observation, are also commonly used in psychology research, depending on the research question and the variables being studied.

How do you know which research method to use?

Deciding which type of research method to use depends on the research question, the variables being studied, and the practical considerations involved. Here are some general guidelines to help students decide which research method to use:

• Identify the research question : The first step is to clearly define the research question. What are you trying to study? What is the hypothesis you want to test? Answering these questions will help you determine which research method is best suited for your study.
• Choose your variables : Identify the independent and dependent variables involved in your research question. This will help you determine whether an experimental or correlational research method is most appropriate.
• Consider your resources : Think about the time, resources, and ethical considerations involved in conducting the research. For example, if you are working on a tight budget, a survey or correlational research method may be more feasible than an experimental study.
• Review existing literature : Conducting a literature review of previous studies on the topic can help you identify the most appropriate research method. This can also help you identify gaps in the literature that your study can fill.
• Consult with a mentor or advisor : If you are still unsure which research method to use, consult with a mentor or advisor who has experience in conducting research in your area of interest. They can provide guidance and help you make an informed decision.

Scholtz SE, de Klerk W, de Beer LT. The use of research methods in psychological research: A systematised review . Front Res Metr Anal . 2020;5:1. doi:10.3389/frma.2020.00001

Palinkas LA. Qualitative and mixed methods in mental health services and implementation research . J Clin Child Adolesc Psychol . 2014;43(6):851-861. doi:10.1080/15374416.2014.910791

Crowe S, Cresswell K, Robertson A, Huby G, Avery A, Sheikh A. The case study approach . BMC Med Res Methodol . 2011;11(1):100. doi:10.1186/1471-2288-11-100

• AQA Model Answers Info
• Purchase AQA Model Answers
• Private Tuition
• Info + Contact

AQA A-LEVEL PSYCHOLOGY REVISION NOTES: RESEARCH METHODS

Sign up to the PsychLogic newsletter at the bottom of this page to download printable AQA A-level Psychology notes + AQA A-level Psychology revision guide + how to revise for A-level Psychology + more... The best way to revise Psychology A-level...

PSYCHOLOGY AQA  A-LEVEL UNIT 2 (7182)

The syllabus.

METHODS, TECHNIQUES & DESIGN

• Primary and secondary data, and meta-analysis. Quantitative and qualitative data
• Aims, operationalising variables, IV’s and DV’s
• Hypotheses - directional and non-directional
• Experimental design - independent groups, repeated measures, matched pairs
• Validity – internal and external; extraneous and confounding variables; types of validity and improving validity
• Control – random allocation, randomisation, standardisation
• Demand characteristics and investigator effects
• Reliability; types of reliability and improving reliability
• Pilot studies
• Correlation analysis – covariables and hypotheses, positive/negative correlations
• Observational techniques – use of behavioural categories
• Self-report techniques – design of questionnaires and interviews
• Case studies
• Content analysis
• Thematic Analysis

PARTICIPANTS; ETHICS; FEATURES OF SCIENCE & SCIENTIFIC METHOD; THE ECONOMY

• Selecting participants and sampling techniques
• The British Psychological Society (BPS) code of ethics and ways of dealing with ethical issues
• Forms and instructions
• Peer review
• Features of science: objectivity, empirical method, replicability and falsifiability
• Paradigms and paradigm shifts
• Reporting psychological investigations
• The implications of psychological research for the economy

DESCRIPTIVE STATISTICS

• Analysis and interpretation of quantitative data. Measures of central tendency - median, mean, mode. Calculating %’s. Measures of dispersion – range and standard deviation (SD)
• Presentation and interpretation of quantitative data – graphs, histograms, bar charts, scattergrams and tables
• Analysis and interpretation of correlational data; positive and negative correlations and the interpretation of correlation coefficients
• Distributions: normal and skewed

INFERENTIAL STATISTICS

• Factors affecting choice of statistics test: Spearman’s rho, Pearson’s r, Wilcoxon, Mann-Whitney, related t-test, unrelated t-test, Chi-Squared test
• Levels of measurement – nominal, ordinal, interval
• Procedures for statistics tests
• Probability and significance: use of statistical tables and critical values in interpretation of significance; Type I and Type II errors
• Introduction to statistical testing: the sign test

INTRODUCTION

Research Methods is concerned with how psychologists conduct research in an attempt to find evidence for theories . A theory without research support is really just someone’s reasoned opinion, not a proven fact .

Psychologists generally adopt a scientific approach to studying the mind and behaviour. The scientific method is based on empiricism – the belief that one can gain true knowledge of the world through the unbiased observation and measurement of observable, physical phenomena .

Laboratory experimentation is the method most associated with science as it involves the careful manipulation of variables to establish whether there are cause-effect relationships with other variables: for example, will an increase in testosterone cause an increase in aggression?

Psychologists face difficulties, however, in that they are studying highly complex, reactive creatures (humans) who tend not to behave in the predictable way that the objects of study of physics, chemistry and biology do. Equally, people put in an artificial laboratory situation who are aware they are being observed will tend not to behave in a normal, natural way. For this (and various other) reasons, psychologists have developed a variety of other means of research such as field and natural experiments , correlation studies and observations .

A debate exists within Psychology as to what extent it is desirable and/or appropriate to apply scientific methods to the study of humans. Many psychologists have argued that a strictly scientific approach reduces the complexity of human behaviour to an overly reductionist level and that human psychology can be better understood by more detailed and in depth methods such as questionnaires , interviews , case studies and content analysis .

Whereas biological approaches , behaviourism and cognitive psychology tend to favour quantitative , scientific , laboratory based approaches, psychodynamic and humanistic approaches argue for a more qualitative , descriptive approach.

The syllabus focuses on scientific approaches and how to design studies which produce valid (accurate/truthful) findings. There is also an emphasis on the statistical analysis of quantitative data .

>>>>>>>

METHODS, TECHNIQUES & DESIGN ( A-level Psychology revision notes)

PRIMARY AND SECONDARY DATA, AND META-ANALYSIS. QUANTITATIVE AND QUALITATIVE DATA

Psychologists conduct research in an attempt to find evidence for theories . Throughout the history of Psychology there has been an on-going debate in regard to what methods of investigation are appropriate to study the mind and behaviour. Whilst some favour a highly scientific, lab-based, experimental approach , others argue that these methods are inappropriate to the study of humans and support more in depth, less scientific, qualitative approaches such as interviews, case studies and observations.

• Laboratory Experiments
• Field Experiments
• Natural & Quasi Experiments
• Correlation Studies
• Observational techniques
• Self-report Questionnaires
• Self-report Interviews
• Case Studies
• Content Analysis

Each of these methodologies uses different research techniques and has associated strengths and limitations .

Data (information produced from a research study) may be

• Quantitative : numerical data that can be statistically analysed . This has the advantage of being more objective , quicker to gather and analyse, and can be presented in ways that are easily and quickly understandable. However, data can be superficial , and lacking depth and detail of participants’ subjective
• Qualitative: written , richly detailed, descriptive accounts of what is being studied. This allows participants to express themselves freely. However, these methods are time consuming , can be costly to collect, difficult to analyse and suffer from problems of subjectivity .

Data gathered by psychologists can be

• Primary – directly collected by the psychologist them self: e.g. questionnaires, interviews, observations, experiments.
• Secondary – data collected by others: e.g. official statistics, the work of other psychologists, media products such as film or documentary.
• Meta-analysis refers to when a psychologist draws together the findings and conclusions of many research studies into 1 single overall conclusion.

LABORATORY EXPERIMENTS ( AQA A-level Psychology revision notes)

Lab experiments are the most complex methodology in terms of their logic and design.

Any experiment begins with an aim .

The aim is a loose, general statement of what we intend to investigate: e.g. does alcohol affect driving performance?

Any experiment looks at the cause-effect relationship between 2 variables . A variable is any factor/thing that can be measured and changes. For example, intelligence, aggression, score on authoritarian personality scale, short-term memory capacity, etc. The two variables in the above example are alcohol and driving performance.

OPERATIONALISING VARIABLES

In psychological research we often want to find a way of expressing a variable numerically. This is referred to as operationalising a variable . Variables can be operationalised in many ways – for example,

• Intelligence can be operationalised through an IQ test
• Authoritarianism can be operationalised through a questionnaire
• STM capacity can be operationalised through a task such as seeing how many digits a participant can remember at once.

INDEPENDENT & DEPENDENT VARIABLES

Of the 2 variables we are testing in an experiment, one is referred to as the Independent Variable (IV) and the other is referred to as the Dependent Variable (DV) .

In an experiment we test 2 conditions of the IV against the DV to see if there is a significant difference between how the 2 conditions of the IV affect the DV .

For example, we could set up an experiment to examine the cause-effect relationship between alcohol and driving performance . To do this we could recruit 100 volunteer participants , randomly split them into 2 groups of 50 , give the 1 st group a measure of alcohol and then let them drive on a driving simulator which would produce a score of x/20 for driving performance. The 2 nd group would be given no alcohol and allowed to drive on the simulator. Therefore, we would end up with 50 scores of x/20 for those who had driven after consuming alcohol, and 50 scores of x/20 for those who had driven and not consumed alcohol.

We could take the mean average score for each group and compare them. For example, we may find that those who had drunk alcohol scored a mean average of 10/20 whereas those who hadn’t consumed alcohol scored an average of 16/20. What we have done in this experiment is to test 2 conditions of the IV (alcohol and no alcohol) against the DV (driving performance) to see if there is a significant difference between how the 2 conditions of the IV affect the DV . If we find a significant difference between how the 2 conditions of the IV affect the DV we have found evidence that there is a cause-effect relationship between alcohol consumption and poor driving performance .  

From the aim of our experiment we formulate our hypotheses.

A hypothesis is an exact, precise, testable prediction of what we expect to find in an experiment.

• The Experimental/Alternative Hypothesis : a statement predicting that we will find a difference between how the 2 conditions of the IV affect the DV: e.g. ‘There will be a significant difference in driving performance between participants who have and have not consumed alcohol’ .

The above hypotheses are non-directional (or 2-tailed) hypotheses. This means that they do not make a prediction about the direction of results : i.e. they don’t predict that 1 of the groups is going to do better or worse than the other, they just predict that some kind of difference will occur.

However, if the experimenter strongly expects that results will go in a certain direction or previous research indicates this he may choose to apply a directional (or 1-tailed) hypothesis. This does make a prediction about the direction of results.

• Experimental Hypothesis (1-tailed): ‘Participants who have consumed alcohol will show significantly poorer driving performance than participants who have not consumed alcohol’.

EXPERIMENTAL DESIGN

In any experiment we always have at least 2 groups of participants performing in at least 2 experimental conditions . There are several different ways in which we can allocate (put) participants to different conditions each with associated strengths and limitations .

1. Independent Groups Design . Participants are split into 2 groups , each group performing in 1 condition only .

The limitations of this design are

• Participant Variables – the fact that individual differences between participants may affect the DV without us being aware of it and thus reduce the validity (accuracy) of our results. For example, we may find that participants in the alcohol condition are all excellent drivers with high alcohol tolerance, whilst participants in the no-alcohol condition are all poor drivers. Thus, the alcohol group may drive better and we might (falsely) conclude that alcohol improves driving performance. The problem of participant variables is reduced with a large sample and by randomly allocating participants to the 2 conditions.
• It requires more participants than a repeated measures design .

The advantage of this design is that we will not encounter Order Effects (see below).

2. Repeated Measures Design . In this design all participants perform in the 1 st condition and then perform in the 2 nd condition . This allows us to directly compare participants’ performance across the 2 conditions.

• Order Effects – when participants perform in condition 1 then condition 2 their performance in the 2 nd condition may either improve due to practise or get worse due to boredom or tiredness . In an attempt to overcome the problem of order effects we can use counterbalancing . This involves ½ the participants performing in condition 1 first, then condition 2, while the other ½ of the participants perform in condition 2 first, then condition 1. (This is thought to balance out the problem of order effects).
• They may also work out the aim of the study and exhibit demand characteristics (see below).

The advantage of this design is that there is no possibility of participant variables threatening the validity of the study.

3. Matched Pairs Design : This design overcomes the problem of order effects and participant variables . Before the study begins we need to find participants who we can match with each other in terms of relevant characteristics such as age, gender, IQ, etc. The study then runs as an independent groups design , however, because each participant is matched with another participant in the other condition participant variables are less of a problem. The disadvantage of this design is it may be costly, time-consuming and difficult to find participants who match precisely .

It is highly important that experiments are well designed and run - otherwise findings may be inaccurate and lead us to draw false conclusions.

Validity generally refers to the truthfulness and accuracy of our findings.

We can distinguish between 2 types of validity.

• INTERNAL/EXPERIMENTAL VALIDITY . This relates to whether we are really measuring what we think we are measuring. In any experiment we are trying to isolate the effect of the IV on the DV . Therefore, we need to ensure that no other unwanted, uncontrolled extraneous variables are affecting the DV without our knowledge. If an extraneous variable does affect our final results, we refer to as a confounding (i.e. confusing) variable.

• Ecological Validity . This relates to the problem of whether studies conducted under highly controlled, artificial, lab situations can produce findings that can be generalised to everyday life, or whether behaviour shown by participants will be artificial . For example, in the drink-driving study, participants use a driving simulator which is not really similar to driving in a real car on a real road.
• Population Validity . If we only use small or biased/unrepresentative samples of participants, we may not be able to generalise findings to human behaviour in general.
• Temporal Validity . If studies were conducted a long time ago, it can be argued that their findings are not relevant to the present day. For example, Asch’s conformity study was conducted in 1950’s America and it has been argued that the climate of America at this time was particularly conformist. Social change since the 50’s has meant that people are now far more non-conformist and independent.

CONTROL OF EXTRANEOUS VARIABLES; RANDOM ALLOCATION, STANDARDISATION

Extraneous variables are variables which the experimenter has failed to eliminate or control which are affecting the DV without us being aware of it. This threatens the validity of the study and the accuracy of our findings.

Extraneous variables must be carefully and systematically controlled . When designing an experiment, researchers should consider the following areas where extraneous variables may arise:

• Random allocation/randomisation of participants to experimental conditions. To avoid any bias on the behalf of the researcher, participants should always be divided into groups randomly.
• Standardisation of instructions and procedures. Participants should be given exactly the same instructions as each other and go through exactly the same procedures as each other to avoid differences in these acting as extraneous variables.
• Participant variables : participants’ age, intelligence, personality and so on should be controlled across the different groups taking part. For example, in the above experiment: gender, driving experience, alcohol tolerance, body mass, etc. Participants could also be pre-tested and put into a matched-pairs design.
• Situational variables : the experimental setting and surrounding environment must be controlled. This may include the time of day, the temperature or noise effects.
• Order effects : participants may improve or get bored performing in different conditions. This can be controlled by using independent groups, matched participants or counter-balancing.
• Demand Characteristics or Investigator Effects (see below).
• A control group is a group of participants from who act as a baseline from which differences in the experimental group are measured. For example, we might compare improvements in mood scores for an experimental group who received therapy against a control group who none.

TYPES OF VALIDITY AND IMPROVING VALIDITY

It is highly important that experiments are well designed and run - otherwise findings may be inaccurate and lead us to draw false conclusions. If studies are to be regarded as credible, they must be valid .

The following techniques are used to check for/achieve/ensure validity .

• Face validity is the extent to which a test is subjectively viewed as being able to measure the concept it claims to measure. In other words, a test can be said to have face validity if it "looks like" it is going to measure what it is supposed to measure.
• Content Validity involves independent experts being asked to assess the validity/accuracy/appropriateness of instruments/tests used to measure a variable: e.g. agreeing that a particular IQ test is a valid measure of intelligence.
• Concurrent Validity involves comparing the validity of a new test/measure against an established test/measure whose validity is already known and trusted. For example, the results of a new form of IQ test could be tested against an old, established IQ test. If scores correlate between the 2 tests they are said to have concurrent validity.

THE RELATIONSHIP BETWEEN RESEARCHER AND PARTICIPANTS

The fact that an experiment is a social situation means that behaviour may be affected by the presence of others (experimenter and other participants) and the expectations that participants have. Thus, we may not be getting a valid picture of how people behave in the real world.

• Demand Characteristics refers to the fact that participants realise they are in an experiment and are being observed and tested. They may, therefore, alter their behaviour either to behave in ways they think the experimenter wants them to behave in or according to how they think they should behave. Participants may try to work out the aim of experiment and modify their behaviour accordingly. They may also show ‘social desirability bias’ – giving responses they believe are correct or moral, rather than answering honestly.
• Investigator Effects refers to the fact that the experimenter may consciously or unconsciously gives hints or clues to research participants about how he wants or expects them to behave.

RELIABILITY

Reliability of a study refers to the issue of if we conduct the study again will the study produce similar results ? Clearly, if a study produces wildly varying results each time it is carried out there is either no real cause-effect relationship between the IV and the DV or the design of the study is invalid . Therefore, repeating a study confirms previous findings.

TYPES OF RELIABILITY

Inter-rater reliability

• If a number of different observers are conducting the same observational study, we need to ensure the observers have inter-rater reliability . This means that observers are all defining behaviours and recording observations in the same way as each other . Thus, before the study begins observers should be trained through the use of, for example, a training video where they learn and are then tested on how to define and categorise behaviours in the same way as each other. We can assess inter-rater reliability by analysing the correlation between different observers score on the same behaviour. This will produce a correlation coefficient (see Correlation Studies and Spearman’s rho test): e.g. +0.96 = a strong positive correlation (they are rating things in the same way as each other).

Test-retest reliability

• Reliability of a test (e.g. IQ test) or questionnaire can be tested by asking a participant to complete the test/questionnaire, then complete it again 2 weeks and a month later. If answers are similar over a period of time, then the test/questionnaire can be said to have reliability. We can assess test-retest reliability by analysing the correlation between different test scores. This will produce a correlation coefficient (see Correlation Studies): e.g. +0.96 = a strong positive correlation (high similarity between different test scores).

PILOT STUDIES

A pilot study is a small scale version of the main study that is conducted in advance to ensure

• The procedures of the study will run smoothly
• That equipment/tests are functioning accurately
• That participants understand instructions
• That all extraneous variables are controlled

  STRENGTHS OF LABORATORY EXPERIMENTS

• High degree of control : experimenters can control all variables in the experiment. The IV and DV can be precisely defined (operationalised) and measured to assess cause-effect relationships - for example, the amount of caffeine given (IV) and reaction time (DV). This leads to greater accuracy and objectivity.
• Replication : other researchers can easily repeat/replicate the experiment and check results for reliability . This is much easier in a controlled laboratory situation as opposed to a field experiment conducted in the real world.

LIMITATIONS OF LABORATORY EXPERIMENTS

• Lack of ecological validity.
• Demand characteristics.

(Explain both these points in full according to above notes.)

FIELD EXPERIMENTS ( Psychology A-level revision)

A field experiment is carried out in the real world rather than under artificial laboratory conditions. Participants are exposed to ‘set-up’ social situation to see how they respond. The ‘naïve’ participants are unaware they are taking part in an experiment.

STRENGTHS OF FIELD EXPERIMENTS

• As the experiment is conducted in the real world levels of ecological validity are increased meaning that we can generalise behaviour to real-life behaviour.
• As participants do not know they are involved in an experiment they will not show demand characteristics .

LIMITATIONS OF FIELD EXPERIMENTS

• As the study is not conducted under tightly controlled laboratory conditions there is a greater chance that extraneous variables will influence the DV without the researcher being aware of this.
• Field experiments often involve breaking ethical guidelines : e.g. failing to get participants consent, deceiving participants, failing to inform them of their right to withdraw or debriefing them, etc.

NATURAL & QUASI EXPERIMENTS ( A-level Psychology revision)

In a natural experiment the psychologist does not manipulate or ‘set up’ a situation to which participants are exposed to, rather they observe a change in the natural world (IV) and assess whether this has an effect on another variable (the DV) . For example, whether the introduction of TV into remote communities (IV = (i) no TV, and (ii) TV) and measuring whether this has had an effect on children’s’ aggressiveness (DV). A quasi-experiment is the same as a normal experiment but participants are not randomly allocated to conditions .

STRENGTHS OF NATURAL/QUASI EXPERIMENTS

• As the experiment is conducted in the real world levels of ecological validity are increased.
• In natural experiments, as participants do not know they are involved in an experiment they will not show demand characteristics.

LIMITATIONS OF NATURAL/QUASI EXPERIMENTS

• Natural experiments may involve breaking ethical guidelines : e.g. failing to get participants consent to be observed, failing to inform them of their right to withdraw or debriefing them.

CORRELATION ANALYSIS ( AQA A-level Psychology revision)

 A correlation study involves measuring the relationship between 2 covariables : e.g. height and weight, stress and illness, ‘A’ Level point score and income aged 30, etc. (However, correlation studies only measure whether there is  some kind of relationship , not whether there is a cause-effect relationship .)

 The relationship may either be

To conduct a correlation study we need to operationalise the 2 co-variables and their relationship can then be plotted on a scattergram for each participant. The general pattern revealed should indicate whether the relationship is positive or negative and how weak or strong the relationship is. However, we can conduct statistical analysis of our data to produce a correlation coefficient : a number somewhere between -1 and +1 which will indicate the exact direction and strength of relationship between the 2 co-variables.

HYPOTHESES FOR CORRELATION STUDIES

Whereas hypotheses for experiments predict there will be a ‘difference’ between how the 2 conditions of the IV affect the DV, hypotheses for correlation studies predict there will be a ‘relationship’ between 2 co-variables.

Hypotheses can be directional or non-directional depending on whether or not past research indicates whether we should expect to find a relationship (either positive or negative).

• 2-Tailed Experimental Hypothesis : ‘There will be a significant correlation between stress and illness’.
• 1-Tailed Experimental Hypothesis : ‘There will be a significant positive correlation between stress and illness’. (This could also be predicting a negative correlation.)

  STRENGTHS OF CORRELATION STUDIES

• Correlation studies allow us to assess the precise direction and strength of relationship between 2 co-variables using correlation coefficients (see above).
• Correlation studies are a valuable preliminary (initial) research tool . They allow us to identify relationships between variables that we may then decide to investigate in more detail through experimentation.

LIMITATIONS OF CORRELATION STUDIES

• Correlation studies only tell us that there is some kind of relationship between 2 variables, they do not tell us about cause-effect relationships , and thus they are a weaker methodology than lab experiments.
• We may sometimes find a correlation between 2 variables by pure chance , even when no real relationship exists between the variables – thus they may be misleading. For example, there is an almost perfect negative correlation between Nigerian iron exports and the UK birth rate between 1870 and 1920 even though these factors are completely unrelated.

OBSERVATIONAL TECHNIQUES ( AQA A-level Psychology revision guide)

Observations simply involve observing behaviour in the natural environment .

Observations may be

• Overt : the psychologist’s presence is made known to the group being studied. This may lead to demand characteristics and participants behaving in unnatural ways.
• Covert : the psychologist’s presence is hidden . Either he appears as a normal member of the public or is his presence is concealed in some way (e.g. CCTV camera). Although this overcomes the problem of demand characteristics , there are ethical issues to do with deception, lack of consent and invasion of privacy.
• Participant : the psychologist joins the group being studied. This may be covert or overt.
• Non-Participant : the psychologist remains outside the group being studied. This may be covert or overt.

Observational studies can be conducted in real life situations (naturalistic observations) or in laboratories (which provide more control – controlled observations ). Behaviours observed can be recorded in a qualitative form or can be counted/quantified .

For example, we may wish to conduct an observational study of gender differences in aggressive behaviours amongst 5-7-year olds. A tally chart can be constructed to record observations and behavioural classifications/categories .

This chart allows us to make statistical statements about behaviours: e.g. boys punch 4 times more than girls do.

One way of recording behavioural categories is event sampling (as in the example above – recording the number of times a particular event occurs); the other is time sampling – recording what is occurring at certain time intervals: e.g. every minute.

If a number of different observers are conducting the same observational study, we need to ensure the observers have inter-rater reliability (see section of Reliability above).

STRENGTHS OF OBSERVATIONAL STUDIES

• During covert observations there are high levels of ecological validity and no demand characteristics . Participants are unaware that they are being observed and they are in a natural environment – thus we are observing behaviour as it naturally occurs.
• With participant observation the psychologist can question participants and get a much more in depth insight into the behaviours, beliefs and motivations of the group being studied . Thus, a much deeper, richer, descriptive picture of behaviour is produced.

  LIMITATIONS OF OBSERVATIONAL STUDIES

• With covert observations ethical issues arise concerning invasion of privacy, lack of consent, deception and lack of right to withdraw.
• With overt observations participants may exhibit demand characteristics and act in socially-appropriate or otherwise unnatural ways.

SELF-REPORT METHODS: QUESTIONNAIRE SURVEYS & INTERVIEWS ( A-level Psychology resources)

 The term self-report simply means that the participant is reporting on their own perception/view of themselves – either using a questionnaire or an interview .

 For either technique:

• Social desirability bias may be an issue in that if a participant knows their answers will be read/heard by someone else they may say what they think is socially acceptable/desirable rather than the truth. To combat this, questionnaires can be kept anonymous and confidential.
• Self-report studies are also subjective in that the individual’s perception of themselves may be quite different from how others view them.

QUESTIONNAIRES

Questionnaires can be:

• Closed ended .

E.g. I intend to vote for Joe Biden.

Closed ended questions allow us to produce quantitative data: e.g. statistical statements such as 45% of participants agreed.

• Open ended .

Produce lengthier answers – richly descriptive, qualitative data.

E.g. Explain why you intend to vote for Joe Biden.

__________________________________________________

When constructing questionnaires, we must try to ensure that the questions we ask are clear , concise , non-ambiguous , and easily understandable, and will be interpreted by all participants in the same way as each other.

We may also want to check the reliability of the questionnaire through test-retest reliability . Open-ended questionnaires can be thematically analysed (see later section on this).

STRENGTHS OF QUESTIONNAIRES

• Closed-ended questionnaires are capable of providing large amounts of information from large amounts of people fairly cheaply and quickly .
• Closed-ended questions can be statistically analysed to allow us to make statements about %’s of people who hold certain beliefs, etc.
• Open-ended questions allow us to gain an in depth insight into participants’ personal opinions and the motives that underlie behaviours and beliefs .

  LIMITATIONS OF QUESTIONNAIRES

• If socially sensitive questions are asked participants may give socially-appropriate responses. E.g. if a questionnaire asks whether someone holds racist beliefs it is unlikely they will admit to this to a researcher. This can be overcome by making questionnaires anonymous and confidential.
• Open-ended questions can be difficult to interpret and analyse as participants may give lengthy answers. This makes it hard to understand broad patterns and trends in participants’ beliefs and behaviours.

Interviews can be conducted with individuals or groups either face-to-face or telephone/internet. The respondent can describe their response in depth and detail (qualitative data) and say what they want to say rather than filling out pre-set answer choices (e.g. questionnaires). Interviews can be thematically analysed (see   later section on this).

Interview questions can be:

• Structured : a pre-set list of questions is asked.
• Unstructured : the interview progresses as more of an on-going conversation between interviewer and interviewee.

STRENGTHS OF INTERVIEWS

• Interviews provide richly detailed qualitative descriptions of participants’ subjective (personal) understanding of their behaviour, beliefs and motivations .
• With open-ended questions , interviewees may be able to suggest and shed light on further areas of research and interest relating to the topic they are being interviewed about.
• Structured interviews allow all participants to be asked the same questions , making general patterns in answers easier to analyse and keep the interview limited to the subject matter the interviewer wants to cover.

LIMITATIONS OF INTERVIEWS

• If socially sensitive questions are asked participants may give socially-appropriate responses. E.g. if an interviewer asks whether someone holds racist beliefs it is unlikely they will admit to this.
• Open-ended questions can be difficult to interpret and analyse as participants may give lengthy, personal answers. This makes it harder to analyse broad patterns and trends in participants’ beliefs and behaviours.

CASE STUDIES ( AQA A-level Psychology resources)

These are longitudinal studies (conducted over a long period of time) which focus in great detail on an individual or a small group . They are often used in the field of psychopathology and child development, and may include a variety of methods such as unstructured interviews and observations .

STRENGTHS OF CASE STUDIES

• Case studies provide richly detailed descriptions of participants’ subjective (personal) understanding of their behaviour, beliefs and motivations .
• Case Studies usually follow the progress and changes an individual goes through over time.

LIMITATIONS OF CASE STUDIES

• Case studies are associated with problems of subjectivity and personal interpretation on the behalf of the psychologist: e.g. the psychologist may be biased in their viewpoint and interpretation of events and behaviour: for example, with the case study of Little Hans, Freud was accused of interpreting Hans’ behaviour to make it support his theory of the Oedipus Complex. Thus, because case studies do not use controlled scientific methods of experimentation, they are thought to lack scientific objectivity and proof.
• For the above reason, and for the fact they are only carried out on one individual, case studies suffer a lack of reliability and generalisability .

CONTENT ANALYSIS ( A-level Psychology notes)

This is a technique where researchers identify themes or behavioural categories and count how many times they occur (see   later section on thematic analysis) . It is often used with written or visual material such as interviews, open-ended questionnaires, diaries, magazines, films, etc.  A coding system of categories will be developed whereby we count certain times a particular piece of content arises.

For example, we might ask mothers with children who have just started primary school to keep a diary of their child’s response to this and then count how many times categories such as ‘child crying’, ‘child showing clingy behaviour’, ‘child showing anger to mother’ occur.

STRENGTHS OF CONTENT ANALYSIS

• It allows qualitative data (writing or visual material) to be put into a quantitative form (counting behaviours) , so that statistical analysis can take place and data can be represented in tables and graphs.

LIMITATIONS OF CONTENT ANALYSIS

• Constructing a coding system involves the risk of an investigator imposing their own meaning on the data. The investigator might choose coding categories they think are important and overlook categories which actually are important. Thus, there may be problems of subjectivity and personal bias .

THEMATIC ANALYSIS ( AQA A-level Psychology notes)

  Interviews, open-ended questionnaires and content analysis (all qualitative research techniques) can be analysed in terms of themes which occur in the content of responses given by participants.  We can count these themes to produce quantitative data . For example, if we interviewed adults who had experienced maternal deprivation as an infant we could analyse what major themes occurred in interviews (e.g. feelings of loss, desire for love, etc.) and count how many times these themes occurred.

STRENGTHS OF THEMATIC ANALYSIS

• We can turn complex qualitative data into quantitative data which can then be statistically analysed. For example, 65% of participants referred to feelings of loss in their interviews.

LIMITATIONS OF THEMATIC ANALYSIS

• If a number of researchers are conducting thematic analysis on the same data they may interpret and count themes in a different way to each other which would lead to a lack of reliability. (This could be overcome through testing for inter-rater reliability.)

PARTICIPANTS & SAMPLING ( A-level Psychology revision notes)

It is important to select participants carefully when conducting research to ensure the study has population validity (see section on Validity above).

The term population refers to all the people within a certain category whom we wish to study: e.g. all schizophrenics, all 5-11 year olds, all pregnant women, etc. From this population we draw a smaller sample . Ideally, we want our sample to be fairly large and to be representative of the population as a whole (i.e. a good cross-section in terms of age, gender, ethnicity, etc.)

With a large , representative, random sample of participants we should be able to generalise (apply) our findings to the population as a whole (i.e. say that what is true of our sample is true of the population as a whole).

There a number of different sampling methods we can employ to select participants each with its own advantages and disadvantages.

• Random sampling . The sample is randomly selected from the population: e.g. picking names at random out of a hat. Although this method is truly random it does not guarantee a representative sample .
• Volunteer (self-selecting) sampling . Participants respond to an advert placed by the researcher: e.g. Milgram’s obedience study. This method is not random and doesn’t guarantee a representative sample as only certain types of people are likely to volunteer. However, volunteers are likely to make motivated and cooperative participants in research.
• Opportunity sampling . Potential participants are approached by the researcher and asked whether they would be willing to take part in a study. This method is not random and doesn’t guarantee a representative sample as only certain types of people are likely to agree to take part. However, those who do are likely to make motivated and cooperative participants in research.
• Systematic sampling . Taking every ‘nth’ person on a list: e.g. every 10 th person on a school register. Not random or guaranteed to be representative .
• Stratified sampling . The population is assessed for what proportion of particular characteristics it contains (e.g. age, gender, ethnicity, social class, etc.) and representative numbers of participants possessing these characteristics are randomly sampled to form the sample.

For example, a school population of 1000 students has 40% boys and 60% girls, and 50% of all students are below the age of 16 and 50% are 16 +.

If we wanted a stratified sample of 100 students we would select

• 40 boys (40% of all students) and 60 girls (60% of all students)
• 20 boys below the age of 16 (50% of the 20 boys)
• 20 boys above the age of 16 (50% of the 20 boys)
• 30 girls below the age of 16 (50% of the 20 girls)
• 30 girls above the age of 16 (50% of the 20 girls)

Stratified sampling is truly representative and random.

ETHICAL ISSUES AND WAYS OF DEALING WITH THEM ( AQA A-level Psychology revision notes)

The British Psychological Society (BPS) publish ethical guidelines which psychologists are supposed to follow when planning and conducting research.

DECEPTION AND INFORMED CONSENT  

Participants should not be deceived (lied to) or involved in experiments unless they have agreed to take part. One way of dealing with this is to make sure that the participant is told precisely what will happen in the experiment before requesting that he or she give voluntary informed consent to take part. In reality, many experiments require some level of deception to avoid demand characteristics, hence it is often difficult to receive fully informed consent.

For example, Milgram got consent to take part in an experiment, but not informed consent as participants did not know the true aim of the study.

Dealing with Deception and Lack of Informed Consent

• At the end of the experiment participants should be informed about the aims, findings and conclusions of the investigation and the researcher should take steps to reduce any distress that may have been caused by the experiment. This may be in the form of counselling . They should also be asked if they have any questions.
• Presumptive Consent . The general public are surveyed and asked whether they believe that the breaking of ethical guidelines in a particular study is justified or not . This solution is often used in relation to experiments where participants cannot be asked for consent as the study requires them to remain naïve: e.g. field experiments such as Hofling.
• Prior General Consent . In this proposed solution, people volunteer to take part in research at some point in the future . Thus, they serve as a pool of participants who may be used at some point in the future.
• Retrospective consent involves asking the participants for consent after they have participated in the study.
• In the case of young children or the mentally ill , parents or guardians can provide consent if they judge a procedure is in the client’s best interests: e.g. whether a child with ADD should be prescribed a drug. Approval could also be obtained after consulting professional colleagues: e.g. psychiatrists debating whether a depressed patient would benefit from a drug treatment.

RIGHT TO WITHDRAW

Participants should have the right to withdraw from an experiment at any time.

They should be informed of this right in the standard briefing instructions given to them before the experiment commences. They have the right to insist that any data they have provided during the experiment should be destroyed.

PROTECTION FROM PHYSICAL AND PSYCHOLOGICAL HARM

Participants should be exposed to no more risk than they would encounter in their normal lives. They should also be protected from any kind of psychological harm such as stress, embarrassment or damage to their self-esteem .  If participants are showing signs of distress they should be reminded of their right to withdraw .

CONFIDENTIALITY

Information about participants’ identities should not be revealed and can be kept confidential by ensuring participants’ identities remain anonymous and confidential. Freud, for example, gave his clients pseudonyms: e.g. Little Hans.

FORMS & INSTRUCTIONS ( Psychology A-level revision)

CONSENT FORM

If asked to write a consent form, to get full marks you must provide sufficient information on both ethical and methodological issues for participants to make an informed decision. You must also write as it would be read out to participants.

The form should contain

• The purpose of the study
• The length of time required of the participants
• Details of any parts of the study that participants might find uncomfortable
• Details about what will be required of them, and what they will have to do
• There is no pressure to take part in the study at all
• Right to withdraw (they can leave at any time, without giving a reason, keep any money they have been paid, and any data collected on them will be destroyed)
• Reassurance about protection from harm
• Reassurance about confidentiality of the data
• They should feel free to ask the researcher any questions at any time
• They will receive a full debrief at the end of the programme

STANDARDISED INSTRUCTION FORM FOR PARTICIPANTS

You need to use the details in the description of the study to write an appropriate set of instructions for participants. The instructions should be clear, concise, use formal language and be as straightforward possible. They must:

• Explain the procedures of this study relevant to participants.
• Include a check of understanding of instructions.

(This is not a consent form so references to ethical issues are not necessary.)

PEER REVIEW ( A-level Psychology revision)

Peer review is the process by which psychological research papers are subjected to independent scrutiny (close examination) by other psychologists working in a similar field who consider the research in terms of its validity and significance . Such people are generally unpaid . Peer review happens before research is published.

Peer review is an important part of this process because it provides a way of checking the validity of the research, making a judgement about the credibility (believability) of the research, and assessing the quality and appropriateness of the design and methodology .  It is a means of prevent incorrect data entering the public domain. This is important to ensure that any funding is being spent correctly .

Peers are also in a position to judge the importance or significance of the research in a wider context .  They can also assess how original the work is and whether it refers to relevant research by other psychologists.  They can then make a recommendation as to whether the research paper should be published in its original form, rejected or revised in some way.  This peer review process helps to ensure that any research paper published in a well-respected journal can be taken seriously by fellow researchers and the public. 

MAJOR FEATURES OF THE SCIENTIFIC METHOD ( AQA A-level Psychology revision)

Science is the unbiased observation and measurement of the natural world. It is the only tool humanity has developed for establishing factual truths about the world. Science allows us to establish the laws of physical world and from this knowledge create technology .

Since the 1700’s the scientific method has been developed, scrutinised and refined.

Major features of the scientific methods are

• Empiricism – Information is gained through direct observation or experiment on physically observable and measurable phenomena rather than by reasoned argument, unfounded beliefs, faith or superstition.
• Objectivity – Scientists should strive to be unbiased and non-interpretative in their observations and measurements. Prior expectations and preconceptions should be put aside. Subjective can be thought of as biased, personal and interpretive.
• Replicability – One way to demonstrate the validity of any observation or experiment is to repeat it. If the outcome is the same, this confirms the truth of the original results, especially if the observations have been made by a different person. In order to achieve such replication it is important for scientists to record their methods carefully so that the same procedures can be followed in the future.
• Control – Scientists seek to demonstrate causal relationships between variables. The experimental method is the only way to do this – where we vary one factor (the independent variable) and observe its effect on a dependent variable. In order for this to be a ‘fair test’ all other conditions must be kept the same, i.e. controlled . This allows us to establish the cause-effect relationships which underlie the laws of nature.
• Theory construction – One aim of science is to record facts, but an additional aim is to use these facts to construct theories to help us understand and predict the natural world. A theory is a collection of general principles that explain observations and facts . Theories should be based a sound body of valid and reliable scientific study.
• Hypothesis Testing – A good theory must be able to generate testable hypotheses . Popper developed the concept of falsification – the only way to really prove a theory correct is to disprove it: if it can’t be disproved it must be correct.

PARADIGMS AND PARADIGM SHIFTS ( AQA A-level Psychology revision guide)

A paradigm refers to the accepted and approved of ways of thinking, understanding, theorising and researching that exist and are shared within any one particular science. For example, biologists all tend to work within a paradigm where they accept basic concepts (evolution and Darwinian theory) as true and agree on how biology should be studied (scientific experimentation).

Psychology is often described as pre-paradigmatic as there is no complete, shared agreement between psychologists about how they should understand and explain human behaviour or what the best methods to study behaviour are. Psychology encompasses a number of conflicting approaches (e.g. behaviourism, biological, cognitive, psychodynamic, evolutionary, etc.) which disagree over what the major influences are on behaviour and what methods should be employed to study behaviour.

A paradigm shift occurs when there is a fundamental change in how scientists in a particular field understand and research subject matter due to evidence proving that the previous paradigm was inadequate/incorrect in some way. For example, in the field of physics, Newton’s laws were the dominant paradigm from the 18 th to early 20 th century before the work of Einstein resulted in a paradigm shift in the way in which physicists understood the physical laws of the natural world.

CONVENTIONS FOR REPORTING PSYCHOLOGICAL INVESTIGATIONS ( A-level Psychology resources)

Psychological investigations are written up/reported in the same way by all psychologists.

Abstract – A summary of the study covering the aims/hypothesis, method/procedures, results and conclusions. Allows a reader to gain a quick overall understanding of a study.

Introduction/Aim/Hypotheses – What the researchers intend to investigate. This often includes a review of previous research (theories and studies), explaining why the researchers intend to conduct this particular study. The researchers may state their research predictions and/or a hypothesis or hypotheses.

Method – A detailed description of what the researchers did , providing enough information for replication of the study. Included in this section is:

• Information about the participants (how they were selected , how many were used, and the experimental design )
• The independent and dependent variables
• The testing environment
• Materials used
• Procedures used to collect data
• Any instructions given to participants before (the brief ) and afterwards (the debrief )

For full marks, the method section should be written clearly , succinctly and in such a way that the study would be replicable . It should be set out in a conventional reporting style, possibly under appropriate headings . The important factor here is whether the study could be replicated.

Results – This section contains statistical data including descriptive statistics (tables, averages and graphs) and inferential statistics (the use of statistical tests to determine how significant the results are).

If you are asked to outline and discuss the results of a study mention the following points

• Write the results out clearly in words: e.g. ‘the mean number of objects remembered for participants listening to music was seven, but for those not listening to music was nine’.
• Refer to the standard deviation or range and explain what they mean, e.g. ‘those listening to music had a higher standard deviation than those not listening to music, meaning that their scores varied more around the mean. So there were more individual differences in participants’ memories when listening to music.’
• Say whether the results were significant and how you know this (refer to the OV, CV and level of significance), and what it means if they were.
• Discuss issues of validity
• Discuss issues of reliability
• The researchers offer explanations of the behaviours they observed and might also consider the implications of the results (how it can be applied to the real world) and make suggestions for future research.
• The researchers must consider their work critically, and evaluate it in terms of validity, reliability, any short-comings or criticisms, etc.
• Discuss how their research relates to the background research discussed in their introduction.

THE IMPLICATIONS OF PSYCHOLOGICAL RESEARCH FOR THE ECONOMY ( AQA A-level Psychology resources)

Although it is difficult to quantify how much psychology contributes to the economy, Psychology university departments receive over £50 million in research grants annually.

Psychological research is used in diverse fields such as medicine, psychiatry, therapy, social work, childcare, advertising, marketing, business, forensic in crime, the army, education, etc.

Apart from direct benefits, Psychology indirectly contributes to the economy: for example, in the UK, 40% of people claiming incapacity benefits are doing so due to anxiety or depression, therefore, psychotherapy may assist the long-term unemployed in returning to work which causes increased tax revenue.

Psychology may also assist in finding solutions to wider social problems relating to crime, aggression, child abuse, etc. This could contribute to the economy by reducing levels of crime (theft and damage to properties), reducing prison population (paid for by the tax-payer) and increased taxation (people working rather than being in prison).

DESCRIPTIVE STATISTICS ( A-level Psychology notes)

Once a study has been conducted that produces quantitative data , patterns and trends can be simply analysed using some of the following techniques.

MEASURES OF CENTRAL TENDENCY

This refers to the 3 forms of average – Mean, Median and Mode – which tell us about the average within a set of data.

For example, a set of scores are produced in a memory test:

5, 7, 8, 8, 10, 11, 14, 15, 45

Add all scores and divide by total number of scores:  123 divided by 9 = 13.67

• An advantage of the mean is that it is the truest form of average because it uses all scores within a set of data.
• A disadvantage is that the mean may be artificially inflated or deflated by extreme scores (outliers) in a set of data (in such a case we can say that the data is skewed ). In the above example the extreme score of 45 artificially inflates the mean to an unrealistically high level .

The median is the middle score in a set of ranked (put in order from low to high) data.

• An advantage of the mode is that It is not affected by extreme scores ( outliers ).
• A disadvantage is that the Mode can be altered a lot by small changes in a set of data.

E.g. 2, 4, 4, 5, 9, 15, 16 Median = 5 (Take mean average if 2 numbers in middle).

       2, 4, 5, 9, 15, 16, 17 Median = 9 (Take mean average if 2 numbers in middle).

The most frequently occurring score in a set of data.

• A disadvantage is that the Mode can be altered a lot by small changes in a set of data. Also, set of scores may have no mode value .

E.g.  2, 2, 4, 5, 9, 15, 16   Mode = 2

         2, 3, 4, 5, 9, 16, 16 Mode = 16

CALCULATING %’s

To calculate how much 1 number is as a percentage of another number divide the 1 st number by the 2 nd and multiple by 100.

For example, if Bob earns £26,060 a year and Nicola earns £137,540 then 

26,060/137,540 x 100 = 18.94

Therefore, Bob earns 18.94% of Nicola’s salary.

MEASURES OF DISPERSION

These tell us about the ‘spread’/‘dispersion’/’variability’ within a set of scores – the range and the standard deviation (SD).

This simply tells us about the range of scores in a set of data . The range is calculated by taking the highest score and subtracting the lowest score.

THE STANDARD DEVIATION (SD)

The standard deviation tells us about the amount of variability from the mean .

For example, 2 classes of students with 2 different psychology teachers gained the following % scores in an end of year test.

GROUP 1: 18, 24, 31, 46, 55, 64, 79, 82, 90, 98.  Mean = 59

GROUP 2: 49, 52, 54, 57, 68, 60, 62, 64, 66, 68.  Mean = 60

Although the 2 groups have very similar mean scores, GROUP 1 have a much larger SD – there is a lot of variability from the mean whereas there is little variation from the mean in GROUP 2.

The SD is a stronger measure of dispersion than the range because

• The SD is a measure of dispersion that is less easily distorted by a single extreme score .
• The SD takes account of the distance of all the scores from the mean.
• The SD d oes not just measure the distance between the highest score and the lowest score .

DISPLAYS OF DATA ( AQA A-level Psychology notes)

Quantitative data can be plotted on a variety of graphs and charts.

GRAPHS are used to display continuous scores ( ordinal data : see Inferential Statistics below). For example, to record participants scores in a memory test (x/20).

HISTOGRAMS are graphs converted to show interval scores (rather than continuous ones). (See Inferential Statistics below.)   

BAR CHARTS are not used to display scores - rather they display categories of information ( nominal data : see Inferential Statistics below). For example, number of participants in a particular category such as: favourite colour, borough of London lived in, participants studied at A Level, etc.

Note: whereas histogram bars join because they display continuous sets of scores, bar chart bars are separate as they show separate categories of information. 

SCATTERGRAMS are used to display data from correlation studies (see previous notes on Correlation Studies).

DISTRIBUTIONS: NORMAL AND SKEWED DISTRIBUTIONS; CHARACTERISTICS OF NORMAL AND SKEWED DISTRIBUTIONS ( A-level Psychology revision notes)

Many characteristics of populations follow a normal distribution: e.g. height, weight, shoe size, etc.

IQ scores are show a ‘normal’ distribution as below: i.e. most scores cluster around the mean average and as scores decrease or increase in either direction, fewer and fewer people possess these high or low scores. 68% of the population have an IQ between 85 and 115, only 2% of the population have an IQ between 130 and 145.

However, distributions of characteristics in populations may be ‘skewed’ ( distorted in one direction of another). For example, salary in the UK is positively skewed : i.e. a small % of the population earn a very large salary. The IQs of children at a school for the gifted would be negatively skewed (i.e. few with a low IQ, lots with a high IQ).

INFERENTIAL STATISTICS ( AQA A-level Psychology revision notes)

Although quantitative data can be analysed in fairly simple ways using measures of central tendency and dispersion, psychologists and scientists employ more complex statistical techniques to analyse results.

Experiments and correlation studies involve assessing whether

• there is a significant difference between how the 2 conditions of the IV affect the DV
• there is a significant correlation between 2 co-variables.

The term ‘significant’ can be thought of as referring to whether there is a real, interesting and important difference or correlation between variables.

For example, in the drink-driving study we may find a mean average score of 16/20 for the sober group and 9/20 for the alcohol group – clearly this is an important ‘significant’ difference. On the other hand if the scores were 14/20 and 11/20 we would be less sure if there was a real ‘significant’ difference between the groups.

At a basic level, statistical analysis is a tool to assess whether we have or have not found a significant difference or correlation in a study.

There are a number of different statistical tests that can be used to analyse data. Which test is appropriate to use is decided by

• Whether the study is an experiment or a correlation study
• Whether the study’s design is an independent groups design or a repeated measures design
• Whether data is at the ordinal , nominal, interval or ratio level (see below)

LEVELS OF DATA

Quantitative data comes in different forms/types.

• Ordinal Data – scores which can be ranked from low to high: e.g. scores in an IQ test, memory test or personality questionnaire.
• Nominal Data – data in the form of categories of information: for example, number of students studying particular participants in college.

For the following examples decide whether data is ordinal or nominal.

Height, eye colour, borough of London lived in, stress score, favourite animal, skill at driving, reaction speed.

• Interval Data – Ordinal data which has either been separated into intervals: e.g. 0-5, 6-10, 11-15, 16-20, etc.

PROCEDURES FOR STATISTICS TESTS 

In the exam you are only required to know about how to conduct inferential statistics using the Sign Test , however all statistics tests follow the basic principles below.

• Data from an experiment or correlation study is processed through a number of statistical/mathematical formulae. This will eventually produce one single number which ‘describes’ the data as a whole – this is referred to as the Calculated/Observed Value (OV)
• The OV is then compared to a Critical Value (CV). This is a number found by cross-referencing certain information on a table of statistical significance .
• Different statistics tests have different rules
• In some tests if the OV > CV then the statistics test shows that we have found a significant difference/correlation and can, therefore, accept the experimental hypothesis . If the OV < CV we reject the experimental hypothesis .
• In other tests the reverse is true: e.g. if OV < CV we accept the experimental and reject the null.
• In the exam you will be told which of the 2 rules above applies to the statistics test concerned.
• At a basic level, therefore, statistical analysis of data is a way of establishing whether we have or haven’t found significant results.

LEVELS OF STATISTICAL SIGNIFICANCE AND PROBABILITY (P)

In theory, psychologists/scientists never say that their findings are 100% accurate and true – there is always a probability that although results seem to indicate particular findings they are incorrect and findings have occurred by chance .

The concept of level of significance is used to indicate to readers to what percentage probability we can say that a particular set of findings are accurate and true, and to what extent results may have simply occurred due to chance .

For most pieces of psychological research a significance level of P < 0.05 is used. This indicates a 95% probability that results are accurate and true and a <5% probability that results occurred due to chance.

Higher levels of significance can be set when the accuracy of research findings is more important: e.g. in trials of a new drug. Thus findings which are significant at P < 0.01 mean that researchers are 99% confident results are true and there is only a 1% probability they occurred due to chance.

< m eans ‘the same as or less than’.

Depending on the results of statistical analysis of data we may find that results are significant at any one of the above levels of probability. The higher the level of probability – the more significant, and therefore stronger, our results are.

TYPE 1 & TYPE 2 ERRORS

Type 1 errors – calling something true when it’s false.

When a statistics test indicates that the experimental hypothesis should be accepted, but in fact, the results are due to chance random factors . If the level of significance is set at 5%, there will always be a 1/20 chance of a type 1 error.

Clearly, the higher the level of significance (e.g. P < 0.1), the greater the chance that a type 1 error will occur (in this case 10%).

Type 2 errors – calling something false when it’s true.

When a statistics test indicates that the experimental hypothesis should be rejected, but in fact, the results are significant .

Clearly, the lower the level of significance (e.g. P < 0.005), the greater the chance that a type 2 error will occur.

 >>>>>>>>

THE SIGN TEST ( Psychology A-level revision)

The Sign Test is the 1 statistics test you do need to know how to fully conduct .

Signs tests are used in experiments with a repeated measures design and nominal data .

Example and procedures

We could conduct a study into whether there is a difference in people’s memory for a list of 10 words they’ve been read (DV = memory score x/10) depending on whether they heard the words in quiet conditions (1 st condition of the IV) or noisy conditions (2 nd condition of the IV). We would use a 1-tailed hypothesis for this study as previous research indicate that noise would disrupt memory ability

Once the experiment is conducted data (results from participants) is put into a results table .

Steps to calculate Sign Test

• Subtract the score for the experimental condition from the control condition . If the result is negative add a minus – sign; if it’s positive add a + sign; if there’s no difference add a 0
• Count the number of times the less frequent sign occurs . In the above example, the + sign is the least frequent. Call this value S . Therefore, S = 2
• Count the total number of + and – signs . Call this value Therefore, N = 7
• Decide whether a 1 or 2-tailed hypothesis was used . In the above example, we used a 1-tailed hypothesis.
• Consult the table of statistical significance (below) for the Sign Test to find the critical value (CV).
• Look down the left hand column marked N until you get to the total number of + and – In the case described N = 7 .
• Cross reference N with the columns for either 1 or 2-tailed test (depending on whether your hypothesis is 1 or 2-tailed) and the Level of Significance value 05 (this is your Level of Significance – P < 0.05 ). In the case above this gives a value of 0 . Call this value the critical value (CV) . Therefore, CV = 0.
• If the critical value ≥ S then we have found a significant difference between how the 2 conditions of the IV affected the DV: i.e. there is a significant difference in how noisy and quiet conditions affect memory ability. In the example above the critical value (CV = 0) is not greater than S (S = 2) therefore, we have not found a significant difference.

  Table of Critical Values for the Sign Test

Start your studies in Spanish and finish in English

• Academic Catalog
• Faculty Achievements
• Library & Tutoring
• Official Transcript
• Student Login
• Student Account
• Request Info
• Why St. Augustine?
• Academic Calendar
• Accreditations
• College Directory

• Our Approach
• Adult Education
• All Programs
• Student Achievement
• HLC Accreditation

School of STEAM

• Business Administration
• Business Management
• Computer Information Systems
• Culinary Arts
• Hospitality Management

School of Education

• Criminal Justice
• Child Development
• Early Childhood Education
• Liberal Arts and Humanities

School of Healthcare and Social Science

• Respiratory Therapy
• Social Work
• Office of Academic Effectiveness
• Request More Info
• Transfer Students
• International Students
• Undocumented & DACA Students
• Student Success Center
• Affordable for All
• Tuition + Fees
• Financial Aid

• Success Stories
• 2022 Clery Report

The Four Main Research Methods in Psychology

If you are a psychology student or have any interest in getting a bachelor of arts in psychology , you’ll quickly come across these four major research methods in psychology. Usually, these four types are divided between two distinct types of psychological research: quantitative and qualitative. 

Qualitative Research:

• Studying objects in their natural settings.
• An interpretive, naturalistic approach to the subject of research. 
• Interpreting phenomena as it naturally occurs. 

Quantitative Research:

• Focuses on a group of people, rather than an individual. 
• Collecting samples, the results of which are usually numerical. 

These four levels of analysis in psychology utilize one of these two types to learn about and develop theories. 

Case Study 

As a psychological research method, a case study follows the qualitative research process, observing communities, individuals, and even specific events. This type of psychological research is conducted with the help of interviews to document nuanced events that happen in someone’s life. The result turns it into a multi-methodological study as the psychologist examines the individual’s daily life, trying to understand and pinpoint where unhealthy behaviors are arising from, and how they can be realized. 

Experimental Method 

Following the quantitative theory, the experimental psychology method tries to look at cause-and-effect relationships, and what happens when a single variable is manipulated. Psychological experiments cover a broad range of methods that can be used to varying degrees of success, from sleep studies to field experiments. Some experiments allow the researcher to be more involved, while other psychological experiments require a hands-off approach. 

Observational Study 

When studying people from a distance, a psychologist gets an opportunity to examine behavior research methods. As a type of qualitative research, observational study in psychology looks at individuals, societies, or social constructs to see how they are being impacted by the world around them. This type of research involves mixed methods as well, due to it occurring in natural settings where the psychologist is not able to control the environment. 

Both qualitative and quantitative, survey research utilizes levels of analysis in psychology. The survey method in psychology utilizes respondents to answer questions, informing the psychologist how they feel. This self-reporting questionnaire asks about feelings, and what they have been doing during their regular day. Depending on the data collected, the results can be either qualitative or quantitative. This is up to the researcher. 

What’s Important about Psychological Research

Research methods in psychology help to expand the academic knowledge of mental health, and the world at large. In order to better understand the world around them, they become experts in the field of psychology and develop a deeper well of knowledge that they can use to help future clients. Are you interested in the field of psychology, and want to help others who are suffering? At St. Augustine, the BA in Psychology is the start of a long and fulfilling career in psychology. Contact us to learn more about it, and how you can start a new life. 

Take The Next Step

AP Psychology: Understanding Research Methods

In AP Psychology, a deep understanding of research methods is essential for interpreting psychological studies and conducting empirical research. Here's a comprehensive guide to the key research methods studied in AP Psychology:

1. Experimental Research:

   - Objective: Establish cause-and-effect relationships between variables.

   - Design: Random assignment of participants to conditions, manipulation of an independent variable, and measurement of dependent variables.

2. Correlational Research:

   - Objective: Examine relationships between variables without manipulating them.

   - Design: Measure variables to determine the degree and direction of correlation. No manipulation of variables occurs.

3. Descriptive Research:

   - Objective: Observe and describe behavior without manipulating variables.

   - Design: Includes naturalistic observation, case studies, and surveys to gather information about behavior.

4. Longitudinal Studies:

   - Objective: Examine changes in behavior or traits over an extended period.

   - Design: Data collected from the same participants over time to observe developmental changes.

5. Cross-Sectional Studies:

   - Objective: Compare individuals of different ages to assess differences.

   - Design: Data collected from participants of different age groups at a single point in time.

6. Quasi-Experimental Designs:

   - Objective: Investigate cause-and-effect relationships without random assignment.

   - Design: Participants are not randomly assigned to conditions due to ethical or practical reasons.

7. Surveys and Questionnaires:

   - Objective: Gather self-report data on opinions, attitudes, or behaviors.

   - Design: Participants respond to a set of questions, providing quantitative or qualitative data.

8. Naturalistic Observation:

   - Objective: Observe and record behavior in its natural setting.

   - Design: Researchers avoid interfering with the environment, allowing for a more authentic representation of behavior.

9. Case Studies:

   - Objective: In-depth analysis of an individual or small group.

   - Design: Intensive examination of a person's history, behavior, and experiences.

10. Independent and Dependent Variables:

    - Objective: Identify the manipulated and measured aspects in an experiment.

    - Design: The independent variable is manipulated, and the dependent variable is measured to observe the effect.

11. Random Assignment:

    - Objective: Minimize pre-existing differences among participants in different experimental conditions.

    - Design: Participants are randomly assigned to experimental and control groups.

12. Sampling Methods:

    - Objective: Ensure the selected sample is representative of the population.

    - Design: Techniques like random sampling, stratified sampling, or convenience sampling are used.

13. Ethical Considerations:

    - Objective: Ensure the well-being of participants and the integrity of research.

    - Design: Adherence to ethical guidelines, including informed consent, debriefing, and protection from harm.

14. Reliability and Validity:

    - Objective: Assess the consistency and accuracy of measurements.

    - Design: Researchers employ techniques to ensure that data collection methods are reliable and valid.

15. Statistical Analysis:

    - Objective: Draw meaningful conclusions from data.

    - Design: Utilize statistical tests like t-tests, ANOVA, or correlation coefficients to analyze and interpret results.

16. Replication:

    - Objective: Confirm the reliability of study findings.

    - Design: Repeated studies with similar methodologies to ensure the consistency of results.

By mastering these research methods, AP Psychology students can critically evaluate psychological studies, design their own experiments, and contribute to the scientific understanding of behavior and mental processes. Understanding the strengths and limitations of each method is crucial for becoming a proficient consumer and producer of psychological research.

You Might Also Like

How can Conducting Research get you into Your Dream College

Want to get admission in your dream college? Do formal research for college admission that will help you to gain admission in your dream college - Read a blog

How to Stand Out through Extracurricular Activities

Do you know the importance of extracurricular activities? Why should you participate in extracurricular activities & how to stand out through it

The Ultimate Guide to College Interviews

College interviews, although nerve wrecking, can be the best chance for you to impress the admissions officer. We give you tips on how to ace your interview.

Free Resources

PSYCH 3002 - Research Methods in Psychology

• APA PsycInfo
• Google Scholar
• Find Cited Articles
• Find "Cited by" Articles
• Browsing Best Journals
• Psychology Journals
• Is it Peer Reviewed?
• Interlibrary Loan

List of Psychology Journals

    The following list contains high impact Sociology journals identified by JCR (Journal Citation Reports).  

Note - Rod Library does provide access to all of these journals. If an article is neither available from OneSearch nor from Google Scholar - UNI students and faculty can request the article via Interlibrary Loan .     

• << Previous: Browsing Best Journals
• Next: Is it Peer Reviewed? >>
• Last Updated: Feb 16, 2024 7:11 AM
• URL: https://guides.lib.uni.edu/research-methods-in-psychology

This paper is in the following e-collection/theme issue:

Published on 17.4.2024 in Vol 26 (2024)

This is a member publication of University College London (Jisc)

Twitter Analysis of Health Care Workers’ Sentiment and Discourse Regarding Post–COVID-19 Condition in Children and Young People: Mixed Methods Study

Authors of this article:

Original Paper

• Macarena Chepo 1 * , RN, BSN, MPH, PhD   ; 
• Sam Martin 2, 3 * , MSc, PhD   ; 
• Noémie Déom 2 , MSc   ; 
• Ahmad Firas Khalid 4 , MD, PhD   ; 
• Cecilia Vindrola-Padros 2 , BA, MA, PhD  

1 School of Nursing, Universidad Andrés Bello, Santiago, Chile

2 Department of Targeted Intervention, University College London, London, United Kingdom

3 Oxford Vaccine Group, Churchill Hospital, University of Oxford, Oxford, United Kingdom

4 Canadian Institutes of Health Research Health System Impact Fellowship, Centre for Implementation Research, Ottawa Hospital Research Institute, Otawa, ON, Canada

*these authors contributed equally

Corresponding Author:

Sam Martin, MSc, PhD

Department of Targeted Intervention

University College London

Charles Bell House 43-45

Foley Street

London, W1W 7TY

United Kingdom

Phone: 44 (0)20 3108 3232

Email: [email protected]

Background: The COVID-19 pandemic has had a significant global impact, with millions of cases and deaths. Research highlights the persistence of symptoms over time (post–COVID-19 condition), a situation of particular concern in children and young people with symptoms. Social media such as Twitter (subsequently rebranded as X) could provide valuable information on the impact of the post–COVID-19 condition on this demographic.

Objective: With a social media analysis of the discourse surrounding the prevalence of post–COVID-19 condition in children and young people, we aimed to explore the perceptions of health care workers (HCWs) concerning post–COVID-19 condition in children and young people in the United Kingdom between January 2021 and January 2022. This will allow us to contribute to the emerging knowledge on post–COVID-19 condition and identify critical areas and future directions for researchers and policy makers.

Methods: From a pragmatic paradigm, we used a mixed methods approach. Through discourse, keyword, sentiment, and image analyses, using Pulsar and InfraNodus, we analyzed the discourse about the experience of post–COVID-19 condition in children and young people in the United Kingdom shared on Twitter between January 1, 2021, and January 31, 2022, from a sample of HCWs with Twitter accounts whose biography identifies them as HCWs.

Results: We obtained 300,000 tweets, out of which (after filtering for relevant tweets) we performed an in-depth qualitative sample analysis of 2588 tweets. The HCWs were responsive to announcements issued by the authorities regarding the management of the COVID-19 pandemic in the United Kingdom. The most frequent sentiment expressed was negative. The main themes were uncertainty about the future, policies and regulations, managing and addressing the COVID-19 pandemic and post–COVID-19 condition in children and young people, vaccination, using Twitter to share scientific literature and management strategies, and clinical and personal experiences.

Conclusions: The perceptions described on Twitter by HCWs concerning the presence of the post–COVID-19 condition in children and young people appear to be a relevant and timely issue and responsive to the declarations and guidelines issued by health authorities over time. We recommend further support and training strategies for health workers and school staff regarding the manifestations and treatment of children and young people with post–COVID-19 condition.

Introduction

More than 3 years after the outbreak of the COVID-19 pandemic [ 1 ], the social, political, and economic impact of this phenomenon has been more than significant, considering >700 million worldwide cases and nearly 7 million people’s deaths [ 2 ]. Given the scale of the phenomenon, it is imperative for all countries to thoroughly examine the lessons gleaned from the pandemic, particularly regarding a matter that has raised significant concern among the populace: the long-term effects experienced by individuals who have had COVID-19, spanning weeks, months, or even years after their initial infection [ 3 ]. This phenomenon, referred to as post–COVID-19 condition (or more commonly “long COVID”), warrants careful consideration and analysis [ 4 ].

There is increasing information regarding the clinical manifestation of this condition, particularly in the adult population. The worldwide prevalence has been estimated at approximately 50% to 70% in individuals hospitalized during acute COVID-19 infection and 10% to 12% in vaccinated cases [ 5 ]. While children and young people have a low likelihood of severe COVID-19 infection [ 6 ], the information available to date indicates that the presence of post–COVID-19 condition in this group may be as disabling as in adults, reaching a prevalence rate of 23.4% (range 3.7%-66.5%) [ 7 ].

An agreed definition by the World Health Organization indicates that post–COVID-19 condition in children and young people is a condition that occurs “in individuals with a history of confirmed or probable SARS-CoV-2 infection when experiencing symptoms lasting at least two months which initially occurred within three months of acute COVID-19” [ 8 ]. Post–COVID-19 condition strongly impacts daily functioning and can develop or continue after COVID-19 infection and may fluctuate or relapse over time [ 4 , 8 , 9 ].

Among the symptoms most frequently attributable to post–COVID-19 condition in children and young people are fatigue, altered smell or anosmia, and anxiety [ 8 ]. However, other symptoms have also been reported, such as sleep disturbances, difficulty in concentrating, abdominal pain, myalgia or arthralgia, earache or ringing in ears, mood swings, persistent chest pain, stomach pain, light sensitivity, diarrhea, heart palpitations, and skin lesions [ 8 , 10 ]. One of England’s most significant studies is the Children and Young People With Long COVID study by Stephenson et al [ 11 ]. This national research matched longitudinal and cohort studies in adolescent individuals aged 11 to 17 years and found the presence of symptoms in 35.4% of the adolescent individuals who tested positive at baseline and 8.3% who of the adolescent individuals who tested negative at baseline. A total of 3 months after testing, 66.5% of those who tested positive and 53.3% of those who tested negative had any symptoms [ 11 ]. However, Stephenson et al [ 12 ] recently indicated that in a 6-month follow-up, the prevalence of specific symptoms reported at the time of the polymerase chain reaction testing decreased over time, where, for example, the prevalence of chills, fever, myalgia, cough, and sore throat among those who tested positive decreased from 10% to 25% to <3%.

As research on the symptoms, prevalence, and treatment of post–COVID-19 condition in children and young people continues, it is essential to add to the literature by developing studies that determine the condition’s impact on this group, considering that they are experiencing a range of unwanted symptoms that disrupt their quality of life and that of their families.

Considering that listening to the voices of families and health workers could be helpful to broaden the knowledge achieved in post–COVID-19 condition in children and young people, a powerful tool could be social media, such as Twitter (subsequently rebranded as X). With >3729 million daily active users, Twitter has become one of the most important social platforms in the world [ 13 ]. People used Twitter during the COVID-19 pandemic for different purposes, such as world leaders communicating with citizens [ 14 , 15 ], organizations monitoring movement [ 16 ], scientists studying public discourse around the pandemic [ 17 , 18 ], and researchers performing sentiment analysis [ 19 - 21 ]. In the case of physicians and health care workers (HCWs), Twitter has been used to share and evaluate scientific evidence, guidelines, and technical advice [ 22 - 24 ] and track the course and burden of disease [ 25 ].

Using the social media monitoring platform Pulsar [ 26 ], we aimed to explore HCWs’ perceptions concerning post–COVID condition in children and young people in the United Kingdom between January 2021 and January 2022. We aimed to contribute to the emerging knowledge on post–COVID-19 condition in children and young people and identify critical areas and future directions for researchers and policy makers.

We considered a mixed methods approach to be a pragmatic research paradigm. We analyzed data by conducting a Collaborative and Digital Analysis of Big Qualitative Data in Time Sensitive Contexts (LISTEN) [ 27 ]. This mixed methods analysis consisted of iterative cycles intercalating team discussion and using digital text and discourse analytics tools to analyze related social media data [ 27 ]. We used the LISTEN method to perform quantitative and qualitative analyses of Twitter posts, extracted through the Pulsar platform [ 26 ], related to the experience of post–COVID-19 condition in children and young people in the United Kingdom (eg, phrases, words, hashtags, videos, and images), published between January 1, 2021, and January 31, 2022. We created an advanced Boolean search for keywords mentioning “long COVID” and corelated words, hashtags, and symptoms; furthermore, we filtered for user accounts who identified as HCWs in their Twitter biography description ( Multimedia Appendix 1 ).

Quantitative analysis of all tweets included the following: (1) engagement analysis, where we specifically measured reactions to posts, for example, a retweet, a share, or a comment or quote made toward a tweet; (2) sentiment and emotion analysis, where we measured the positive or negative sentiment in the words and tone of each post within the context of post–COVID-19 condition and HCW’s roles ( Multimedia Appendix 2 ); (3) emotion analysis, where we measured the emotions expressed in the tweets, classified as sadness, anger, disgust, fear, and joy; (4) frequency analysis, where we observed the frequency of keywords and themes in the data set; (5) segmentation analysis, where we measured the key connections or relationships between keywords and their frequent use in the same context; (6) demographic analysis, where we measured the occupation, gender (man or woman or nonbinary or unknown), and city of origin related to the users posting tweets; and (7) analyses, where we evaluated the most influential accounts and the most mentioned websites.

Big qualitative analysis was carried out through thematic discourse analysis of the data sample, using InfraNodus [ 28 ], specifically analyzing the key themes and topics of concern expressed throughout the data set. A codebook was constructed based on the mapping of themes agreed upon by 3 researchers (ND, SM, and MC; Multimedia Appendix 3 ).

The principal investigators (ND, AFK, SM, and MC) interpreted and analyzed the data collected, following the recommendations for rigorous research provided by Creswell and Poth [ 29 ]. Using the LISTEN method [ 27 ], we aimed to show that the integration of qualitative insights through thematic analysis with the quantitative backing of topic modeling can offer a comprehensive view of the discourse. This mixed methods approach allows us to capture the richness of qualitative data while leveraging the objectivity of quantitative measures. Our initial data harvest of the larger corpus data from the Pulsar platform captured 300,000 tweets; this data harvest helped to underpin the software’s sentiment analysis modeling of this specific data set, providing a robust quantitative foundation. The addition of further qualitative data analyses from a smaller qualitative sample allowed for an in-depth understanding of nuanced conversations, particularly when exploring new or complex phenomena such as post–COVID-19 condition in children and young people, with the provision of insights into the context, subtext, and sentiment behind the tweets offering valuable snapshots of public perception and discourse. We used an iterative mixed methods approach, iterating between team discussions and using digital analytics tools to discern relevant themes from the Twitter data corpus. Specifically, we used InfraNodus for thematic analysis, which incorporates a topic modeling script for analyzing and identifying key topics of concern with a data set and provides a structured and objective interpretation of the data. The coding process involved 3 independent researchers (MC, SM, and ND), each with expertise in health care, social network analysis, and digital global health. When initial coding disagreements arose, we meticulously tagged any queries and discussed the posts in question. These instances led to 3 structured meetings wherein the research team deliberated collaboratively to resolve conflicting interpretations. This approach resulted in an 81.99% (2122/2588) initial intercoder agreement rate for the tweets analyzed. For the remaining instances where consensus was not initially reached, the majority rule was applied to finalize theme codings. To quantify the reliability of our coding procedure, with 81.99% (2122/2588) of the tweets coded identically, we used the Cohen κ score, which provides a measure of interrater agreement adjusted for chance. Including the calculation of all variations, this score was calculated to be approximately κ=0.70, indicating good agreement among the coders.

Ethical Considerations

The study only collected data from publicly accessible social networks that have been anonymized by various means, particularly by replacing all usernames and links with anonymous text and summaries of tweets that have been edited, retaining the original message, avoiding direct quotations being identifiable, and ensuring that no information is provided on the identity of the individuals who posted the content studied on the platform.

Internet research requires researchers to carefully consider guidelines to determine whether ethics approval and informed consent are needed [ 30 ]. On the basis of the terms set out by the Research Ethics Committee at the University College London [ 31 ], the study was considered exempt from formal ethics approval for the following reasons: (1) study involving information freely available in the public domain, such as published biographies, newspaper accounts of an individual’s activities, and published minutes of a meeting, that although is considered personal under the Data Protection Act, would not require ethics review; and (2) study involving anonymized records and data sets in the public domain, such as data sets available through the Office for National Statistics or the UK Data Archive where appropriate permissions have already been obtained and it is not possible to identify individuals from the information provided.

Therefore, we anonymized all records and data sets collected during the study to make identification impossible. We removed social media usernames from the data samples. No direct or easily traceable quotes have been included. These measures align with best practices [ 32 - 35 ]. While this study was beyond the scope of the human ethics committee, we adhered to the principles of ethics: beneficence, nonmaleficence, autonomy, and justice [ 36 ]. We collected and analyzed data through secure encrypted servers via the Meltwater and InfraNodus platforms.

Audience Analysis

During the period from January 2021 to January 2022, we obtained 300,000 tweets from 936 accounts. After filtering for relevant posts (refer to inclusion and exclusion criteria in Multimedia Appendix 1 ), we analyzed a sample of 2588 tweets using mixed methods analysis. In terms of gender (man, woman, nonbinary, or unknown), 32.88% (851/2588) were female individuals, 23.49% (608/2588) were male individuals, and 43.59% (1128/2588) were unknown. According to the description given in the user’s biography, the most frequently self-reported terms were “NHS” (582/2588, 22.49%), “health” (230/2588, 8.89%), “medical” (168/2588, 6.49%), “nurse” (166/2588, 6.41%), “clinical” (160/2588, 6.18%), “mum” (158/2588, 6.11%), “doctor” (145/2588, 5.6%), and “GP” (145/2588, 5.6%). In terms of city, tweets came mainly from London (958/2588, 37.02%), Newcastle upon Tyne (326/2588, 12.6%), Redcar (160/2588, 6.18%), Manchester (140/2588, 5.41%), and Bradford (111/2588, 4.29%).

Regarding profession described in the user’s biography, the most frequently mentioned roles were nurses (176/2588, 6.8%); medical roles, for example, paramedic and nursing assistant (173/2588, 6.68%); clinical roles, for example, surgeon, physiotherapist, and anesthesiologist (160/2588, 6.18%); general practitioners (GPs), for example, hospital GP or local surgery GP (142/2588, 5.49%); and physician (140/2588, 5.41%). The most frequent organization affiliated with was the National Health Service (587/2588, 22.68%).

Most Influential Accounts

One of the accounts that generated the highest number of mentions and, therefore, some of the most influence, as they were the ones that talked the most about post–COVID-19 condition in children and young people, was the account for @longcovidkids (593/2588, 22.91% tweets), related to the most shared website longcovidkids.org [ 37 ] , an international UK-based charity for families and children living with post–COVID-19 condition. Although the account was created in October 2020, it was first mentioned in our data collection timeline on January 1, 2021. It offers web support services, funding, and research participation and represents children and young people living with post–COVID-19 condition in expert forums, research panels, health organizations, and parliamentary groups. The other most shared web pages were theguardian.com (the United Kingdom) [ 38 ], bbc.co.uk (the United Kingdom) [ 39 ], peoplewith.com (the United States) [ 40 ], and ncbi.nlm.nih.gov (the United States) [ 41 ]. This shows that in the United Kingdom, there was a mixed influence of UK and US link resources linked to HCW Twitter users in the United Kingdom.

Keyword Analysis

The volume of social media engagement in the discussion about the post–COVID-19 condition experience in children and young people in the United Kingdom reached 1400 posts, 1550 engagements, and 1.9 million impressions. Overall, comments were very responsive to government decisions regarding the vaccination program and school closures ( Multimedia Appendix 4 ). During the first peak of comments in January 2021, the amount of discourse expanded leading up to March 2021, when there were different announcements of school closures, and the guidelines were delivered regarding the priority groups of the vaccination program (frontline HCW and people aged >80 years first). The highest engagement was between June and July 2021, which coincides with the government announcement regarding the availability of vaccines for people aged >18 years. The third peak of comments occurred in September 2021, the same month the authorities announced the extension of the vaccination program to children aged 12 to 15 years.

Top Keywords Analysis

The top words in posts associated with children and young people’s experience of post–COVID-19 condition in the United Kingdom were “Children” (352/2588, 13.6%), “kids” (160/2588, 6.18%), “people” (158/2588, 6.11%), “Young” (148/2588, 5.72%), and “schools” (83/2588, 3.21%). The top hashtags were #longcovid (1387/2588, 53.59%), #longcovidkids (448/2588, 17.31%), #covid19 (370/2588, 14.3%), and #covid (176/2588, 6.8%).

Sentiment and Emotions Analysis

According to sentiment analysis, 99.38% (2572/2588) of the posts reflected negative sentiments and 0.62% (16/2588) reflected positive sentiments. Negative sentiments were mainly associated with comments on hospitalization figures related to the COVID-19 pandemic, criticism of pandemic mitigation policies, and vaccination of children and young people. Furthermore, positive sentiments mainly concerned acknowledgments around decreasing numbers of community support groups.

The primary emotions identified were as follows:

• Sadness (1752/2588, 67.7%), such as in the following tweet:

@[Username] Really upset, after my tough on-call last night. Hospitalisations are still going up, and Gov announcement minismises the effect of long-COVID in adults and children. It’s so hard to keep spirits up today. But we’ll try and continue doing our best in the NHS.

• Joy (367/2588, 14.18%), such as in the following tweet:

@[Username] It’s been an amazing day! [...] I’ve been able to share the experience I’ve gained treating children and adolescents with Long COVID over the last year.

• Fear (233/2588, 9%), as seen in the following tweet:

@[Username] It’s really urgent that young people get the message that they need to get vaccinated. Long COVID is ruining many people’s lives! It’s not a lie or hypochondria, there are real, physiological changes, please understand!

Segmentation Analysis

This analysis revealed the critical clusters of conversation around the main topics of concern within the discourse network around post–COVID-19 condition. Comments were distributed in 4 key conversation segments as follows:

• People, schools, and prevention (1734/2588, 67%): Most of the comments related to measures taken in terms of COVID-19 prevention in schools, concern about the risk of exposure, and sharing experiences of infection in schools.
• Health, adults, and impact (401/2588, 15.49%): Comments mainly reflected concerns and uncertainty about the long-term effect of post–COVID-19 condition on both children and young people and adults.
• Cases, virus, and risk (326/2588, 12.6%): Comments reflected worries about the associated risks and long-term consequences attributable to post–COVID-19 condition (in both adults and children and young people) and the constant mutation of the virus, which will create a permanent risk in the population.
• Months, distress, and symptoms (106/2588, 4.1%): Some HCWs used Twitter to share how children and young people experience post–COVID-19 condition and the extent of these symptoms. Some HCWs exemplified certain typical manifestations, such as fatigue.

Discourse Analysis by Theme

To better understand the topics discussed from the segmentation analysis, we performed a discourse analysis of the key co-occurring themes and topics of concern shared within discussions regarding post–COVID-19 condition in children and young people. The following themes emerged ( Textbox 1 ): concern or uncertainty for the future, school attendance, mask protection from COVID-19, vaccine uptake, infection rates, policy (support or skepticism), understanding and visualizing symptoms, child mental health, access to care, community support, and research ( Figures 1 and 2 ).

• Concern for the future or uncertainty (615/2588, 23.76% tweets): Most comments showed a concern for the future, focusing on shared statistics regarding the rate and spread of infection in children and young people and how this would affect future health outcomes. Furthermore, this group expressed concern regarding political decisions; the presence of illness in loved ones; the eventual overload and response capacity of the health system in the face of an increase in post–COVID-19 condition cases; and the need for training of health care workers (HCWs) to deal with comorbid, potentially long-term symptoms ( Figure 1 A).
• Schools (460/2588, 17.77% tweets): Comments aimed to promote vaccination policies for schoolchildren and flexible measures regarding teachers’ work and attendance, considering cases of people with prolonged symptoms. In addition, several tweets expressed dissatisfaction with school risk mitigation measures, such as the use of face masks and air filters ( Figure 1 B).
• Vaccine (386/2588, 14.9% tweets): Most tweets from this group showed their disapproval of the constant changes in the government’s decisions regarding schools and priority groups for vaccination. Between March and June 2021, the first set of tweets criticized the lack of priority in the vaccination program for schoolchildren and other at-risk groups (such as teachers). Once the authorities announced a vaccination program for schoolchildren aged 12 to 15 years ( Multimedia Appendix 4 ), most comments promoted vaccination for this group. A few comments (78/2588, 3.01%) shared concerns about the vaccine’s efficacy for children, based on the experiences of COVID-19 reinfection in adults despite having received the recommended initial doses. However, to a lesser extent (26/2588, 1%), there was a refusal to vaccinate children, citing fear of possible adverse effects. Nonetheless, it is worth noting that the community frequently refuted such comments ( Figure 1 C).
• Share statistics (334/2588, 12.91% tweets): Frequently, HCWs shared statistical data, such as the number of affected children and young people, the number of post–COVID-19 condition cases, and hospital admissions and deaths. Some of these data were used to validate the existence of the post–COVID-19 phenomenon or to express concern about it ( Figure 1 D).
• Policy (316/2588, 12.21% tweets): The comments were responsive to the policies emanating from the authorities over time ( Multimedia Appendix 4 ). There were 5 main criticisms, including changes in school closure or opening policies; HCWs question why the authorities ignore the evidence of post–COVID-19 cases in children and young people, leading them to question whether decision makers have sufficient training to control the pandemic adequately; the failure to include teachers and school workers in the COVID-19 vaccination program as well as the younger population; the lack of mitigation measures in schools, such as improvements in ventilation systems and mandatory use of masks; and the herd immunity as a plan in the government’s hidden agenda , that is, to promote work and activate the economy ( Figure 1 E).
• “Proof” (280/2588, 10.82% tweets): Most tweets in this group argued regarding the existence of children and young people with post–COVID-19 condition through pictures; statistics; scientific papers; and personal, family, and professional experiences ( Figure 1 F).
• Signs and symptoms (189/2588, 7.3% tweets): Among the symptoms described, chronic fatigue and exhaustion were the most frequent symptoms, which prevent normal activities. Other symptoms were respiratory: dyspnea, chronic cough, and shortness of breath; gastrointestinal: acute or intense abdominal pain, nausea, bloating, gastroparesis, and change in smell or taste; muscular: severe joint pain, “painful foot” and difficulty with physical activity; mental health: anxiety and low mood; topical: rash, skin rashes, and redness and pain in the eyes; and nonspecific symptoms, such as chest pain, heart palpitations, constant high body temperature, precocious puberty, hormonal changes, and erectile dysfunction ( Figure 2 A).
• Face masks (119/2588, 4.6% tweets): Face masks were widely promoted, especially in schools, because HCWs considered them as a practical and straightforward strategy to control the pandemic ( Figure 2 B).
• Skepticism (101/2588, 3.9% tweets): Comments showed reticence toward post–COVID-19 condition in children and young people. Some of the arguments focused on a perceived lack of clarity in the clinical manifestations and stressed the need to better differentiate the post–COVID-19 condition from other related symptomatologies, such as mood disorders (eg, depression and anxiety due to confinement). In contrast, several arguments agreed on the need for more scientific evidence, arguing that post–COVID-19 condition in children and young people are isolated. Other users claimed not to know of such cases instead of calling post–COVID-19 condition in children and young people SMS text message an exaggeration. In addition, several arguments favored releasing restrictions for children and young people, particularly arguments related to the use of masks, because of possible associated risks, for example, hypoxia ( Figure 2 C).
• Mental health (54/2588, 2.09% tweets): Symptoms attributable to mental health problems in children and young people were also a concern. For instance, HCWs mentioned sadness, fear of infecting their family, anxiety regarding sick parents, stress, night terrors, self-harm, and suicidal ideation. Furthermore, users discussed a perceived lack of specific support for children and young people and their families in situations such as hospitalization; prolonged COVID-19 condition; admission to intensive care; and death of a family member, schoolmate, or teacher, all situations that triggered permanent stress in these groups ( Figure 2 D).
• Community support or asking for advice (93/2588, 3.59% tweets): Some HCWs used Twitter to ask for guidance on a specific issue or share experiences of having post–COVID-19 condition or caring for children and young people or family members. Furthermore, they shared informative infographics provided by experts regarding post–COVID-19 condition in children and young people ( Figure 2 E).
• Access to health care or treatment (72/2588, 2.78% tweets): Some HCWs mentioned the lack of specialist (cardiology) support, concerns regarding prolonged National Health Service burnout, and criticisms regarding how follow-up was carried out concerning the relative symptomatology of children and young people with post–COVID-19 condition. At the same time, opening new centers for children and young people with post–COVID-19 condition generated different reactions. On the one hand, some HCWs recognized it as a substantial development, but on the other hand, some HCWs recognized it as proof of the existence of post–COVID-19 condition in children and young people, which raised concerns for the future ( Figure 2 F).
• Research (52/2588, 2% tweets): Under this theme, tweets largely promoted study on post–COVID-19 condition in children and young people or highlighted the need for further study on the subject ( Figure 2 G).
• Images (57/2588, 2.2% tweets): Images shared were primarily from scientific studies, including infographics (from organizations such as National Health Service or @LongCovidKids) and visualization of children and young people’s symptoms, such as rashes, COVID-19 toe, and joint pain. Most infographics shared by organizations (and not individuals), such as the organization LongCovidKids, were related to statistics, such as the number of children and young people with post–COVID-19 condition or the quantification of the type of symptoms experienced. Shared photographs tended to show the more “visually recognizable” symptoms of post–COVID-19 condition, such as skin lesions, rashes, or inflammation. The less visible symptoms, such as chronic fatigue and neurological issues, were represented with photographs of children and young people lying, sleeping under blankets, or duvets or on hospital beds ( Figure 2 H).

Principal Findings

Our primary objective was to explore HCWs’ perceptions concerning post–COVID-19 condition in children and young people in the United Kingdom between January 2021 and January 2022. Our findings indicated that comments made by HCWs on Twitter were responsive to announcements issued by authorities regarding the management of the COVID-19 pandemic in the United Kingdom and associated regulations on the operation of schools. The most frequent feelings and emotions were negative, mainly sadness. In turn, we identified relevant themes for HCWs, such as uncertainty or concern about the future; policies; and regulations for the prevention, management, and addressing both COVID-19 and post–COVID-19 condition in children and young people; vaccination; and the use of Twitter as a strategy to share scientific literature, management strategies, and clinical and personal experiences.

Concern from HCWs regarding the policies for addressing the COVID-19 pandemic in the children and young people in the United Kingdom (including vaccination and schools) was a recurring theme in our findings. Furthermore, concern regarding the side effects of the COVID-19 vaccine and how the vaccine might interact with preexisting physiological symptoms of post–COVID-19 condition in children and young people was a topic of discussion. Similarly, the constant change in policy making in the United Kingdom, as public health bodies and governments have tried to understand and adapt to the emergence of post–COVID-19 condition, have added to the strength of this ongoing debate [ 42 ]. The lack of up-to-date evidence on post–COVID-19 condition in children and young people prompted HCWs to rely on Twitter during the pandemic to communicate relevant information. Twitter has a broad audience reach; is used as a communication tool by politicians, health bodies, and other key influences; and facilitates real-time updates [ 43 ]. During the pandemic, HCWs, primarily those in frontline roles and local response coordination, have often been challenged to become credible spokespersons for pandemic information [ 44 ]. Such credibility directly influences public confidence and decision-making, ultimately determining the success or failure of a public health intervention [ 43 ].

Furthermore, failures in risk communication could explain the presence of uncertainty and negative feelings associated with school regulations. When people are upset, distressed, or fearful, they often do not trust the authority, decrease the perceived validity of the communication received, and find information processing difficult [ 45 ]. In this regard, Fotheringham et al [ 46 ] indicated that during 2020, school leaders in the United Kingdom faced pressures and challenges related to translating and enacting school policies, particularly with the perceived lack of agency shared by the government concerning being able to translate centrally issued guidelines. In turn, Tomson et al [ 47 ] reported that the pandemic has negatively impacted the well-being of leaders in all types of schools and across all demographic groups, affecting their ability to think clearly and solve work-related problems. Given that the protection and care of children and young people health during the COVID-19 pandemic ultimately rests with school leaders, the search for support strategies that focus on the needs of these groups becomes an urgent necessity.

Findings in Relation to Other Studies

Using Twitter’s information, this is one of the first studies to capture health professionals’ perceptions of prolonged COVID-19 in the children and young people in the United Kingdom. However, other studies have addressed post–COVID-19 condition on this social network. Callard and Peregov [ 48 ] reviewed how, through social platforms such as Twitter, patients made the persistence and heterogeneity of COVID-19 symptoms visible, thus catapulting the inclusion of post–COVID-19 condition as a relevant phenomenon in clinical and policy debates. In contrast, other authors in the last 2 years have explored on various platforms (including Twitter) the persistence of symptoms and emotional impact after months of suspected and confirmed diagnosis of COVID-19 [ 49 - 55 ], including the period of vaccination. Furthermore, others have explored web discussions regarding this phenomenon [ 56 ]. Several of these authors agree on a perceived lack of support and specific resources from governmental bodies, a lack of information or clarity in the instructions given, and the absence of formal mechanisms to allow the voices of patients and the community to be heard. The above point is critical as it highlights the gap between the needs of the population and the response provided by policy makers, which not only translates into a gap in access to health services but also limits citizen participation in decision-making on the issues that affect their own health and increases distrust toward regulations and instructions issued by the government.

Implications for Policy and Practice

Several policy recommendations and implications are targeted at various stakeholders to consider while implementing future policy guidelines to address post–COVID-19 health care delivery. First, policy makers should consider investing appropriate resources to collect data regarding post–COVID-19 condition in children and young people, specifically on the impact of COVID-19 on the mental health of children and young people. This implies working closely with researchers to streamline data collection and reporting on post–COVID-19 condition. Second, policy makers should consider providing a basic level of psychosocial support with access to quality mental health and psychosocial support services for HCWs, school staff, parents, and children and young people experiencing post–COVID-19 condition. This implies strengthening health systems, community-based programming, and mobilization. Policies must include documenting the impact of mental health and psychosocial support interventions and innovative approaches to be more widely disseminated and scaled up across different contexts and target population groups. Third, to address the criticism around frequent changes in school closure and opening policies, decision makers should develop clear, easy-to-understand school mitigation plans informed by the best available evidence. The plans should incorporate teachers, school workers, and parents to ensure all voices are included in the policy plan. Fourth, policy makers should adopt a shared decision-making approach incorporating HCWs in the decision-making process for managing the COVID-19 pandemic. Finally, government decision makers should set post–COVID-19 pandemic recovery policies informed from a health equity perspective and how this affects children and young people living with post–COVID-19 condition, factoring in childhood, family income, housing, domestic violence, access to health care, and racism.

In terms of the needed clearer road map for recommendations to support training strategies for HCWs and school staff regarding post–COVID-19 condition in children and young people, we have outlined the following 10 steps.

Step 1: Data Collection and Analysis

Our study underlines the critical need for comprehensive data on post–COVID-19 condition’s impact on the mental health of children and young people. As a first step, it is recommended that policy makers should allocate resources for the systematic collection and analysis of data on post–COVID-19 condition in children and young people, particularly focusing on mental health outcomes. These data should be used to identify the most prevalent symptoms and the most effective treatment strategies. In this context, it is recommended that experts emphasize the importance of early detection and medical consultation for mental health issues in children and young people diagnosed with post–COVID-19 condition, including mood changes, irritability, social withdrawal, memory problems, difficulty in concentrating, anxiety, depression, posttraumatic stress, school absenteeism, and suicidal ideation [ 57 , 58 ]. This entails working closely with researchers to streamline data collection and reporting on post–COVID-19 condition.

Step 2: Psychosocial Support Framework

It has been noted that globally, programs for managing post–COVID-19 condition in children and young people are heterogeneous, ranging from the use of physiotherapy, pediatric occupational therapy, and psychological support to interventions aimed at lifestyle modifications [ 59 ]. This diversity could impact differential outcomes in the treatment, recovery, and timely and effective rehabilitation of children and young people with post–COVID-19 condition. Upon analyzing the wider literature and the social media data in this study, it is recommended that a basic level of psychosocial support should be established. This would involve ensuring access to quality mental health services for HCWs, school staff, parents, and children and young people with post–COVID-19 condition. This framework should be integrated into the health system and community-based programming, emphasizing the mobilization of resources and strengthening of support networks. It is suggested that the psychosocial support framework should facilitate access to quality mental health services and support networks that are robust and responsive. Community engagement gleaned from further Twitter discourse analysis should be a helpful guide in the development of these services to ensure they meet the real and expressed needs of children and young people with post–COVID-19 condition. Practical examples of basic psychosocial support include using web support services; individual or group therapy sessions; school-based emotional support programs; and counseling sessions aimed at parents, family members, or school staff.

Step 3: Educational Mitigation Plans

The frequent policy changes around school closures highlight the necessity for stable and clear educational mitigation plans. It is recommended that these plans should be directly informed by the evidence collected and further analysis of sentiments and emotions surrounding post–COVID-19 condition in schools. Incorporating the viewpoints of teachers, parents, and school staff, as identified in our thematic analysis, will ensure that the mitigation strategies are comprehensive, feasible, and sensitive to the psychosocial impact on children and young people. School staff and policy makers should collaborate to develop clear, evidence-informed educational mitigation plans. These plans should be straightforward and involve teachers, school workers, and parents in their creation, ensuring a unified approach that considers the voices of all stakeholders.

Step 4: Shared Decision-Making in Health Care

In health care settings, the adoption of a shared decision-making model is crucial, enabling HCWs to actively contribute to the formulation of COVID-19 and post–COVID-19 policies. This inclusive approach ensures that frontline workers can provide valuable insights toward policy development. To facilitate this, the establishment of advisory committees composed of representatives from HCWs is recommended. This committee can convene regularly to deliberate on key decisions pertaining to the COVID-19 pandemic management, including prevention measures, resource distribution, and vaccination strategies. Such collaborative groups have demonstrated effectiveness in identifying priority needs within the context of a pandemic [ 60 ].

Step 5: Health Equity in Policy Setting

Post–COVID-19 recovery policies should be set with a health equity lens. This means considering factors such as family income, housing, domestic violence, access to health care, and racism and how these factors affect children and young people living with post–COVID-19 condition. Our findings emphasize the importance of framing post–COVID-19 recovery policies through a lens of health equity. The concerns raised by HCWs regarding the socioeconomic impacts, such as family income and access to health care, underline the need for policies that address not just the medical aspects of post–COVID-19 condition but also the social determinants of health. An equitable approach will ensure that children and young people from diverse backgrounds receive appropriate support.

Step 6: Documenting and Disseminating Interventions

It is vital to document the impact of mental health and psychosocial support interventions. In this context, it is crucial to implement innovative strategies to disseminate unbiased information about post–COVID-19 condition among health care professionals and educators working with children and young people, ensuring it reaches different contexts and populations. These strategies may include creating interactive multimedia resources, such as videos and mobile apps; organizing webinars; actively using social media; and forming web support groups. These groups will provide a space where patients, health care professionals, and educators can share their experiences and knowledge regarding post–COVID-19 condition. These actions will not only help reduce isolation and social stigma but also strengthen support for these groups considered vulnerable [ 61 ].

Step 7: Developing a Clear Communication Strategy

Policy makers must develop a clear communication strategy to address frequent policy changes and mitigate confusion. This strategy should be informed by the data collected and analysis conducted in Step 1. The data reveal a palpable sense of uncertainty and frustration due to frequent policy shifts, underscoring the need for a clear and consistent communication strategy. This strategy should be grounded in the evidence gathered from the health care community’s discourse and aim to minimize confusion by providing timely, transparent, and reliable information regarding post–COVID-19 policies and support services.

Step 8: Training and Support Strategies

On the basis of the findings of the comprehensive data analysis, specific training and support strategies should be developed for HCWs and school staff. These strategies should be focused on the practical aspects of identifying and managing post–COVID-19 condition in children and young people. For instance, training sessions could include practical workshops on recognizing post–COVID-19 symptoms in children and adolescents, conducting diagnostic assessments, and implementing appropriate treatment and support interventions.

Step 9: Continuous Feedback and Policy Adaptation

The continuous evolution of the post–COVID-19 phenomenon demands an iterative approach to policy making. On the basis of our study, we recommend establishing feedback mechanisms with HCWs and school staff to monitor the reception and effectiveness of implemented policies. This feedback, coupled with ongoing research, should inform policy adaptations to ensure they remain aligned with the evolving landscape of post–COVID-19 condition and its impact on children and young people.

Step 10: Evaluation and Research

Finally, there should be a commitment to ongoing evaluation and research. This will involve not only monitoring the implementation of the abovementioned steps but also supporting new research to fill any remaining gaps in understanding the long-term effects of COVID-19 on children and young people.

This sequence of steps is designed to be iterative and responsive, ensuring that the recommendations from the study are translated into concrete actions that adapt to emerging data and research findings.

Strengths and Limitations

A key strength of this study is that our social media analysis of post–COVID-19 condition contributes toward an emerging understanding of reported experiential, emotional, and practical dimensions of post–COVID-19 condition in children and young people specifically and questions of vaccine hesitancy in children and young people with post–COVID-19 condition. This is one of the few studies to collect HCWs’ perceptions regarding post–COVID-19 condition in children and young people in the United Kingdom using information from Twitter. We identify key areas that need considering attention and focus, such as the provision of psychosocial support with access to quality mental health resources to alleviate the impact of post–COVID-19 condition in children and young people and the development of clear post–COVID-19 pandemic recovery guidelines that are informed by health equity perspective, and how this affects children and young people living with post–COVID-19 condition.

One of the limitations this study acknowledges is the definition of post–COVID-19 condition in children and young people. When data were collected, the lack of consensus on the definition of post–COVID-19 condition in children and young people forced us to formulate a definition of post–COVID-19 condition in children and young people based on the available literature. Furthermore, this study is limited to the perceptions of people who used descriptors in their web biography attributable to HCWs; therefore, our results only represent some HCWs in the United Kingdom and those in other countries. In turn, this research collected data from Twitter only; therefore, further inquiry into HCWs’ perceptions of post–COVID-19 condition in children and young people required expanding to other data sources or social networks and including languages other than English. We acknowledge that demographic factors, geographic location, and individual daily activities of social media users can significantly influence language use and word choice, introducing potential biases in tweet-based data. Such biases are inherent in any analysis of social media content and can affect the generalizability of findings. For instance, our study relies on Twitter data, which do not encompass the full spectrum of global or the UK public opinion on post–COVID-19 condition in children and young people. While Twitter serves as a valuable platform for capturing real-time sentiments and experiences, it is not fully representative of all demographics and geographic regions. Our results may reflect the perspectives of more vocal or active social media users, which may not correspond to the silent majority or those without access to social media. In addition, the absence of geotagged information for many users limits our ability to conduct a more nuanced spatial analysis of the sentiments expressed.

Furthermore, our study is built upon the recognition that social media data may overrepresent certain demographic groups while underrepresenting others, such as the older population or those without reliable internet access. This skew can influence the apparent prevalence of certain views or experiences of post–COVID-19 condition. Moreover, individuals’ patterns of daily life, reflected in their social media use and content, contribute additional layers of complexity and potential bias to the discourse analyzed.

Consistent with scholarly precedents on the subject [ 62 , 63 ], our study acknowledges these biases as intrinsic limitations of social media–based research. Although our analysis did not control for these factors, we recognize their potential impact on our results. Future studies would benefit from incorporating a broader array of data sources, including interviews or focus groups, to provide a more representative and comprehensive understanding of post–COVID-19 condition in children and young people. This approach would complement our Twitter-based findings and help mitigate the biases inherent in social media data.

Conclusions

More than a year after the start of the COVID-19 pandemic, the perceptions described on Twitter by HCWs concerning the presence of post–COVID-19 condition in children and young people appear to be a relevant and timely issue as well as very responsive to the declarations and guidelines issued by the health authorities over time. The most prominent group within the discourse studied was the activist or lobbying organization @LongCovidKids, which shared the most tweets and images over the period studied. We recommend that future research focus on how web health activism is organized and carried out for children and young people with post–COVID-19 condition. Such a strategy would allow for a better understanding of the scope and impact of this phenomenon and how it can influence decision-making. Furthermore, we suggest different mitigation strategies, support, and training of HCWs and school staff regarding manifestations and treatment of post–COVID-19 condition in children and young people across all demographic areas.

Acknowledgments

The authors would like to thank the Rapid Research Evaluation and Assessment Lab, Department of Targeted Intervention, University College London, London, United Kingdom, whose support has been essential for developing this project.

Conflicts of Interest

None declared.

Filters used for the search strategy on Twitter.

Sentiment analysis framework: attitudes toward post–COVID-19 condition in children and young people.

Theme codebook: examples of tweets that fit into main themes tagged for mention of children and young people with post–COVID-19 condition.

Timeline of national governmental policies and guidelines regarding children and young people.

• World Health Organization. COVID-19 Public Health Emergency of International Concern (PHEIC) Global research and innovation forum. Global Research Collaboration for Infectious Disease Preparedness. Feb 12, 2020. URL: https:/​/www.​who.int/​publications/​m/​item/​covid-19-public-health-emergency-of-international-concern-(pheic)-global-research-and-inno vation-forum [accessed 2022-06-06]
• Johns Hopkins University of Medicine. COVID-19 Dashboard by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University (JHU). Coronavirus Resource Center. Jan 22, 2020. URL: https://coronavirus.jhu.edu/map.html [accessed 2023-06-09]
• Nature Editorial. Long COVID and kids: more research is urgently needed. Nature. Feb 08, 2022;602(7896):183. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Long COVID or post-COVID conditions. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/coronavirus/2019-ncov/long-term-effects/index.html [accessed 2023-06-09]
• Davis HE, McCorkell L, Vogel JM, Topol E. Long COVID: major findings, mechanisms and recommendations. Nat Rev Microbiol. Mar 13, 2023;21(3):133-146. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Zimmermann P, Curtis N. Why is COVID-19 less severe in children? A review of the proposed mechanisms underlying the age-related difference in severity of SARS-CoV-2 infections. Arch Dis Child. Dec 01, 2020;106(5):429-439. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Zheng YB, Zeng N, Yuan K, Tian SS, Yang YB, Gao N, et al. Prevalence and risk factor for long COVID in children and adolescents: a meta-analysis and systematic review. J Infect Public Health. Mar 07, 2023;16(5):660-672. [ FREE Full text ] [ CrossRef ] [ Medline ]
• World Health Organization. A clinical case definition for post COVID-19 condition in children and adolescents by expert consensus. World Health Organization. Feb 16, 2023. URL: https:/​/www.​who.int/​publications/​i/​item/​WHO-2019-nCoV-Post -COVID-19-condition-CA-Clinical-case-definition-2023-1 [accessed 2024-03-26]
• Stephenson T, Allin B, Nugawela MD, Rojas N, Dalrymple E, Pinto Pereira S, CLoCk Consortium, et al. Long COVID (post-COVID-19 condition) in children: a modified Delphi process. Arch Dis Child. Jun 17, 2022;107(7):674-680. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Esposito S, Principi N, Azzari C, Cardinale F, Di Mauro G, Galli L, et al. Italian intersociety consensus on management of long Covid in children. Ital J Pediatr. Mar 09, 2022;48(1):1-9. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Stephenson T, Pinto Pereira SM, Shafran R, de Stavola BL, Rojas N, McOwat K, CLoCk Consortium, et al. Physical and mental health 3 months after SARS-CoV-2 infection (long COVID) among adolescents in England (CLoCk): a national matched cohort study. Lancet Child Adolesc Health. Feb 08, 2022;6(4):230-239. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Stephenson T, Pinto Pereira SM, Nugawela MD, McOwat K, Simmons R, Chalder T, et al. CLoCk Consortium. Long COVID-six months of prospective follow-up of changes in symptom profiles of non-hospitalised children and young people after SARS-CoV-2 testing: a national matched cohort study (The CLoCk) study. PLoS One. Mar 6, 2023;18(3):e0277704. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Twitter users, stats, data and trends. Data Reportal. May 11, 2023. URL: https://datareportal.com/essential-twitter-stats#:~ :text=Based [accessed 2023-06-09]
• Rufai SR, Bunce C. World leaders' usage of Twitter in response to the COVID-19 pandemic: a content analysis. J Public Health (Oxf). Aug 18, 2020;42(3):510-516. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Haman M. The use of Twitter by state leaders and its impact on the public during the COVID-19 pandemic. Heliyon. Nov 2020;6(11):e05540. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Huang X, Li Z, Jiang Y, Li X, Porter D. Twitter reveals human mobility dynamics during the COVID-19 pandemic. PLoS One. Nov 10, 2020;15(11):e0241957. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Wicke P, Bolognesi MM. Framing COVID-19: how we conceptualize and discuss the pandemic on Twitter. PLoS One. Sep 30, 2020;15(9):e0240010. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Chang CH, Monselise M, Yang CC. What are people concerned about during the pandemic? detecting evolving topics about COVID-19 from Twitter. J Healthc Inform Res. Jan 17, 2021;5(1):70-97. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Xue J, Chen J, Hu R, Chen C, Zheng C, Su Y, et al. Twitter discussions and emotions about the COVID-19 pandemic: machine learning approach. J Med Internet Res. Nov 25, 2020;22(11):e20550. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Boon-Itt S, Skunkan Y. Public perception of the COVID-19 pandemic on Twitter: sentiment analysis and topic modeling study. JMIR Public Health Surveill. Nov 11, 2020;6(4):e21978. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Valdez D, Ten Thij M, Bathina K, Rutter LA, Bollen J. Social media insights into US mental health during the COVID-19 pandemic: longitudinal analysis of Twitter data. J Med Internet Res. Dec 14, 2020;22(12):e21418. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Rashid MA, Yip SW, Gill D, Arfeen Z. Sharing is caring: an analysis of #FOAMed Twitter posts during the COVID-19 pandemic. Postgrad Med J. Mar 14, 2022;98(1157):199-204. [ CrossRef ] [ Medline ]
• Ghosh P, Schwartz G, Narouze S. Twitter as a powerful tool for communication between pain physicians during COVID-19 pandemic. Reg Anesth Pain Med. Feb 21, 2021;46(2):187-188. [ CrossRef ] [ Medline ]
• Burgos LM, Gil Ramirez A, Utengen A, Thamman R. Use of Twitter during COVID-19 pandemic: an opportunity for continuing medical education in cardiology. Medicina (B Aires). 2020;80 Suppl 6:122-123. [ FREE Full text ] [ Medline ]
• Margus C, Brown N, Hertelendy AJ, Safferman MR, Hart A, Ciottone GR. Emergency physician Twitter use in the COVID-19 pandemic as a potential predictor of impending surge: retrospective observational study. J Med Internet Res. Jul 14, 2021;23(7):e28615. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Pulsar TRAC- Audience intelligence platform and social listening tool. Pulsar. URL: https://www.pulsarplatform.com/solutions/pulsar-trac/ [accessed 2022-03-01]
• Vera San Juan N, Aceituno D, Djellouli N, Sumray K, Regenold N, Syversen A, et al. Mental health and well-being of healthcare workers during the COVID-19 pandemic in the UK: contrasting guidelines with experiences in practice. BJPsych Open. Dec 10, 2020;7(1):e15. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Paranyushkin D. InfraNodus: generating insight using text network analysis. In: Proceedings of the World Wide Web Conference. 2019. Presented at: WWW '19; May 13-17, 2019; San Francisco, CA. [ CrossRef ]
• Creswell JW, Poth CN. Qualitative Inquiry and Research Design: Choosing Among Five Approaches 4th Edition. Thousand Oaks, CA. SAGE Publications, Inc; 2017.
• Eysenbach G, Till JE. Ethical issues in qualitative research on internet communities. BMJ. Nov 10, 2001;323(7321):1103-1105. [ FREE Full text ] [ CrossRef ] [ Medline ]
• UCL research ethics. University College London. URL: https://www.ucl.ac.uk/research-ethics/do-i-need-ethical-approval# When [accessed 2023-06-12]
• Martin S, Kilich E, Dada S, Kummervold PE, Denny C, Paterson P, et al. "Vaccines for pregnant women…?! Absurd" - Mapping maternal vaccination discourse and stance on social media over six months. Vaccine. Sep 29, 2020;38(42):6627-6637. [ CrossRef ] [ Medline ]
• Kummervold PE, Martin S, Dada S, Kilich E, Denny C, Paterson P, et al. Categorizing vaccine confidence with a transformer-based machine learning model: analysis of nuances of vaccine sentiment in Twitter discourse. JMIR Med Inform. Oct 08, 2021;9(10):e29584. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Ahmed W, Bath PA, Demartini G. Using Twitter as a data source: an overview of ethical, legal, and methodological challenges. In: Woodfield K, editor. The Ethics of Online Research. Bingley, UK. Emerald Publishing Limited; Dec 12, 2017.
• Ayers JW, Caputi TL, Nebeker C, Dredze M. Don't quote me: reverse identification of research participants in social media studies. NPJ Digit Med. Aug 2, 2018;1(1):30. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Varkey B. Principles of clinical ethics and their application to practice. Med Princ Pract. Jun 4, 2021;30(1):17-28. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Long Covid Kids homepage. Long Covid Kids. URL: https://es.longcovidkids.org/ [accessed 2023-06-12]
• The Guardian homepage. The Guardian. URL: https://www.theguardian.com/uk [accessed 2023-06-12]
• Welcome to the BBC. BBC. URL: https://www.bbc.com/ [accessed 2023-06-12]
• People with health. PeopleWith. URL: https://peoplewith.com/ [accessed 2023-06-12]
• Welcome to NCBI. National Institutes of Health National Library of Medicine. URL: https://www.ncbi.nlm.nih.gov/ [accessed 2023-06-12]
• Edobor M. Trust and public discourse during the Covid‐19 pandemic. IPPR Progress Rev. Feb 15, 2021;27(4):354-360. [ CrossRef ]
• Nielsen RK, Fletcher R, Kalogeropoulos A, Simon F. Communications in the coronavirus crisis: lessons for the second wave. Reuters Institute for the Study of Journalism. Oct 27, 2020. URL: https://reutersinstitute.politics.ox.ac.uk/communications-coronavirus-crisis-lessons-second-wave [accessed 2024-03-26]
• Zohar T, Negev M, Sirkin M, Levine H. Trust in COVID-19 policy among public health professionals in Israel during the first wave of the pandemic: a cross-sectional study. Isr J Health Policy Res. Apr 11, 2022;11(1):20. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Enria L, Waterlow N, Rogers NT, Brindle H, Lal S, Eggo RM, et al. Trust and transparency in times of crisis: results from an online survey during the first wave (April 2020) of the COVID-19 epidemic in the UK. PLoS One. Feb 16, 2021;16(2):e0239247. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Fotheringham P, Harriott T, Healy G, Arenge G, Wilson E. Pressures and influences on school leaders navigating policy development during the COVID‐19 pandemic. Brit Educ Res J. Jul 30, 2021;48(2):201-227. [ CrossRef ]
• Thomson P, Greany T, Martindale N. The trust deficit in England: emerging research evidence about school leaders and the pandemic. J Educ Admin History. Sep 13, 2021;53(3-4):296-300. [ CrossRef ]
• Callard F, Perego E. How and why patients made long COVID. Soc Sci Med. Jan 2021;268:113426. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Davis HE, Assaf GS, McCorkell L, Wei H, Low RJ, Re'em Y, et al. Characterizing long COVID in an international cohort: 7 months of symptoms and their impact. EClinicalMedicine. Aug 2021;38:101019. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Miyake E, Martin S. Long Covid: online patient narratives, public health communication and vaccine hesitancy. Digit Health. Nov 29, 2021;7:20552076211059649. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Matharaarachchi S, Domaratzki M, Katz A, Muthukumarana S. Discovering long COVID symptom patterns: association rule mining and sentiment analysis in social media tweets. JMIR Form Res. Sep 07, 2022;6(9):e37984. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Bhattacharyya A, Seth A, Rai S. The effects of long COVID-19, its severity, and the need for immediate attention: analysis of clinical trials and Twitter data. Front Big Data. Dec 15, 2022;5:1051386. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Samannodi M, Alwafi H, Naser AY, Al Qurashi AA, Qedair JT, Salawati E, et al. Determinants of post-COVID-19 conditions among SARS-CoV-2-infected patients in Saudi Arabia: a web-based cross-sectional study. Diseases. Aug 23, 2022;10(3):55. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Santarossa S, Rapp A, Sardinas S, Hussein J, Ramirez A, Cassidy-Bushrow AE, et al. Understanding the #longCOVID and #longhaulers conversation on Twitter: multimethod study. JMIR Infodemiology. 2022;2(1):e31259. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Déguilhem A, Malaab J, Talmatkadi M, Renner S, Foulquié P, Fagherazzi G, et al. Identifying profiles and symptoms of patients with long COVID in France: data mining infodemiology study based on social media. JMIR Infodemiology. Nov 22, 2022;2(2):e39849. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Awoyemi T, Ebili U, Olusanya A, Ogunniyi KE, Adejumo AV. Twitter sentiment analysis of long COVID syndrome. Cureus. Jun 2022;14(6):e25901. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Malone LA, Morrow A, Chen Y, Curtis D, de Ferranti SD, Desai M, et al. Multi-disciplinary collaborative consensus guidance statement on the assessment and treatment of postacute sequelae of SARS-CoV-2 infection (PASC) in children and adolescents. PM R. Oct 2022;14(10):1241-1269. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Shachar-Lavie I, Shorer M, Segal H, Fennig S, Ashkenazi-Hoffnung L. Mental health among children with long COVID during the COVID-19 pandemic. Eur J Pediatr. Apr 14, 2023;182(4):1793-1801. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Brackel CL, Noij LC, Vijverberg SJ, Legghe CL, Maitland-van der Zee AH, van Goudoever JB, et al. International care programs for pediatric post-COVID condition (long COVID) and the way forward. Pediatr Res. Jan 29, 2024. (forthcoming). [ CrossRef ] [ Medline ]
• Ripp J, Peccoralo L, Charney D. Attending to the emotional well-being of the health care workforce in a New York City health system during the COVID-19 pandemic. Acad Med. Aug 2020;95(8):1136-1139. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Buonsenso D, Camporesi A, Morello R, De Rose C, Fracasso M, Chieffo DP, et al. Social stigma in children with long COVID. Children (Basel). Sep 07, 2023;10(9):1518. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Mitchell L, Frank MR, Harris KD, Dodds PS, Danforth CM. The geography of happiness: connecting twitter sentiment and expression, demographics, and objective characteristics of place. PLoS One. May 29, 2013;8(5):e64417. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Padilla JJ, Kavak H, Lynch CJ, Gore RJ, Diallo SY. Temporal and spatiotemporal investigation of tourist attraction visit sentiment on Twitter. PLoS One. Jun 14, 2018;13(6):e0198857. [ FREE Full text ] [ CrossRef ] [ Medline ]

Abbreviations

Edited by A Mavragani; submitted 20.06.23; peer-reviewed by R Gore, A Wahbeh; comments to author 02.11.23; revised version received 14.02.24; accepted 08.03.24; published 17.04.24.

©Macarena Chepo, Sam Martin, Noémie Déom, Ahmad Firas Khalid, Cecilia Vindrola-Padros. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 17.04.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.

Neolithic women in Europe were tied up and buried alive in ritual sacrifices, study suggests

The research found evidence of the "incaprettamento" method of murder at 14 Neolithic sites in Europe.

The murder of sacrificial victims by "incaprettamento" — tying their neck to their legs bent behind their back, so that they effectively strangled themselves — seems to have been a tradition across much of Neolithic Europe, with a new study identifying more than a dozen such murders over more than 2,000 years.

The study comes after a reassessment of an ancient tomb that was discovered more than 20 years ago at Saint-Paul-Trois-Châteaux near Avignon, in southern France. The tomb mimics a silo, or pit where grain was stored, and it held the remains of three women who were buried there about 5,500 years ago.

The new study, published Wednesday (April 10) in the journal Science Advances , reinterprets the positions of two of the skeletons and suggests the individuals were deliberately killed — first by tying them up in the manner called "incaprettamento" and then by burying them while they were still alive, perhaps for an agricultural ritual.

Study senior author Eric Crubézy , a biological anthropologist at Paul Sabatier University in Toulouse, France, told Live Science that there was a lot of agricultural symbolism to the tomb. He noted that a wooden structure built over it was aligned with the sun at the solstices and that several broken stones for grinding grain were found nearby. "You have the alignment, you have the silo, you have the broken stones — so it seems that it was a rite related to agriculture."

Related: Skull of Neolithic 'bog body' from Denmark was smashed by 8 heavy blows in violent murder

To investigate the idea of human sacrifice at Saint-Paul-Trois-Châteaux, Crubézy, who worked on the initial discovery of the tomb, and colleagues examined earlier archaeological studies of tomb sites throughout Europe. The team included forensic pathologist Bertrand Ludes , of Paris Cité University and the study's lead author.

They found evidence of 20 probable cases of sacrificial murders using incaprettamento at 14 Neolithic (New Stone Age) sites dating to between 5400 and 3500 B.C. They also found papers describing Mesolithic (Middle Stone Age) rock art in the Addaura Cave in Sicily, made between 14000 and 11000 B.C., that seems to depict two human figures bound in the incaprettamento manner.

Sign up for the Live Science daily newsletter now

Get the world’s most fascinating discoveries delivered straight to your inbox.

Crubézy said it appears incaprettamento originated as a sacrificial custom in the Mesolithic period, before agriculture, and later came to be used for human sacrifices associated with agriculture in the Neolithic period.

As a method of human sacrifice, incaprettamento seems to have been widespread across much of Neolithic Europe, with evidence of the practice at sites ranging from the Czech Republic to Spain. The earliest is a tomb near Brno-Bohunice in the Czech Republic that is dated to about 5400 B.C., and the latest is the tomb at Saint-Paul-Trois-Châteaux, suggesting that the practice persisted for more than 2,000 years, Crubézy said.

Gruesome murders

The bindings used to tie the two individuals at Saint-Paul-Trois-Châteaux have long since decayed, but a few features of their skeletons — such as the unusual positions of their legs — suggest how they died, Crubézy said.

The third woman in the tomb seems to have been older and likely died from natural causes, the researchers found. She was also interred normally for the time, on her side in the center of the tomb. This suggests that she had been ceremonially buried after her natural death and that the two younger women had been sacrificed to be buried with her, he said.

— 15 people were brutally murdered 5,000 years ago, but the bodies were buried with care

— 2 waves of mass murder struck prehistoric Denmark, genetic study reveals

— Why were dozens of people butchered 6,200 years ago and buried in a Neolithic death pit?

The two sacrificial victims seem to have been pinned down with heavy fragments of stones used for grinding grain, indicating that, despite their bindings, they were still alive when they were buried, he said.

Today, the gruesome incaprettamento murder method is associated with the Italian Mafia , who have sometimes used it as a form of warning or reprimand.

Crubézy said it wasn't known why incaprettamento was used for Stone Age human sacrifices, but it might have been because a person bound in this way could be seen as strangling themselves, rather than being killed by someone else.

Tom Metcalfe is a freelance journalist and regular Live Science contributor who is based in London in the United Kingdom. Tom writes mainly about science, space, archaeology, the Earth and the oceans. He has also written for the BBC, NBC News, National Geographic, Scientific American, Air & Space, and many others.

32 astonishing ancient burials, from 'vampire' decapitations to riches for the afterlife

Drowned land off Australia was an Aboriginal hotspot in last ice age, 4,000 stone artifacts reveal

AI pinpoints where psychosis originates in the brain

• DAR "Crubézy said it wasn't known why incaprettamento was used for Stone Age human sacrifices, but it might have been because a person bound in this way could be seen as strangling themselves, rather than being killed by someone else." This would make no sense because a person obviously could not bind THEMSELVES in this manner! Reply
• Lemmy Caution The article rather confusingly presents us with two widely separate years in which the burial of the two sacrificial victims is thought to have taken place. First we are told these burials are estimated to have occurred around the year 5,400 BCE. Further along in the narrative, on the other hand, we are informed these sacrificial burials took place approximately 5,500 years ago. The obvious problem with this divergent chronology is that there is a substantial difference, which is to say all of 1900 years, between 5,500 years ago and the earlier noted figure of 5,400 BCE, which amounts to fully 7400 years ago. Reply
• View All 2 Comments

Most Popular

• 2 Infamous boat-sinking orcas spotted hundreds of miles from where they should be, baffling scientist
• 3 Pluto's huge white 'heart' has a surprisingly violent origin, new study suggests
• 4 Most massive stellar black hole in the Milky Way discovered 'extremely close' to Earth
• 5 2,000-foot-wide 'potentially hazardous' asteroid has just made its closest approach to Earth — and you can see it with a telescope
• 2 Tired of your laptop battery degrading? New 'pulse current' charging process could double its lifespan.
• 3 Infamous boat-sinking orcas spotted hundreds of miles from where they should be, baffling scientist