Research Methods in Psychology

The Scientific Method in Psychology

Psychology is a science because it uses empirical methods to investigate questions about behaviour And mental processes. The scientific method in psychology involves a systematic cycle of Observation, theory development, hypothesis formulation, data collection, analysis, and theory Revision.

Key characteristics of the scientific approach:

• Empiricism: Knowledge is derived from systematic observation and measurement, not from intuition, authority, or tradition.
• Objectivity: Researchers strive to minimise the influence of personal biases and expectations on the collection and interpretation of data.
• Replicability: Findings must be replicable by other researchers using the same methods. Replication is the primary mechanism for establishing the reliability of findings.
• Falsifiability: Scientific theories must generate testable predictions that could, in principle, be disproven by empirical evidence (Popper, 1959).
• Parsimony: When multiple explanations account for the same data, the simplest explanation is preferred (Occam”s razor).

The Research Cycle

1. Observation: A phenomenon of interest is identified through clinical observation, prior research, or theoretical prediction.
2. Theory: A theory is developed to explain the phenomenon. A theory is a systematic set of principles that organises and explains observations.
3. Hypothesis: A testable prediction is derived from the theory. A hypothesis must be specific, measurable, and falsifiable.
4. Data collection: An appropriate research design is selected, and data are collected in a controlled and systematic manner.
5. Analysis: Data are analysed using appropriate statistical techniques.
6. Conclusion: The results are interpreted in relation to the original hypothesis and theory.
7. Peer review and replication: Findings are subjected to peer review and independent replication.

Research Designs

Experimental Designs

Experiments are research designs in which the researcher manipulates one variable (the independent Variable) while measuring its effect on another variable (the dependent variable), while controlling For the influence of extraneous variables. Experiments are the only research design that can Establish cause-and-effect relationships.

True experiment vs. Quasi-experiment: A true experiment requires random assignment of Participants to conditions. Random assignment ensures that, on average, the groups are equivalent on All variables except the independent variable. Quasi-experiments lack random assignment and Therefore cannot establish causation with the same confidence.

Non-Experimental Designs

Variables

• Independent variable (IV): The variable that is manipulated by the researcher. In a study of the effect of music on recall, the type of music (classical vs. No music) is the IV.
• Dependent variable (DV): The variable that is measured by the researcher. In the same study, the number of words recalled is the DV.
• Confounding variable: A variable that varies systematically with the IV and may provide an alternative explanation for the observed effect on the DV. For example, if participants in the “classical music” condition are tested in the morning and participants in the “no music” condition are tested in the afternoon, time of day is a confounding variable.
• Extraneous variable: Any variable other than the IV that could potentially affect the DV. Confounding variables are a subset of extraneous variables. Extraneous variables that are not confounding can be controlled through randomisation, counterbalancing, or standardisation.
• Controlled variable: A variable that is held constant across all conditions to prevent it from influencing the DV.

Operationalisation

Operationalisation is the process of defining a variable in terms of the specific procedures used to Measure or manipulate it. A good operational definition is precise, measurable, and replicable. For Example, “aggression” could be operationalised as “the number of aggressive acts observed in a 10-minute play session,” or as “scores on the Buss-Perry Aggression Questionnaire.” Different Operationalisations may capture different aspects of the same construct, which can affect the Results and their interpretation.

Sampling Methods

Sample Size

Larger samples generally produce more reliable and generalisable results. The required sample size Depends on the expected effect size, the desired statistical power, and the variability of the data. In psychology, a typical experimental study has a sample size of 20—50 participants per condition, Although this varies widely.

Reliability

Reliability refers to the consistency of a measure. A reliable measure produces the same results When applied repeatedly under the same conditions.

Types of Reliability

• Test-retest reliability: The consistency of a measure over time. Participants complete the same measure on two occasions, and the correlation between the two sets of scores is calculated. High test-retest reliability indicates that the measure is stable over time.
• Inter-rater reliability: The degree of agreement between two or more independent raters or observers. Inter-rater reliability is assessed using Cohen’s kappa (for categorical data) or the intraclass correlation coefficient (for continuous data). High inter-rater reliability indicates that the measure is objective and not dependent on the individual rater.
• Internal consistency: The degree to which all items on a measure assess the same construct. Internal consistency is assessed using Cronbach’s alpha, which ranges from 0 to 1. A Cronbach’s alpha of 0.70 or above is generally considered acceptable.

Improving Reliability

• Standardise procedures (use the same instructions, materials, and setting for all participants)
• Train raters and use clear coding schemes
• Use larger samples
• Use established, validated measures rather than ad hoc measures
• Pilot test materials and procedures before conducting the main study

Validity

Validity refers to the extent to which a measure or study accurately assesses or investigates what It claims to assess or investigate.

Internal Validity

Internal validity refers to the extent to which the observed effect on the DV can be attributed to The IV, rather than to confounding variables. Threats to internal validity include:

• Participant variables: Individual differences between participants (e.g., age, intelligence, mood) that may affect the DV. Controlled through random assignment, matching, or within-subjects designs.
• Experimenter bias: The experimenter’s expectations influence the results, either through subtle cues given to participants (experimenter expectancy effect) or through biased data recording. Controlled through double-blind procedures.
• Demand characteristics: Participants alter their behaviour to conform to what they believe the experimenter expects. Controlled through deception, single-blind procedures, and filler tasks.
• Order effects: In within-subjects designs, the order in which conditions are presented affects performance (practice effects, fatigue effects, carryover effects). Controlled through counterbalancing (e.g., ABBA design, Latin square).

External Validity

External validity refers to the extent to which the findings of a study can be generalised beyond The specific conditions of the study.

• Ecological validity: The extent to which the findings can be generalised to real-world settings. Laboratory experiments have lower ecological validity than field experiments or naturalistic observations.
• Population validity: The extent to which the findings can be generalised to the broader population from which the sample was drawn. This depends on the representativeness of the sample.

Other Types of Validity

Ethical Considerations

Ethical principles in psychological research are designed to protect the rights, dignity, and Welfare of research participants. The following guidelines are based on the codes of ethics Published by major psychological associations (APA, BPS) and are directly relevant to the IB Psychology Internal Assessment.

Key Ethical Principles

• Informed consent: Participants must be fully informed about the nature, purpose, and procedures of the research, including any potential risks, before they agree to participate. Consent must be voluntary and given without coercion. Where deception is necessary, participants must give general consent and be fully debriefed afterwards.
• Deception: Deception should be used only when there is no feasible alternative, when the scientific value of the research justifies the use of deception, and when the deception does not cause harm. Participants must be debriefed as soon as possible after the study.
• Debriefing: After participation, participants must be provided with a full explanation of the study’s purpose, the nature of any deception used, and the opportunity to ask questions. If participants were deceived, they must be told the true purpose of the study and the reasons for the deception.
• Right to withdraw: Participants must be informed that they have the right to withdraw from the study at any time, without penalty, and without having to provide a reason.
• Confidentiality: All data collected from participants must be kept confidential. Participants’ identities must be protected through anonymisation or the use of codes. Data must be stored securely and accessible only to authorised researchers.
• Protection from harm: Participants must not be exposed to physical or psychological harm that exceeds that encountered in everyday life. If harm is possible, the researcher must take all reasonable steps to minimise it and must justify the risk in terms of the potential benefits of the research.
• Deception vs. Concealment: Concealment involves withholding information (e.g., not telling participants the true hypothesis), while deception involves actively misleading participants (e.g., using confederates). Both require careful ethical justification.

Animal Research

Research involving non-human animals is subject to additional ethical guidelines:

• The “3Rs” framework (Replacement, Reduction, Refinement) must be applied: researchers should seek alternatives to animal use, use the minimum number of animals necessary, and minimise suffering.
• The potential benefits of the research must outweigh the costs to the animals.
• Animals must be housed and cared for in accordance with established welfare standards.
• Procedures that cause pain or distress must be justified and minimised.

Institutional Review

All psychological research must be reviewed and approved by an institutional ethics committee (or Institutional review board, IRB) before it is conducted. The ethics committee evaluates the study’s Risk-benefit ratio, the adequacy of informed consent procedures, and the plans for data protection And debriefing.

Quantitative Data Analysis

Descriptive Statistics

Descriptive statistics summarise and describe the main features of a dataset.

Measures of central tendency:

Measures of dispersion:

Inferential Statistics

Inferential statistics allow researchers to draw conclusions about a population based on data Collected from a sample. They are used to test hypotheses and determine whether observed effects are Statistically significant (i.e., unlikely to have occurred by chance alone).

Significance levels and p-values:

• The significance level (alpha) is the threshold below which a result is considered statistically significant. In psychology, the conventional significance level is $\mathrm{p} \lt 0.05$Meaning there is less than a 5% probability that the observed result occurred by chance alone.
• The p-value is the probability of obtaining the observed result (or a more extreme result) if the null hypothesis is true. If $\mathrm{p} \lt \alpha$The null hypothesis is rejected and the result is considered statistically significant.

Type I and Type II errors:

The probability of a Type I error is equal to the significance level (alpha). The probability of a Type II error is denoted beta ($\beta$). The statistical power of a test is the probability of Correctly rejecting a false null hypothesis (power $= 1 - \beta$). Power is influenced by sample Size, effect size, and significance level.

Choosing the Right Statistical Test

The choice of statistical test depends on three factors:

1. The research design: Are you comparing groups or looking for a relationship between variables? Is the design independent measures (between-subjects) or repeated measures (within-subjects)?
2. The level of measurement: Are the data nominal (categories), ordinal (ranks), or interval/ratio (continuous)?
3. Whether the data meet the assumptions of parametric tests: Parametric tests assume that the data are normally distributed and have approximately equal variances. If these assumptions are not met, non-parametric alternatives should be used.

Interpreting the correlation coefficient (r):

• $r = 1$: Perfect positive correlation
• $r = -1$: Perfect negative correlation
• $r = 0$: No correlation
• $r \approx 0.1\mathrm{--}0.3$: Weak correlation
• $r \approx 0.3\mathrm{--}0.7$: Moderate correlation
• $r \approx 0.7\mathrm{--}1.0$: Strong correlation

Cohen’s d (effect size): Cohen’s d measures the standardised difference between two means, Providing an indication of the practical significance of the result (as opposed to statistical Significance).

• $d \approx 0.2$: Small effect
• $d \approx 0.5$: Medium effect
• $d \approx 0.8$: Large effect

Descriptive vs. Inferential Statistics

Descriptive statistics summarise the data that have been collected. Inferential statistics allow the Researcher to generalise from the sample to the population. Both are essential: descriptive Statistics provide an overview of the data, while inferential statistics allow the researcher to Test hypotheses and draw conclusions.

Reporting Conventions (APA Format)

Psychological research is reported according to the guidelines of the American Psychological Association (APA). Key conventions include:

• Statistical notation: Test statistic, degrees of freedom, p-value. For example: t(28) = 2.45$$\mathrm{p} \lt 0.05$$r = 0.62.
• Mean and standard deviation: Reported as M = 23.4$$SD = 4.2.
• Confidence intervals: Reported alongside point estimates, e.g., $95\%$ CI $[18.2, 28.6]$.
• Decimal places: Means and standard deviations are reported to one decimal place for most measures; test statistics and p-values are reported to two or three decimal places.
• Rounding: P-values are reported as exact values (e.g., $p = 0.032$) unless $p \lt 0.001$In which case they are reported as $p \lt 0.001$.

Cross-Topic Links

• Research methods and the biological LOA: Experimental designs (laboratory experiments, quasi-experiments) and brain imaging techniques are discussed in the Biological Level of Analysis.
• Research methods and the cognitive LOA: Experimental paradigms used in memory research (e.g., Loftus and Palmer’s leading questions, Craik and Tulving’s levels of processing) are examples of the application of research methods discussed here.
• Research methods and the sociocultural LOA: The ethical issues arising from Asch’s and Milgram’s studies are directly relevant to the discussion of ethics in this section.
• Research methods and abnormal psychology: Issues of reliability and validity in psychiatric diagnosis are discussed in Abnormal Psychology.
• Qualitative research: The qualitative methods covered in Qualitative Research (HL) complement the quantitative methods discussed here.

Common Pitfalls

1. Confusing correlation and causation in psychological research evidence.

2. Presenting theories without the supporting empirical evidence that led to their acceptance.

3. Describing a study without evaluating its methodology (e.g., sample, controls, ecological validity).

4. Failing to discuss ethical issues (informed consent, deception, debriefing, right to withdraw) when evaluating studies.

Summary

The key principles covered in this topic are linked in the sub-pages above. Focus on understanding the definitions, applying the formulas or frameworks, and evaluating strengths and limitations of each approach.

Worked Examples

Worked examples demonstrating the application of key concepts are covered in the detailed sub-pages linked above.