Assessing Formatting Accuracy of APA Style References: A Scoping Review

Abstract

Objective – The objective of this scoping review is to synthesize the existing literature on the accuracy of formatting American Psychological Association (APA) Style references, with a focus on how accuracy has been defined and measured across studies. Specifically, the review aims to identify commonly reported formatting errors, evaluate the transparency and reproducibility of research methods, and assess whether standard assessment tools have been proposed or developed. Additionally, the review gathers the discipline and geographic location of study authors and examined how issues of diversity, equity, and inclusion (DEI) are addressed in this body of research.

Methods – The review followed the JBI methodology for scoping reviews, with a registered protocol on the Open Science Framework. A comprehensive search strategy was executed in the following academic databases: Academic Search Complete, Business Source Complete, CINAHL Plus with Full-Text, Education Source Complete, LISTA, ProQuest Platform Search, and the Web of Science Core Collection. This was supplemented with Google and Google Scholar searches. Initial searches were conducted in May 2023 and updated in November 2024. Eligibility criteria included English-language studies that assessed APA Style formatting accuracy in reference list entries. Two independent reviewers conducted all phases of screening and data extraction, with discrepancies resolved through consensus or third-party adjudication. Citation searching was also employed, yielding additional studies. Data extracted included publication details, source types, accuracy measures, and identified biases.

Results – Out of the included 32 studies, most were authored by researchers in Library Science and published in North America between 2006 and 2024. APA Manual editions from the 3rd to the 7th were represented. Reference sources most often came from student papers (41%), followed by article reference lists and databases. The most frequently analyzed source types were journal articles and books. Fourteen studies evaluated automated tools that create references, including tools embedded in databases, citation managers, and AI tools such as ChatGPT. Seventeen types of errors were pre-identified and nine additional error types were noted from the included studies. However, error classification terminology varied widely across studies, limiting comparability. While some studies used comprehensive checklists to assess accuracy, only a few tools were accessible, and no standardized, widely accepted assessment method emerged. Formatting accuracy was quantified using 64 different types of metrics, with inconsistent use of normalized measures. Only one study explicitly addressed a DEI-related issue—mis-formatting of names from non-Western cultures—highlighting an underexplored area of concern. Citation searching was notably effective in identifying studies not indexed in major databases.

Conclusion – This review reveals a fragmented research landscape regarding how formatting accuracy of APA references is measured and described. There is no consensus on assessment methodology, terminology, or reporting metrics, making it difficult to benchmark or compare results across studies. The findings underscore the need for standardized, source-specific tools to assess formatting accuracy and call attention to the role of librarians and educators in addressing this gap. Additionally, more attention must be paid to equity considerations, particularly related to name formatting conventions. Consistent terminology, inclusive practices, and evidence based tools are essential for advancing citation literacy and supporting academic integrity.