Ah, the research paper

Such exhilaration! Such consternation! Educators are fond of research papers because they require you to find your own sources, confront conflicting evidence, and synthesize diverse information and ideas—all skills required in any professional leadership role. Research papers also allow students to pursue their own topic of interest; your professors have to assume that you are genuinely interested in at least some major part of the course.^[1] The open-endedness of research papers sets you up to do your best work as a self-motivated scholar.

This chapter is about secondary sources: what they are, where to find them, and how to choose them.^[2] Recall the distinction between primary and secondary sources. Primary sources are original documents, data, or images: the law code of the Le Dynasty in Vietnam, the letters of Kurt Vonnegut, data gathered from an experiment on color perception, an interview, or Farm Service Administration photographs from the 1930s.^[3] Secondary sources are produced by analyzing primary sources. They include news articles, scholarly articles, reviews of films or art exhibitions, documentary films, and other pieces that have some descriptive or analytical purpose. Some things may be primary sources in one context but secondary sources in another. For example, if you’re using news articles to inform an analysis of a historical event, they’re serving as secondary sources. If you’re counting the number of times a particular newspaper reported on different types of events, then the news articles are serving as primary sources because they’re more akin to raw data.

Some sources are better than others

You probably know by now that if you cite Wikipedia as an authoritative source, the wrath of your professor shall be visited upon you. Why is it that even the most informative Wikipedia articles are still often considered illegitimate? And what are good sources to use? The table below summarizes types of secondary sources in four tiers. All sources have their legitimate uses, but the top-tier ones are preferable for citation.

Tier	Type	Content	Uses	How to find them
1	Peer-reviewed academic publications	Rigorous research and analysis	Provide strong evidence for claims and references to other high-quality sources	Google Scholar, library catalogs, and academic article databases
2	Reports, articles, and books from credible non-academic sources	Well researched and even-handed descriptions of an event or state of the world	Initial research on events or trends not yet analyzed in the academic literature; may reference important Tier 1 sources	Websites of relevant agencies, Google searches using (site: *.gov or site: *.org), academic article databases
3	Short pieces from newspapers or credible websites	Simple reporting of events, research findings, or policy changes	Often point to useful Tier 2 or Tier 1 sources, may provide a factoid or two not found anywhere else	Strategic Google searches or article databases including newspapers and magazines
4	Agenda-driven or uncertain pieces	Mostly opinion, varying in thoughtfulness and credibility	May represent a particular position within a debate; more often provide keywords and clues about higher quality sources	Non-specific Google searches

Tier 1: Peer-reviewed academic publications

These are sources from the mainstream academic literature: books and scholarly articles. Academic books generally fall into three categories: (1) textbooks written with students in mind, (2) monographs which give an extended report on a large research project, and (3) edited volumes in which each chapter is authored by different people. Scholarly articles appear in academic journals, which are published multiple times a year in order to share the latest research findings with scholars in the field. They’re usually sponsored by some academic society. To get published, these articles and books had to earn favorable anonymous evaluations by qualified scholars. Who are the experts writing, reviewing, and editing these scholarly publications? Your professors. I describe this process below. Learning how to read and use these sources is a fundamental part of being a college student.

Tier 2: Reports, articles and books from credible non-academic sources

Some events and trends are too recent to appear in Tier 1 sources. Also, Tier 1 sources tend to be highly specific, and sometimes you need a more general perspective on a topic. Thus, Tier 2 sources can provide quality information that is more accessible to non-academics. There are three main categories. First, official reports from government agencies or major international institutions like the World Bank or the United Nations; these institutions generally have research departments staffed with qualified experts who seek to provide rigorous, even-handed information to decision-makers. Second, feature articles from major newspapers and magazines like the New York Times, Wall Street Journal, London Times, or The Economist are based on original reporting by experienced journalists (not press releases) and are typically 1500+ words in length. Third, there are some great books from non-academic presses that cite their sources; they’re often written by journalists. All three of these sources are generally well researched descriptions of an event or state of the world, undertaken by credentialed experts who generally seek to be even-handed. It is still up to you to judge their credibility. Your instructors and campus librarians can advise you on which sources in this category have the most credibility.

Tier 3. Short pieces from periodicals or credible websites

A step below the well-developed reports and feature articles that make up Tier 2 are the short tidbits that one finds in newspapers and magazines or credible websites. How short is a short news article? Usually, they’re just a couple paragraphs or less, and they’re often reporting on just one thing: an event, an interesting research finding, or a policy change. They don’t take extensive research and analysis to write, and many just summarize a press release written and distributed by an organization or business. They may describe things like corporate mergers, newly discovered diet-health links, or important school-funding legislation. You may want to cite Tier 3 sources in your paper if they provide an important factoid or two that isn’t provided by a higher-tier piece, but if the Tier 3 article describes a particular study or academic expert, your best bet is to find the journal article or book it is reporting on and use that Tier 1 source instead. If the article mentions which journal the study was published in, you can go right to that journal through your library website. Sometimes you can find the original journal article by putting the scholar’s name and some keywords into Google Scholar.

What counts as a credible website in this tier? You may need some guidance from instructors or librarians, but you can learn a lot by examining the person or organization providing the information (look for an “About” link). For example, if the organization is clearly agenda-driven or not up-front about its aims and/or funding sources, then it definitely isn’t something you want to cite as a neutral authority. Also look for signs of expertise. A tidbit about a medical research finding written by someone with a science background carries more weight than the same topic written by a policy analyst. These sources are sometimes uncertain, which is all the more reason to follow the trail to a Tier 1 or Tier 2 source whenever possible.

Tier 4. Agenda-driven or pieces from unknown sources

This tier is essentially everything else, including Wikipedia.^[4] These types of sources—especially Wikipedia—can be hugely helpful in identifying interesting topics, positions within a debate, keywords to search on, and, sometimes, higher-tier sources on the topic. They often play a critically important role in the early part of the research process, but they generally aren’t (and shouldn’t be) cited in the final paper. Throwing some keywords into Google and seeing what you get is a fine way to get started, but don’t stop there. Start a list of the people, organizations, sources, and keywords that seem most relevant to your topic. For example, suppose you’ve been assigned a research paper about the impact of linen production and trade on the ancient world. A quick Google search reveals that (1) linen comes from the flax plant, (2) the scientific name for flax is Linum usitatissimum, (3) Egypt dominated linen production at the height of its empire, and (4) Alex J. Warden published a book about ancient linen trade in 1867. Similarly, you found some useful search terms to try instead of “ancient world” (antiquity, Egyptian empire, ancient Egypt, ancient Mediterranean) and some generalizations for linen (fabric, textiles, or weaving). Now you’ve got a lot to work with as you tap into the library catalog and academic article databases.

Origins and anatomy of a journal article

Most of the Tier 1 sources available are academic articles, also called scholarly articles, scholarly papers, journal articles, academic papers, or peer-reviewed articles. They all mean the same thing: a paper published in an academic periodical after being scrutinized anonymously and judged to be sound by other experts in the subfield. Their origin explains both their basic structure and the high esteem they have in the eyes of your professors.

Many journals are sponsored by academic associations. Most of your professors belong to some big, general one (such as the Modern Language Association^[5], the American Psychological Association^[6], the National Association for Sport and Physical Education, or the American Physical Society) and one or more smaller ones organized around particular areas of interest and expertise (such as the Association for the Study of Food and Society, the International Association for Statistical Computing, or the Slavic and East European Folklore Association). There are also generalist organizations organized by region of the country or state, such as the Eastern Sociological Society or the Southern Management Association. Each of these associations exists to promote the exchange of research findings and collaboration in their disciplines. Towards this end, they organize conferences, sponsor working groups, and publish one or more academic journals. These journals are meant to both publicize and archive the most interesting and important findings of the field.

Academic papers are essentially reports that scholars write to their peers—present and future—about what they’ve done in their research, what they’ve found, and why they think it’s important. Thus, in a lot of fields they often have a structure reminiscent of the lab reports you’ve written for science classes:

1. Abstract: A one-paragraph summary of the article: its purpose, methods, findings, and significance.
2. Introduction: An overview of the key question or problem that the paper addresses, why it is important, and the key conclusion(s) (i.e., thesis or theses) of the paper.
3. Literature review: A synthesis of all the relevant prior research (the so-called “academic literature” on the subject) that explains why the paper makes an original and important contribution to the body of knowledge.
4. Data and methods: An explanation of what data or information the author(s) used and what they did with it.
5. Results: A full explanation of the key findings of the study.
6. Conclusion/discussion: Puts the key findings or insights from the paper into their broader context; explains why they matter.

Not all papers are so “sciencey.” For example, a historical or literary analysis doesn’t necessarily have a “data and methods” section; but they do explain and justify the research question, describe how the authors’ own points relate to those made in other relevant articles and books, develop the key insights yielded by the analysis, and conclude by explaining their significance. Some academic papers are review articles, in which the “data” are published papers and the “findings” are key insights, enduring lines of debate, and/or remaining unanswered questions.

Scholarly journals use a peer-review process to decide which articles merit publication. First, hopeful authors send their article manuscript to the journal editor, a role filled by some prominent scholar in the field. The editor reads over the manuscript and decides whether it seems worthy of peer-review. If it’s outside the interests of the journal or is clearly inadequate, the editor will reject it outright. If it looks appropriate and sufficiently high quality, the editor will recruit a few other experts in the field to act as anonymous peer reviewers. The editor will send the manuscript (scrubbed of identifying information) to the reviewers who will read it closely and provide a thorough critique. Is the research question driving the paper timely and important? Does the paper sufficiently and accurately review all of the relevant prior research? Are the information sources believable and the research methods rigorous? Are the stated results fully justified by the findings? Is the significance of the research clear? Is it well written? Overall, does the paper add new, trustworthy, and important knowledge to the field? Reviewers send their comments to the editor who then decides whether to (1) reject the manuscript, (2) ask the author(s) to revise and resubmit the manuscript^[7], or (3) accept it for publication. Editors send the reviewers’ comments (again, with no identifying information) to authors along with their decisions. A manuscript that has been revised and resubmitted usually goes out for peer-review again; editors often try to get reviews from one or two first-round reviewers as well as a new reviewer. The whole process, from start to finish, can easily take a year, and it is often another year before the paper appears in print.

Understanding the academic publication process and the structure of scholarly articles tells you a lot about how to find, read and use these sources:

1. Find them quickly. Instead of paging through mountains of dubious web content, go right to the relevant scholarly article databases in order to quickly find the highest quality sources.
2. Use the abstracts. Abstracts tell you immediately whether or not the article you’re holding is relevant or useful to the paper you’re assigned to write. You shouldn’t ever have the experience of reading the whole paper just to discover it’s not useful.
3. Read strategically. Knowing the anatomy of a scholarly article tells you what you should be reading for in each section. For example, you don’t necessarily need to understand every nuance of the literature review. You can just focus on why the authors claim that their own study is distinct from the ones that came before.
4. Don’t sweat the technical stuff. Not every social scientist understands the intricacies of log-linear modeling of quantitative survey data; however, the reviewers definitely do, and they found the analysis to be well constructed. Thus, you can accept the findings as legitimate and just focus on the passages that explain the findings and their significance in plainer language.
5. Use one article to find others. If you have one really good article that’s a few years old, you can use article databases to find newer articles that cited it in their own literature reviews. That immediately tells you which ones are on the same topic and offer newer findings. On the other hand, if your first source is very recent, the literature review section will describe the other papers in the same line of research. You can look them up directly.

Students sometimes grumble when they’re ordered to use scholarly articles in their research. It seems a lot easier to just Google some terms and find stuff that way. However, academic articles are the most efficient resource out there. They are vetted by experts and structured specifically to help readers zero in on the most important passages.

Finding Tier 1 sources: article databases

Your campus library pays big money to subscribe to databases for Tier 1 articles. Some are general purpose databases that include the most prominent journals across disciplines^[8], and some are specific to a particular discipline.^[9] Often they have the full-text of the articles right there for you to save or print. We won’t go over particular databases here because every campus has different offerings. If you haven’t already attended a workshop on using the resources provided by your library, you should. A one-hour workshop will save you many, many hours in the future. If there aren’t any workshops, you can always seek advice from librarians and other library staff on the best databases for your topic. Many libraries also have online research guides that point you to the best databases for the specific discipline and, perhaps, the specific course. Librarians are eager to help you succeed with your research—it’s their job and they love it!—so don’t be shy about asking.

An increasingly popular article database is Google Scholar. It looks like a regular Google search, and it aspires to include the vast majority of published scholarship. Google doesn’t share a list of which journals they include or how Google Scholar works, which limits its utility for scholars. Also, because it’s so wide-ranging, it can be harder to find the most appropriate sources. However, if you want to cast a wide net, it’s a very useful tool.

Here are three tips for using Google Scholar effectively:

1. Add your field (economics, psychology, French, etc.) as one of your keywords. If you just put in “crime,” for example, Google Scholar will return all sorts of stuff from sociology, psychology, geography, and history. If your paper is on crime in French literature, your best sources may be buried under thousands of papers from other disciplines. A set of search terms like “crime French literature modern” will get you to relevant sources much faster.
2. Don’t ever pay for an article. When you click on links to articles in Google Scholar, you may end up on a publisher’s site that tells you that you can download the article for $20 or $30. Don’t do it! You probably have access to virtually all the published academic literature through your library resources. Write down the key information (authors’ names, title, journal title, volume, issue number, year, page numbers) and go find the article through your library website. If you don’t have immediate full-text access, you may be able to get it through inter-library loan.
3. Use the “cited by” feature. If you get one great hit on Google Scholar, you can quickly see a list of other papers that cited it. For example, the search terms “crime economics” yielded this hit for a 1988 paper that appeared in a journal called Kyklos:

1988 is nearly 30 years ago; for a social-science paper you probably want more recent sources. You can see that, according to Google, this paper was cited by 392 other sources. You can click on that “Cited by 392” to see that list. You can even search within that list of 392 if you’re trying to narrow down the topic. For example, you could search on the term “cities” to see which of those 392 articles are most likely to be about the economic impact of crime on cities.

Library research as problem-solving

You’ll probably engage the subscription article databases at different points in the process. For example, imagine you’ve been assigned a research paper that can focus on any topic relevant to the course. Imagine further that you don’t have a clue about where to start and aren’t entirely sure what counts as an appropriate topic in this discipline. A great approach is to find the top journals in the specific field of your course and browse through recent issues to see what people are publishing on. For example, when I assign an open-topic research paper in my Introduction to Sociology course, I suggest that students looking for a topic browse recent issues of Social Problems or American Journal of Sociology and find an article that looks interesting. They’ll have a topic and—booyah!—their first source. An instructor of a class on kinesiology might recommend browsing Human Movement Science, the Journal of Strength and Conditioning Research, or Perceptual and Motor Skills.

When you have a topic and are looking for a set of sources, your biggest challenge is finding the right keywords. You’ll never find the right sources without them. You’ll obviously start with words and phrases from the assignment prompt, but you can’t stop there. As explained above, lower tier sources (such as Wikipedia) or the top-tier sources you already have are great for identifying alternative keywords, and librarians and other library staff are also well practiced at finding new approaches to try. Librarians can also point you to the best databases for your topic as well.

As you assess your evidence and further develop your thesis through the writing process, you may need to seek additional sources. For example, imagine you’re writing a paper about the added risks adolescents face when they have experienced their parents’ divorce. As you synthesize the evidence about negative impacts, you begin to wonder if scholars have documented some positive impacts as well.^[10] Thus you delve back into the literature to look for more articles, find some more concepts and keywords (such as “resiliency”), assess new evidence, and revise your thinking to account for these broader perspectives. Your instructor may have asked you to turn in a bibliography weeks before the final paper draft. You can check with your professor, but he or she is probably perfectly fine with you seeking additional sources as your thinking evolves. That’s how scholars write.

Finding good sources is a much more creative task than it seems on the face of it. It’s an extended problem-solving exercise, an iterative cycle of questions and answers. Go ahead and use Wikipedia to get broadly informed if you want. It won’t corrupt your brain. But use it, and all other sources, strategically. You should eventually arrive at a core set of Tier 1 sources that will enable you to make a well informed and thoughtful argument in support of your thesis. It’s also a good sign when you find yourself deciding that some of the first sources you found are no longer relevant to your thesis; that likely means that you have revised and specified your thinking and are well on your way to constructing the kind of self-driven in-depth analysis that your professor is looking for.