About a week before I left for my vacation, Paul Pival, Ken Varnum and David Rothman had an interesting distributed discussion about how students are perceiving the research literature and are evaluating the quality of documents given that, online, everything looks virtually the same (and even more so when you’re looking at an RSS feed through an aggregator). Although I’d wanted to respond to what they’d been discussing, I didn’t have time and filed it away in the closet of my brain. I’d more or less forgotten about it until this week on my reference shift.
I had a student come to the reference desk who was doing a paper on a certain historical photograph. He needed eight sources about this photograph and all he had so far was something from the Wikipedia. I had assumed that he was just using the Wikipedia entry to get basic background information — who the people in the photo were, etc. We found some stuff on the photo in JSTOR and Academic Search Premiere and I also pointed him to some books in the library that described the historical event that this picture was depicting. He then started asking me about how to cite all this and I told him how to cite stuff from databases and from the Web. He then asked me “I’ve been trying to find the author of this article from the Wikipedia so I can cite it. Do you know where I can find it?” Yikes! I explained to the student that the Wikipedia is written and edited by everyone and anyone who wants to, so hundreds or thousands of people (some reliable, some not) could have contributed to this article. I asked him how he felt about using that in his paper. “Ummm… ok.” I was shocked that he still planned to use it, even though he knew that the information may or may not be true. Yes, I know that more likely than not, the Wikipedia article was right, but this student really didn’t care if it was right or wrong. He just wanted to get those 8 sources as quickly as possible and didn’t really care how “authoritative” they were.
I guess what surprised me the most about this was that his teacher had never mentioned what kinds of sources she wanted (or didn’t want) in the paper — what was acceptable and what was unacceptable.
To recap what Paul, Ken and David discussed: Paul started the discussion by talking about how flat the world of research literature looks to someone who has only seen it online. And I agree. Students don’t know what to look for to determine if the resource they are using in their paper is from a scholarly publication, a trade magazine, or some yahoo’s very professional-looking, but utterly worthless Web site. Paul thinks that students need more of a sense of where these resources are physically coming from so that they can understand the differences. Ken agrees with Paul’s assertions and remembers his own experience, in the pre-full-text database era, when he himself likely picked the three easiest-to find resources without thinking about authority. Ken then muses about what could be done with RSS feeds to indicate to people how authoritative the source is.
David had a somewhat different take on this. He argues that this issue is not a result of so many of our resources being online, but that it is just another manifestation of the age-old struggle to get students to be critical of information resources. Even when we only had print resources available, we still had students who didn’t care (just as Ken said) whether the sources they were choosing were the most authoritative ones. David argues “all that has changed is the container and/or delivery method.” David argues that teaching students about authority by trying to make online resources emulate print resources is pointless because more and more, students will be accessing resources online. To me, it’s like teaching people born in the 1930s about cars by relating them to horse and buggies. It might have worked to explain it that way to their parents who grew up with horses and buggies (and that’s why we have the term horsepower), but it makes no sense for people who have no relationship to that reality and never will. What we need to do is teach them the subtle clues they need to determine whether an article is authoritative or whether it is not something they should be citing in their paper. Because, no matter how similar things may look, there are plenty of clues that will let someone know whether an article is something they should be using in their paper or not.
I taught a few English 101 information literacy classes last semester and I incorporated a little activity into the class. I broke the class up into four groups and gave each of them an article on a certain topic. One was from the Wikipedia, one was from a government Website, one was from Newsweek and was found in a database, and the last one was from a peer-reviewed journal article found in the same database. I asked the students to tell me if they thought this was a good article that they’d use in a research paper. All of them, including the Wikipedia folks, thought that their article looked good enough to use (the only group that was even a bit skeptical of their work was the one with the report from a government Website). I then told them about the things to look for when evaluating a Website, article, or other resource for quality. At the end, I had them go back and critique each article. The students could then see that they had no idea who wrote the Wikipedia entry or what the qualifications were of the person who wrote the Newsweek article. They saw that the article from the government Website was sponsored by the government and written by two PhDs. They came out with a much better sense of what to look for when they’re doing their research on the Web or in the databases.
But the question is, even with that knowledge, do they really care whether what they are citing is authoritative? In most cases, the answer is no. That student whom I educated at the reference desk about the Wikipedia still may use it in his paper. Why? Because he needs eight sources and his teacher never told him that he couldn’t use the Wikipedia as one of those sources. What does he care about authority? Ultimately, I think if the professors keep accepting stuff from the Wikipedia and other less-than-authoritative sources of information, students will continue not to care where they get their information from. I hear the professors complain about students turning in stuff with citations from the Wikipedia, but until they mark their grade down for it, the students will continue to cite it. We can educate these students until the cows come home, but ultimately, we don’t grade their papers. It’s the folks who give them a grade who really can shape the sort of research the students do.
There is an instructor in the Criminal Justice program with whom I work frequently on developing information literacy instruction for the distance program in Justice Administration (he’s the program director). He also teaches undergraduate classes, and some of what I’ve been telling him the past year has definitely had an impact. He is now asking his students to attach the abstract or front page of every resource they are citing in their paper. That way he can see if it is of sufficient quality and if it is even relevant to their paper topic. I think that’s brilliant. In so many classes, so long as you have a bibliography, you’re in good shape. So many professors just don’t check. While I’m sure his students grumble about it, he is doing them such a huge favor because they will be so much better equipped than other students to do scholarly research in subsequent classes.
I agree that it’s important for us to teach information literacy skills to students. But if we do this and the professors continue to accept garbage citations from their students, I don’t think much of what we say is going to have much of an impact.
Update: I just wanted to make it clear that I don’t think the Wikipedia is useless in research. I often use it with students to get background information on a topic (just as I do Google) and to find links to more authoritative sources on the subject. But I do not think it should be cited in a college or higher-level paper for two reasons: 1) the information has not been verified and 2) I don’t think college students should be citing any encyclopedia in their paper.
Gods yes, the grading is definitely the key. I’m teaching at high school level and it is a constant struggle to get students to see that even very basic elements of information literacy. I am working on getting every teacher to have a basic requirement of citations, spell checking and more than one information source. Even though I help kids out in the library a lot, they are still mostly inclined to copy and paste from the internet without even giving a citation, never mind actually checking authority. Teachers accept this, so they keep doing it *sighs*.
If the student puts the authority of the information in context, why shouldn’t he use it?
Or, for that matter, who says that a layman can’t have some knowledge about a photograph (or whatever research topic)? Some independent researchers know a lot about their topics of interest.
(Just provoking discussion here.)
Nice post. I think about Wikipedia a bit differently, though. You seem to be equating Wikipedia with garbage, which I don’t think is necessarily the case.
The great thing about Wikipedia is that, with just a little discussion, it foregrounds the sausage-making aspect of publication and “information” and “knowledge” and all that. Simply saying “don’t use Wikipedia!” seems like a missed opportunity to me.
I’d like to see more teachers and faculty have their students read Wikipedia critically. Read an article, then read the discussion page, then look at the history. Is this a controversial topic? How can you tell? Are the article authors citing sources? Can you follow them up? And so on.
Because (a) I believe students should be approaching more traditional sources in a similar fashion; asking “who is saying this, how do they know this, and why are they saying it in quite this fashion” are always good questions. And (b) because the world is a lot more like Wikipedia than it is like a refereed journal article, and the skills they develop in interrogating and evaluating a Wikipedia article will server them well in the future.
I think this would help with your major point here, which is that most students don’t even think about any of these issues unless they are actually taught.
Hi Steve. I definitely don\’t think the Wikipedia is garbage nor do I think that students shouldn\’t be using it at all, and I\’m not sure where you got the idea that I think it is garbage. It\’s a great source for background information, but because it\’s written by so many different people and because so many facts in it have not been verified by subject experts, nothing in the Wikipedia should be seen as the gospel truth and safe to cite in a paper. Really encyclopedias in general should only be used for background info and not as sources for one\’s paper. Students need to be critical of anything they are looking at, regardless of the source. But I honestly do not think that students should be citing the Wikipedia in their papers — nor does Jimmy Wales for that matter.
Of course I agree that students should be taught to be critical of every source they; that was the goal of the activity I did with the students in the ENGL 101 class. And I think that the Wikipedia is an excellent tool for teaching students to be critical of sources.
I like your assignment – I might test out with some engineering students — maybe a patient for a product, a press release about the product, the wikipedia entry, a popular news article about the product, as well as sci-tech scholarly journal article on the concept.
I agree with comments above though… we have to stop seeing wikipedia as bad. If it is one of 8 sources that’s fine. It’s more about context. I have helped several students track down refs via a wikipedia entry. It’s a great starting point.
As for the issue of profs… I think as next gen faculty come along this concept will be blurred even more. We want to push the info lit concept but not come across as old-fashioned. We need to make it relevant and less abstract…. but great post.
sbc, the problem is that the student doesn’t know if the information he is citing from the Wikipedia is true of not, nor did he really care about verifying any of the facts. When you have an article that is reviewed by experts in that area of study, you can feel a bit safer that the person writing it knows his or her stuff, since the experts would likely have caught any inaccuracies.
Yes, of course a layman can know a lot about a topic, but a person writing something on a Website (that isn’t reviewed) could just as easily be making things up or could be disguising opinion as fact. Should the student just trust something on faith when they don’t know who wrote it or that it was reviewed or verified by experts in the field?
Meredith says “I definitely don’t think the Wikipedia is garbage nor do I think that students shouldn’t be using it at all, and I’m not sure where you got the idea that I think it is garbage.”
I guess I was working off of the original closing line of the post: “But if we do this and the professors continue to accept garbage citations from their students, I don’t think much of what we say is going to have much of an impact.” But I understand you have a more nuanced vision of what Wikipedia has to offer than that.
I, too, love the Jimmy Wales quote “For God’s sake, you’re in college; don’t cite the encyclopedia.”
And I don’t want to detract from your main point, which–it seems to me–is the lack of understanding on students’ parts of the distinctions and nuances of academic and other information sources. If I have time, I plan to write a little more about this today on my blog. Thanks for the thought-provoking post.
Thanks for weighing in Meredith. I think we’re in agreement that the problem is one of information literacy, but you’ve added the important observation that academic libraryfolk can’t successfully promote information literacy skills without professors making the same skills a requirement and a priority.
My wife is a Professor of Art History who has large classes of undergrads, and has mentioned in the past her view that most professors expect far too little of their students when it comes to research and citation.
I would love to see you recommend that after submitting the paper, the student go back to the Wikipedia article and update it with new facts and to cite sources.
Very cool idea, Caleb! I’d love to see students get involved in editing the Wikipedia as well and it would be a great learning experience.