Ethnography & Case-Study Research: Grey Literature

What is "grey literature"? Is this a term that you use in your work? Why does knowing this language matter?

The first time I heard the term "grey literature" I was speaking with an anthropologist who had become a public servant with the Canadian federal government. He was describing some of the tasks of his job in policy development and mentioned reviewing grey literature.

I could not recall ever using myself this term myself, or coming across it in ethnographic studies or methods handbooks. When I asked him to elaborate, he referenced all of the internal reports and white papers that provided important background for current policy issues. The term struck me as a peculiar, almost demeaning way to talk about existing documents that seemed like they were rather important in giving a researcher a holistic picture of the context under study.

Although a strange term to my ears, clearly the concept of "grey literature" was a normative term in the field of policy development and in the public service.

The next time I heard the term grey literature, it was when I was hired to develop a case-study for OCWI. As my supervisor outlined the project she envisioned, reviewing the grey literature on the program being evaluated and in locating it in its larger context would be paramount.

Again, it struck me that this term – despite being rather foreign to me – was part of the everyday language of Case Study and Program Evaluation research that I was now venturing into.

So, what is "grey literature"? 

The term seemed so foreign to me, and yet seemed to describe something so familiar or commonplace that I found myself overthinking the concept, and worrying that I was out of my depth as an ethnographer doing Case Study and Program Evaluation research.

As it turns out though, as an anthropologist, I have always worked with grey literature – I just didn't have this blanket term in my methodological vocabulary!

Grey literature encompasses all of the documents that are available, but not intended for wide distribution. Think of the term as contrasting with "black and white" literature that is commercially published (see Western University Library's informative, quick video on the topic of grey lit).

According to the International Conference on Grey Literature (GreyNet), grey literature includes the "multiple document types produced on all levels of government, academics, business, and organization in electronic and print formats not controlled by commercial publishing i.e. where publishing is not the primary activity of the producing body." As such, grey literature includes:

• government documents and websites
• white papers
• evaluations and research reports
• conference proceedings and unpublished/ working-papers
• data (e.g. census, geospatial, economic)
• practice guidelines
• patents
• theses and dissertations
• internal communications
• community-based websites, newsletters, and blogs

For some anthropologists, perhaps "grey literature" is already a prominent part of your methodological vocabulary. However, in speaking with colleagues, I have found that I am not the only anthropologist who was unfamiliar with this term, even though I am deeply aware of the importance of the kinds of documents it references.

So, to come back to the last question I posed at the beginning of this post...

Why does knowing this language matter?

Knowing this language matters because it allows us to speak about and champion our skills as social researchers to a broader public.

As I have discussed in previous posts in this series, anthropological ethnography has a lot of offer in projects centred on case studies or program evaluation (and beyond). However, in order to show that we can 'walk the walk' of these kinds of projects, and with these kinds of audiences, we first need to learn how to 'talk the talk'.

Quick links and further reading:

• International Conference on Grey Literature (GreyNet)
• Western University Library's Grey Literature Video Tutorial
• anthro everywhere!'s Special Series: Ethnography & ... page with all the posts in our Ethnography & Case Study Research series
• Ethnography, Case-Study Research, and Program Evaluation (Oh my!) (8 January 2018)
• Ethnography & Case Study Research: Applying an ethnographic approach (15 January 2018)

One Size Does Not Fit All - Preliminary Findings

On November 13th, anthro everywhere! blogger Jennifer Long continued her One Size Does Not Fit All series where she provides readers with an overview of her new pedagogical research project in collaboration with Ms. Silvie Tanu Halim at the W. Booth School of Engineering Practice & Technology. This research explores mature and non-traditional students' educational experiences where we seek to understand how these perspectives differ depending on our medium of instruction: online (synchronous, asynchronous), or face-to-face.

We left off on Nov 12th discussing how blogger Jennifer Long invited students to participate in their survey.

Although the survey is still open, the following is a line graph outlining when we received our 86 responses (thus far):

Figure 1. Responses according to date

As mentioned in previous posts, although we did use incentives to encourage participation, it appears that most participants decided to take part soon after the project was introduced by Blogger Jennifer Long.

Dr. Long attended Ms. Tanu Halim's classes on November 07th (online, yes, I made an appearance in the online course) and November 9th (in class). November 7th sees the greatest spike. This spike can perhaps be accounted for, if we consider that students were already in front of their computer when they were invited to participate in an online survey. The second spike appears to be on the Sunday or Monday following my visit to the classroom (after the weekend) on the 10th.

I also thought I'd share some of the aggregated information about those taking part in the survey. When speaking about mature students, it became apparent that the majority of our respondents were between the ages of 21 and 25.

Age Ranges of Participants thus far (Nov 16 2017)

It will be interesting to compare this information with that of other scholars and how individuals 25+ experience education at SEPT when compared to those in the 21-25 category.

What is also informative are their responses to preferences to learning:

Learning Preferences of Mature Students

It will be very interesting to delve into their comments to understand what we see here, that more respondents prefer to learn new course material in-class rather than online.

Check out future posts to learn how the researchers will collect and analyse their data -- or see all posts in the One Size Does Not Fit All research series on our updated page Special Series: Ethnography & ... (formerly "Ethnography & Tourism")

Want to use these findings for your own work? Please cite this source as follows:

• Long, J., & Tanu Halim, S. (2017, November 16). One Size Does Not Fit All - Preliminary Findings [Web log post]. Retrieved from https://anthrolens.blogspot.ca/2017/11/one-size-does-not-fit-all-preliminary.html

One Size Does Not Fit All - Encouraging Participation without Coercing Participation

We take up from where we left off on November 8th when anthro everywhere! blogger Jennifer Long continued her overview of her new pedagogical research project in collaboration with Ms. Silvie Tanu Halim at the W. Booth School of Engineering Practice & Technology. All posts that begin with 'One Size Does Not Fit All' describe a project which explores mature and non-traditional students' educational experiences and seeks to understand how these perspectives differ depending on our medium of instruction: online (synchronous, asynchronous), or face-to-face.

We left off on Nov 8th providing a final overview of our survey questions about educational experiences and preferences. Today, we're going to discuss how blogger Jennifer Long invited students to participate in their survey.

As discussed in previous posts, the target population of our research are our own students. To be more specific, they are Ms. Tanu Halim's students. To conduct this research, Ms. Tanu Halim and Dr. Long had to submit an ethics proposal to our university's board of ethics for research projects involving human beings. This is standard practice for any researchers working with consenting individuals. Unsurprisingly, our research board wanted to understand how we'd be mitigating the pressure students might feel if their own instructor is asking them to take part in research.

First, as researchers, we had to outline how our research was voluntary, as in, our participants would not be negatively effected by choosing not to take part. Therefore, our letter of consent included the following text:

Your participation in this study is strictly voluntary. This study is not an assessment component for this course; therefore, your responses will not be evaluated in any way during this study. As such, your grade for your class will not be negatively impacted if you choose to withdraw or not participate in the study. 

We also outlined the potential risks facing students if students chose to take part. For this project, we identified the potential of both psychological and social risks. The following is the text describing how we will try to mitigate these risks:

Psychological risks:
Participants are informed in the online invitation and Letter of Information that this study is voluntary. If worried about the social risk, students are informed in the invitation text and Letter of Information that they can access the survey and choose not to participate while still contributing to the 70% participation threshold. 

Social Risks:
Further, if participants wish not to answer particular survey questions, they will have the option to skip any question they are not comfortable answering. 

As described in the psychological risks, we're awarding everyone in the class a bonus mark once we've hit a 70% response rate threshold. To maintain anonymous responses, we've decide to dole out these bonus marks to everyone as we're not collecting their identifying information. This could however make some students feel forced to take part and therefore, we've included an option where students can click on the survey and then decide not to take part (selecting 'no' to the consent screen). In so doing, these click throughs to 'non consent' still count toward the 70% threshold.

There has been some debate regarding how much incentivizing participants will influence the responses researchers receive.  As becomes evident, Ms. Tanu Halim and I had to walk a fine line of trying to entice students to participate (online surveys suffer from low response rates) and overstepping our boundaries as instructors by influencing our students to take part.

Another step we're taking to encourage realistic responses and experiences is to collect this information anonymously.  In taking this approach, we're hoping that our students are able to willingly take part and provide us in-depth information about their learning experiences and preferences in ways that are meaningful to them. Further, if we don't know who took part, we can't give preferential treatment to anyone.

Finally, when inviting students to take part in our survey, Dr. Tanu Halim left the room while Dr. Long provided a brief explanation about the research and its project plan. This 'script' is outlined again in our ethics proposal, as a means to avoid undue coercive behaviour. This approach allows students to ask questions and speak to any concerns they may have away from the eyes and ears of their professor. Blogger Jennifer Long told the students about the study and where to find the link, but students have the choice to take part at a later point in time and not, for example, under Dr. Long's 'watchful eye'. This would present few options for some students.

Check out future posts to learn how the researchers will collect and analyse their data.

Want to use any ethics phrasing for your own work?
Please cite this source as follows:
Long, J., & Tanu Halim, S. (2017, November 13). One Size Does Not Fit All - Enouraging Participation without Coercive Participation [Web log post]. Retrieved from https://anthrolens.blogspot.ca/2017/11/one-size-does-not-fit-all-encouraging.html

One Size Does Not Fit All - Research on Mature Students' Educational Experiences

In a follow up from our post on November 2nd, anthro everywhere! blogger Jennifer Long continues to discuss her new pedagogical research project in collaboration with Ms. Silvie Tanu Halim at the W. Booth School of Engineering Practice & Technology. 

Check out last week's posts to learn the context behind our study. In a nutshell, we seek to know more about mature and non-traditional students' educational experiences  and, to explore how these perspectives differ depending on our medium of instruction: online (synchronous, asynchronous), or face-to-face.

We left off on Nov 2nd by showcasing some of our questions about the demographic information of our participants. In today's post, we get down to the nitty-gritty of the learning experiences and preferences.

The rest of our questions deal with student experiences of online learning. Therefore, we have to narrow our participant group to those with online experiences. 

Question 8 follows: Have you ever taken an online course (including high school, college or university courses, training, or workshops) in the past? Yes/No

Here, we put a little logic into things, if a student answers 'no', they are thanked for their time. If they answer yes, students will continue on to the question set below.

If student participants select yes, they are asked to fill out a matrix  with answers between not very effective (all the way) to very effective for the following items:

1. How effective do you find time spent attending online lectures (in synchronous [defined in survey] format)?
2. How effective do you find time spent watching pre-recorded lecture videos (which you can watch at any time)?
3. How effective do you find time spent reading through course notes (for comprehension of material)?
4. How effective do you find time spent working through problems in the course textbook (through self-directed learning in complement to online resources)?
5. How effective do you find time spent discussing course content with student peers? 
6. How effective do you find time spent discussing course content with your instructors?

Then we ask them questions about their use of resource materials for online learning: 

1. Do you prefer synchronous or asynchronous learning for online courses? Why?
2. Do you use the accommodation/preference options on the pre-recorded videos (e.g. slow down, speed up videos)? 
3. Do you replay videos if you do not understand a concept? Why (or why not)? 
4. How important is it to have an online community with your student peers? Scale of not at all to very important.

As it happens, our survey opened up last night. Check out some of next week's posts to learn how blogger Jennifer Long invites her colleagues students to participate and how we work to avoid undue pressure on our student participants to take part in our survey.

Want to use these questions for your own work? 
Please cite this source as follows:
Long, J., & Tanu Halim, S. (2017, November 02). One Size Does Not Fit All - Research on Mature Students' Educational Experiences [Web log post]. Retrieved from http://anthrolens.blogspot.ca/2017/11/one-size-does-not-fit-all-research-on.html

Quick Links:

• Simon Coleman and Bob Simpson, Unintended consequences?  Anthropology, pedagogy and person Anthropology Today (1999) http://www.jstor.org/stable/2678353
• One Size Does Not Fit All - Anthropological & Pedagogical Research on Mature Students Anthro Everywhere! (Nov 2 2017)
• One size does not fit all - Applying Anthropological Principals to Pedagogical Research Anthro Everywhere! (Oct 30 2017)
• What do Cultural Anthropologists do? "Decode" Human Behaviour, Anthro Everywhere! (Aug 28 2017)
• Qualitative versus Quantitative Research - from a business perspective (Feb 23 2017)
• A New Home for Ethnography: The Use and Legacy of Ethnography by Anthropologists and Non-Anthropologists Anthro Everywhere! (June 9, 2016)

One Size Does Not Fit All - Anthropological & Pedagogical Research on Mature Students

In a follow up from our post on Monday, anthro everywhere! blogger Jennifer Long continues to discuss her new pedagogical research project in collaboration with Ms. Silvie Tanu Halim at the W. Booth School of Engineering Practice & Technology. 

Here, we as researchers are interested in exploring the educational experiences and learning preferences of mature and/or non-traditional students and, to explore how these perspectives differ depending on the instruction medium. We left off last day promising to further explain the types of questions would wanted to ask.

As mentioned in the previous post, our population would include students signed up to the Degree Completion Program. These students have completed (at least) an advanced diploma from a College. 

What assumptions do we make about this population? 

As mentioned in the last post, we assume that these students will have more or different competing responsibilities for their time. To expand on this point, we find that the majority of our students do not come straight from a college program but are returning to post-secondary education after having begun their career. Therefore, these students typically work a 40 hour work week, may have dependents to care for, and other commitments on their time.

In their exploration of the role of anthropological knowledge outside the classroom, Coleman and Simpson (1999) find that anthropological knowledge provides: (1) a unique opportunity to hold a mirror up to one's own life circumstances and (2) a chance to reflect on one's personal experiences. However, the cultural outcomes of participating in higher education may generate contrasting relationships outside of school and personal change that is not without a problematic middle-class undertone. Citing David James (1995), the authors warn  that post-secondary participation may very well reproduce a social distance between one's university and home life. Importantly, these authors - using Alison James' work - help us question how a return to university may be felt by some to be a world of new possibilities and for others, an alternative form of personal  displacement and dis-empowerment.

How then, are our DCP students experiencing their education here at SEPT? Are they experiencing a new world of possibilities or personal displacement and dis-empowerment. What is the role of the medium of pedagogy - and how does his affect how these students experience their post-secondary education? 

Below are a list of questions we included in our online survey to help understand the rounded picture of people's lives (borrowed from Coleman and Simpson). Next week, we'll follow up with an overview of the questions around the mediums (paths) of learning:

1. Your gender (multiple options available)
2. Your age (range)
3. Hours per week spent on family and household responsibilities (range)
4. Hours per week spent on work, work-related activities (e.g. travel), or other weekly tasks (e.g. volunteering, searching for work, etc. ) during a typical (or average) work week throughout the year (range)
5. How do you prefer to learn new course material? (Options include in class, online, or on your own through self-directed learning (i.e. using course materials to complete tasks at your own pace according to set deadlines)? Follow up question: Why? [Open text box]
6. How do you learn (new course material) most effectively? Options include in class, online, or self-directed learning (definitions integrated into survey). Why? [Open text box]
7. As a mature student, how will your educational experience differ from those traditional students entering university directly from high school? [Open text box]

Want to use these questions for your own work? 
Please cite this source as follows:
Long, J., & Tanu Halim, S. (2017, November 02). One Size Does Not Fit All - Anthropological & Pedagogical Research on Mature Students [Web log post]. Retrieved from https://anthrolens.blogspot.com/2017/11/one-size-does-not-fit-all.html

Quick Links:

• Simon Coleman and Bob Simpson, Unintended consequences?  Anthropology, pedagogy and person Anthropology Today (1999) http://www.jstor.org/stable/2678353
• One size does not fit all - Applying Anthropological Principals to Pedagogical Research Anthro Everywhere! (Oct 30 2017)
• What do Cultural Anthropologists do? "Decode" Human Behaviour, Anthro Everywhere! (Aug 28 2017)
• Qualitative versus Quantitative Research - from a business perspective (Feb 23 2017)
• A New Home for Ethnography: The Use and Legacy of Ethnography by Anthropologists and Non-Anthropologists Anthro Everywhere! (June 9, 2016)

Writing better Conference Abstracts and crafting better Posters

We originally planned to write this post for grad students, but really, couldn't we all benefit fit from learning a bit more about how to write a great conference abstract or an eye-catching poster?

Here are a couple of interesting resources for helping you do just that.

From the LSE Impact Blog, you might like to read Your essential ‘how-to’ guide to writing good abstracts and their follow-up post How to write a killer conference abstract: The first step towards an engaging presentation. These posts contain some useful tips for grad students applying to a conference for the first time. Veteran conference-goers may also benefit from reviewing these suggestions, and considering how conference abstracts are different from article abstracts.

Conference posters are often less common among social anthropologists than paper presentations. As a visual medium, posters present unique challenges for researchers whose work is based in narrative. However, we're not the only discipline who struggles with how best to represent our findings in this format. Luckily, there are many resources available to help you craft an informative and eye-catching poster:

• 4 Design Tips, For Awesome Research Posters (22 October 2012, AAA Blog)
• Better Posters: A resource for improving poster presentations
• How to Create a Research Poster: Poster Basics (NYU Libraries)
• Creating Anthropology Conference Posters: A Guide for Beginners (Jason E. Miller and John K. Trainor)

We've also taken the opportunity to update our page on Advice for Grad Students | Writing Tips with this information on conferencing. If you're getting ready to head to a conference, you might also want to check out our collected tips on networking on our Advice for Grad Students | Professional Development Strategies page.

Anthropologists Visualizing Data: Packaging Anthropological Knowledge Part Three

In line with the post from earlier this week, Anthro Everywhere! is revisiting the topic of visualizing data in accessible (i.e. easily consumable) ways.

What do I mean about easily consumable data visualization? Take for example, a non-anthropological sample from the Cornell Note-taking System from Cornell University's Learning Strategies Center about the Cornell Note-taking System, a useful tool for all undergraduate students seen below (for a clearer copy, click on the link above or below in quick links):

Cornell Note-taking System by Cornell University's Learning Strategies Center

Despite this interesting method, the below revision by Life Hacker (from 2006!) is arguably more accessible:

Life Hacker's Version of Cornell's Note-taking System

The question for today's post is: What kinds of accessible and memorable data visualization have anthropologists created? 

There are likely many examples, one of which stuck in my mind was Grant Otsuki's portrayal of the number of dissertations produced by institutions. 

According to Otsuki, the size of the circles is proportional to the number of dissertations in cultural anthropology produced by that institution since 1900. If a user his website, they can hold their mouse pointer over the circle to get the full name of the institution, and the number of dissertations produced:

Otsuki's Portrayal of the Number of Dissertations produced by Institution

Otsuki's larger work focuses on the question “What does it mean to be human in contemporary technological societies?” This example of dissertations per university is one example of anthropological visualizations of their data.

But let's put the question to you: What other memorable and accessible visualizations have you seen by anthropologists? Let us know via email (anthrolens@gmail.com) or tweet us @anthrolens.

Quick Links:

• Cornell Note Taking System, Cornell University Learning Strategies Centre
• gjotsuki.net/visualizations.html, Grant Otsuki
• Geek to Live: Take study-worthy lecture notes, Gina Trapani on Life Hacker (Sept 22 2006)
• The Packaging Anthropological Knowledge Part Two, Anthro Everywhere! (July 31 2017)
• The Packaging of Anthropological Knowledge and Its Merits According to Market Research Experts. Anthro Everywhere! (June 29 2017)