Skip to content

Simplifying paper writing with Mendeley’s Cite-o-Matic and MS Word

Ever since I was a PhD student, I tried as much as I could to make it easy for me to write my doctoral dissertation. But since I am so analog in the way I work (I take notes by hand, I edit by hand, and I highlight and scribble on the margins of printed book chapters and journal articles), I also spend much more time than people who are purely digital. This said, I have always used reference managers and have tested a few (EndNote, Mendeley, Zotero, RefWorks) during the course of my PhD and as a professor. My good friend and co-author Dr. Oriol Mirosa (University of Wisconsin-Milwaukee) recommended Sente, which I saw in action and is way more powerful than any other reference manager I’ve ever seen. And at some point I plan to make sure to write a comparison of different reference managers. But I digress…

#AcWri on a plane

I am the first one to recognize that I don’t use Mendeley’s feature to its fullest extent (and I am also aware of the ethical implications of the fact that it’s now a paid service for many features, and that it was bought by Elsevier, etc.) Since I started using Mendeley 5 years ago, I am pretty comfortable using it as is and I don’t foresee I’ll be changing my reference manager any time soon. One of the things I’m trying to teach my students how to do is to write their papers with proper referencing and citation (we’ve had some highly visible cases of plagiarism in academic work in Mexico recently, so I want to teach my students better study and writing techniques). As a result, I’m combining my post on how to write effective memos with this one and the post I wrote on how to write a research paper in 8 simple steps during a workshop I’ll be giving next week.

I simplify how I write memoranda and my own research papers by integrating Mendeley’s Cite-o-Matic (the Mendeley version of EndNote’s Cite-As-You-Write) plugin. Microsoft Word and Mendeley connect through a plugin that allows you to insert a citation as you are writing. I always keep both Mendeley and Word open when I write memoranda or papers because that way I can cite as I write. I also open Excel because often times, I already have an Excel dump of all the quotations I need (see my post on how to manage literature reviews with an Excel dump). If you want to learn how to use Mendeley’s Cite-o-Matic’s feature you can do so by reading this website.

inserting cite as you write

Because I often copy and paste large blocks of text quotations in my memoranda, I need to ensure that I avoid plagiarism and properly attribute them. To do so, I insert the block of text and immediately after, I insert the citation and edit the field with the proper page. Since this is a manually edited citation, you need to approve Mendeley’s manual edit every time you do this. But this process ensures that everything you write is properly attributed and cited.

Hopefully using an in-line citation process will work for you the same way it works for me, and what I’m also hoping is that my students will use this technique for their own papers!

Posted in academia.

Tagged with , , , .

No comments

By Raul Pacheco-Vega – September 1, 2016

Why did I switch to starting work at 4am and how did I do it?

Many, many people have asked me why I start working at 4am, and how the hell did I change from being a night owl to being a morning person. I had been thinking about writing about this topic for a very long time, and then this Wall Street Journal article started making the rounds (“Why 4 a.m. Is the Most Productive Hour“). Before anybody gets freaked out about me promoting overwork and longer hours (I don’t), let me explain that I wake up at 4am, and go to bed at the very latest by 10pm. I also have a 1 – 1.5 hour nap every day. This is completely in agreement with the fact that I have been actively advocating AGAINST overwork in academia.

AcWri at home office (Leon and Aguascalientes)

If you knew me while I was doing my undergraduate degree (I have a Bachelor of Science in Chemical Engineering), you probably knew that I was a night owl. My late grandpa (another late-night person) would stay up with me until I finished my homework (usually between 1 and 3am, but sometimes as late as 4am). Often times, he would get tired and want to go to sleep before me, but he stayed and I really valued our time together during those long nights. As I was completing my degree, I had to wake up around 7 (a short 3-5 hours after finishing homework) to go to work which meant that I was usually exhausted by the time I had finished school. Since I played highly competitive volleyball at the national level for a very long time, even after I started working, I was lucky that my down time coincided with training and thus I got an additional high from the exercise. Then after I went to dance school. So, by the time I hit 7pm, I was ready to sleep. But I had homework to do. I got a 2 hour nap and then I started working on homework again.

I am not as young as I was then, so I couldn’t really maintain this schedule now even if I wanted to. Also, this was during my undergraduate and first few years of work. I was hoping that working would switch me to being a morning person (it didn’t). Even during my PhD I still remained a late night person, and this was compounded because just about everyone I dated was a night owl. Every close friend of mine was (with the exception of three of them) a night owl. Until I started seeing someone who woke up at 5am. EVERY. SINGLE. DAY.

And that was the end of it.

Not the end of the relationship, mind you. Much to the contrary, what this meant was the end of my time as a night owl. As I completed my PhD, submitted my final doctoral dissertation, filed it in the library and started working full time, I started weaning off of the late nights. I started switching to an early morning (which for someone like me, meant waking up at 7am, like most people do).

But then I realized I had way too much work to do to wake up at 7am. I would need to stay up late to finish my work if I wanted to come to the office to a clean desk. About 5 years ago, when I was already going up to 6am (slowly) I read Peter Shankman’s post (in a desperate Google search to justify whether it was worth for me to make the sacrifice of waking up earlier and earlier). His post, and the experience of my former professor Tony Dorcey (who woke up at 3am every day, and worked until 4pm, but then went to bed at 8pm) convinced me to go up to 4:45am. But then my body apparently decided that 4am was just fine, and since my gym opens at 6am, and I try to write 2 hours a day every day, 4-6 #AcWri (academic writing) and 6-7am exercise seemed to make sense.

OBVIOUSLY I get tired earlier. OBVIOUSLY I need a nap (I have what is called a 6+1.5 sleep cycle, where I sleep 6 hours but I then get a 1.5 hour nap). OBVIOUSLY this has a negative impact on my social activities. I don’t take well to those rare times when my friends keep me up after 10pm (you know who you are if you’re reading and you know why you shouldn’t). I simply have learned to explain to my friends, colleagues, students, and coauthors that I don’t stay up after 10pm, and to NEVER call me at that time (my brothers do this on rare occasions, with the subsequent angry “you woke me up“). But generally speaking, people tend to be very, very attentive and appreciative of my time.

There’s plenty of articles on why people wake up at 4m, and why it is the most productive. I Googled the idea and got a sample here and here. Like everything, you need to negotiate with other people when you’re living in a context of 8am to 5pm (or like in Mexico, where 9-2 and 5-8 are acceptable).

If you have a 4 am start, you really need to negotiate with people and teach them to respect your wake up time. For example, I push for faculty meetings to be closer to 1pm. First, it forces them (my colleagues) to be VERY efficient with time (many of them eat at 1:30pm) and not keep meetings too long. Second, I get my work done (4am-6am, then 8am-1pm) before my body shuts down for the day (usually at 2:30pm). And third, it allows me to be more receptive to ideas (if a meeting is in the early morning, I resent it and thus I’m cranky when attending). Because that’s also when I am at my most productive writing and data-analyzing, those meetings completely disrupt my productivity.

You can’t do the 4am wake-up time cold turkey, as my good friend and colleague Dr. Allyson Benton indicated – doing it cold turkey is pretty horrible (she and her husband, who is also a professor, do this too). Allyson and I agree that you need to do this gradually. Here’s a post by someone who did the 4:30am rise for 21 days (the number of days that apparently the scientific research says will be enough to create a habit for you). I can’t say that waking up at 4:30am was something I did in 21 days, but I assume it can be done. It took me MUCH longer.

Here is how I went up to a 4 am wake-up time: I started first with a very decent 6:30am rise. I spent the first few weeks (2-3) doing 6:30, then I went up to 5:45am (I didn’t reduce 15 minutes per week, as some suggested – my body doesn’t work that way). This was good for about 2 months. Then I read the Shankman post and tried to reduce to 4:45am. This didn’t go well, and I started regressing to 6am by waking up, feeling groggy and then “sleeping in” until 6am. After a few weeks, I was able to go down to 4:45am, which I then tried for a couple of weeks. Then my body automagically decided to wake up at 4am, and I haven’t stopped since.

Obviously, as those who wrote the posts that I linked, there are a few rules to this 4am thing (and it only works for some people – for example, if you are a Mom who just had a baby, or your toddler wakes up at 5am, or you need more sleep – there are PLENTY of people for whom 4am will NOT work and there is no need to make it work for them):

  • Listen to your body and rest when it asks you to.
  • Verbalize that your waking time is different to your colleagues and ask people to respect it.
  • Eat well, exercise regularly, and sleep exactly the number of hours your body needs, which often may mean, go to bed MUCH earlier
  • Accept that this is a process, and that for you 5:30am may be the earliest you can wake up and be functional, period.

I also have a few hacks for myself to make sure I can do this 4 am wake up and write thing:

1. I leave my work stuff ready the night before (music play list included).

2. I also make sure to have my To-Do list for the day ready the night before. This comes from my weekly planner whiteboard and my Everything Notebook, as you may already have guessed.

And…

3. I sleep as much as my body needs. That means, 1.5 hour naps just about every day, sleeping with ear plugs, going to bed early, and sleeping in on weekends.

As I have said, 4am isn’t for everyone, but if you want to try it, this is how I did it.

Posted in academia, productivity.

3 comments

By Raul Pacheco-Vega – August 28, 2016

Starting up and maintaining an Everything Notebook

It’s been an excellent few months for me, because I have been able to share more of my “tricks and tools of the trade” with people who read my blog, and readers seem to like how my workflow processes help them with their own. As always, I don’t provide “advice”. I simply share my experiences in hopes they will help other academics who are at similar stages of my life, or my own students (or other professors’ students!).

One idea that came to me recently is that, while folks seem excited with the concept of the Everything Notebook (to keep track of their To-Do lists, research notes, ideas, etc.) I don’t think I wrote what I believe are the key elements of how the Everything Notebook works from the start up. In my view, the two things that make my Everything Notebook work for me are the durable plastic tabs and the use of colour (in my case, Sharpie 0.4mm fine markers, and multiple colour highlighters). The third element is the flexibility and ease of adjustment of an Everything Notebook. I can move stuff around very easily, as shown below.

The key to the Everything Notebook’s simplicity is that you don’t need to create an Index (as opposed to the Bullet Journal). Because the Everything Notebook has descriptive titles in each of the rigid plastic tabs that are attached to each section, you don’t need to have a detailed index. While I do try to save some pages for Research, a few for Students, space for To Do lists, and a few pages for Administrative Tasks, I don’t fret if one thing runs over another, or if I end up having to move the plastic tabs from one page to another. The beauty of using plastic durable tabs is that they’re mobile. You don’t depend on specific dividers and therefore, you can vary how many pages you use for each section.

Another important element is flexibility of notes’ location. Because I label each page or set of pages with a cue to the specific content that is in that page, I don’t necessarily need to write all my To Do lists in a specific location. All I do, particularly if I run out of space, is tag the page with the proper cue so that I can know what exactly is filed where.

As shown above, I bring my Everything Notebook everywhere. Even if I’m working online (writing notes, or editing papers), I keep an analog medium to jot down ideas and/or To-Do items. My Everything Notebook is always synchronized with my Project Whiteboard and Google Calendar. I’m also glad other people have taken up the concept!

The important thing for me is that the Everything Notebook gives me the flexibility of not having to be strict about content, or location of said content. I can have a To Do list, followed by a few notes from a scholarly seminar, followed by ideas about a research project, followed by notes from my lectures or scribbles related to a new research paper. Because I use the plastic tabs to organize the notebook, I always know exactly what is located where.

And more importantly, I use the Everything Notebook everyday. I carry it everywhere. My students, colleagues, other academics, participants in meetings, people whom I’ve interviewed during fieldwork, everyone has seen the Everything Notebook, and so far everybody has understood what I use it for.

Caveats to using an Everything Notebook

There are obviously a couple of caveats, though. The first one is obvious, some people are colour-blind and therefore using colour will not help them. The advantage of using plastic tabs (and you can even use traditional adhesive mini-notes) is that you don’t depend on a colour-code. You can simply turn your Everything Notebook around and read what the tab says.

The second caveat is obviously that you need to carry the Everything Notebook around. I do, and it’s the first thing that I usually bring with me. Except when I don’t, and then my life is completely screwed up. That’s why it’s important to have the meetings synchronized with Google Calendar (because my iCal is synchronized to my Google Calendar, so I may forget what I’m meant to be doing, but I don’t miss where I am supposed to be or which meeting I should be attending).

The third caveat is that you may run out of space. If so, and it’s happened to me before, you can start a new Everything Notebook. Just keep the previous one handy in case you need to confer. I have my two most recent Everything Notebooks at my office at the ready just in case I need to confer about specific datasets, ideas, fieldwork, etc.

The Everything Notebook in action, beyond writing and To-Do list planning.

When discussing how to operate the Everything Notebook, Dr. Veronica Kitchen from University of Waterloo asked me what would we do if there are some notes you took by hand in your Everything Notebook and you don’t remember where you left them.

As I noted below, when the article or book chapter, or book, or report is worth writing a memo about (or memo-ing), then I insert a larger tab where I write the citation.

When people ask me “how do you find stuff in your Everything Notebook”, I show them how I use plastic tabs (they’re pretty sturdy and rigid) to mark the content. I use very descriptive titles so that I can find quickly. Also, I use the tabs on the right hand side, on the top and on the bottom.

From the example below: “Lucero Radonic” means notes from my Skype meetings with Dr. Lucero Radonic from Michigan State University, a water anthropologist who shares interest in water governance in Mexico with me. “Seminar with Debora” refers to a seminar I attended that Dr. Debora VanNijnatten (a good friend and colleague from Wilfrid Laurier University) gave at CIDE earlier this year. “LASA 2016” are my notes from the panel where I presented at LASA in late May of this year. “Goals June 2016” should be obvious, those are my writing and mentoring and teaching goals for June.

It is also clear that sometimes you scribble things in notepads, or Post-It notes. You don’t want to lose those notes, and you wonder how to integrate them to the Everything Notebook. What I do is: I staple them. That way, I know for a fact that I won’t be losing the notes I already had written for a project, or a To-Do list that I ended up drafting on a plane or in a line to enter a building.

I am just happy to see that people find my methods useful. Hopefully this post will help those who may need an organization system that doesn’t have to be perfect (because I am FAR from perfect myself!)

Posted in academia.

Tagged with , .

9 comments

By Raul Pacheco-Vega – August 25, 2016

Tales of the Field. On Writing Ethnography (Van Maanen, 2011)

Tales of The Field (Van Maanen 2011)Even though I strongly recommend NOT to do any work during your holidays, I had the pleasure of spending my holidays taking care of my 8 and 5 year old nephews, and during the time during which they allowed me to work, I basically caught up on my reading. One of the books I really enjoyed and spent a few days reading was one of the classics of ethnography: Van Maanen, John. 2011. Tales of the Field. On Writing Ethnography. 2nd. ed. Chicago and London: The University of Chicago Press. As someone who primarily does qualitative work (particularly ethnography) I am always keen to read books that are specific on research methods. This semester I am not teaching Research Methods, but I have been developing a strong syllabus specific for public policy.

Van Maanen is an anthropologist, and he makes no apologies for the clobbering he gives sociologists who use ethnographic methods. He is a purist and believes that ethnography is truly a concept, a method and a way of living and researching that is by nature and in its own right, anthropological. Van Maanen does an excellent job of offering insight into the daily practice of ethnography. He also offers a historical overview of ethnography and fieldwork, both as method and as practice. From an epistemological viewpoint, for Van Maanen ethnography IS fieldwork and fieldwork IS ethnography. I offer two quotes:

“The trick of ethnography is to adequately display the culture (or, more commonly, parts of the culture) in a way that is meaningful to readers without great distortion” (Van Maanen 2011, p.13)

“In anthropology, fieldwork alone sets the discipline off from other social sciences. A lengthy stay in an exotic culture (exotic, that is, to the fieldworker) is the central rite of passage serving to initiate and anoint a newcomer to the discipline” (Van Maanen 2011, p. 14)

In pages 17-23, Van Maanen compares how sociologists and anthropologists use ethnography (these pages reminded me of a conversation my coauthor Kate Parizeau and I had over email with Carole McGranahan – ethnography IS what anthropologists do). Van Maanen historicizes the evolution of ethnography as a method and as a field itself, with an overview of the Chicago sociology School. Van Maanen differentiates how sociologists look at ethnography (somewhat as the less relevant method, whereas to anthropologists, ethnography IS the method by excellence) – I liked that Van Maanen centers on W.E.B. Dubois as an early fieldworker and key to the field itself.

The book is organized as follows: Van Maanen reviews his 3 types of Tales (Realist Tales, Confessional Tales, Impressionist Tales). He then closes with a chapter on Fieldwork, Culture and Ethnography revisited, analyzing other types of tales (with brief, not extensive notes). Each chapter revisits the conventions that mark each tale. Then he uses a chapter section to describe how to produce each type of tale, often with examples from his own ethnographic writing. Then he writes about each type of tale in perspective — how each fieldworker and author operates within each Tale, etc.

The Epilogue serves to bring the book together, and offers perspective on the evolution of ethnography, fieldwork, writing and reading conventions. I liked that Van Maanen takes a self-critiquing position where he says that even though he is writing a main text on ethnography, he doesn’t have all the answers. Nobody whose ethnography textbook I’ve read really does have this kind of humble approach (albeit towards the end!).

I strongly recommend the Van Maanen for anybody who does ethnography, and it is a reference text, so I would strongly encourage students and researchers to buy a copy for themselves and keep it handy.

This blog post is a shorter version of my memorandum on Van Maanen, not a formal book review. I am sharing it in hopes it will be of use to those who study ethnography and qualitative methods.

Posted in academia, research methods.

Tagged with , , .

No comments

By Raul Pacheco-Vega – August 17, 2016

Synchronizing my digital and analog weekly and daily planner

Some people who see how my daily workflow happens in real life seem to be taken aback by the fact that I synchronize my digital and analog daily and weekly plans. To them, it would appear as though I take longer to plan my life than to actually execute it. This isn’t the case. It’s quite simple because everything that goes on my weekly plan (which I write on one of my campus office whiteboards) is synchronized with my digital and analog calendars.

My weekly plan (on the whiteboard) is synchronized with my Everything Notebook.

Synchronizing weekly plans

To-Do Lists in my Everything NotebookAs you can see, everything that was planned on my Weekly Plan (on the whiteboard) is also transferred to my Everything Notebook. I need the analog version so that I can check off stuff that I am working on, and so that I can have a daily reminder of what I am doing when. For example, it is crucial to me to wake up and see what exactly I’m supposed to be doing on which day. So I open my Everything Notebook on the week where I’m supposed to be working, and I see what tasks I have due and by when. When I arrive to campus, I know for a fact that I can check off both on the whiteboard and on the Everything Notebook what I’ve already accomplished. By Friday, I erase those things I completed from the whiteboard. But everything is also digitally synchronized. I use Google Calendar for everything. I block weekly class-meeting schedules, office hours, and time to write.

Since I am sometimes absent-minded, I require having a Google Calendar alert that reminds me of where I should be when I should be. On Fridays, after everything is said and done, I clear my weekly plan and leave on whatever I didn’t accomplish, and then refill with new tasks.

Synchronizing weekly plans

Because I know that “things happen”, sometimes I need to migrate tasks from one day to another (which is why the green arrows point a task to a different day).

Synchronization of my weekly plan to google calendar

The tasks that have specific dates and times (like my teaching, and meetings) are blocked into my Google Calendar directly.

Schedule Week 2 August 2016

And at the end of the day, everything is synchronized. This process takes literally 30 seconds to run, and 5-15 minutes to set up. Hopefully my method will be useful to other folks!

Posted in academia, productivity.

Tagged with , , , , .

2 comments

By Raul Pacheco-Vega – August 16, 2016

My Regional Development (Fall 2016) syllabus

And in a similar fashion to what I did in previous semesters, I am hereby sharing my Regional Development syllabus for Fall 2016. This semester, I also used the same textbook by a male scholar (Contemporary Policy Analysis by Mintrom) because I want to teach policy analysis techniques alongside main regional development theories, my ratio of female-to-male scholars’ is about 62%. It was a bit harder for me to include women in this particular course because I dropped 2 weeks worth of clusters theory and other topics where women have published (occupation-industry analysis, for example). You can check my syllabus here.

Posted in academia, teaching.

Tagged with , , , , .

No comments

By Raul Pacheco-Vega – August 9, 2016

My Public Policy Analysis Fall 2016 syllabus

As I have done in previous semesters for the past year or so, I am hereby sharing my Public Policy Analysis syllabus for Fall 2016. This semester, without taking into account that I included a textbook by a male scholar (Contemporary Policy Analysis by Mintrom), my ratio of female-to-male scholars’ is about 68%. I’ve said this before – it’s much easier to include female scholars and younger, under-represented minorities in public policy than in other fields. You can check my syllabus here.

Posted in academia, teaching.

Tagged with , .

No comments

By Raul Pacheco-Vega – August 9, 2016

Creating a syllabus for a new course: The answer-seeking method

A few months ago, University Affairs (the premiere higher education magazine in Canada) asked me if I would be willing to write something for them. I wrote about how I use storytelling techniques to create a syllabus. The syllabus-writing-as-storytelling (SWAS) method works very well when you know EXACTLY the kind of course you will be teaching. Using the SWAS method would be very simple if I were teaching any of the public policy courses I used to teach at UBC, or any of the environmental politics, global environmental politics or Latin American environmental politics courses I taught there too.

Syllabusing (syllabus building)

But that didn’t happen in 2013.

When I was asked to start teaching again (I got a one-year release from teaching when I arrived to CIDE), I was tasked with two courses: First, State and Local Government (2013-2014) and Regional Development (2014-2015). My first thought was “oh, great… I now have to create two new courses and I have no clue what I want to teach”. Bear in mind, I study subnational politics and governance, but I had never needed to teach Federalism or Subnational Politics, let alone a course in State and Local Government. Same with Regional Development. I do economic geography, spatial analysis and public policy, but I had never combined them in a course. These courses are what I call “area courses” (e.g. not specific to public policy, or political science per se).

So what did I do? I started asking myself questions. That’s why I call this method “answer-seeking”. The first thing I wanted to know was “what exactly should I be teaching in a State and Local Government course?”. I figured the best technique I could use was attempting to answer these questions. Below you will find a sample of the kind of questions I asked myself to create this course:

  • What exactly does subnational politics entail?
  • What types of governments do we have?
  • What types of relationships do these governments have with each other?
  • How are the types of governments (and the levels of governments) relating to each other?
  • How do the different branches of government (executive, legislative, judiciary) relate to each other and at which different levels (state, municipal, federal)?
  • How do governments at the municipal level deal with governance issues that cross different scales?
  • What kinds of new developments in state and local government scholarship are coming along?
  • What kind of political science and public policy scholarship applies specifically to subnational levels?
  • Which journals publish stuff at the subnational level?

What I did next was to start researching the answers to my own self-posed questions. In doing so, I started crafting a trajectory of what the course would be looking like:

  1. Governments and governance
  2. The executive at all three levels
  3. The legislative at all three levels
  4. The judiciary at all three levels
  5. Vertical and horizontal interactions across government levels and branches
  6. Subnational politics and policy (and different areas of policy)
  7. Metropolitan governance, intermunicipal cooperation
  8. Cooperation across sectors: industry, academia, non-profit sector relations with the government at all three levels
  9. Polycentric governance
  10. New developments in state and local government

Having a relatively large followership on Twitter and belonging to the Political Scientists Facebook group helped me too, because I could ask questions to my followers on specific topics, and authors. Furthermore, since I adjust my courses’ syllabi for gender and under-represented minorities’ scholarship, I had to revisit the topics to ensure that I had opened spaces and opportunities for URMS. You can check the outcome of this exercise, in the most recent version (2015) of my State and Local Government syllabus.

As time has gone by, and the more I have taught the course, I have learned more about which topics are relevant and how my students react to specific assigned reading materials and activities. Therefore, for the next iterations, I don’t seek to answer questions, but I instead use more of a storytelling approach, which you can read about here.

Hopefully my method can be useful to those of you facing new preps!

Posted in academia.

Tagged with , , , .

No comments

By Raul Pacheco-Vega – August 9, 2016

Should public administration scholarship be subjected to the same transparency standards as political science? A response to Lars Tummers

This is an expanded response to Dr. Lars Tummers’ essay on transparency in Public Administration Review’s Speak Your Mind section. The original is located here. I also blogged about qualitative vs quantitative standards a few weeks back but I had not published that essay, which is live now and can be read here.

Professor Lars Tummers wrote an excellent essay for Public Administration Review‘s blog Speak Your Mind that raises fundamental issues with which I am very familiar with, as I’ve taken part of the discussions in the political science realm, from a qualitative researcher perspective. Many of the responses to Lars’ essay have addressed these points at much longer length than I could possibly do, and I can’t make justice to the debate in a few short lines, so I’m just going to raise a few points from a very personal perspective.

1) I am wholeheartedly in favor of more open science, replications, transparency, pre-registration and a number of elements of a more robust, causal-mechanism-driven social science. I work with experimental methods (I was originally trained as a chemical engineer, so I did experiments before experiments were cool in social sciences) and therefore I espouse many of the views of several posters here, including Professor Tummers.

2) I am trained as a political scientist who works in a public administration department. As a result, I have read (and written about) the debates (which were actually happening in political science well before public administration caught up to them). This debate hasn’t ended and is still heated. The LaCour and Green and Alice Goffman issues have only contributed to elevating the level of discussion and the need for an open conversation about this.

3) I do, however, conduct qualitative (primarily interview-based, ethnographic and discourse analysis) research. I don’t want to enter into a discussion about whether the epistemology and ontology of social sciences should be divided in qualitative and quantitative methods. This debate is never going to end, so I strongly recommend reading Tom Pepinsky and Jay Ulfelder on why the discussion on qual/quant divides may actually be detrimental rather than useful.

4) Based on the fact that I conduct ethnographic work in very vulnerable communities, I am rather wary of sharing raw data (e.g. my field notes) with anybody to leave them for interpretation. Identification of vulnerable populations in any kind of social science reporting is not well seen, and many would see it as actually harmful. The IRB principles are there for a reason. We need to protect those communities we study and avoid any kind of harm to them.

5) Let’s not forget the fact that I’m a pre-tenure, tenure-track professor (a factor that plays into me being disincentivized to share raw data – what if someone who writes/analyzes data faster than me comes up with a faster analysis than I can possibly produce? My tenure committee isn’t going to judge me for data production, they’ll judge me for publications in high impact journals).

6) Even when I do quantitative analysis, I very often create my own datasets and therefore I am wary of sharing them before I have exploited them (see point 5). Transparency is rad, and I’m all for letting people judge the quality and rigor of my work by examining my databases and how I processed them (e.g. publishing code, etc.) BUT I am not ok with someone publishing a paper with my database BEFORE I get a chance to do so. Again, we are not rewarding data production, we are rewarding journal article/book publication.

7) What I think is missing from the conversation is a series of tables (sorry, I think in diagrams and tables) creating possible scenarios and then describing EXACTLY what the TOP guidelines would require from a researcher to comply with them. For example – my next paper is on the politics of water privatization in Mexico. Do I need to publish the raw data? Do I need to submit the raw transcripts of my interviews? Should I post them anonymized (anonymity will reduce the ability of researchers who might want to replicate my study to learn more of the contextual elements of my analysis)? I think that’s what is missing. A simple, visual, easy guide with several scenarios, containing MANY examples from the qualitative and interpretive traditions.

In summary, do I think public administration scholarship could use more transparency? For sure. We need to be able to test whether claims in PA journals actually can be sustained by the evidence presented and by the data collected. But PA suffers from the same emerging chasm between quantitative and qualitative research. I don’t want PA to fetichisize quantitative analysis as more rigorous. There is plenty of qualitative, interpretive, ethnographic research that is robust and analytical. I want a more rigorous PA scholarship and stronger, robust, testable research designs. That’s what I want, and that’s what I hope we can all contribute.

(and yes, I just saw the 2016 IPMJ summary article on ethnography in public management research, BTW). I also participated in the session at PMRC where the analysis presented by Ospina, Esteve and their PhD student showed, and I quote Esteve from Twitter “7.5% qual studies in top PA journ. last 5 years. Presenting it at PMRC & S. Ospina :)”

Thanks Andy Whitford, Steve Kelman, Lars Tummers and Don Moynihan also for excellent discussions on Twitter on this topic. I leave you with one of the discussions I enjoyed the most about this topic in the tweets below:

Posted in academia, public administration, research methods.

Tagged with , , , , , .

No comments

By Raul Pacheco-Vega – August 1, 2016

Should qualitative data be subjected to the same transparency standards as quantitative?

If you’ve followed me on Twitter for any length of time, you’ll know I’m someone who is very much into open access, open science, transparency, replicability and traceability. I strongly believe that we should make our research as open and transparent as possible so that people can replicate our findings (or fail to replicate, as the case may be). In fact, if you read my tweets from when the DART initiative started, I was actually pretty supportive.

Today, I am not so sure anymore. I started feeling quite uneasy and I can’t quite put my finger on the reason why. Since I use my writing to reflect on issues, I decided to write a blog post.

Transparency is an issue that is important to me, but one that I don’t spend my every living moment thinking about. So, bear that in mind when you critique/read my post. These are some reflections that may be preliminary, and that may or not be correct. I don’t have the time nor the inclination to spend much time on this reflection at this point in my life. When I submit a paper to a journal whose standards for replication require me to be completely transparent about my data, I’ll have to reflect on it a lot more. Right now, I have papers to finish, so this reflection is necessarily incomplete.

The issue that prompted my reflection and uneasiness was the following: I read a paper authored by a specific researcher, we’ll call him A. This researcher used the primary data generated by another researcher, we will call her B (who seemed quite knowledgeable about the topic). Despite the fact that the fieldwork seemed quite short, I gave B the benefit of the doubt as she had published quite extensively about the topic. But A hadn’t. A’s foray into the topic seemed basically grabbing B’s data, thinking about it through a different theoretical lens, and voila, you have a peer reviewed paper. A cited B, and mentioned he had used her data.

Organizing my fieldwork notebook

When I finished reading the article, I felt really uneasy. This action (A publishing a paper using B’s fieldwork data) seemed unethical to me. I don’t know why, I can’t shake the feeling, and it may actually not be the case. But that’s how I felt. I shared my thoughts on Twitter. Now, if you know me, you’ll know that I’m more than happy to share my quantitative datasets, my papers, even my conference (draft) papers. Heck, I was even willing to share raw field notes. But this particular paper stopped me on my tracks.

The question, obviously, lingers… shouldn’t qualitative data be subjected to the same standards as quantitative? Why am I so willing to share my datasets so openly but my fieldwork (qualitative) data (interviews, participant observations) I don’t feel as excited to share as before? I don’t know, and I’m not sure if it’s the fact that I’m pre-tenure and I worry about being scooped (seeing as I’ve seen 5 papers published that were exactly the pieces I was going to write, this feeling has increased in the past few months).

WARNING – my commenting system is somehow not working as well as I would like it to, so if you have a long comment to write, I suggest you type it in Word or LaTeX and save it, and if you can’t insert it into my comments box section, email it to me, and I’ll post it directly on the WordPress interface.

Posted in academia.

Tagged with , , .

1 comment

By Raul Pacheco-Vega – August 1, 2016