Category Archives: Games Research

Foundations of Digital Games 09 recap

Ok, lessee…

At the end of April I went to Foundations of Digital Games. A lot of the sessions were on AI and procedural programming for computer and video games, which isn’t entirely related to what I study, so I went swimming, hot-tubbing, sailing, etc. instead. But the sessions on game studies (Jose Zagal, Mia Consalvo, Jesper Juul, moderated by TL Taylor) was good.

Jose (who I’ve cited for his, Rick, and Hsi’s look at cooperation in the Lord of the Rings boardgame, and who worked with a couple of other students including Amanda Ladd [careful, my virus protection program claims there’s a trojan associated with her site… no idea if that is true] who was also at the conference (as an undergrad!)) did a paper on the current qualities of game reviews, breaking out the moves and arguments they make into 9 or so different categories. The problem is that they only chose IGN and Gamespot to look at, which means they were missing out on a whole slew of alternative review sites such as Adventure Gamers as well as missing print publications. Maybe there’s no difference in terms of what reviews do, but maybe there is.

Mia presented a study on the online community around the hidden object games Mystery Case Files, specifically Return to Ravenhearst, describing how the kinds of talk on their forums is just as rich and varied as the kinds of talk on MMOG forums.

Jesper (along with Marleigh Norton at MIT) took a deeper look at difficulty in games, showing how difficulty can come from both the game and with the game interface and that these are actually very blurred. There’s a difference between bad interface design and an interface that is meant to be difficult to master. In fact, such games as Wario Ware are actually all about figuring out the interface. So, the assumption that good UI is always an intuitive or invisible UI isn’t always a good assumption to make.

There were other sessions on creating a game development department or bridging industry with academia, and those were pretty good. The take away message I got, though it wasn’t necessarily explicit, was from Magy Seif El-Nasr and Kurt Squire who said they’ve been going to GDC for several years, first as a grad student. GDC is expensive, but the point I got was that you have to be visible, that building a relationship with industry folks takes time. That’s pretty much the reason why I’ve been trying to go to as many varied conferences as possible, though I’ve been limiting mine to ones that don’t cost a fortune. I wonder if I should start going to GDC, though…

Constance Steinkuehler and Yasmin Kafai were both at the conference, too, so there definitely was some representation from the Learning Sciences. One grad student I met, Al Yang pointed out, however, that it seemed like the different disciplines and/or schools, despite being stuck on a boat together, were relatively cliquish.

Other notables I met were Chris Lewis (who sneered at my Strongbow), Jack Stockholm and Veronica Zammito, both from Vancouver and guildies from Terror Nova! What sucks is that I didn’t meet them all until the last day, so we hardly talked at all. 🙁 Being stuck on a boat isn’t really as limiting as one would think…

I also met a bunch of people (Bob and his family, Mark, Gene) from Utah who work with Roger Altizer, my cabinmate, who I met at the Internet Researchers conference in Vancouver a couple of years back.

Cy from Microsoft, Brian from EA, Noah from UCSC (who edited First Person and is part of Grand Text Auto)… many more.

All in all, really fun conference. Bolt is a good movie.

The long rambly update… April 09 edition!

A lot has happened in the last few weeks:

A Comparison of Collaboration across Two Game Contexts: Lord of the Rings Online and World of Warcraft

To better understand the nature of virtual collaboration, we present analyses of high-stakes team activities, known as “raids,” in massively multiplayer online games (MMOGs). These situations are hotbeds of collaboration, which is increasingly recognized as a valuable twenty-first century skill (Karoly & Panis, 2004). Raids usually involve a great amount of communication and coordination of actions, interdependence of teammates, leadership, and execution of strategy, similar to elements of collaboration in other settings, such as business (Reeves, Malone & O’Driscoll, 2008), surgical teams (Edmondson, 2003), the military (Salas, Bower & Cannon-Bowers, 1995), control room teams (Patrick, et. al., 2006), sports teams (Eccles & Tenenbaum, 2004), and educational settings (Mercier, Goldman & Booker, 2006). These raid events often span hours at a time and are often repeated over several months before the raid zone is cleared, i.e. when the team is able to successfully defeat all of the enemies. Existing studies of learning in MMOGs include gaming as a constellation of literacy practices (Steinkuehler, 2007, 2008), scientific argumentation in web forums around game strategies (Steinkuehler & Duncan, 2008), and learning game ethos, strategy, and fact-finding with peers via chat (Nardi, 2007). Yet other research has looked at the development of social skills (Ducheneaut & Moore, 2005) and the build-up and leveraging of social and cultural capital to succeed in game activities (Jakobsson & Taylor, 2003, Malaby, 2006). Previous work on raiding has included a focus on providing an ethnographic account of in-game activity and the realignment work needed after moments of failure (Chen, 2009). Without cross-setting comparisons, however, it is difficult to uncover which aspects of gaming are specific to the game world and which can be thought of as enduring qualities of expert collaborative group practice.

To make cross-setting comparisons, we analyze gameplay video, audio conversations, and text chat data from two popular MMOGs, The Lord of the Rings Online (LOTRO) and World of Warcraft (WoW). Using a participant-observation approach, we examine two semi-stable teams of players who spent several weeks learning to be successful in a raid. In particular, we examine collaborative behavior and communication for two raid battles in each game: one successful battle, and one unsuccessful. The four cases were coded based on adaptations to work team behavior frameworks (Rousseau, et al., 2006), situation awareness measures (Patrick, et al., 2006), and a coding system used in examining differences between problem-solving youth groups (Baron, 2003). Informed by theories on the relational networks of human and nonhuman actors (Latour, 1988, 2005), which includes considering the distribution of cognitive work within ecological settings (Hutchins, 1995a, 1995b), and the assemblage of such systems as applied to games (Taylor, forthcoming), our analyses focus on one aspect of practice, the communication of expert players. This communication includes voice and text chat, and the patterns that emerge when looking across game sessions. By comparing two games with different designs (e.g. team size, player abilities, and scripting of battles) and cultures (e.g. roles, expectations, preferred mode of communication, and use of external tools), we can discover what is common about these collaborative activities, giving us an insight into what is common about teamwork and collaboration in virtual tasks that require a high degree of technical skill and coordinated effort. Themes emerge concerning situational awareness, psychological safety (Edmonson, 1999, 2003), problem solving (Barron, 2003; Roschelle, 1992), and critical communicative practices necessary for success. Results are discussed in relation to collaboration research in other non-virtual settings.

  • Yay! Submitted something to the Digital Games Research Association conference (DiGRA, London, September 1-4). I’ll hear on June 1 whether it is accepted. I can’t post what I submitted yet… Blind review and all…
  • Yay! I’m in a reading group this quarter that focuses on actor-network theory and activity theory. Right now we’re reading Latour’s Reassembling the Social. Read the above abstract to get a really, really brief summary, though I realize it isn’t written for non-academics…
  • Yay! I’m taking Isaac Gottesman‘s Educators as Intellectuals class (again, but this one is different than the one two years ago). We are reading biographical, philosophical, and ethnographic accounts of what it means to be an intellectual/activist/educator and writing our own historical, situated accounts… There’s some crazy connections being made between this and the sociotechnical stuff I’ve been reading… Gross, for example, argues that Rorty was shaped by his relationships with others and that social and cultural capital played a huge part in his development, more so than any inherent agentive trait. Here’s the full list of what we’re reading:
  • Yay! I’m going on the Microsoft, EA, and GarageGames sponsored Foundations of Digital Games (FDG) conference next week, which takes place on the Disney cruise ship, sailing the Bahamas. 🙂 Cabining with Roger Altizer! We’re going to hit up Disney World first. Hopefully, while he screams like a little school girl, I’ll just be giggling (like a little school girl).
  • Boo! Robin is sick this week. I was sick for like a day, but her’s is lasting a week so far…
  • Boo! Ushki also got sick this week. She was constipated something fierce.
  • Boo! Our water heater exploded on Thursday. Apparently, it’s a power vent heater, costing about $1000 more than a regular water heater ($1500). But, on top of that, the contractors who built our townhouse cut some corners and did some really strange things with their install of the water heater, snuggling it in a really tight space in the garage that is too small for modern water heaters. Furthermore, our heating system uses the hot water system, complicating matters a little, as the dudes from Fast Water Heater Co. install a new water heater in a new space. We originally got a quote from O’Neill Plumbing that seemed high, but I was at the office and Robin was stuffy headed so we didn’t quite understand the complexity of the situation. When we got a second quote from the Home Depot referred Fast Water Heater Co., the prices were actually about the same: $2700!! Boo, indeed. We went with Fast since Jason took the time to explain the situation very carefully (three times! me, Robin, my mom).
  • Yay (and Boo)! I’m going to go to State of Play (SoP, NYC, June 18-20), and Dan Hunter, the guy organizing it (and fellow guildie) is offering graduate students free conference registration and either free room and board or some money for airfare! There was talk about folks who were going to be at Games Learning Society (GLS, Madison, June 12-14) carpooling over to NYC. That sounded like fun but I’m having problems getting a confirmation that that is actually happening. Given that I now need to pay for this new water heater somehow, I fear I might be skipping GLS this year… 🙁 If I get into DiGRA, I hope Phil remembers his conversation with me about getting LIFE to pay for it…

Also:

  • I’m ramping up video analysis of a specific kid and his video game practices for ESTG’s ethnographic study.
  • I’m an officer for Educators for Social Justice (ESJ) this year, and this quarter we’re organizing a panel on teacher education and social justice issues.
  • I’m helping the Associated Students of the College of Ed (ASCE) set up a website next week.
  • The IT Crowd is pretty good.
  • The Red Dwarf final episodes finally were aired. Odd Blade Runner references. I think the third part (of three) fell flat.
  • I just finished playing Drakensang. Very linear. No narrative decision points to speak of. Very detailed combat system. German. Felt kind of like Drakensang : The Witcher = Icewind Dale : Baldur’s Gate (or maybe even Planescape).

Bay Area

Last week and this week I’m in the SF Bay Area, visiting family and working with some Stanford folks.

The LIFE (Learning in Informal and Formal Environments) Center is a collaboraiton between some profs at UW and Stanford and some researchers at SRI. As a student of the Center, I applied for a one week exchange thing they have for students at one uni to visit a student at the other uni.

Anyway, I’ve been working with Sarah Walter who is looking at collaboration in Lord of the Rings Online while raiding, which is basically the same thing I’m doing except that I frame mine more as activity system description and I look at World of Warcraft.

We’re pretty much dealing with the same data, though, from two different games, so it made sense to collaborate on a paper and some conference presentations. Yay!

It’s slow going, and technically, LIFE is paying for like 5 days of working but we’ve been at it off and on for a week and half now. Got a todo list now, and looking forward to get back to Seattle with new direction.

Today, my bro and I are meeting another Stanford student, Sarah Lewis, to go visit the California Academy of Science. Fun!

Later tonight, we’re going to Chris’s to play Battlestar Galactica the boardgame that Grey got. Last weekend, we met and played some boardgames, too. Ghost Stories and Cuba.

Yesterday, I met up with TL Taylor and Casey O’Donnel for lunch. That was cool. This week, GDC is happening in SF. Tomorrow, I’ll probably be meeting some guildies for dinner.

Robin was here with me last week, and our first two meals were at In-n-Out and Pizza Chicago. 🙂

Social dimensions of expertise published!

at Transformative Works and Cultures!

It’s an odd piece, but I’ll write about it later…  right now I gotta go hang out with SG. 🙂

Looks like Julian just started a blog!

Julian Dibbell

Well, last month…

He writes about gold farming and such for Wired and such. 🙂

Change to Leet Noobs page

Just added this to the Leet Noobs page to reflect my change in emphasis:

[Edit Feb 13, 2009:

I’ve moved slightly away from thinking about WoW as a two phase (two stage) process. I mean, it is helpful and maybe ethnographically correct–as in some players see it that way–but the line between the stages is very blurred, especially for anyone leveling up a character after their first one.

I wrote a paper that started out as me describing these two stages more. I intended to include things such as chat data and video analysis to illustrate the stages better, but I didn’t have time to do that kind of analysis for the deadline, so instead I turned it into a “how did ethnography help me” kind of paper, which seemed to make sense since it was for a special issue of Transformative Works and Cultures on ethnography and games.

Well, the reviewers, editor, and I eventually agreed that I should reframe what I submitted into a description of the social dimensions of expertise found in both stage one and stage two of character development. It’s a much better paper now after the review process than it started out as, but I’m afraid it reads a little hacked together (because it *was* a little hacked together!). Yet, I’m happy to say that it will, in fact, be appearing in TWC this Spring! 🙂

As for “Leet Noobs,” I am considering using it as the title for my dissertation, which, at this point, looks like it will be recasting the various publications I have through the lens of Actor-Network Theory/Distributed Cognition (maybe some Activity Theory thrown in, to boot) and be done by December 2009.

]

Also, NSF was here last Friday and Saturday for a visit to the LIFE Center while “us kids” were doing our grad student inter-SLC conference. One of the NSF folks really digged my poster and requested it be sent to him. We ended up sending him the charts one instead since it has more data on it. 🙂

Recent publications

I’ve been remiss in posting when things of mine get published.

I just now updated the Papers page with this:

  • Chen, M. (forthcoming). Visualization of expert chat development in a World of Warcraft player group. E-Learning.
  • Chen, M. (forthcoming). Social dimensions of expertise in World of Warcraft players.Transformative Works and Cultures.
  • Chen, M. (2009). Communication, coordination, and camaraderie in World of Warcraft. Games and Culture 4, 47-73.  Check out the different versions of this paper I’ve made available in the name of making academia transparent!  Email me for the final version or wait til it gets published in 2009.
  • Chen, M. (2008). The player matters: A review of Ninja Gaiden: Dragon Sword. E-Learning 5(4), 508-512.
  • Chen, M. (2008). Moral ambiguity in The Witcher: A game review. E-Learning 5(3), 358-365.

Gaming in China brief from Futures of Learning

New Media Practices in China, Part 3: Gaming

Nice summary report.

A few sentences that I thought of that should’ve gone in the paper I just revised

but I think it is too late now since the deadline was yesterday:

Since the players in this raid group have all been playing for about a year and have reached the highest level in the game, they could be seen as expert players. This was not because they were experts of the game mechanics, per se. Rather, these players had successfully accumulated and displayed social and cultural capital, which depended on a fluency of the game culture above and beyond fluency with the game artifact (Chen, forthcoming (from the TWC article that I revised last month)). This research focuses on the adaptive nature of the raid group’s expertise, where the individual experts had to learn to coordinate and communicate effectively with teammates such that the group itself became an acting, thinking entity.

This would have let readers of the visualization paper know better what I meant by expertise and why I called the paper as an exploration of expert chat development rather than chat of the move from novice to expert…

Let me back up.

A few months ago (August or Sept) I was asked by Constance Steinkuehler to submit a paper for a special issue on games for eLearning. I didn’t really have anything I could write about with any sort of warranted claims, but I figured that I should take advantage of an invited paper plus it’s generally a good move to say yes to Constance. 😉

So, I emailed her telling her that I wasn’t sure I could make any strong claims as most of my analysis work has yet to be done but that I’d give it a shot. I spent a bunch of time exploring the use of visuals, namely charts, to look at the chat data that I have. This took a while, and given the time that I had, I decided to write a paper on how I made the charts (sent draft around Thanksgiving), since after doing a quick search I couldn’t really find any papers of that type that dealt with qualitative data in education. (There’s stuff from other disciplines and there’s stuff on quantitative data.)

I got feedback from her (Dec), mostly to make the findings and discussion areas more substantial and to move the “how-to” section to an appendix. In other words, to change the paper to not a methods paper but rather one on expertise development, which was the topic under study.

Edited and sent (early Jan), feedback given with a 24 hour deadline (two days ago), edited and sent again (and actually I think it is much better now and includes some chat data along with the charts to strengthen claims), but this morning I woke up thinking… “there’s not enough framing in the paper. I could have described what I consider expertise with these players better.” Oh well….

Claims? Based on analysis of two nights in Molten Core, separated by a couple of months, the first of which we encounter Ragnaros for the first time and the second in which we defeated him:

  • the use of charts is very helpful but should be seen as complementing and supplementing deeper analysis of the content of the chat
  • the level of overall talk rose but the cases of on-task talk remained at about the same level or even lowered. the thought is that as you become expert in something you can spend less of your time focused on the task and more on general banter since the task activity has become routinized
  • women chatted less than men did. unknown reasons
  • the time it took on the successful night actually lengthened rather than shortened, but most of it can be explained with the raid leader taking the time to explain the fight. we had become experienced enough to be able to talk through the fight before actual engagement

Working on paper revision today

I’ll post the draft when I get a chance. It was originally a paper on expertise development in WoW, submitted to Transformative Works and Culture, a new online journal. I didn’t have time to get into it as much as I wanted and turned the paper into one that highlighted ethnographic methods and how they were useful. I am now revising it, however, to be re-reframed back to being about expertise development, on the advise of the editors. Makes sense, and there’s plenty material… It’s just sort of haphazard now, though…

But anyway, I ended up cutting this paragraph out and thought it should be saved somewhere:

Part of the meaning players derived from playing World of Warcraft depended heavily on body performance. Playing successfully was not just a cognitive function but required experiential knowledge in a sort of physical sense—both the real aching, tired wrists and back after a long session of playing and the virtual movement and actions on-screen. For example, I experienced finding the “groove” for my character, hitting a particular tempo with the activation of his abilities that everything seemed to “flow” perfectly. While I don’t think “flow theory” (Csíkszentmihályi 1990) applies to most of the game, “flow” is an apt description of the perfect rhythm I was feeling and the muscle memory I was developing.