---
abstract: "What means are used in communicating game studies research? The article presents an analysis of findings produced through computational web scraping all published material in the 20-year lifetime of the Game Studies Journal, looking for a range of media facilitated by its permissive HTML format and published alongside text. The inquiry intends to provide reflexive data into the 20-year history of the field’s oldest journal and the implicit research tradition cultivated so far. Extending the discussion, it presents the problematic relationship of game studies and design, making a case for the formal inclusion of design-based research methods to the interdiscipline, which while latent in its current ecology are nevertheless foreseeable to manifest in the third decade of the game studies project. Lastly, it advocates for *research through design*: the production of videogame artifacts as research vehicles for generating new knowledge, advancing discourse, and uniting the research landscape altogether."
author: Constantinos Miltiadis
bibliography: static/cm-digra-2023/cm-digra-bib.bib
contributors:
- constantinos-miltiadis.md
csl: static/cm-digra-2023/chicago-author-date-3.csl
draft: false
keywords:
- game studies journal
- data mining
- computational analysis
- videogame research
- research communication
- research methods
- epistemology
- use of media
- design research
- research through design
- game design
title: Sample Markdown Article COMPILED (‘Other than text’ - Constantinos DiGRA 2023)
---

Actual article reference
- Miltiadis, Constantinos. ‘Other than Text: Media Used in Game Studies Publications. A Computational Analysis into 20 Years of Publications of the Game Studies Journal, and an Appeal for Research Through Design’. In *Proceedings of the 2023 DiGRA International Conference: Limits and Margins of Games*. Sevilla: DiGRA, 2023. <https://doi.org/10.5281/zenodo.7944673>.

------------------------------------------------------------------------

*Author’s note*: The first part of this paper presents and discusses data retrieved, analyzed, and visualized through a custom Python program developed in a [Jupyter Notebook](https://jupyter.org/), implementing the libraries [Beautiful Soup](https://www.crummy.com/software/BeautifulSoup/bs4/doc/) (for web scraping), [NumPy](https://numpy.org/) (for math), [Pandas](https://pandas.pydata.org/) (for statistics and visualization), and [Matplotlib](https://matplotlib.org/) (for additional plotting functions). The fully annotated source code developed for this inquiry is provided openly and as part of this contribution for evaluation and corroboration of findings as well as for further extension and production of derivative works by the community. It is provisionally hosted by the author at <https://github.com/cmiltiadis/other-than-text>, and archived at <https://doi.org/10.5281/zenodo.7944673>, pending action by the DiGRA board for archiving contribution artifacts that cannot be accommodated within traditional paper formats.

------------------------------------------------------------------------

# Introduction: Diagrams and Other Media in Game Studies Research

The following study started out of genuine curiosity to answer the question: can one use diagrams in game studies research, and, is it common to use diagrams or other visual media in such research?

Here, the question of diagrams is not just encyclopedic.
Diagrams, sketches, and illustrations serve as low-threshold means to organize, make sense of, and communicate information impossible to convey otherwise, for example through text, taxonomies, or quantification. They are distinct from pictures as they rely more on abstraction than faithful representation, and as such they serve as native methods in practices and professions that rely less on analytical knowledge and more on implicit or tacit knowledge, for example in design and architecture.
Moreover, diagrams and other visual means were essential for the advent of the scientific revolution (Edgerton 1985; Franklin 2000; Latour 1986) and are still employed in the natural sciences today.[^1]

Diagrammatic reasoning, according to Tylén and colleagues (2014), is used both in everyday and specialized practices to “crystalize and support innovating thinking practices and interpersonal communication.” This, by reducing complexity and rendering perceivable abstract structures; mapping ontologies and interrelations; affording manipulable representations that accommodate testing new insights or hypotheses; enabling collective forms of thinking through their communicability; and finally supporting and augmenting cognitive processes. For videogames especially, where textual descriptions, taxonomical analyses, and representational renderings might not be adequate, diagrams can serve to reason with the medium’s procedural rhetoric and ontologies, while sketches can accommodate concepts that rely on a spatial substrate (see also Almeida et al. 2013).

In fact, the use of visual methods is rather common in game design and development practices and can be observed to permeate literature that intersects such situated knowledges with fields of analysis like game studies.
Extended use of such means has been employed to communicate matters pertaining to videogame spatiality[^2] (Backe 2021; Jakobsson 2003; Robinett 2006; Totten 2014; Totten 2017); temporality (Juul 2004; Nitsche 2007); fundamental game mechanics (Swink 2008b); and formal frameworks such as MDA (Hunicke et al. 2004; Walk et al. 2017), *Game Design Patterns* (Björk et al. 2004), and the diagram language *Machinations* (E. Adams et al. 2012; Dormans 2012). Besides, the need for visual languages was stressed on par with the need for a shared vocabulary in the study of game design tools and methods by Almeida and da Silva (2013), highlighting shared agendas between the analysis of games as existing objects and of games in the making.

However, how much do such visual media and methods take part in formal game studies research? While multiple contributions have suggested methodologies to analyze videogames, the matter of how to communicate videogame research has been given less attention. ‘Playing research’ (Aarseth 2003), to take an example, suggests studying a game by playing it well. However, the matter of communicating that understanding is left vague, or rather implicit in existing scholarly traditions.

Thus, the search for diagrams and by extent for other media in the study of videogames can be viewed as a qualitative and reflexive inquiry into the types of thinking and argumentation involved in their discussion. Furthermore, it can help infer the proximity or degree of convergence between scholarly research on the one hand, and the types of knowledge and reasoning involved in *making* videogames, on the other.

After manually browsing existing literature, the inquiry turned into computational tools to assist in the wider search for media in game studies research, while focusing on the case of the Game Studies Journal (GSJ).
This, on the one hand, allowed to abstract the subject of this inquiry into any non-text media used alongside text in the communication of game studies research. On the other hand, it allowed focusing the scope of this inquiry into the tradition of a single journal for several reasons (discussed in the following), chiefly because of its prominence in the field, its openness and transparency, and its unique capacity to accommodate multiple media types.

The following is organized in two parts. Firstly, a computational analysis into *what type of means, other than text, are used in game studies publications, in the example of GSJ?*
Extrapolating findings, the second part discusses matters of interdisciplinarity in game studies and the GSJ particularly, unpacking the problematic relationship to design epistemologies. I argue that the link to design is crucial for the field entering its third decade, not the least for the inclusion of media-based research methods. Finally, I advocate for *research through design*, contributions based on and involving the prototyping of videogame artifacts.

# Web scraping the Game Studies Journal

The data presented in this study are generated from ‘data scraping’ all the entries of the GSJ in its 20-year history, up to volume 2021 issue 3, in search of media that accompany text. This is computationally extracting, organizing, and visualizing information from all published material.
For this type of inquiry and for focusing the question of media published in videogame research the GSJ stands out as an ideal candidate for two main reasons: one technical and one epistemological.

Firstly, the GSJ is ideal for web scraping from a technical perspective.
The journal is decidedly open access (Aarseth 2014), thus all its content is readily available. Like most game studies journals it is self-published rather than published by an external commercial publisher. Stemming from the previous (the devotion to accessibility, the initial lack of experience with publishing infrastructure, and limited resources), besides that the journal stands for aspects of digital culture, is that the GMJ is published solely in HTML format and only digitally.[^3] While digital publications are common, academic journals published in online formats are rather rare nowadays. Most make use of the PDF format[^4] which can be said to serve as the standard for scientific publishing across the board.
Nevertheless, the GSJ is in comparison significantly more accessible: it does not require downloading files, and its lightweight entries can be read online on any browser, printed on paper, or saved as offline files.
Last but not least, the fact that the journal is in plain HTML renders it transparent to thorough computational scraping.

The second and foremost reason is that the GSJ stands out because of its seminal importance to the field.
It is the journal that formally – at least for the academic context – established the field of game studies in 2001, with its first issue marked by the founding editorial as “Year One” for computer game studies (Aarseth 2001). As one of the field’s flagship publication venues and at the age of 20, it is currently one of the few that are formally and highly accredited in academic research.[^5]
Thus, the analysis of a journal of such central and historical importance to a field can reveal trends and conventions in its research tradition.

Systematic studies into massive volumes of literature for epistemological purposes are not uncommon, and this is also true for game studies.
Two precedents, by Melcer and colleagues (2015), and by Martin (2018), provide crucial evidence for the structure of the videogame research ecology, mapped in the spatial and the temporal domains respectively.
The first, analyzed the academic publishing landscape through keyword mapping across 48 venues in a span of 15 years, concluding its segmentation into 20 thematic areas, and 7 distinct sub-communities.
The second, investigated the field’s degree of interdisciplinarity, through a cross-reference and keyword analysis in four academic communities to identify shared thematic clusters and track their evolution in time.
Evidently, such studies provide extremely useful insights into the current consistency of the ever-growing research landscape.
As Martin writes, they help “describe the historical development of a field,” as well as identify new research areas for development, “possible research gaps and areas for collaboration” (2018).

However, such massive computational inquiries come with limitations.
They are curtailed by the availability of open and searchable information provided by the publisher or index catalog, which in most cases consists only of metadata such as citation information (authors, titles, abstracts, and keywords), and rarely include bibliographic references.[^6]
Thus, at best, they concern everything but the actual content of the contributions they examine.

What this present study proposes is a closer look into the GSJ itself in its 20-year tradition through a deep dive into the actual content of its complete published oeuvre. It employs a form of “algorithmic criticism” (Ramsay 2011) concerned not with text (e.g. content, thematic, or keyword analyses), but with means of communication, asking: *what means, other than text, are used to discuss videogames*; with videogame abstractly understood as a rapidly evolving digital, procedural, interactive, performative, and sensory-rich audiovisual medium and cultural object, the experience of which often transcends or even escapes textuality.
This approach allows for a qualitatively richer and reflexive inquiry into the “habitus” (Bourdieu 1990) of the journal, as the convergence of a research community (its authors, reviewers, and the agenda set out by the editorial board), parallel to the evolving object of study.
Furthermore, it can demonstrate the paradigm of scholarship set by one of the field’s most distinguished venues, which also established the field, to the wider research community.

# What is Possible to Publish in Game Studies?

Before proceeding to findings, one question to consider abstractly is what is possible and acceptable to submit and publish as game studies research? That is, *what kind of material, besides text, can be published as research?*

Let’s first consider technical limitations.
For publications that favor a print format, the options are rather limited. In this case, instructions often restrict the number of images, their size, color reproduction, and the overall page count of the submission – aspects pertaining to technical or practical limitations of the publication and its reproduction in print. For the case of journals published in digital print-ready PDF formats, instructions might be more lax. However, as with the previous category, submissions are subject to the pagination layout of the venue, which, for example, might shrink images to fit the page or column width.

For the overwhelming majority of game studies venues, print-ready digital PDF is the format of choice.[^7] In the cases examined, instructions resemble those of print publications provisioning images and tables. However, no limit is set to their use nor the page length of the submission.[^8] Exceptions are DiGRA and its journal ToDIGRA, which explicitly mention that submissions “may be accompanied by various media files, such as videos, sound clips, and even demonstrator games,” although such media are rendered secondary as instructions explain that the paper should “stand on its own” citing accessibility reasons.[^9]

For GSJ, published natively in plain HTML, the possibilities are theoretically multiple.
However, from the array of content and media that could practically be accommodated besides text, the journal’s submission guidelines, like the previous cases, only explicitly provision for elements found in conventional print publications: figures and tables.[^10]
No cap is imposed on their use, neither for a conventional page length of the submission (apart from word count). Nevertheless, images are restricted to a 50KB file size and 350-pixel width, an outdated limitation by today’s standards, both for online content and for the subject matter of videogames.[^11]

Apart from the previous, the GSJ submission guidelines are rather vague regarding what else could be allowed to publish. The only mention related to media states that “use of other multimedia elements (like a flash plug-in \[obsolete as of 2021\]) has to be previously discussed with the editors” (see endnote 10). While media use is neither encouraged nor prohibited, a close inspection would reveal that, albeit in exceptional cases, the journal has already published articles that include content types impossible to reproduce in print form, and at least uncustomary if not difficult to include in PDF files.
These are three unique cases that include links to attached audio files, a YouTube video embedded as inline frame (iframe) in the body of the text, and an animated GIF.

Given the absence of explicit restrictions we can assume that the journal is open to accommodate, when possible, media artifacts submitted by authors. Thus, the question could be put as *what media can the journal accommodate*? A concise list of what can be published on an HTML website includes:

1.  Text (including notes and bibliography)
2.  Images and animated images
3.  HTML tables
4.  Hyperlinks [^12]
5.  Links to file attachments hosted on a server (e.g. audio and video)
6.  Embedded content (iframes) that can host:
    - sound (for example via Soundcloud)
    - video (via video streaming platforms)
    - third party websites
    - embeddable HTML5/WebGL content – such as videogames.[^13]

While only text, images, and tables are explicitly allowed by the journal guidelines, the inquiry looked into all of the above cases.

# Data Analysis

## Data Mining Process, Pitfalls, and Overall Metrics

One single Python program was developed to cater to all purposes of this analysis, including data gathering, processing, and visualization – provided openly with this paper.
The starting point was the latest GSJ “Archive” page[^14] which lists alphabetically all the content published since 2001. From that, unique hyperlinks to journal entries were identified, and each entry was scanned individually to retrieve relevant information. To render comprehensible the analytics into dimensions of the journal’s published work, the retrieved data were visualized with graphs at the level of issues, overall published material, and media types.

While the journal’s HTML website makes web scraping tasks easier, certain omissions and inconsistencies of the GSJ website pose minor or major obstacles to a non-human reader.[^15]
One relevant example is the lack of signification to distinguish between actual papers and other kinds of published entries like editorials, book reviews, and interviews.[^16] Although these can be filtered manually for the relatively small volume of published works in GSJ, the present study opted for automating tasks rather than manually catering to each individual case. Therefore, what follows refers to published *entries* and *not papers* and takes into account all published material except ‘Call for Papers’ entries.

| **Parameter**                    | **Amount/case(s)**                                                                                     |
|----------------------------------|--------------------------------------------------------------------------------------------------------|
| Number of issues                 | 41 (until volume 21, issue 3; 2001-2021)                                                               |
| Number of entries                | 279 (including, book reviews, interviews, and most editorials that cannot be excluded computationally) |
| Number of images (overall)       | 659 (in 109 entries; 39%)                                                                              |
| Number of HTML tables (overall)  | 70 (in 36 entries; 13%)                                                                                |
| Entries with images or tables    | 124 (44%)                                                                                              |
| Image filetypes                  | JPG (77%), GIF (12%), PNG (11%; although not provisioned)                                              |
| Images types found               | 16                                                                                                     |
| Embedded content (iframes)       | one case (YouTube video)                                                                               |
| Animated GIFs                    | one case                                                                                               |
| Sound files                      | one case                                                                                               |
| Amount of referenced video links | 93 (in 29 entries; 10%)                                                                                |
| Most used media type             | Videogame screenshot (44% of all images)                                                               |
| Most combined media type         | Videogame screenshot (in 56% of unique combinations)                                                   |
| Most common hyperlink            | “gamestudies.org” (137 instances in 62 entries; 22%)                                                   |

**Table 1:** Overall metrics of material published in GSJ.

Table 1 lists metrics from the overall findings. The study found 279 entries published in 41 issues between 2001 and 2021 (until volume 21, issue 3), with a total sum of 659 images and 70 HTML tables. The images were annotated manually and classified into 16 distinct categories for further analysis into types of media used and their combinations. Additionally, entries were scanned for hyperlinks which were analyzed to infer common references to websites.

## Frequency of Images in GSJ

<figure>
<img src="/cm-digra-2023/images/gsc_images_per_issue.png" alt="Figure 1: Image distribution per journal issue." />
<figcaption aria-hidden="true">Figure 1: Image distribution per journal issue.</figcaption>
</figure>

Overall, images are by far the most used medium in journal entries, with a total of 659 instances.
Figure 1 shows the total image count per issue of the GSJ, arranged by date of publication.
The graph doesn’t reveal any pattern. Rather, it shows that such metrics vary greatly from issue to issue, while the use of images in general appears rather limited.
The mean image count per issue entry is under 9 and in most cases under 5.
In addition, the entry with the highest image count per issue often accounts for a significant part of the overall image count. For 26 issues (63%) such entries account for 50% or more of the overall image count while 3 of those account for 100%.
In terms of distribution, the median image count per issue entry is 0 for 27 issues (67%), and 5 or fewer images for the rest, with one exception with 8 images (issue 14: 2011/1).

<figure>
<img src="/cm-digra-2023/images/gsc_image_frequency_in_entries.png" alt="Figure 2: Image frequency per journal entry." />
<figcaption aria-hidden="true">Figure 2: Image frequency per journal entry.</figcaption>
</figure>

<figure>
<img src="/cm-digra-2023/images/gsc_image_frequency_in_entries_non_zero.png" alt="Figure 3: Image frequency in journal entries with images." />
<figcaption aria-hidden="true">Figure 3: Image frequency in journal entries with images.</figcaption>
</figure>

Figure 2 presents the number of images per entry, where an overwhelming 61% do not use any images. The image count distribution for the 109 entries with images (39%) is presented in Figure 3.
The most frequent case is 4 images found in 19 instances followed by 1,3 and 5 images (in 14, 14, and 13 instances respectively). After that point, the frequency of cases with more images decreases. Nevertheless, 17 cases (15% of this group) make use of 10 or more images, with a maximum of 27 images observed in 2 cases.

## HTML Tables

<figure>
<img src="/cm-digra-2023/images/gsc_table_frequency.png" alt="Figure 4: Frequency of HTML tables." />
<figcaption aria-hidden="true">Figure 4: Frequency of HTML tables.</figcaption>
</figure>

Figure 4 presents the amount of HTML tables in single entries.[^17] From the 36 entries that feature tables (13% overall), the most popular case is 1 table, found in 21 entries, followed by 2 tables in 8 entries. Entries with more than three tables are rather rare, nevertheless, the top-most case includes eight.

## Image Frequency by Type

The next step was to assess image types qualitatively, to distinguish them in regard to the information they convey.
For example, a videogame screenshot, a photograph, a graph, and a diagram are all accounted for as “figures.” Nevertheless, they all carry different kinds of information, can support different types of arguments, and arguably accommodate different types of knowledge.
To account for that, all images were downloaded, annotated, and classified into different media types, taking into account how these were referred to by authors, where such information was offered.[^18]

The classification found 16 distinct image types. Screenshots were distinguished into three categories: “\[Video\]Game Screenshot”, “Film screenshot”, and other screenshots (as “Screenshot”). The label “Picture” was used for images of documentation material – such as videogame promotional material and posters. “Glyph” was used for images of non-Latin characters or symbols. “Illustration” was used for cases of original illustrations or collages by authors.

Finally, the case of tables is a caveat in the GSJ as they appear both in the form of HTML tables – discussed before – and as images of rasterized tables. Since the two table types don’t overlap, they were kept distinct for this study.

<figure>
<img src="/cm-digra-2023/images/gsc_image_types.png" alt="Figure 5: Image type classification." />
<figcaption aria-hidden="true">Figure 5: Image type classification.</figcaption>
</figure>

Figure 5 presents the distribution of the 659 images found in the 16 image types.
Videogame screenshots are by far the most used media type at 44% of all images (290 instances).
Pictures and graphs occupy the second and third place at 13%, while tables and photos follow at about half of that.
In outlier types, unique cases use images to depict: musical scores; algorithms; text; and an animated GIF.

## Media Combinations

<figure>
<img src="/cm-digra-2023/images/gsc_media_types.png" alt="Figure 6: Amount of different media types in single entries." />
<figcaption aria-hidden="true">Figure 6: Amount of different media types in single entries.</figcaption>
</figure>

<figure>
<img src="/cm-digra-2023/images/gsc_media_types_non_zero.png" alt="Figure 7: Amount of different media types in single entries with media." />
<figcaption aria-hidden="true">Figure 7: Amount of different media types in single entries with media.</figcaption>
</figure>

The previous data regarding different media types were analyzed on a per-entry basis, including the category of HTML tables discussed before.
Figure 6 presents the amount of media combinations in the body of single entries, and Figure 7 the frequency of different media types among the 124 entries (44.4%) with media. The analysis shows that 155 entries (55.6% overall), do not contain any media, while 35.5% feature up to 2. From then on combinations of media types decrease, with 2 outliers featuring 5 and 8 different types respectively.

<figure>
<img src="/cm-digra-2023/images/gsc_media_types_in_combinations.png" alt="Figure 8: Presence of media types in different combinations." />
<figcaption aria-hidden="true">Figure 8: Presence of media types in different combinations.</figcaption>
</figure>

<figure>
<img src="/cm-digra-2023/images/gsc_media_types_detailed.png" alt="Figure 9: Frequency of specific media combinations in single entries with media." />
<figcaption aria-hidden="true">Figure 9: Frequency of specific media combinations in single entries with media.</figcaption>
</figure>

Lastly for this category, and for completion, Figure 8 shows the presence of each media type in unique media combinations, and Figure 9 lists in detail all media combinations and their frequency.
For entries with media, those with just videogame screenshots are the most frequent with 28 cases (22%) followed by those with just tables (of either type) with 16 (13%).
Another way to put the same is that videogame screenshots and tables (to a lesser extent) are the most common self-standing media next to text.
The 48 other media combinations that follow appear in 5 cases or less, while 31 combinations (62%) are unique.
Videogame screenshots are also the most-combined media type present in 28 different combinations (56%), followed by tables in 23, pictures in 18, and diagrams in 13 media combinations.

## Hyperlinks

![Figure 10: Websites referenced in more than five entries.](/cm-digra-2023/images/gsc_popular_websites_colored.png)
For an additional metric, all entries were scanned for hyperlinks to search for frequently referenced websites, provided in the text body or bibliography.[^19] Figure 10 lists websites occurring in more than 5 individual entries.
As shown, the most common website is by far the GSJ itself, appearing in 62 unique entries (22% overall), 137 times.
DOI links[^20] come second with 306 instances in 36 entries.
Third are YouTube links found in 27 entries.
Fourth is the DiGRA website in 25 entries. Links to other game studies publication venues include the journals Loading, and Eludamos, in 10 and 6 entries respectively, while links to general academic publishers are also common.
The game design website Gamasutra (now Game Developer) comes 5<sup>th</sup>, followed by the videogame press website Kotaku (in 24 and 21 entries respectively). Other videogame press websites are also common (IGN, Polygon, Gamespot, Eurogamer, GamesIndustry.biz, and PC Gamer) as well as the website of the Entertainment Software Association.
In general news websites, we find US-based publications (Wired, New York Times, and The Washington Post).
Other common websites are Internet Archive, the blogsites WordPress and BlogSpot, the wiki pages Wikipedia and Wikia (now Fandom), and Reddit. Also present in this list are links to personal websites of videogame scholars ([Nick Yee](http://www.nickyee.com/), [Jesper Juul](https://www.jesperjuul.net/), and Gonzalo Frasca ([ludology.org](http://ludology.org/))).

These show that besides scholarly research authors also rely on and employ in their argumentation a wide array of community commentaries, news reports, and media relating to the videogame phenomenon. However, given the journal’s loose regulations regarding hyperlinks, many URLs are not formatted properly but only provided as plain text. Thus, further research is required to draw sound conclusions.

## Video References & Iframes

<figure>
<img src="/cm-digra-2023/images/gsc_videolink_frequency.png" alt="Figure 11: Amount of video links in single entries." />
<figcaption aria-hidden="true">Figure 11: Amount of video links in single entries.</figcaption>
</figure>

A subset of the previous is a metric concerning the use of hyperlinks referring to video material. Such links can be of any type (gameplay content, lectures, etc.) and can be included in the text, the bibliography, or embedded as iframes in the body of the text.
A total of 93 video links were found, distributed in 29 entries (10.4%) as shown in Figure 11.
Except for a Vimeo and a Twitch link, these are all YouTube videos.
Extensive use of video references appears particularly in entries that discuss such material specifically, such as Carter and colleagues -Carter et al. (2015), which is the top-most contributor to the category with 19 video links.

Throughout the journal, there is only one case that embeds a video frame in the body of the article (M. B. Adams et al. 2018). This is also the only case of an iframe in the entire journal.

# Discussion & Extrapolation

What can be inferred from the abovementioned findings is that ‘the average’ entry published in GSJ will most likely not have much besides text. Like the majority, it will have no pictures (61%) or tables (55%). In case it does contain elements besides text, that will likely be videogame screenshots.
From a media perspective, this picture of the journal might not outright suggest one that is concerned with phenomena of media culture, or media-rich art.

This is not to say that media are not present in the journal. On the contrary, while that might not be the norm, a closer look reveals that multiple contributions make extensive use of media for their purposes. One in 5 entries (20%) features 5 images or more, and 6% feature 10 or more – something rather unlikely to come across in print publications. Furthermore, the use of media in argumentation is rather rich and varied with about 1 in 4 entries (24%) combining 2 media types or more.

Nevertheless, no regular or systematic use of the journal’s rather rare online digital format can be observed when it comes to media.
The exceptions mentioned before that feature in-text media (a YouTube iframe, an animated GIF, and sound file attachments) appear to be the only cases that make use of the journal’s digital infrastructure – which did not warrant more extensive inquiry as a category. As exceptions though, these cases demonstrate that contributions with digital-exclusive media are both allowed and present.
Regardless, the classic categories of ‘figures and tables,’ found in all conventional academic paper templates, appear to accommodate the overwhelming majority of contributions.[^21]

For the subject matter of videogames, the lack of media in the argumentation and communication of research appears rather puzzling for several reasons. Chiefly, because videogames have been discussed as an unprecedented and media-rich genre[^22] where one might expect to see media, or more experimental means also taking part in discourse as well as the communication and argumentation of related research.
Additionally, game studies – a rather young interdisciplinary field – does not have any significant prior epistemological tradition to adhere to, besides the conventions it sets for itself. Thus, what constitutes a contribution and what that looks like, for a young field and research community, is something to be gradually regulated and adjusted between its publishing venues on the one hand, and its community of contributors and reviewers on the other.

For the case of the GSJ, which carried the burden of establishing the field’s first academic journal, the rather conservative outlook is likely owed to its initial attempt to legitimize game studies research by appearing ‘scientifically appropriate.’ In a 2014 keynote presentation Espen Aarseth, the journal’s co-founder and editor-in-chief, remarked the following in a seemingly humorous fashion while discussing the foundation of the field and the GSJ:

> By having a journal we signal to the world, to the academic world, that here we have a new field; a field that is serious; a field where you should be able to get credit when you publish articles. *So we made it as boring as possible to achieve that.* It is on the web, but yes you can’t post comments, there is no blog \[or\] anything. *Just plain boring academic articles, to make it seem that this is a very serious field* (transcript from Aarseth 2014, 13:10, emphasis mine).

For 2001, disguising a journal for a marginal or frowned-upon subject inside an aesthetically “boring” container so that it appears legitimate enough to the eyes of the wider academic community was clearly strategic in reasoning.
Nevertheless, in the 20 years since, it is also an aesthetic that remained with the journal, and an attribute that can be said to gradually formalize into an implicitly ingrained tradition: that its contributions are rather similar in form and presentation to contributions found in generic traditional humanities scholarship.

## Interdisciplinary Discipline and the Matter of Design in Game Studies

Extrapolating from previous findings, we can discuss how ‘interdisciplinarity’ in the model of GSJ, and for videogame research at large, can play a role in shaping research methods and means of research communication.

Parallel to the journal’s agenda is its community and the contributed knowledge with can steer research, challenge traditions, and influence the ‘shape’ of contributions. That is particularly interesting for interdisciplinary fields such as the present one, where peers from different backgrounds and research traditions contribute with their own methods, means, and methodologies, which are not – and need not be – universally shared among the same community.

For the GSJ, interdisciplinarity was a quality paramount to the establishment of the game studies project. In “creating a new discipline,” its first editorial emphatically remarked that “\[we\] all enter this field from *somewhere else*”, and signed off with “you are all invited!” (Aarseth 2001, emphasis in original). However, the examples provided as points of plausible disciplinary origin (“anthropology, sociology, narratology, semiotics, film studies, etc.”) betrayed a rather narrow conception of that interdisciplinarity, rather rooted in the humanities and media studies (Kultima 2015). Nonetheless, in the decades since, the range of ‘home disciplines’ for contributing authors in game studies research has widened considerably, far beyond those originally prescribed (Butt et al. 2018; Martin 2018; Mäyrä et al. 2014).

Given the above, in the two decades of the field’s and journal’s history, one particular epistemic domain can be observed to be historically excluded. That is the domain of design, which also appears as the crux for the interdisciplinary ‘discipline’ of game studies.

References to game designers and monographs by game designers are common if not canonical in game studies literature,[^23] though not the same can be said for the degree of inclusiveness of design approaches (or methods) in academic contributions.
According to Kultima (2015), there is a significant gap between the videogame as a (design) practice and as a field of academic study. That can be historically explained, Kultima argues, owed partly to a problematic understanding of design and a narrow interpretation of interdisciplinarity, matters which eventually cost to the field the inclusion of design research methodologies.
All the while, the same study reports, “game design” is found to be the most common keyword in videogame research.

For the GSJ specifically, the relationship to design appears similarly problematic, and ‘design’ itself ill-understood. In 2005, discussing the interdisciplinary nature of videogame research and its problems, Aarseth made extensive mentions to his understanding of the role of design in that constellation:

> Inevitably, the only powerful nexus among these diverse approaches then becomes design. Humanists, technologists, and social scientists come together through a common interest in outstanding design. Game design will have to unite the insights from social science, technology, and art, and so becomes the overruling discipline whereby all the other approaches are measured. The value of technology, social theory, and aesthetics can be measured through the lens of design, because it is closest to the practice itself (Aarseth 2005).

In this passage, Aarseth seems to acknowledge design not only as a distinct “approach,” but also for its inherent capacity as a “powerful nexus.”[^24] As such, he sees design as capable to unite, organize and measure all contributing methodologies in game studies.

Despite that, he continues by immediately deprecating his previous statement:

> However, this is problematical for a number of reasons. For one thing, design theory is quite underdeveloped compared to the other traditions. There is a clear danger that commercial success and sales numbers will dominate the discourse, to the detriment of scholarly values and strength of argument (Aarseth 2005).

Aarseth’s objection here is twofold. Firstly, that ‘design’ comes with comparably underdeveloped theory, and secondly that its admittance to game studies, due to its proximity to practice, could entail the risk of polluting academic values with commercial ones.

This self-rebuttal, as with similar statements made elsewhere,[^25] betrays confusion as to what the keyword ‘design’ refers to. Is it the field of design, or design research methods? Or is it game design, as a younger applied practice?
For one, the design field is not quite underdeveloped, but a rather mature interdiscipline with decades of rigorous research traditions.[^26] Moreover, the scholarly and applied wings of design, as well as their cultures and values, are clearly distinct, but also in an organic interrelation in which they can critique and inform one another.

More crucially, the usefulness of design – as an out-group tradition in this interdisciplinary constellation – need not be measured by how its “theory” compares to that of other – in-group – fields. Rather, such an assessment needs to be grounded on its own methods and what these can contribute to the existing constellation.
The distinction here is crucial for conceiving an interdisciplinary field, where multiple entry points and methods are required and need to collaboratively co-exist.

The practice of interdisciplinary, however, is far from a trivial task. As distilled by Aarseth, the matter comes down to “how do we trust each other, when we don’t share the same methods?” (2014). His proposal for the field’s future suggested the model of architecture schools (Aarseth 2001, 2014); environments that house multiple disciplines working together for the study of complex phenomena and the production of architects:

> Maybe something like an architecture school, where people from many different disciplines work together to produce architects but also understand cities, structures, and all the stuff that goes on. That could be one model to strive for. Groups of specialists in different disciplines but working closely together and educating people (transcript from Aarseth 2014, 1:02:00).

The analogy to the architecture school model appears to resonate with the current state of videogame research in which game studies formally contribute. Furthermore, the statement could not underline more strongly the centrality of design, for videogame research too.

In architecture schools, practice-based design courses form the spine of educational curricula, while design-based tacit knowledge is also the discipline’s unifying basis from which specializations stem. Design here is indeed the “nexus” that connects and valuates other constituents of the discipline besides practice, including history, theory, and technical subjects.

At the same time, the architectural school model, as described by Aarseth, is not far in reality from programs to which game studies formally contribute.
In fact, that is the case for the few established game studies research units – for example the Institute of Digital Games in Malta and the Center for Computer Games Research in Copenhagen.[^27] Such units are populated by staff from various specializations relating to games – besides game studies proper – who collectively contribute to curricula centered around game design, and the production of competent professionals.

That game studies units primarily contribute to design-based study programs undeniably forecasts the form of research for game studies entering its third decade. It hints at the native knowledges currently cultivated in videogame-related education, and the direction of scholarly literacy. Consequently, we can ask: what kinds of research can we envision for the future of game studies? This, given that the field is already becoming populated by graduates with videogame-native degrees, i.e. people not coming from “*somewhere else*” (Aarseth 2001).
By and large, the presence of and enrichment with design knowledge and methods appears as an inevitability.

## Design Research and Games Studies

For the game studies ecology, the inclusion of design methods is not a novel suggestion, nor is design research a new practice. The purpose of game design research methods and imperatives for their inclusion have been discussed extensively in recent years (Khaled et al. 2023; Kultima 2015; Lankoski et al. 2017; Malazita et al. 2023; Stenros et al. 2018). Nevertheless, while design-based research takes part in undergraduate and postgraduate education, its use as a research method is less present when it comes to game studies publications.

To briefly examine and categorize design research trajectories into game studies we can use Frayling’s tripartite model (1993; see also Stenros et al. 2018) outlining indicative forms of research in the context of arts and design. These are:

- *research into arts and design*: concerned with historical, theoretical, and aesthetic-related research;
- *research through arts and design*: implementing hands-on design prototyping for the investigation and advancement of the medium as well as of novel applications, where contributions concern discussion of such studies and can include prototypes; and lastly
- *research for arts and design*: concerning the design and development of artifacts as contributions to arts and design in themselves.

By this perspective, the first category is rather aligned with ‘canonical’ game studies contributions – whether or not implicitly informed by design practice.
The second and third categories appear rather problematic and can be identified in a set of scattered contributions. This, to the best of our knowledge, can be attributed to the lack of venues that can accommodate contributions in videogame form, the lack of accreditation thereof, and the relatively limited precedents in scientific literature.

As “research *for* design” we can identify multiple precedents of videogames developed to also contribute to discourse and are often elaborated in publications. Such cases include *September 12th* by Frasca (2003), which initiated the genre of “Newsgames” later discussed in literature (Bogost et al. 2010; Sicart 2008); the “playable philosophy” games and parallel publications by Gualeni that investigate videogames as philosophical tools;[^28] the game design practice of Barr and its subsequent design analysis;[^29] and the work of multiple academic practitioners such as Peirce and Flanagan,[^30] and more recently LeMieux with Boluk.[^31]
An exceptional case of design practice intersecting game studies can be found in a 2016 issue of the GAME journal[^32] containing discussions based on provided videogame artifacts (see Barr 2016; Gualeni 2016).

The category of “research *through* design,” which appears rather promising for game studies research is more scattered.
As such we can categorize design-informed texts, such as the design-based accounts by Crawford (1984),[^33] and Salen and Zimmerman (2003). Design investigations can also be found outside of videogame research proper. Informed by practice and enriched with diagrams, the investigation and theorization of digital spatiality by Jakobsson (2003), for example, provides a counter-precedent to the scholarship of its contemporary “spatial turn” in game studies (Günzel 2008). A significant recent precedent is the “playable essay” by Juul (2021), consisting of a Unity-developed browser-embedded videogame accompanied by an essay that follows an analysis from the standpoint of game design, meant to first be played and then read.[^34]
Lastly, investigations *through* design prototyping are common within game design and development communities. Prime examples include the discussion of “game feel” and its demonstration through videogame artifacts by Swink (2008b, 2008a), as well as the recent “interactive video essay” *Platformer Toolkit* by Brown (2022a, 2022b), discussing and exposing fundamental experiential aspects of player controller ‘feel’ through a videogame prototype and accompanying video discussion.

What such examples show is that while lacking appropriate accreditation or formal outlets, designerly research is already present, spearheaded by notable scholars of the field, and contributing to the multimodality of videogame research. Besides, it is also the native means of practice for the global “lively art” (Jenkins 2005) of game design. Such investigations shine light from perspectives that also draw from a practical know-how of the medium and contribute *through making*, as opposed to the study of games with analytical or even playful methods outside their status as objects of design. As in the example of “Newsgames,” such methods are not only capable to explore the edges of games and gaming aesthetics but furthermore advance discourse and the medium altogether. This, often towards directions unlikely for the gaming market to attempt, which is in stark contrast to the study of games through their manifestations as readymade commercial objects.

Moreover, over the past few decades a notable trend has been observed towards artifact construction research methods. In the realm of HCI particularly, *research through design* programs (here RtD) concentrate on experimental generation of non-commercial artifacts (Gaver 2012; Zimmerman et al. 2007, 2008), which are subject to formal evaluation criteria (Prochner et al. 2022).
The strength of this approach lies in its distinctive capacity to draw from a diverse range of disciplines to explore innovative concepts, applications, and hypotheses, as well as address ‘wicked problems.’
Its synthetic perspectives proffer forms of understanding that diverge from traditional analytic approaches. Furthermore, RtD yields artifacts that serve as ‘theory nexus,’ instigating the development of new theoretical frameworks and promoting the proliferation of theory, rather than pushing towards its convergence.

Additionally, within her paradigm of “generic epistemology” Schmid foregrounds the construction of artifacts (Schmid et al. 2014). This paradigm, which is concerned with contemporary post-disciplinary objects (Schmid 2015), underlines the synthesis and making processes inherent to design, which entail “a mode of reasoning that produces the new” (Schmid 2018). This distinct mode of reasoning intrinsic to artifact construction not only generates new knowledge but also enables knowledge contributions not otherwise possible. Drawing from a diverse spectrum of disciplines and knowledge bases, design transcends the boundaries typically imposed by single disciplines or philosophies (Schmid 2018; Schmid et al. 2014). This underscores the unique potential of design to the broader epistemological landscape.

For game studies, given the presence of design-informed or design-based investigations, as well as the position of design parallel to and jointly with ‘studies’ literacies in videogame-related education, we can presume that the formalization of game design research is only a matter of time. The question at hand is in what relation or proximity to game studies?

To return to the question of media and means of research in game studies contributions, that of the videogame prototype itself is a logical candidate, not only by extrinsic methodologies but also by existing practices in the field. The recent “playable essay” by Juul (2021), is a foreseeable publication format to look forward to, as well as a prime example of how game design (synthesis) and studies (analysis) methods can work hand in hand (Coulton et al. 2017; Waern et al. 2015; see also Brown 2022a).
Furthermore, as previously discussed, the odds of such an ‘epistemological update’ to enrich and unite the expanding research landscape are promising.

# Conclusion

The inquiry into media published in the past 20 years of the GSJ provides some qualitative insights into the means of argumentation and communication within the habitus of the journal as a relatively open interdisciplinary community. From this vantage point, the considerable work produced in this timespan parallel to the establishment of the field appears to mostly adhere to conventions of traditional scholarship. This is to an extent consequential to the difficulties of establishing a new interdiscipline. Nevertheless, it is arguably also disproportionate compared to the boldness of the game studies project and the specificity of the novel media-rich phenomenon of study.

Notwithstanding, for the now-adult game studies entering its third decade, conformism to extraneous conventions need not be the case. Rather, a renewal of its vows and re-examination of the tradition cultivated so far are more pressing imperatives for enabling its future. For one, the case of design as a binder and “powerful nexus” to unite the multiple aspects of the videogame phenomenon into a “single discipline” (Aarseth 2001) or “fuzzy set” (Aarseth 2015), is pending at the gates for the new generations of game studies – those not coming from “*somewhere else*” (Aarseth 2001) – to pioneer.

Eventually, the question remains: “how do we trust each other, when we don’t share the same methods?”
While the architecture school model might provide a useful precedent to conceive the future, for an interdisciplinary field birthed after post-modernism devoted to the study of a “contemporary object” (Schmid 2015), there likely is no answer or existing schema to prescribe to, besides the road it paves for itself. In that, perhaps the guiding principle is what Derrida (2001) discussed for the unconditional humanities of tomorrow: *faith*.

# Acknowledgements

I want to thank Petros Koutsolampros and Andreas Kelemen for their assistance with coding and data visualization; Miro Roman for his help with a proof-of-concept image scraper developed in Mathematica; and Yoon Han, Dooley Murphy, Ed Morrell, Luis Vega, and Bassam El Baroni for their generous comments.
I am thankful to the anonymous reviewers of the Game Studies Journal for their constructive feedback on an earlier version of this paper.
I am particularly grateful to Stefano Gualeni for his insightful feedback and encouragement.

# Bibliography

<div id="refs" class="references csl-bib-body hanging-indent">

<div id="ref-aarseth2001" class="csl-entry">

Aarseth, E. 2001. “Computer Game Studies, Year One.” *Game Studies*. 1 (1). <http://www.gamestudies.org/0101/editorial.html>.

</div>

<div id="ref-aarseth2003" class="csl-entry">

———. 2003. “Playing Research: Methodological Approaches to Game Analysis.” In *Proceedings of the Digital Arts and Culture Conference*, 28–29. Melbourne: spilforskning.dk.

</div>

<div id="ref-aarseth2005" class="csl-entry">

———. 2005. “Game Studies: What Is It Good For.” *The International Digital Media & Arts Association Journal*. 2 (1): 3–7. <http://www.academia.edu/download/31687896/iDMAa_Journal_Vol_2_No_1_Burkart.pdf#page=9>.

</div>

<div id="ref-aarseth2014" class="csl-entry">

———. 2014. “Game Studies Challenges - Past, Present and Future.” Presented at the CEEGS 2014, Masaryk University, Brno, October. <https://www.youtube.com/watch?v=6TqI0XwXbqo>.

</div>

<div id="ref-aarseth2015" class="csl-entry">

———. 2015. “Meta-Game Studies.” *Game Studies*. 15 (1). <http://gamestudies.org/1501/articles/editorial>.

</div>

<div id="ref-aarseth2021" class="csl-entry">

———. 2021. “Two Decades of Game Studies.” *Game Studies*. 21 (1). <http://gamestudies.org/2101/articles/aarseth_anniversary>.

</div>

<div id="ref-adams2012a" class="csl-entry">

Adams, E., and Dormans, J. 2012. *Game Mechanics: Advanced Game Design*. Berkeley, CA: New Riders.

</div>

<div id="ref-adamsWhyHaveMake2018" class="csl-entry">

Adams, M. B., and Rambukkana, N. 2018. “‘Why Do I Have to Make a Choice? Maybe the Three of Us Could, Uh...’: Non-Monogamy in Videogame Narratives.” *Game Studies*. 18 (2). <http://gamestudies.org/1802/articles/adams_rambukkana>.

</div>

<div id="ref-almeida2013a" class="csl-entry">

Almeida, M. S. O., and Silva, F. S. C. da. 2013. “A Systematic Review of Game Design Methods and Tools.” In *Entertainment Computing – ICEC 2013*, edited by Junia C. Anacleto, Esteban W. G. Clua, Flavio S. Correa da Silva, Sidney Fels, and Hyun S. Yang, 8215:17–29. Berlin, Heidelberg: Springer Berlin Heidelberg. <https://doi.org/10.1007/978-3-642-41106-9_3>.

</div>

<div id="ref-backe2021" class="csl-entry">

Backe, H.-J. 2021. “The Aesthetics of Non-Euclidean Game Spaces.” In *Game \| World \| Architectonics: Transdisciplinary Approaches on Structures and Mechanics, Levels and Spaces, Aesthetics and Perception*, edited by Marc Bonner, 153–67. Heidelberg: Heidelberg University Publishing. <https://doi.org/10.17885/heiup.752>.

</div>

<div id="ref-barr2016" class="csl-entry">

Barr, P. 2016. “Critical Jostling.” *G\|A\|M\|E Games as Art, Media, Entertainment*. 1 (5). <https://www.gamejournal.it/?p=2898>.

</div>

<div id="ref-bjork2004" class="csl-entry">

Björk, S., and Holopainen, J. 2004. *Patterns In Game Design*. Hingham, Mass: Charles River Media.

</div>

<div id="ref-bogostNewsgamesJournalismPlay2010" class="csl-entry">

Bogost, I., Ferrari, S., and Schweizer, B. 2010. *Newsgames: Journalism at Play*. Cambridge, Mass: MIT Press.

</div>

<div id="ref-boluk2017" class="csl-entry">

Boluk, S., and LeMieux, P. 2017. *Metagaming: Playing, Competing, Spectating, Cheating, Trading, Making, and Breaking Videogames*. Electronic Mediations 53. Minneapolis: University of Minnesota Press. <https://manifold.umn.edu/projects/metagaming>.

</div>

<div id="ref-bourdieu1990" class="csl-entry">

Bourdieu, P. 1990. “Structures, Habitus, Practices.” In *The Logic of Practice*, translated by Richard Nice, 52–65. Stanford, California: Stanford University Press. <https://books.google.com?id=YHN8uW49l7AC>.

</div>

<div id="ref-brown2022a" class="csl-entry">

Brown, M. 2022a. “Platformer Toolkit by Game Maker’s Toolkit.” itch.io. 2022. <https://gmtk.itch.io/platformer-toolkit>.

</div>

<div id="ref-brown2022" class="csl-entry">

———. 2022b. “Can You Fix This Platformer? By Game Maker’s Toolkit.” YouTube. June 17, 2022. <https://www.youtube.com/watch?v=zWi0jgghGcI>.

</div>

<div id="ref-buttHomoIncludensSurveying2018" class="csl-entry">

Butt, M.-A., De Wildt, L., Kowert, R., and Sandovar, A. 2018. “Homo Includens: Surveying DiGRA’s Diversity.” *Transactions of the Digital Games Research Association*. 4 (1): 66–104. <https://doi.org/10.26503/todigra.v4i1.85>.

</div>

<div id="ref-carterDemarcationProblemMultiplayer2015" class="csl-entry">

Carter, M., Gibbs, M., and Arnold, M. 2015. “The Demarcation Problem in Multiplayer Games: Boundary-Work in EVE Online’s <span class="nocase">eSport</span>.” *Game Studies*. 15 (1). <http://gamestudies.org/1501/articles/carter>.

</div>

<div id="ref-coulton2017" class="csl-entry">

Coulton, P., and Hook, A. 2017. “Games Design Research Through Game Design Practice.” In *Game Design Research: An Introduction to Theory & Practice*, edited by Petri Lankoski and Jussi Holopainen, 169–202. Pittsburgh, PA: Carnegie Mellon University: ETC Press. <https://press.etc.cmu.edu/books/game-design-research>.

</div>

<div id="ref-crawford1984" class="csl-entry">

Crawford, C. 1984. *The Art of Computer Game Design*. Berkeley, Calif: Osborne/McGraw-Hill. <http://archive.org/details/artofcomputergam00chri>.

</div>

<div id="ref-derridaFutureProfessionUniversity2001" class="csl-entry">

Derrida, J. 2001. “The Future of the Profession or the University Without Condition (Thanks to the ‘Humanities,’ What Could Take Place Tomorrow).” In *Jacques Derrida and the Humanities: A Critical Reader*, edited by Tom Cohen, 24–57. Cambridge University Press. <https://books.google.com?id=yoRKMwsOjwsC>.

</div>

<div id="ref-dormans2012" class="csl-entry">

Dormans, J. 2012. “Engineering Emergence: Applied Theory for Game Design.” Doctoral Thesis, Amsterdam: University of Amsterdam. <https://hdl.handle.net/11245/1.358623>.

</div>

<div id="ref-edgerton1985" class="csl-entry">

Edgerton, S. 1985. “The Renaissance Development of the Scientific Illustration.” In *Science and the Arts in the Renaissance*, edited by John William Shirley and F. David Hoeniger, 168–97. Plainsboro, NJ: Associated University Presses.

</div>

<div id="ref-franklin2000" class="csl-entry">

Franklin, J. 2000. “Diagrammatic Reasoning and Modelling in the Imagination: The Secret Weapons of the Scientific Revolution.” In *1543 and All That: Image and Word, Change and Continuity in the Proto-Scientific Revolution*, edited by Guy Freeland and Anthony Corones, 13:53–115. Studies in History and Philosophy of Science. Dordrecht: Springer Netherlands. <https://doi.org/10.1007/978-94-015-9478-3>.

</div>

<div id="ref-frascaSeptember12th2003" class="csl-entry">

Frasca, G. 2003. “*September 12th*.” Microsoft Windows. Newsgaming. <http://newsgaming.com/games/index12.htm>.

</div>

<div id="ref-fraylingResearchArtDesign1993" class="csl-entry">

Frayling, C. 1993. “Research in Art and Design.” *Royal College of Art*. 1 (1): 1–5. <http://www.opengrey.eu/item/display/10068/492065>.

</div>

<div id="ref-gallowaySocialRealismGaming2004" class="csl-entry">

Galloway, A. R. 2004. “Social Realism in Gaming.” *Game Studies*. 4 (1). <http://www.gamestudies.org/0401/galloway/>.

</div>

<div id="ref-gaver2012" class="csl-entry">

Gaver, W. 2012. “What Should We Expect from Research Through Design?” In *Proceedings of the SIGCHI Conference on Human Factors in Computing Systems*, 937–46. Austin Texas USA: ACM. <https://doi.org/10.1145/2207676.2208538>.

</div>

<div id="ref-gualeniVirtualWorldsPhilosophical2015" class="csl-entry">

Gualeni, S. 2015. *Virtual Worlds as Philosophical Tools: How to Philosophize with a Digital Hammer*. Houndmills, Basingstoke, Hampshire ; New York, NY: Palgrave Macmillan.

</div>

<div id="ref-gualeni2016" class="csl-entry">

———. 2016. “Self-Reflexive Videogames: Observations and Corollaries on Virtual Worlds as Philosophical Artifacts.” *G\|A\|M\|E Games as Art, Media, Entertainment*. 1 (5). <https://www.gamejournal.it/?p=2903>.

</div>

<div id="ref-gualeniPhilosophyDoingDigital2018" class="csl-entry">

———. 2018. “A Philosophy of ‘Doing’ in the Digital.” In *Towards a Philosophy of Digital Media*, 225–55. Houndmills, Basingstoke, Hampshire ; New York, NY: Palgrave Macmillan, Cham. <https://doi.org/10.1007/978-3-319-75759-9_12>.

</div>

<div id="ref-gunzel2008" class="csl-entry">

Günzel, S. 2008. “The Spatial Turn in Computer Game Studies.” In *Future and Reality of Gaming*, 147–56. Vienna: Braumüller.

</div>

<div id="ref-hunicke2004" class="csl-entry">

Hunicke, R., LeBlanc, M., and Zubek, R. 2004. “MDA: A Formal Approach to Game Design and Game Research.” In *Proceedings of the AAAI Workshop on Challenges in Game AI*, 4:1722. 1. San Jose, CA.

</div>

<div id="ref-jakobsson2003" class="csl-entry">

Jakobsson, M. 2003. “A Virtual Realist Primer to Virtual World Design.” In *Searching Voices: Towards a Canon for Interaction Design*, edited by Pelle Ehn and Jonas Löwgren. Studies in Arts and Communication 01. Malmö: School of Arts and Communication, Malmö University.

</div>

<div id="ref-jenkins2005" class="csl-entry">

Jenkins, H. 2005. “Games, the New Lively Art.” In *Handbook of Computer Game Studies*, edited by Joost Raessens and Jeffrey Goldstein, 175–89. Cambridge, Mass: MIT Press.

</div>

<div id="ref-juul2004" class="csl-entry">

Juul, J. 2004. “Jesper Juul: Time To Play.” In *First Person: New Media as Story, Performance and Game*, edited by Noah Wardrip-Fruin, 131–42. Cambridge, Mass.: MIT Press. <https://www.jesperjuul.net/text/timetoplay/>.

</div>

<div id="ref-juulGameVideoGame2021" class="csl-entry">

———. 2021. “The Game of Video Game Objects: A Minimal Theory of When We See Pixels as Objects Rather Than Pictures.” In *Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play*, 376–81. Virtual Event Austria: ACM. <https://doi.org/10.1145/3450337.3483449>.

</div>

<div id="ref-khaled2023" class="csl-entry">

Khaled, R., and Barr, P. 2023. “Generative Logics and Conceptual Clicks: A Case Study of the Method for Design Materialization.” *Design Issues*. 39 (1): 55–69. <https://doi.org/10.1162/desi_a_00706>.

</div>

<div id="ref-khaledDocumentingTrajectoriesDesign2018" class="csl-entry">

Khaled, R., Lessard, J., and Barr, P. 2018. “Documenting Trajectories in Design Space: A Methodology for Applied Game Design Research.” In *Proceedings of the 13th International Conference on the Foundations of Digital Games*, 1–10. Malmö Sweden: ACM. <https://doi.org/10.1145/3235765.3235767>.

</div>

<div id="ref-kultimaGameDesignResearch2015" class="csl-entry">

Kultima, A. 2015. “Game Design Research.” In *Proceedings of the 19th International Academic Mindtrek Conference*, 18–25. Tampere Finland: ACM. <https://doi.org/10.1145/2818187.2818300>.

</div>

<div id="ref-lankoski2017" class="csl-entry">

Lankoski, P., and Holopainen, J., eds. 2017. *Game Design Research: An Introduction to Theory & Practice*. Pittsburgh, PA: Carnegie Mellon University: ETC Press. <https://press.etc.cmu.edu/books/game-design-research>.

</div>

<div id="ref-latour1986" class="csl-entry">

Latour, B. 1986. “Visualisation and Cognition: Drawing Things Together.” In *Knowledge and Society Studies in the Sociology of Culture Past and Present*, edited by Henrika Kuklick, 6:1–40. Greenwich, London: Jai Press. <http://www.bruno-latour.fr/sites/default/files/21-DRAWING-THINGS-TOGETHER-GB.pdf>.

</div>

<div id="ref-malazita2023" class="csl-entry">

Malazita, J., and O’Donnell, C. 2023. “Introduction: Toward Critical Game Design.” *Design Issues*. 39 (1): 4–13. <https://doi.org/10.1162/desi_e_00702>.

</div>

<div id="ref-martin2018" class="csl-entry">

Martin, P. 2018. “The Intellectual Structure of Game Research.” *Game Studies*. 18 (1). <http://gamestudies.org/1801/articles/paul_martin>.

</div>

<div id="ref-mayraDisciplinaryIdentityGame2014" class="csl-entry">

Mäyrä, F., Van Looy, J., and Quandt, T. 2014. “Disciplinary Identity of Game Scholars: An Outline.” In *DiGRA ’13 - Proceedings of the 2013 DiGRA International Conference: DeFragging Game Studies*. Vol. 7. Atlanta, Georgia: DiGRA. <http://www.digra.org/digital-library/publications/disciplinary-identity-of-game-scholars-an-outline/>.

</div>

<div id="ref-melcer2015" class="csl-entry">

Melcer, E. F., Nguyen, T.-H. D., Chen, Z., Canossa, A., El-Nasr, M. S., and Isbister, K. 2015. “Games Research Today: Analyzing the Academic Landscape 2000-2014.” In *Proceedings of the 10th International Conference on the Foundations of Digital Games (FDG 2015)*. <http://www.fdg2015.org/papers/fdg2015_paper_41.pdf>.

</div>

<div id="ref-nitsche2007" class="csl-entry">

Nitsche, M. 2007. “Mapping Time in Video Games.” In *Proceedings of DiGRA2007: Situated Play*, 4:145–51. University of Tokyo. <http://www.digra.org/digital-library/publications/mapping-time-in-video-games/>.

</div>

<div id="ref-prochner2022" class="csl-entry">

Prochner, I., and Godin, D. 2022. “Quality in Research Through Design Projects: Recommendations for Evaluation and Enhancement.” *Design Studies*. 78 (January): 101061. <https://doi.org/10.1016/j.destud.2021.101061>.

</div>

<div id="ref-ramsay2011" class="csl-entry">

Ramsay, S. 2011. *Reading Machines: Toward and Algorithmic Criticism*. University of Illinois Press. <https://books.google.com?id=14KPI0ORQigC>.

</div>

<div id="ref-robinett2006" class="csl-entry">

Robinett, W. 2006. “Adventure as a Video Game: Adventure for the Atari 2600.” In *The Game Design Reader: A Rules of Play Anthology*, edited by Katie Salen and Eric Zimmerman, 690–713. Cambridge, Mass: MIT Press.

</div>

<div id="ref-salen2003" class="csl-entry">

Salen, K., and Zimmerman, E. 2003. *Rules of Play: Game Design Fundamentals*. Cambridge, Mass: The MIT Press.

</div>

<div id="ref-schmid2015" class="csl-entry">

Schmid, A.-F. 2015. “On Contemporary Objects.” In *Simulation, Exercise, Operations*, translated by Robin Mackay, 63–68. Falmouth, United Kingdom: Urbanomic. <https://primer.dk/onsite/Projects/Ripe/Anne-Francoise-Schmid-On-Contemporary-Objects-2012>.

</div>

<div id="ref-schmid2018" class="csl-entry">

———. 2018. “The Philosophical Underpinnings of Design Theory.” In *Advancements in the Philosophy of Design*, edited by Pieter E. Vermaas and Stéphane Vial, 415–30. Design Research Foundations. Cham: Springer International Publishing. <https://doi.org/10.1007/978-3-319-73302-9_19>.

</div>

<div id="ref-schmid2014" class="csl-entry">

Schmid, A.-F., and Hatchuel, A. 2014. “On Generic Epistemology.” Translated by Robin Mackay. *Angelaki*. 19 (2): 131–44. <https://doi.org/10.1080/0969725X.2014.950868>.

</div>

<div id="ref-sicartNewsgamesTheoryDesign2008" class="csl-entry">

Sicart, M. 2008. “Newsgames: Theory and Design.” In *International Conference on Entertainment Computing*, 27–33. Springer. <https://link.springer.com/chapter/10.1007/978-3-540-89222-9_4>.

</div>

<div id="ref-stenros2018" class="csl-entry">

Stenros, J., and Kultima, A. 2018. “On the Expanding Ludosphere.” *Simulation & Gaming*. 49 (3): 338–55. <https://doi.org/10.1177/1046878118779640>.

</div>

<div id="ref-stoneTimeReparativeGame2018" class="csl-entry">

Stone, K. 2018. “Time and Reparative Game Design: Queerness, Disability, and Affect.” *Game Studies*. 18 (3). <http://gamestudies.org/1803/articles/stone>.

</div>

<div id="ref-swink2008a" class="csl-entry">

Swink, S. 2008a. “Demos.” Game Feel. 2008. <http://www.game-feel.com/?page_id=8>.

</div>

<div id="ref-swink2008" class="csl-entry">

———. 2008b. *Game Feel: A Game Designer’s Guide to Virtual Sensation*. Amsterdam ; Boston: CRC Press.

</div>

<div id="ref-totten2014" class="csl-entry">

Totten, C. W. 2014. *An Architectural Approach to Level Design*. Boca Raton: CRC Press. <https://books.google.com?id=QOzMAwAAQBAJ>.

</div>

<div id="ref-totten2017" class="csl-entry">

———, ed. 2017. *Level Design: Processes and Experiences*. Boca Raton: CRC Press.

</div>

<div id="ref-tylen2014" class="csl-entry">

Tylén, K., Fusaroli, R., Bjørndahl, J. S., Raczaszek-Leonardi, J., Østergaard, S., and Stjernfelt, F. 2014. “Diagrammatic Reasoning: Abstraction, Interaction, and Insight.” *Pragmatics & Cognition*. 22 (2): 264–83. <https://doi.org/10.1075/pc.22.2.06tyl>.

</div>

<div id="ref-waern2015" class="csl-entry">

Waern, A., and Back, J. 2015. “Experimental Game Design.” In *Game Research Methods*, edited by Petri Lankoski and Staffan Björk, 341–53. Pittsburgh, PA, USA: ETC Press.

</div>

<div id="ref-walk2017" class="csl-entry">

Walk, W., Görlich, D., and Barrett, M. 2017. “Design, Dynamics, Experience (DDE): An Advancement of the MDA Framework for Game Design.” In *Game Dynamics*, edited by Oliver Korn and Newton Lee, 27–45. Cham: Springer International Publishing. <https://doi.org/10.1007/978-3-319-53088-8_3>.

</div>

<div id="ref-zimmerman2008" class="csl-entry">

Zimmerman, J., and Forlizzi, J. 2008. “The Role of Design Artifacts in Design Theory Construction.” *Artifact*. 2 (1, 1): 41–45. <https://doi.org/10.1080/17493460802276893>.

</div>

<div id="ref-zimmerman2007" class="csl-entry">

Zimmerman, J., Forlizzi, J., and Evenson, S. 2007. “Research Through Design as a Method for Interaction Design Research in HCI.” In *Proceedings of the SIGCHI Conference on Human Factors in Computing Systems*, 493–502. San Jose California USA: ACM. <https://doi.org/10.1145/1240624.1240704>.

</div>

</div>

[^1]: See for example the recent trend of ‘graphical’ or ‘visual abstracts’ which are increasingly required together with paper submissions in fields of natural science, <https://www.elsevier.com/authors/tools-and-resources/visual-abstract>. Accessed January 20, 2023.

[^2]: Notably, such media are missing from contributions related to the “spatial turn” (see Günzel 2008 and referenced contributions).

[^3]: See the 20<sup>th</sup> anniversary editorial of GSJ discussing the founding editors’ lack of publishing experience, the desire to create an online journal in the model of the earlier *Postmodern Culture* journal, and the journal’s dependence on volunteer labor (Aarseth 2021).

[^4]: “Portable Document Format” (PDF); royalty-free standard controlled by Adobe.

[^5]: To give an example from the Nordics – where game studies is more likely to be an accredited field of research – the Publication Forum of the Finnish scientific community (JUFO) lists the GSJ as a “leading” publication with a score of two out of three. For comparison, the only other venues accredited in this channel from those mentioned here, are the Eludamos journal, the DiGRA conference and ToDiGRA journal with a score of one, while the journals GAME, Loading, and Press Start are listed with a zero score. Only Games and Culture (of Sage) is ranked higher with a score of three. See [www.tsv.fi/julkaisufoorumi/haku.php](https://www.tsv.fi/julkaisufoorumi/haku.php?nimeke=game+studies&konferenssilyh=&issn=&tyyppi=kaikki&kieli=&maa=&wos=&scopus=&nappi=Search). Accessed January 27, 2023.

[^6]: This is regardless of whether the actual papers themselves are accessible to the researcher via institutional subscription, in case they are not open access.

[^7]: To the author’s best of knowledge, with the exception of GSJ, the few established games studies venues publish in A4-type PDF format. Such cases include the journals [TODiGRA](http://todigra.org/), [Eludamos](https://www.eludamos.org/index.php/eludamos), [Loading](https://journals.sfu.ca/loading/index.php/loading) and [Press Start](https://press-start.gla.ac.uk/index.php/press-start/) – as well as non open access ones, published for example by Sage. The same is the case for the published proceedings or manuscripts of DiGRA and the Philosophy of Computer Games conference. An exception is [GAME](https://www.gamejournal.it/) journal published both in PDF and in website form.

[^8]: For the journals Eludamos, Loading, and Press Start, which only mention figures and tables for non-text elements, see [Eludamos Journal - Online submission information](https://www.eludamos.org/index.php/eludamos/about/submissions#onlineSubmissions), [Loading Journal - Author guidelines](https://journals.sfu.ca/loading/index.php/loading/about/submissions), and [Press Start - Information for authors](https://press-start.gla.ac.uk/index.php/press-start/information/authors). Accessed January 10, 2023.

[^9]: The paragraph in question from the latest submission templates for both DiGRA and ToDIGRA adds: “However, the paper should stand on its own without such media, as they may not be available to everyone who reads the paper” ([CALL FOR PAPERS DIGRA 2023](http://www.digra.org/call-for-papers-digra-2023-international-conference/) and [ToDIGRA author guidelines](http://todigra.org/index.php/todigra/about/submissions#authorGuidelines)). Nevertheless, to our best of knowledge, no such artifacts are archived in the DiGRA library.

[^10]: For GSJ submission guidelines see [gamestudies.org/2102/submission_guidelines](http://gamestudies.org/2102/submission_guidelines). Accessed January 10, 2023.

[^11]: 95% of all images found in GSJ are under 200KB. Image size limitations are likely a legacy term originating in the journal’s foundation in 2001, intended for accessibility or facilitation of on-demand printing. Nevertheless, in rare cases GSJ contributions host click-to-enlarge images (see Galloway 2004).

[^12]: As discussed in the next section, the journal’s policy regarding hyperlinks (click-able URLs) is unclear. Its guidelines only ask to verify URLs, and do no discuss hyperlinks, while a note on “Internet Addresses” does not hyperlink its examples (see endnote 10).

[^13]: Both Unity and Unreal Engine (game engines that currently account for the majority of the game development market share including indie development; royalty-free for non-commercial applications), can compile into HTML5 format that can be embedded in websites. For an example from academic scholarship see the videogame artifact developed as part of a contribution by Juul (2021). See also Brown (2022a)

[^14]: The version of the GSJ archive scanned is <http://gamestudies.org/2103/archive>.

[^15]: For specific issues with the structure of the GSJ website and how they were tackled in this inquiry see source code annotations. Examples of these include lack of HTML structures to identify paper metadata (i.e. title, authors, abstract, date, and keywords; although not necessary for the present inquiry), which also impair citation retrieval tools that work for some but not all entries of the journal; inconsistent formatting of entry pages; changing norms in journal URL conventions (from 2006); various HTML formatting errors; mistyped or erroneous external links; and occasional omissions of keywords.

[^16]: Distinctions between entry types (e.g. editorials, book reviews, and peer-reviewed papers) are only stated at the level of a journal issue, and can be deduced through reading only – not by metadata classification, keywords, or entry title. Only ‘Call for Papers’ entries were consistently marked and were filtered out.

[^17]: The table category is rather problematic for the GSJ. Tables are found both as HTML-formatted ones and also as rasterized images. The latter case is presented in the following section on image classification.

[^18]: The spreadsheet used for the classification is provided with this contribution as well as the source code to generate, load, and visualize alternative classifications.

[^19]: Hyperlinks are text segments associated with an external link via HTML. The URLs collected where stripped to obtain the base website, with common such patterns matched across entries. This does not include cases where a URL appears as plain text.

[^20]: “Digital Object Identifier” (DOI) handles to published material.

[^21]: Excluding the three mentioned exceptions with non-printable media, all other entries (98%) could practically be reproduced in a conventional academic publishing template.

[^22]: To give an example, computer games are mentioned as “not one medium, but many different media” in the first editorial of the GSJ (Aarseth 2001).

[^23]: For examples of classic oft-quoted publications by game designers see the works of Chris Crawford, Katie Salen and Eric Zimmerman. Transactions with design are not uncommon for the GSJ either. In addition to published interviews with game designers, there is at least one case that provides visual documentation and discussion of a game development process (see Stone 2018).

[^24]: The domain-bridging capacity of design is corroborated by Martin (2018).

[^25]: Aarseth’s bias against design and mentions of its ‘underdeveloped theory’ can also be observed in casual remarks from a keynote presentation where he commented the following: “game design is really dangerous, \[it\] has the nice position of being in the middle. Everybody can relate to game design \[…\] So even if game design doesn’t have a lot of strong theory, they have a very strong practical position in this field. Therefore, you have a lot of power \[…\] That’s why I am afraid of you” (transcript from Aarseth 2014, 22:00). Additionally, the only related mention in the journal’s first editorial frames design within “technical design aspects” (Aarseth 2001).

[^26]: It is outside of the scope of this article to argue for the heritage of design discourses. For extensive discussions of design research for the context of game studies see Stenros and Kultima (2018), and Lankoski and Holopainen (2017).

[^27]: See [MSc in Games, at ITU Copenhagen](https://en.itu.dk/Programmes/MSc-Programmes/Games#who-studies-games) and [MSc in Digital Games at University of Malta](https://www.um.edu.mt/digitalgames/students). Accessed January 10, 2023.

[^28]: For “playable philosophy” videogames see [gua-le-ni.com/games](https://gua-le-ni.com/games), and for related literature see Gualeni (2015, 2016, 2018). Accessed January 29, 2023.

[^29]: For videogames by Barr see <https://pippinbarr.com/games/>, and for discussions of his practice see Khaled and colleagues (2018; 2023). Accessed January 29, 2023.

[^30]: See [cpandfriends.com](http://cpandfriends.com/) and [maryflanagan.com/games](https://maryflanagan.com/games/). Accessed January 10, 2023.

[^31]: See <https://alt254.itch.io/> and discussion in Boluk and LeMieux (2017, 26–75). Accessed January 29, 2023.

[^32]: For issue 2016 (1) of GAME “Games on Games. Game design as critical reflexive practice” see <https://www.gamejournal.it/issues/game-n-52016/vol-1-journal/>. Accessed 30 January 2023.

[^33]: See also Crawford’s other pioneering initiatives into game design discourse such as the *Journal of Computer Game Design*, a subscription magazine founded in 1987, renamed to *Journal of Interactive Entertainment Design* in 1993 and disbanded in 1996 (partly archived in <http://www.erasmatazz.com/library/the-journal-of-computer/index.html>. Accessed January 30, 2023), through which he initiated the *Game Design Symposium* in 1988, that evolved into the *Game Developers Conference*.

[^34]: For the videogame counterpart of the “playable essay see [www.jesperjuul.net/text/gameofobjects](https://www.jesperjuul.net/text/gameofobjects/).” Accessed January 9, 2023. Note that the artifact is not archived by the publication venue but by the author.
