Issue 15.1

AudioVisual Data in DH

Edited by Taylor Arnold, Jasmijn van Gorp, Stefania Scagliola, and Lauren Tilton

Introduction: Special Issue on AudioVisual Data in DH
  • Taylor Arnold
  • Stefania Scagliola
  • Lauren Tilton
  • Jasmijn Van Gorp
  • images
  • dh
  • media studies
  • moving images
  • sound
  • visual art
  • philosophy
    EN

    This is the introduction to the special issue on AudioVisual data in DH.

    Founding the Special Interest Group Audio-Visual in Digital Humanities: An Interview with Franciska de Jong, Martijn Kleppe, and Max Kemman
    • Stefania Scagliola
    • moving images
    • sound
    • dh
    • media studies
    • images
      EN

      This is an interview on the founding of the ADHO AVinDH Special Interest Group.

      Exploring Film Language with a Digital Analysis Tool: the Case of Kinolab
      • Allison Cooper
      • Fernando Nascimento
      • David Francis
      • project report
      • moving images
      • databases
      • annotation
      • access
      • semantic web
        EN

        This article presents a case study of Kinolab, a digital platform for the analysis of narrative film language.

        Audiovisualities out of Annotation: Three Case Studies in Teaching Digital Annotation with Mediate
        • Joel Burges
        • Solvegia Armoskaite
        • Tiamat Fox
        • Darren Mueller
        • Joshua Romphf
        • Emily Sherwood
        • Madeline Ullrich
        • annotation
        • tools
        • moving images
        • media studies
        • project report
        • users
        • sound
          EN

          This article describes Mediate: An Annotation Tool for Audiovisual Media, developed at the University of Rochester, and emphasizes the platform as a source for the understanding of film, television, poetry, pop songs, live performance, music, and advertising as shown in three cases studies from film and media studies, music history, and linguistics.

          The Media Ecology Project: Collaborative DH Synergies to Produce New Research in Visual Culture History
          • Mark Williams
          • John Bell
          • history
          • media studies
          • data curation
          • archives
          • images
          • project management
            EN

            This essay details the development and current NEH-funded research goals of The Media Ecology Project (MEP), directed by Prof. Mark Williams and designed by Dr. John Bell at Dartmouth.

            Audiated Annotation from the Middle Ages to the Open Web
            • Tanya E. Clement
            • Liz Fischer
            • music
            • annotation
            • access
            • sound
            • cultural criticism
              EN

              This short article introduces audiation as an alternate theoretical framing for articulating the significance of personal literary annotations.

              Healing the Gap: Digital Humanities Methods for the Virtual Reunification of Split Media and Paper Collections
              • Stephanie Sapienza
              • Eric Hoyt
              • Matt St. John
              • Ed Summers
              • JJ Bersch
              • data curation
              • access
              • project report
              • minimal computing
              • project management
                EN

                This paper introduces and unpacks several challenges faced by stewards who work with audiovisual resources, departing from the premise that audiovisual resources are undervalued and underutilized as primary source materials for scholarship and therefore receive less attention in the sphere of digital humanities.

                PodcastRE Analytics: Using RSS to Study the Cultures and Norms of Podcasting
                • Eric Hoyt
                • J.J. Bersch
                • Susan Noh
                • Samuel Hansen
                • Jacob Mertens
                • Jeremy Wade Morris
                • metadata
                • data visualization
                • data curation
                • digitization
                  EN

                  We share three different methods for studying RSS feeds and podcast metadata: 1) visualizing how topics and keywords trend over time; 2) visualizing networks of common associated keywords entered by podcasters; and 3) analyzing norms and common practices for the duration of podcasts (as a time-based media format, podcasting is unusual in that it is not bound by the programming schedules and technical limitations that provide strict parameters for most audiovisual forms).

                  Transdisciplinary Analysis of a Corpus of French Newsreels: The ANTRACT Project
                  • Jean Carrive
                  • Abdelkrim Beloued
                  • Pascale Goetschel
                  • Serge Heiden
                  • Antoine Laurent
                  • Pasquale Lisena
                  • Franck Mazuet
                  • Sylvain Meignier
                  • Bénédicte Pincemin
                  • Géraldine Poels
                  • Raphaël Troncy
                  • moving images
                  • history
                  • project report
                  • tools
                  • archives
                  • semantic web
                    EN

                    The ANTRACT project is a cross-disciplinary apparatus dedicated to the analysis of the French newsreel company Les Actualités Françaises (1945-1969) and its film productions.

                    Topological properties of music collaboration networks: The case of Jazz and Hip Hop
                    • Lukas Gienapp
                    • Clara Kruckenberg
                    • Manuel Burghardt
                    • music
                    • collaboration
                    • music
                    • network
                      EN

                      We propose a generalizable approach to studying the topological properties of music collaboration networks within and between genres that relies on data from the freely available Discogs database.

                      Afrofuturist Intellectual Mixtapes: A Classroom Case Study
                      • Tyechia L. Thompson
                      • Dashiel Carrera
                      • pedagogy
                      • music
                      • project report
                      • race
                        EN

                        This article is a classroom case study of the Intellectual Mixtape Project, an AudioVisual digital humanities module.

                        Annotating our Environs with the Sound and Sight of Numbers: The DataScapes Project
                        • John Bonnett
                        • Joe Bolton
                        • William Ralph
                        • Amy Legault
                        • Erin MacAfee
                        • Michael Winter
                        • Chris Jaques
                        • Mark Anderson
                        • ar
                        • digitization
                        • sound
                        • performance
                          EN

                          The DataScapes Project is an exploration of how Augmented Reality objects can be used as constituents for Landscape Architecture.

                          What Does A Photograph Sound Like? Digital Image Sonification As Synesthetic AudioVisual Digital Humanities
                          • Michael J. Kramer
                          • images
                          • digitization
                          • interdisciplinarity
                          • sound
                          • gender
                            EN

                            I investigate how digital image sonification amplifies issues of gender, power, embodiment, spectacle, performance, hierarchy, and performance in a photograph of Joan Baez` performing at the Greek Amphitheater in Berkeley, California, during the early 1960s.

                            From close listening to distant listening: Developing tools for Speech-Music discrimination of Danish music radio
                            • Iben Have
                            • Kenneth Enevoldsen
                            • music
                            • digitization
                            • history
                            • machine learning
                              EN

                              This article investigates the research question: How has the distribution of music and talk on the Danish Broadcasting Corporation’s radio channel P3 developed 1989-2019 by comparing a qualitative case study with a new large-scale study.

                              Hearing Change in the Chocolate City: Computational Methods for Listening to Gentrification
                              • Alison Martin
                              • race
                              • social justice
                              • geospatial
                              • sound
                              • history
                              • public history
                              • anthropology
                                EN

                                This article uses ethnography and computational soundscape to listen to processes of gentrification in Washington, DC.

                                Advances in Digital Music Iconography: Benchmarking the detection of musical instruments in unrestricted, non-photorealistic images from the artistic domain
                                • Matthia Sabatelli
                                • Nikolay Banar
                                • Marie Cocriamont
                                • Eva Coudyzer
                                • Karine Lasaracina
                                • Walter Daelemans
                                • Pierre Geurts
                                • Mike Kestemont
                                • tools
                                • music
                                • images
                                • machine learning
                                • visual art
                                  EN

                                  In this paper, we present MINERVA, the first benchmark dataset for the detection of musical instruments in non-photorealistic, unrestricted image collections from the realm of the visual arts.

                                  Music Theory, the Missing Link Between Music-Related Big Data and Artificial Intelligence
                                  • Jeffrey A. T. Lupker
                                  • William J. Turkel
                                  • music
                                  • machine learning
                                    EN

                                    This paper examines musical artificial intelligence (AI) algorithms that can not only learn from big data, but learn in ways that would be familiar to a musician or music theorist.

                                    Comparative K-Pop Choreography Analysis through Deep-Learning Pose Estimation across a Large Video Corpus
                                    • Peter Broadwell
                                    • Timothy R. Tangherlini
                                    • machine learning
                                    • content analysis
                                    • performance
                                    • moving images
                                    • area studies
                                      EN

                                      In this paper, we describe the considerations and choices made in the process of applying deep learning-based posed detection to a large corpus of K-pop music videos, and present the analytical methods we developed while focusing on a smaller subset of dance practice videos.

                                      Moving Cinematic History: Filmic Analysis through Performative Research
                                      • Jenny Oyallon-Koloski
                                      • Dora Valkanova
                                      • Michael J. Junokas
                                      • Kayt MacMaster
                                      • Sarah Marks Mininsohn
                                      • images
                                      • tools
                                      • moving images
                                      • performance
                                        EN

                                        We argue for the value of motion capture-driven research that moves audiovisual analysis in a performative direction to integrate the dancer/researcher into the cinematic space.

                                        Towards a User-Friendly Tool for Automated Sign Annotation: Identification and Annotation of Time Slots, Number of Hands, and Handshape
                                        • Manolis Fragkiadakis
                                        • Victoria Nyst
                                        • Peter van der Putten
                                        • users
                                        • access
                                        • annotation
                                        • machine learning
                                        • tools
                                        • corpora
                                        • data visualization
                                          EN

                                          The aim of this project is to develop a set of tools to assist the annotation of the signs and their formal features in a video irrespectively of its content and quality.

                                          Books Aren't Dead: Resurrecting Audio Technology and Feminist Digital Humanities Approaches to Publication and Authorship
                                          • Emily Edwards
                                          • Robin Hershkowitz
                                          • gender
                                          • media history
                                          • access
                                            EN

                                            This article explores how the podcast medium as a form of audio technology has facilitated the reimagining of academic publication and feminist praxis.

                                            Another Type of Human Narrative: Visualizing Movement Histories Through Motion Capture Data and Virtual Reality
                                            • Eugenia S. Kim
                                            • ar
                                            • oral history
                                            • data curation
                                            • performance
                                            • digitization
                                              EN

                                              In this article I propose that motion capture (mocap) and virtual reality (VR) technology can be used to record and visualize movement histories as a supplement to oral histories or for when a memory is based in a embodied experience.

                                              Deformin' in the Rain: How (and Why) to Break a Classic Film
                                              • Jason Mittell
                                              • moving images
                                              • images
                                              • cultural criticism
                                              • digitization
                                              • sound
                                              • visual art
                                                EN

                                                Following upon the strain of digital humanities practice that Mark Sample terms the deformed humanities, this essay subjects a single film to a series of deformations: the classic musical Singin' in the Rain.

                                                Book Review: Digital Sound Studies (2018)
                                                • Tracey El Hajj
                                                • dh
                                                • sound
                                                • access
                                                • pedagogy
                                                  EN

                                                  A book review of the edited volume Digital Sound Studies.

                                                  Göttingen Dialogues in Digital Humanities

                                                  Edited by Marco Büchler

                                                  Introduction to Göttingen Dialogues 2016
                                                  • Marco Büchler
                                                      EN

                                                      An introduction to the special issue on the 2016 Göttingen Dialogues

                                                      Hierarchical or Non-hierarchical? A Philosophical Approach to a Debate in Text Encoding
                                                      • Alois Pichler
                                                      • markup
                                                      • manuscripts
                                                      • philosophy
                                                      • reading
                                                        EN

                                                        XML is apt for the encoding of complex manuscript materials.

                                                        Annotating ritual in ancient Greek tragedy: a bottom-up approach in action
                                                        • Gloria Mugelli
                                                        • Federico Boschetti
                                                        • Andrea Bellandi
                                                        • Riccardo Del Gratta
                                                        • Anas Fahad Khan
                                                        • Andrea Taddei
                                                        • classics
                                                        • history
                                                        • tools
                                                        • databases
                                                        • users
                                                        • annotation
                                                        • project report
                                                        • textual annotation
                                                        • bottom-up approach
                                                        • domain specific languages
                                                        • ontologies
                                                        • ancient Greek
                                                        • ancient Greek tragedy
                                                        • ritual
                                                        • religion
                                                        EN

                                                        Description of the Euporia annotation system.

                                                        Can an author style be unveiled through word distribution?
                                                        • Giulia Benotto
                                                        • stylistics
                                                        • literary studies
                                                        • distributional semantics
                                                        • stylometry
                                                        • vector space model
                                                        • italian literature
                                                        • verism
                                                        • autorship attribution
                                                        • human stylome
                                                        EN

                                                        This article explores whether authorship can be attributed through word distribution by applying distributional semantics to a corpus of Italian literature.

                                                        Using an Advanced Text Index Structure for Corpus Exploration in Digital Humanities
                                                        • Tobias Englmeier
                                                        • Marco Büchler
                                                        • Stefan Gerdjikov
                                                        • Klaus U. Schulz
                                                        • data visualization
                                                        • corpora
                                                        • data analytics
                                                        • corpus exploration
                                                        • metadata
                                                        • phrase extraction
                                                        • text alignment
                                                        • SCDAWG
                                                        • index structures
                                                        EN

                                                        A study investigating the application of the SCDAWG index structure for large scale corpus exploration

                                                        Computer Vision and the Creation of a Database of Printers’ Ornaments
                                                        • Hazel Wilkinson
                                                        • James Briggs
                                                        • Dirk Gorissen
                                                        • databases
                                                        • project report
                                                        • graphic design
                                                        • digitization
                                                        • visual art
                                                        • computer vision
                                                        • machine learning
                                                        • book history
                                                        • fleuron
                                                        • ornaments
                                                        • database
                                                        EN

                                                        The creation of a database of a million printers’ ornaments.

                                                        Inferring standard name form, gender and nobility from historical texts using stable model semantics
                                                        • Davor Lauc
                                                        • Darko Vitek
                                                        • history
                                                        • tools
                                                        • project report
                                                        • sequence tagging
                                                        • proper name normalisation
                                                        • answer set programming
                                                        EN

                                                        How to perform a fine-grained named entity recognition of proper names?

                                                        German Narratives in International Television Format Adaptations: Comparing Du und Ich (ZDF 2002) with Un Gars, Une Fille (Quebec 1997-2002)
                                                        • Edward Larkey
                                                        • moving images
                                                        • cultural criticism
                                                        • history
                                                        • area studies
                                                        • annotation
                                                          EN

                                                          A comparison of the Quebec sitcom Un Gars, Une Fille ("A Guy and a Girl") to its German remake using Adobe Premiere Pro annotation software and in the context of post-WWII emotional repression.

                                                          From the Presupposition of Doom to the Manifestation of Code: Using Emulated Citation in the Study of Games and Cultural Software
                                                          • Eric Kaltman
                                                          • Joseph Osborn
                                                          • Noah Wardrip-Fruin
                                                          • games
                                                          • citation
                                                          • standards
                                                          • archives
                                                            EN

                                                            Presentation of a prototype tool for citing games and software

                                                            Fostering Community Engagement through Datathon Events: The Archives Unleashed Experience
                                                            • Samantha Fritz
                                                            • Ian Milligan
                                                            • Nick Ruest
                                                            • Jimmy Lin
                                                            • transcription
                                                            • collaboration
                                                            • archives
                                                            • users
                                                            • access
                                                              EN

                                                              Examines community engagement with datathon events to propose how to build and engage users in open-source DH projects

                                                              Leonardo, Morelli, and the Computational Mirror
                                                              • Alison Langmead
                                                              • Christopher J. Nygren
                                                              • Paul Rodriguez
                                                              • Alan Craig
                                                              • collaboration
                                                              • visual art
                                                              • machine learning
                                                              • digitization
                                                                EN

                                                                Explores the value, role, and pitfalls for digitel methods of art attribution