Frankenstein’s Telephone

Frankenstein's Telephone, supported by City of Melbourne covid19 grants

Frankenstein’s Telephone is now an interactive online Artificial Intelligence art exhibition. Visit www.frankensteinstelephone.com to view my works and create your own.

Sponsored by the City of Melbourne Covid 19 Arts grants.

Frankenstein's telephone coming June 30, proudly supported by the City of Melbourne covid29 relief grants

‘Frankenstein’s Telephone’ is a conceptual artwork created using artificial intelligence to examine how computer vision expresses gender classifications. Each of the images in the sequence  are snapshots of that document how various neural networks have generated an image based on a prompt phrase. The steps taken to create the sequence are as follows:

  1. Select an image caption from the Broadly Gender Spectrum Collection. 
  2. Enter the caption into ATTN GAN, a generative adversarial network that creates an image based on the caption.
  3. The image generated by ATTN GAN is then uploaded to DeepLab, an artificial intelligence algorithm that segments and classifies parts of an image as people and types of objects.
  4. The resulting abstract segmented and classified image is then fed to SPADE-COCO, a generative adversarial network that generates a new image based on the segmented labeled image.
  5. The resulting image is then fed to IM2TXT, a neural image caption generator. The final screenshot is the desaturated image with the resulting caption. 
  6. REPEAT using the resulting caption until the caption no longer references a person or people.

Through this process, I want to consider how neural networks and machine vision deal with gender and how the design of these networks and technologies reflect the bias and perspective the humans who designed these artificial intelligence systems. All AI systems are trained using a datasets selected and curated by people and therefore reflect inherent bias. What is interesting is interrogating how the resulting AI responds to its training parameters and generates outputs that evolve and shift over time.

This work is an AI version of the game ‘telephone’ where a message is passed around a circle of players by whispering in a neighbour’s ear, who then passes on their version of what they heard. The resulting message is often humorously garbled. In ‘Frankenstein’s Telephone’, I am interested in the shifts pertaining to gender and personhood. The sequence of different AI systems reveals aspects of how AI classification works and, potentially, where bias occurs and which parts of the chain are weakest.

The red color in the segmentation assigned in DeepLab is ungendered. It simply stands for “person”. I believe that the simplicity of that classification category is what we should aspire to. As demonstrated in these works, however, some of these open source AI networks have been designed to ascribe gender. The discomfiting images of computer generated humanity calls to mind the story of Frankenstein’s monster, a narrative that many queer people, especially transgender people, identify with. The real monsters are the people behind the scenes that unconsciously perpetuate bias. The datasets used in these works are created by humans and are labeled by humans. The captions use gendered language written by humans and interpreted by machine. This is where the bias comes from, this is where the mistakes and misgendering occur. These machine generated conceptions of humanity, with their unexpected forms and eyes and mouths could be seen as modern monsters, but no less deserving of their label “person”.