Turing Tests in the Creative Arts

2017 Turing Tests in the Creative Arts

Sponsored by The Neukom Institute for Computational Science at Dartmouth College
Partners: The Departments of Music, Mathematics, and Computer Science Dartmouth College; The 2017 Conference in Computational Creativity; The Santa Fe Institute

Organizers: Michael Casey, Kirstyn Leuner, Allen Riddell, Dan Rockmore, Gus Xia

Turing Test Competition in Literary Arts

This competition includes several performance tasks in literary arts. Competitors are asked to create machines that can produce sonnets and complete short stories. An artificial writer passes this Turing test if human judges cannot distinguish the machine output from human output given the same challenge. The winners of each task category, PoetiX and DigiLit, will be awarded $2000. Prizes may also be given at the discretion of the judges for outstanding efforts.

DigiLit 2017

The DigiLit prize competition encourages the creation of algorithms able to produce "human-level" short story writing that is indistinguishable from an “average” human effort. A 2016 competition revealed just how difficult this is. For 2017, the organizers will give a prize to contestants able to create algorithms that best complete a short story. That is, given a roughly 1000-2000 word story prompt that has no ending, contestant must generate a 300-500-word conclusion to the story.

See the DigiLit 2017 Rules

PoetiX 2017

PoetiX is a competition in computer-generated sonnet writing. This competition ran in 2016 and generated some outstanding creative work. See http://bregman.dartmouth.edu/turingtests/poetix for the 2016 results. While, there are many forms of the sonnet, for the purposes of the prize we are considering only “traditional” sonnets: fourteen line poems, in iambic pentameter, in either Shakespearean or Petrarchan/Italian form. Shakespearean sonnets are characterized by an “abab cdcd efef gg” rhyme scheme. Petrarchan or Italian sonnets will have an octave with the rhyme scheme “abba abba” followed by a sestet with no fixed rhyme scheme. To read more about the sonnet form, see:

http://www.sonnetwriters.com/definition-of-sonnet/,
http://www.english.illinois.edu/maps/sonnet.htm, and
http://en.wikipedia.org/wiki/Sonnet.

See the PoetiX 2017 Rules

Turing Test Competition Human-Computer Music Interaction

The Turing Test Competition in Human-Computer Music Interaction comprises several performance tasks in instrumental music and dance. Competitors are asked to create artificial performers capable of performing “duets” with human performers in real time. An artificial performer passes this Turing test if human judges cannot distinguish the Human-Computer music interaction from Human-Human interaction. The winners of each task category, instrumental music and dance, will be awarded $2000 and will be invited to perform live at the 2017 Conference in Computational Creativity.

Task descriptions

AccompaniX: Improvised Music Collaboration

This task consists of generating, from a classical score or jazz lead sheet, a causal accompaniment for a novel performance of a melody.

AlgoRhythm: Dance Animation

This task consists of generating a motion vector (or point light) synthesis of a dancer to accompany a given musical performance of a choice of Waltz or a Street Dance music.

Each task contains a human part (to be performed by a human) and a computer part (to be performed by the submitted artificial performer). We explain below in detail the classical music collaboration. The other tasks are analogous (in a manner that we indicate below).

See the Human-Computer Music Interaction 2017 Rules

Subscribe to the Creative Turing Tests Newsletter

Yes! I want to keep appraised of Turing Test developments. Add me to the Turing Tests competition email list: