Results of the 2016 Creative Turing Tests have been posted here.
May 18th, 2016
Three different Creative Turing Tests competitions were held in 2016: DigiLit for short stories, PoetiX for sonnets, and AlgoRhythms for dance music DJ sets. All entries were in the form of computer code that generates novel works in one of these three creative modes.
2016 FINAL RESULTS, May 18th, 2016
AlgoRhythms Competition Results
Number of Completed Entries: 8
Prizes:
First Prize (joint): Jaume Parera and Pritish Chandna (Music Technology Group, Upf, Barcelona, Spain) - DJ Codo Nudo, 39% of audience voted set as "Human": $2000
First Prize (joint): CJ Carr and Zack Zukowski (Medford, MA, USA) - DadaBots - Jungle Bot, 38% of audience voted set as "Human": $2000
Second Prize:Gerard Roma (Surrey, UK), Dub Life, 28% of audience voted set as "Human": $1000
Two evaluation rounds:
- On-line listening poll: Human vs. Algorithm?
- Live SMS voting by 100+ audience members at DJ2RNGT3ST dance party
There were three Human DJs and three Algorithm Finalists - all hidden from view while audience danced and voted to 10 mins of music from each. We counted the votes: Human versus Algorithm. Winning the turing test would mean 50% or more votes for Human. One of the algorithms achieved this in the on-line vote. After the dance party, overall, two algorithms achieved about 40% Human votes, and they were highly sophisticated technical achievements, using cutting-edge methods in music information research (MIR), so they were given joint first place.
Examples:
Try it for yourself, take the on-line poll: On-line listening poll: Human vs. Algorithm?
DigiLit Competition Results
Number of completed entries: 3
First prize: no first prize awarded.
Second prize:Judy Malloy: second prize for her algorithm, which creates variations on a story called “Another Party in Woodside”, each constructed by randomly arranging pre-written sentences into paragraphs; $1000.
Judges:
- David Cope – Algorithmic music pioneer
- Lynn Neary - NPR Correspondent
- David Krakauer - President of The Santa Fe Institute
Evaluation Details:
Each judge received 11 short stories – 8 “human generated” and 3 “machine generated” (one from each of the two machines)
“Passing the Turing Test” – means a given algorithm (machine having a majority of the judges rating its entries as “human”
Results: No machine won, but one submission generated by Toksu and Ibrahim on the seed “thesaurus” “fooled” one of the judges!
PoetiX Competition Results
Number of completed entries: 2
Prizes:
First Prize: Marjan Ghazvini Nejad, Xing shi, Yejin Choi, and Kevin Knight (USC/ISI, USA) extraordinary programming effort that is a marriage of multiple AI techniques: $3000. See an example poem...
Second Prize: Andrea Gagliano, Emily Paul, Kyle Booten, and Marti Hearst. (UC Berkeley, USA) "Pythonic Poet": $1000
Judges:
- Luke Menand – Pulitzer Prize-winning author and New Yorker contributor
- Robert Siegel - NPR Correspondent
- Ray Monk - Award-winning biographer and philosopher
Evaluation Details:
Each judge received 10 sonnets – 6 “human generated” and 4 “machine generated” (two from each of the two machines)
"Passing the Turing Test” – means a given algorithm (machine having a majority of the judges rating its entries as “human”
Results: All judges had perfect scores – so all machines were identified.
Turing Tests Competitions Details
Competition Deadline: April 15, 2016.
Registration for the competition is now closed. If you already have an upload link, please submit your entry ASAP.
Master of Ceremonies for Awards on May 18th
Joe Palca (NPR: Correspondent, Science Desk)
Competition Judges
David Cope (Composer, Algorithmic Music Pioneer, UCSC Music Professor)
David Krakauer (President, the Santa Fe Institute)
Louis Menand (Pulitzer Prize winning author and Professor at Harvard University)
Ray Monk (Author, Biographer, Professor of Philosophy)
Lynn Neary (NPR: Correspondent, Arts Desk and Guest Host)
Robert Siegel (NPR: Senior Host, All Things Considered)
Register and Submit an Entry
Register and Submit your entry here. Registration is due by April 15th, 2016, an upload link will be sent to you upon registering your entry.
Registration is now closed. We will announce the winners on Wednesday, May 18th, at the Dartmouth Digital Arts Expo (DAX) which will be held in the Hood Museum of Art.
Partners
Joe's Big Idea (Special Series, NPR with Joe Palca)