• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

Emerging Scholars Blog

InterVarsity's Emerging Scholars Network

DONATE
  • Home
  • About Us
    • About Our Bloggers
    • Commenting Policy
  • Reading Lists
  • Scholar’s Compass
    • Scholar’s Compass Booklet
    • View Recent Posts
  • Connect
    • Membership
    • Events
    • Donate
    • Contact Us
You are here: Home / Science Corner / Science and Faith / Science Corner: Sing a New Song

Science Corner: Sing a New Song

May 6, 2020 by Andy Walsh No Comments

ukelele photo
My daughter has taken this time to teach herself to play the ukelele. (Photo by Josh Engroff )

Music has been helping us stay together even as we stay apart, from window serenades to video conference concerts. It is hard to imagine we will ever have a shortage of music making, not to mention the decades of existing music recordings. So we don’t need to train computers to make new music for us, but of course that hasn’t stopped us. We don’t do it so that they can replace us, we do it so we can better understand the music we make and what makes it appealing. And whether it is the intention or not, I think teaching our machines to make a joyful noise is just as worthy as making those sounds ourselves.

Computers can make music in a variety of ways. They can attempt original compositions, either by generating scores to be performed/synthesized or by combining loops and samples and bits of recordings. The newly launched OpenAI Jukebox is attempting something different, more akin to generating new recordings instead of composing new songs (worked best in Chrome for me, FYI). Rather than trying to specify notes or words, the software constructs soundwaves more directly, specifying moment to moment what frequencies should be heard. As a rough analogy, imagine reconstructing a digital image by specifying the color pixel by pixel, as opposed to assembling an image from objects like cats and baby Yodas.

The end result is a sort of AI version of Wheel of Musical Impressions, with reasonable simulacra of popular artists singing familiar songs as well as new–at least new to them. Consider the following sample:

OpenAI · Jazz, in the style of Frank Sinatra & Ella Fitzgerald – OpenAI Jukebox

That’s a duet of Frank Sinatra and Ella Fitzgerald, singing a song from from the recent Oscar-nonwinning film La La Land, written years after their deaths. Note that this is not exactly as straightforward as feeding the song lyrics into a speech synthesizer with samples of their voices. As a result, the recordings meander around the lyrics and occasionally veer out of the realm of existing English altogether. Thus we get examples like this rather surreal Rick Roll:

OpenAI · Pop, in the style of Rick Astley – OpenAI Jukebox

The software can use varying inputs to start from; the above starts with a few seconds of the original recording and then finishes the performance in its own idiosyncratic fashion. This is reminiscent of another OpenAI project, a text generator that made a splash a year ago. You can give it a starting sentence or two and it could generate a small document from that prompt, well beyond the predictive text in your phone that can guess a word or two. The result is sentences and paragraphs which are often eminently readable, although they still have a tendency to meander and at times even contradict themselves. There was a sense of a student trying to pad out a term paper; there may be no obvious problems or mistakes but you are left wondering if anything was actually said.

Some of the music here has a similar quality, especially when there are no lyrics to provide structure. The moment-to-moment listening experience is pleasant enough, but there’s not much of a sense of melodic development. Try this soundtrack in the style of Danny Elfman for example (clip not embeddable). If you know film music, you’ll likely recognize the Elfmanesque qualities it has identified and reproduced, but you probably won’t want to hire Jukebox for your next blockbluster.

One of the secondary outcomes is a clustering of existing songs and artists. Broad genre groupings are apparent, although probably more interesting are artists at the edges of genres and also subgenre clusters. For example, hip hop seems to have two distinct groups, and the classical composers tend to be closer to fellow members of the same era and/or movement. Even if you don’t want to list to the synthetic music, you might find it interesting to browse through these clusters.

One last sample for you, a take on contemporary Christian music. Maybe something to keep in mind if the church worship leaders need a break from streaming.

OpenAI · Contemporary Christian, in the style of Casting Crowns – OpenAI Jukebox

There are over 7,000 recordings to explore; take a listen and share any interesting finds in the comments!

About the author:

Andy Walsh
Posts

Andy has worn many hats in his life. He knows this is a dreadfully clichéd notion, but since it is also literally true he uses it anyway. Among his current metaphorical hats: husband of one wife, father of two teenagers, reader of science fiction and science fact, enthusiast of contemporary symphonic music, and chief science officer. Previous metaphorical hats include: comp bio postdoc, molecular biology grad student, InterVarsity chapter president (that one came with a literal hat), music store clerk, house painter, and mosquito trapper. Among his more unique literal hats: British bobby, captain's hats (of varying levels of authenticity) of several specific vessels, a deerstalker from 221B Baker St, and a railroad engineer's cap. His monthly Science in Review is drawn from his weekly Science Corner posts -- Wednesdays, 8am (Eastern) on the Emerging Scholars Network Blog. His book Faith across the Multiverse is available from Hendrickson.

  • Andy Walsh
    https://blog.emergingscholars.org/author/andy/
    I Found a Postdoc in the Sciences: Now What? (Pt 1)
  • Andy Walsh
    https://blog.emergingscholars.org/author/andy/
    I Found a Postdoc in the Sciences: Now What? (Pt 2)
  • Andy Walsh
    https://blog.emergingscholars.org/author/andy/
    Science Corner: Cat Chat
  • Andy Walsh
    https://blog.emergingscholars.org/author/andy/
    Science Corner: A Season of Rest

Share this:

  • Email
  • Print
  • Facebook
  • More
  • Twitter
  • Tumblr
  • LinkedIn
  • Reddit
  • Pinterest

Filed Under: Science and Faith Tagged With: artificial intelligence, music, science, science corner, worship

Reader Interactions

Leave a Reply Cancel reply

Primary Sidebar

Become a Member

Membership is Free. Sign up and receive our monthly newsletter and access ESN member benefits.

Join ESN Today

Scholar’s Compass Booklet

Scholar's Compass Booklet

Click here to get your copy

Top Posts

  • The Message of Genesis 1
  • "Agony"
  • Faith and Reason, Part 3: Aquinas
  • Faith and Reason, Part 2: Augustine
  • Christian Views of Creation

Facebook Posts

Facebook Posts

Footer

About Us

The Emerging Scholars Network (ESN) is a national network within InterVarsity’s Graduate & Faculty Ministries which supports those on the academic pathway as they work out how their academic vocation serves God and others. We encourage and equip undergraduates, graduate students, postdocs, and early career faculty as they navigate each stage of their academic vocation and transition to the next step in or beyond the academy.

Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy

Recent Posts

  • “Agony”
  • Forgiveness
  • Confession

Article Categories

Privacy Policy | Terms of Use | Contact Us
Member of the International Fellowship of Evangelical Students
Copyright © 2023 - InterVarsity Christian Fellowship/USA ®. All rights reserved.

InterVarsity, InterVarsity Christian Fellowship/USA, and the InterVarsity logo are trademarks of InterVarsity Christian Fellowship/USA and its affiliated companies.