Hiroshige with AI Generated Music

Written By Derek Au

Music for Hiroshige woodblock prints generated by M2UGen, “a Music Understanding and Generation model that is capable of Music Question Answering and also Music Generation from texts, images, videos and audios, as well as Music Editing.”

Audio generated with demo, using the woodcut images with the prompt in the paper, "Generate a music for this scene." Settings: temperature = 0.6, top p = 0.8 (as in the paper)

Demo
Paper

Woodblock prints by Utagawa Hiroshige (Ando) courtesy Brooklyn Museum:

  1. Suruga-cho, No. 8 in One Hundred Famous Views of Edo

  2. Asuma Shrine and the Entwined Camphor, No. 31 in One Hundred Famous Views of Edo

  3. Temple Gardens, Nippori, No. 14 in One Hundred Famous Views of Edo

  4. Flower Pavilion, Dango Slope, Sendagi, No. 16 in One Hundred Famous Views of Edo

  5. New Fuji, Meguro, No. 24 in One Hundred Famous Views of Edo

  6. The Kawaguchi Ferry and Zenkoji Temple, No. 20 in One Hundred Famous Views of Edo

Derek Au https://derekau.net
Previous

Beyond eMuseum and Search Silos
Next

“Accessible Art Tags” GPT