According to the Cuneiform Digital Library Initiative, there are examples of cuneiform writing on alabaster, basalt, marble and other non-clay substrates.