An actual crayon would then be “un crayon de couleur” in French. Sounds exhausting to say, but also notably fancier.