A Modbus network should be wired in a twisted pair data cable with an overall screen.

A Belden 8762 is an example of such a cable.

As a general rule of thumb the thicker the cable the better, especially over a longer network run.

A cable such as CAT5 should never be used.