I'd think a stick would burn through an exhaust pipe, being that they're usually pretty thin wall.
If the ID of the silencer slips over the pipe, maybe cut a couple slots 180 degrees from each other and clamp it there.
Welding a mounting tab on the silencer to bolt it to the chassis and keep it from rocking would help too, if feasible.
You also might consider a t-bolt clamp instead of a worm gear clamp, as you should be able to get a bit more squeeze.