[Core] RFC 3264 says once we assign a payload number to a dynamic codec, we are stuck with it.
8.3.1 Modifying Address, Port or Transport
The port number for a stream MAY be changed. To do this, the offerer
creates a new media description, with the port number in the m line
different from the corresponding stream in the previous SDP. If only
the port number is to be changed, the rest of the media stream
description SHOULD remain unchanged. The offerer MUST be prepared to
receive media on both the old and new ports as soon as the offer is
sent. The offerer SHOULD NOT cease listening for media on the old
port until the answer is received and media arrives on the new port.
Doing so could result in loss of media during the transition.
Co-authored-by: Anthony Minessale <anthm@signalwire.com>