$\\\$ <- Three slashes between $'s $\\$ <- Three slashes between dollar signs
This will be escaped* in new (or edited) posts. This is not yet reflected in the preview pane. This is also a per-site setting, this behavior does not exist on sites without client-side LaTeX rendering enabled.
*Technically, it just bypasses markdown conversion entirely.