The standard libertarian formula is to grant freedom to people as long as they don’t use it to hurt others. It is a reasonable and humane approach to both ethics and politics.
But reactionaries want to be free to oppress others. That is the freedom they cherish the most; they deeply resent any efforts to restrict it.
Marx turned Hegel on his head. Reactionaries turn Mill on his head.