That was before Democrats decided to let People of Color in their Big Tent and Republicans in response decided to eject them. That started under FDR when he integrated the army and culminated with LBJ's Civil Rights laws. It didn't happen overnight: That took about 25 years. So "conservative Democrat" or not was not so important as that flip. In Lincoln's time, I would have been a proud Republican!