@mfweof and @RokoMijic on naturalistic metaethics
Anything moral is only moral because it won, and it won for some reason other than being moral.
The past is not more ethical than the present. The past is (relative to current standards) less ethical, but so is the future!
The maintenance of present day human values are bound to present day technology in the same way thay the maintenance of medieval hierarchies was bound to the function of knights on the battlefield. Technology is not value neutral, so if you want to upgrade your technology without destroying your values you need to do some kind of alignment work. You need to constrain that technology so that it doesn’t do the thing it wants to do in the most efficient way possible: you need to make a gun that only knights can use.
See also: Robin Hanson, Most AI fear is Future Fear.