The Federal Reserve is sailing into the unknown as it starts to unload its bondholdings as a key part of tightening policy over the next few months.