You were just lucky with where the engine and the auxiliary drive shaft that operates the fuel pump lever happened to come to rest.
The bump on the aux. d/shaft is just a small eccentric, it's nowhere near as big as a lobe on a camshaft operating the engine valves.
The older twin-cams engines had the fuel pump held on by 2 studs with nuts, so sometimes the pump had to be wiggled to remove it off the studs - later engines, such as your's has bolts and nuts, so easier to remove/refit the pump. (Fiat started fitting bolts and nuts instead of studs and nuts on various units from c. the mid/late '70's e.g. the cam box housings to the cylinder head comes to mind).
Your picture does indeed show the insulating spacer still attached to the cylinder block - there's a gasket on each side of this spacer - if there is no sign of leakage at the gasket between the spacer and engine block, I'd be tempted to leave it alone and just fit a new gasket between the new pump and spacer (if you don't have a new gasket, you could re-use the original one if undamaged, maybe apply a slight amount of sealant to ensure no leaks).
As regards a tightening torque figure for the fuel pump mounting bolts, (just in case you were about to ask

) I've never seen one listed, but I'd estimate it as perhaps 12 - 15 lb.ft. (or ft/lbs).
Given that the pump has an alum. alloy flange, I'd just 'nip' it up by hand using a tiny fraction of my immense strength

, applied to a short wrench. This is an ability that most (properly trained) Mechanics develop over time i.e. how to tighten things correctly without using a torque wrench - it's a combination of 'feel', judgement and experience. I'd suggest screwing the bolts in by hand, tighten most of the way using a wrench and, for the final tightening, placing a box wrench (or ratchet + socket) on the bolt, hold the wrench in place using your thumb on the ring of the wrench (or the side of the ratchet head) and with your fingers on the beam of the wrench tighten the bolt by curling your fingers towards your palm, as if you were trying to make a fist.
Don't forget to carefully check the condition of the flexible fuel hoses, in fact, given your car has been off the road for some time, I'd recommend replacing them and get new hosing that is 'Ethanol resistant' (over here I use Gates (U.S.) fuel hose). Ditto the flexible hoses at the tank end of the hard lines.
The large filler neck hose that connects to the fuel tank is another area that could give trouble, best renew this also, if in any doubt as to it's condition and it's resistance to Ethanol containing fuel.