Found the source of the tapping sound. It seems like the HPFP is also pulsing the low-pressure side with pressure pulses. This is making quite the racket in the fuel tank. Yes the metal fuel pump cover and rear seat dampen the sound significantly, but it would seem that its resonating through the floor boards into the cabin.
The sound disappears at about 1000 RPM.