That doesn't seem right, but I'm not sure it's broken.
My YD25 D40 does a similar thing, where it pulls the boost down a little after the initial surge, but it's more subtle than what you're seeing.
Are all your vacuum lines in good condition?
Maybe the actuator is dying?
If the diaphragm is only half buggered it might hold vacuum initially & then bleed out quickly?
(I'm assuming the VNT failsafe logic is designed to open the vanes...?
i.e. fail = no boost)
Yeah but boost seems to have been okay on my psi gauge until i replaced the hoses and bsc weird maybe the vacuum lines are a different diameter, i replayed them with 3mm hose but looked thicker than ones before