Ah, I see the issue you're referring to, Avathacis. The solution is simple enough: the buff should go away when you are hit or when you attack. Which is really what I was imagining in the first place, I just assumed that whatever counterattack you took after attacking would knock it off. Silly me -- will fix.
PC. My DoD file holds 4 .dats (achievements, collections, magicbox, and wkeys), 2 .txts (hiscores and last), 1 xml (config), 24 save folders, and 2 folders for mods (one I made and one for the steam workshop subscriptions).