Working muscle ships lactate as a fuel other tissues can oxidize. The burn is not lactate acting as a toxin.
The mid-afternoon slump is circadian and post-meal, with mitochondria supplying ATP at the pace the cell allows.