It's perfectly safe to consume, so the only concern is the flavor aspect. If your beer tastes good, then no problem. I easily get a tablespoon in a 3-gallon batch just from what's left in the fermenter/bottling bucket/keg/etc. during transfers.