Because I know the context, I know that it is being used metaphorically.
In this case, either the context would be different and would change my understanding of the phrase, or the person, knowing that the phrase had a primarily metaphorical meaning, would say 'I literally have a lot on my...