Well, if is a recurring thing with the elder I would probably write him a gentle note about it. If it is a one time thing, just let it go. I also lead Bible studies and it is easy to get derailed. Just ask yourself if this new topic or side topic will be edifying to those who listen or not.