It is possible but not trivial to implement. Currently the lightbox is just loading the images directly so there is not a way to add extra markup. It would require creating and using a dialog page to show the images and then extra markup could be added to the dialog.
I will add a wish list item for this in my project tracker but can't promise when this will be implemented.
Best,
Joe