Continue Watching - bring them to playlist, not file

The "continue watching" feature doesn't bring them back to the playlist they were watching, just the individual file. So they can only go back to that one video and then have to figure out which playlist they were in if they want to resume and continue watching that playlist. It seems odd that a default playlist must be selected, but it doesn't bring them back to the last playlist they were watching.