I understand how you feel, but its hard for me to keep track of all the changes between versions and if people miss important files it creates support issues for me that can be difficult to solve since I don't know what people left out.
So my advice is keep it simple and always upload all the files, yes it can take some time but, its the only way to be sure you have all the needed changes. Now occasionally if I fix some small bug and make an incremental release I may say in the release announcement that you only need to upload some specific new files, but unless I say otherwise in the release announcement its always best to upload all the files.
Best,
Joe