You have to remember you are in a vehicle that is over 40yrs old and as such the braking performance will never equal todays modern vehicles.
A disc brake conversion will undoutably improve performance but a well maintaned drum brake set up will be adequate if the vehicle is in standard trim. A conversion kit can cost up to £550, and dependant on the use you will put the vehicle to will no doubt influence your choice.
Before you comdem the drum brake set up ensure it is working as design, paying particular attention the drum diameter is within design sizes and surface condition is not "ribbed" and uneven, brake cylinder operation, brake shoe condition and check the adjusters are free to operate.
If you fit any new components wait till the brake shoes are fully bedded in and adjust them up accordingly.
When everything is in working order it is really no great problem to adjust up the shoes, and it's not like you have to adjust them every week, you could take the vehicle to a local MOT testing station and ask them to do a brake performance check for your reassurance. This will give you an idea of the braking efficency and maybe some piece of mind that things are as designed.