There was actually at least one nuclear powered lighthouse that was modified as an experiment. I believe that instead of having a traditional nuclear reactor it used an RTG (Radiothermal Generator) device working off the decay of nuclear material. Such devices are pretty commonly used for satellites.
The Russians had nuclear powered unmanned lighthouses.