Now with esps (created with FO4Edit) that adds invisible glasses and hats one for each different effect. (as in there are 5 types of glasses that give PER+1, but it would be silly to add them all since they're invisible).
As with all esps, back up your save, and use it at your own risk.(One issue I found is that if you uninstall the mod without unequiping the item you will retain the stat effects, reinstalling the mod and removing the item works, but only if you didn't overwrite after uninstalling)
Don't forget to endorse it if you like it, it helps in making people aware of the mod.

How to get the items:
Open the console(using ~ ), type "help invis 4"
It will show you a list with the items and their respective ids.
add the item you want by typing "player.additem [id]"

Glasses added:
Black-rim glasses(CHR+1)
Eyeglasses(PER+1)
Liam's glasses(INT+2, CHR-1)
Road goggles(INT+1)

Hats added:
Airship captain's hat(CHR+1, END+1)
Baseball cap(PER+1)
Battered fedora(LCK+1)
Bowler Hat(END+1)
Formal hat(CHR+1)
Sea captain's hat(END+2)
Press cap(INT+1)

Also with standalone mods that makes the Faded Visor(PER+1), Eyeglasses(PER+1) or Black-rim Glasses(CHR+1) invisible.
This will make all such items hidden for that particular gender.
In 6 files for convenience.
Update: Added invisible Pompadour wig, it will make characters that wear it completely bald though.