I'm not sure if that is possible since a lot of constructible objects relies on those perks. If you don't like using your perk points for crafting, I recommend this mod. It allows you to configure how many perk points you gain per level so you can use the extra points to the crafting perks.
8 comments
https://www.nexusmods.com/fallout4/mods/3938