Assign Product > Attributes to Specific Categories

If possible, we would like the have the option of assigning Product > Attributes to specific categories. 

For example: currently we have Product Attributes for 'Brand' and 'Manufacturer' - they both contain very similar options, but 'Manufacturer' is customer friendly for Fabric pages versus Brand on a sewing machine page. 

Thank you!