Are you saying if you put Andy on a D team that he wouldn't hold the same value because they wouldn't pitch to him? You forget the value of him on the mound, not just in his pitches but his ability to mentally control a game too.
Are you saying that if you put Collins, Lewis, Wegmen, Cayton, Reyna, or any other elite player on a D team that they wouldn't instantly add to the defensive value of a team. Plus with a 2 home run limit at D every swing would be a rocket about three foot off the ground through the infield. The thing you forget about these ELITE players is that they are ELITE. If you put them at a level with stricter home run limits they would take the same amount of bp and work singularly on hitting the ball as hard as they can down instead of up. The end result is some poor person probably will be in the hospital.
There are multiple conference tournaments a year held on 300 foot fields with strict home run limits. I would be willing to bet that these ELITE PLAYERS hit less dbo's and keep it in the park when needed than an e, d, or c player.