After years of using graymilter (with a series of local hacks) I switched to milter-greylist.
After it run for a few days:
# Summary: 149173 records, 137182 greylisted, 11991 whitelisted, 0 tarpitted
and with only a few tweaks in its configuration:
racl whitelist domain google.com racl whitelist domain googlemail.com racl whitelist domain gmail.com racl whitelist domain yahoo.com racl whitelist domain hotmail.com racl whitelist domain live.com racl whitelist domain outlook.com racl whitelist domain amazon.com racl whitelist domain ebay.com #racl whitelist domain gr racl greylist default
You can apt-get install milter-greylist (which makes maintenance through OS upgrades manageble) and it has all the features that I would love to add in my series of hacks to graymilter but never got around to doing so.
(previous)