Many people think that national lottery funding for elite athletes takes money away from grassroots sports facilities.