It was all systems go – quality art, media buzz, more space, more work – but with a lower attendance and many big collector names absent, America’s premier art fair had a last hurrah undertow