Proper fix, noted here for prosperity 
My /etc/sudoers was missing this line:
#includedir /etc/sudoers.d
Make sure there’s no space between # and includedir otherwise it will be treated like a comment.
Also ensure files in /etc/sudoers.d/ have the permissions 0440.