Controversy has swirled around the Patmos Library since patrons began protesting some books with LGBT themes written for young adults.