Here is a personal selection of books on history of mathematics, on popularisation of mathematics as well as fiction books with a mathematical flavour. Some of the books are in Dutch.
For a very extensive list of books related to mathematics see Mathematical Fiction of Alex Kasman.