We've 2 kids, 8 and 5 - both total book worms (and into Minecraft and biking and dude perfect and all sorts... But they love books). Find stuff you'll enjoy reading to them. And read to them a lot. You've got the right idea. MO Williams books are great for that age. The elephant and piggie books are fun, Annette's Baguette is brilliant. The Brambly Hedge books are lovely. Dr Seuss is mostly quite fun. Peter's railway (if they like trains or engineering at all), the Thomas the Tank engine books, the topsy and Tim books are ok... But get lots of books from the library, charity / thrift stores. Get lots of books to try out, and have available for them to read. And if they aren't interested, you can always thrift them again. Hanging out at the local library can be good. No time pressure, just let them browse and look at whatever random things they want. For slightly older kids, we've really enjoyed reading Hillary McKay, Terry Pratchett's kids books / short stories, Vivian French's books are great. and some of the classics are great too - EE Milne, the Paddington books...
Also recommended in this reply