In Japan, though Samurai has a strict and simple life, there is only one thing for them to pay much money.
It is a sword or Katana.
Katana is the soul for Samurai.
Similarly, books are the soul for intellectual persons.
So Mr. Watanabe thinks he would pay much money for books.