If you believe a particular book is infallible, how do you justify not following it entirely?

The amount of information you need to understand the answer to this question does not allow for it to be explained on YH answers. If you truly desire to know, which I don't believe you do, you need to seek out a local minister and ask him.